3D light splitting mechanism and 3D shooting method

Abstract

The present application provides a 3D light splitting mechanism and a 3D shooting method, which can realize the 3D effect of displaying the picture shot by a 2D camera. The 3D light splitting mechanism includes: a first reflection structure and a second reflection structure; the first reflection structure includes a first lens, the angle between the first lens and the optical axis of the 2D camera is a first preset value, the straight-line distance between the center of the first lens and the center of the 2D camera is a second preset value, and the second preset value is set to meet the requirement that the framing area of ​​the 2D camera is blocked by the first lens; the second reflection structure includes a second lens and a third lens, and the angle formed between the second lens and the third lens is a third preset value; the second reflection structure is arranged opposite to and offset from the first reflection structure, and the distance between the center of the connecting line between the second lens and the third lens and the center of the first lens is a fourth preset value, and the fourth preset value is set to meet the requirement that the framing area of ​​the 2D camera is divided into two uniform pictures by the connecting line between the second lens and the third lens.

Description

[Technical field]

[0001] The present application belongs to the field of naked-eye 3D, and in particular relates to a 3D light splitting mechanism and a 3D shooting method. [Background technology]

[0002] Naked-eye 3D, short for Autostereoscopy, is a general term for technologies that achieve stereoscopic visual effects without the aid of external tools such as polarized glasses.

[0003] The current 3D videos or images are shot by distinguishing the left and right eyes, with a visual difference of about 65mm. By letting your left eye see the left eye image and your right eye see the right eye image, your brain can synthesize a three-dimensional picture with a sense of depth. Currently, the 3D effect is mainly achieved through light barrier technology and cylindrical lens technology. However, there is currently no equipment that can directly graft on a 2D camera to achieve 3D display effects. [Summary of the invention]

[0004] The purpose of the present application is to provide a 3D light splitting mechanism and a 3D shooting method, which can realize the 3D effect of displaying the picture taken by a 2D camera.

[0005] A first aspect of an embodiment of the present application provides a 3D light splitting mechanism, the 3D light splitting mechanism comprising:

[0006] a first reflecting structure and a second reflecting structure;

[0007] The first reflective structure includes a first lens, the first lens is arranged in the shooting direction of the 2D camera, and the angle between the first lens and the optical axis of the 2D camera is a first preset value, the straight-line distance between the center of the first lens and the center of the 2D camera is a second preset value, and the second preset value is set to meet the requirement that the framing area of ​​the 2D camera is blocked by the first lens, and the 2D camera is associated with the 3D light splitting mechanism;

[0008] The second reflective structure includes a second lens and a third lens, the second lens and the third lens are arranged at an angle, and the angle between the second lens and the third lens is a third preset value;

[0009] The second reflective structure is arranged opposite to and staggered with the first reflective structure, and the distance between the center of the connecting line between the second lens and the third lens and the center of the first lens is a fourth preset value. The setting of the fourth preset value satisfies that the framing area of ​​the 2D camera is reflected to the second reflective structure through the first reflective structure, and the picture taken by the 2D camera is divided into two even pictures by the connecting line between the second lens and the third lens.

[0010] In a possible design, the 3D light splitting mechanism further includes:

[0011] Fixtures and enclosures;

[0012] The fixing device is used to fix the 3D light splitting mechanism to a camera device, and the camera device is associated with the 2D camera;

[0013] The housing is wrapped around the first reflective structure and the second reflective structure, and includes a base, the base is detachably connected to the fixing device, and the base is used to place the first reflective structure and the second reflective structure;

[0014] The housing is provided with a first adjusting device and a second adjusting device, the first adjusting device is used to adjust the relative position of the 3D light splitting mechanism and the 2D camera, and the second adjusting device is used to adjust the relative position of the first reflecting structure and the second reflecting structure.

[0015] In one possible design, the fixing device includes:

[0016] A clamping portion, wherein the clamping portion is used to clamp the 3D light splitting mechanism to the camera device.

[0017] In a possible design, the 3D light splitting mechanism further includes:

[0018] The third adjusting device is used to adjust the angle between the second lens and the third lens of the second reflective structure.

[0019] A second aspect of the present application provides a 3D shooting method, applied to the 3D light splitting mechanism according to claim 1 or 2, comprising:

[0020] Adjusting the relative position of the 3D light splitting mechanism and the 2D camera so that the connection line between the second lens and the third lens is located on the vertical center line of the picture taken by the 2D camera, the second lens and the third lens are included in the 3D light splitting mechanism, and the second lens and the third lens are arranged at an angle;

[0021] Splitting the shooting picture corresponding to the 2D camera into a left picture and a right picture based on a connection line between the second lens and the third lens;

[0022] The left picture and the right picture are matched and calibrated and then output.

[0023] In a possible design, the matching and calibrating the left picture and the right picture and then outputting the matched picture and the right picture comprises:

[0024] Performing a corner point matching operation on the left picture and the right picture to obtain a rotation angle between the left picture and the right picture;

[0025] Rotate the left picture and the right picture according to the rotation angle;

[0026] Determining a target depth of field of the captured image of the 2D camera according to a target parallax, wherein the target parallax is a difference between the coordinates of a target focus point scene on the left image and the coordinates of a target focus point scene on the right image, and the target focus point scene is a scene at the center of the rotated left image and a scene at the center of the rotated right image;

[0027] cropping the rotated left image and the rotated right image according to the target depth of field;

[0028] Output the cropped image.

[0029] In a possible design, performing a corner point matching operation on the left picture and the right picture to obtain a rotation angle of the left picture and the right picture includes:

[0030] Extracting a first corner point set corresponding to the left picture and a second corner point set corresponding to the right picture;

[0031] Determine a first descriptor for each corner point in the first set of corner points and a second descriptor for each corner point in the second set of corner points;

[0032] Determining a correspondence between the left picture and the right picture according to a first descriptor of each corner point in the first corner point set and a second descriptor of each corner point in the second corner point set;

[0033] Determine the successfully matched corner points in the left picture and the right picture according to the corresponding relationship;

[0034] The rotation angles of the left picture and the right picture are calculated according to the successfully matched corner points.

[0035] In a possible design, the cropping of the rotated left picture and the rotated right picture according to the target depth of field includes:

[0036] Determining the target focus scene corresponding to the rotated left picture and the right picture;

[0037] The rotated left image and the right image are cropped according to a preset length and width with the target focused scene as the center.

[0038] In one possible design, the method further includes:

[0039] A target mapping relationship is calibrated, where the target mapping relationship is a mapping relationship between the parallax and the depth of field after the left image and the right image are rotated.

[0040] In one possible design, the method further includes:

[0041] Receive operation instructions;

[0042] In response to the operation instruction, the relative position between the 3D light splitting mechanism and the 2D camera is adjusted according to the operation instruction, so that the first reflection structure and the second reflection structure in the 3D light splitting mechanism cover the framing area corresponding to the 2D camera.

[0043] A third aspect of an embodiment of the present application provides a computer device, which includes at least one connected processor, memory and transceiver, wherein the memory is used to store program code, and the processor is used to call the program code in the memory to execute the steps of the 3D shooting method described in the second aspect above.

[0044] A fourth aspect of an embodiment of the present application provides a computer storage medium, which includes instructions, and when the instructions are executed on a computer, the computer executes the steps of the 3D shooting method described in the second aspect.

[0045] Compared with the related art, in the embodiment provided by the present application, the 3D splitting mechanism can make the framing area of ​​the 2D camera reflected to the second reflective structure through the first reflective structure and the second reflective structure, and the picture taken by the 2D camera is divided into two uniform pictures by the second lens and the third lens, so as to realize the picture taken by the ordinary 2D camera being divided into uniform left and right pictures, and the left and right pictures are calibrated and matched and then output, so as to realize the 3D effect of displaying the picture taken by the 2D camera.

Brief Description of the Drawings

[0046] Figure 1 A schematic diagram of an embodiment of a 3D light splitting mechanism provided in an embodiment of the present application;

[0047] Figure 2 A schematic diagram of an embodiment of a fixing device of a 3D light splitting structure provided in an embodiment of the present application as a clamping portion;

[0048] Figure 3 A schematic diagram of an embodiment of a 3D shooting method provided in an embodiment of the present application;

[0049] Figure 4 A schematic diagram of the structure of a second reflective structure provided in an embodiment of the present application;

[0050] Figure 5 A schematic diagram of another embodiment of the 3D shooting method provided in an embodiment of the present application;

[0051] Figure 6 A schematic diagram of another embodiment of the 3D shooting method provided in an embodiment of the present application. [Specific implementation method]

[0052] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments.

[0053] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0054] In the description of the present invention, it should be noted that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance.

[0055] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances. In addition, in the description of the present invention, unless otherwise specified, "plurality" means two or more.

[0056] See also Figure 1 , Figure 1 A schematic diagram of a 3D light splitting mechanism 100 provided in an embodiment of the present application includes:

[0057] A first reflective structure 101 and a second reflective structure 102;

[0058] The first reflective structure 101 includes a first lens, which is disposed in the shooting direction of the 2D camera 103, and the angle between the first lens and the optical axis of the 2D camera 103 is a first preset value. Figure 1 α in (the angle can be set to 45°, and of course it can also be set according to the actual situation);

[0059] The straight-line distance between the center of the first lens and the center of the 2D camera 103 is a second preset value, and the second preset value needs to be set to meet the requirement that the framing area of ​​the 2D camera is blocked by the first lens. The 2D camera 103 is associated with the 3D light splitting mechanism 100. For example, the 2D camera is a camera on a terminal device, and the 3D light splitting mechanism 100 is an external device clamped or hung on the terminal device to achieve a 3D display effect.

[0060] The second reflective structure 102 includes a second lens 102A and a third lens 102B, wherein the second lens 102A and the third lens 102B are arranged at an angle, and the angle between the second lens 102A and the third lens 102B is a third preset value, and the angle formed between the second lens 102A and the third lens 102B is adjusted according to actual conditions. Figure 1 In the description, the angle formed between the second lens 102A and the third lens 102B is 90 degrees, but it can also be set according to actual conditions, and is not specifically limited;

[0061] The second reflective structure 102 is arranged opposite to and staggered with the first reflective structure 101, and the distance between the center of the connecting line between the second lens 102A and the third lens 102B and the center of the first lens is a fourth preset value, and the setting of the fourth preset value needs to satisfy that the framing area of ​​the 2D camera is reflected to the second reflective structure 102 through the first reflective structure 101, and the picture taken by the 2D camera 103 is divided into two uniform pictures by the second lens 102A and the third lens 102B. The uniformity here refers to dividing the shooting picture corresponding to the 2D camera into two pictures of the same area, which refers to the division in the vertical direction.

[0062] In one embodiment, the 3D light splitting mechanism further includes:

[0063] Fixtures and enclosures;

[0064] The fixing device is used to fix the 3D light splitting mechanism to the camera device, and the camera device has an associated relationship with the 2D camera 103. For example, the 2D camera is a built-in 2D camera on the terminal device, and the fixing device fixes the 3D light splitting mechanism on the 2D camera 103 of the terminal device;

[0065] The shell is wrapped around the periphery of the first reflective structure 101 and the second reflective structure 102, and the shell further includes a base, and the base is detachably connected to the fixing device. The specific structures of the fixing device and the shell are not specifically limited here, as long as the fixing device can fix the 3D light splitting mechanism 100 to the camera device, as long as the shell can be wrapped around the periphery of the first reflective structure 101 and the second reflective structure 102, it can protect the first reflective structure 101 and the second reflective structure 102;

[0066] The housing further includes a base, which is detachably connected to the fixing device and is used to place the first reflecting structure 101 and the second reflecting structure 102, and the first reflecting structure 101 and the second reflecting structure 102 can move left and right and up and down on the base;

[0067] The housing is provided with a first adjusting device and a second adjusting device, the first adjusting device is used to adjust the relative position of the 3D light splitting mechanism 100 and the 2D camera 103, and the second adjusting device is used to adjust the relative position of the first reflective structure and the second reflective structure.

[0068] The fixing device also includes a clamping portion, which is used to clamp the 3D light splitting mechanism 100 to the camera device. Figure 2 As shown, Figure 2 The fixing device provided in the embodiment of the present application is a schematic diagram of an embodiment of a clamping part, which clamps the 3D light splitting mechanism to the 2D camera of the camera device. Figure 2 The structure of the clamping portion is only an example and does not represent a limitation on the structure of the clamping portion; in addition, the clamping portion can also be clamped at other positions of the camera device, as long as the 3D splitting mechanism can be fixed to the camera device, and the viewing area of ​​the 2D camera is blocked by the first reflective structure 101 in the 3D splitting mechanism, and the captured picture is divided into two even pictures by the second lens 102A and the third lens 102B included in the second reflective structure of the 3D splitting mechanism. For example, if the camera device is a terminal device, the clamping portion can also be clamped in the middle of the terminal device.

[0069] In one embodiment, the 3D light splitting mechanism further includes: a third adjusting device, the third adjusting device is used to adjust the angle between the second lens 102A and the third lens 102B included in the second reflective structure 102. Since the 3D light splitting mechanism is an external device, it is necessary to adjust the angle formed between the second lens 102A and the third lens 102B in the second reflective structure 102 for different camera devices. Therefore, the 3D light splitting mechanism 100 is also provided with a third adjusting device, which can adjust the angle between the second lens 102A and the third lens 102B. The position and specific structure of the third adjusting device on the 3D light splitting mechanism 100 are not specifically limited here, as long as it can be connected with the second lens 102A and the third lens 102B to adjust the angle interface between the second lens 102A and the third lens 102B.

[0070] In summary, it can be seen that in the embodiments provided in the present application, the 3D splitting mechanism can, through the first reflection structure and the second reflection structure, enable the framing area of ​​the 2D camera to be reflected to the second reflection structure through the first reflection structure, and the picture taken by the 2D camera is divided into two uniform pictures by the second lens and the third lens, so as to realize dividing the picture taken by the ordinary 2D camera into uniform left and right pictures, and outputting the left and right pictures after calibrating and matching, so as to realize the 3D effect of displaying the picture taken by the 2D camera.

[0071] See also Figure 3 , Figure 3 A 3D shooting method is provided in an embodiment of the present application. The 3D shooting method is applied to the above Figure 1 as well as Figure 2 The 3D spectroscopic mechanism includes:

[0072] 301. Adjust the relative position of the 3D light splitting mechanism and the 2D camera so that the connection line between the second lens and the third lens is located on the vertical center line of the picture taken by the 2D camera.

[0073] In this embodiment, when the 2D camera is shooting, the straight-line distance between the second reflective structure and the first reflective structure in the 3D splitting mechanism arranged on the 2D camera can be adjusted so that the connection line between the second lens and the third lens is located on the vertical center line of the picture taken by the 2D camera. The second lens and the third lens are arranged at an angle, and the angle value of the angle formed between the second lens and the third lens can be adjusted by the third adjustment device in the above embodiment, so that the connection line between the adjusted second lens and the third lens is located on the vertical center line of the picture taken by the 2D camera.

[0074] Regarding adjusting the angle value formed between the second lens and the third lens included in the second reflective structure, the following is combined with Figure 4 To explain, Figure 4 As shown, Figure 4 The schematic diagram of the structure of the second reflective structure provided in the embodiment of the present application includes a second lens 401 and a third lens 402. When performing 3D shooting, the angle value between the second lens 401 and the third lens 402 can be adjusted (e.g. Figure 4 ), so that the connecting line 403 between the second lens 401 and the third lens 402 is located on the vertical center line of the shooting picture corresponding to the 2D camera.

[0075] In one embodiment, the 3D light splitting mechanism can also receive the user's operation instruction, and adjust the relative position between the 3D light splitting mechanism and the 2D camera according to the user's operation instruction, so that the first reflection structure and the second reflection structure in the 3D light splitting mechanism cover the framing area corresponding to the 2D camera, that is, the angle and the straight-line distance between the first reflection structure and the optical axis of the 2D camera can be adjusted according to the user's operation instruction, or the straight-line distance or the offset distance between the second reflection structure and the first reflection structure can be adjusted, such as Figure 1 As shown, the second reflective structure can be moved in direction A to adjust the misalignment distance between the second reflective structure and the first reflective structure, or the straight-line distance between the first reflective structure and the second reflective structure and the 2D camera can be adjusted simultaneously to move them in direction A. Similarly, the angle value between the second lens and the third lens included in the second reflective structure can also be adjusted according to the user's operation instruction, such as Figure 4 That is, when adjusting the relative position relationship between the first reflective structure and the second reflective structure, it can be adjusted automatically or manually by the user, and there is no specific limitation.

[0076] 302. Split a shooting picture corresponding to the 2D camera into a left picture and a right picture based on a connection line between the second lens and the third lens.

[0077] In this embodiment, the shooting picture corresponding to the 2D camera is divided into a left picture and a right picture based on the connection line between the second lens and the third lens. Figure 4 and Figure 5 , picture 501 is the shooting picture corresponding to the 2D camera, 502 is the connection line between the second lens 401 and the third lens 402 in the second reflective structure, and here, the shooting picture 501 corresponding to the 2D camera can be divided into a left picture 503 and a right picture 504 based on the connection line 501 between the second lens 401 and the third lens 402. The specific division method is not limited here, as long as the shooting picture corresponding to the 2D camera can be divided into a left picture and a right picture based on the connection line 501.

[0078] 303. The left image and the right image are matched and calibrated and then outputted.

[0079] In this embodiment, a corner point matching operation may be first performed on the left image and the right image to obtain a rotation angle between the left image and the right image. The following is a detailed description of the calculation method of the rotation angle:

[0080] Extract the first set of corner points corresponding to the left picture and the second set of corner points corresponding to the right picture; determine the first descriptor of each corner point in the first set of corner points and the second descriptor of each corner point in the second set of corner points; determine the correspondence between the left picture and the right picture according to the first descriptor of each corner point in the first set of corner points and the second descriptor of each corner point in the second set of corner points; determine the successfully matched corner points in the left picture and the right picture according to the correspondence (that is, extract the successfully matched corner points in the left picture and the right picture, and remove the unsuccessfully matched corner points in the left picture and the right picture), and calculate the rotation angle of the left picture and the right picture according to the successfully matched corner points. Figure 6 As shown, 601 is the left picture, 602 is the right picture, 603 is the successfully matched corner point in the left picture 601, and 604 is the successfully matched corner point in the right picture 602. The successfully matched corner points 604 in the left picture 601 (here, two successfully matched angles in the left and right pictures are used as an example for explanation, of course, there can also be multiple, and the specific number is not limited) are connected to obtain line 605, and the corner points 605 corresponding to the corner points 604 in the right picture 602 are connected to obtain line 606, and then a first angle 608 between the line 605 and the horizontal line 607 and a second angle 609 between the line 606 and the horizontal line 607 can be obtained, wherein the difference between the first angle 608 and the second angle 609 is the rotation angle.

[0081] Then the left and right images are rotated according to the rotation angle, that is, the left image is rotated toward the right image according to the rotation angle, and the right image is rotated toward the left image according to the rotation angle. Figure 5 As shown, with the connection line 502 as a reference, the left picture 503 is rotated toward the right picture 504, and the rotation angle is the calculated rotation angle; with the connection line 502 as a reference, the right picture 504 is rotated toward the left picture 503, and the rotation angle is the calculated rotation angle;

[0082] Afterwards, the target depth of field of the captured image of the 2D camera is determined according to the target parallax, the target parallax being the difference between the coordinates of the target focus point scene on the left image and the coordinates on the right image, the target focus point scene being the scene at the center of the rotated left image and the scene at the center of the rotated right image, such as Figure 5The "+"-shaped scene in the left picture 503 and the right picture 504; when determining the target depth of field, it can be determined according to a pre-calibrated target mapping relationship, which is a mapping relationship between the parallax and the depth of field after the left picture and the right picture are rotated;

[0083] Afterwards, the rotated left image and the rotated right image are cropped according to the target depth of field. Specifically, the corner points of the target focused scene corresponding to the rotated left image and the right image can be determined, and the rotated left image and the rotated right image are cropped according to the preset length and width with the target focused scene as the center, and the cropped left image and the cropped right image are output.

[0084] In summary, it can be seen that in the embodiment provided by the present application, the 3D splitting mechanism is arranged on the 2D camera, and through the first reflection structure and the second reflection structure on the 3D splitting mechanism, the framing area of ​​the 2D camera can be reflected to the second reflection structure through the first reflection structure, and the picture taken by the 2D camera is divided into two uniform pictures by the second lens and the third lens, so as to realize the division of the picture taken by the ordinary 2D camera into uniform left and right pictures, and the picture taken by the 2D camera can be displayed with a 3D effect.

[0085] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A 3D light splitting mechanism, characterized in that: The 3D light splitting mechanism comprises: a first reflecting structure and a second reflecting structure; The first reflective structure includes a first lens, the first lens is arranged in the shooting direction of the 2D camera, and the angle between the first lens and the optical axis of the 2D camera is a first preset value, the straight-line distance between the center of the first lens and the center of the 2D camera is a second preset value, and the second preset value is set to meet the requirement that the framing area of ​​the 2D camera is blocked by the first lens, and the 2D camera is associated with the 3D light splitting mechanism; The second reflective structure includes a second lens and a third lens, the second lens and the third lens are arranged at an angle, and the angle between the second lens and the third lens is a third preset value; The second reflective structure is arranged opposite to and staggered with the first reflective structure, and the distance between the center of the connecting line between the second lens and the third lens and the center of the first lens is a fourth preset value. The setting of the fourth preset value satisfies that the viewing area of ​​the 2D camera is reflected to the second reflective structure through the first reflective structure, and the picture taken by the 2D camera is vertically divided into two even pictures by the connecting line between the second lens and the third lens.

2. The 3D light splitting mechanism according to claim 1, characterized in that: The 3D light splitting mechanism further includes: Fixtures and enclosures; The fixing device is used to fix the 3D light splitting mechanism to a camera device, and the camera device is associated with the 2D camera; The housing is wrapped around the first reflective structure and the second reflective structure, and includes a base, the base is detachably connected to the fixing device, and the base is used to place the first reflective structure and the second reflective structure; The housing is provided with a first adjusting device and a second adjusting device, the first adjusting device is used to adjust the relative position of the 3D light splitting mechanism and the 2D camera, and the second adjusting device is used to adjust the relative position of the first reflecting structure and the second reflecting structure.

3. The 3D light splitting mechanism according to claim 2, characterized in that: The fixing device comprises: A clamping portion, wherein the clamping portion is used to clamp the 3D light splitting mechanism to the camera device.

4. The 3D light splitting mechanism according to any one of claims 1 to 3, characterized in that: The 3D light splitting mechanism further includes: The third adjusting device is used to adjust the angle between the second lens and the third lens of the second reflective structure.

5. A 3D shooting method, applied to the 3D light splitting mechanism according to claim 1 or 2, characterized in that: include: Adjusting the relative position of the 3D light splitting mechanism and the 2D camera so that the connection line between the second lens and the third lens is located on the vertical center line of the picture taken by the 2D camera, the second lens and the third lens are included in the 3D light splitting mechanism, and the second lens and the third lens are arranged at an angle; Splitting the shooting picture corresponding to the 2D camera into a left picture and a right picture based on a connection line between the second lens and the third lens; The left picture and the right picture are matched and calibrated and then output.

6. The method according to claim 5, characterized in that The matching and calibrating the left picture and the right picture and then outputting them comprises: Performing a corner point matching operation on the left picture and the right picture to obtain a rotation angle between the left picture and the right picture; Rotate the left picture and the right picture according to the rotation angle; Determining a target depth of field of the captured image of the 2D camera according to a target parallax, wherein the target parallax is a difference between the coordinates of a target focus point scene on the left image and the coordinates of a target focus point scene on the right image, and the target focus point scene is a scene at the center of the rotated left image and a scene at the center of the rotated right image; cropping the rotated left image and the rotated right image according to the target depth of field; Output the cropped image.

7. The method according to claim 6, characterized in that The performing a corner point matching operation on the left picture and the right picture to obtain a rotation angle of the left picture and the right picture includes: Extracting a first corner point set corresponding to the left picture and a second corner point set corresponding to the right picture; Determine a first descriptor for each corner point in the first set of corner points and a second descriptor for each corner point in the second set of corner points; Determining a correspondence between the left picture and the right picture according to a first descriptor of each corner point in the first corner point set and a second descriptor of each corner point in the second corner point set; Determine the successfully matched corner points in the left picture and the right picture according to the corresponding relationship; The rotation angles of the left picture and the right picture are calculated according to the successfully matched corner points.

8. The method according to claim 6, characterized in that The cropping of the rotated left picture and the rotated right picture according to the target depth of field comprises: Determining the target focus scene corresponding to the rotated left picture and the right picture; The rotated left image and the right image are cropped according to a preset length and width with the target focused scene as the center.

9. The method according to claim 6, characterized in that The method further comprises: A target mapping relationship is calibrated, where the target mapping relationship is a mapping relationship between the parallax and the depth of field after the left image and the right image are rotated.

10. The method according to any one of claims 5 to 9, characterized in that The method further comprises: Receive operation instructions; In response to the operation instruction, the relative position between the 3D light splitting mechanism and the 2D camera is adjusted according to the operation instruction, so that the first reflection structure and the second reflection structure in the 3D light splitting mechanism cover the framing area corresponding to the 2D camera.

Images