Camera module, electronic equipment, shooting method and device

Abstract

The invention discloses a camera module, electronic equipment and a shooting method and device, and belongs to the technical field of photography. The camera module comprises a first lens; a second lens; a first reflection part of the prism assembly is arranged corresponding to the first lens, and a second reflection part of the prism assembly is arranged corresponding to the second lens; the image sensor is arranged between the first lens and the second lens, and the first lens, the second lens and the image sensor are located on the same side of the prism assembly; wherein the view field range corresponding to the first lens partially coincides with the view field range corresponding to the second lens, and light enters the prism assembly after passing through at least one of the first lens and the second lens and is imaged on the image sensor after being reflected in the prism assembly.

Description

Technical Field

[0001] The present application belongs to the field of photographic technology, and specifically relates to a camera module, electronic equipment, and a shooting method and device. Background Art

[0002] At present, photography function has become a standard feature of smartphones. With the launch of various head-mounted display devices on the market, 3D (3-Dimensional) imaging has gradually become a highlight of shooting with handheld mobile terminals such as mobile phones.

[0003] In the related technology, 3D imaging can be achieved by shooting with two mobile phones at different spatial angles and then processed by post-processing software. At this time, the relative positions of the two mobile phones need to be kept fixed, and additional fixing devices, such as brackets, are often required to assist in the realization. The shooting is inconvenient, and there are few video synthesis software that can be adapted.

[0004] In a single mobile phone, multiple cameras need to work together to achieve 3D imaging. For example, the main camera, i.e., the wide-angle camera, works with the ultra-wide-angle camera to shoot, and part of the effective imaging area of ​​the ultra-wide-angle camera is cropped to make it the same as the FOV (Field of View) of the main camera, and then the 3D image is synthesized through an algorithm. At this time, on the one hand, it is necessary to set up multiple cameras to work together, and the cameras take up more space; on the other hand, the 3D imaging effect will be poor due to the inconsistent depth of field of the wide-angle camera and the ultra-wide-angle camera. The ultra-wide-angle picture needs to be cropped to be consistent with the wide-angle picture, which will lead to a decrease in resolution, and the two cameras often use different image sensors, which will cause color inconsistencies and affect the 3D imaging effect. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a camera module, an electronic device, a shooting method and an apparatus, which can reduce the space occupied by the camera used for 3D imaging, improve the 3D imaging effect, and meet the high-quality 3D shooting needs in a smaller space.

[0006] In a first aspect, an embodiment of the present application provides a camera module, comprising: a first lens; a second lens; a prism assembly, wherein the first reflecting portion of the prism assembly is arranged corresponding to the first lens, and the second reflecting portion of the prism assembly is arranged corresponding to the second lens; an image sensor is arranged between the first lens and the second lens, and the first lens, the second lens and the image sensor are located on the same side of the prism assembly; wherein the field of view corresponding to the first lens partially overlaps with the field of view corresponding to the second lens, and light enters the prism assembly after passing through at least one of the first lens and the second lens, and is imaged on the image sensor after being reflected inside the prism assembly.

[0007] In a second aspect, an embodiment of the present application provides an electronic device, comprising: the camera module of the first aspect; a processor connected to the camera module, the processor being configured to determine depth data based on the first image data and the second image data when the image data generated by the image sensor includes first image data and second image data, and to generate a three-dimensional image based on the first image data, the second image data and the depth data; wherein the first image data is generated based on the light incident on the first lens, and the second image data is generated based on the light incident on the second lens.

[0008] In a third aspect, an embodiment of the present application provides a shooting method, which is applied to an electronic device such as the second aspect, and the shooting method includes: acquiring first image data and second image data generated by an image sensor; determining depth data based on the first image data and the second image data, and generating a three-dimensional image based on the first image data, the second image data and the depth data.

[0009] In a fourth aspect, an embodiment of the present application provides a shooting device, comprising the camera module of the first aspect, the shooting device also comprising: a processing unit, for acquiring first image data and second image data generated by an image sensor; the processing unit, further for determining depth data based on the first image data and the second image data; the processing unit, further for generating a three-dimensional image based on the first image data, the second image data and the depth data.

[0010] In a fifth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the shooting method of the third aspect are implemented.

[0011] In a sixth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the steps of the shooting method of the third aspect.

[0012] In a seventh aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the shooting method of the third aspect.

[0013] The camera module provided in the embodiment of the present application includes a first lens, a second lens, a prism assembly and an image sensor. Among them, the first reflective portion of the prism assembly is arranged corresponding to the first lens, and the second reflective portion of the prism assembly is arranged corresponding to the second lens; the image sensor is arranged between the first lens and the second lens, and the first lens, the second lens and the image sensor are located on the same side of the prism assembly. The field of view corresponding to the first lens partially overlaps with the field of view corresponding to the second lens. After passing through at least one of the first lens and the second lens, the light enters the prism assembly, and is reflected inside the prism assembly and imaged on the image sensor. Through the above-mentioned camera module, an innovative hardware structure design scheme for shooting is implemented, and an integrated stereo shooting design is realized. It is possible to simultaneously obtain left and right images through an image sensor, thereby obtaining shooting data records with depth data, and stereo shooting can be achieved through a single exposure. In this way, on the one hand, the integrated design can achieve 3D imaging through only one image sensor, which simplifies the design structure of the camera module used for 3D imaging and reduces the space occupied by the camera module; on the other hand, two images are simultaneously acquired by one image sensor to obtain depth data for 3D imaging, and there is no need to crop the image, which can avoid problems such as inconsistent depth of field, inconsistent resolution, and inconsistent color that occur during 3D shooting, thereby improving the 3D imaging effect and meeting the needs of high-quality 3D shooting in a smaller space. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 One of the structural schematic diagrams of the camera module provided in the embodiment of the present application;

[0015] Figure 2 Three views of the camera module provided in the embodiment of the present application;

[0016] Figure 3 The second structural diagram of the camera module provided in the embodiment of the present application;

[0017] Figure 4 The third structural diagram of the camera module provided in the embodiment of the present application;

[0018] Figure 5 A fourth structural diagram of a camera module provided in an embodiment of the present application;

[0019] Figure 6 A fifth structural diagram of a camera module provided in an embodiment of the present application;

[0020] Figure 7 A structural block diagram of an electronic device provided in an embodiment of the present application;

[0021] Figure 8 One of the structural schematic diagrams of the electronic device provided in the embodiment of the present application;

[0022] Fig. 9 A second structural diagram of an electronic device provided in an embodiment of the present application;

[0023] Fig.10 The third structural diagram of the electronic device provided in the embodiment of the present application;

[0024] Fig.11 A fourth structural diagram of an electronic device provided in an embodiment of the present application;

[0025] Fig.12 A schematic diagram of a process flow of a photographing method provided in an embodiment of the present application;

[0026] Fig.13 This is a structural block diagram of a shooting device provided in an embodiment of the present application.

[0027] Reference numerals:

[0028] 100 camera module, 102 first lens, 104 second lens, 106 prism assembly, 108 image sensor, 110 first prism, 112 second prism, 114 fixing part, 116 first incident surface, 118 first exit surface, 120 first reflection surface, 122 second reflection surface, 124 third reflection surface, 126 second incident surface, 128 second exit surface, 130 fourth reflection surface, 132 fifth reflection surface, 134 sixth reflection surface, 136 focus anti-shake module, 138 first reflection part, 140 second reflection part, 142 first photosensitive area, 144 second photosensitive area, 200 electronic device, 202 processor, 204 ISP processing unit, 206 depth algorithm processing unit, 208 data storage unit, 210 display module, 212 cover plate. DETAILED DESCRIPTION

[0029] The embodiments of the present application will be described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and should not be construed as limitations on the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0030] The features of the terms "first" and "second" in the specification of this application may include one or more of the features explicitly or implicitly. In the description of this application, unless otherwise specified, "plurality" means two or more.

[0031] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "connected" and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0032] Combine the following Figure 1-Figure 13 The camera module, electronic device, shooting method and device according to the embodiments of the present application are described in detail.

[0033] like Figure 1 and Figure 2 As shown, the embodiment of the present application provides a camera module 100 , wherein the camera module 100 includes a first lens 102 , a second lens 104 , a prism assembly 106 and an image sensor 108 .

[0034] In some embodiments, the first lens 102 , the second lens 104 , and the image sensor 108 are disposed on the same side of the prism assembly 106 to reduce the size of the camera module 100 .

[0035] In some embodiments, the first reflective portion 138 of the prism assembly 106 is disposed corresponding to the first lens 102 , and the second reflective portion 140 of the prism assembly 106 is disposed corresponding to the second lens 104 .

[0036] In some embodiments, the image sensor 108 is disposed between the first lens 102 and the second lens 104 to minimize the design volume of the camera module 100 .

[0037] In some embodiments, a center line between the first lens 102 and the second lens 104 , a long side direction of the image sensor 108 , and a long side direction of the prism assembly 106 are parallel to each other.

[0038] In some embodiments, the first lens 102 and the second lens 104 are both used to collect light.

[0039] When the camera module 100 is in operation, light passes through at least one of the first lens 102 and the second lens 104 and enters the prism assembly 106 . Light is reflected inside the prism assembly 106 and then forms an image on the image sensor 108 .

[0040] That is, during the operation of the camera module 100, light can be transmitted to the image sensor 108 through the first lens 102 and the first reflecting portion 138 of the prism assembly 106, and light can also be transmitted to the image sensor 108 through the second lens 104 and the second reflecting portion 140 of the prism assembly 106, and the image sensor 108 then generates corresponding image data based on the received light.

[0041] In some embodiments, Figure 1 and Figure 2 As shown, the field of view FOV1 corresponding to the first lens 102 partially overlaps with the field of view FOV2 corresponding to the second lens 104, which facilitates shooting the same object using two lenses, and then obtaining the depth data of the object by calculating the parallax between the two cameras, thereby achieving 3D image shooting.

[0042] On this basis, when the camera module 100 is used for 3D imaging, the light passes through the first lens 102 and the first reflective portion 138 of the prism assembly 106 to the image sensor 108, and the image sensor 108 generates corresponding first image data. At the same time, the light passes through the second lens 104 and the second reflective portion 140 of the prism assembly 106 to the image sensor 108, and the image sensor 108 generates corresponding second image data. In some embodiments, since the field of view FOV1 corresponding to the first lens 102 and the field of view FOV2 corresponding to the second lens 104 partially overlap, the depth data of the photographed object can be determined based on the parallax between the first lens 102 and the second lens 104, and then a three-dimensional image of the photographed object can be generated according to the first image data, the second image data and the depth data, so as to achieve 3D photography of the photographed object.

[0043] It is understandable that current smart terminals lack the ability to innovate camera functions. Terminal manufacturers are all focusing on the same telephoto imaging track and lack innovation in main camera, wide-angle or other functional camera modules.

[0044] Therefore, the present application proposes the above-mentioned camera module 100 to solve the current lack of innovation in imaging hardware of smart terminals, and at the same time, expand the new track of imaging hardware, turning from the two-dimensional imaging track to the three-dimensional imaging track. Specifically, the camera module 100 proposed in the present application adopts a dual-lens and integrated prism design, with a simple structure and elegant design. It innovates the hardware structure design scheme for shooting, realizes an integrated stereo shooting design, and can simultaneously obtain two left and right images through only one image sensor 108, thereby obtaining a shooting data record with depth data, and can achieve stereo shooting through a single exposure. While reducing the occupied space of the camera module 100 for 3D imaging, it can also improve the 3D imaging effect and meet the high-quality 3D shooting needs in a smaller space.

[0045] In some embodiments, the first lens 102 and the second lens 104 may include multiple lenses, which is not specifically limited herein.

[0046] In some embodiments, the first lens 102 and the second lens 104 may be completely identical, or may be designed with different optical parameters. The designs of the first lens 102 and the second lens 104 may be specifically defined based on actual product requirements and planning. At the same time, there are no specific restrictions on the product size specifications, lens quantity, and coating settings of the first lens 102 and the second lens 104.

[0047] In some embodiments, when the camera module 100 is used for 3D imaging, the camera module 100 has the best shooting effect when the field of view FOV1 of the first lens 102 is the same as the field of view FOV2 of the second lens 104. In actual application, the field of view FOV1 of the first lens 102 and the field of view FOV2 of the second lens 104 may be the same or different, and no specific limitation is made here.

[0048] In some embodiments, when the object distance range is greater than 50 cm, the overlap between the field of view FOV1 of the first lens 102 and the field of view FOV2 of the second lens 104 is greater than 30% of the minimum field of view of the first lens 102 and the second lens 104 .

[0049] In some embodiments, the image sensor 108 may adopt a rolling exposure mode or a global exposure mode. As for the specific type of the image sensor 108 , those skilled in the art may select it according to actual conditions, and no specific limitation is made here.

[0050] In some embodiments, the camera module 100 proposed in the present application can be used to implement stereoscopic imaging photography, applied to the visible light band, and the visible light band cannot be split.

[0051] In some embodiments, the camera module 100 proposed in the present application can also change the focus points of the first lens 102 and the second lens 104 by focusing, thereby achieving stereoscopic photography at different distances.

[0052] In some embodiments, Figures 3 to 5 As shown, the camera module 100 may further include a focus anti-shake module 136 .

[0053] In some embodiments, Figure 3 As shown, the focus anti-shake module 136 can be arranged around the first lens 102 and the second lens 104, or, as shown in FIG. Figure 4 As shown, the focus anti-shake module 136 is only arranged around the first lens 102, or, as shown in FIG. Figure 5 As shown, the focus anti-shake module 136 is only arranged around the second lens 104 .

[0054] The number and location of the focus anti-shake modules 136 can be set by those skilled in the art according to actual conditions, and no specific limitation is made here.

[0055] In some embodiments, the focus type of the focus anti-shake module 136 can be electromagnetic drive, SMA (Shape Memory Alloy) drive, piezoelectric drive, electrostrictive drive, etc., and the anti-shake type of the focus anti-shake module 136 can be electromagnetic drive, SMA drive, piezoelectric drive, electrostrictive drive, etc., which are not specifically limited here. In addition, there is no limitation on whether the focus anti-shake module 136 adopts a closed-loop solution for focus.

[0056] In some embodiments, Figure 6 As shown, the first lens 102 and the second lens 104 may not be designed with a focus anti-shake module, and the presence or absence of the focus anti-shake module may be determined according to the specific requirements of the shooting scene.

[0057] The camera module 100 according to the embodiment of the present application includes a first lens 102, a second lens 104, a prism assembly 106, and an image sensor 108. The first reflective portion 138 of the prism assembly 106 is arranged corresponding to the first lens 102, and the second reflective portion 140 of the prism assembly 106 is arranged corresponding to the second lens 104; the image sensor 108 is arranged between the first lens 102 and the second lens 104, and the first lens 102, the second lens 104, and the image sensor 108 are located on the same side of the prism assembly 106. The field of view corresponding to the first lens 102 partially overlaps with the field of view corresponding to the second lens 104, and the light enters the prism assembly 106 after passing through at least one of the first lens 102 and the second lens 104, and is imaged on the image sensor 108 after being reflected inside the prism assembly 106. Through the above-mentioned camera module 100, an innovative hardware structure design scheme for shooting is implemented, and an integrated stereo shooting design is realized. It is possible to simultaneously obtain two left and right images through only one image sensor 108, thereby obtaining shooting data records with depth data, and stereo shooting can be realized through one exposure. In this way, on the one hand, the integrated design can realize 3D imaging through only one image sensor 108, simplifying the design structure of the camera module 100 for 3D imaging and reducing the space occupied by the camera module 100; on the other hand, two images are simultaneously obtained through one image sensor 108 to obtain depth data for 3D imaging, and there is no need to crop the image, which can avoid problems such as inconsistent depth of field, inconsistent resolution, and inconsistent color in the 3D shooting process, improve the 3D imaging effect, and meet the high-quality 3D shooting needs in a smaller space.

[0058] According to some embodiments of the present application, optionally, Figure 1 and Figure 2 As shown, the first reflecting portion 138 includes a first prism 110 , the second reflecting portion 140 includes a second prism 112 , and the prism assembly 106 further includes a fixing member 114 .

[0059] The first prism 110 is disposed corresponding to the first lens 102 , and the second prism 112 is disposed corresponding to the second lens 104 .

[0060] In some embodiments, the first prism 110 corresponds to the first photosensitive area 142 of the image sensor 108, and the second prism 112 corresponds to the second photosensitive area 144 of the image sensor 108. Specifically, the first prism 110 and the second prism 112 may each correspond to half of the photosensitive area of ​​the image sensor 108.

[0061] In some embodiments, the first prism 110 is used to reflect the light emitted by the first lens 102 to the first photosensitive area 142 of the image sensor 108 , and the second prism 112 is used to reflect the light emitted by the second lens 104 to the second photosensitive area 144 of the image sensor 108 .

[0062] In some embodiments, the fixing member 114 is disposed between the first prism 110 and the second prism 112 , and the fixing member 114 is used to fix the relative positions of the first prism 110 and the second prism 112 .

[0063] In some embodiments, the first prism 110 and the second prism 112 may be trapezoidal prisms, and the fixing member 114 may be a triangular prism or a bracket, etc., which is not specifically limited here.

[0064] According to the camera module 100 of the embodiment of the present application, the first reflecting portion 138 includes a first prism 110, the second reflecting portion 140 includes a second prism 112, and the prism assembly 106 further includes a fixing member 114. The fixing member 114 is disposed between the first prism 110 and the second prism 112, and the fixing member 114 is used to fix the first prism 110 and the second prism 112. The first prism 110 is used to reflect the light emitted by the first lens 102 to the image sensor 108, and the second prism 112 is used to reflect the light emitted by the second lens 104 to the image sensor 108. In this way, the prism assembly 106 adopts an independent integrated prism design, which has a simple structure, simplifies the design structure of the camera module 100, and, by means of the first prism 110 and the second prism 112, two images can be simultaneously acquired through only one image sensor 108, thereby obtaining depth data for 3D imaging, and there is no need to crop the image, thereby improving the 3D imaging effect.

[0065] According to some embodiments of the present application, optionally, Figure 1 and Figure 2 As shown, the first prism 110 includes a first incident surface 116 , a first emitting surface 118 , a first reflecting surface 120 , a second reflecting surface 122 , and a third reflecting surface 124 .

[0066] The first incident surface 116 is disposed corresponding to the first lens 102 , and the first incident surface 116 is perpendicular to the optical axis of the first lens 102 .

[0067] In some embodiments, the first emission surface 118 is disposed corresponding to the first light sensing region 142 of the image sensor 108 , and the first emission surface 118 is parallel to the image sensor 108 .

[0068] In some embodiments, the first reflective surface 120 is connected to the first incident surface 116 .

[0069] In some embodiments, the second reflective surface 122 is connected to the first incident surface 116 and the first emitting surface 118 respectively.

[0070] In some embodiments, the third reflective surface 124 is connected to the first emitting surface 118 .

[0071] In some embodiments, the first incident surface 116 and the first exit surface 118 are both transmissive surfaces.

[0072] During the operation of the camera module 100, the light emitted by the first lens 102 is incident on the first reflection surface 120 inside the first prism 110 perpendicularly to the first incident surface 116, and then reflected by the first reflection surface 120 to the second reflection surface 122, and then reflected by the second reflection surface 122 to the third reflection surface 124, and finally reflected by the third reflection surface 124 to the first exit surface 118 and enter the first photosensitive area 142 of the image sensor 108.

[0073] In some embodiments, considering the difficulty of structural realization and processing, the first incident surface 116 , the second reflective surface 122 , and the first emitting surface 118 may be located in a common plane of the first prism 110 .

[0074] In some embodiments, the reflective function of the first reflective surface 120, the second reflective surface 122, and the third reflective surface 124 can be achieved within the total reflection range by controlling the angle of the incident light on the corresponding plane, or by coating a film layer with a reflective function on the corresponding areas of the first reflective surface 120, the second reflective surface 122, and the third reflective surface 124, and no specific limitation is made herein.

[0075] In some embodiments, in the first prism 110, except for the transmission surface and the reflection surface, other surfaces of the first prism 110 are subjected to matte treatment such as coating, ink coating, silk-screen printing, etc. as needed to avoid stray light imaging effects.

[0076] According to the camera module 100 of the embodiment of the present application, the first prism 110 includes a first incident surface 116, a first exit surface 118, a first reflection surface 120, a second reflection surface 122, and a third reflection surface 124. The first incident surface 116 is arranged corresponding to the first lens 102, and the first incident surface 116 is perpendicular to the optical axis of the first lens 102; the first exit surface 118 is arranged corresponding to the first photosensitive area 142 of the image sensor 108, and the first exit surface 118 is parallel to the image sensor 108; the first reflection surface 120 is connected to the first incident surface 116; the second reflection surface 122 is respectively connected to the first incident surface 116 and the first exit surface 118; and the third reflection surface 124 is connected to the first exit surface 118. The light emitted from the first lens 102 is incident on the first reflection surface 120 via the first incident surface 116, is reflected by the first reflection surface 120 to the second reflection surface 122, is reflected by the second reflection surface 122 to the third reflection surface 124, is further reflected by the third reflection surface 124 to the first emission surface 118 and is incident on the first photosensitive area 142 of the image sensor 108. In this way, through the cooperation of the first lens 102 and the first prism 110, the light can be transmitted to the first photosensitive area 142 of the image sensor 108, thereby obtaining an image corresponding to one side of the first lens 102.

[0077] According to some embodiments of the present application, optionally, Figure 1 and Figure 2 As shown, the structures of the second prism 112 and the first prism 110 are in a mirror relationship. The second prism 112 includes a second incident surface 126 , a second emitting surface 128 , a fourth reflecting surface 130 , a fifth reflecting surface 132 and a sixth reflecting surface 134 .

[0078] The second incident surface 126 is disposed corresponding to the second lens 104 , and the second incident surface 126 is perpendicular to the optical axis of the second lens 104 .

[0079] In some embodiments, the second emission surface 128 is disposed corresponding to the second photosensitive region 144 of the image sensor 108 , and the second emission surface 128 is parallel to the image sensor 108 .

[0080] In some embodiments, the first exit surface 118 and the second exit surface 128 may be connected, and the first exit surface 118 and the second exit surface 128 may correspond to half of the photosensitive area of ​​the image sensor 108. Figure 2 As shown, the first photosensitive region 142 and the second photosensitive region 144 have the same area, and the lengths of the first exit surface 118 and the second exit surface 128 are both half of the length of the image sensor 108, that is, D.

[0081] In some embodiments, there may be a gap between the first emission surface 118 and the second emission surface 128 , which is not specifically limited herein.

[0082] In some embodiments, the fourth reflective surface 130 is connected to the second incident surface 126 .

[0083] In some embodiments, the fifth reflective surface 132 is connected to the second incident surface 126 and the second emitting surface 128 respectively.

[0084] In some embodiments, the sixth reflective surface 134 is connected to the second emitting surface 128 .

[0085] In some embodiments, the second incident surface 126 and the second exit surface 128 are both transmissive surfaces.

[0086] In some embodiments, the transmission path of the second light is in a mirror image relationship with the transmission path of the first light.

[0087] Specifically, during the operation of the camera module 100, the light emitted by the second lens 104 is incident on the fourth reflection surface 130 inside the second prism 112 perpendicularly to the second incident surface 126, and then reflected by the fourth reflection surface 130 to the fifth reflection surface 132, and then reflected by the fifth reflection surface 132 to the sixth reflection surface 134, and finally reflected by the sixth reflection surface 134 to the second exit surface 128 and incident on the second photosensitive area 144 of the image sensor 108.

[0088] In some embodiments, considering the difficulty of structural realization and processing, the second incident surface 126 , the fifth reflection surface 132 , and the second emission surface 128 may be located in a common plane of the second prism 112 .

[0089] In some embodiments, the reflection function of the fourth reflection surface 130, the fifth reflection surface 132 and the sixth reflection surface 134 can be achieved within the total reflection range by controlling the angle of the incident light on the corresponding plane, or by coating a film layer with a reflection function on the corresponding areas of the fourth reflection surface 130, the fifth reflection surface 132 and the sixth reflection surface 134, and no specific limitation is made here.

[0090] In some embodiments, in the second prism 112, except for the transmission surface and the reflection surface, other surfaces of the second prism 112 are subjected to matte treatment such as coating, ink coating, silk-screen printing, etc. as needed to avoid stray light imaging effects.

[0091] According to the camera module 100 of the embodiment of the present application, the second prism 112 includes a second incident surface 126, a second exit surface 128, a fourth reflection surface 130, a fifth reflection surface 132 and a sixth reflection surface 134. The second incident surface 126 is arranged corresponding to the second lens 104, the second incident surface 126 is perpendicular to the optical axis of the second lens 104, the second exit surface 128 is arranged corresponding to the second photosensitive area 144 of the image sensor 108, the second exit surface 128 is parallel to the image sensor 108, the fourth reflection surface 130 is connected to the second incident surface 126, the fifth reflection surface 132 is connected to the second incident surface 126 and the second exit surface 128 respectively, and the sixth reflection surface 134 is connected to the second exit surface 128. The light emitted from the first lens 102 is incident on the first reflection surface 120 via the first incident surface 116, is reflected by the first reflection surface 120 to the second reflection surface 122, is reflected by the second reflection surface 122 to the third reflection surface 124, is reflected by the third reflection surface 124 to the first exit surface 118, and is incident on the second photosensitive area 144 of the image sensor 108. In this way, the light can be transmitted to the second photosensitive area 144 of the image sensor 108 through the cooperation of the second lens 104 and the second prism 112, so as to obtain an image corresponding to the side of the second lens 104.

[0092] According to some embodiments of the present application, optionally, Figure 1 As shown, the first reflection surface 120 and the first incident surface 116 form a first angle a, and the third reflection surface 124 and the first emitting surface 118 form a second angle b.

[0093] The first angle a and the second angle b both range from 20° to 46°, so as to ensure as much effective light reflection as possible and as little stray light interference as possible in the first prism 110 .

[0094] In actual application, the specific values ​​of the first angle a and the second angle b can be set by those skilled in the art according to actual conditions, and no specific limitation is made here.

[0095] According to the camera module 100 of the embodiment of the present application, the first reflection surface 120 and the first incident surface 116 form a first angle, the third reflection surface 124 and the first exit surface 118 form a second angle, and the angle range of the first angle and the second angle are both 20° to 46°. In this way, effective reflection of light in the first prism 110 can be ensured, stray light interference can be reduced, and thus the imaging quality of the first photosensitive area 142 of the image sensor 108 can be ensured.

[0096] According to some embodiments of the present application, optionally, Figure 1 As shown, the fourth reflection surface 130 and the second incident surface 126 form a third angle c, and the sixth reflection surface 134 and the second emitting surface 128 form a fourth angle d.

[0097] The third angle c and the fourth angle d both range from 20° to 46°, so as to ensure as much effective light reflection as possible and as little stray light interference as possible in the second prism 112 .

[0098] In actual application, the specific values ​​of the third angle c and the fourth angle d can be set by those skilled in the art according to actual conditions, and no specific limitation is made here.

[0099] According to the camera module 100 of the embodiment of the present application, the fourth reflection surface 130 and the second incident surface 126 form a third angle, the sixth reflection surface 134 and the second exit surface 128 form a fourth angle, and the angle range of the third angle and the fourth angle are both 20° to 46°. In this way, effective reflection of light in the second prism 112 can be ensured, stray light interference can be reduced, and thus the imaging quality of the second photosensitive area 144 of the image sensor 108 can be ensured.

[0100] According to some embodiments of the present application, the refractive index of the prism assembly 106 is optionally in the range of 1.7 to 2.4, so that the light can be totally reflected after entering the prism assembly 106, thereby ensuring effective reflection of the light and the imaging quality of the image sensor 108.

[0101] According to some embodiments of the present application, optionally, Figure 2 As shown, the length L of the orthographic projection of the prism assembly 106 along the optical axis direction of the first lens 102 is N times the width W, and N is greater than 3. In this way, the miniaturized design of the camera module 100 is achieved. When the camera module 100 is assembled into an electronic device, the mainboard wiring area occupied by the camera module 100 in a top-down angle is minimized, which is beneficial to the layout of other electronic components on the mainboard of the electronic device.

[0102] According to some embodiments of the present application, optionally, Figure 2 As shown, the maximum distance h1 between the first lens 102 and the prism assembly 106 and the maximum distance h2 between the second lens 104 and the prism assembly 106 are both greater than the maximum distance h3 between the image sensor 108 and the prism assembly 106. In this way, the overall height of the camera module 100 is reduced, making it easier to adapt to miniaturized electronic devices.

[0103] There is no specific limitation on the maximum distance h1 between the first lens 102 and the prism assembly 106 and the maximum distance h2 between the second lens 104 and the prism assembly 106 .

[0104] According to the camera module 100 of the embodiment of the present application, the maximum distance between the first lens 102 and the prism assembly 106 and the maximum distance between the second lens 104 and the prism assembly 106 are both greater than the maximum distance between the image sensor 108 and the prism assembly 106. In this way, the overall height of the camera module 100 is reduced, the space occupied by the camera module 100 is reduced, and it is easy to adapt to miniaturized electronic devices.

[0105] According to some embodiments of the present application, optionally, Figure 7 As shown, the embodiment of the present application further provides an electronic device 200. The electronic device 200 includes a processor 202 and a camera module 100 in any of the above embodiments. The electronic device 200 provided in the embodiment of the present application includes the camera module 100 in any of the above embodiments, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0106] Among them, the processor 202 is connected to the camera module 100, and the processor 202 can specifically be a data processing module. The processor 202 is used to determine depth data based on the first image data and the second image data when the image data generated by the image sensor in the camera module 100 includes first image data and second image data, and then generate a three-dimensional image based on the first image data, the second image data and the depth data.

[0107] Specifically, when the electronic device 200 performs 3D shooting through the camera module 100, the same shooting object is shot through the two lenses in the camera module 100, and two planar two-dimensional images of the shooting object, namely the first image data and the second image data, are obtained at the same time. The processor 202 then obtains the relevant parameters of the two lenses based on the two planar two-dimensional images, and then calculates the depth data of the shooting object. On this basis, the processor 202 obtains an image record with depth information based on the two planar two-dimensional images and the above-mentioned depth data, thereby completing three-dimensional stereo shooting.

[0108] Specifically, Figure 7As shown, the processor 202 includes an ISP processing unit 204, a depth algorithm processing unit 206 and a data storage unit 208, and the electronic device 200 also includes a display module 210. When the electronic device 200 performs 3D shooting through the camera module 100, the camera module 100 is started, and the same shooting object is shot through the two lenses in the camera module 100. At this time, the light passes through the two lenses in the camera module 100 and the refraction of the prism assembly to the surface of the image sensor, and the image sensor then converts the light signal into a two-dimensional image data signal to obtain the first image data and the second image data, and transmits the first image data and the second image data to the ISP (Image Signal Process) processing unit for image data processing. On this basis, the depth algorithm processing unit 206 uses a computer algorithm to calculate the parallax between the two lenses according to the first image data and the second image data, thereby obtaining the depth data of the shooting object and realizing the three-dimensional stereo shooting of the shooting object. The first image data, the second image data and the depth data are stored in the data storage unit 208. When the user views the 3D image through the interactive interface of the electronic device 200, the processor 202 transmits the captured three-dimensional image data to the display module 210 for presentation after being triggered by the interactive control.

[0109] Parallax refers to the difference in the position of an object in two images when two lenses capture the same object. The computer determines the distance of the object from the lens by measuring this difference, thereby obtaining the depth data of the object.

[0110] In some embodiments, the above-mentioned computer algorithm can be a traditional geometric algorithm or a neural network algorithm, which is not specifically limited here.

[0111] In addition, it should be noted that if users want to watch three-dimensional immersive images, they need to use a three-dimensional display terminal such as a virtual display device or a custom-built and designed three-dimensional display device.

[0112] In some embodiments, Figures 8 to 11 As shown, the electronic device 200 further includes a cover plate 212 , and the cover plate 212 covers the camera module 100 to protect the camera module 100 .

[0113] In some embodiments, Figure 8 and Fig.10 As shown, the camera module 100 can be disposed horizontally on the electronic device 200, or, as shown in FIG. Fig. 9 and Fig.11 As shown, the camera module 100 can be disposed vertically on the electronic device 200 .

[0114] In some embodiments, Figure 8 and Fig. 9 As shown, the cover plate 212 may be rectangular, or, as shown in FIG. Fig.10 and Fig.11 As shown, the cover plate 212 may be circular in shape.

[0115] In some embodiments, Figure 8 and Fig. 9 As shown, the camera module 100 can be arranged at the top edge of the electronic device 200, or, as shown in FIG. Fig.10 and Fig.11 As shown, the camera module 100 can be set at the top middle position of the electronic device 200.

[0116] Those skilled in the art may select the location and direction of the camera module 100 and the shape of the cover plate 212 according to the design requirements of the electronic device 200 , and no specific limitation is made here.

[0117] In addition, in actual application, the electronic device 200 may be any device including a camera hardware module, such as a smart phone, a smart watch, a tablet computer, and a laptop computer, and no specific limitation is made herein.

[0118] It should be noted that the electronic device 200 in the embodiment of the present application includes a mobile electronic device and a non-mobile electronic device.

[0119] In the actual application process, the electronic device 200 can be a terminal or other devices other than a terminal. For example, the electronic device 200 can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiments of the present application are not specifically limited.

[0120] According to some embodiments of the present application, optionally, Fig.12 As shown, the embodiment of the present application provides a shooting method, which may include the following S302 to S306:

[0121] S302: Acquire first image data and second image data generated by an image sensor.

[0122] The shooting method proposed in the embodiment of the present application is applied to the electronic device in the above embodiment, and the electronic device can specifically be a smart phone, a tablet computer, a laptop computer, a smart watch and other devices, which are not specifically limited here.

[0123] The first image data is generated based on the light incident from the first lens, and the second image data is generated based on the light incident from the second lens.

[0124] Specifically, in the shooting method provided in the embodiment of the present application, during the 3D shooting process, the same shooting object is shot simultaneously through two lenses in the camera module, and the image sensor generates first image data and second image data of the shooting object respectively.

[0125] S304: Determine depth data according to the first image data and the second image data.

[0126] Specifically, in the shooting method provided in the embodiment of the present application, first image data and second image data generated by the image sensor are obtained, and based on the first image data and the second image data, the parallax between the two lenses in the camera module is calculated, that is, the position difference between the photographed object in the first image data and the second image data is calculated, and then the distance between the photographed object and the two lenses is determined based on the position difference, so as to obtain the depth data of the photographed object.

[0127] S306: Generate a three-dimensional image according to the first image data, the second image data and the depth data.

[0128] Specifically, in the shooting method provided in the embodiment of the present application, after the depth data of the shooting object is obtained, a three-dimensional image of the shooting object is generated according to the first image data, the second image data and the depth data.

[0129] The above-mentioned shooting method provided by the embodiment of the present application obtains the first image data and the second image data generated by the image sensor; determines the depth data according to the first image data and the second image data, and generates a three-dimensional image according to the first image data, the second image data and the depth data. In this way, two images of the shooting object are obtained at the same time and the depth data of the shooting object is obtained thereby, thereby realizing three-dimensional stereoscopic shooting of the shooting object without cropping the image, and avoiding the problems of inconsistent depth of field, inconsistent resolution, inconsistent color, etc. that occur during the 3D shooting process, thereby improving the 3D imaging effect.

[0130] The shooting method provided in the embodiment of the present application can be executed by a shooting device. In the embodiment of the present application, the shooting device provided in the embodiment of the present application is described by taking the shooting device executing the above shooting method as an example.

[0131] like Fig.13 As shown, an embodiment of the present application provides a photographing device 400, which includes the camera module 100 in any of the above embodiments, and the photographing device 400 also includes the following processing unit 402.

[0132] The processing unit 402 is used to obtain the first image data and the second image data generated by the image sensor;

[0133] The processing unit 402 is further configured to determine depth data based on the first image data and the second image data;

[0134] The processing unit 402 is further configured to generate a three-dimensional image according to the first image data, the second image data and the depth data.

[0135] The shooting device 400 provided in the embodiment of the present application obtains the first image data and the second image data generated by the image sensor; determines the depth data according to the first image data and the second image data, and generates a three-dimensional image according to the first image data, the second image data and the depth data. In this way, two images of the shooting object are obtained at the same time and the depth data of the shooting object is obtained thereby, thereby realizing three-dimensional stereoscopic shooting of the shooting object without cropping the image, and avoiding the problems of inconsistent depth of field, inconsistent resolution, inconsistent color, etc. that occur during the 3D shooting process, thereby improving the 3D imaging effect.

[0136] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned shooting method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0137] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0138] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned shooting method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0139] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0140] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned shooting method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0141] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0142] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present application, and that the scope of the present application is defined by the claims and their equivalents.

Claims

1. A camera module, characterized in that: include: First shot; Second shot; A prism assembly, wherein a first reflective portion of the prism assembly is disposed correspondingly to the first lens, and a second reflective portion of the prism assembly is disposed correspondingly to the second lens; An image sensor is disposed between the first lens and the second lens, and the first lens, the second lens and the image sensor are located on the same side of the prism assembly; The field of view corresponding to the first lens partially overlaps with the field of view corresponding to the second lens, and light enters the prism assembly after passing through at least one of the first lens and the second lens, and is reflected inside the prism assembly and imaged on the image sensor.

2. The camera module according to claim 1, characterized in that: The first reflecting portion comprises: a first prism, the first prism being used to reflect the light emitted by the first lens to the image sensor; The second reflecting portion comprises: a second prism, the second prism being used to reflect the light emitted by the second lens to the image sensor; The prism assembly further comprises: A fixing member is disposed between the first prism and the second prism, and is used to fix the first prism and the second prism.

3. The camera module according to claim 2, characterized in that: The first prism comprises: A first incident surface, arranged corresponding to the first lens, wherein the first incident surface is perpendicular to the optical axis of the first lens; A first exit surface, arranged corresponding to a first photosensitive area of ​​the image sensor, wherein the first exit surface is parallel to the image sensor; A first reflecting surface connected to the first incident surface; A second reflecting surface, connected to the first incident surface and the first exit surface respectively; A third reflecting surface connected to the first emitting surface; Among them, the light emitted by the first lens is incident on the first reflection surface through the first incident surface, reflected by the first reflection surface to the second reflection surface, reflected by the second reflection surface to the third reflection surface, and then reflected by the third reflection surface to the first exit surface and enter the first photosensitive area of ​​the image sensor.

4. The camera module according to claim 2, characterized in that: The second prism comprises: A second incident surface, arranged corresponding to the second lens, the second incident surface being perpendicular to the optical axis of the second lens; A second emission surface is arranged corresponding to the second photosensitive area of ​​the image sensor, and the second emission surface is parallel to the image sensor; a fourth reflecting surface connected to the second incident surface; a fifth reflecting surface, connected to the second incident surface and the second emitting surface respectively; a sixth reflecting surface connected to the second emitting surface; Among them, the light emitted by the second lens is incident on the fourth reflection surface via the second incident surface, reflected by the fourth reflection surface to the fifth reflection surface, reflected by the fifth reflection surface to the sixth reflection surface, and then reflected by the sixth reflection surface to the second exit surface and enter the second photosensitive area of ​​the image sensor.

5. The camera module according to claim 3, characterized in that: The first reflection surface and the first incident surface form a first angle, the third reflection surface and the first exit surface form a second angle, and the first angle and the second angle both range from 20° to 46°.

6. The camera module according to claim 4, characterized in that: The fourth reflection surface and the second incident surface form a third angle, and the sixth reflection surface and the second exit surface form a fourth angle; The angle range of the third angle and the fourth angle is 20° to 46°.

7. The camera module according to any one of claims 1 to 6, characterized in that: The refractive index of the prism assembly ranges from 1.7 to 2.

4.

8. The camera module according to any one of claims 1 to 6, characterized in that: The length of the orthographic projection of the prism assembly along the optical axis direction of the first lens is N times the width, and N is greater than 3.

9. The camera module according to any one of claims 1 to 6, characterized in that: The farthest distance between the first lens and the prism assembly and the farthest distance between the second lens and the prism assembly are both greater than the farthest distance between the image sensor and the prism assembly.

10. An electronic device, characterized in that: include: The camera module according to any one of claims 1 to 9; a processor connected to the camera module, the processor being configured to, when the image data generated by the image sensor includes first image data and second image data, determine depth data according to the first image data and the second image data, and generate a three-dimensional image according to the first image data, the second image data and the depth data; The first image data is generated based on the light incident on the first lens, and the second image data is generated based on the light incident on the second lens.

11. A shooting method, characterized in that: Applied to the electronic device as claimed in claim 10, the shooting method comprises: Acquire first image data and second image data generated by an image sensor; determining depth data based on the first image data and the second image data; A three-dimensional image is generated according to the first image data, the second image data, and the depth data.

12. A photographing device, characterized in that: The camera module according to any one of claims 1 to 9, wherein the shooting device further comprises: a processing unit, configured to obtain first image data and second image data generated by an image sensor; The processing unit is further configured to determine depth data based on the first image data and the second image data; The processing unit is further configured to generate a three-dimensional image according to the first image data, the second image data and the depth data.

Images