Camera module, image acquisition method and electronic equipment

Abstract

The invention provides a camera module, an image acquisition method and electronic equipment, and belongs to the technical field of electronics. The camera module comprises at least two cameras; the at least two cameras are adjacent, and at least parts of view field angles of the two adjacent cameras in the at least two cameras are connected or overlapped. According to the camera module provided by the invention, an image acquisition scheme that the two cameras with relatively small sizes or relatively small field angles are utilized to cooperatively complete relatively large field angle imaging is realized, and the problems that the space of full-screen electronic equipment is limited and the arrangement difficulty of the front-facing camera is high are solved.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to a camera module, an image acquisition method and an electronic device. Background Art

[0002] With the development of the market, consumers have increasingly stringent requirements for display effects, requiring not only diversified appearance designs, but also a higher screen-to-body ratio. Full-screen technology achieves a screen-to-body ratio of more than 90% through ultra-narrow or even borderless designs.

[0003] In order to achieve compatibility between full screen and front camera, the under-screen camera solution is generally adopted in related technologies, hoping to realize the layout of the front camera without affecting the screen-to-body ratio.

[0004] However, due to the limitations of screen component technology, when the pixel density only meets the basic display function, the front camera still has a large pixel occlusion problem, resulting in blurry images captured by the front camera and poor imaging quality. Summary of the invention

[0005] The present application provides a camera module, an image acquisition method and an electronic device, which can solve the problem of pixel occlusion in the under-screen camera, resulting in blurred images captured by the front camera and poor imaging quality.

[0006] The technical solution is as follows:

[0007] In one aspect, a camera module is provided, the camera module comprising: at least two cameras;

[0008] The at least two cameras are adjacent to each other, and the field of view angles of two adjacent cameras among the at least two cameras are at least partially connected or overlapped.

[0009] In some embodiments, optical centers of two adjacent cameras of the at least two cameras are arranged at a target angle α;

[0010] Wherein, α≤(θ1+θ2) / 2, θ1 and θ2 are the field of view angles of two adjacent cameras respectively.

[0011] In some embodiments, two adjacent cameras of the at least two cameras are arranged along a first direction, and the two adjacent cameras are rotated and staggered around the axis of the first direction, so that the orthographic projections of the optical centers of the two adjacent cameras in a plane perpendicular to the first direction are arranged at a target angle α.

[0012] In some embodiments, each of the at least two cameras comprises a lens and an image sensor, and the lens is located on a light-sensitive side of the image sensor;

[0013] A first dimension of the lens parallel to the first direction is L1, and a second dimension of the lens perpendicular to the first direction is L2;

[0014] Among them, the value range of L1:L2 is 1.5-2.5;

[0015] and / or,

[0016] The first dimension L1 has a value range of 0.5 mm to 1.5 mm, and the second dimension L2 has a value range of 0.3 mm to 1.0 mm.

[0017] In some embodiments, the camera module further includes an image processing unit;

[0018] The image processing unit is electrically connected to each of the at least two cameras, and is used to receive a sub-image from each camera and stitch the sub-images into a complete image based on the relative position relationship of the field of view of the cameras.

[0019] In some embodiments, the camera module further includes a signal synchronization unit, which is electrically connected to each of the at least two cameras, and is used to control two adjacent cameras to synchronously capture at least one frame of sub-image.

[0020] In some embodiments, the signal synchronization unit is used to control the at least two cameras to synchronously capture the sub-image of each frame;

[0021] or,

[0022] The signal synchronization unit is used to control the at least two cameras to synchronously capture the sub-images of the target frame.

[0023] In some embodiments, the signal synchronization unit includes at least two first synchronization interfaces and at least one first synchronization signal line, the at least two first synchronization interfaces are respectively located on the at least two cameras, and the at least one first synchronization signal line is electrically connected between the at least two first synchronization interfaces.

[0024] In some embodiments, the signal synchronization unit further includes a second synchronization interface and a second synchronization signal line, the second synchronization interface is located on the image processing unit, and the second synchronization signal line is electrically connected between the second synchronization interface and at least one of the first synchronization interfaces.

[0025] On the other hand, an electronic device is provided, the electronic device comprising: the camera module described in the present application, as well as a screen assembly and a housing assembly;

[0026] The screen assembly is connected to the shell assembly, and the screen assembly includes a cover plate, and at least a portion of the edge of the cover plate overlaps with the shell assembly to form a micro-gap area;

[0027] The orthographic projection of the image acquisition end of the camera module on the screen assembly at least partially overlaps with the micro-slit area.

[0028] In some embodiments, at least two viewing windows are provided in the micro-slit area, and each of the at least two viewing windows corresponds to at least one of the cameras;

[0029] The camera comprises a lens, and the shapes of the at least two viewing windows are the same as the shape of the lens.

[0030] In some embodiments, the at least two windows are respectively covered with a decorative film layer, and the decorative film layer is capable of allowing visible light to pass through.

[0031] On the other hand, an image acquisition method is provided, which is applied to the camera module or the electronic device described in the present application, and the image acquisition method includes:

[0032] Controlling the at least two cameras to synchronously capture sub-images;

[0033] Determining a relative position of at least two of the sub-images according to a position of each of the at least two cameras;

[0034] At least two of the sub-images are spliced ​​together to form a complete image.

[0035] In some embodiments, controlling the at least two cameras to synchronously capture sub-images includes:

[0036] Synchronize at least one parameter setting of shutter speed, focal length, aperture, contrast, saturation, brightness, exposure, and sharpness of the at least two cameras;

[0037] Control the at least two cameras to synchronously capture at least one frame of the sub-image.

[0038] In some embodiments, controlling the at least two cameras to synchronously capture at least one frame of the sub-image includes:

[0039] Controlling the two cameras to synchronously capture the sub-image of each frame;

[0040] or,

[0041] The two cameras are controlled to synchronously capture the sub-image of a target frame; the target frame includes at least one frame from the second frame to the fifth frame.

[0042] In some embodiments, determining the relative position of at least two sub-images according to the position of each of the at least two cameras includes:

[0043] If the field of view angles of two adjacent cameras are at least partially connected, controlling the edges of the sub-images output by the two adjacent cameras to be connected;

[0044] or,

[0045] If the field of view angles of two adjacent cameras at least partially overlap, the sub-images output by the two adjacent cameras are controlled to at least partially overlap.

[0046] In some embodiments, controlling the sub-images output by two adjacent cameras to at least partially overlap includes:

[0047] Determining an overlapping area of ​​at least two of the sub-images according to the color temperatures of the sub-images output by two adjacent cameras;

[0048] and / or,

[0049] The overlapping area of ​​at least two sub-images is determined according to the infrared spot patterns in the overlapping area of ​​the field of view of two adjacent cameras.

[0050] In some embodiments, stitching at least two of the sub-images together to form a complete image comprises:

[0051] Selecting one of the sub-images as a reference image, and establishing a reference coordinate system in the reference image;

[0052] Mapping the remaining sub-images into the reference coordinate system;

[0053] An image fusion algorithm is used to eliminate the seams between at least two of the sub-images.

[0054] The beneficial effects of the technical solution provided by this application include at least:

[0055] In the camera module of the present application, at least two cameras are arranged adjacent to each other, and the markets of the two adjacent cameras are at least partially connected or overlapped, and the images generated by at least two cameras are at least partially connected or overlapped. By stitching the images generated by the at least two cameras respectively, a stitched image with a larger field of view angle can be generated, thereby realizing an image acquisition scheme in which two cameras with smaller sizes or smaller field of view angles collaborate to complete imaging with a larger field of view angle; since the camera size or field of view angle can be designed to be smaller, the space required for camera assembly and light entry is smaller, and the narrow border area or screen black border area of ​​the full-screen electronic device can be fully utilized, which is conducive to solving the problem of limited space and difficulty in arranging the front camera of the full-screen electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0057] Figure 1 is a structural schematic diagram of a camera module provided in Example 1 of the present application;

[0058] Figure 2 is a structural schematic diagram of a camera module provided in Embodiment 2 of the present application;

[0059] Figure 3 This is a schematic diagram of the connection state of the field of view angle of the camera module provided in the first embodiment of the present application;

[0060] Figure 4 This is a schematic diagram of the overlapping state of the field of view angle of the camera module provided in the first embodiment of the present application;

[0061] Figure 5 It is a schematic diagram of the connection between the camera, the image processing unit, and the signal synchronization unit provided in the embodiment of the present application;

[0062] Figure 6 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0063] Figure 7 is a schematic structural diagram of a micro-slit region provided in an embodiment of the present application;

[0064] Figure 8 is a schematic diagram of the positions of the camera and the window provided in an embodiment of the present application;

[0065] Fig. 9 It is a flowchart of the image acquisition method provided in an embodiment of the present application.

[0066] The reference numerals in the figures represent respectively:

[0067] 10. Camera module; 20. Screen assembly; 30. Frame;

[0068] 1. Camera; 11. Lens; 12. Image sensor;

[0069] 2. Image processing unit;

[0070] 3. Signal synchronization unit;

[0071] 4. Micro-slit area; 41. Window;

[0072] A. First direction; B. Second direction. DETAILED DESCRIPTION

[0073] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0074] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate directions or positional relationships based on the attached Figure 1 The orientation or positional relationship shown is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0075] It should be understood that in this application, "electrical connection" can be understood as physical contact and electrical conduction between components; it can also be understood as a form of connection between different components in the circuit structure through physical lines such as printed circuit board (PCB) copper foil or wires that can transmit electrical signals. "Communication connection" can refer to electrical signal transmission, including wireless communication connection and wired communication connection. Wireless communication connection does not require a physical medium and does not belong to a connection relationship that limits the product structure. "Connection" and "connected" can both refer to a mechanical connection relationship or a physical connection relationship, that is, A is connected to B or A is connected to B, which can mean that there is a fastening component (such as screws, bolts, rivets, etc.) between A and B, or A and B are in contact with each other and A and B are difficult to separate.

[0076] Unless otherwise defined, all technical terms used in the embodiments of the present application have the same meanings as commonly understood by those of ordinary skill in the art.

[0077] Field of View (FOV), also known as field of view in optical engineering, determines the field of view of the optical instrument. The larger the field of view, the larger the field of view and the smaller the optical magnification. In layman's terms, the target object will not be included in the lens if it exceeds this angle.

[0078] The front camera is the camera on the front of the phone, which is mainly used for taking photos and video chatting. In addition, the front camera also has more functions, such as face unlocking and so on.

[0079] However, with the introduction of the full-screen concept, the front camera has become the biggest technical challenge in achieving the full-screen. The front camera layout schemes that have emerged in related technologies include bangs screen, water drop screen, widow's peak, hole screen, special-shaped screen, etc. However, in the above schemes, the presence of the front camera will destroy the integrity of the entire screen. In addition, the lifting design of the front camera, although the screen ratio is almost 100%, has many problems in terms of speed and life.

[0080] In addition to the above solutions, there is also an under-screen camera solution. However, due to the limitations of the current level of technology, this solution has obvious screen holes when the screen is on, which reduces the display effect. On the other hand, the screen transmittance can only reach 5%-20% of the normal requirements, and even less light can enter the front camera, so the imaging effect of the under-screen camera is poor.

[0081] Therefore, the present application provides a camera module, an image acquisition method and an electronic device, which can realize an image acquisition solution that uses two cameras with smaller sizes or smaller field of view angles to collaborate to complete imaging with a larger field of view angle. It can make full use of the narrower border area or black border area of ​​the screen of the full-screen electronic device, which is conducive to solving the problem of limited space in full-screen electronic devices and difficulty in arranging the front camera.

[0082] The electronic device provided by the present application. Specifically, the electronic device can be any one of various types of computer system devices that are mobile or portable and perform wireless communication ( Figure 1 Specifically, the electronic device may be a mobile phone or a smart phone (e.g., a phone based on iPhone TM, a phone based on Android TM), a portable gaming device (e.g., Nintendo DS TM, PlayStation Portable TM, Gameboy Advance TM, iPhone TM), a laptop, a PDA, a portable Internet device, a music player, and a data storage device, other handheld devices, and headsets, etc. The electronic device may also be other wearable devices that need to be charged (e.g., a head mounted device (HMD) such as an electronic bracelet, an electronic necklace, an electronic device, or a smart watch).

[0083] The electronic device can also be any one of a plurality of electronic devices, including but not limited to cellular phones, smart phones, other wireless communication devices, personal digital assistants, audio players, other media players, music recorders, video recorders, other media recorders, radios, medical devices, vehicle transportation instruments, calculators, programmable remote controls, pagers, laptop computers, desktop computers, printers, netbook computers, personal digital assistants (PDAs), portable multimedia players (PMPs), Moving Picture Experts Group (MPEG-1 or MPEGG-2) Audio Layer 3 (MP3) players, portable medical devices, and digital cameras and combinations thereof.

[0084] In some cases, the electronic device can perform multiple functions (e.g., play music, display video, store pictures, and receive and send phone calls). If desired, the electronic device can be a device such as a cellular phone, a media player, other handheld device, a wristwatch device, a pendant device, a handset device, or other compact portable device.

[0085] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0086] On the one hand, combined with Figure 1 and Figure 2As shown, this embodiment provides a camera module 10, which includes: at least two cameras 1; at least two cameras 1 are adjacent to each other, and the field of view angles of two adjacent cameras 1 among the at least two cameras 1 are at least partially connected or overlapped.

[0087] In the camera module 10 of the present embodiment, at least two cameras 1 are arranged adjacent to each other, and the markets of the two adjacent cameras 1 are at least partially connected or overlapped, and the images generated by at least two cameras 1 are at least partially connected or overlapped. By stitching the images respectively generated by the at least two cameras 1, a stitched image with a larger field of view angle can be generated, thereby realizing an image acquisition scheme of utilizing two cameras 1 with smaller sizes or smaller field of view angles to collaborate to complete imaging with a larger field of view angle.

[0088] Since the size or field of view of the camera 1 can be designed to be smaller, the space required for the assembly and light intake of the camera 1 is smaller, and the narrow border area or the black border area of ​​the screen of the full-screen electronic device can be fully utilized. This is conducive to solving the problem of limited space in electronic devices and difficulty in arranging the front camera 1.

[0089] The camera module 10 of this embodiment can be applied to the screen black border area of ​​a full-screen electronic device. The screen black border area is usually located at the edge of the screen cover (or glass cover). In order to connect the full-screen to the middle frame of the device, the screen cover is usually larger than the display panel below, and multiple edge areas are used to coat adhesive materials to bond and connect with the middle frame. However, the screen black border area will also reduce the screen-to-body ratio, so the width of the screen black border area is usually small, for example, 0.5mm-1mm.

[0090] The field of view of the camera 1 used in the related art is generally rectangular, and optical imaging is performed with a circular or nearly circular lens 11. The dimensions of this camera 1 on the X-axis (for example, the width direction of the full screen) and the Y-axis (for example, the height direction of the full screen) are comparable.

[0091] Taking the case where camera 1 is arranged in the black border area at the edge of the screen along the X-axis as an example, the X-axis field of view of camera 1 is not affected, but the Y-axis field of view is limited by the width of the black border area and cannot exceed 1 mm, so that the Y-axis field of view of camera 1 is restricted.

[0092] The camera module 10 of this embodiment adopts a method of stitching imaging of at least two cameras 1, making full use of the space along the X-axis in the black border area, so that the fields of view of the cameras 1 adjacent to each other along the X-axis are connected or partially overlapped, and the two adjacent cameras 1 have different orientations and can respectively capture images of different areas, which are then stitched into a complete image. The adjacent cameras 1 achieve complementary Y-axis field of view angles, avoiding the defect of insufficient Y-axis field of view angle of a single camera 1.

[0093] In addition, the field of view angles of the cameras 1 adjacent to each other along the X-axis are connected or partially overlapped in order to minimize the X-axis offset of the two images to be stitched, reduce the difficulty of angle matching of the images to be stitched, and prevent imaging errors.

[0094] In some possible implementations, the field of view angles of two adjacent cameras 1 of at least two cameras 1 overlap. Exemplarily, the edge lines of the field of view angles of the two cameras 1 overlap by 1°-3°.

[0095] In some possible implementations, the field of view angles of two adjacent cameras 1 of at least two cameras 1 are connected. Exemplarily, the edge lines of the field of view angles of the two cameras 1 overlap.

[0096] Optionally, the field of view angle of each camera 1 is 40°-50°, and the complementary field of view angle of two adjacent cameras 1 is 80°-100°.

[0097] Combination Figure 3 and Figure 4 As shown, in some embodiments, the optical centers of two adjacent cameras 1 among at least two cameras 1 are arranged at a target angle α; wherein α≤(θ1+θ2) / 2, θ1 and θ2 are the field of view angles of the two adjacent cameras 1, respectively.

[0098] The optical center is the center line of the light inlet of the camera 1, for example, the center line of the lens 11. The optical center is also the center of the field of view of the camera 1. By arranging two adjacent cameras 1 in the above manner, the field of view of the two cameras 1 can be complementary.

[0099] Exemplarily, the field of view angles θ1 and θ2 of two adjacent cameras 1 may be the same or different.

[0100] In this embodiment, the target angle α determines the degree of complementarity between two adjacent cameras 1. When the field of view of two adjacent cameras 1 is connected (refer to Figure 3 ), the target angle α takes the maximum value, α=(θ1+θ2) / 2. When the field of view angles of two adjacent cameras 1 partially overlap (refer to Figure 4 ), the value of the target angle α decreases, α<(θ1+θ2) / 2. And the more overlaps there are, the smaller the value of the target angle α becomes.

[0101] In some possible implementations, the target angle α has a value range of 1°-3°. Optionally, the target angle α has a value of, for example, 1°, 1.4°, 1.5°, 1.8°, 2°, 2.4°, 2.5°, 2.8°, 3°, etc.

[0102] Combination Figure 1 , Figure 3 and Figure 4 As shown, in some embodiments, two adjacent cameras 1 of the at least two cameras 1 are arranged along a first direction A, and the two adjacent cameras 1 are rotated and staggered around the axis of the first direction A, so that the orthographic projections of the optical centers of the two adjacent cameras 1 in a plane perpendicular to the first direction A are arranged at a target angle α. Optionally, the first direction A is one of the X-axis or the Y-axis.

[0103] By arranging two adjacent cameras 1 adjacent to each other along a first direction A and rotating them respectively, the orthographic projections of the optical centers of the two cameras 1 in a plane perpendicular to the first direction A are arranged at a target angle α, so that the field of view angles of the two cameras 1 are at least partially connected or overlapped, thereby achieving the complementarity of the field of view angles of the two cameras 1 perpendicular to the first direction A.

[0104] Combination Figure 2 , Figure 3 and Figure 4 As shown, in some embodiments, two adjacent cameras 1 of the at least two cameras 1 are arranged along a first direction A and staggered along a second direction B; wherein the second direction B is perpendicular to the first direction A. Optionally, the first direction A is one of the X axis or the Y axis, and the second direction B is the other of the X axis or the Y axis.

[0105] Two adjacent cameras 1 are rotated and staggered around the axis of the first direction A, so that the orthographic projections of the optical centers of the two adjacent cameras 1 in a plane perpendicular to the first direction A are arranged at a target angle α.

[0106] By arranging two adjacent cameras 1 adjacent to each other in an alternating manner and rotating them in an alternating manner, the orthographic projections of the optical centers of the two cameras 1 in a plane perpendicular to the first direction A can be arranged at a target angle α, thereby making the field of view angles of the two cameras 1 at least partially connected, thereby achieving the complementarity of the field of view angles of the two cameras 1 perpendicular to the first direction A.

[0107] Combination Figure 1 As shown, in some embodiments, each of the at least two cameras 1 includes a lens 11 and an image sensor 12, and the lens 11 is located on the photosensitive side of the image sensor 12; a first dimension of the lens 11 parallel to the first direction A is L1, and a second dimension of the lens 11 perpendicular to the first direction A is L2; ​​wherein the value range of L1:L2 is 1.5-2.5.

[0108] When the first size and the second size of the lens 11 meet the above-mentioned ratio range, the camera 1 is in a narrow rectangle, which can achieve complementary imaging while meeting the assembly requirements of the black border area of ​​the screen.

[0109] Exemplarily, the value of the ratio L1:L2 of the first size to the second size is, for example, 1.5, 1.6, 1.7, 1.8, 1.9, 2.0, 2.1, 2.2, 2.3, 2.4, 2.5, etc. Optionally, the value of the ratio L1:L2 of the first size to the second size is 2.0.

[0110] In other embodiments, the first dimension L1 has a value range of 0.5 mm-1.5 mm, and the second dimension L2 has a value range of 0.3 mm-1.0 mm.

[0111] When the first size L1 and the second size L2 of the lens 11 respectively meet the above value ranges, the camera 1 is in a narrow rectangle, which can achieve complementary imaging while meeting the assembly requirements of the black border area of ​​the screen.

[0112] Exemplarily, the value of the first dimension L1 is, for example, 0.5 mm, 0.6 mm, 0.7 mm, 0.8 mm, 0.9 mm, 1.0 mm, 1.1 mm, 1.2 mm, 1.3 mm, 1.4 mm, 1.5 mm, etc. Optionally, the first dimension L1:L2 is 1.0 mm.

[0113] Exemplarily, the value of the second dimension L3 is, for example, 0.3 mm, 0.4 mm, 0.5 mm, 0.6 mm, 0.7 mm, 0.8 mm, 0.9 mm, 1.0 mm, etc. Optionally, the value of the second dimension L2 is 0.6 mm.

[0114] Combination Figure 5 As shown, in some embodiments, the camera module 10 also includes an image processing unit 2; the image processing unit 2 is electrically connected to each camera 1 of at least two cameras 1, and the image processing unit 2 is used to receive a sub-image of each camera 1 and stitch the sub-images into a complete image according to the relative position relationship of the field of view angle of the camera 1.

[0115] The image processing unit 2 is used to receive the sub-images captured by each camera 1, and the sub-images are spliced ​​into a complete image according to the relative position relationship between each camera 1, so as to achieve the purpose of complementary imaging using the viewing angles of multiple cameras 1.

[0116] In some possible implementations, the image processing unit 2 stores and runs an image stitching algorithm based on feature points, and stitches sub-images into a complete image by running the image stitching algorithm based on feature points.

[0117] Combination Figure 5As shown, in some embodiments, the camera module 10 also includes a signal synchronization unit 3, which is electrically connected to each camera 1 of at least two cameras 1, and the signal synchronization unit 3 is used to control two adjacent cameras 1 to synchronously capture at least one frame of sub-image.

[0118] In order to ensure that all sub-images used to stitch together a complete image are captured at the same time and position, each camera 1 is electrically connected together through a signal synchronization unit 3, and the signal synchronization unit 3 is used to control two adjacent cameras 1 to capture sub-images at the same time, which is beneficial to improving the image acquisition quality of the camera module 10.

[0119] Combination Figure 5 As shown, in some embodiments, the signal synchronization unit 3 is used to control at least two cameras 1 to synchronously capture sub-images of each frame; or, the signal synchronization unit 3 is used to control at least two cameras 1 to synchronously capture sub-images of a target frame.

[0120] By using the signal synchronization unit 3 to control the acquisition of sub-images of each frame or target frame of the camera 1 , synchronous acquisition of the camera 1 can be achieved, thereby improving the imaging quality of the camera module 10 .

[0121] Exemplarily, the target frame is the third frame or the fourth frame. The sub-images of the third frame or the fourth frame usually have a better imaging effect, and using the sub-images of the third frame or the fourth frame for image stitching can ensure that the complete image has a better imaging effect.

[0122] In some embodiments, the signal synchronization unit 3 includes at least two first synchronization interfaces and at least one first synchronization signal line, the at least two first synchronization interfaces are respectively located on at least two cameras 1, and the at least one first synchronization signal line is electrically connected between the at least two first synchronization interfaces.

[0123] A first synchronization interface is arranged on each camera 1, and the first synchronization signal line is used to connect to the first synchronization interfaces of different cameras 1, so as to physically connect at least two cameras 1. Optionally, a camera 1 at one end of the first synchronization signal line is used as a master control end, and a camera 1 at the other end of the first synchronization signal line is used as a controlled end. When image acquisition is required, the camera 1 at the master control end is started and an electrical signal / optical signal is sent to the camera 1 at the controlled end. The controlled end and the master control end are started at the same time to complete the sub-image acquisition.

[0124] In some embodiments, the signal synchronization unit 3 further includes a second synchronization interface and a second synchronization signal line, the second synchronization interface is located on the image processing unit 2, and the second synchronization signal line is electrically connected between the second synchronization interface and at least one first synchronization interface. The signal processing unit and the camera 1 are electrically connected by the second synchronization signal line, and the signal processing unit can synchronously obtain the synchronization signal of the camera 1, and receive and splice the sub-image data transmitted from the camera 1. The signal processing unit can also use the second synchronization signal line to perform synchronization command control on the camera module 10.

[0125] On the other hand, combined Figure 6 and Figure 7 As shown, this embodiment provides an electronic device, which includes: the camera module 10 of the present application, as well as a screen assembly 20 and a shell assembly; the screen assembly 20 is connected to the shell assembly, and the screen assembly 20 includes a cover plate, at least part of the edge of the cover plate overlaps with the shell assembly to form a micro-slit area 4; the orthographic projection of the image acquisition end of the camera module 10 on the screen assembly 20 overlaps at least part of the micro-slit area 4. Among them, the image acquisition end of the camera module 10 includes the lens 11 of the camera 1. The shell assembly includes a middle frame structure, such as a metal middle frame, a plastic middle frame, etc.

[0126] The electronic device of this embodiment adopts the camera module 10 of the present application and has all the beneficial technical effects of all the embodiments herein.

[0127] In the electronic device of this embodiment, the area where the cover plate of the screen assembly 20 overlaps with the shell assembly forms a micro-slit area 4, which is also a black border area. The orthographic projection of the image acquisition end of the camera module 10 on the screen assembly 20 at least partially overlaps with the micro-slit area 4 or is completely located in the micro-slit area 4, and does not occupy the display area of ​​the screen, so that the electronic device has a higher screen-to-body ratio.

[0128] In some possible implementations, the shell assembly is provided with a step surface, and at least a portion of the cover plate overlaps the step surface, and the area of ​​the step surface covered by the cover plate forms the above-mentioned micro-gap area 4.

[0129] In some other possible implementations, at least one edge of the cover member overlaps with the housing assembly to form the above-mentioned micro-gap area 4. The edge may be one of the two wide sides or one of the two long sides of the cover member.

[0130] Exemplarily, the wide side of the cover member located at the upper edge of the screen assembly 20 (eg, the upper edge of the Y-axis) overlaps with the shell assembly to form the above-mentioned micro-gap area 4.

[0131] Combination Figure 7As shown, in some embodiments, at least two windows 41 are provided in the micro-slit area 4, and each of the at least two windows 41 corresponds to at least one camera 1; the camera 1 includes a lens 11, and the shapes of the at least two windows 41 are the same as the shape of the lens 11. Among them, the micro-slit area 4 extends along the first direction A (for example, the X axis), and the at least two windows 41 are arranged along the first direction A, which can make full use of the lateral space of the micro-slit area 4 and realize complementary imaging of multiple cameras 1.

[0132] The lens 11 of the present application is designed as a narrow rectangle with a larger X-axis and a smaller Y-axis. The window 41 of the same shape is used to reduce the appearance proportion of the window 41 and improve the overall appearance of the screen assembly 20.

[0133] In some embodiments, at least two windows 41 are respectively covered with decorative film layers, and the decorative film layers can allow visible light to pass through. By irradiating the decorative film layers on the windows 41, the visual damage of the windows 41 to the overall effect of the screen assembly 20 can be reduced, thereby improving the overall effect of the electronic device.

[0134] In some possible implementations, the screen assembly 20 may include a display panel, which is connected to the cover member, and the area of ​​the display panel is smaller than the cover member, so that an area around the cover member is reserved for overlapping with the housing assembly. Optionally, the display panel may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.

[0135] In some possible implementations, the terminal device may include a radio frequency (RF) circuit, a memory including one or more computer-readable storage media, an input unit, a display unit, a sensor, an audio circuit, a Wi-Fi module, a processor including one or more processing cores, and a power supply and other components.

[0136] On the other hand, combined Fig. 9 As shown, this embodiment provides an image acquisition method, which is applied to the camera module 10 or electronic device of the present application. The image acquisition method includes:

[0137] Step S1, controlling at least two cameras 1 to synchronously capture sub-images.

[0138] Step S2, determining the relative position of at least two sub-images according to the position of each camera 1 of the at least two cameras 1.

[0139] Step S3: stitching at least two sub-images into a complete image.

[0140] The image acquisition method of this embodiment is applied to the camera module 10 or electronic device of this application, and has all the beneficial technical effects of all the embodiments of this invention. By using this image acquisition method, at least two cameras 1 with smaller field of view angles can complete image acquisition with a larger field of view angle through the complementary field of view angles, meeting the working requirements of the front camera 1 in the border or black border area of ​​the full-screen electronic device.

[0141] In some embodiments, step S1 controls at least two cameras 1 to synchronously capture sub-images, including:

[0142] Step S11, synchronizing at least one parameter setting of shutter speed, focal length, aperture, contrast, saturation, brightness, exposure, and sharpness of at least two cameras 1.

[0143] Step S12, controlling at least two cameras 1 to synchronously capture at least one frame of sub-image.

[0144] By synchronously controlling the control parameters of camera 1, such as shutter speed, focal length, aperture, contrast, saturation, brightness, exposure, sharpness, etc., the imaging quality and imaging effect of each camera 1 are made the same or at least similar, thereby avoiding imaging differences between sub-images generated by different cameras 1 and affecting the effect of the stitched image.

[0145] In some embodiments, step S12 controls at least two cameras 1 to synchronously capture at least one frame of sub-image, including:

[0146] Step S121, controlling the two cameras 1 to synchronously capture the sub-image of each frame.

[0147] Alternatively, controlling at least two cameras 1 to synchronously capture at least one frame of sub-image includes:

[0148] Step S122, controlling the two cameras 1 to synchronously capture a sub-image of a target frame; the target frame includes at least one frame from the second frame to the fifth frame.

[0149] By controlling the camera 1 to synchronously capture the sub-images of each frame or target frame, the imaging quality and imaging effect of each camera 1 are made the same or at least similar, ensuring that the sub-images can be smoothly spliced ​​and have a good imaging effect.

[0150] When the camera 1 based on optical imaging technology is working, it usually captures multiple sub-images within an extreme time, among which the sub-images from the second frame to the fifth frame usually have better imaging effects. Using the sub-images from the second frame to the fifth frame for image stitching can ensure that the complete image has better imaging effects.

[0151] In some embodiments, step S2 determines the relative position of at least two sub-images according to the position of each camera 1 of the at least two cameras 1, including:

[0152] Step S21 : if the field of view angles of two adjacent cameras 1 are at least partially connected, then the edges of the sub-images output by the two adjacent cameras 1 are controlled to be connected.

[0153] Alternatively, step S2 determines the relative position of at least two sub-images according to the position of each camera 1 of at least two cameras 1, including:

[0154] Step S22: if the field of view angles of two adjacent cameras 1 at least partially overlap, control the sub-images output by the two adjacent cameras 1 to at least partially overlap.

[0155] Different stitching strategies can be adopted according to the connection or overlap of the field of view angles of two adjacent cameras 1 to meet different scene requirements.

[0156] In some embodiments, controlling the sub-images output by two adjacent cameras 1 to at least partially overlap in step S22 includes:

[0157] Step S221 : determining an overlapping area of ​​at least two sub-images according to the color temperatures of the sub-images output by two adjacent cameras 1 .

[0158] When the field of view angles of two adjacent cameras 1 partially overlap, the color temperatures of images of the same or similar areas captured by different cameras 1 are usually the same or similar. According to the distribution law of color temperature, the areas with the same or similar color temperature in at least two sub-images are overlapped, and the overlapping area will be consistent with the overlapping relationship of the field of view angle of camera 1, thereby completing the stitching of at least two sub-images.

[0159] In some embodiments, controlling the sub-images output by two adjacent cameras 1 to at least partially overlap in step S22 includes:

[0160] Step S221 , determining an overlapping area of ​​at least two sub-images according to infrared spot patterns in an overlapping area of ​​the field of view of two adjacent cameras 1 .

[0161] When the field of view angles of two adjacent cameras 1 partially overlap, a laser generator is used to project one or more infrared spot patterns in front of the camera module 10, and the infrared spot patterns are ensured to be located in the overlapping area of ​​the field of view angles of the two adjacent cameras 1. Different cameras 1 collect infrared spot patterns respectively, and then based on a feature point algorithm or a pattern overlap algorithm, the infrared spot patterns in at least two sub-images are overlapped, so that at least two sub-images can be spliced.

[0162] In some embodiments, step S3 stitches at least two sub-images into a complete image, including:

[0163] Step S31, selecting one of the sub-images as a reference image, and establishing a reference coordinate system in the reference image.

[0164] Step S32, mapping the remaining sub-images into the reference coordinate system.

[0165] Step S33: using an image fusion algorithm to eliminate the seams between at least two sub-images.

[0166] Through the above-mentioned steps S31 to S33, the sub-images generated by different cameras 1 can be converted and fused, so as to facilitate splicing and eliminate the seams between the sub-images.

[0167] It should be noted that the "several" and "at least one" mentioned in this article refer to one or more, and "multiple" and "at least two" refer to two or more. "And / or" describes the association relationship of the associated objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0168] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0169] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0170] In the description of this specification, the reference terms "certain embodiments", "one embodiment", "some embodiments", "illustrative embodiments", "example", "specific example", or "some examples" mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application.

[0171] The above description is only an embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the principles of the present application shall be included in the protection scope of the present application.

Claims

1. A camera module, characterized in that: The camera module (10) comprises: at least two cameras (1); The at least two cameras (1) are adjacent to each other, and the field of view angles of two adjacent cameras (1) among the at least two cameras (1) are at least partially connected or overlapped.

2. The camera module according to claim 1, characterized in that: The optical centers of two adjacent cameras (1) of the at least two cameras (1) are arranged at a target angle α; Wherein, α≤(θ1+θ2) / 2, θ1 and θ2 are the field of view angles of two adjacent cameras (1) respectively.

3. The camera module according to claim 1 or 2, characterized in that: Two adjacent cameras (1) of the at least two cameras (1) are arranged along a first direction, and the two adjacent cameras (1) are respectively rotated and staggered around an axis of the first direction, so that the orthographic projections of the optical centers of the two adjacent cameras (1) in a plane perpendicular to the first direction are arranged at a target angle α.

4. The camera module according to claim 3, characterized in that: Each camera (1) of the at least two cameras (1) comprises a lens (11) and an image sensor (12), wherein the lens (11) is located on a light-sensitive side of the image sensor (12); A first dimension of the lens (11) parallel to the first direction is L1, and a second dimension of the lens (11) perpendicular to the first direction is L2; Among them, the value range of L1:L2 is 1.5-2.5; and / or, The first dimension L1 has a value range of 0.5 mm to 1.5 mm, and the second dimension L2 has a value range of 0.3 mm to 1.0 mm.

5. The camera module according to any one of claims 1 to 4, characterized in that: The camera module (10) further comprises an image processing unit (2); The image processing unit (2) is electrically connected to each of the at least two cameras (1), and is used to receive a sub-image from each of the cameras (1), and to stitch the sub-images together into a complete image based on the relative positional relationship of the field of view angles of the cameras (1).

6. The camera module according to any one of claims 1 to 5, characterized in that: The camera module (10) further comprises a signal synchronization unit (3), wherein the signal synchronization unit (3) is electrically connected to each of the at least two cameras (1), and the signal synchronization unit (3) is used to control two adjacent cameras (1) to synchronously capture at least one frame of sub-image.

7. The camera module according to claim 6, characterized in that: The signal synchronization unit (3) is used to control the at least two cameras (1) to synchronously capture the sub-image of each frame; or, The signal synchronization unit (3) is used to control the at least two cameras (1) to synchronously capture the sub-images of the target frame.

8. The camera module according to claim 6, characterized in that: The signal synchronization unit (3) comprises at least two first synchronization interfaces and at least one first synchronization signal line, wherein the at least two first synchronization interfaces are respectively located on the at least two cameras (1), and the at least one first synchronization signal line is electrically connected between the at least two first synchronization interfaces.

9. The camera module according to claim 8, characterized in that: The signal synchronization unit (3) further comprises a second synchronization interface and a second synchronization signal line, wherein the second synchronization interface is located on the image processing unit (3), and the second synchronization signal line is electrically connected between the second synchronization interface and at least one of the first synchronization interfaces.

10. An electronic device, characterized in that: The electronic device comprises: the camera module (10) according to any one of claims 1 to 9, as well as a screen assembly (20) and a housing assembly (30); The screen assembly (20) is connected to the shell assembly (30), the screen assembly (20) comprises a cover plate, at least part of the edge of the cover plate overlaps with the shell assembly (30) to form a micro-gap area (4); The orthographic projection of the image acquisition end of the camera module (10) on the screen component (20) at least partially overlaps with the micro-slit area (4).

11. The electronic device according to claim 10, characterized in that: At least two viewing windows (41) are provided in the micro-slit area (4), and each of the at least two viewing windows (41) corresponds to at least one of the cameras (1); The camera (1) comprises a lens (11), and the shape of the at least two viewing windows (41) is the same as the shape of the lens (11).

12. The electronic device according to claim 11, characterized in that: The at least two viewing windows (41) are respectively covered with decorative film layers, and the decorative film layers are capable of allowing visible light to pass through.

13. An image acquisition method, characterized in that: The camera module (10) applied to any one of claims 1 to 9 or the electronic device according to any one of claims 10 to 12, wherein the image acquisition method comprises: Controlling the at least two cameras (1) to synchronously capture sub-images; Determining the relative position of at least two sub-images according to the position of each of the at least two cameras (1); At least two of the sub-images are spliced ​​together to form a complete image.

14. The image acquisition method according to claim 13, characterized in that: The controlling the at least two cameras (1) to synchronously capture sub-images comprises: Synchronizing at least one parameter setting of shutter speed, focal length, aperture, contrast, saturation, brightness, exposure, and sharpness of the at least two cameras (1); Controlling the at least two cameras (1) to synchronously capture at least one frame of the sub-image.

15. The image acquisition method according to claim 14, characterized in that: The controlling the at least two cameras (1) to synchronously capture at least one frame of the sub-image comprises: Controlling the two cameras (1) to synchronously capture the sub-image of each frame; or, The two cameras (1) are controlled to synchronously capture the sub-image of a target frame; the target frame comprises at least one frame from the second frame to the fifth frame.

16. The image acquisition method according to claim 13, characterized in that: The step of determining the relative position of at least two sub-images according to the position of each of the at least two cameras (1) comprises: If the viewing angles of two adjacent cameras (1) are at least partially connected, the edges of the sub-images output by the two adjacent cameras (1) are controlled to be connected; or, If the viewing angles of two adjacent cameras (1) at least partially overlap, the sub-images output by the two adjacent cameras (1) are controlled to at least partially overlap.

17. The image acquisition method according to claim 16, characterized in that: The step of controlling the sub-images output by two adjacent cameras (1) to at least partially overlap comprises: Determining an overlapping area of ​​at least two of the sub-images according to the color temperatures of the sub-images output by two adjacent cameras (1); and / or, The overlapping area of ​​at least two sub-images is determined based on the infrared spot pattern in the overlapping area of ​​the field of view of two adjacent cameras (1).

18. The image acquisition method according to any one of claims 13 to 17, characterized in that: The step of stitching at least two of the sub-images into a complete image comprises: Selecting one of the sub-images as a reference image, and establishing a reference coordinate system in the reference image; Mapping the remaining sub-images into the reference coordinate system; An image fusion algorithm is used to eliminate the seams between at least two of the sub-images.

Images