Image acquisition module and electronic equipment

Abstract

The invention discloses an image acquisition module and electronic equipment. The image acquisition module comprises a carrier used for bearing an electronic component; the first photosensitive component is arranged at a first position of the carrier and is used for acquiring a first image signal; the second photosensitive component is arranged at a second position of the carrier and is used for acquiring a second image signal; the signal processing module is arranged at a third position of the carrier and is in signal connection with the first photosensitive component and the second photosensitive component; wherein the signal processing module can perform different processing on the first image signal or the second image signal under the condition that the image acquisition module supports the target equipment to realize different function services so as to output different processing results, and the target equipment is electronic equipment which establishes target communication connection with the image acquisition module. The electronic equipment comprises a first processor and the image acquisition module.

Description

Technical Field

[0001] The present application relates to the field of image acquisition technology, and in particular to an image acquisition module and an electronic device. Background Art

[0002] With the continuous development of electronic information technology and image processing technology, the functions that need to be realized by image acquisition modules in electronic devices are increasing.

[0003] In order to support electronic devices to realize different functions, more devices are set in the image acquisition module, or multiple groups of different image acquisition modules need to be set in the electronic device, so that the image acquisition modules deployed in the electronic device need to occupy a large space. Summary of the invention

[0004] On the one hand, the present application provides an image acquisition module, including:

[0005] A carrier for carrying electronic components;

[0006] A first photosensitive component disposed at a first position of the carrier, for acquiring a first image signal;

[0007] A second photosensitive component disposed at a second position of the carrier, for collecting a second image signal;

[0008] A signal processing module disposed at a third position of the carrier, connected to the first photosensitive component and the second photosensitive component by signal;

[0009] Among them, the signal processing module can perform different processing on the first image signal or the second image signal to output different processing results when the image acquisition module supports the target device to implement different functional services. The target device is an electronic device that establishes a target communication connection with the image acquisition module.

[0010] In a possible implementation, the signal processing module includes: an image signal processing unit and an artificial intelligence processing unit having a signal connection;

[0011] In a case where the image acquisition module supports the target device to implement a first functional service, the image signal processing unit performs a first processing on the first image signal to output a first target image;

[0012] and / or,

[0013] When the image acquisition module supports the target device to implement a second functional service, the second image signal is subjected to a second processing by the artificial intelligence processing unit to output a target recognition result or a target detection result.

[0014] In another possible implementation, the image acquisition module further includes a third photosensitive component disposed at a fourth position of the carrier, and the third photosensitive component is used to acquire a third image signal;

[0015] Wherein, the second photosensitive component and the third photosensitive component are configured to acquire corresponding image signals in time-sharing;

[0016] or,

[0017] The signal processing module is configured to acquire the second image signal and the third image signal in a time-sharing manner.

[0018] In another possible implementation, the third photosensitive component includes a third image sensor and a third lens matched therewith, and the third image sensor is signal-connected to the signal processing module;

[0019] The second photosensitive component includes a second image sensor and a second lens matched therewith;

[0020] The third image sensor is the same as the second image sensor, and the third lens is the same as the second lens.

[0021] In another possible implementation, the carrier includes a first bearing surface and a second bearing surface disposed opposite to each other;

[0022] The second photosensitive component is disposed at a second position of the first carrying surface, and the third photosensitive component is disposed at a fourth position of the second carrying surface;

[0023] and / or,

[0024] The first photosensitive component is arranged at a first position of the first carrying surface, and the first photosensitive component includes a first image sensor and a first lens matching therewith. The first image sensor is different from the second image sensor, and the first lens is the same as or different from the second lens.

[0025] In yet another possible implementation, the carrier includes a first carrier and a second carrier, and the first carrier and the second carrier are connected via a flexible circuit board signal;

[0026] The second photosensitive component is disposed at a second position of the first carrier, and the third photosensitive component is disposed at a fourth position of the second carrier;

[0027] The first carrier and the second carrier are located in the same plane or in two parallel planes;

[0028] The cooperation between the second lens and the third lens enables the image acquisition module to obtain a panoramic image signal of the spatial environment.

[0029] In another possible implementation, the image acquisition module further includes a scheduling unit disposed between the second photosensitive component, the third photosensitive component and the signal processing module;

[0030] The scheduling unit can respond to different control signals to connect the signal path between the second photosensitive component, the third photosensitive component and the signal processing module, or,

[0031] A signal path is conducted between the second photosensitive component, the third photosensitive component and a target processor of a target device.

[0032] On the other hand, the present application further provides an electronic device, including a first processor and an image acquisition module, wherein the image acquisition module includes:

[0033] A carrier for carrying electronic components, and establishing a target communication connection with the first processor;

[0034] A first photosensitive component disposed at a first position of the carrier, for acquiring a first image signal;

[0035] A second photosensitive component disposed at a second position of the carrier, for collecting a second image signal;

[0036] A signal processing module disposed at a third position of the carrier, connected to the first photosensitive component and the second photosensitive component by signal;

[0037] The signal processing module can perform different processing on the first image signal or the second image signal to output different processing results when the electronic device implements different functional services.

[0038] In yet another possible implementation, the signal processing module includes an image signal processing unit and an artificial intelligence processing unit having a signal connection;

[0039] The image acquisition module further includes a third photosensitive component disposed at a fourth position of the carrier, and the third photosensitive component is used to acquire a third image signal;

[0040] In the case where the electronic device implements the first functional service, the image signal processing unit processes the first image signal into an infrared image or an RGB image and provides it to a first application of the electronic device;

[0041] And / or, when the electronic device implements the second functional service, the second image signal or the third image signal is identified or detected by the artificial intelligence processing unit, so that the first processor controls the electronic device to perform a corresponding response action based on the obtained identification result or detection result.

[0042] In another possible implementation, the image acquisition module further includes a third photosensitive component disposed at a fourth position of the carrier, and the third photosensitive component is used to acquire a third image signal;

[0043] The electronic device is capable of generating a target control signal in response to a target operation acting on the electronic device;

[0044] The target control signal can control the scheduling unit arranged between the second photosensitive component, the third photosensitive component and the signal processing module to conduct the signal path between the second photosensitive component, the third photosensitive component and the second processor of the electronic device, so as to utilize the second processor to process the acquired second image signal and / or third image signal into a second target image. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0046] Figure 1 A schematic diagram of the structure of the image acquisition module provided in this application;

[0047] Figure 2 A schematic diagram of another composition structure of the image acquisition module provided in this application;

[0048] Figure 3 This is an example diagram of the relative position relationship between the various components in the image acquisition module in this application.

[0049] Figure 4 A schematic diagram of data transmission between components in the image acquisition module in this application;

[0050] Figure 5 A schematic diagram of a composition structure of an electronic device provided in this application;

[0051] Figure 6 A schematic diagram of a framework for controlling a scheduling unit in an image acquisition module of an electronic device in the present application to perform a switching operation. DETAILED DESCRIPTION

[0052] The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation mode of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application. It is known to those skilled in the art that with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0053] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0054] The image acquisition module provided by this application is first introduced below.

[0055] like Figure 1 , showing a schematic diagram of the composition structure of the image acquisition module provided in an embodiment of the present application.

[0056] Depend on Figure 1 It can be seen that the image acquisition module 100 includes:

[0057] A carrier 101 for carrying electronic components;

[0058] A first photosensitive component 102 disposed at a first position of the carrier 101;

[0059] A second photosensitive component 103 disposed at a second position of the carrier 101;

[0060] And a signal processing module 104 is disposed at a third position of the carrier 101 .

[0061] The first photosensitive component 102 is used to obtain a first image signal.

[0062] The second photosensitive component 103 is used to collect a second image signal.

[0063] The signal processing module 104 is connected to the first photosensitive component 102 and the second photosensitive component 103 by signal.

[0064] Among them, the signal processing module can perform different processing on the first image signal or the second image signal to output different processing results when the image acquisition module supports the target device to implement different functional services.

[0065] Among them, the target device is an electronic device that establishes a target communication connection with the image acquisition module. For example, the target device can be an electronic device equipped with the image acquisition module or connected to the image acquisition module. Accordingly, when the target device is equipped with the image acquisition module, the target communication connection is achieved by welding the carrier of the image acquisition module to the mainboard of the electronic device or plugging it into the corresponding interface on the mainboard of the electronic device through the MIPI interface or the USB interface, and there is no restriction on this. When the target device is connected to the image acquisition module, the target device and the image acquisition module can achieve the target communication connection through lines such as USB, and there is no restriction on this.

[0066] The target device may be a computer processing device such as a mobile phone, a laptop computer, a tablet computer, or an All-in-One PC (AIO for short).

[0067] In a possible implementation, the carrier is not only a support for the electronic components, but also a carrier for the electronic components to realize signal connection (i.e., electrical signal connection or electrical connection). On this basis, the signal processing module 104 and the first photosensitive component 102 and the second photosensitive component 103 provide the carrier with signal connection. For example, the carrier can be a printed circuit board (PCB).

[0068] In the present application, the photosensitive component may be composed of an image sensor and a lens. Correspondingly, the first photosensitive component may include a first image sensor and a first lens, and the second photosensitive component may include a second image sensor and a second lens. On this basis, the signal connection between the signal processing module and the first photosensitive component is actually the signal connection between the signal processing module and the first image sensor. Similarly, the signal connection between the signal processing module and the second photosensitive component is actually the signal connection between the signal processing module and the second image sensor.

[0069] In the present application, the first photosensitive component and the second photosensitive component are different types of photosensitive components. The image signals collected by the first photosensitive component and the second photosensitive component can be image signals required for different functional services.

[0070] For example, in a possible implementation, the first photosensitive component may collect a first image signal that is an RGB image signal (i.e., an image signal in the visible spectrum, that is, an image within the spectrum that can be perceived by the human eye) or an infrared image signal (also called an IR image signal). For example, the first photosensitive component includes a first image sensor and a first lens, and the first image sensor is an image sensor that can collect visible light and infrared light, that is, a hybrid visible light / infrared light sensor.

[0071] The second image signal collected by the second photosensitive component is a panoramic image signal. For example, the second photosensitive component includes a second image sensor and a second lens, and the second image sensor is a detection sensor, also known as a perception sensor. The second lens is a wide-angle lens, for example, the second lens can be a fisheye lens with a viewing angle close to 180 degrees.

[0072] In the present application, the signal processing module may have many possibilities, such as the signal processing module may be a digital signal processing (DSP) chip, and of course, may also be other types of processing chips, without limitation.

[0073] Among them, the image acquisition module can support a variety of functional services for the target device. For example, the functional services that the image acquisition module can support the target device to implement include but are not limited to: face recognition function, image acquisition function, environment judgment function and full-space perception function. Among them, the image acquisition function includes image acquisition for video calls, or the target device captures and stores images. The environment judgment function is used to determine the environmental information of the target device. The full-space perception function is used to achieve target detection or object recognition. For example, the full-space perception function can be used to monitor the appearance or movement of specified tasks, objects or other objects in the electronic device cycle; or to realize object recognition functions such as identifying set target objects.

[0074] When the image processing module needs to support different functional services implemented by the target device, the source of the image signal that the image processing module needs to process and the specific processing of the image signal will also be different. Based on this, the signal processing module will determine whether the image signal from the first photosensitive component or the second photosensitive component needs to be processed to implement the functional service based on the functional service currently required by the target device, and process the image signal from the corresponding photosensitive component to obtain the processing result corresponding to the functional service.

[0075] For example, when the first image sensor of the first photosensitive component is a hybrid visible light / infrared light sensor, and the second image sensor of the second photosensitive component is a perception sensor, when the image processing module supports the target device to realize face login, face verification or video call, the signal processing module processes the first image signal collected by the first photosensitive component to meet the requirements of RGB image or IR image; when the image processing module supports the target device to realize panoramic perception or object detection, the signal processing module needs to identify and process the second image signal to obtain an object recognition result, such as whether the target object is perceived, and the specific location of the perceived target object.

[0076] From the above content, it can be known that in the present application, the image acquisition module carries a first photosensitive component for acquiring a first image signal, a second photosensitive component for acquiring a second image signal, and a signal processing module connected to the first photosensitive component and the second photosensitive component signal through a carrier. The signal processing module can process the first image signal obtained by the first photosensitive component or the second image signal obtained by the second photosensitive component according to the functional service that the image acquisition module needs to support the target device to implement, so as to output different processing results, so that one image acquisition module can support electronic devices to implement different functional services, reducing the number of image acquisition modules that need to be deployed or connected by electronic devices, and naturally reducing the space required for deploying or connecting image acquisition modules.

[0077] Moreover, in the present application, only one signal processing module is needed in the image processing module to meet the needs of the target device to realize different functional services, so there is no need to set different signal processing modules in the image processing module for different image sensor elements, thereby reducing the number of components in the image processing module, and further reducing the volume of the image processing module, which can naturally reduce the space required for electronic equipment to deploy or connect the image processing module.

[0078] It is understandable that the signal processing module can realize the specific implementation of processing the image signals collected by different photosensitive components and there are also multiple possibilities for implementation.

[0079] In a possible implementation, the signal processing module includes: an image signal processing unit and an artificial intelligence processing unit having a signal connection. Figure 2 , which shows another schematic diagram of the composition structure of the image acquisition module provided in an embodiment of the present application.

[0080] like Figure 2 The signal processing module 104 in the image acquisition module includes: an image signal processing unit 1041 and an artificial intelligence processing unit 1042.

[0081] exist Figure 2 On the basis of this, when the image acquisition module supports the target device to implement the first functional service, the first image signal obtained by the first photosensitive component 102 is processed by the image signal processing unit 1041 to output the first target image.

[0082] The first functional service is a function that needs to be implemented by using the first image signal collected by the first photosensitive component. For example, the first functional service can be a task function belonging to image collection, such as face login, video call or image capture.

[0083] The image signal processing unit can also be called the ISP (Image Signal Processing) module. Its main function is to post-process the signal output by the front-end image sensor. Its main functions include linear correction, noise removal, bad pixel removal, interpolation, white balance, automatic exposure control, etc. ISP technology determines the imaging quality of the camera to a large extent.

[0084] In the present application, the ISP unit can perform post-processing such as linear correction, noise removal, and bad pixel removal on the first image signal when the image processing and acquisition module needs to support the target device to realize face login, obtain video calls and other image acquisition-related functions, and the first target image output by the ISP unit can be at least one of an RGB image and an IR image.

[0085] In particular, in order to improve the security of face recognition during face login, it is necessary to improve the anti-attack or anti-counterfeiting of the image. On this basis, the image acquisition module also includes an infrared light-emitting unit, which is used to output infrared light. For example, the infrared light-emitting unit can be a flood infrared LED lamp for outputting infrared light. In the process of the first perception unit obtaining the first image signal, the infrared light-emitting unit is turned on and outputs infrared light.

[0086] exist Figure 2 When the signal processing module of the image acquisition module includes an artificial intelligence processing unit (artificial intelligence AI chip), and when the image acquisition module supports the target device to implement a second functional service, the second image signal captured by the second photosensitive component 103 is subjected to a second processing by the artificial intelligence processing unit 1042 to output a target recognition result or a target detection result.

[0087] The second functional service is a function that needs to be implemented by means of the second image signal collected by the second photosensitive component. For example, the second functional service may be a functional service such as scene recognition or object perception.

[0088] Among them, the second processing of the second image signal by the artificial intelligence processing unit includes but is not limited to: analyzing the scene environment represented by the second image signal, identifying objects such as people and objects in the second image signal, and dynamically capturing object change information.

[0089] It is understandable that, depending on the difference of the second functional service, the second processing of the second image signal by the artificial intelligence processing unit will also be different, and accordingly, the result obtained by the second processing will also be different.

[0090] For example, when the second functional service is scene recognition, by performing the second processing on the second image signal, a target recognition result can be output, and the target recognition result can represent the recognized scene information. The target recognition result can be image data or text data, for example, the target recognition result can be an image representing the scene or language description information describing the scene.

[0091] For another example, when the second functional service is object perception, the artificial intelligence processing unit can output a target detection result by performing a second processing on the second image signal, and the target detection result can be an object detection result (or an object perception result) used to characterize the object detection situation. The target detection result can be image data or text data. For example, the target detection result can be an image of the detected object, an object identifier, or object description information such as a feature or position information describing the object.

[0092] Among them, the artificial intelligence processing unit can perform the second image signal processing with the help of artificial intelligence technologies such as neural networks or machine learning, without specific restrictions.

[0093] Of course, the signal processing module can support the operations performed by the above artificial intelligence processing unit and the image signal processing unit at the same time, or it can only support the corresponding operations performed by one of the artificial intelligence processing unit and the image signal processing unit.

[0094] Based on any one of the above embodiments of the image acquisition module, the image acquisition module further includes a third photosensitive component disposed at a fourth position of the carrier, and the third photosensitive component is used to acquire a third image signal.

[0095] Combination Figure 2 Description, by Figure 2 It can be seen that a third photosensitive component 105 is also provided on the carrier 101 of the image acquisition module, and the third photosensitive component has a signal connection with the signal processing module.

[0096] In one possible scenario, the second photosensitive component and the third photosensitive component are configured to acquire corresponding image signals in a time-sharing manner. That is, at the same time, only the second photosensitive component can acquire the second image signal, or the third photosensitive component can acquire the third image signal, so that the signal processing module can only obtain the second image signal or the third image signal at the same time.

[0097] For example, acquisition rules such as image acquisition frequency may be configured in the respective firmware of the second photosensitive component and the third photosensitive component (such as the firmware of the image sensor of the photosensitive component), or control rules for controlling the second photosensitive component and the third photosensitive component to acquire image signals in time-sharing may be configured in the firmware of the signal processing module. For example, the power on and off or working status of the second photosensitive component and the third photosensitive component may be controlled to ensure that only the second photosensitive component or the third photosensitive component acquires images at each moment.

[0098] In another possible case, the signal processing module is configured to acquire the second image signal and the third image signal in a time-sharing manner. In this case, the image acquisition moments of the second photosensitive component and the third photosensitive component are not limited, but the signal processing module cannot simultaneously acquire the image signals acquired by the two photosensitive components, so that the signal processing module can only acquire the second image signal or the third image signal at the same time.

[0099] For example, the signal processing module may be configured with image acquisition rules for time-sharing acquisition. For example, when the signal processing module includes an artificial intelligence processing unit, image acquisition rules for time-sharing acquisition of the second image signal and the third image signal may be configured in the artificial intelligence processing unit.

[0100] In the above two cases, the signal processing module can only obtain and process the second image signal or the third image signal at the same time. In this way, one signal processing module can realize time-sharing processing of the image signals from the second photosensitive component and the third photosensitive component, without the need to separately set up a signal processing module for processing the second image signal and a signal processing module for processing the third image signal. This can reduce the number of components that need to be set in the image acquisition module, naturally reduce the volume of the image acquisition module, and thus reduce the space occupied by the image acquisition module.

[0101] In a possible implementation, when the second photosensitive component includes a second image sensor and a second lens matched with the second image sensor, the third photosensitive component may include a third image sensor and a third lens matched with the third image sensor. The third image sensor is signal-connected to the signal processing module.

[0102] In this implementation, the third image sensor is the same as the second image sensor, and the third lens is the same as the second lens, so that the first photosensitive component and the second photosensitive component can be the same type of photosensitive components.

[0103] For example, when the second image signal collected by the second photosensitive component is a 180-degree panoramic image signal (which may be a panoramic image signal close to 180 degrees), the third image signal collected by the third photosensitive component is also a 180-degree panoramic image signal. Since the second photosensitive component and the third photosensitive component are located at different positions, under the premise that the image acquisition module is deployed in the target device or connected to the target device, the second photosensitive component and the third photosensitive component cooperate to obtain images within a larger viewing angle around the electronic device at different times. For example, the second image sensor of the second photosensitive component and the third image sensor of the third photosensitive component are detection sensors (perception sensors), and the second lens and the third lens are fisheye lenses or other wide-angle lenses with a viewing angle close to 180 degrees.

[0104] It is understandable that, since the second photosensitive component and the third photosensitive component are the same type of photosensitive components, the third image signal acquired by the third photosensitive component and the second image signal acquired by the second photosensitive component can be used to support the target device to implement the same functional service. On this basis, when the signal processing module confirms that the second image signal needs to be processed based on the functional service currently implemented by the target device supported by the image acquisition module, the signal processing module actually needs to process the second image signal and the third image signal obtained in time sharing.

[0105] For example, based on the premise that the image acquisition module supports the target device to perform object perception, the signal processing module needs to process the currently obtained second image signal or third image signal to obtain the object perception result. Among them, the signal processing module does not need to distinguish the sources of the second image signal and the third image signal, and can analyze the second image signal and the third image signal respectively at different times, so as to determine the object perception result by processing the second image signal or the third image signal at multiple times.

[0106] On the premise that the image sensors and lenses of the second photosensitive component and the third photosensitive component are the same, in order to utilize the second photosensitive component and the third photosensitive component to obtain images within a wider viewing angle range, the present application also needs to reasonably set the relative positions of the second photosensitive component and the third photosensitive component so that the image capture viewing angles of the second photosensitive component and the third photosensitive component are not exactly the same.

[0107] For example, in a possible implementation, the carrier in the image acquisition module may include a first bearing surface and a second bearing surface that are disposed opposite to each other. The first bearing surface and the second bearing surface are two mutually parallel surfaces of the carrier, and therefore, the first bearing surface and the second bearing surface are oriented opposite to each other. The second photosensitive component is disposed at a second position of the first bearing surface, and the third photosensitive component is disposed at a fourth position of the second bearing surface. Figure 2As shown in , the second photosensitive component and the third photosensitive component are respectively located on two carrying surfaces of the carrier.

[0108] It can be understood that since the first carrying surface and the second carrying surface are two opposite surfaces of the carrier, the second photosensitive component is arranged on the first carrying surface, and the third photosensitive component is arranged on the second carrying surface, so that the second photosensitive component and the third photosensitive component can be oriented in opposite directions (i.e., oriented opposite to each other), so that images in a wider range can be captured with the help of the second photosensitive component and the third photosensitive component.

[0109] For example, taking the example that the second lens of the second photosensitive component and the third lens of the third photosensitive component are both wide-angle lenses, when the second photosensitive component and the third photosensitive component are respectively arranged on the first carrying surface and the second carrying surface, the second lens and the third lens are oriented in opposite directions, and both lenses are wide-angle lenses close to 180 degrees, and each lens can cover an area within a range of close to 180 degrees on one side of the carrier, then the two lenses can cover an area within a range of 360 degrees of the image acquisition module, so that the second photosensitive component and the third photosensitive component can cooperate to capture images within a range of close to 360 degrees.

[0110] It is understandable that, under the premise that the carrier has a first bearing surface and a second bearing surface, the present application does not impose any restrictions on the bearing surface where the first photosensitive component is located. For example, the first photosensitive component is arranged at a first position on the first bearing surface. Wherein, under the premise that the first photosensitive component includes a first image sensor and a first lens matched therewith, the first image sensor of the first photosensitive component is different from the second image sensor, and the first lens of the first photosensitive component can be the same as or different from the second lens, and there is no restriction on this.

[0111] Of course, under the premise that the carrier has a first carrying surface and a second carrying surface, the positional relationship between the first photosensitive component, the second photosensitive component and the third photosensitive component can satisfy the above conditions at the same time, or only the positional relationship between the second photosensitive component and the first photosensitive component or the third photosensitive component can be as described above.

[0112] In another possible implementation, in order to obtain an image in a wider viewing angle range by using the second photosensitive component and the third photosensitive component, the carrier may include a first carrier and a second carrier. Accordingly, the relative position relationship between the second photosensitive component and the third photosensitive component can be seen in Figure 3 . Figure 3 An example diagram showing the relative position relationship between the components in the image acquisition module of the present application is shown.

[0113] Depend on Figure 3It can be seen that the carrier in the image acquisition module includes a first carrier 1011 and a second carrier 1012. The first carrier 1011 and the second carrier 1012 are connected by signals through a flexible circuit board 1013. The first carrier and the second carrier are not only supports for electronic components, but also carriers for electronic components to achieve signal connection. For example, the first carrier and the second carrier can both be PCB boards.

[0114] Among them, the flexible printed circuit (FPC) has the characteristics of good bendability, can be adapted to bend in a small space, and can achieve connection between components that need to be electrically connected in the first carrier and the second carrier.

[0115] On this basis, the second photosensitive component 102 is set at the second position of the first carrier 1011, and the third photosensitive component 105 is set at the fourth position of the second carrier 1012.

[0116] like Figure 3 As shown, the first carrier 1011 and the second carrier 1012 are located in two parallel planes. On this basis, the second lens of the second photosensitive component and the third lens of the third photosensitive component are oriented in opposite directions, and the cooperation between the second lens and the third lens enables the image acquisition module to obtain a panoramic image signal of the space environment in which it is located. Among them, the panoramic image signal can be considered as a 360-degree or nearly 360-degree image signal of the space environment in which the image acquisition module is located.

[0117] For example, the second photosensitive component is disposed on the first surface of the first carrier, and the second photosensitive component is disposed on the second surface of the second carrier, and the first surface and the second surface are opposite to each other.

[0118] Depend on Figure 3 It can be seen that by connecting the first carrier and the second carrier with the help of a flexible printed circuit board, the distance between the first carrier and the second carrier can be flexibly adjusted. On the premise that the second lens of the second photosensitive component carried by the first carrier and the third lens of the third photosensitive component carried by the second carrier can be facing away from each other, the limited space of the image acquisition module can be fully utilized.

[0119] It can be understood that, when the carrier includes a first carrier and a second carrier, the first photosensitive component and the signal processing module can be arranged on the first carrier or on the second carrier. Figure 3 In the example, the first photosensitive component 102, the signal processing module 104 and the second photosensitive component 103 are all arranged on the first carrier and are located on the same carrying surface of the first carrier. Furthermore, the first carrier is also provided with an infrared light emitting unit 106, which is arranged close to the first photosensitive component and is located on the same carrying surface of the first carrier as the first photosensitive component.

[0120] certainly, Figure 3 The description is made by taking the first carrier 1011 and the second carrier 1012 as being located on two parallel planes. In practical applications, there may be other possibilities for the positional relationship between the first carrier and the second carrier.

[0121] For example, in one implementation, the first carrier and the second carrier can also be located in the same plane. On this basis, the second lens of the second photosensitive component and the third lens of the third photosensitive component cooperate to enable the image acquisition module to obtain a panoramic image signal of the spatial environment.

[0122] For example, when the first carrier and the second carrier are in the same plane, the first photosensitive component is arranged on the first surface of the first carrier, and the second photosensitive component is arranged on the second surface of the second carrier, and the first surface and the second surface are opposite to each other, so that the second lens and the third lens are oriented opposite to each other, thereby achieving the same effect as the second photosensitive component being arranged on the first carrying surface and the third photosensitive component being arranged on the second carrying surface, so that the cooperation of the second lens and the third lens can enable the image acquisition module to obtain a panoramic image signal of the spatial environment in which it is located.

[0123] For ease of understanding, when the image acquisition module supports the target device to implement different functional services, the data transmission relationship between the signal processing module and the first photosensitive component, the second photosensitive component and the third photosensitive component is explained below by taking the first image sensor of the first photosensitive component as a hybrid visible light and infrared light sensor, the second image sensor of the second photosensitive component and the third image sensor of the third photosensitive component as perception sensors. Figure 4 A schematic diagram showing data transmission between components in the image acquisition module in the present application.

[0124] Depend on Figure 4 It can be seen that the visible light image or infrared light image acquired by the hybrid visible light and infrared light sensor can be transmitted to the image signal processing unit in the signal processing module. On this basis, when the image acquisition module needs to support the target device to implement functions related to image acquisition such as face verification or video calls, the image signal processing unit can obtain at least one of the visible light image signal and infrared light image signal acquired by the hybrid visible light and infrared light sensor and perform corresponding processing.

[0125] Among them, the image signals acquired by the perception sensors in the second photosensitive component and the perception sensors in the third photosensitive component can be transmitted to the artificial intelligence processing unit in the signal processing module. On this basis, when the image acquisition module needs to support the target device to realize functions such as scene detection and object perception, the artificial intelligence processing module can obtain the image signals transmitted by the perception sensors of the second photosensitive component and the third photosensitive component in a time-sharing manner and process them.

[0126] In an optional manner, the signal processing module also includes a scheduler, which can control the artificial intelligence processing unit or the image signal processing unit to obtain the image captured by the corresponding photosensitive component based on the functional services that need to be implemented by the target device.

[0127] In the present application, the image signals collected by the second photosensitive component and the third photosensitive component can be black and white image signals or color image signals; or the second photosensitive component and the third photosensitive component can be controlled to generate black and white image signals or color image signals under the control of the signal processing module.

[0128] For example, when it is necessary to use the image signals obtained by the second photosensitive component and the third photosensitive component to perceive the object, the signal processing module (such as the artificial intelligence processing unit) can instruct the second photosensitive component and the third photosensitive component to obtain black and white light image signals. If it is necessary to display, output or store the images obtained by the second photosensitive component and the third photosensitive component, the signal processing module (such as the artificial intelligence processing unit) can instruct the second photosensitive component and the third photosensitive component to obtain color image signals.

[0129] It is understandable that when the image acquisition module is applied to the target device (for example, the image acquisition module is integrated into the target device or connected to the target device), so that the target device and the image acquisition module have a target communication connection, the target processor of the target device may also need to obtain the image signals obtained by the second photosensitive component and the third photosensitive component in the image acquisition module in order to perform image analysis or display and other processing.

[0130] Based on this, in order to be able to switch the images captured by the second photosensitive component and the third photosensitive component from being transmitted to the signal processing module to being transmitted to the target processor of the target device, the image acquisition module of the present application may also include: a scheduling unit between the second photosensitive component, the third photosensitive component and the signal processing module.

[0131] Among them, the scheduling unit can respond to different control signals to conduct the signal path between the second photosensitive component, the third photosensitive component and the signal processing module; or, conduct the signal path between the second photosensitive component, the third photosensitive component and the target processor of the target device.

[0132] The target processor may be a processor in the target device for performing image signal processing, and is not specifically limited thereto. For example, the target processor may be an image signal processor of a system on chip.

[0133] The control signal to which the scheduling unit responds may be a control signal sent by the target device.

[0134] In another aspect, the present application also provides an electronic device. Figure 5 , showing a schematic diagram of the composition structure of an electronic device provided by the present application.

[0135] like Figure 5 The electronic device 500 includes a first processor 501 and an image acquisition module 502.

[0136] The image acquisition module 502 includes:

[0137] A carrier 101 for carrying electronic components, wherein the carrier 101 establishes a target communication connection with the first processor 101;

[0138] A first photosensitive component 102 disposed at a first position of the carrier, for acquiring a first image signal;

[0139] A second photosensitive component 103 disposed at a second position of the carrier, for collecting a second image signal;

[0140] The signal processing module 104 disposed at the third position of the carrier is signal-connected to the first photosensitive component and the second photosensitive component.

[0141] The signal processing module can perform different processing on the first image signal or the second image signal to output different processing results when the electronic device realizes different functional services.

[0142] The first processor may be a central processing unit, a graphics processing unit or other types of processors in the electronic device, and is not limited thereto. The first processor may control the operation or sleep of the image acquisition module.

[0143] The image acquisition module in the electronic device can refer to the introduction of the above-mentioned embodiments of the image acquisition module, which will not be described again here.

[0144] Combined with the previous introduction to the image acquisition module, it can be seen that the signal processing module in the image acquisition module can process the first image signal obtained by the first photosensitive component or the second image signal obtained by the second photosensitive component according to the functional service implemented by the electronic device, so as to output different processing results. Therefore, one image acquisition module can support the electronic device to implement different functional services, reducing the number of image acquisition modules that need to be deployed or connected by the electronic device, and naturally reducing the space occupied by the electronic device due to the setting of the image acquisition module.

[0145] Moreover, in the present application, only one signal processing module is required in the image processing module to meet the needs of the target device to realize different functional services, so there is no need to set different signal processing modules for different image sensor elements in the image processing module, thereby reducing the number of components in the image processing module, and further reducing the volume of the image processing module, which naturally reduces the space occupied by the electronic device to set the image processing module.

[0146] In a possible implementation, in the image acquisition module in the electronic device, the signal processing module includes an image signal processing unit and an artificial intelligence processing unit with signal connections, as described above and will not be repeated here.

[0147] Furthermore, the image acquisition module further includes a third photosensitive component disposed at a fourth position of the carrier, and the third photosensitive component is used to acquire a third image signal;

[0148] When the electronic device implements the first functional service, the first image signal is processed into an infrared image or an RGB image by the image signal processing unit and is given to a first application of the electronic device.

[0149] Among them, the first functional service can refer to the previous introduction and will not be repeated here.

[0150] Among them, the first application of the electronic device can be an application that implements the first functional service. For example, if the first functional service is face recognition, the first application can be a face recognition application or an application that involves logging in or making payments with the help of face recognition. For example, if the first functional service is video calling, then the first application can be a video calling application, without any restriction.

[0151] And / or, when the electronic device implements the second functional service, the second image signal or the third image signal is identified or detected by the artificial intelligence processing unit, so that the first processor controls the electronic device to perform a corresponding response action based on the obtained identification result or detection result.

[0152] Regarding the second functional service, as well as the recognition or detection processing of the second image signal and the third image signal by the artificial intelligence unit, please refer to the relevant introduction of the previous embodiments, which will not be repeated here.

[0153] Among them, the response action that the first processor needs to perform based on the identification result or detection result is related to the specific configuration of the electronic device or the application in the electronic device that needs to perform an action based on the identification result or detection result, and there is no limitation on this. For example, based on the identification result or detection result, the response action performed can be outputting the identification result or detection result, or generating a result output prompt, etc. For another example, if a set abnormal condition is determined based on the identification result or detection result, an operation such as outputting an alarm prompt can be performed.

[0154] In another possible implementation, when the image acquisition module in the electronic device further includes a third photosensitive component, the electronic device can also generate a target control signal in response to a target operation acting on the electronic device. The target control signal can control a scheduling unit disposed between the second photosensitive component, the third photosensitive component and the signal processing module to conduct a signal path between the second photosensitive component, the third photosensitive component and the second processor of the electronic device, so as to utilize the second processor to process the acquired second image signal and / or third image signal into a second target image.

[0155] The second processor may be the same as the target processor mentioned above. For example, the second processor may be an image signal processor in a system on chip (SOC) in an electronic device. The details are as described above and will not be described in detail.

[0156] The second target image may be a panoramic image or a non-panoramic image. After the second processor processes the second target image, the second target image may be sent to the second application, which may be an image display application or other application that needs to output an image. Of course, the second application may also be other applications that need to be processed with the help of the second target image, and there is no limitation on this.

[0157] Among them, the target operation can be an input operation that can be input by the user to trigger the path switching. For example, the target operation can be an operation of a toggle switch on the electronic device, or an operation of the space acting on the operation interface, or a voice control operation or a gesture control operation, without limitation. The target operation can also be a target call operation of an application in the electronic device, and the target call operation is used to request to call a specified switching control interface to trigger the electronic device to generate a target control signal. For example, the application can be an application that needs to determine the scene environment in which the electronic device is located. On this basis, the application can send a call request to the operating system of the electronic device to execute the target call operation of calling the switching control interface to trigger the electronic device to generate a target control signal.

[0158] In a possible implementation, the electronic device may include a third processor that is electrically connected to the scheduling unit, and the third processor may generate a target control signal in response to the target operation, and transmit the target control signal to the scheduling unit. For example, the third processor may be an embedded controller, or other operations.

[0159] For ease of understanding, take the image acquisition module as an example. Figure 4 The scheduling unit is added on the basis of the image acquisition module, and the second processor is an image signal processor in the electronic device as an example. Figure 6 , showing a framework schematic diagram of an electronic device controlling a scheduling unit in an image acquisition module to perform a switching operation.

[0160] Depend on Figure 6 It can be seen that the image acquisition module has a communication connection with the processor platform of the electronic device. For example, the image acquisition module can establish a connection with the processor platform of the electronic device through a USB bus. Of course, there can be other connection methods, which are not limited.

[0161] contrast Figure 4 It can be seen that Figure 6 The image acquisition module in the embodiment adds a scheduling unit arranged between the second photosensitive component, the third photosensitive component and the signal processing module, through which the signal channel arranged between the second photosensitive component, the third photosensitive component and the signal processing module can be controlled to be connected or disconnected.

[0162] At the same time, the scheduling unit also has a communication connection with the image signal processor in the electronic device, and the scheduling unit can control the signal path between the second photosensitive component, the third photosensitive component and the image signal processor to be connected or disconnected. Among them, there are many possibilities for the channel path between the second photosensitive component, the third photosensitive component and the image signal processor in the electronic device. For example, the signal connection path between the second photosensitive component, the third photosensitive component and the image signal processor of the electronic device can be established through the Mobile Industry Processor Interface (MIPI).

[0163] An embedded controller is provided in the electronic device, and the embedded controller is also in communication connection with the scheduling unit. On this basis, the embedded controller can determine the target operation based on the user's manual switching operation or the software call operation, and generate control information to send to the scheduling unit to control the scheduling unit to conduct the signal path between the second photosensitive component, the third photosensitive component and the signal processing module, or conduct the signal path between the second photosensitive component, the third photosensitive component and the image signal processor of the electronic device.

[0164] After obtaining the second photosensitive component and the image signal collected by the second photosensitive component, the image signal processor of the electronic device can process the image signal and output a corresponding processing result, that is, a second target image.

[0165] It should be noted that the various parts in this specification are described in a combination of parallel and progressive manners, and each part focuses on the differences from other parts. The same or similar parts between the various parts can be referenced to each other.

[0166] For the above description of the disclosed embodiments, the features recorded in the embodiments in this specification can be replaced or combined with each other, so that professionals in the field can implement or use the present application. Various modifications to these embodiments are obvious to professionals in the field, and the general principles defined in this article can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown in this article, but will conform to the widest scope consistent with the principles and novel features disclosed in this article.

Claims

1. An image acquisition module, comprising: A carrier for carrying electronic components; A first photosensitive component disposed at a first position of the carrier, for acquiring a first image signal; A second photosensitive component disposed at a second position of the carrier, for collecting a second image signal; A signal processing module disposed at a third position of the carrier, connected to the first photosensitive component and the second photosensitive component by signal; Among them, the signal processing module can perform different processing on the first image signal or the second image signal to output different processing results when the image acquisition module supports the target device to implement different functional services. The target device is an electronic device that establishes a target communication connection with the image acquisition module.

2. According to the image acquisition module according to claim 1, the signal processing module comprises: an image signal processing unit and an artificial intelligence processing unit having signal connections; In a case where the image acquisition module supports the target device to implement a first functional service, the image signal processing unit performs a first processing on the first image signal to output a first target image; and / or, When the image acquisition module supports the target device to implement a second functional service, the second image signal is subjected to a second processing by the artificial intelligence processing unit to output a target recognition result or a target detection result.

3. The image acquisition module according to claim 1 or 2, further comprising a third photosensitive component disposed at a fourth position of the carrier, the third photosensitive component being used to acquire a third image signal; in, The second photosensitive component and the third photosensitive component are configured to acquire corresponding image signals in time-sharing; or, The signal processing module is configured to acquire the second image signal and the third image signal in a time-sharing manner.

4. The image acquisition module according to claim 3, wherein the third photosensitive component comprises a third image sensor and a third lens matched therewith, and the third image sensor is signal-connected to the signal processing module; The second photosensitive component includes a second image sensor and a second lens matched therewith; The third image sensor is the same as the second image sensor, and the third lens is the same as the second lens.

5. The image acquisition module according to claim 4, wherein: The carrier comprises a first carrying surface and a second carrying surface which are arranged opposite to each other; The second photosensitive component is disposed at a second position of the first carrying surface, and the third photosensitive component is disposed at a fourth position of the second carrying surface; and / or, The first photosensitive component is arranged at a first position of the first carrying surface, and the first photosensitive component includes a first image sensor and a first lens matching therewith. The first image sensor is different from the second image sensor, and the first lens is the same as or different from the second lens.

6. The image acquisition module according to claim 4, wherein: The carrier comprises a first carrier and a second carrier, wherein the first carrier and the second carrier are connected by a flexible circuit board signal; The second photosensitive component is disposed at a second position of the first carrier, and the third photosensitive component is disposed at a fourth position of the second carrier; The first carrier and the second carrier are located in the same plane or in two parallel planes; The cooperation between the second lens and the third lens enables the image acquisition module to obtain a panoramic image signal of the spatial environment.

7. The image acquisition module according to claim 4, further comprising a scheduling unit arranged between the second photosensitive component, the third photosensitive component and the signal processing module; The scheduling unit can respond to different control signals to connect the signal path between the second photosensitive component, the third photosensitive component and the signal processing module, or, A signal path is conducted between the second photosensitive component, the third photosensitive component and a target processor of a target device.

8. An electronic device, comprising a first processor and an image acquisition module, wherein: The image acquisition module comprises: A carrier for carrying electronic components, and establishing a target communication connection with the first processor; A first photosensitive component disposed at a first position of the carrier, for acquiring a first image signal; A second photosensitive component disposed at a second position of the carrier, for collecting a second image signal; A signal processing module disposed at a third position of the carrier, connected to the first photosensitive component and the second photosensitive component by signal; The signal processing module can perform different processing on the first image signal or the second image signal to output different processing results when the electronic device implements different functional services.

9. The electronic device according to claim 8, wherein: The signal processing module includes an image signal processing unit and an artificial intelligence processing unit having signal connections; The image acquisition module further includes a third photosensitive component disposed at a fourth position of the carrier, and the third photosensitive component is used to acquire a third image signal; In the case where the electronic device implements the first functional service, the image signal processing unit processes the first image signal into an infrared image or an RGB image and provides it to a first application of the electronic device; And / or, when the electronic device implements the second functional service, the second image signal or the third image signal is identified or detected by the artificial intelligence processing unit, so that the first processor controls the electronic device to perform a corresponding response action based on the obtained identification result or detection result.

10. The electronic device according to claim 8, wherein the image acquisition module further comprises a third photosensitive component disposed at a fourth position of the carrier, and the third photosensitive component is used to acquire a third image signal; The electronic device is capable of generating a target control signal in response to a target operation acting on the electronic device; The target control signal can control the scheduling unit arranged between the second photosensitive component, the third photosensitive component and the signal processing module to conduct the signal path between the second photosensitive component, the third photosensitive component and the second processor of the electronic device, so as to utilize the second processor to process the acquired second image signal and / or third image signal into a second target image.

Images