Method and apparatus for field of view registration of dual camera sensors, storage medium, and electronic device

Abstract

The application discloses a field-of-view registration method and device of a dual-camera sensor, a storage medium and an electronic device. The field-of-view registration method of the dual-camera sensor comprises the following steps: acquiring a gray-scale image of a first backlight plate by an RGB image sensor, the first backlight plate being provided with a plurality of uniformly arranged light transmission windows; calculating first position information of each light transmission window in the RGB image sensor according to the gray-scale image; acquiring second position information of each light transmission window in a corresponding sensing area in a multispectral sensor; and registering the fields of view of the multispectral sensor and the RGB image sensor according to the first position information and the second position information. The scheme can improve the imaging quality of the electronic device.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of sensors, in particular to a field-of-view registration method and device of a dual-camera sensor, a storage medium and an electronic device. BACKGROUND

[0002] With the progress of society and the development of technology, electronic devices have gradually become necessities in people's lives, and the shooting function as an important configuration of electronic products is also gradually developing. However, with the popularization of the shooting function, people's experience requirements for using the shooting function are getting higher and higher, and how to improve the imaging quality of electronic devices is one of the technical challenges faced by improving the shooting experience.

[0003] At present, in order to enhance the color performance of digital images and make up for the defect that traditional image sensors are difficult to obtain environmental spectrum information, a multi-spectral sensor is usually used to assist shooting. However, there is a problem that the multi-spectral sensor and the RGB image sensor cannot be aligned in the same area, which leads to an undesirable imaging quality of the electronic device. SUMMARY

[0004] The embodiments of the present application provide a field-of-view registration method and device of a dual-camera sensor, a storage medium and an electronic device, which can improve the imaging quality of the electronic device.

[0005] In a first aspect, the embodiments of the present application provide a field-of-view registration method of a dual-camera sensor, comprising:

[0006] obtaining a gray-scale image of a first backlight plate by an RGB image sensor, the first backlight plate having a plurality of uniformly arranged light transmission windows;

[0007] calculating first position information of each of the light transmission windows in the RGB image sensor according to the gray-scale image;

[0008] obtaining second position information of each of the light transmission windows in a corresponding sensing area of a multi-spectral sensor;

[0009] registering the fields of view of the multi-spectral sensor and the RGB image sensor according to the first position information and the second position information.

[0010] In the field-of-view registration method of the dual-camera sensor provided by the embodiments of the present application, the obtaining of the second position information of each of the light transmission windows in the corresponding sensing area of the multi-spectral sensor comprises:

[0011] obtaining first sensing parameters and second sensing parameters of each of the sensing areas in the multi-spectral sensor;

[0012] According to the first sensing parameter and the second sensing parameter, second position information of each light transmission window in a corresponding sensing area is calculated.

[0013] In the field of view registration method of the dual-camera sensor provided in the embodiments of the present application, the first sensing parameter and the second sensing parameter of each sensing area in the multi-spectrum sensor are obtained, including:

[0014] When the distance between the second backlight plate and the dual-camera sensor is fixed, the first sensing parameter of each sensing area in the multi-spectrum sensor is obtained, the second backlight plate being a uniform backlight plate;

[0015] When the first backlight plate is formed by covering the black light-blocking material on the second backlight plate, the second sensing parameter of each sensing area in the multi-spectrum sensor is obtained.

[0016] In the field of view registration method of the dual-camera sensor provided in the embodiments of the present application, according to the first sensing parameter and the second sensing parameter, second position information of each light transmission window in a corresponding sensing area is calculated, including:

[0017] The second sensing parameter is divided by the first sensing parameter to obtain a proportionality coefficient;

[0018] According to the proportionality coefficient, second position information of each light transmission window in a corresponding sensing area is determined.

[0019] In the field of view registration method of the dual-camera sensor provided in the embodiments of the present application, according to the first position information and the second position information, the field of view of the multi-spectrum sensor and the RGB image sensor is registered, including:

[0020] According to the first position information and the second position information, a deviation value of a detection area of the multi-spectrum sensor and a shooting area of the RGB image sensor is calculated;

[0021] According to the deviation value, the field of view of the multi-spectrum sensor and the RGB image sensor is registered.

[0022] In a second aspect, the embodiments of the present application provide a field of view registration device of a dual-camera sensor, including:

[0023] A first obtaining unit is configured to obtain a gray-scale image of a first backlight plate by using an RGB image sensor, the first backlight plate having a plurality of light transmission windows arranged uniformly thereon;

[0024] A second obtaining unit is configured to calculate first position information of each light transmission window in the RGB image sensor according to the gray-scale image;

[0025] The third acquisition unit is configured to acquire second position information of each light-transmitting window in a corresponding sensing area of the multispectral sensor.

[0026] The field-of-view registration unit is configured to register the fields of view of the multispectral sensor and the RGB image sensor according to the first position information and the second position information.

[0027] In the field-of-view registration device of the dual-camera sensor provided in the embodiments of the present application, the second acquisition unit is configured to:

[0028] acquire first sensing parameters and second sensing parameters of each sensing area of the multispectral sensor;

[0029] calculate second position information of each light-transmitting window in the corresponding sensing area according to the first sensing parameters and the second sensing parameters.

[0030] In the field-of-view registration device of the dual-camera sensor provided in the embodiments of the present application, the field-of-view registration unit is configured to:

[0031] calculate a deviation value of a detection area of the multispectral sensor and a shooting area of the RGB image sensor according to the first position information and the second position information;

[0032] register the fields of view of the multispectral sensor and the RGB image sensor according to the deviation value.

[0033] In a third aspect, the present application provides a storage medium, which stores a plurality of instructions, and the instructions are adapted to be loaded by a processor to execute the field-of-view registration method of the dual-camera sensor according to any one of the above aspects.

[0034] In a fourth aspect, the present application provides an electronic device, which comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the field-of-view registration method of the dual-camera sensor according to any one of the above aspects when executing the computer program.

[0035] In summary, the field of view registration method of the dual-camera sensor provided by the embodiment of the application comprises: acquiring a gray-scale image of a first backlight plate through an RGB image sensor, the first backlight plate having a plurality of uniformly arranged light transmission windows; calculating first position information of each light transmission window in the RGB image sensor according to the gray-scale image; acquiring second position information of each light transmission window in a corresponding sensing area of a multispectral sensor; and registering the fields of view of the multispectral sensor and the RGB image sensor according to the first position information and the second position information. The present scheme can register the multispectral sensor and the RGB image sensor, so that the multispectral sensor and the RGB image sensor can be aligned to the same area, thereby improving the imaging quality of the electronic device. BRIEF DESCRIPTION OF DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0037] Figure 1 is a flowchart of the field of view registration method of the dual-camera sensor provided by the embodiment of the present application.

[0038] Figure 2 is a structural schematic diagram of the first backlight plate provided by the embodiment of the present application.

[0039] Figure 3 is a schematic diagram of the position relationship between the dual-camera sensor and the first backlight plate provided by the embodiment of the present application.

[0040] Figure 4 is a schematic diagram of the sensing area distribution of the multispectral sensor provided by the embodiment of the present application.

[0041] Figure 5 is a schematic diagram of the position relationship between the sensing area and the light transmission area provided by the embodiment of the present application.

[0042] Figure 6 is a schematic diagram of the application scenario of the sensing area provided by the embodiment of the present application.

[0043] Figure 7 is a structural schematic diagram of the field of view registration device of the dual-camera sensor provided by the embodiment of the present application.

[0044] Figure 8 is a structural schematic diagram of the electronic device provided by the embodiment of the present application. DETAILED DESCRIPTION

[0045] The exemplary embodiments will be described in detail below with reference to the attached drawings. In the following description, unless otherwise indicated, like numbers in the attached drawings refer to the same or similar elements. The following description of exemplary embodiments is not representative of all possible embodiments consistent with the present application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the present application as detailed in the appended claims.

[0046] It should be noted that, in this document, the terms "comprises", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element preceded by "comprises... a" does not, without more constraints, foreclose the existence of additional identical elements in the process, method, article, or apparatus that comprises the element. Also, like-named components having a same function are typically identified in different embodiments of the application by like reference numerals.

[0047] It should be understood that the specific embodiments described herein are merely exemplary and do not limit the application.

[0048] In the following description, the suffixes "module", "part" or "unit" used for an element are merely intended for facilitating description of the application, and they do not have specific meanings or functions. Therefore, "module", "part" or "unit" can be mixedly used.

[0049] In the description of the present application, it should be noted that the terms "upper", "lower", "left", "right", "inner", "outer", and the like, indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are merely used to facilitate the description of the present application and simplify the description, and do not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as limiting the present application. In addition, the terms "first", "second", and the like are used only for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0050] At present, in order to enhance the color performance of digital images and make up for the defect that it is difficult for traditional image sensors to obtain environmental spectral information, a multispectral sensor is usually used to assist in shooting. However, there is a problem that it is difficult to align the same area between the multispectral sensor and the RGB image sensor, resulting in an undesirable imaging quality of the electronic device.

[0051] Based on this, the embodiment of the present application provides a field of view registration method, device, storage medium and electronic equipment of a dual-camera sensor. Specifically, the field of view registration device of the dual-camera sensor can be integrated in an electronic device with a shooting function, such as a mobile phone, a wearable smart device, a tablet computer, a notebook computer, and a personal computer (PC).

[0052] The technical solutions shown in the present application will be described in detail below through specific embodiments. It should be noted that the order of the following embodiments is not limited to the priority order of the embodiments.

[0053] Please refer to Figure 1 , Figure 1 is a flowchart of a field of view registration method of a dual-camera sensor provided by the embodiment of the present application. The specific process of the field of view registration method of the dual-camera sensor can be as follows:

[0054] 101, obtaining a gray-scale image of a first backlight plate by an RGB image sensor, the first backlight plate having a plurality of uniformly arranged light transmission windows.

[0055] In the specific implementation process, a second backlight plate with a preset distance from the dual-camera sensor can be arranged before the dual-camera sensor, and then a black light-blocking material is coated on the second backlight plate to form a first backlight plate with a plurality of uniformly arranged light transmission windows. The second backlight plate is a uniform backlight plate, such as a white backlight plate. The first backlight plate can be as shown in Figure 2 The positional relationship between the dual-camera sensor and the first backlight plate can be as shown in Figure 3 .

[0056] At this time, the first backlight plate can be photographed by the RGB image sensor to obtain the gray-scale image of the first backlight plate.

[0057] 102, calculating first position information of each light transmission window in the RGB image sensor according to the gray-scale image.

[0058] Specifically, the pixel distribution information of each light transmission window in the RGB image sensor can be determined according to the gray-scale image, and then the first position information of each light transmission window in the RGB image sensor can be calculated based on the pixel distribution information of each light transmission window in the RGB image sensor.

[0059] 103, obtaining second position information of each light transmission window in a corresponding sensing area of the multispectral sensor.

[0060] It should be noted that in the embodiments of the present application, the multispectral sensor has a plurality of uniformly distributed sensing areas (Block), and the multispectral sensor detects the spectral distribution in different fields of view through different sensing areas. Each sensing area has full-spectrum detection capability. The specific distribution of each sensing area in the multispectral sensor can be as shown in Figure 4 .

[0061] Specifically, the first sensing parameter and the second sensing parameter of each sensing area in the multispectral sensor can be obtained first, and then the second position information of each light transmission window in the corresponding sensing area is calculated according to the first sensing parameter and the second sensing parameter.

[0062] The first sensing parameter is the corresponding sensing parameter of each sensing area when the multispectral sensor shoots the second backlight plate. The second sensing parameter is the corresponding sensing parameter of each sensing area when the multispectral sensor shoots the first backlight plate. That is, in some embodiments, the step of "obtaining the first sensing parameter and the second sensing parameter of each sensing area in the multispectral sensor" can be specifically:

[0063] When the distance between the second backlight plate and the dual-camera sensor is fixed, the first sensing parameter of each sensing area in the multispectral sensor is obtained; when the black light-blocking material is covered on the second backlight plate to form the first backlight plate, the second sensing parameter of each sensing area in the multispectral sensor is obtained.

[0064] It should be noted that in the embodiments of the present application, when the multispectral sensor is used to shoot the first backlight plate, the light of each light transmission window can act on at least four adjacent sensing areas of the multispectral sensor, that is, each light transmission window has at least four adjacent sensing areas to receive light. For example, when the multispectral sensor is used to shoot the first backlight plate, the schematic diagram of the light transmission window and the sensing area can be as shown in Figure 5 .

[0065] In some embodiments, the second sensing parameter of each sensing area can be divided by the first sensing parameter to obtain a proportionality coefficient η. It can be understood that the proportionality coefficient η represents the corresponding sensing area in the relevant light transmission window in the photosensitive area. Then, the second position information of each light transmission window in the corresponding sensing area is determined according to the number of the light transmission window acting on the sensing area. That is, the step of "calculating the second position information of each light transmission window in the corresponding sensing area according to the first sensing parameter and the second sensing parameter" can include:

[0066] Divide the second sensing parameter by the first sensing parameter to obtain a proportionality coefficient;

[0067] Determine the second position information of each light transmission window in the corresponding sensing area according to the proportionality coefficient.

[0068] For example, when the light from each light-transmitting window can act on four adjacent sensing areas of the multispectral sensor, the position of the light-transmitting window in the sensing area can be calculated using the four proportional coefficients η of the light-transmitting window.

[0069] The calculation process of the second position information is described in detail below using an example.

[0070] For example, Figure 6 As shown in the figure, a light-transmitting window acts on four adjacent sensing areas, where the total area of ​​the four sensing areas A1, A2, A3, and A4 is A. The areas of the light-transmitting windows in A1, A2, A3, and A4 are S1, S2, S3, and S4, respectively. At this time, the ratio coefficients between the light-sensitive area of ​​each sensing area and the total area are:

[0071]

[0072] When the light-transmitting window is located at the exact center of the four sensing areas A1 to A4, the four photosensitive areas S1 to S4 are equal, with length and width a0 and b0. At this point, the second position information of the light-transmitting window in the four sensing areas can be directly determined. If the center offset coordinates are x and y, the following relationship holds:

[0073]

[0074] At this time, the four unknowns a0, b0, x, and y can be solved by the above formula, thereby determining the second position information of the light-transmitting window in the four sensing areas.

[0075] 104. Align the fields of view of the multispectral sensor and the RGB image sensor according to the first position information and the second position information.

[0076] At this time, the deviation value between the detection area of ​​the multispectral sensor and the shooting area of ​​the RGB image sensor can be calculated according to the first position information and the second position information; and the fields of view of the multispectral sensor and the RGB image sensor are aligned according to the deviation value.

[0077] In summary, the field of view registration method of the dual-camera sensor provided in the embodiments of the present application comprises: acquiring a gray-scale image of a first backlight plate through an RGB image sensor, the first backlight plate having a plurality of uniformly arranged light transmission windows; calculating first position information of each light transmission window in the RGB image sensor according to the gray-scale image; acquiring second position information of each light transmission window in a corresponding sensing area in a multispectral sensor; and registering the fields of view of the multispectral sensor and the RGB image sensor according to the first position information and the second position information. The present scheme can register the multispectral sensor and the RGB image sensor, so that the multispectral sensor and the RGB image sensor can be aligned to the same area, thereby improving the imaging quality of the electronic device.

[0078] To better implement the field of view registration method of the dual-camera sensor provided in the embodiments of the present application, the embodiments of the present application further provide a field of view registration device of a dual-camera sensor. The meanings of the terms are the same as those in the field of view registration method of the dual-camera sensor, and specific implementation details can be referred to the description in the method embodiments.

[0079] Please refer to Figure 7 , Figure 7 is a structural schematic diagram of the field of view registration device of the dual-camera sensor provided in the embodiments of the present application. The field of view registration device of the dual-camera sensor can comprise a first acquisition unit 201, a second acquisition unit 202, a third acquisition unit 203, and a field of view registration unit 204. Among them,

[0080] The first acquisition unit 201 is configured to acquire a gray-scale image of a first backlight plate through an RGB image sensor, the first backlight plate having a plurality of uniformly arranged light transmission windows.

[0081] The second acquisition unit 202 is configured to calculate first position information of each light transmission window in the RGB image sensor according to the gray-scale image.

[0082] The third acquisition unit 203 is configured to acquire second position information of each light transmission window in a corresponding sensing area in a multispectral sensor.

[0083] The field of view registration unit 204 is configured to register the fields of view of the multispectral sensor and the RGB image sensor according to the first position information and the second position information.

[0084] In some embodiments, the second acquisition unit 202 can be specifically configured to:

[0085] acquire first sensing parameters and second sensing parameters of each sensing area in the multispectral sensor;

[0086] calculate the second position information of each light transmission window in the corresponding sensing area according to the first sensing parameters and the second sensing parameters.

[0087] In some embodiments, the field of view registration unit 204 can be specifically used for:

[0088] calculating a deviation value of the detection region of the multi-spectrum sensor and the shooting region of the RGB image sensor according to the first position information and the second position information;

[0089] registering the fields of view of the multi-spectrum sensor and the RGB image sensor according to the deviation value.

[0090] The specific implementation of each unit can refer to the above-mentioned embodiments of the field of view registration method of the dual-camera sensor, which will not be repeated here.

[0091] In summary, the field of view registration device of the dual-camera sensor provided by the embodiments of the present application can acquire a gray-scale image of a first backlight plate by the RGB image sensor through the first acquisition unit 201, and the first backlight plate has a plurality of uniformly arranged light transmission windows; the second acquisition unit 202 calculates the first position information of each light transmission window in the RGB image sensor according to the gray-scale image; the third acquisition unit 203 acquires the second position information of the corresponding sensing area of each light transmission window in the multi-spectrum sensor; and the field of view registration unit 204 registers the fields of view of the multi-spectrum sensor and the RGB image sensor according to the first position information and the second position information. The present scheme can register the multi-spectrum sensor and the RGB image sensor, so that the multi-spectrum sensor and the RGB image sensor can be aligned to the same region, thereby improving the imaging quality of the electronic device.

[0092] The embodiments of the present application also provide an electronic device, which can integrate the field of view registration device of the dual-camera sensor of the embodiments of the present application, as shown in Figure 8 , which shows the structural schematic diagram of the electronic device related to the embodiments of the present application. Specifically:

[0093] The electronic device can include a radio frequency (RF) circuit 601, a memory 602 including one or more computer readable storage media, an input unit 603, a display unit 604, a sensor 605, an audio circuit 606, a wireless fidelity (WiFi) module 607, a processor 608 including one or more processing cores, and a power supply 609, and the like. Those skilled in the art can understand that the structure of the electronic device shown in Figure 8 does not constitute a limitation on the electronic device, and can include more or fewer components than those shown, or combine certain components, or different component arrangements. Among them:

[0094] The RF circuit 601 can be used for receiving and sending signals in the process of information or communication, in particular, receiving the downlink information from the base station and delivering it to the processor 608 for processing; in addition, sending the uplink data to the base station. Generally, the RF circuit 601 includes but is not limited to an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, etc. In addition, the RF circuit 601 can also communicate with the network and other devices through wireless communication. Wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.

[0095] The memory 602 can be used to store software programs and modules, and the processor 608 can execute various functions and information processing by running the software programs and modules stored in the memory 602. The memory 602 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc.; the data storage area can store data created according to the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the memory 602 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. Accordingly, the memory 602 can also include a memory controller to provide access for the processor 608 and the input unit 603 to the memory 602.

[0096] The input unit 603 can be configured to receive input of digital or character information, and generate a key, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, in one embodiment, the input unit 603 can include a touch-sensitive surface and other input devices. The touch-sensitive surface, also known as a touch display or touchpad, can collect touch operations (such as a user's operation on or near the touch-sensitive surface using a finger, a stylus, or any suitable object or accessory) of the user on or near the touch-sensitive surface, and drive the corresponding connection device according to the pre-set program. Optionally, the touch-sensitive surface can include two parts of touch detection device and touch controller. Among them, the touch detection device detects the touch position of the user and detects the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, and converts it into touch coordinates and sends it to the processor 608, and can receive the command from the processor 608 and execute it. In addition, the touch-sensitive surface can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface, the input unit 603 can also include other input devices. Specifically, the other input devices can include one or more of a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), trackballs, mice, joysticks, etc.

[0097] The display unit 604 can be configured to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, which can be composed of graphics, text, icons, video, and any combination thereof. The display unit 604 can include a display panel, which can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch-sensitive surface can cover the display panel, and when the touch-sensitive surface detects a touch operation on or near it, it is transmitted to the processor 608 to determine the type of touch event, and then the processor 608 provides corresponding visual output on the display panel according to the type of touch event. Although in Figure 8 , the touch-sensitive surface and the display panel are implemented as two independent components to realize input and input functions, in some embodiments, the touch-sensitive surface and the display panel can be integrated to realize input and output functions.

[0098] The electronic device can also include at least one sensor 605, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor can include an ambient light sensor that can adjust the brightness of the display panel according to the brightness of ambient light, and a proximity sensor that can turn off the display panel and / or backlight when the electronic device is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and when at rest, can detect the magnitude and direction of gravity, and can be used for identifying the posture of the mobile phone (such as switching between horizontal and vertical screens, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometers, taps), and the like. As for other sensors that the electronic device can also be configured, such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, and the like, they will not be described here.

[0099] The audio circuit 606, the speaker, and the microphone can provide an audio interface between the user and the electronic device. The audio circuit 606 can convert the received audio data into an electrical signal and transmit it to the speaker, which converts the electrical signal into a sound signal and outputs it. On the other hand, the microphone collects a sound signal and converts it into an electrical signal, which is received by the audio circuit 606 and converted into audio data. The audio data is then output to the processor 608 for processing, and then transmitted to another electronic device via the RF circuit 601, or output to the memory 602 for further processing. The audio circuit 606 can also include a jack for connecting external earphones to the electronic device.

[0100] WiFi is a short-range wireless transmission technology. The WiFi module 607 can help the user to send and receive emails, browse web pages, and access streaming media, etc. It provides users with wireless broadband Internet access. Although Figure 8 The WiFi module 607 is shown, but it is understood that it does not belong to the essential components of the electronic device, and can be omitted as needed without changing the essence of the application.

[0101] The processor 608 is the control center of the electronic device, which connects all parts of the mobile phone through various interfaces and lines, executes various functions of the electronic device and processes data by running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602, thereby monitoring the mobile phone as a whole. Optionally, the processor 608 can include one or more processing cores; preferably, the processor 608 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 608.

[0102] The electronic device also includes a power supply 609 (such as a battery) that supplies power to the various components. Preferably, the power supply is logically connected to the processor 608 through a power management system, which enables functions such as managing charging, discharging, and power consumption management. The power supply 609 can also include one or more DC or AC power sources, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and the like.

[0103] Although not shown, the electronic device can also include a camera, a Bluetooth module, and the like, which are not described here in detail. In the present embodiment, the processor 608 in the electronic device loads one or more executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and runs the application programs stored in the memory 602 by the processor 608, thereby implementing various functions, such as:

[0104] obtaining a grayscale image of a first backlight plate through an RGB image sensor, the first backlight plate having a plurality of light-transmitting windows arranged uniformly thereon;

[0105] calculating first position information of each of the light-transmitting windows in the RGB image sensor according to the grayscale image;

[0106] obtaining second position information of each of the light-transmitting windows in a corresponding sensing area of a multispectral sensor;

[0107] registering fields of view of the multispectral sensor and the RGB image sensor according to the first position information and the second position information.

[0108] In summary, the electronic device provided in the embodiments of the present application obtains a grayscale image of a first backlight plate through an RGB image sensor, the first backlight plate having a plurality of light-transmitting windows arranged uniformly thereon; calculates first position information of each of the light-transmitting windows in the RGB image sensor according to the grayscale image; obtains second position information of each of the light-transmitting windows in a corresponding sensing area of a multispectral sensor; and registers fields of view of the multispectral sensor and the RGB image sensor according to the first position information and the second position information. The present solution can register the multispectral sensor and the RGB image sensor, so that the multispectral sensor and the RGB image sensor can be aligned to the same area, thereby improving the imaging quality of the electronic device.

[0109] In the above embodiments, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the detailed description of the field registration method of the dual-camera sensor above, which will not be described here again.

[0110] It should be noted that, for the field of view registration method of the dual-camera sensor in the embodiments of the present application, a person skilled in the art can understand that all or part of the processes of implementing the field of view registration method of the dual-camera sensor in the embodiments of the present application can be completed by a computer program controlling relevant hardware. The computer program can be stored in a computer-readable storage medium, such as a memory of a terminal, and executed by at least one processor in the terminal. In the execution process, the computer program can include processes such as the field of view registration method of the dual-camera sensor.

[0111] For the field of view registration device of the dual-camera sensor in the embodiments of the present application, each functional module can be integrated in one processing chip, or each module can exist physically independently, or two or more modules can be integrated in one module. The integrated module can be realized in the form of hardware or in the form of a software functional module. If the integrated module is realized in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0112] Therefore, the embodiments of the present application provide a storage medium, which stores a plurality of instructions. The instructions can be loaded by a processor to execute steps in any field of view registration method of a dual-camera sensor provided by the embodiments of the present application. The storage medium can be a disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), etc.

[0113] The field of view registration method, device, storage medium and electronic device of the dual-camera sensor provided by the present application are described in detail above. The principles and implementation manners of the present application are described by applying specific examples in this paper. The above description of the embodiments is only used to help understand the core idea of the present application. Meanwhile, for those skilled in the art, according to the idea of the present application, the specific implementation manner and application range can be changed. In summary, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A method for field of view registration of dual-camera sensors, characterized in that: include: Acquire a grayscale image of a first backlight panel through an RGB image sensor, wherein the first backlight panel has a plurality of evenly arranged light-transmitting windows; Calculating first position information of each of the light-transmitting windows in the RGB image sensor according to the grayscale image; When the distance between the second backlight panel and the dual-camera sensor is fixed, obtaining first sensing parameters of each sensing area in the multispectral sensor, where the second backlight panel is a uniform backlight panel; When the second backlight panel is covered with a black light-blocking material to form the first backlight panel, obtaining a second sensing parameter of each sensing area in the multispectral sensor; Dividing the second sensing parameter by the first sensing parameter to obtain a proportional coefficient; Determining second position information of each light-transmitting window in the corresponding sensing area according to the proportional coefficient; The fields of view of the multispectral sensor and the RGB image sensor are aligned according to the first position information and the second position information.

2. The method for field of view registration of a dual-camera sensor according to claim 1, wherein: The registering the fields of view of the multispectral sensor and the RGB image sensor according to the first position information and the second position information includes: Calculating a deviation value between a detection area of ​​the multispectral sensor and a shooting area of ​​the RGB image sensor according to the first position information and the second position information; The fields of view of the multispectral sensor and the RGB image sensor are aligned according to the deviation value.

3. A dual-sensor field of view registration device, characterized in that: include: A first acquisition unit is configured to acquire a grayscale image of a first backlight panel through an RGB image sensor, wherein the first backlight panel has a plurality of evenly arranged light-transmitting windows; a second acquiring unit, configured to calculate first position information of each of the light-transmitting windows in the RGB image sensor according to the grayscale image; a third acquisition unit, configured to acquire, when a distance between the second backlight panel and the dual-camera sensor is fixed, a first sensing parameter of each sensing area in the multispectral sensor, where the second backlight panel is a uniform backlight panel; acquire, when the second backlight panel is covered with a black light-blocking material to form the first backlight panel, a second sensing parameter of each sensing area in the multispectral sensor; divide the second sensing parameter by the first sensing parameter to obtain a proportionality coefficient; and determine, based on the proportionality coefficient, second position information of each light-transmitting window in the corresponding sensing area; A field of view registration unit is configured to align the fields of view of the multispectral sensor and the RGB image sensor according to the first position information and the second position information.

4. The field of view registration device for a dual-camera sensor according to claim 3, wherein: The field of view registration unit is used for: Calculating a deviation value between a detection area of ​​the multispectral sensor and a shooting area of ​​the RGB image sensor according to the first position information and the second position information; The fields of view of the multispectral sensor and the RGB image sensor are aligned according to the deviation value.

5. A storage medium, characterized in that The storage medium stores a plurality of instructions, which are suitable for loading by a processor to execute the field of view registration method of a dual-camera sensor according to claim 1 or 2.

6. An electronic device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method for field of view registration of a dual-camera sensor according to claim 1 or 2 is implemented.

Images