A switching method and electronic device for HDR sensor and non-HDR sensor

Abstract

The embodiment of the present invention provides a method and electronic device for switching between an HDR sensor and a non-HDR sensor. The method includes: receiving a zoom instruction input by a user, wherein the zoom instruction includes a zoom ratio; determining a target sensor according to the zoom ratio, wherein the target sensor is an HDR sensor or a non-HDR sensor; releasing a target resource corresponding to the target sensor, wherein the target resource is a pipeline resource in an image signal processor ISP for processing an image output by the target sensor; receiving a target image output by the target sensor, and performing a first image processing on the target image through the target resource. The embodiment of the present invention reduces the chip area, thereby reducing the chip cost.

Description

[Technical field]

[0001] The embodiments of the present invention relate to the field of image processing, and in particular to a method and electronic device for switching between an HDR sensor and a non-HDR sensor. [Background technology]

[0002] Due to the limitations of hardware cost and module manufacturing process, the camera in electronic equipment has a certain gap in photography effect compared with SLR cameras, especially in scenes with a high dynamic range of brightness, the effect gap is more obvious. High Dynamic Range (HDR) sensors support multiple exposures. In particular, when the HDR sensor is a single-frame progressive (stagger) HDR sensor, for high-dynamic scenes, the single-frame progressive HDR sensor collects image data of different exposures and fuses the collected image data to produce a high-dynamic image. In a high-dynamic image, the high-brightness areas are not overexposed and the details of the low-brightness areas are still clearly visible.

[0003] On triple-camera electronic devices and quad-camera electronic devices, usually only one HDR sensor is set, for example, the HDR sensor is the main wide-angle sensor. In zoom scenes, there is a situation where the HDR sensor smoothly switches to a non-HDR sensor, and vice versa. The dynamic switching mechanism between the HDR sensor and the non-HDR sensor is the same on triple-camera electronic devices and quad-camera electronic devices.

[0004] In the Image Signal Prosessor (ISP) intellectual property (IP) that supports multiple sensor data processing, in order to support HDR sensors, a complete pipeline needs to be established specifically for HDR image processing. Take a single-frame progressive HDR sensor as an example. The single-frame progressive HDR sensor supports row-level exposure. The so-called row-level exposure means that different exposures are performed on each row according to the current scene requirements. At the same time, N1 rows are in long exposure, N2 rows are in medium exposure, and N3 rows are in short exposure. Therefore, within one frame time, three types of image data of long exposure, medium exposure and short exposure are obtained at the same time, which shortens the data acquisition time as a whole and greatly reduces the possibility of ghost images. In order to meet real-time requirements, the ISP IP needs to process the same frame of images with long exposure, medium exposure and short exposure images at the same time. For this purpose, the ISP IP needs to reserve resources to meet the processing requirements of the three types of exposure images.

[0005] In order to support dynamic switching of HDR sensors and non-HDR sensors, the related technology reserves resources for image processing of HDR sensors and non-HDR sensors respectively, which leads to a larger ISP IP area, and then leads to an increase in chip area and chip cost. [Summary of the invention]

[0006] In view of this, an embodiment of the present invention provides a method for switching between an HDR sensor and a non-HDR sensor and an electronic device, so as to reduce chip area and thus reduce chip cost.

[0007] On the one hand, an embodiment of the present invention provides a method for switching between a high dynamic range image HDR sensor and a non-HDR sensor, including:

[0008] Receiving a zoom instruction input by a user, wherein the zoom instruction includes a zoom ratio;

[0009] Determining a target sensor according to the zoom ratio, wherein the target sensor is an HDR sensor or a non-HDR sensor;

[0010] releasing a target resource corresponding to the target sensor, where the target resource is a pipeline resource in a pipeline resource of an image signal processor ISP for processing an output image of the target sensor;

[0011] A target image output by the target sensor is received, and a first image processing is performed on the target image through the target resource.

[0012] Optionally, the target sensor is a non-HDR sensor;

[0013] After determining the target sensor according to the zoom ratio, the method further includes:

[0014] Receiving a long exposure image, a medium exposure image, and a short exposure image output by the HDR sensor;

[0015] performing a second image processing on the short-exposure image by using the pipeline resources for processing the short-exposure image, and performing a second image processing on the medium-exposure image by using the pipeline resources for processing the medium-exposure image;

[0016] The releasing the target resource corresponding to the target sensor includes:

[0017] Stop processing the long exposure image to release target resources corresponding to the non-HDR sensor.

[0018] Optionally, the target sensor is a non-HDR sensor;

[0019] After determining the target sensor according to the zoom ratio, the method further includes:

[0020] Receiving a long exposure image, a medium exposure image, and a short exposure image output by the HDR sensor;

[0021] performing a second image processing on the intermediate exposure image by using a pipeline resource for processing the intermediate exposure image;

[0022] The releasing the target resource corresponding to the target sensor includes:

[0023] Stop processing the long exposure image and the short exposure image to release target resources corresponding to the non-HDR sensor.

[0024] Optionally, the target sensor is a non-HDR sensor;

[0025] After determining the target sensor according to the zoom ratio, the method further includes:

[0026] Receiving the medium exposure image and the short exposure image output by the HDR sensor;

[0027] performing a second image processing on the intermediate exposure image by using a pipeline resource for processing the intermediate exposure image;

[0028] The releasing the target resource corresponding to the target sensor includes:

[0029] Stop processing the short exposure image to release target resources corresponding to the non-HDR sensor.

[0030] Optionally, the target sensor is an HDR sensor;

[0031] After determining the target sensor according to the zoom ratio, the method further includes:

[0032] receiving a target image output by the non-HDR sensor, and performing a first image processing on the target image by using a pipeline resource for processing the target image output by the non-HDR sensor;

[0033] receiving a long-exposure image, a medium-exposure image, and a short-exposure image output by the HDR sensor, performing a second image processing on the medium-exposure image through a pipeline resource for processing the medium-exposure image output by the HDR sensor, and discarding the long-exposure image and the short-exposure image;

[0034] The releasing the target resource corresponding to the target sensor includes:

[0035] Stop processing the target image output by the non-HDR sensor to release the target resource corresponding to the HDR sensor;

[0036] After releasing the target resource corresponding to the target sensor, the method further includes:

[0037] Receiving a long exposure image, a medium exposure image, and a short exposure image output by the HDR sensor;

[0038] The second image processing is performed on the medium exposure image through the pipeline resources used to process the medium exposure image, the second image processing is performed on the short exposure image through the pipeline resources used to process the short exposure image, and the second image processing is performed on the long exposure image through the target resources corresponding to the HDR sensor.

[0039] Optionally, the target sensor is an HDR sensor;

[0040] After determining the target sensor according to the zoom ratio, the method further includes:

[0041] receiving a target image output by the non-HDR sensor, and performing a first image processing on the target image by using a pipeline resource for processing the target image output by the non-HDR sensor;

[0042] receiving a medium exposure image and a short exposure image output by the HDR sensor, performing a second image processing on the medium exposure image by using a pipeline resource for processing the medium exposure image output by the HDR sensor, and discarding the short exposure image;

[0043] The releasing the target resource corresponding to the target sensor includes:

[0044] Stop processing the target image output by the non-HDR sensor to release the target resource corresponding to the HDR sensor;

[0045] After releasing the target resource corresponding to the target sensor, the method further includes:

[0046] Receiving the medium exposure image and the short exposure image output by the HDR sensor;

[0047] The second image processing is performed on the medium exposure image through the pipeline resources used to process the medium exposure image, and the second image processing is performed on the short exposure image through the target resources corresponding to the HDR sensor.

[0048] On the other hand, an embodiment of the present invention provides an electronic device, including: a chip and a target sensor, the chip and the target sensor are connected, and the target sensor is an HDR sensor or a non-HDR sensor;

[0049] The chip is used to receive a zoom instruction input by a user, wherein the zoom instruction includes a zoom ratio; determine a target sensor according to the zoom ratio; release a target resource corresponding to the target sensor, wherein the target resource is a pipeline resource in a pipeline resource of an image signal processor ISP for processing an image output by the target sensor; receive a target image output by the target sensor, and perform a first image processing on the target image through the target resource.

[0050] On the other hand, an embodiment of the present invention provides a chip, the chip includes a control module, a first ISP and two second ISPs, the control module is connected to the first ISP and the two second ISPs;

[0051] The first ISP includes at least one first processor, a pipeline source corresponding to each first processor, an image fusion module and a second processor, each first processor is connected to the corresponding pipeline resource, at least one first processor is connected to the image fusion module, and the image fusion module is connected to the second processor;

[0052] The second ISP includes a third processor, and the non-HDR sensor is connected to the corresponding third processor through an interface module.

[0053] On the other hand, an embodiment of the present invention provides an electronic device, comprising one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the terminal device, enable the terminal device to perform the above method.

[0054] On the other hand, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the above method.

[0055] In the technical solution provided by the embodiment of the present invention, a zoom instruction input by a user is received, and the zoom instruction includes a zoom ratio; according to the zoom ratio, a target sensor is determined, and the target sensor is an HDR sensor or a non-HDR sensor; a target resource corresponding to the target sensor is released, and the target resource is a pipeline resource in the pipeline resource of the image signal processor ISP for processing the output image of the target sensor; a target image output by the target sensor is received, and a first image processing is performed on the target image through the target resource. In the embodiment of the present invention, the switching between the HDR sensor and the non-HDR sensor is realized by releasing the target resource, which reduces the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

Brief Description of the Drawings

[0056] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0057] Figure 1 A schematic diagram of the structure of a switching system between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0058] Figure 2a A flowchart of a method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0059] Figure 2b A flowchart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0060] Figure 2c A flowchart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0061] Figure 2d A flowchart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0062] Figure 2e A flowchart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0063] Figure 2f A flowchart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0064] Figure 3a A signaling flow chart of a method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0065] Figure 3b A signaling flow chart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0066] Figure 3c A signaling flow chart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0067] Figure 3d A signaling flow chart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0068] Figure 3eA signaling flow chart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention;

[0069] Figure 4 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. [Specific implementation method]

[0070] In order to better understand the technical solution of the present invention, the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0071] It should be clear that the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0072] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0073] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0074] Figure 1 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention is shown in FIG. Figure 1 As shown, the electronic device includes a chip 15 and a target sensor, and the chip 15 is connected to the target sensor, wherein the target sensor is an HDR sensor or a non-HDR sensor.

[0075] In the embodiment of the present invention, the electronic device may include a chip 15, an HDR sensor 11 and at least one non-HDR sensor. For example, the at least one HDR sensor may include a non-HDR sensor 12 and a non-HDR sensor 13.

[0076] In the embodiment of the present invention, the electronic device further includes an interface module 14 , and the HDR sensor 11 and at least one non-HDR sensor are connected to the chip 15 via the interface module 14 .

[0077] The interface module 14 may include at least one physical layer (PHY) interface and at least one camera serial interface (CMOS Serial Interface, CSI).

[0078] The chip 15 may include a control module, a first ISP and two second ISPs, and the control module is connected to the first ISP and the two second ISPs. The HDR sensor 11 is connected to the first ISP via a PHY interface and a CSI, the non-HDR sensor 12 is connected to the second ISP via a PHY interface and a CSI, and the non-HDR sensor 13 is connected to the second ISP via a PHY interface and a CSI.

[0079] The first ISP includes at least one first processor, pipeline resources corresponding to each first processor, an image fusion module and a second processor, each first processor is connected to the corresponding pipeline resources, at least one first processor is connected to the image fusion module, and the image fusion module is connected to the second processor. The HDR sensor 11 is connected to the at least one first processor via the interface module 14.

[0080] The second ISP includes a third processor, and the non-HDR sensor 12 is connected to the corresponding third processor via the interface module 14 .

[0081] Furthermore, the chip 15 further includes at least one DDR. The second processor is connected to the corresponding DDR, and the third processor is connected to the corresponding DDR.

[0082] In an electronic device provided by an embodiment of the present invention, the electronic device receives a zoom instruction input by a user through a control module in a chip, and the zoom instruction includes a zoom ratio; according to the zoom ratio, a target sensor is determined, and the target sensor is an HDR sensor or a non-HDR sensor; a target resource corresponding to the target sensor is released, and the target resource is a pipeline resource in a pipeline resource of an image signal processor ISP for processing an output image of the target sensor; a target image output by the target sensor is received, and a first image processing is performed on the target image through the target resource. In the embodiment of the present invention, the electronic device realizes the switching between the HDR sensor and the non-HDR sensor by releasing the target resource, thereby reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0083] Figure 2a A flow chart of a method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention, such as Figure 2a As shown, the method includes:

[0084] Step 101: Receive a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0085] Each step in the embodiment of the present invention can be executed by a chip.

[0086] In the embodiment of the present invention, the zoom instruction is used to instruct the chip to perform a zoom operation. For example, a user slides a zoom slider on a shooting interface of an electronic device to input a zoom instruction.

[0087] For example, if the user slides the zoom slider to 0.5x, the zoom ratio is 0.5x zoom; if the user slides the zoom slider to 1.0x, the zoom ratio is 1.0x zoom; if the user slides the zoom slider to 2.0x, the zoom ratio is 2.0x zoom; if the user slides the zoom slider to 3.0x, the zoom ratio is 3.0x zoom.

[0088] Step 102: Determine a target sensor according to the zoom ratio, where the target sensor is an HDR sensor or a non-HDR sensor.

[0089] For example, the electronic device may be a three-camera mobile phone or a four-camera mobile phone. The embodiment of the present invention is described by taking the electronic device as a three-camera mobile phone as an example. For example, the three-camera mobile phone includes three cameras, and the three cameras include an ultra-wide angle (UltraWide angle, referred to as UW) camera, a wide angle (W) camera, and a telephoto (T) camera. Each camera may include a sensor, and the electronic device may include three sensors, and the three sensors include an HDR sensor and two non-HDR sensors. Among them, the HDR sensor includes a wide angle sensor, which may also be called a W sensor, and the wide angle sensor has 16 million pixels (MegaPixel, referred to as MP or M); the non-HDR sensor includes a telephoto sensor, which may be called a T sensor, and the telephoto sensor has 16M pixels; the non-HDR sensor includes an ultra-wide angle sensor, which may be called a UW sensor, and the ultra-wide angle sensor has 16M pixels.

[0090] In the embodiment of the present invention, different zoom ratios correspond to different target sensors, and step 102 may specifically include: determining the target sensor corresponding to the zoom ratio according to the zoom ratio. For example, when the zoom ratio is 3.0x zoom, the target sensor corresponding to the zoom ratio is the T sensor, and the determined target sensor is a non-HDR sensor; when the zoom ratio is 1.0x zoom, the target sensor corresponding to the zoom ratio is the W sensor, and the determined target sensor is an HDR sensor.

[0091] Step 103: Release the target resource corresponding to the target sensor, where the target resource is a pipeline resource in the ISP pipeline resource used to process the output image of the target sensor.

[0092] As an optional solution, if the target sensor is an HDR sensor, the target resource is a pipeline resource in the ISP corresponding to the HDR sensor for processing an output image of the HDR sensor.

[0093] As another optional solution, if the target sensor is a non-HDR sensor, the target resource is a pipeline resource in the ISP corresponding to the HDR sensor for processing an output image of the non-HDR sensor.

[0094] Step 104: Receive a target image output by the target sensor, and perform a first image processing on the target image through a target resource.

[0095] In the embodiment of the present invention, if the target sensor is an HDR sensor, the first image processing may be RAW processing, and the chip may perform RAW processing on the target image through the target resource.

[0096] In an embodiment of the present invention, if the target sensor is a non-HDR sensor, the first image processing may include RAW processing, RGB processing, and YUV processing, and the chip may perform RAW processing, RGB processing, and YUV processing on the target image through the target resource.

[0097] In the method for switching between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, a target resource corresponding to a target sensor is released, a target image output by the target sensor is received, and a first image processing is performed on the target image through the target resource. In the embodiment of the present invention, the switching between an HDR sensor and a non-HDR sensor is achieved by releasing the target resource, thereby reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0098] Figure 2b A flowchart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention is shown in FIG. Figure 2b As shown, the method includes:

[0099] Step 201: Receive a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0100] Each step in the embodiment of the present invention can be executed by a chip.

[0101] In this embodiment, it is assumed that the current sensor is an HDR sensor, and the user slides the zoom slider on the shooting interface to 1.0x. The HDR sensor outputs a long exposure image, a medium exposure image, and a short exposure image to the chip, and the chip needs to process the three exposure images of the long exposure image, the medium exposure image, and the short exposure image. For example, the HDR sensor is a W sensor. This embodiment shows the case where the HDR sensor outputs three exposure images.

[0102] At this time, the user slides the zoom slider to 3.0x to input a zoom command, and the zoom ratio in the zoom command is 3.0x zoom.

[0103] Step 202: Determine a target sensor according to the zoom ratio, where the target sensor is a non-HDR sensor.

[0104] In this embodiment, for example, the zoom ratio is 3.0x zoom, and the non-HDR sensor corresponding to the 3.0x zoom is determined to be the T sensor. Then the chip switches the HDR sensor to the non-HDR sensor according to the zoom instruction, that is, switches the W sensor to the T sensor.

[0105] Step 203: receiving the long exposure image, the medium exposure image, and the short exposure image output by the HDR sensor.

[0106] When the chip receives a zoom command, the HDR sensor still outputs long-exposure images, medium-exposure images, and short-exposure images to the chip.

[0107] Step 204: perform a second image processing on the short exposure image by using the pipeline resources for processing the short exposure image, and perform a second image processing on the medium exposure image by using the pipeline resources for processing the medium exposure image.

[0108] In this embodiment, since the chip receives a zoom instruction, the second image processing is performed only on the short exposure image and the medium exposure image.

[0109] In this embodiment, the second image processing is RAW processing.

[0110] Step 205: stop processing the long exposure image to release target resources corresponding to the non-HDR sensor.

[0111] In this step, the target resource is the pipeline resource used to process the long exposure image. Since the chip receives the zoom instruction, it stops processing the long exposure image to release the pipeline resource used to process the long exposure image. Thus, the target resource can be used to process the target image output by the non-HDR sensor.

[0112] It should be noted that: in this embodiment, step 205 and step 204 can be executed simultaneously, or step 205 can be executed before step 204.

[0113] Step 206: Receive a target image output by a non-HDR sensor, and perform a first image processing on the target image using a target resource.

[0114] In this embodiment, the chip can receive the target image output by the T sensor.

[0115] In this embodiment, the first image processing may include RAW processing, RGB processing and YUV processing.

[0116] In this embodiment, since the chip has released the target resources, the chip can process the target image output by the non-HDR sensor through the released target resources. Then, when the image obtained after the chip processes the target image output by the non-HDR sensor meets the display requirements, the chip can stop processing the image output by the HDR sensor, that is, the chip can stop processing the short exposure image and the medium exposure image output by the HDR sensor, thereby realizing the switch from the HDR sensor to the non-HDR sensor.

[0117] In the switching method between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, the target resources corresponding to the non-HDR sensor are released by stopping processing of the long exposure image output by the HDR sensor; the target image output by the non-HDR sensor is received, and the first image processing is performed on the target image through the target resources, thereby saving pipeline resources required when switching from the HDR sensor to the non-HDR sensor, reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0118] Figure 2c A flowchart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention is shown in FIG. Figure 2c As shown, the method includes:

[0119] Step 301: Receive a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0120] Step 302: Determine a target sensor according to the zoom ratio, where the target sensor is a non-HDR sensor.

[0121] Step 303: receiving the long exposure image, the medium exposure image, and the short exposure image output by the HDR sensor.

[0122] In this embodiment, the description of steps 301 to 303 can refer to the description of steps 201 to 203 in the above embodiment, and will not be repeated here.

[0123] Step 304: Perform second image processing on the intermediate exposure image using pipeline resources for processing the intermediate exposure image.

[0124] In this embodiment, since the chip receives a zoom instruction, the first image processing is only performed on the middle exposure image.

[0125] In this embodiment, the second image processing is RAW processing.

[0126] Step 305: stop processing the long exposure image and the short exposure image to release target resources corresponding to the non-HDR sensor.

[0127] In this step, the target resource is the pipeline resource used to process the long-exposure image. Since the chip receives the zoom command, it stops processing the long-exposure image and the short-exposure image to release the pipeline resources used to process the long-exposure image and the short-exposure image. As a result, the pipeline resources used to process the long-exposure image can be used to process the target image output by the non-HDR sensor.

[0128] It should be noted that: in this embodiment, step 305 and step 304 can be executed simultaneously, or step 305 can be executed before step 304.

[0129] Step 306: Receive a target image output by the non-HDR sensor, and perform a first image processing on the target image using a target resource.

[0130] In this embodiment, the first image processing may include RAW processing, RGB processing and YUV processing.

[0131] In this embodiment, since the chip has released the target resources, the chip can process the target image output by the non-HDR sensor through the released target resources, and then the chip can stop processing the image output by the HDR sensor, thereby achieving switching from the HDR sensor to the non-HDR sensor.

[0132] In the switching method between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, by stopping processing of the long-exposure image and the short-exposure image output by the HDR sensor, the target resources corresponding to the non-HDR sensor are released; the target image output by the non-HDR sensor is received, and the first image processing is performed on the target image through the target resources, thereby saving the pipeline resources required when switching from the HDR sensor to the non-HDR sensor, reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0133] Figure 2d A flowchart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention is shown in FIG. Figure 2d As shown, the method includes:

[0134] Step 401: Receive a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0135] Each step in the embodiment of the present invention can be executed by a chip.

[0136] In this embodiment, it is assumed that the current sensor is an HDR sensor, and the user slides the zoom slider on the shooting interface to 1.0x. The HDR sensor outputs a medium exposure image and a short exposure image to the chip, and the chip needs to process the two exposure images. For example, the HDR sensor is a W sensor. This embodiment shows the case where the HDR sensor outputs two exposure images.

[0137] At this time, the user slides the zoom slider to 3.0x to input a zoom command, and the zoom ratio in the zoom command is 3.0x zoom.

[0138] Step 402: Determine a target sensor according to the zoom ratio, where the target sensor is a non-HDR sensor.

[0139] In this embodiment, for example, the zoom ratio is 3.0x zoom, and the non-HDR sensor corresponding to the 3.0x zoom is determined to be the T sensor. Then the chip switches the HDR sensor to the non-HDR sensor according to the zoom instruction, that is, switches the W sensor to the T sensor.

[0140] Step 403: Receive the medium exposure image and the short exposure image output by the HDR sensor.

[0141] When the chip receives a zoom command, the HDR sensor still outputs medium exposure images and short exposure images to the chip.

[0142] Step 404: Perform second image processing on the intermediate exposure image using pipeline resources for processing the intermediate exposure image.

[0143] In this embodiment, since the chip receives a zoom instruction, the second image processing is performed only on the middle exposure image.

[0144] In this embodiment, the second image processing is RAW processing.

[0145] Step 405: stop processing the short exposure image to release target resources corresponding to the non-HDR sensor.

[0146] In this step, the target resource is the pipeline resource used to process the short-exposure image. Since the chip receives the zoom instruction, it stops processing the short-exposure image to release the pipeline resource used to process the short-exposure image. Thus, the target resource can be used to process the target image output by the non-HDR sensor.

[0147] It should be noted that: in this embodiment, step 405 and step 404 can be executed simultaneously, or step 405 can be executed before step 404.

[0148] Step 406: Receive a target image output by a non-HDR sensor, and perform a first image processing on the target image using a target resource.

[0149] In this embodiment, the first image processing may include RAW processing, RGB processing and YUV processing.

[0150] In this embodiment, since the chip has released the target resources, the chip can process the target image output by the non-HDR sensor through the released target resources, and then the chip can stop processing the image output by the HDR sensor, thereby achieving switching from the HDR sensor to the non-HDR sensor.

[0151] exist Figure 2a to Figure 2d In the illustrated embodiment, as an optional scheme, if the chip receives a zoom instruction within the Nth frame and completes the process of switching from the HDR sensor to the non-HDR sensor within the Nth frame, it indicates that the chip completes the switching from the HDR sensor to the non-HDR sensor within one frame, thereby completing the frame-level dynamic switching of the sensor. For the user who slides the zoom bar, the switching process is almost imperceptible.

[0152] exist Figure 2a to Figure 2d In the illustrated embodiment, as an optional scheme, if the chip receives a zoom instruction within the Nth frame and completes the process of switching from the HDR sensor to the non-HDR sensor within the N+1th frame, that is, the process of switching from the HDR sensor to the non-HDR sensor is completed within the Nth frame and the N+1th frame, then it indicates that the chip completes the switching from the HDR sensor to the non-HDR sensor within two frames, thereby completing the frame-level dynamic switching of the sensor. For the user who slides the zoom bar, the switching process is almost imperceptible.

[0153] In the switching method between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, by stopping processing of the short exposure image output by the HDR sensor, the target resources corresponding to the non-HDR sensor are released; the target image output by the non-HDR sensor is received, and the first image processing is performed on the target image through the target resources, thereby saving the pipeline resources required when switching from the HDR sensor to the non-HDR sensor, reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0154] Figure 2e A flowchart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention is shown in FIG. Figure 2e As shown, the method includes:

[0155] Step 501: Receive a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0156] Each step in the embodiment of the present invention can be executed by a chip.

[0157] In this embodiment, assuming that the current sensor is a non-HDR sensor, the user slides the zoom slider on the shooting interface to 3.0x, the non-HDR sensor outputs the target image to the chip, and the chip needs to process the target image. For example, the non-HDR sensor is a T sensor.

[0158] At this time, the user slides the zoom slider to 1.0x to input a zoom command, and the zoom ratio in the zoom command is 1.0x zoom.

[0159] Step 502: Determine a target sensor according to the zoom ratio, where the target sensor is an HDR sensor.

[0160] In this embodiment, for example, the zoom ratio is 1.0x zoom, and the HDR sensor corresponding to the determined 1.0x zoom is the W sensor. Then the chip switches the non-HDR sensor to the HDR sensor according to the zoom instruction, that is, switches the T sensor to the W sensor.

[0161] Step 503: Receive a target image output by a non-HDR sensor, and perform a first image processing on the target image by using pipeline resources for processing the target image output by the non-HDR sensor.

[0162] When the chip receives a zoom command, the non-HDR sensor still outputs the target image to the chip.

[0163] Since the non-HDR sensor still outputs the target image to the chip, the chip still performs the first image processing on the target image output by the non-HDR sensor.

[0164] In this embodiment, the first image processing may include RAW processing.

[0165] Step 504: receiving the long exposure image, the medium exposure image, and the short exposure image output by the HDR sensor, performing second image processing on the medium exposure image by using pipeline resources for processing the medium exposure image output by the HDR sensor, and discarding the long exposure image and the short exposure image.

[0166] In this embodiment, the second image processing may be RAW processing.

[0167] Step 505: Stop processing the target image output by the non-HDR sensor to release the target resources corresponding to the HDR sensor.

[0168] In this embodiment, when the image obtained after the chip performs the second image processing on the medium exposure image output by the HDR sensor meets the display requirements, the chip can stop processing the target image output by the non-HDR sensor to achieve the purpose of releasing the target resources corresponding to the HDR sensor.

[0169] In this step, the target resource is a pipeline resource for processing the target image output by the non-HDR sensor. Since the chip receives a zoom instruction, it stops processing the target image output by the non-HDR sensor to release the pipeline resource for processing the target image output by the non-HDR sensor. This allows the target resource to be used to process the image output by the HDR sensor, for example, the target resource is subsequently used to process the long exposure image output by the HDR sensor.

[0170] Step 506: Receive the long exposure image, the medium exposure image, and the short exposure image output by the HDR sensor.

[0171] This embodiment shows the case where the HDR sensor outputs three exposure images. Based on step 504, in this step, the chip further starts to receive the long exposure image and the short exposure image output by the HDR sensor, so as to achieve the purpose of simultaneously receiving the long exposure image, the medium exposure image and the short exposure image output by the HDR sensor.

[0172] Step 507: perform a second image processing on the medium exposure image by using the pipeline resources for processing the medium exposure image, perform a second image processing on the short exposure image by using the pipeline resources for processing the short exposure image, and perform a second image processing on the long exposure image by using the target resources corresponding to the HDR sensor.

[0173] In this embodiment, since the chip has released the target resources, the chip can process the long exposure image output by the HDR sensor through the released target resources, thereby achieving switching from the non-HDR sensor to the HDR sensor.

[0174] In the switching method between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, the target resources corresponding to the HDR sensor are released by stopping processing of a target image output by the non-HDR sensor; the long-exposure image, the medium-exposure image, and the short-exposure image output by the HDR sensor are received, and the long-exposure image, the medium-exposure image, and the short-exposure image output by the HDR sensor are subjected to first image processing through the target resources, thereby saving pipeline resources required when switching from the HDR sensor to the non-HDR sensor, reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0175] Figure 2f A flowchart of another method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention is shown in FIG. Figure 2f As shown, the method includes:

[0176] Step 601: Receive a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0177] Step 602: Determine a target sensor according to the zoom ratio, where the target sensor is an HDR sensor.

[0178] Step 603: Receive a target image output by a non-HDR sensor, and perform a first image processing on the target image by using pipeline resources for processing the target image output by the non-HDR sensor.

[0179] In this embodiment, the first image processing may include RAW processing.

[0180] Step 604: Receive the medium exposure image and the short exposure image output by the HDR sensor, perform second image processing on the medium exposure image by using pipeline resources for processing the medium exposure image output by the HDR sensor, and discard the short exposure image.

[0181] In this embodiment, the description of steps 601 to 604 can refer to the description of steps 501 to 504 in the above embodiment, which will not be repeated here.

[0182] In this embodiment, the second image processing is RAW processing.

[0183] Step 605: Stop processing the target image output by the non-HDR sensor to release the target resources corresponding to the HDR sensor.

[0184] In this embodiment, when the image obtained after the chip performs the second image processing on the medium exposure image output by the HDR sensor meets the display requirements, the chip can stop processing the target image output by the non-HDR sensor to achieve the purpose of releasing the target resources corresponding to the HDR sensor.

[0185] In this step, the target resource is a pipeline resource for processing the target image output by the non-HDR sensor. Since the chip receives a zoom instruction, it stops processing the target image output by the non-HDR sensor to release the pipeline resource for processing the target image output by the non-HDR sensor. This allows the target resource to be used to process the image output by the HDR sensor, for example, the target resource is subsequently used to process the short-exposure image output by the HDR sensor.

[0186] Step 606: Receive the medium exposure image and the short exposure image output by the HDR sensor.

[0187] This embodiment shows the case where the HDR sensor outputs two exposure images. Based on step 604, in this step, the chip further starts to receive the short exposure image output by the HDR sensor, so as to achieve the purpose of simultaneously receiving the medium exposure image and the short exposure image output by the HDR sensor.

[0188] Step 607: perform second image processing on the medium exposure image by using the pipeline resources for processing the medium exposure image, and perform second image processing on the short exposure image by using the target resources corresponding to the HDR sensor.

[0189] In this embodiment, since the chip has released the target resources, the chip can process the short-exposure image output by the HDR sensor through the released target resources, thereby achieving switching from the non-HDR sensor to the HDR sensor.

[0190] exist Figure 2e to Figure 2f In the embodiment shown, the chip starts processing the medium exposure image output by the HDR sensor at the Nth frame, stops processing the target image output by the non-HDR sensor at the N+1th frame to release the target resources corresponding to the HDR sensor, and processes the target image output by the non-HDR sensor at the N+2nd frame. Figure 2e In the embodiment, the HDR sensor outputs a long-exposure image, a medium-exposure image, and a short-exposure image. The chip completes the switching from the non-HDR sensor to the HDR sensor within three frames, thereby completing the frame-level dynamic switching of the sensor. For the user who slides the zoom bar, the switching process is almost imperceptible.

[0191] In the switching method between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, the target resources corresponding to the HDR sensor are released by stopping processing of a target image output by the non-HDR sensor; a medium-exposure image and a short-exposure image output by the HDR sensor are received, and a first image processing is performed on the medium-exposure image and the short-exposure image output by the HDR sensor through the target resources, thereby saving pipeline resources required when switching from the HDR sensor to the non-HDR sensor, reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0192] Figure 3a A signaling flow chart of a method for switching between an HDR sensor and a non-HDR sensor provided by an embodiment of the present invention, such as Figure 3a As shown, the method includes:

[0193] Step 801: The control module receives a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0194] In this embodiment, assuming that the current sensor is an HDR sensor, the user slides the zoom slider on the shooting interface to 3.0x to input a zoom command, and the zoom ratio in the zoom command is 3.0x zoom.

[0195] Step 802: The control module determines a target sensor according to the zoom ratio, where the target sensor is a non-HDR sensor.

[0196] In this embodiment, for example, the zoom ratio is 3.0x zoom, and the non-HDR sensor corresponding to the determined 3.0x zoom is the T sensor.

[0197] Step 803: The control module sends a switching instruction to the first ISP, where the switching instruction includes information of the non-HDR sensor.

[0198] In this embodiment, the information of the non-HDR sensor is used to identify the non-HDR sensor. For example, the information of the non-HDR sensor is used to identify the non-HDR sensor as a T sensor. Assume that the current sensor is an HDR sensor, that is, in this embodiment, the HDR sensor needs to be switched to a non-HDR sensor, that is, the W sensor is switched to a T sensor.

[0199] Step 804: The first ISP receives the long exposure image, the medium exposure image, and the short exposure image output by the HDR sensor.

[0200] In this embodiment, when the control module receives a zoom instruction, the HDR sensor still outputs a long exposure image, a medium exposure image, and a short exposure image to the first ISP.

[0201] Step 805: In response to the information from the non-HDR sensor, the first ISP performs a second image processing on the short exposure image through the pipeline resources used to process the short exposure image to generate a short exposure processed image, performs a second image processing on the medium exposure image through the pipeline resources used to process the medium exposure image to generate a medium exposure processed image, and stops processing the long exposure image to release the target resources corresponding to the non-HDR sensor.

[0202] In this embodiment, the first ISP learns through the information of the non-HDR sensor that the HDR sensor needs to be switched to a non-HDR sensor, that is, the W sensor is switched to a T sensor, so step 805 is executed to start processing only short exposure images and medium exposure images, and stop processing long exposure images to release target resources, wherein the target resources are pipeline resources used to process long exposure images.

[0203] In this embodiment, the second image processing is RAW processing.

[0204] Step 806: The first ISP performs HDR fusion processing on the short exposure processed image and the medium exposure processed image to generate a fused image, and performs third image processing on the fused image to generate first display image data.

[0205] In this embodiment, the third image processing may include RAW processing, RGB processing and YUV processing.

[0206] Step 807: The first ISP outputs the first display image data to the display screen.

[0207] Step 808: The display screen displays the first display image according to the first display image data.

[0208] Step 809: The second ISP receives the target image output by the non-HDR sensor.

[0209] In this embodiment, the second ISP receives the target image output by the T sensor.

[0210] Step 810: The second ISP performs a first image processing on a target image through a target resource to generate second display image data.

[0211] In this embodiment, the first image processing includes RAW processing, RGB processing and YUV processing.

[0212] Step 811: The second ISP outputs the second display image data to the display screen.

[0213] Step 812: The display screen displays the second display image according to the second display image data.

[0214] In this embodiment, when the second display image data obtained after the second ISP performs image processing on the target image meets the display requirements, the first ISP can stop processing the image output by the HDR sensor, and the first ISP can stop outputting image data to the display screen. At this time, the display screen stops displaying the first display image, and the display screen starts to display the second display image according to the second display image data output by the second ISP, thereby realizing the switching from the HDR sensor to the non-HDR sensor.

[0215] In the switching method between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, the first ISP stops processing the long exposure image in response to information from the non-HDR sensor to release target resources corresponding to the non-HDR sensor, and the second ISP performs the first image processing on the target image through the target resources to generate second display image data, thereby saving pipeline resources required when switching from the HDR sensor to the non-HDR sensor, reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0216] Figure 3b A signaling flow chart of another HDR sensor and non-HDR sensor switching method provided by an embodiment of the present invention, such as Figure 3b As shown, the method includes:

[0217] Step 901: The control module receives a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0218] Step 902: The control module determines a target sensor according to the zoom ratio, where the target sensor is a non-HDR sensor.

[0219] Step 903: The control module sends a switching instruction to the first ISP, where the switching instruction includes information of the non-HDR sensor.

[0220] Step 904: The first ISP receives the long exposure image, the medium exposure image, and the short exposure image output by the HDR sensor.

[0221] In this embodiment, the description of steps 901 to 904 can refer to the description of steps 801 to 804 in the above embodiment, which will not be repeated here.

[0222] Step 905: In response to the information of the non-HDR sensor, the first ISP performs a second image processing on the medium exposure image to generate a medium exposure processed image through pipeline resources used for processing the medium exposure image, and stops processing the long exposure image and the short exposure image to release the target resources corresponding to the non-HDR sensor.

[0223] In this embodiment, the first ISP learns through the information of the non-HDR sensor that the HDR sensor needs to be switched to a non-HDR sensor, that is, the W sensor is switched to a T sensor, so step 905 is executed to start processing only the medium exposure image, and stop processing the long exposure image and the short exposure image to release the target resources, wherein the target resources are the pipeline resources used to process the long exposure image and the short exposure image.

[0224] In this embodiment, the second image processing is RAW processing.

[0225] Step 906: The first ISP performs HDR fusion on the intermediate exposure processed image to generate a fused image, and performs color space processing on the fused image to generate first display image data.

[0226] In this embodiment, the color space processing may include RAW processing, RGB processing and YUV processing.

[0227] Step 907: The first ISP outputs the first display image data to the display screen.

[0228] Step 908: The display screen displays the first display image according to the first display image data.

[0229] Step 909: The second ISP receives the target image output by the non-HDR sensor.

[0230] In this embodiment, the second ISP receives the target image output by the T sensor.

[0231] Step 910: The second ISP performs a first image processing on a target image through a target resource to generate second display image data.

[0232] In this embodiment, the first image processing includes RAW processing, RGB processing and YUV processing.

[0233] Step 911: The second ISP outputs the second display image data to the display screen.

[0234] Step 912: The display screen displays the second display image according to the second display image data.

[0235] In this embodiment, when the second display image data obtained after the second ISP performs image processing on the target image meets the display requirements, the first ISP can stop processing the image output by the HDR sensor, and the first ISP can stop outputting image data to the display screen. At this time, the display screen stops displaying the first display image, and the display screen starts to display the second display image according to the second display image data output by the second ISP, thereby realizing the switching from the HDR sensor to the non-HDR sensor.

[0236] In the switching method between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, the first ISP stops processing the long-exposure image and the short-exposure image in response to information from the non-HDR sensor to release target resources corresponding to the non-HDR sensor, and the second ISP performs the first image processing on the target image through the target resources to generate second display image data, thereby saving pipeline resources required when switching from the HDR sensor to the non-HDR sensor, reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0237] Figure 3c A signaling flow chart of another HDR sensor and non-HDR sensor switching method provided by an embodiment of the present invention, such as Figure 3c As shown, the method includes:

[0238] Step 1001: The control module receives a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0239] Step 1002: The control module determines a target sensor according to the zoom ratio, where the target sensor is a non-HDR sensor.

[0240] Step 1003: The control module sends a switching instruction to the first ISP, where the switching instruction includes information of the non-HDR sensor.

[0241] In this embodiment, the description of steps 1001 to 1003 can refer to the description of steps 801 to 803 in the above embodiment, which will not be repeated here.

[0242] Step 1004: The first ISP receives the medium exposure image and the short exposure image output by the HDR sensor.

[0243] When the control module receives the zoom instruction, at this time, the HDR sensor still outputs the medium exposure image and the short exposure image to the first ISP.

[0244] Step 1005: In response to the information of the non-HDR sensor, the first ISP performs second image processing on the medium exposure image to generate a medium exposure processed image through pipeline resources used for processing the medium exposure image, and stops processing the short exposure image to release target resources corresponding to the non-HDR sensor.

[0245] In this embodiment, the first ISP learns through the information of the non-HDR sensor that the HDR sensor needs to be switched to a non-HDR sensor, that is, the W sensor is switched to a T sensor, so step 1005 is executed to start processing only the medium exposure image and stop processing the short exposure image to release the target resources, wherein the target resources are the pipeline resources used to process the short exposure image.

[0246] In this embodiment, the second image processing is RAW processing.

[0247] Step 1006: The first ISP performs third image processing on the intermediate exposure processed image to generate first display image data.

[0248] In this embodiment, the third image processing may include RAW processing, RGB processing and YUV processing.

[0249] Step 1007: The first ISP outputs the first display image data to the display screen.

[0250] Step 1008: The display screen displays the first display image according to the first display image data.

[0251] Step 1009: The second ISP receives the target image output by the non-HDR sensor.

[0252] In this embodiment, the second ISP receives the target image output by the T sensor.

[0253] Step 1010: The second ISP performs a first image processing on a target image through a target resource to generate second display image data.

[0254] In this embodiment, the first image processing includes RAW processing, RGB processing and YUV processing.

[0255] Step 1011: The second ISP outputs the second display image data to the display screen.

[0256] Step 1012: The display screen displays the second display image according to the second display image data.

[0257] In this embodiment, when the second display image data obtained after the second ISP performs image processing on the target image meets the display requirements, the first ISP can stop processing the image output by the HDR sensor, and the first ISP can stop outputting image data to the display screen. At this time, the display screen stops displaying the first display image, and the display screen starts to display the second display image according to the second display image data output by the second ISP, thereby realizing the switching from the HDR sensor to the non-HDR sensor.

[0258] In the switching method between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, the first ISP stops processing the short exposure image in response to information from the non-HDR sensor to release target resources corresponding to the non-HDR sensor, and the second ISP performs the first image processing on the target image through the target resources to generate second display image data, thereby saving pipeline resources required when switching from the HDR sensor to the non-HDR sensor, reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0259] Figure 3d A signaling flow chart of another HDR sensor and non-HDR sensor switching method provided by an embodiment of the present invention, such as Figure 3d As shown, the method includes:

[0260] Step 1101: The control module receives a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0261] In this embodiment, assuming that the current sensor is an HDR sensor, the user slides the zoom slider on the shooting interface to 1.0x to input a zoom command, and the zoom ratio in the zoom command is 1.0x zoom.

[0262] Step 1102: The control module determines a target sensor according to the zoom ratio, where the target sensor is an HDR sensor.

[0263] In this embodiment, for example, the zoom ratio is 1.0x zoom, and the non-HDR sensor corresponding to the determined 1.0x zoom is the W sensor.

[0264] Step 1103: The control module sends a switching instruction to the second ISP, where the switching instruction includes information of the HDR sensor.

[0265] In this embodiment, the information of the HDR sensor is used to identify the HDR sensor. For example, the information of the HDR sensor is used to identify the HDR sensor as a W sensor. Assume that the current sensor is a non-HDR sensor, that is, in this embodiment, the non-HDR sensor needs to be switched to an HDR sensor, that is, the T sensor is switched to a W sensor.

[0266] Step 1104: The second ISP receives the target image output by the non-HDR sensor.

[0267] Step 1105: The second ISP performs a first image processing on the target image by using pipeline resources for processing the target image output by the non-HDR sensor to generate second display image data.

[0268] When the control module receives the zoom instruction, at this time, the non-HDR sensor still outputs the target image to the second ISP.

[0269] In this embodiment, the first image processing includes RAW processing, RGB processing and YUV processing.

[0270] Step 1106: The second ISP outputs the second display image data to the display screen.

[0271] Step 1107: The display screen displays the second display image according to the second display image data.

[0272] Step 1108: The first ISP receives the long exposure image, the medium exposure image, and the short exposure image output by the HDR sensor.

[0273] Step 1109: The first ISP performs a second image processing on the medium exposure image to generate a medium exposure processed image through pipeline resources for processing the medium exposure image output by the HDR sensor, performs a third image processing on the medium exposure processed image to generate first display image data, and discards the long exposure image and the short exposure image.

[0274] In this embodiment, the second image processing is RAW processing, and the third image processing includes RAW processing, RGB processing and YUV processing.

[0275] Step 1110: The first ISP sends the first display image data to the display screen.

[0276] Step 1111: The display screen displays a first display image according to the first display image data.

[0277] When the first display image data obtained after the first ISP performs image processing on the intermediate exposure image meets the display requirement, the display screen displays the first display image according to the first display image data.

[0278] Step 1112: The second ISP stops processing the target image output by the non-HDR sensor in response to the information of the HDR sensor to release the target resources corresponding to the HDR sensor.

[0279] In this embodiment, the second ISP learns from the information of the HDR sensor that the non-HDR sensor needs to be switched to the HDR sensor, that is, the T sensor is switched to the W sensor, so the stop processing of the target image in step 1112 is executed to release the target resource, wherein the target resource is the pipeline resource for processing the long exposure image. At this time, the second ISP stops the image processing work.

[0280] Step 1113: The first ISP receives the long exposure image, the medium exposure image, and the short exposure image output by the HDR sensor.

[0281] Step 1114: The first ISP performs a second image processing on the medium exposure image through the pipeline resources for processing the medium exposure image to generate a medium exposure processed image, performs a second image processing on the short exposure image through the pipeline resources for processing the short exposure image to generate a short exposure processed image, and performs a second image processing on the long exposure image through the target resources to generate a long exposure processed image, performs HDR fusion processing on the short exposure processed image, the medium exposure processed image and the long exposure processed image to generate a fused image, and performs a third image processing on the fused image to generate first display image data.

[0282] Step 1115: The first ISP outputs the first display image data to the display screen.

[0283] Step 1116: The display screen displays the first display image according to the first display image data.

[0284] In the switching method between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, the second ISP stops processing a target image output by the non-HDR sensor in response to information from the HDR sensor to release target resources corresponding to the HDR sensor, and the first ISP performs second image processing on the target image through the target resources to generate a short-exposure processed image, a medium-exposure processed image, and a long-exposure processed image, performs HDR fusion processing on the short-exposure processed image, the medium-exposure processed image, and the long-exposure processed image to generate a fused image, and performs third image processing on the fused image to generate first display image data, thereby saving pipeline resources required when switching from an HDR sensor to a non-HDR sensor, reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0285] Figure 3e A signaling flow chart of another HDR sensor and non-HDR sensor switching method provided by an embodiment of the present invention, such as Figure 3e As shown, the method includes:

[0286] Step 1201: The control module receives a zoom instruction input by a user, where the zoom instruction includes a zoom ratio.

[0287] Step 1202: The control module determines a target sensor according to the zoom ratio, where the target sensor is an HDR sensor.

[0288] Step 1203: The control module sends a switching instruction to the second ISP, where the switching instruction includes information of the HDR sensor.

[0289] Step 1204: The second ISP receives the target image output by the non-HDR sensor.

[0290] Step 1205: The second ISP performs a first image processing on the target image by using pipeline resources for processing the target image output by the non-HDR sensor to generate second display image data.

[0291] Step 1206: The second ISP outputs the second display image data to the display screen.

[0292] Step 1207: The display screen displays the second display image according to the second display image data.

[0293] Step 1208: The first ISP receives the medium exposure image and the short exposure image output by the HDR sensor.

[0294] Step 1209: The first ISP performs a second image processing on the medium exposure image to generate a medium exposure processed image through pipeline resources for processing the medium exposure image output by the HDR sensor, performs a third image processing on the medium exposure processed image to generate first display image data, and discards the short exposure image.

[0295] Step 1210: The first ISP sends first display image data to a display screen.

[0296] Step 1211: The display screen displays a first display image according to the first display image data.

[0297] In this embodiment, the description of steps 1201 to 1211 can refer to the description of steps 1101 to 1111 in the above embodiment, which will not be repeated here.

[0298] Step 1212: The second ISP stops processing the target image output by the non-HDR sensor in response to the information of the HDR sensor to release the target resources corresponding to the HDR sensor.

[0299] In this embodiment, the second ISP learns from the information of the HDR sensor that the non-HDR sensor needs to be switched to the HDR sensor, that is, the T sensor is switched to the W sensor, so the stop processing of the target image in step 1212 is executed to release the target resource, wherein the target resource is the pipeline resource for processing the short exposure image. At this time, the second ISP stops the image processing work.

[0300] Step 1213: The first ISP receives the medium exposure image and the short exposure image output by the HDR sensor.

[0301] Step 1214: The first ISP performs a second image processing on the medium exposure image through the pipeline resources for processing the medium exposure image to generate a medium exposure processed image, and performs a second image processing on the short exposure image through the target resources to generate a short exposure processed image, performs HDR fusion processing on the short exposure processed image and the medium exposure processed image to generate a fused image, and performs a third image processing on the fused image to generate first display image data.

[0302] Step 1215: The first ISP outputs the first display image data to the display screen.

[0303] Step 1216: The display screen displays the first display image according to the first display image data.

[0304] In the switching method between an HDR sensor and a non-HDR sensor provided in an embodiment of the present invention, the second ISP stops processing a target image output by the non-HDR sensor in response to information from the HDR sensor to release target resources corresponding to the HDR sensor, the first ISP performs second image processing on the medium exposure image through pipeline resources used to process the medium exposure image to generate a medium exposure processed image, and performs second image processing on the short exposure image through target resources to generate a short exposure processed image, performs HDR fusion processing on the short exposure processed image and the medium exposure processed image to generate a fused image, and performs third image processing on the fused image to generate first display image data, thereby saving pipeline resources required when switching from the HDR sensor to the non-HDR sensor, reducing the area of ​​the ISP IP, thereby reducing the chip area, and further reducing the chip cost.

[0305] An embodiment of the present invention provides a storage medium, which includes a stored program, wherein when the program is running, the device where the storage medium is located is controlled to execute the steps of the embodiment of the above-mentioned method for switching between an HDR sensor and a non-HDR sensor. For a specific description, please refer to the embodiment of the above-mentioned method for switching between an HDR sensor and a non-HDR sensor.

[0306] An embodiment of the present invention provides an electronic device, including a memory and a processor, wherein the memory is used to store information including program instructions, and the processor is used to control the execution of the program instructions. When the program instructions are loaded and executed by the processor, the steps of the embodiment of the switching method between the HDR sensor and the non-HDR sensor are implemented. For a specific description, please refer to the embodiment of the switching method between the HDR sensor and the non-HDR sensor.

[0307] Figure 4 Schematic diagram of an electronic device provided by an embodiment of the present invention. Figure 4 As shown, the electronic device 30 of this embodiment includes: a processor 31, a memory 32, and a computer program 33 stored in the memory 32 and executable on the processor 31. When the computer program 33 is executed by the processor 31, the data processing method applied in the embodiment is implemented. To avoid repetition, it is not described one by one here. Alternatively, when the computer program is executed by the processor 31, the functions of each model / unit in the parking lot cooperative autonomous parking device in the embodiment are implemented. To avoid repetition, it is not described one by one here.

[0308] The electronic device 30 includes, but is not limited to, a processor 31 and a memory 32. Those skilled in the art will appreciate that Figure 4 It is only an example of the electronic device 30 and does not constitute a limitation of the electronic device 30. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the electronic device 30 may also include input and output devices, network access devices, buses, etc.

[0309] The processor 31 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0310] The memory 32 may be an internal storage unit of the electronic device 30, such as a hard disk or memory of the electronic device 30. The memory 32 may also be an external storage device of the electronic device 30, such as a plug-in hard disk, a Smart Media (SM) card, a Secure Digital (SD) card, a Flash Card, etc. equipped on the electronic device 30. Further, the memory 32 may also include both an internal storage unit of the electronic device 30 and an external storage device. The memory 32 is used to store computer programs and other programs and data required by the computer device. The memory 32 may also be used to temporarily store data that has been output or is to be output.

[0311] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0312] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0313] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units. The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the scope of protection of the present invention.

Claims

1. A method for switching between a high dynamic range image HDR sensor and a non-HDR sensor, characterized in that: include: Receiving a zoom instruction input by a user, wherein the zoom instruction includes a zoom ratio; According to the zoom ratio, determining a target sensor from an HDR sensor and a non-HDR sensor, wherein the target sensor is an HDR sensor or a non-HDR sensor; releasing a target resource corresponding to the target sensor, where the target resource is a pipeline resource in a pipeline resource of an image signal processor ISP for processing an output image of the target sensor; A target image output by the target sensor is received, and a first image processing is performed on the target image through the target resource.

2. The method according to claim 1, characterized in that The target sensor is a non-HDR sensor; After determining the target sensor according to the zoom ratio, the method further includes: Receiving a long exposure image, a medium exposure image, and a short exposure image output by the HDR sensor; performing a second image processing on the short-exposure image by using the pipeline resources for processing the short-exposure image, and performing a second image processing on the medium-exposure image by using the pipeline resources for processing the medium-exposure image; The releasing the target resource corresponding to the target sensor includes: Stop processing the long exposure image to release target resources corresponding to the non-HDR sensor.

3. The method according to claim 1, characterized in that The target sensor is a non-HDR sensor; After determining the target sensor according to the zoom ratio, the method further includes: Receiving a long exposure image, a medium exposure image, and a short exposure image output by the HDR sensor; Performing a second image processing on the intermediate exposure image by using a pipeline resource for processing the intermediate exposure image; The releasing the target resource corresponding to the target sensor includes: Stop processing the long-exposure image and the short-exposure image to release target resources corresponding to the non-HDR sensor.

4. The method according to claim 1, characterized in that The target sensor is a non-HDR sensor; After determining the target sensor according to the zoom ratio, the method further includes: Receiving the medium exposure image and the short exposure image output by the HDR sensor; Performing a second image processing on the intermediate exposure image by using a pipeline resource for processing the intermediate exposure image; The releasing the target resource corresponding to the target sensor includes: Stop processing the short exposure image to release target resources corresponding to the non-HDR sensor.

5. The method according to claim 1, characterized in that The target sensor is an HDR sensor; After determining the target sensor according to the zoom ratio, the method further includes: receiving a target image output by the non-HDR sensor, and performing a first image processing on the target image by using a pipeline resource for processing the target image output by the non-HDR sensor; receiving a long-exposure image, a medium-exposure image, and a short-exposure image output by the HDR sensor, performing a second image processing on the medium-exposure image through a pipeline resource for processing the medium-exposure image output by the HDR sensor, and discarding the long-exposure image and the short-exposure image; The releasing the target resource corresponding to the target sensor includes: Stop processing the target image output by the non-HDR sensor to release the target resource corresponding to the HDR sensor; After releasing the target resource corresponding to the target sensor, the method further includes: Receiving a long exposure image, a medium exposure image, and a short exposure image output by the HDR sensor; The second image processing is performed on the medium exposure image through the pipeline resources used to process the medium exposure image, the second image processing is performed on the short exposure image through the pipeline resources used to process the short exposure image, and the second image processing is performed on the long exposure image through the target resources corresponding to the HDR sensor.

6. The method according to claim 1, characterized in that The target sensor is an HDR sensor; After determining the target sensor according to the zoom ratio, the method further includes: receiving a target image output by the non-HDR sensor, and performing a first image processing on the target image by using a pipeline resource for processing the target image output by the non-HDR sensor; receiving a medium exposure image and a short exposure image output by the HDR sensor, performing a second image processing on the medium exposure image by using a pipeline resource for processing the medium exposure image output by the HDR sensor, and discarding the short exposure image; The releasing the target resource corresponding to the target sensor includes: Stop processing the target image output by the non-HDR sensor to release the target resource corresponding to the HDR sensor; After releasing the target resource corresponding to the target sensor, the method further includes: Receiving the medium exposure image and the short exposure image output by the HDR sensor; The second image processing is performed on the medium exposure image through the pipeline resources used to process the medium exposure image, and the second image processing is performed on the short exposure image through the target resources corresponding to the HDR sensor.

7. An electronic device, characterized in that: include: A chip and a target sensor, wherein the chip and the target sensor are connected, and the target sensor is an HDR sensor or a non-HDR sensor; The chip is used to receive a zoom instruction input by a user, wherein the zoom instruction includes a zoom ratio; determine a target sensor according to the zoom ratio; release a target resource corresponding to the target sensor, wherein the target resource is a pipeline resource in a pipeline resource of an image signal processor ISP for processing an image output by the target sensor; receive a target image output by the target sensor, and perform a first image processing on the target image through the target resource; Wherein, when the target sensor is an HDR sensor, the target resource is determined by a non-HDR sensor; When the target sensor is a non-HDR sensor, the target resource is determined by the HDR sensor.

8. The electronic device according to claim 7, characterized in that: The chip includes a control module, a first ISP and two second ISPs, and the control module is connected to the first ISP and the two second ISPs; The first ISP includes at least one first processor, a pipeline source corresponding to each first processor, an image fusion module and a second processor, each first processor is connected to the corresponding pipeline resource, at least one first processor is connected to the image fusion module, and the image fusion module is connected to the second processor; The second ISP includes a third processor, and the non-HDR sensor is connected to the corresponding third processor through an interface module.

9. An electronic device, characterized in that: The method comprises one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by a terminal device, enable the terminal device to execute the method described in any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 6.

Images