A parameter configuration method and device, and a storage medium

Abstract

The application discloses a parameter configuration method and device, and a storage medium. For each image sensor in at least one image sensor, a configuration parameter set corresponding to the image sensor is determined, the configuration parameter set is generated by an image processor based on an image collected by the corresponding image sensor, and the configuration parameter set includes at least two configuration parameters. For each configuration parameter set, a candidate configuration parameter is selected from the configuration parameter set to determine at least one candidate configuration parameter, and the at least one candidate configuration parameter is stored. The candidate configuration parameter is a valid configuration parameter in the configuration parameter set. In the case that a target image sensor is started, the at least one candidate configuration parameter is read, and a target configuration parameter is selected from the at least one read candidate configuration parameter, the target configuration parameter is used for the image processor to process target image data collected by the target image sensor.

Description

TECHNICAL FIELD

[0001] The present application relates to terminal control technology, and in particular to a parameter configuration method and device, and a storage medium. BACKGROUND

[0002] When the camera of the electronic device is started, the 5A algorithm is initially run, and the configuration parameter at the initial running of the 5A algorithm is the configuration parameter of the 5A hardware module at the end of the last camera application running. The configuration parameter used is referred to as "warm data". The use of 5A warm data can accelerate the convergence speed of the 5A algorithm and obtain a faster camera stability response effect.

[0003] For a homogeneous platform camera system, the Camera hardware abstraction layer (HAL) in the application processor computing processing unit (ACPU) directly controls and real-time monitors the running state of the image signal processing (ISP) hardware system, and the 5A algorithm is deployed on the ACPU side. The calculation and result output of the 5A algorithm are synchronized between image frames, and the Camera HAL in the ACPU can directly record the configuration parameter of the 5A hardware module corresponding to the last valid image frame at the end of the preview stream of a camera. However, in a heterogeneous platform camera system, the running state of the ISP hardware system is controlled and real-time monitored by a micro control unit (MCU), but the Camera HAL is deployed in the ACPU, so that the ACPU cannot directly obtain the configuration parameter on the 5A hardware module at the last valid frame. SUMMARY

[0004] Embodiments of the present application provide a parameter configuration method and device, and a storage medium, which can determine the configuration parameter, i.e. warm data, used when a target image sensor is started.

[0005] The technical solution of the embodiments of the present application is as follows:

[0006] The embodiments of the present application provide a parameter configuration method, which comprises the following steps:

[0007] For each image sensor in at least one image sensor, a configuration parameter set corresponding to the image sensor is determined, the configuration parameter set is generated by an image processor based on an image collected by the corresponding image sensor, and the configuration parameter set comprises at least two configuration parameters, different configuration parameters corresponding to different image frames;

[0008] For each configuration parameter set, a candidate configuration parameter is selected from the configuration parameter set to determine at least one candidate configuration parameter, and the at least one candidate configuration parameter is stored; the candidate configuration parameter is a valid configuration parameter in the configuration parameter set;

[0009] In a case where a target image sensor is started, the at least one candidate configuration parameter is read, and a target configuration parameter is selected from the read at least one candidate configuration parameter, the target configuration parameter being used for processing, by the image processor, of target image data collected by the target image sensor, the target image sensor being one of the at least one image sensor.

[0010] An embodiment of the present application provides an electronic device, which comprises:

[0011] A determination unit is configured to determine, for each image sensor in at least one image sensor, a configuration parameter set corresponding to the image sensor, the configuration parameter set being generated by an image processor based on an image collected by the corresponding image sensor, the configuration parameter set comprising at least two configuration parameters, different configuration parameters corresponding to different frames of images;

[0012] A first selection unit is configured to select, for each configuration parameter set, a candidate configuration parameter from the configuration parameter set to determine at least one candidate configuration parameter; the candidate configuration parameter is a valid configuration parameter in the configuration parameter set;

[0013] A storage unit is configured to store the at least one candidate configuration parameter;

[0014] A second selection unit is configured to, in a case where a target image sensor is started, read the at least one candidate configuration parameter, and select a target configuration parameter from the read at least one candidate configuration parameter, the target configuration parameter being used for processing, by the image processor, of target image data collected by the target image sensor, the target image sensor being one of the at least one image sensor.

[0015] An embodiment of the present application provides an electronic device, which comprises a processor configured to:

[0016] For each image sensor in at least one image sensor, a configuration parameter set corresponding to the image sensor is determined, the configuration parameter set being generated by an image processor based on an image collected by the corresponding image sensor, the configuration parameter set comprising at least two configuration parameters, different configuration parameters corresponding to different frames of images;

[0017] For each configuration parameter set, a candidate configuration parameter is selected from the configuration parameter set to determine at least one candidate configuration parameter, and the at least one candidate configuration parameter is stored; the candidate configuration parameter is a valid configuration parameter in the configuration parameter set;

[0018] In a case that a target image sensor is started, the at least one candidate configuration parameter is read, and a target configuration parameter is selected from the read at least one candidate configuration parameter, the target configuration parameter being used for processing target image data collected by the target image sensor by the image processor, the target image sensor being one of the at least one image sensor.

[0019] Embodiments of the present application provide an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps in the parameter configuration method.

[0020] Embodiments of the present application provide a computer readable storage medium having a computer program stored thereon, wherein the computer program is executable by a processor to implement the parameter configuration method.

[0021] Embodiments of the present application provide a chip for implementing the parameter configuration method, the chip comprising a processor configured to call and execute a computer program from a memory, so that a device installed with the chip implements the parameter configuration method.

[0022] The parameter configuration method and device provided by the embodiment of the application, the storage medium, for each image sensor in at least one image sensor, determine the configuration parameter set corresponding to the image sensor, the configuration parameter set is generated by an image processor based on an image collected by the corresponding image sensor, and the configuration parameter set includes at least two configuration parameters, and different configuration parameters correspond to different frames of images; for each configuration parameter set, a candidate configuration parameter is selected from the configuration parameter set to determine at least one candidate configuration parameter, and the at least one candidate configuration parameter is stored; the candidate configuration parameter is a valid configuration parameter in the configuration parameter set; in the case that a target image sensor starts, the at least one candidate configuration parameter is read, and a target configuration parameter is selected from the at least one read candidate configuration parameter, the target configuration parameter is used for the image processor to process target image data collected by the target image sensor, and the target image sensor is one of the at least one image sensor; thereby, the configuration parameter set including the configuration parameters of different frames of images is stored with valid configuration parameters, when the target image sensor starts, the target configuration parameter used for processing the current image frame collected by the target sensor is selected from the stored multiple valid configuration parameters, and in the case that the configuration parameter used by the target image sensor when starting is determined as hot data, the complexity of round-trip matching and inter-core communication is reduced. BRIEF DESCRIPTION OF DRAWINGS

[0023] Figure 1 is an optional flowchart of a parameter configuration method provided by the embodiment of the application;

[0024] Figure 2 is an optional structural diagram of an electronic device provided by the embodiment of the application;

[0025] Figure 3 is an optional flowchart of a parameter configuration method provided by the embodiment of the application;

[0026] Figure 4 is an optional flowchart of a parameter configuration method provided by the embodiment of the application;

[0027] Figure 5 is an optional structural diagram of a camera hardware system based on a heterogeneous platform provided by the embodiment of the application;

[0028] Figure 6 is a hot data determination flowchart provided by the embodiment of the application;

[0029] Figure 7 is a data transmission software transmission diagram of a camera system based on a heterogeneous platform provided by the embodiment of the application;

[0030] Figure 8 is a camera runtime 5A operation result cache schematic path provided by an embodiment of the present application;

[0031] Figure 9 is a camera runtime 5A operation result selection storage schematic path provided by an embodiment of the present application;

[0032] Figure 10 is a 5A operation result loading flow schematic path provided by an embodiment of the present application;

[0033] Figure 11 is a 5A hot data loading strategy schematic path provided by an embodiment of the present application;

[0034] Figure 12 is an optional schematic structural diagram of an electronic device provided by an embodiment of the present application;

[0035] Figure 13 is an optional schematic structural diagram of an electronic device provided by an embodiment of the present application;

[0036] Figure 14 is an optional schematic structural diagram of an electronic device provided by an embodiment of the present application;

[0037] Figure 15 is an optional schematic structural diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0038] In order to make the objectives, technical solutions and advantages of the present application clearer, the following will further describe the present application with reference to the accompanying drawings, and the described embodiments should not be regarded as limiting the present application, and all other embodiments obtained by those of ordinary skill in the art without creative labor fall within the scope of protection of the present application.

[0039] The embodiments of the present application can be provided as a parameter configuration method and device and a storage medium. In actual application, the parameter configuration method can be implemented by an electronic device, and each functional entity in the electronic device can be cooperatively implemented by hardware resources of a computer device (such as a terminal device, a network device, etc.), such as computing resources (such as a processor), and communication resources (such as used to support various communication modes such as optical cable and cellular).

[0040] Of course, the embodiments of the present application are not limited to being provided as a method and hardware, but can also have various implementation manners, for example, being provided as a storage medium (storing instructions for executing the parameter configuration method provided by the embodiments of the present application).

[0041] The following describes each embodiment of the parameter configuration method, device and storage medium provided by the embodiments of the present application.

[0042] The parameter configuration method provided in the embodiments of the present application can be as shown in Figure 1 The method can include the following steps.

[0043] In S101, the electronic device determines, for each image sensor in the at least one image sensor, a configuration parameter set corresponding to the image sensor, the configuration parameter set being generated by the image processor based on an image collected by the corresponding image sensor, the configuration parameter set including at least two configuration parameters, and different configuration parameters corresponding to different frames of images.

[0044] In the embodiments of the present application, the electronic device is provided with one or more image sensors, and for one image sensor in the image sensors possessed by the electronic device, a configuration parameter set corresponding to the image sensor is generated according to an image collected by the image sensor when the image sensor is running to collect images. The one or more image sensors can run simultaneously in the electronic device. The image sensor can be understood as a camera. The configuration parameter set corresponding to one image sensor is composed of configuration parameters corresponding to the image sensor, wherein the configuration parameters corresponding to the image sensor include configuration parameters of the image sensor and configuration parameters of a data processing path for processing the image collected by the image sensor. The data processing path is used to perform image processing functions such as automatic exposure, automatic focusing, and automatic white balance on the image collected by the image sensor. The data processing path can be composed of hardware modules for implementing the image processing functions, and the hardware modules in the data path can run on the image processor. The image processing functions in the data processing path are not limited in the embodiments of the present application. The configuration parameters of the image sensor are used to control the image sensor, and the configuration parameters of the image processing path are used to control the image processing path.

[0045] For one configuration parameter set, the configuration parameters corresponding to different frames of images can be included. When an image sensor is running, the image sensor collects images, and the image processor generates configuration parameters corresponding to one frame of image based on the frame of image, so as to constitute the configuration parameter set corresponding to the image sensor based on the configuration parameters corresponding to each frame of image in the at least one frame of image collected by the image sensor. In the embodiments of the present application, the configuration parameters generated by the image processor are used for the image processor to process the images collected by the image sensor later.

[0046] In an embodiment of the present application, the configuration parameters corresponding to one frame of image can include one or more, and the multiple configuration parameters can be considered as one configuration parameter cluster. It can be understood that one configuration parameter set includes multiple configuration parameter clusters, different configuration parameter clusters correspond to different frames of image, and the configuration parameter cluster corresponding to one frame of image includes one or more configuration parameters. Different configuration parameters corresponding to one frame of image are configuration parameters of different functions. For example, the configuration parameters of image sensor and the configuration parameters of 5A algorithm. The configuration parameters of 5A algorithm can be understood as the configuration parameters of the hardware module implementing the 5A algorithm in the data processing path. The 5A algorithm includes at least one of the following: Auto Exposure (AE), Auto Focus (AF), Auto While Balance (AWB), Auto Lens Shading Correction (ALSC), and Auto Anti-Flicker (ATF). Different configuration parameters in the multiple configuration parameters corresponding to one frame of image are used to configure different hardware modules running on the image processor to implement corresponding functions. For example, the configuration parameters corresponding to one frame of image include AE configuration parameters, AF configuration parameters, and AWB configuration parameters. The AE configuration parameters, the AF configuration parameters, and the AWB configuration parameters are respectively used to configure the hardware module 1 implementing the AE algorithm running on the image processor, the hardware module 2 implementing the AF algorithm running on the image processor, and the hardware module 3 implementing the AWB algorithm running on the image processor.

[0047] In an embodiment of the present application, for the AE algorithm, the configuration parameters thereof can be referred to as AE configuration parameters, and the AE configuration parameters include exposure, exposure time, gain, etc. For the AF algorithm, the configuration parameters thereof can be referred to as AF configuration parameters, and the AF configuration parameters include the code value of the motor in the image sensor, i.e., the motor driving distance, and the focus distance. For the AWB algorithm, the configuration parameters thereof can be referred to as AWB configuration parameters, and the AWB configuration parameters include color temperature and color image space CDM correction parameters. For the ALSC algorithm, the configuration parameters thereof can be referred to as ALSC configuration parameters, and the ALSC configuration parameters include the lens correction table for correcting lens shading. For the ATF algorithm, the configuration parameters thereof can be referred to as ATF configuration parameters, and the ATF configuration parameters include the frequency of public screen light.

[0048] In an embodiment of the present application, the plurality of configuration parameters corresponding to one frame of image can be generated by one image processor or by a plurality of image processors. The image processor can include at least one of an ACPU and an MCU. In an example, the plurality of configuration parameters corresponding to one frame of image are generated by the ACPU. In an example, the plurality of configuration parameters corresponding to one frame of image can be generated by the ACPU. In an example, part of the plurality of configuration parameters corresponding to one frame of image are generated by the ACPU, and the other part of the plurality of configuration parameters corresponding to one frame of image are generated by the MCU. The configuration parameters generated by the ACPU are used for processing the image collected by the image sensor by the ACPU, and the configuration parameters generated by the MCU are used for processing the image collected by the image sensor by the MAC.

[0049] For one image sensor, the configuration parameters included in the corresponding configuration parameter set are directed to different images. For example, the electronic device has an image sensor 1, and the configuration parameter set 1 corresponding to the image sensor 1 includes the configuration parameters corresponding to the mth frame of image and the configuration parameters corresponding to the m+1th frame of image. For another example, the electronic device has an image sensor 1 and an image sensor 2, the configuration parameter set 1 corresponding to the image sensor 1 includes the configuration parameters corresponding to the mth frame of image and the configuration parameters corresponding to the m+1th frame of image, and the configuration parameter set 2 corresponding to the image sensor 2 includes the configuration parameters corresponding to the m+2th frame of image and the configuration parameters corresponding to the m+3th frame of image.

[0050] In an embodiment of the present application, the configuration parameter sets corresponding to different image sensors can be stored in the same buffer area, i.e., a first cache area, and different configuration parameter sets are stored in different buffer queues in the first cache area. When the configuration parameters are stored, the frame number and the timestamp of the corresponding image and other auxiliary information are also stored, wherein the timestamp is the generation time of the corresponding image, and the electronic device can select the candidate configuration parameter based on the validity identifier of each configuration parameter in the configuration parameter set and the auxiliary information.

[0051] In an embodiment of the present application, when the image sensor is working, the image processor can generate the configuration parameter set corresponding to the corresponding image sensor in real time based on the image generated by the image sensor.

[0052] In S102, the electronic device selects the candidate configuration parameter from each configuration parameter set to determine at least one candidate configuration parameter and stores the at least one candidate configuration parameter. The candidate configuration parameter is the valid configuration parameter in the configuration parameter set.

[0053] For each set of configuration parameters, the electronic device selects an effective configuration parameter from the set of configuration parameters as a candidate configuration parameter corresponding to the image sensor, thereby forming at least one candidate configuration parameter based on the candidate configuration parameters corresponding to the image sensors. The electronic device stores the formed at least one candidate configuration parameter.

[0054] In the embodiments of the present application, when the electronic device stores the candidate configuration parameter, the following information corresponding to the candidate configuration parameter can be stored at least one of: the identifier of the image sensor corresponding to the candidate configuration parameter, the validity identifier, and the timestamp. The identifier of the image sensor corresponding to the candidate configuration parameter is used to identify which image sensor the candidate configuration parameter corresponds to, the validity identifier is used to identify that the candidate configuration parameter is an effective configuration parameter, and the timestamp represents the acquisition time of the image corresponding to the candidate configuration parameter to determine whether the candidate configuration parameter can be used as a target configuration parameter.

[0055] In the embodiments of the present application, if the configuration parameter is stored with the validity identifier and the timestamp, when a configuration parameter is stored as a candidate configuration parameter, the identifier of the corresponding image sensor can be directly added based on the validity identifier and the timestamp.

[0056] In the embodiments of the present application, the method of selecting a candidate configuration parameter from a set of configuration parameters by the electronic device is not limited.

[0057] The candidate configuration parameter stored in the electronic device can be understood as a data source of hot data, wherein the hot data can be understood as a corresponding configuration parameter for a next target image sensor.

[0058] S103, in the case where the target image sensor is started, the electronic device reads the at least one candidate configuration parameter, and selects a target configuration parameter from the read at least one candidate configuration parameter, the target configuration parameter is used for the image processor to process target image data collected by the target image sensor, and the target image sensor is one of the at least one image sensor.

[0059] When the electronic device uses the target image sensor to collect images, the at least one candidate configuration parameter stored is read, and a target configuration parameter is selected from the at least one candidate configuration parameter as hot data, the image processor is configured by the target configuration parameter, so that the image processor processes the image collected by the target image sensor based on the configuration of the configuration parameter, and realizes the function corresponding to the configuration parameter.

[0060] In the embodiments of the present application, the target image sensor is one of the at least one image sensor, and the target configuration parameter selected by the electronic device from the at least one candidate configuration parameter can be a candidate configuration parameter corresponding to the target image sensor or a candidate configuration parameter corresponding to another image sensor.

[0061] The target image sensor can be started in a scenario in which no image sensor is started in the electronic device, or the target image sensor can be started in a scenario in which another image sensor is started, and the image sensor performing image acquisition is switched from the other image sensor to the target image sensor, so that the target image sensor is used to perform image acquisition.

[0062] In the embodiments of the present application, after the electronic device determines the candidate configuration parameter corresponding to an image sensor, the candidate configuration parameter can be used as a configuration parameter of the current image sensor when the image sensor acquires an image later.

[0063] The parameter configuration method provided in the embodiments of the present application includes the following steps: determining a configuration parameter set corresponding to each image sensor in at least one image sensor, the configuration parameter set being generated by an image processor based on an image acquired by the corresponding image sensor, the configuration parameter set including at least two configuration parameters, and different configuration parameters corresponding to different frames of images; selecting a candidate configuration parameter from the configuration parameter set for each configuration parameter set to determine at least one candidate configuration parameter and store the at least one candidate configuration parameter; the candidate configuration parameter being a valid configuration parameter in the configuration parameter set; in a case where a target image sensor is started, reading the at least one candidate configuration parameter and selecting a target configuration parameter from the read at least one candidate configuration parameter, the target configuration parameter being used by the image processor to process target image data acquired by the target image sensor, the target image sensor being one of the at least one image sensor; thereby storing valid configuration parameters of configuration parameter sets including configuration parameters of different frames of images, selecting a target configuration parameter used to process a current frame of image acquired by the target sensor from the stored multiple valid configuration parameters when the target image sensor is started, and reducing the complexity of back-and-forth matching and inter-core communication in a case where the configuration parameter used by the target image sensor when the target image sensor is started is determined.

[0064] In some embodiments, the configuration parameter includes a first configuration parameter and a second configuration parameter, the first configuration parameter being generated by a first image processor, and the second configuration parameter being generated by a second image processor, and S101 determining the configuration parameter set corresponding to the image sensor includes:

[0065] In a case where the image sensor acquires a first frame image, a first configuration parameter corresponding to the first frame image is stored in correspondence with a first frame identifier, and a second configuration parameter corresponding to a second frame image acquired by the image sensor is stored in correspondence with the second frame identifier, the first frame identifier being used to identify the first frame image, and the second frame identifier being used to identify the second frame image, the second frame image being a previous frame image of the first frame image;

[0066] In a case where the image sensor acquires a third frame, a first configuration parameter corresponding to the third frame image is stored in correspondence with a third frame identifier, and a second configuration parameter corresponding to the first frame image is stored in correspondence with the first frame identifier, the third frame image being a next frame image of the first frame image, and the third frame identifier being used to identify the third frame image.

[0067] The first configuration parameter corresponding to the first frame identifier and the second configuration parameter corresponding to the first frame identifier constitute configuration parameters corresponding to the first frame image in the configuration parameter set.

[0068] In the embodiment, for an image sensor, in a case where the image sensor acquires a frame image, a first configuration parameter corresponding to the frame image and a second configuration parameter of a previous frame image are generated. The first configuration parameter is generated by a first image processor, and the second configuration parameter is generated by a second image processor. Here, the second frame image is a previous frame image of the first frame image, and the first frame image is a previous frame image of the third frame image.

[0069] In the embodiment, the first configuration parameter can include an AE configuration parameter (AE operation result) and an AF configuration parameter (AF operation result), and the first image processor is an MCU. An ISP running on the MCU generates the AE operation result and the AF operation result. The second configuration parameter can include an AWB configuration parameter (AWB operation result), an ALCS configuration parameter (ALCS operation result), and an ATF configuration parameter (ATF operation result), and the second image processor is an ACPU. The ACPU can include camera HALs of different image sensors, and the different camera HALs are used to generate the AWB operation result, the ALCS operation result, and the ATF operation result corresponding to the image sensor.

[0070] In an example, the configuration parameter is taken as a configuration parameter of a hardware module used for an A5 algorithm. The A5 algorithm includes the following algorithms: AE, AF, AWB, ALSC, and ATF. The structure of a camera hardware system in the electronic device is as shown in Figure 2As shown, it comprises: MCU, ISP, ACPU. MCU is used to control ISP, and ACPU comprises camera HAL, wherein, ISP obtains AE configuration parameters or AF configuration parameters according to image data input by AE algorithm and AF algorithm respectively. Camera HAL in ACPU obtains AWB configuration parameters, ALSC configuration parameters and ATF configuration parameters according to image data input by AWB algorithm, ALSC algorithm and ATF algorithm respectively.

[0071] In some embodiments, the first image processor (ACPU) is used to control the at least one image sensor, and the second image processor (MCU) is used to pre-process data collected by the image sensor; and the determining the configuration parameter set corresponding to the image sensor further comprises:

[0072] S1011, processing the second frame image by the second image processor to generate second configuration parameters corresponding to the second frame image;

[0073] S1012, sending the second configuration parameters and metadata of the first frame image collected by the image sensor to the first image processor;

[0074] S1013, processing the metadata of the first frame image by the first image processor to generate first configuration parameters corresponding to the first frame image;

[0075] S1014, storing the second configuration parameters corresponding to the second frame image and the first configuration parameters corresponding to the first frame image in a cache subspace corresponding to the image sensor in a first cache space by the first image processor.

[0076] For the first frame image, after the statistical information of different functions is determined, the second image processor can only determine the second configuration parameter based on the statistical information of the second function (the function corresponding to the second configuration parameter), and the second image processor sends the second configuration parameter and the statistical information of the first function (the function corresponding to the first configuration parameter) to the first image processor, and the first image processor determines the first configuration parameter based on the statistical information of the first function. When the second image processor determines the second configuration parameter based on the statistical information of the second function, the metadata of the first frame image is not obtained, at this time, the second configuration parameter is determined based on the metadata of the first frame image and the statistical information of the second function. When the second image processor sends the statistical information of the first function to the first image processor, the metadata of the first frame image can be sent to the first image processor together, and the first image processor determines the first configuration parameter based on the metadata of the first frame image and the statistical information of the first function. The second frame image can be a previous frame image of the first frame image, for example, the second frame image is the mth frame image, and the first frame image is the m+1th frame image. For another example, the second frame image is the N-1th frame image, and the first frame image is the Nth frame image.

[0077] Here, the second configuration parameter can include AE configuration parameters, i.e., AE operation results, AF configuration parameters, i.e., AF operation results, and the ISP runs on the second image processor, wherein the AE configuration parameters and the AF configuration parameters are used to configure AE control modules and AF control modules in the ISP, and the first configuration parameter can include AWB configuration parameters, i.e., AWB operation results, ALCS configuration parameters, i.e., ALCS operation results, and ATF configuration parameters, i.e., ATF operation results, and the camera HAL running on the ACPU can include AWB modules, ALSC modules, and ATF modules. The ISP can send the second configuration parameter and the statistical information of the first function to the camera HAL on the ACPU through the communication interface between the MCU and the ACPU.

[0078] In an example, taking the configuration parameter of the hardware module used for the A5 algorithm as an example, the A5 algorithm includes the following algorithms: AE, AF, AWB, ALSC, and ATF. The structure of the camera hardware system, i.e., the image processing system, in the electronic device is as shown in Figure 2 The MCU is used to control the ISP, and the ACPU includes a camera HAL, wherein the ISP obtains AE configuration parameters or AF configuration parameters according to image data input by AE algorithms and AF algorithms respectively. The camera HAL in the ACPU obtains AWB configuration parameters, ALSC configuration parameters, and ATF configuration parameters according to image data input by AWB algorithms, ALSC algorithms, and ATF algorithms respectively.

[0079] As shown in Figure 3As shown, the ISP firmware calculates the AE configuration parameter and the AF configuration parameter corresponding to the N-1th frame of image based on the statistical information of the AE and the AF, and sends the AE configuration parameter, the AF configuration parameter, the statistical information of the AWB, the ALSC and the ATF corresponding to the N-1th frame of image and the metadata of the Nth frame of image to the camera HAL in the ACPU, the camera HAL adds the AE configuration parameter and the AF configuration parameter corresponding to the N-1th frame of image to the configuration parameter group corresponding to the N-1th frame of image, and inputs the metadata of the Nth frame of image to the AWB algorithm, the ALSC algorithm and the ATF algorithm respectively to obtain the AWB configuration parameter, the ALSC configuration parameter and the ATF configuration parameter.

[0080] In the embodiment of the present application, in the determination process of the one-time configuration data, part of the configuration parameters of the previous frame of image are determined, and part of the configuration parameters of the current frame of image are determined, so that in the determination process of the one-time configuration parameter, the complete configuration parameter is not determined, in the determination process of the multiple-time configuration parameter, the one-time complete configuration parameter is determined, and the one-time complete configuration parameter is stored as a parameter cluster.

[0081] In an example, the second configuration parameters include AE configuration parameters and AF configuration parameters, and the first configuration parameters include AWB configuration parameters, ALSC configuration parameters and ATF configuration parameters; for the mth frame image, after the ISP determines the statistical information of the AE, AF, AWB, ALSC and ATF algorithms, the ISP determines the AF configuration parameters and the AF configuration parameters corresponding to the (m-1)th frame image based on the statistical information of the AE and AF and the metadata of the (m-1)th frame image, and determines the metadata of the mth frame image, and sends the AF configuration parameters and the AF configuration parameters corresponding to the (m-1)th frame image and the metadata of the mth frame image, the statistical information of the AWB, ALSC and ATF to the ACPU, the ACPU determines the AWB configuration parameters, the ALSC configuration parameters and the ATF configuration parameters of the mth frame image based on the metadata of the mth frame image and the statistical information of the AWB, ALSC and ATF, and the AF configuration parameters and the AF configuration parameters corresponding to the (m-1)th frame image and the AWB configuration parameters, the ALSC configuration parameters and the ATF configuration parameters of the mth frame image; for the (m+1)th frame image, after the ISP determines the statistical information of the AE, AF, AWB, ALSC and ATF algorithms, the ISP determines the AF configuration parameters and the AF configuration parameters corresponding to the mth frame image based on the statistical information of the AE and AF and the metadata of the mth frame image, and determines the metadata of the (m+1)th frame image, and sends the AF configuration parameters and the AF configuration parameters corresponding to the mth frame image and the metadata of the (m+1)th frame image, the statistical information of the AWB, ALSC and ATF to the ACPU, the ACPU determines the AWB configuration parameters, the ALSC configuration parameters and the ATF configuration parameters of the (m+1)th frame image based on the metadata of the (m+1)th frame image and the statistical information of the AWB, ALSC and ATF, and the AF configuration parameters and the AF configuration parameters corresponding to the mth frame image and the AWB configuration parameters, the ALSC configuration parameters and the ATF configuration parameters of the (m+1)th frame image, at this time, the AF configuration parameters and the AF configuration parameters corresponding to the mth frame image, the AWB configuration parameters, the ALSC configuration parameters and the ATF configuration parameters are stored as a cluster.

[0082] In an example, a complete configuration parameter structure is as follows:

[0083]

[0084] In another example, a complete configuration parameter structure is as follows:

[0085]

[0086]

[0087] In some embodiments, the S102 described selecting candidate configuration parameters from the configuration parameter set includes:

[0088] select a candidate configuration parameter from the set of configuration parameters when a first time condition is met; wherein the first time condition comprises at least one of:

[0089] the first image sensor corresponding to the set of configuration parameters is closed;

[0090] an image sensor performing image acquisition is switched from the first image sensor to a second image sensor, the first image sensor and the second image sensor being different image sensors in the at least one image sensor;

[0091] a time point determined based on a set period is reached.

[0092] In an embodiment of the present application, the timing of the electronic device selecting a candidate configuration parameter from the set of configuration parameters comprises at least one of:

[0093] Timing 1: the first image sensor corresponding to the set of configuration parameters is closed;

[0094] Timing 2: an image sensor performing image acquisition is switched from the first image sensor to a second image sensor;

[0095] Timing 3: a time point determined based on a set period is reached.

[0096] For Timing 1, when the camera is normally closed, the camera resource is normally released, and before the 5A service program is released, the 5A algorithm result data marked as Flag-Valid position, i.e., the valid configuration parameter, is stored as hot data into the file.

[0097] For Timing 2, when the camera switching occurs, such as simple switching, SAT scaling conversion, etc., the 5A algorithm result data marked as Flag-Valid position is extracted as hot data into the multi-camera hot data centralized area, and is stored as hot data into the file.

[0098] For Timing 3, in combination with the validity duration of the hot data, the 5A algorithm result data marked as Flag-Valid position is periodically extracted as hot data into the multi-camera hot data centralized area, and is stored as hot data into the file. In view of the problem that data is not saved in time in the case of Crash exception, the storage is regularly done, and the hot data life validity judgment is done when loaded.

[0099] Here, the multi-camera hot data centralized area can be understood as a centralized area for storing candidate configuration parameters of multiple cameras.

[0100] In the embodiments of the present application, the electronic device can select the 5A algorithm result data marked as Flag-Valid position, i.e., the candidate configuration parameter, from the configuration parameter set according to the valid thermal data selection strategy. The valid thermal data selection strategy can be based on the validity identification, timestamp and other information of the configuration parameter.

[0101] In some embodiments, the S102 includes:

[0102] The configuration parameter with the shortest generation time in the valid configuration parameters in the configuration parameter set is determined as the candidate configuration parameter of the configuration parameter set.

[0103] In the embodiments of the present application, when the electronic device selects the candidate configuration parameter, it starts from the configuration parameter set corresponding to the last frame of image in the configuration parameters included in the configuration parameter set, and checks the validity of each configuration parameter in sequence, and determines the first valid configuration parameter as the candidate configuration parameter. Here, when generating the configuration parameter, the validity identification corresponding to the configuration parameter can be generated.

[0104] In an example, the configuration parameter set corresponding to the last frame of image in the configuration parameter set is the configuration parameter corresponding to the Nth frame of image, at this time, the configuration parameter is invalid, then the configuration parameter corresponding to the N-1th frame is searched, if the N-1th frame configuration parameter is valid, the N-1th frame configuration parameter is determined as the candidate configuration parameter. Here, the reasons for the invalidity of the Nth frame configuration parameter can include: the metadata of the Nth frame of image is invalid, and can also include that the complete configuration parameter is not included.

[0105] In some embodiments, the electronic device further performs the following processing:

[0106] For each configuration parameter in the configuration parameter set, the validity of the configuration parameter is determined according to the validity identification of the configuration parameter, which is related to the validity of the metadata of the image corresponding to the configuration parameter and whether the configuration parameter is complete.

[0107] The validity identifier determines the validity of the required image metadata based on the corresponding configuration parameters and the integrity of the corresponding configuration parameters. For example, the configuration parameter set of the image sensor X includes configuration parameters corresponding to the mth frame image, the m+1th frame image, and the m+2th frame image. The configuration parameters corresponding to one frame image include configuration parameter 1, configuration parameter 2, and configuration parameter 3. Taking the configuration parameters corresponding to the mth frame image as an example, the validity identifier of the configuration parameters corresponding to the mth frame image is determined based on the validity of the metadata of the mth frame image and whether the configuration parameters 1, 2, and 3 are included in the configuration parameters. If the metadata of the mth frame image is valid and the configuration parameters 1, 2, and 3 are included in the configuration parameters, the validity identifier of the configuration parameters indicates that the configuration parameters are valid. If the metadata of the mth frame image is invalid or the configuration parameters 1, 2, and 3 are not included in the configuration parameters, the validity identifier of the configuration parameters indicates that the configuration parameters are invalid.

[0108] In the embodiments of the present application, the configuration parameters correspond to the validity mark, i.e., the validity identifier, the frame number, the timestamp, and the calculation result of the 5A algorithm of each frame image. The electronic device checks whether valid metadata can be obtained, whether the 5A algorithm is successfully processed, i.e., whether the configuration parameters are complete, and records the 5A warm data validity mark. When storing the result of each frame 5A algorithm, the complete and valid data result is checked in turn from the N-1th frame in reverse order. The first valid 5A algorithm result is marked as Flag-Valid.

[0109] When the camera is closed or switched off or periodically, the data marked as Flag-Valid is stored as warm data in a file, which can be used as warm data for the next start and input to the 5A algorithm.

[0110] In some embodiments, the at least one candidate configuration parameter is stored in S102, including:

[0111] The at least one candidate configuration parameter is stored in a configuration parameter file, and the configuration parameter file is stored in a set file path.

[0112] The at least one candidate configuration parameter is cached to a second cache space.

[0113] In the embodiments of the present application, the electronic device stores the at least one candidate configuration parameter in the form of a file to a set file path after determining the at least one candidate configuration parameter, and stores the at least one candidate configuration parameter to a second cache space, so that the at least one candidate configuration parameter is stored in multiple ways.

[0114] In an example, as Figure 4As shown, the camera in the electronic device includes camera 1 and camera 2, and the at least one configuration parameter group includes a configuration parameter set 1 of camera 1 and a configuration parameter set 2 of camera 2. The configuration parameter set 1 includes configuration parameter 1 corresponding to image frame 1 and configuration parameter 2 corresponding to image 2, and the configuration parameter set 2 includes configuration parameter 3 corresponding to image frame 3 and configuration parameter 4 corresponding to image 4. The candidate configuration parameter selected from the configuration parameter set 1 is configuration parameter 1, and the candidate configuration parameter selected from the configuration parameter set 2 is configuration parameter 4. Configuration parameter 1 and configuration parameter 2 are added to a file, the file is stored in a set file path, and configuration parameter 1 and configuration parameter 2 are cached in a cache.

[0115] In some embodiments, S103 reads the at least one candidate configuration parameter, including:

[0116] The target image sensor startup scene is determined, and the startup scene includes a first startup scene and a second startup scene. In the first startup scene, the second cache space is emptied, and in the second startup scene, the second cache space is not emptied.

[0117] The at least one candidate configuration parameter is read from the set file path or the second cache space according to the startup scene.

[0118] In the first startup scene, the electronic device does not have other image sensors before the target image sensor starts, which can also be referred to as an initial startup scene. In the second startup scene, the electronic device has other image sensors before the target image sensor starts, so that the image sensor that collects images switches from other image sensors to the current target image sensor, which can also be referred to as an image sensor switching scene.

[0119] In the first startup scene, the camera resource is normally released before the target image sensor starts, and the second cache space is emptied. Therefore, the electronic device reads a file from the set file path and parses the candidate configuration parameter from the read file. In the second startup scene, there are other image sensors before the target image sensor starts, and the second cache space is not emptied. Therefore, the electronic device reads the candidate configuration parameter from the second cache space.

[0120] In some embodiments, S103 selects a target configuration parameter for configuring the target image sensor from the at least one candidate configuration parameter, including:

[0121] The target configuration parameter is selected from the at least one candidate configuration parameter according to a set configuration parameter loading strategy. The configuration parameter loading strategy is related to at least one of the following information: a running time of an adjacent image sensor, and a sensor type of the image sensor.

[0122] The electronic device selects a target configuration parameter for the current target image sensor from at least one candidate configuration parameter by a configuration parameter loading strategy, wherein the configuration parameter loading strategy can be constructed based on factors such as a hot data life cycle, a neighboring camera runtime occasion, a camera type proximity relationship, and the like, so as to determine whether to load hot data of the self or hot data of a neighboring camera in the current scene, thereby solving problems such as hot data missing or expiring when multiple cameras are started or switched. The life cycle of the hot data includes the following states: survival, expiration, and default.

[0123] The configuration parameter loading strategy can also be referred to as a hot data loading strategy. If the configuration parameter is a 5A configuration parameter, the corresponding hot data loading strategy can be referred to as a 5A hot data loading strategy.

[0124] In the embodiments of the present application, the candidate configuration parameters read from the set file path or the second cache space can be determined based on the configuration parameter loading strategy, and whether the to-be-judged configuration parameter is a valid configuration parameter can be determined based on the timestamp of the to-be-judged configuration parameter. If the to-be-judged configuration parameter is a valid configuration parameter, the to-be-judged configuration parameter is determined as the target configuration parameter. If the to-be-judged configuration parameter is an invalid configuration parameter, a new to-be-judged configuration parameter is selected from the candidate configuration parameters read from the set file path or the second cache space based on the configuration parameter loading strategy. In the embodiments of the present application, the candidate configuration parameters read from the set file path or the second cache space can also be determined based on the starting scene, the to-be-judged configuration parameter can be selected from the read candidate configuration parameters based on the configuration parameter loading strategy, and whether the to-be-judged configuration parameter is the target configuration parameter can be determined based on the timestamp of the to-be-judged configuration parameter.

[0125] In the embodiments of the present application, the configuration parameter loading strategy follows at least one of the following principles:

[0126] Principle one:

[0127] According to the loading order and validity check of the 5A hot data file of the camera itself, the 5A hot data cache of the neighboring camera, and the 5A hot data file of the neighboring camera, the first valid configuration parameter obtained is the target configuration parameter.

[0128] Principle two:

[0129] When the camera camera-x is started, if the hot data of the neighboring camera-y needs to be used, the hot data of the other party is borrowed as the starting hot data of itself according to the degree of similarity with the type of the camera itself. The priority order of loading the neighboring camera is (not limited to) ultra-wide, wide-angle, telephoto, and macro cameras, and the priority of the neighboring camera is upward.

[0130] In some embodiments, the selecting the target configuration parameter from the at least one candidate configuration parameter according to the set configuration parameter loading strategy in S103 comprises:

[0131] selecting a first candidate configuration parameter from the at least one candidate configuration parameter according to the configuration parameter loading strategy;

[0132] judging whether the first candidate configuration parameter is in a state of survival;

[0133] if the first candidate configuration parameter is not in the state of survival, continuing to select a first candidate configuration parameter from the at least one candidate configuration parameter according to the configuration parameter loading strategy and judging whether the first candidate configuration parameter is in the state of survival until the selected first candidate configuration parameter is in the state of survival;

[0134] if the first candidate configuration parameter is in the state of survival, determining that the first candidate configuration parameter is the target configuration parameter.

[0135] In the embodiments of the present application, after a first candidate configuration parameter is selected based on the configuration parameter loading strategy, it is judged in which state of the life cycle the first candidate configuration parameter is in. If the first candidate configuration parameter is in the state of survival, it is considered that the first candidate configuration parameter is valid and the first candidate configuration parameter is determined as the target configuration parameter. If the state of the first candidate configuration parameter is not storage but expiration or default, it is determined that the first candidate configuration parameter is not the target configuration parameter and the next candidate configuration parameter is searched as a new first candidate configuration parameter until a first candidate configuration parameter in the state of survival is found.

[0136] In an example, if the candidate configuration parameter of the current camera camera-x exists in the form of a file, after being loaded and parsed, the validity of the candidate configuration parameter is analyzed and the state is checked. If the state is survival, the life cycle of the candidate configuration parameter is not expired and the candidate configuration parameter of the camera-x stored in the form of a file is loaded as the target configuration parameter when the camera is started.

[0137] In an example, if the corresponding candidate configuration parameter of the current camera camera-x exists in the form of a file, after loading and parsing, the candidate configuration parameter validity check state is checked. If it is an expired state, the candidate configuration parameter life cycle has ended, then: (1) if the camera just switches from the adjacent camera-y to the current camera-x, the candidate configuration parameter in the memory buffer area of the adjacent camera-y is loaded when the current camera is started (the resources of the adjacent camera-y will be maintained for a period of time after switching, and if it is not switched back for a long time, the resources will be exited and destroyed); (2) if the adjacent camera-y is not running, it is determined whether the candidate configuration parameter of the adjacent camera-y is expired when the current camera-x is started. If it is not expired, the candidate configuration parameter of the camera-y is used; (3) if the candidate configuration parameter of the camera-y is also expired, the candidate configuration parameter of the camera-x is continued to be used.

[0138] In an example, if the corresponding candidate configuration parameter of the current camera-x does not exist in the form of a file, it is determined that the candidate configuration parameter corresponding to the camera-x is in a missing state. It is checked whether there is a type adjacent camera-y, and the target configuration parameter is extracted from the candidate configuration parameter in the memory buffer area of the camera-y according to the running situation of the camera-y. The priority order of the adjacent camera-y for loading is (not limited to) ultra-wide, wide-angle, telephoto, and macro cameras, and the priority of the adjacent camera-y is upwardly dependent.

[0139] Next, the parameter configuration method provided by the embodiments of the present application is further described.

[0140] The embodiments of the present application provide a Camera system 5A warm data collaborative storage and loading scheme based on a heterogeneous platform, including: (1) using the N-1 frame image AE / AF algorithm result carried by the N frame image Meta of the cross-system uplink distribution, fusing the N-1 frame AWB / LSC / ATF result and caching, designing an effective warm data selection strategy to avoid invalid warm data, flush instruction and pipeline non-synchronous cache caused by abnormal crash (crash), locking the selected frame 5A information as warm data, and greatly reducing the complexity of round-trip matching and inter-core communication in a general scheme. (2) Based on the warm data life cycle, the running time of the adjacent camera, and the similar relationship of the camera type, a set of 5A algorithm warm data loading strategy is constructed to determine whether to load the own warm data or the warm data of the adjacent camera in the current scene, so as to solve the problems of warm data missing and expiration when multiple cameras are started or switched.

[0141] The Camera hardware system based on the heterogeneous platform is as follows: Figure 5As shown, the camera system (Camera-Sys) in the camera hardware system includes: MCU and ISP, the MCU controls the ISP through a bus protocol (Advanced eXtensible Interface, AXI), the application system (AP-Sys) in the camera hardware system includes: ACPU, the MCU and the ACPU exchange information through a mailbox (Mailbox) communication bus. Among them, the AE / AF control is sunk in the MCU side, and the AE / AF algorithm generates operation results. The AW / ALSC / ATF algorithm is deployed on the ACPU side. The statistical data operation of a certain frame of image, the MCU side and the ACPU side run at the same time respectively, therefore, how to simultaneously concentrate the AE / AF, AWB / ALSC / ATF algorithm results obtained by analyzing the same frame of image as the subsequent hot data, how to store multiple cameras, and how to load under various conditions, are problems that need to be further solved by the application.

[0142] In the embodiment of the application, the ISP is used to implement the image signal processing ISP algorithm, and the preprocessing of the image includes 5A algorithm, front-end (FE) processing, middle-end (ME) processing, and the processing of the image by the ISP further includes BE processing. Among them, different ends are used to perform different processing on the image. In addition to including the ACPU, the AP Sys can also run an application software program for image processing.

[0143] The acquisition process of 5A hot data is as shown in Figure 6 The process includes the following five steps:

[0144] S1, generation: 5A algorithm deployed on different processors, after each frame of image is generated, operation results are generated according to relevant input parameters.

[0145] S2, acquisition: acquiring operation results from the 5A algorithm, and transmitting to the ACPU side through a data path.

[0146] S3, caching: on the ACPU side, the 5A result data of the same camera is matched according to the image frame number, and temporarily stored in the cache area.

[0147] S4, concentration: for one or more cameras, valid data is selected from the cache at regular intervals and stored.

[0148] S5, storage: the 5A valid data stored at regular intervals or when the camera is closed is stored in a file in a certain format as hot data.

[0149] The 5A Warm Data software transmission path based on a heterogeneous platform is as shown in Figure 7 As shown in Figure 7In the embodiment, the camera system includes: a Hardware layer, a Firmware layer, a Kernel layer, a User layer, and a Camera Hardware Abstraction Layer (Camera HAL). The Hardware layer and the Firmware layer belong to the MCU, and the Kernel layer, the User layer, and the Camera HAL layer belong to the ACPU.

[0150] For the Hardware layer, there are many hardware modules in the ISP hardware. In addition to flowing to the next stage of hardware, the image stream output by each sensor sensor is input to the 5A statistical module, such as the AWB, AE, AF, ALSC, and ATF corresponding statistical modules. Each statistical module periodically outputs Stats statistical information according to the Sensor frame rate, and provides the 5A algorithm to calculate the 5A operation result.

[0151] For the Firmware layer, it is a control pipeline for managing the camera hardware. The AE / AF related algorithms and software control are directly controlled by the bottom MCU core. In the following description, N frame represents the current running image frame. N-1 represents the previous frame image.

[0152] In the ISP FW of the Firmware layer, there are: IQC, module 1: AE control (AE CTL), module 2: AF control (CTL), AWB control (ATL), and ALSC control (CTL). Among them, module 1 is used for AEC (automatic exposure control) logic and algorithm, processes each frame of image information, and outputs the AE operation result. Module 2 is used for AFC (automatic focus control) logic and algorithm, processes each frame of image information, and outputs the AF operation result.

[0153] In the Firmware layer, there is also module 3: FE MetaBuffer, in which the N-1 frame AE / AF operation result is placed in the N frame image corresponding FE MetaBuffer. The N frame MetaBuffer is uploaded to the AP layer. The MCU interacts with the AP side through Metadata to upload the uplink data.

[0154] For the Kernel layer: the Android software Linux kernel. The Kernel layer includes module 4, which is loaded with drivers related to ISP, sensor, etc. Module 4 is used to realize the interaction between the Firmware layer and the User layer, and can realize the uploading of MetaBuffer and other data.

[0155] For the User layer: the HW Layer layer thereof implements the interaction between the Kernel and the User layer. Among them, the HW Layer is used for information management of the ISP service. The User layer includes: module 5, module 5 includes software modules such as Message Manager, ISP service, etc., which can realize uploading of MetaBuffer and the like data.

[0156] Camera HAL, belonging to AP, is used for controlling the specific business logic of the Camera. AWB, ALSC, ATF algorithm, data processing.

[0157] The Camera HAL includes the following modules 6 to 13. Among them,

[0158] Module 6: receives MetaBuffer sent from the MCU side through the source node 0 (SourceNode 0) and timely dispatches it to module 7. At this time, it waits for module 7 to complete the Meta data analysis, and then continues to dispatch other data to modules 8 to 12. Among them, different cameras can correspond to different source nodes.

[0159] Module 7, namely MetaDataNode_0: receives N frames of MetaBuffer, and stores the AE / AF algorithm results of N-1 frames in the shared data space MetaTable after analysis, for subsequent use by other modules. AE / AF / AWB / ALSC / ATF Node can access.

[0160] Module 8, namely AF node (afNode_0), and module 9, namely AE node (aeNode_0): with the operation of N frame data dispatching of SouceNode, AE / AF Node accesses MetaTable, respectively obtains AE / AF algorithm results of N-1 frames, and backfills them into a RingBuffer commonly used by 5A, corresponding to the data position of N-1 frames, referring to the storage position of frame number N-1 AE / AF in module 13 Ring-Buffer. That is, module 8 and module 9 receive N frames of FE MetaBuffer, take out N-1 frames of AE / AF algorithm results, and fill the data into the Ring-Buffer position corresponding to N-1 frames.

[0161] Module 10, i.e., ATF node (atfNode_0), module 11, i.e., ALSC node (alscNode_0), module 12, i.e., AWB node (awbNode_0): after the AWB / ATF / ALSC algorithm outputs results with the operation of the SourceNode dispatching each frame of data, on one hand, the corresponding image frame number is cached in the 5A public RingBuffer queue, and when the frame is stored, the frame is cached in real time; on the other hand, the MCU is dispatched, and the frame number is matched with the AE / AF algorithm results to form a cluster of information, the ISP hardware pipeline configuration parameters are constructed, and the 5A related hardware modules are configured, which are used to process the image stream of subsequent frames. When each subsequent image is generated, the MCU uploads the Meta data in the FE stage of the ISP process, and the output results of the AE / AF algorithm of the previous frame are attached. Module 12, module 11 and module 10 store the Nth image AWB / ALSC / ATF algorithm calculation results in the Nth corresponding Ring-Buffer position.

[0162] Module 13: RingBuffer for storing 5A operation results. The Nth image AWB / ALSC / ATF algorithm calculation results are stored in the Nth corresponding Ring-Buffer position. Therefore, from the perspective of the pipeline, for the same frame of image, the AWB / ALSC / ATF algorithm calculation results are always earlier than the AE / AF algorithm data results, and are stored in the Ring-Buffer.

[0163] The processCaptureRequest in the core provides image information for image processing when the image sensor collects images.

[0164] Camera runtime cache 5A operation results

[0165] As shown in Figure 8 , the camera single camera runtime caches 5A operation results.

[0166] As shown in Figure 8 , the 801 is a 5A result data structure body (schematic) corresponding to one frame of image. The 5A warm data validity flag, frame number, time stamp, and operation results of each frame of image 5A algorithm.

[0167] The Cameral HAL service software checks whether valid Meta can be obtained, whether the 5A algorithm is successfully processed, i.e., whether the operation results of each algorithm in the 5A algorithm are obtained, and records the 5A warm data validity flag.

[0168] In addition, the flush instruction is downloaded before the pipeline is closed, and the ISP still has data to send before it stops. The pipeline on the AP side has already started to prepare for destruction, and the integrity of the subsequent frame 5A algorithm result data needs to be determined. If the MetaBuffer does not contain AE / AF algorithm results or the running results are abnormal, the 5A warm data validity flag will be recorded as false.

[0169] Figure 8 The middle 802 is the operation result of the continuous m frames of images 5A. The operation results of the continuous m frames of images 5A are recorded in real time, and through the data content, the operation results of each frame of image 5A are clearly recorded as the data source for subsequent hot data selection.

[0170] Figure 8 The middle 803 is the RingBuffer buffer storing the operation results of 5A. This RingBuffer is used as a carrier for storing the operation results of 5A. For each real-time running camera, the N-1 frame of AE / AF data carried by the current N frame of FE MetaBuffer is continuously backfilled into the RingBuffer corresponding to the N-1 frame.

[0171] Effective hot data selection strategy

[0172] The 5A warm data contains a validity flag, frame number, timestamp, and calculation result of each frame of image 5A algorithm. The CameraHAL business software checks whether valid Meta can be obtained, whether the 5A algorithm is successfully processed, and records the 5A warm data validity flag. When storing the 5A algorithm result of each frame, the data result is checked in reverse order from N-1 frame to N-1 frame. The first valid 5A algorithm result checked is marked as Flag-Valid.

[0173] When this camera is closed or switched away or periodically, the data marked as Flag-Valid is stored as hot data in a file or buffer, which can be used as hot data for the next start and input to the 5A algorithm.

[0174] Multi-camera 5A warm data storage method

[0175] As shown in Figure 9 , the 5A operation results are selected and stored when the camera multi-camera is running. When the multi-camera is running, each camera, for example, camera x, y, stores the 5A hot data in the manner shown in Figure 8 .

[0176] The Camera HAL system selects 5A (Data Acquisition, Analysis, and Availability) results from all working cameras at the following times: when a camera is turned off, switched to another camera, or periodically; it sequentially checks complete and valid data results starting from frame N-1, and promptly selects 5A results, aggregates them into a single data structure, and stores or updates them to a file.

[0177] The timing for storing the results of the relevant 5A algorithm as hot data can be determined in the following ways:

[0178] (a) When the camera is off:

[0179] When the camera is turned off normally, the camera resources are released normally. Before the 5A business program releases the data, the 5A algorithm result data marked as Flag-Valid is stored as hot data in the file according to the "effective hot data selection strategy".

[0180] (b) Camera switching:

[0181] When camera switching occurs, such as simple switching or SAT scaling conversion, the 5A algorithm result data marked as Flag-Valid is extracted as hot data into the "Multi-camera Hot Data Central Area" according to the "Effective Hot Data Selection Strategy" and stored as hot data in a file.

[0182] (c) Regularly:

[0183] Based on the validity period of hot data, and according to the results of the "effective hot data selection strategy," 5A algorithm result data marked as Flag-Valid is periodically extracted as hot data and stored in the "multi-camera hot data centralized area," and simultaneously stored as hot data in a file. To address the issue of untimely data saving when Crash anomalies occur, regular storage and hot data validity checks are performed during loading.

[0184] like Figure 10 The diagram shown is a simplified flowchart of the 5A hot data loading process. The 5A hot data loading method is divided into two types based on how the hot data is stored:

[0185] Thermal data is stored in the form of files.

[0186] When a camera is turned on, during the pre-stream initialization phase, the camera software reads the thermal data file, loads it into memory, and parses the 5A algorithm thermal data using the corresponding data storage structure. This data corresponds to algorithms such as AE / AF / AWB / ALSC / ATF. The software then checks the camera ID and thermal data validity for matching, and then configures the data (either input or sent) for use in the 5A algorithm initialization process.

[0187] Hot data is stored in the form of a cache.

[0188] When the camera has multiple cameras, if a certain camera-x is initialized, its thermal data time is too long to expire, and the adjacent camera-y may be working or just switched to the background. After analyzing the loading strategy, if the requirements are met, the 5A operation stored in the cache of camera-y can be used as the 5A thermal data of camera-x for the initialization process of the 5A algorithm.

[0189] Camera camera 5A thermal data loading strategy

[0190] Based on the thermal data life cycle, the running time of adjacent cameras, and the similar relationship between camera types, a set of 5A algorithm thermal data loading strategies are constructed to determine whether to load the thermal data of the adjacent camera or the thermal data of the current scene. To solve the problem of missing or expired thermal data when multiple cameras are started or switched. The basic principles followed by the 5A thermal data loading strategy are:

[0191] Principle one:

[0192] The order of loading file selection is the 5A thermal data file of the camera itself, the 5A thermal data cache of the adjacent camera, and the 5A thermal data file of the adjacent camera, in turn. The first valid value is obtained, and the search is stopped.

[0193] Principle two:

[0194] When the camera camera-x starts, if it needs to use the thermal data of the adjacent camera-y, it will borrow the thermal data of the other camera as its starting thermal data according to the degree of similarity between the camera types. The priority of loading adjacent cameras is (not limited to) super wide, wide, telephoto, and macro cameras, and the priority of adjacent cameras is upward.

[0195] (2) 5A thermal data loading strategy classification division

[0196] Before analyzing this strategy, the existence state of the 5A thermal data corresponding to the camera camera is structured and divided into three states: survival, missing, and expired. Combined with Figure 11 , the 5A thermal data loading strategy simplified block diagram analyzes the camera camera 5A thermal data loading strategy from the flow point of view. Figure 11 In the above, the thermal data source (1) exists in the form of a file. Figure 11 In the above, the thermal data source (2) exists in the form of a cache.

[0197] Survival state

[0198] For example, referring to the first basic principle of the loading strategy, if the current camera camera-x corresponding hot data source (1) exists in the form of a file, after loading and parsing, the 5A hot data validity check state is analyzed by the loading strategy center, if it is a survival state, the 5A hot data life cycle has not expired, and the 5A hot data stored by the camera-x itself is loaded when the camera-x is started, that is, the 5A hot data stored by the camera-x corresponding hot data source (1).

[0199] Expiry state

[0200] For example, referring to the first basic principle of the loading strategy, if the current camera camera-x corresponding hot data source (1) exists in the form of a file, after loading and parsing, the 5A hot data validity check state is analyzed by the loading strategy center, if it is a survival state, the 5A hot data life cycle has not expired, and the 5A hot data stored by the camera-x itself is loaded when the camera-x is started, that is, the 5A hot data stored by the camera-x corresponding hot data source (1).

[0201] (a) If the camera is switched from the adjacent camera-y to the current camera-x, the hot data source (2) in the memory buffer area of the adjacent camera-y is loaded when the current camera-x is started. (The resources of the adjacent camera-y will be maintained for a period of time after switching, and if it is not switched back for a long time, the resources will be exited and destroyed.)

[0202] (b) If the adjacent camera-y is not running, it is determined whether the hot data source (1) of the adjacent camera-y is expired when the current camera-x is started, if not, the hot data source (1) of the camera-y is used.

[0203] (c) If it is also expired, then the hot data source (1) of the camera-x itself is used.

[0204] □ Missing state

[0205] For example, if the current camera-x corresponding hot data source (1) does not exist in the form of a file, it is determined that the 5A hot data corresponding to the camera-x is in a missing state. It will be referred to the second basic principle of the loading strategy to check whether the type of the adjacent camera-y is combined with the running condition of the adjacent camera-y to select the hot data from the hot data source (2) in the memory buffer area of the camera-y or further load the camera camera-y corresponding hot data source (1).

[0206] The priority order of loading the adjacent camera is (not limited to) super wide, wide angle, long focal length, and macro camera, and the priority of the adjacent camera is upwardly dependent.

[0207] In the parameter configuration method provided by the embodiment of the application:

[0208] In one aspect, (1) the output results of the AWB / ATF / ALSC algorithm are cached in the RingBuffer pair with the corresponding image frame number, and then the last frame AE / AF algorithm results carried by the Meta are backfilled into the corresponding data structure of the buffer RingBuffer according to the frame number, and updated in real time with the frame. (2) Effective hot data selection strategy: 5A service software checks whether valid Metadata can be obtained, whether the algorithm is successfully processed, and eliminates the cached invalid frame configuration parameters; the camera downloads the Flush instruction before shutdown, and there is still data sent before the ISP stops, the AP side pipeline has started to prepare for destruction, and the integrity of the subsequent frame data needs to be judged; for the problem of not timely data saving in the crash exception, regular storage is done and judgment is made when loading. Based on this, with the help of effective hot data selection strategy, the 5A configuration parameters closest to the current ISP hardware running are locked, and the position marker is Flag-Valid. (3) When the camera is turned off, the cluster of 5A data marked with Flag-Valid in RingBuffer is Warm Data, which is stored in the specified file together with other hot data.

[0209] On the other hand, (1) the 5A hot data corresponding to the camera lens has the following states: existing, missing, expired, etc. (2) The 5A hot data corresponding to the current camera lens-x is in the existing state, the life cycle is not expired, and the 5A hot data stored by the camera lens-x itself is loaded when the camera lens is started. (3) The 5A hot data corresponding to the current camera lens-x is expired: if it is switched from the adjacent camera lens-y to the current camera lens-x, the hot data in the memory buffer area of the adjacent camera lens-y is loaded when the current camera lens-x is started; if the adjacent camera lens-y is not running, it is judged whether the hot data of the adjacent camera lens-y is expired when the current camera lens-x is started (if it is also expired, then the hot data of the camera lens-x itself is used). (4) If the 5A hot data of the current camera lens-x is missing, the hot data of the adjacent camera lens-y is used when it is started. (5) The priority order of loading the adjacent camera lens is (not limited to) super wide, wide, telephoto, and macro camera lenses, and the priority of the adjacent camera lens is upward.

[0210] Thus:

[0211] 1. Utilize the N-1 frame image AE / AF algorithm results carried by the N frame image Meta of the cross-system uplink dispatch, fuse N-1 frame AWB / LS C / ATF results and cache, design effective hot data selection strategy to avoid invalid hot data, flush and abnormal crash caused pipeline non-synchronous cache, lock and select frame 5A information as hot data, greatly reduce the complexity of round-trip matching and inter-core communication in the general scheme.

[0212] 2. Based on the lifecycle of hot data, the running time of adjacent cameras, and the similarity of camera types, a hot data loading strategy for the 5A algorithm is constructed to determine whether to load its own hot data or the hot data of adjacent cameras in the current scene, so as to solve the problems of missing or expired hot data when multiple cameras are started or switched.

[0213] An electronic device according to an embodiment of this application, such as Figure 12 As shown, the electronic device 1200 includes:

[0214] The determining unit 1201 is configured to determine a set of configuration parameters corresponding to each image sensor in at least one image sensor. The set of configuration parameters is generated by the image processor based on the images acquired by the corresponding image sensor. The set of configuration parameters includes at least two configuration parameters, and different configuration parameters correspond to different frame images.

[0215] The first selection unit 1202 is configured to select candidate configuration parameters from the configuration parameter set for each configuration parameter set to determine at least one candidate configuration parameter; the candidate configuration parameter is a valid configuration parameter in the configuration parameter set.

[0216] Storage unit 1203 is configured to store the at least one candidate configuration parameter;

[0217] The second selection unit 1204 is configured to read the at least one candidate configuration parameter when the target image sensor is started, and select a target configuration parameter from the read at least one candidate configuration parameter. The target configuration parameter is used by the image processor to process the target image data acquired by the target image sensor. The target image sensor is one of the at least one image sensors.

[0218] In some embodiments, the determining unit 1201 is further configured to:

[0219] When the image sensor acquires the first frame image, the first configuration parameter corresponding to the first frame image is stored in the first frame identifier, and the second configuration parameter corresponding to the second frame image acquired by the image sensor is stored in the second frame identifier. The first frame identifier is used to identify the first frame image, the second frame identifier is used to identify the second frame image, and the second frame image is the previous frame image of the first frame image.

[0220] In a case where the image sensor collects a third frame image, a first configuration parameter corresponding to the third frame image is stored with a third frame identifier, and a second configuration parameter corresponding to the first frame image is stored with the first frame identifier, the third frame image being a frame image subsequent to the first frame image, and the third frame identifier being used to identify the third frame image;

[0221] The first configuration parameter corresponding to the first frame identifier and the second configuration parameter corresponding to the first frame identifier constitute configuration parameters corresponding to the first frame image in the configuration parameter set.

[0222] The configuration parameters include the first configuration parameter and the second configuration parameter, the first configuration parameter being generated by a first image processor, and the second configuration parameter being generated by a second image processor.

[0223] In some embodiments, the determination unit 1201 is further configured to:

[0224] The second image processor processes the second frame image to generate a second configuration parameter corresponding to the second frame image.

[0225] The second configuration parameter and metadata of a first frame image collected by the image sensor are sent to the first image processor.

[0226] The first image processor processes the metadata of the first frame image to generate a first configuration parameter corresponding to the first frame image.

[0227] The first image processor stores the second configuration parameter corresponding to the second frame image and the first configuration parameter corresponding to the first frame image in a cache subspace corresponding to the image sensor in a first cache space.

[0228] The first image processor is configured to control the at least one image sensor, and the second image processor is configured to pre-process data collected by the image sensor.

[0229] In some embodiments, the first selection unit 1202 is further configured to:

[0230] When a first time condition is met, a candidate configuration parameter is selected from the configuration parameter set; wherein the first time condition includes at least one of the following:

[0231]

[0232] The first image sensor corresponding to the configuration parameter set is turned off.

[0233] ​The image sensor that performs image acquisition is switched from the first image sensor to a second image sensor, the first image sensor and the second image sensor being different image sensors in the at least one image sensor;

[0234] A time point determined based on a set period is reached.

[0235] In some embodiments, the first selection unit 1202 is further configured to:

[0236] The configuration parameter with the shortest generation time among the valid configuration parameters in the configuration parameter set is determined as the candidate configuration parameter of the configuration parameter set.

[0237] In some embodiments, the first selection unit 1202 is further configured to:

[0238] For each configuration parameter in the configuration parameter set, the validity of the configuration parameter is determined according to the validity identifier of the configuration parameter, the validity identifier being related to the validity of the metadata of the image corresponding to the respective configuration parameter and whether the configuration parameter is complete.

[0239] In some embodiments, the storage unit 1203 is further configured to:

[0240] The at least one candidate configuration parameter is stored in a configuration parameter file, and the configuration parameter file is stored in a set file path;

[0241] The at least one candidate configuration parameter is cached in a second cache space.

[0242] In some embodiments, the second selection unit 1204 is further configured to:

[0243] The target image sensor startup scenario is determined, the target image sensor startup scenario including a first startup scenario and a second startup scenario, the second cache space being emptied in the first startup scenario, and the second cache space not being emptied in the second startup scenario;

[0244] The at least one candidate configuration parameter is read from the set file path or the second cache space according to the startup scenario.

[0245] In some embodiments, the second selection unit 1204 is further configured to:

[0246] The target configuration parameter is selected from the at least one candidate configuration parameter according to a set configuration parameter loading strategy, the configuration parameter loading strategy being related to at least one of the following information: running time of an adjacent image sensor, sensor type of the image sensor.

[0247] In some embodiments, the second selection unit 1204 is further configured to:

[0248] select a first candidate configuration parameter from the at least one candidate configuration parameter according to the configuration parameter loading strategy;

[0249] determine whether the first candidate configuration parameter is valid;

[0250] If the first candidate configuration parameter is not valid, continue to select a second candidate configuration parameter from the at least one candidate configuration parameter according to the configuration parameter loading strategy, and take the second candidate configuration parameter as a new first candidate configuration parameter, continue to determine whether the first candidate configuration parameter is valid, until the selected first candidate configuration parameter is valid.

[0251] If the first candidate configuration parameter is valid, determine that the first candidate configuration parameter is the target configuration parameter.

[0252] In actual application, the above-mentioned determination unit, first selection unit, second selection unit, storage unit and the like can be realized by a processor on an electronic device, specifically, a combination of one or more of a central processing unit (CPU), a microprocessor unit (MPU), an application processor (AP), a digital signal processor (DSP), and a field programmable gate array (FPGA).

[0253] Those skilled in the art should understand that the above-mentioned related description of the electronic device of the embodiments of the present application can be understood with reference to the related description of the parameter configuration method of the embodiments of the present application.

[0254] Figure 13 An optional implementation provided by the embodiments of the present application is a structural schematic diagram of an electronic device, as shown in Figure 13 The embodiments of the present application provide an electronic device 1300, which includes an electronic chip 1301. The electronic chip can implement the parameter configuration method described in one or more of the above embodiments. The electronic chip can implement a processor of the electronic device or a microprocessor of the fast charging module.

[0255] The embodiments of the present application provide an electronic device, Figure 14 Another optional implementation provided by the embodiments of the present application is a structural schematic diagram of an electronic device, as shown in Figure 14 The embodiments of the present application provide an electronic device 1400, which includes:

[0256] The processor 1401 and the storage medium 1402 storing instructions executable by the processor 1401 perform operations in dependence on the processor 1401 when the instructions are executed by the processor 1401, and the parameter configuration method performed in one or more embodiments described above is executed.

[0257] It should be noted that in actual application, various components in the terminal are coupled together through the communication bus 1403. It can be understood that the communication bus 1403 is used to realize the connection and communication between the components. The communication bus 1403 includes not only a data bus, but also a power bus, a control bus and a status signal bus. However, for the purpose of clear illustration, all kinds of buses are marked as the communication bus 1403 in the Figure 14

[0258] The embodiment of the present application provides a computer storage medium, which is used to store a computer program, and the computer program causes a computer to execute the steps of the parameter configuration method in one or more embodiments described above.

[0259] The embodiment of the present application provides a schematic structural diagram of an electronic device 1500. Figure 15 The electronic device 1500 shown includes a processor 1510. The processor 1510 is configured to:

[0260] For each image sensor of the at least one image sensor, a configuration parameter set corresponding to the image sensor is determined, the configuration parameter set is generated by an image processor based on an image collected by the corresponding image sensor, and the configuration parameter set includes at least two configuration parameters, and different configuration parameters correspond to different frames of images.

[0261] For each configuration parameter set, a candidate configuration parameter is selected from the configuration parameter set to determine at least one candidate configuration parameter, and the at least one candidate configuration parameter is stored; the candidate configuration parameter is a valid configuration parameter in the configuration parameter set.

[0262] In the case that a target image sensor is started, the at least one candidate configuration parameter is read, and a target configuration parameter is selected from the at least one candidate configuration parameter read, the target configuration parameter is used for the image processor to process target image data collected by the target image sensor, and the target image sensor is one of the at least one image sensor.

[0263] In the embodiment of the present application, the processor 1510 can call and run a computer program from the memory to realize the parameter configuration method in the embodiment of the present application.

[0264] ​Optionally, as shown in Figure 15 The electronic device 1500 can further include a memory 1520. The processor 1510 can call and run a computer program from the memory 1520 to implement the parameter configuration method in the embodiments of the present application.

[0265] The memory 1520 can be a separate device independent of the processor 1510, or can be integrated in the processor 1510.

[0266] Optionally, as shown in Figure 15 The electronic device 1500 can further include a transceiver 1530, and the processor 1510 can control the transceiver 1530 to communicate with other devices, specifically, can receive signals sent by other devices. Here, the transceiver can include at least two antennas.

[0267] It can be understood that the transceiver includes multiple physical paths for receiving signals or transmitting signals, and the physical elements on one or more physical paths for transmitting signals constitute a transmitter. The values of the MPRs of the physical paths in the transmitter are independent.

[0268] It can be understood that, Figures 13 to 15 The electronic device shown in any of the figures can further include an image sensor and an image processor, the image sensor being configured to acquire images, and the image processor being configured to process the images acquired by the image sensor.

[0269] Optionally, the electronic device 1500 can implement the corresponding processes implemented by the electronic device in various methods of the embodiments of the present application. For the sake of brevity, they will not be described here again. It should be understood that the processor of the embodiments of the present application can be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above method embodiments can be completed by the integrated logic circuit of hardware in the processor or the instruction in the form of software. The processor mentioned above can be a general processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The disclosed methods, steps and logic block diagrams in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as hardware code processor execution completion, or executed by hardware and software module combination in the code processor. The software module can be located in the random access memory, the flash memory, the read only memory, the programmable read only memory or the electrically erasable programmable memory, the register and other mature storage media in the art. The storage medium is located in the memory, and the processor reads the information in the memory, and combines the hardware to complete the steps of the above method.

[0270] It is to be understood that the memory in the embodiments of the present application can be a volatile memory or a nonvolatile memory, or can include both volatile and nonvolatile memory. Among them, the nonvolatile memory can be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), an electrically erasable programmable read-only memory (Electrically EPROM, EEPROM) or a flash memory. The volatile memory can be a random access memory (Random Access Memory, RAM) used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (Synchlink DRAM, SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DR RAM). It should be noted that the memory of the system and method described herein is intended to include, but not limited to, these and any other suitable types of memory.

[0271] It should be understood that the above-mentioned memory is exemplary but not limiting, for example, the memory in the embodiments of the present application can also be static random access memory (static RAM, SRAM), dynamic random access memory (dynamic RAM, DRAM), synchronous dynamic random access memory (synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synch link DRAM, SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DR RAM) and the like. That is, the memory in the embodiments of the present application is intended to include, but not limited to, these and any other suitable types of memory.

[0272] The embodiment of the present application further provides a computer readable storage medium for storing the computer program.

[0273] Optionally, the computer readable storage medium can be applied to the electronic device in the embodiment of the present application, and the computer program enables the computer to execute the corresponding process realized by the electronic device in each method of the embodiment of the present application. For brevity, details are not described herein.

[0274] The embodiment of the present application further provides a computer program product comprising computer program instructions.

[0275] Optionally, the computer program can be applied to the electronic device in the embodiment of the present application, and when the computer program runs on the computer, the computer program enables the computer to execute the corresponding process realized by the electronic device in each method of the embodiment of the present application. For brevity, details are not described herein.

[0276] Those skilled in the art can understand that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software mode depends on the specific application and design constraints of the technical solution. The skilled person can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0277] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, and details are not described herein.

[0278] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division, and actual implementation can have another division manner. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0279] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e. can be located in one place, or can be distributed on multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0280] In addition, each function unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit.

[0281] If the functions are realized in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the parts of the technical solutions that essentially contribute to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0282] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method of parameter configuration, characterized by, The method comprises: For each image sensor of the at least one image sensor, determining a configuration parameter set corresponding to the image sensor, the configuration parameter set being generated by an image processor based on an image collected by the corresponding image sensor, the configuration parameter set comprising at least two configuration parameters, different configuration parameters corresponding to different frame images; the configuration parameters comprise first configuration parameters and second configuration parameters, the first configuration parameters being generated by a first image processor, and the second configuration parameters being generated by a second image processor and sent to the first image processor; For each configuration parameter set, selecting a candidate configuration parameter from the configuration parameter set to determine at least one candidate configuration parameter, and storing the at least one candidate configuration parameter; the candidate configuration parameter is a valid configuration parameter in the configuration parameter set; In the case where a target image sensor is started, reading the at least one candidate configuration parameter, and selecting a target configuration parameter from the at least one candidate configuration parameter read, the target configuration parameter being used by the image processor to process target image data collected by the target image sensor, the target image sensor being one of the at least one image sensor.

2. The method of claim 1, wherein, The determination of the configuration parameter set corresponding to the image sensor comprises: In the case where the image sensor collects a first frame image, storing a first frame identifier corresponding to a first configuration parameter corresponding to the first frame image, and storing a second frame identifier corresponding to a second configuration parameter corresponding to a second frame image collected by the image sensor, the first frame identifier being used to identify the first frame image, and the second frame identifier being used to identify the second frame image, the second frame image being a previous frame image of the first frame image; In the case where the image sensor collects a third frame image, storing a third frame identifier corresponding to a first configuration parameter corresponding to the third frame image, and storing a first frame identifier corresponding to a second configuration parameter corresponding to the first frame image, the third frame image being a subsequent frame image of the first frame image, and the third frame identifier being used to identify the third frame image; Wherein, the first configuration parameter corresponding to the first frame identifier and the second configuration parameter corresponding to the first frame identifier constitute the configuration parameters corresponding to the first frame image in the configuration parameter set.

3. The method of claim 2, wherein, The first image processor is used to control the at least one image sensor, and the second image processor is used to pre-process data collected by the image sensor; The determination of the configuration parameter set corresponding to the image sensor further comprises: Generating the second configuration parameter corresponding to the second frame image by processing the second frame image through the second image processor; Sending the second configuration parameter and metadata of a first frame image collected by the image sensor to the first image processor; Generating the first configuration parameter corresponding to the first frame image by processing the metadata of the first frame image through the first image processor; The first image processor stores a second configuration parameter corresponding to the second frame image and a first configuration parameter corresponding to the first frame image in a cache subspace corresponding to the image sensor in a first cache space.

4. The method of claim 1, wherein, The selecting the candidate configuration parameter from the configuration parameter set comprises: selecting the candidate configuration parameter from the configuration parameter set when a first time condition is met, wherein the first time condition comprises at least one of the following: the first image sensor is closed; an image sensor performing image acquisition is switched from the first image sensor to a second image sensor, the first image sensor and the second image sensor being different image sensors in the at least one image sensor; a time point determined based on a set period is reached.

5. The method of claim 1, wherein, The selecting the candidate configuration parameter from the configuration parameter set comprises: determining, as the candidate configuration parameter of the configuration parameter set, a configuration parameter with the shortest generation time among the valid configuration parameters in the configuration parameter set.

6. The method of claim 5, wherein, The method further comprises: for each configuration parameter in the configuration parameter set, judging the validity of the configuration parameter according to a validity identifier of the configuration parameter, the validity identifier being related to the validity of the metadata of the image corresponding to the corresponding configuration parameter and whether the configuration parameter is complete.

7. The method of claim 1, wherein, The storing the at least one candidate configuration parameter comprises: storing the at least one candidate configuration parameter in a configuration parameter file and storing the configuration parameter file in a set file path; caching the at least one candidate configuration parameter to a second cache space.

8. The method of claim 7, wherein, The reading the at least one candidate configuration parameter comprises: determining a start-up scenario of the target image sensor, the start-up scenario comprising a first start-up scenario and a second start-up scenario, the second cache space being emptied in the first start-up scenario, and the second cache space not being emptied in the second start-up scenario; reading the at least one candidate configuration parameter from the set file path or the second cache space according to the start-up scenario.

9. The method according to any one of claims 1 to 7, characterized in that, The selecting the target configuration parameter for configuring the target image sensor from the at least one candidate configuration parameter comprises: selecting the target configuration parameter from the at least one candidate configuration parameter according to a set configuration parameter loading strategy, the configuration parameter loading strategy being related to at least one of the following information: running time of an adjacent image sensor, sensor type of the image sensor.

10. The method of claim 9, wherein, The selecting the target configuration parameter from the at least one candidate configuration parameter according to a set configuration parameter loading strategy comprises: selecting a first candidate configuration parameter from the at least one candidate configuration parameter according to the configuration parameter loading strategy; judging whether the state of the first candidate configuration parameter is valid; and if the state of the first candidate configuration parameter is valid, determining the first candidate configuration parameter as the target configuration parameter. If the state of the first candidate configuration parameter is not valid, a second candidate configuration parameter is selected from the at least one candidate configuration parameter according to the configuration parameter loading strategy, the second candidate configuration parameter is taken as a new first candidate configuration parameter, and the state of the first candidate configuration parameter is determined until the selected first candidate configuration parameter is valid. If the state of the first candidate configuration parameter is valid, the first candidate configuration parameter is determined as the target configuration parameter.

11. An electronic device, comprising: The electronic device comprises: The determining unit is configured to determine, for each image sensor in the at least one image sensor, a configuration parameter set corresponding to the image sensor, the configuration parameter set being generated by an image processor based on an image collected by the corresponding image sensor, the configuration parameter set comprising at least two configuration parameters, different configuration parameters corresponding to different frames of images; the configuration parameters comprise a first configuration parameter and a second configuration parameter, the first configuration parameter being generated by a first image processor, and the second configuration parameter being generated by a second image processor and sent to the first image processor; The first selecting unit is configured to select, for each configuration parameter set, a candidate configuration parameter from the configuration parameter set to determine at least one candidate configuration parameter; the candidate configuration parameter is a valid configuration parameter in the configuration parameter set; The storage unit is configured to store the at least one candidate configuration parameter; The second selecting unit is configured to, in a case where a target image sensor is started, read the at least one candidate configuration parameter, and select a target configuration parameter from the read at least one candidate configuration parameter, the target configuration parameter being used for the image processor to process target image data collected by the target image sensor, the target image sensor being one of the at least one image sensor.

12. An electronic device comprising a processor, characterized in that The processor is configured to: determine, for each image sensor in the at least one image sensor, a configuration parameter set corresponding to the image sensor, the configuration parameter set being generated by an image processor based on an image collected by the corresponding image sensor, the configuration parameter set comprising at least two configuration parameters, different configuration parameters corresponding to different frames of images; the configuration parameters comprise a first configuration parameter and a second configuration parameter, the first configuration parameter being generated by a first image processor, and the second configuration parameter being generated by a second image processor and sent to the first image processor; select, for each configuration parameter set, a candidate configuration parameter from the configuration parameter set to determine at least one candidate configuration parameter, and store the at least one candidate configuration parameter; the candidate configuration parameter is a valid configuration parameter in the configuration parameter set; In case of starting of a target image sensor, reading the at least one candidate configuration parameter, and selecting a target configuration parameter from the at least one candidate configuration parameter read, the target configuration parameter being used for processing of target image data captured by the target image sensor by the image processor, the target image sensor being one of the at least one image sensor.

13. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor, when executing the computer program, implements the steps of the parameter configuration method of any one of claims 1 to 10.

14. A storage medium storing an executable program, characterized by The executable program, when executed by the processor, implements the parameter configuration method of any one of claims 1 to 10.

15. A chip comprising a processor, characterized in that The processor is configured to implement the parameter configuration method of any one of claims 1 to 10.

Images