Parameter configuration system

Abstract

The invention discloses a parameter configuration system. The parameter configuration system comprises a storage module used for storing a first image processing configuration parameter of which the data volume is greater than a first threshold value through two data sets; the transfer module is connected with the storage unit and used for transmitting the first image processing configuration parameters between the image processing module and the storage unit; the image processing module is used for counting environment information according to the first image processing configuration parameters and transmitting the environment information to the processing module; and the processing module is used for calculating an image processing configuration parameter according to the first image processing configuration parameter and a preset parameter processing strategy. According to the image processing method and device, the modes of channel combination transmission, dual registers and the like are adopted, on the premise of saving resources, the configuration flexibility is fully considered, it is guaranteed that parameter dynamic refreshing is completed by using the least resources, the image processing module uses the most accurate parameters, the image processing effect is effectively improved, and meanwhile the load pressure of the processing module can be relieved.

Description

Technical Field

[0001] The present invention relates to computer-related fields, and in particular to a parameter configuration system. Background Art

[0002] Faced with the increasingly high image quality requirements for night scenes, ultra-clear and wide dynamic range, the existing image processing algorithms are becoming increasingly complex. First, for different types of sensors, the module needs to be configured with different parameter tables. Second, the color temperature of light will change under different environmental conditions, and the parameter table must also change accordingly, which means that frame-level refresh is required. In the face of the need for dynamic refresh of ISP parameters in such multi-sensor scenarios, the chip needs to consume a large amount of storage resources to store the parameters. Second, the system needs to flexibly control parameter refresh, and low latency requirements are very high.

[0003] The traditional method is to directly use registers or storage units to store multiple sets of parameters corresponding to the sensor. In a multi-sensor dynamic scenario, firstly, in order to meet the frame-level refresh requirements of the parameters, multiple storage resources are required. Secondly, when there are many modules with such parameter refresh requirements, the CPU load pressure is very high, and the system has no time to respond. The modules cannot use the most accurate parameters, which will reduce the image processing effect. Summary of the invention

[0004] The embodiment of the present invention provides a parameter configuration system to at least solve the technical problem in the prior art that the dynamic refresh response of ISP parameters in a multi-sensor scenario is not timely.

[0005] According to one aspect of an embodiment of the present invention, there is provided a parameter configuration system, comprising: a storage module, for storing first image processing configuration parameters having a data volume greater than a first threshold value through two data sets; a transfer module, connected to the storage unit, for transmitting the first image processing configuration parameters between the image processing module and the storage unit; an image processing module, for performing image processing according to the first image processing configuration parameters, and for statistically calculating environmental information based on the image information and transmitting it to the processing module; and the processing module, for updating the first image processing configuration parameters according to the environmental information and a pre-set parameter processing strategy.

[0006] Optionally, the image processing module is provided with a plurality of algorithm sub-modules, each algorithm sub-module being used to issue a parameter reading request to the external storage module, complete the reading of the first image processing configuration parameter, determine the module storage address of the read first image processing configuration parameter, and complete the storage of the read first image processing configuration parameter.

[0007] Optionally, the image processing module is used to set a refresh state of a first image processing configuration parameter corresponding to a target sensor, and send a parameter reading request to the transfer module; the transfer module is used to transfer the parameter reading request to the storage module.

[0008] Optionally, the image processing module is used to set the refresh status of the first image processing configuration parameter corresponding to the target sensor state, and use a custom signal protocol to send a parameter reading request to the relay module; the relay module is used to transfer the parameter reading request to the storage module using a universal bus protocol.

[0009] Optionally, the image processing module is used to set a first memory and a second memory to store the first image processing configuration parameters, the first memory is used to read the first image processing configuration parameters, and the second memory is used to refresh and write the first image processing configuration parameters.

[0010] Optionally, the processing module is also used to update a second image processing configuration parameter; the image processing module is used to set a first type of register and a second type of register to store the second image processing configuration parameter, the second type of register is used for use by the image processing module, and the data volume of the second image processing configuration parameter is less than a second threshold.

[0011] Optionally, the first type of register is directly connected to the processing module via a bus so that the processing module can be configured at any time; the second type of register takes the data of the first type of register and stores it at an appropriate time for internal use by the image processing module.

[0012] Optionally, the storage space for storing each data set in the storage module is divided into M sub-parts, and each sub-part of each storage space corresponds to a sensor; each sub-part is divided into N sub-storage spaces, and each sub-storage space of each sub-part corresponds to an algorithm sub-module of the image processing module; each sub-storage space is set with a corresponding status flag signal, and the status flag signal is used to identify the update and usage of the first image processing configuration parameters in the corresponding sub-storage space.

[0013] Optionally, the image processing module is configured to read the required first image processing configuration parameters from the storage module and store them inside the image processing module. After the first image processing configuration parameters are stored inside, the high potential corresponding to the status flag signal corresponding to the storage space where the first image processing configuration parameters are located is cleared.

[0014] Optionally, a transfer module is used to cache the first image processing configuration parameter requested by the image processing module.

[0015] In the embodiment of the present invention, the storage module is used to store the first image processing configuration parameter with a data volume greater than the first threshold through two data sets; the transfer module is connected to the storage unit and is used to transmit the first image processing configuration parameter between the image processing module and the storage unit; the image processing module is used to calculate the environmental information according to the first image processing configuration parameter and transmit it to the processing module; the processing module is used to calculate the image processing configuration parameter according to the first image processing configuration parameter and the pre-set parameter processing strategy. By adopting the methods of combined transmission by separate channels and double registers, the flexibility of configuration is fully considered under the premise of saving resources, ensuring that the dynamic refresh of parameters is completed with the least resources, allowing the image processing module to use the most accurate parameters, effectively improving the image processing effect, and at the same time reducing the load pressure of the processing module. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0017] Figure 1 is a hardware structure block diagram of a surveillance camera of an optional parameter processing system according to an embodiment of the present invention;

[0018] Figure 2 is a structural diagram of an optional parameter processing system according to an embodiment of the present invention;

[0019] Figure 3 is a schematic diagram of storage space division in an optional storage module according to an embodiment of the present invention;

[0020] Figure 4 is a structural diagram of an optional ISP parameter configuration system applicable to a multi-sensor scenario according to an embodiment of the present invention;

[0021] Figure 5 It is a control logic schematic diagram of an algorithm submodule in an optional image processing module according to an embodiment of the present invention. DETAILED DESCRIPTION

[0022] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0023] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a sequence of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0024] The parameter configuration system embodiment provided in the embodiment of the present invention can be executed in a surveillance camera. Taking running on a surveillance camera as an example, Figure 1 FIG. 1 is a hardware structure diagram of a surveillance camera of a parameter configuration system according to an embodiment of the present invention. Figure 1 As shown, the surveillance camera 10 may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data. Optionally, the above-mentioned surveillance camera 10 may also include a transmission device 106 and an input / output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is for illustration only and does not limit the structure of the above-mentioned surveillance camera. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations shown.

[0025] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the parameter configuration system in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories can be connected to the surveillance camera 10 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0026] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the surveillance camera 10. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet.

[0027] In this embodiment, a parameter configuration system is also provided. Figure 2 is a structural diagram of a parameter configuration system according to an embodiment of the present invention, based on Figure 2 The system structure shown in the figure, the functions implemented by each module of the parameter configuration system are as follows:

[0028] The storage module 22 is used to store the first image processing configuration parameter whose data volume is greater than the first threshold through two data sets.

[0029] The transfer module 24 is connected to the storage unit and is used to transmit the first image processing configuration parameter between the image processing module and the storage unit.

[0030] The image processing module 26 is used to perform image processing according to the first image processing configuration parameters, and to calculate environmental information based on the image information and transmit it to the processing module.

[0031] The processing module 28 is used to update the image processing configuration parameters according to the environmental information and a preset parameter processing strategy, and the image processing configuration parameters at least include the first image processing configuration parameters.

[0032] The image processing module may be an ISP module or other types of image processing modules, which is not limited in the present invention.

[0033] In this embodiment, the image processing module calculates current environmental information based on current image information and transmits it to the CPU end (corresponding to the above-mentioned processing module). The CPU updates the image processing configuration parameters based on the feedback information and a preset parameter calculation method.

[0034] The current environment information is used to reflect the current shooting environment conditions, which may include but is not limited to color temperature, light intensity, etc.

[0035] Among them, the image processing configuration parameters are transferred from the image processing module to the external storage, which will save the on-chip storage resources of the image processing module, but at the same time will bring about transmission problems. In order to effectively control the efficient transmission under the dynamic refresh of parameters, in this embodiment, for the storage module, only the table type parameters (corresponding to the first image processing configuration parameters) with a large amount of data (the amount of data is greater than the first threshold) are stored, and two sets of storage, set0 and set1, are used internally to ensure that the image processing module reads the first image processing configuration parameters and the CPU writes the first image processing configuration parameters synchronously when the storage module works normally. Set0 / 1 is further divided into M sub-parts to ensure that the parameter access processes before each sensor are independent of each other and do not interfere with each other. For each sub-part of Set0 / 1, each algorithm sub-module in the image processing module is configured with a corresponding storage space for storing the first image processing configuration parameters corresponding to the corresponding algorithm sub-module; that is, the sub-part corresponding to each sensor in set0 / 1 is further divided into N sub-storage spaces, corresponding to the N algorithm sub-modules one by one. Each sub-storage space of each sub-part of each set (set0 or set1) is respectively provided with a status flag signal, which is used to identify the update and use of the first image processing configuration parameter in the sub-storage space. This two-set storage and status flag signal feedback method realizes that there is no need to transmit parameters for each frame, and the corresponding part of the storage can be read and written at any time, which effectively reduces the bus transmission pressure and ensures the timely and fast transmission of parameters.

[0036] Among them, the transfer module is used to transfer table parameters between the image processing module and the storage module. The image processing module sends a parameter reading request to the transfer unit according to the sensor status corresponding to the image and the parameter refresh status indicated by the status flag signal, using a custom signal protocol; the transfer unit transfers the parameter reading request to the storage unit, using a universal bus protocol. The transfer unit has a buffering function, which can support the internal back pressure of the image processing module without affecting the normal working state of the image processing module. Table parameters with large data volume are stored in the external storage module and transmitted using the transfer module, effectively reducing the transmission pressure of the CPU.

[0037] In this embodiment, separate channel combined transmission is adopted, and different transmission channels are used for different categories of image processing configuration parameters (such as table parameters and control parameters); ping-pong access control is used to ensure that parameter refresh and normal operation of the image processing module are carried out synchronously; dual registers can be configured at any time to reduce the load pressure on the CPU.

[0038] Among them, for the control parameters with small data volume (corresponding to the second image processing configuration parameters), registers are directly used for storage inside the image processing module, which will not waste resources and is also convenient for subsequent debugging. Each algorithm submodule in the image processing module uses 1 set of confreg and M sets of workreg. One set of workreg in an algorithm submodule corresponds to one sensor. Confreg is directly connected to the bus and can be configured at any time. Workreg is used inside the module and the parameters of confreg are read at the appropriate time. This dual register configuration method prolongs the configuration time interval and effectively reduces the CPU load pressure.

[0039] For table-type parameters with large data volume, they are stored in the external storage module, and the image processing module reads them from the external storage module. Two sets of mem storage, table0 and table1, are used inside the image processing module. One set of mem is used for reading by the image processing module, and the other set of mem is used for refreshing and writing table-type parameters. The ping-pong access operation between the two ensures that the latest and most accurate parameters are provided to the module, effectively improving the image processing effect.

[0040] Through the embodiment provided by the present invention, the storage module is used to store the first image processing configuration parameter with a data volume greater than the first threshold through two data sets; the transfer module is connected to the storage unit and is used to transmit the first image processing configuration parameter between the image processing module and the storage unit; the image processing module is used to calculate the environmental information according to the first image processing configuration parameter and transmit it to the processing module; the processing module is used to calculate the image processing configuration parameter according to the first image processing configuration parameter and the pre-set parameter processing strategy. The use of separate channel combined transmission, double registers and other methods fully considers the flexibility of configuration under the premise of saving resources, ensures that the parameters are dynamically refreshed with the least resources, allows the image processing module to use the most accurate parameters, effectively improves the image processing effect, and also reduces the load pressure of the processing module.

[0041] Optionally, the image processing module 26 can be used to set up multiple algorithm sub-modules, each algorithm sub-module is used to issue a parameter reading request to an external storage module to complete the reading of the first image processing configuration parameter, and is used to determine the module storage address of the read first image processing configuration parameter to complete the storage of the read first image processing configuration parameter.

[0042] Optionally, the image processing module 26 may also be used to set a refresh state of the first image processing configuration parameter corresponding to the target sensor, and send a parameter reading request to the transfer module; the transfer module is used to transfer the parameter reading request to the storage module.

[0043] Among them, the target sensor can be the sensor corresponding to the next frame image. According to the actual image processing process design, the target sensor can also be the sensor corresponding to the current frame image to be processed, and the present invention does not limit this. The refresh status of the first image processing configuration parameter can be, but is not limited to, notified to the image processing module by the CPU through the bus. Specifically, when the first image processing configuration parameter corresponding to the target sensor is refreshed, a parameter reading request can be issued to the transfer module.

[0044] Optionally, the image processing module 26 can be used to set the refresh status of the first image processing configuration parameter corresponding to the target sensor, and use a custom signal protocol to send a parameter reading request to the transfer module; the transfer module is used to transfer the parameter reading request to the storage module using a universal bus protocol.

[0045] Optionally, the image processing module 26 may be configured to set a first memory and a second memory to store first image processing configuration parameters, wherein the first memory is used to read the first image processing configuration parameters, and the second memory is used to refresh and write the first image processing configuration parameters.

[0046] Specifically, the image processing module reads the first image processing configuration parameters from the first memory for parameter configuration, and reads the updated first image processing configuration parameters from the storage module and writes them into the second memory. It should be noted that the first memory and the second memory are not fixed, and a memory is the first memory at a certain moment, but may be the second memory at another moment.

[0047] In the embodiment, the first memory and the second memory correspond to two sets of mems, table0 and table1, respectively.

[0048] Optionally, the image processing module 26 can be used to set the first type of register and the second type of register to store second image processing configuration parameters, the second type of register is used for use by the image processing module, the data volume of the second image processing configuration parameters is less than the second threshold, and the image processing configuration parameters also include the second image processing configuration parameters.

[0049] Optionally, the first type of register is directly connected to the processing module through a bus so that the processing module can configure it at any time; the second type of register takes the data of the first type of register and stores it at an appropriate time for internal use by the image processing module.

[0050] Optionally, the storage space for storing each data set in the storage module is divided into M sub-parts, and each sub-part of each storage space corresponds to a sensor; each sub-part is divided into N sub-storage spaces, and each sub-storage space of each sub-part corresponds to an algorithm sub-module of the image processing module; each sub-storage space is set with a corresponding status flag signal, and the status flag signal is used to identify the update and use of the first image processing configuration parameters in the corresponding sub-storage space.

[0051] Optionally, the image processing module can be configured to read the required first image processing configuration parameters from the storage module and store them inside the image processing module. After the first image processing configuration parameters are stored inside, the high potential corresponding to the status flag signal corresponding to the storage space where the first image processing configuration parameters are located is cleared.

[0052] In this embodiment, if Figure 3 As shown, for the storage module, it is divided into two parts, set0 and set1 as a whole. Each part set(x) (x takes the value of 0 or 1) is specifically divided into M sub-parts (the specific number depends on the sensor category or the number of sensors), and then in each sub-part, a certain table storage space (module(n)_table, n=0,1,...,N) is allocated to the algorithm sub-module of each image processing module, that is, each sub-part is further divided into N sub-storage spaces, and each sub-storage space corresponds to an algorithm sub-module (module(n)).

[0053] Each table part (i.e., each sub-storage space) corresponds to a status flag signal Module(n)_Set(x)_Sensor(m)_Flag. After the CPU completes writing the first image processing configuration parameters to each part of the external storage module, it pulls up the corresponding Module(n)_Set(x)_Sensor(m)_Flag and transmits it to each algorithm sub-module through the bus, indicating that this part of the parameter update is complete and can be used by the algorithm sub-module. The algorithm sub-module inside the image processing module reads the required image processing configuration parameters from the external storage module through the transfer module and stores them internally according to the image state (specifically, the image state of the current frame and the next frame) and the parameter update state. When this process is completed, Module(n)_Set(x)_Sensor(m)_Flag is cleared to zero, indicating that the first image processing configuration parameters have been used, and the CPU can continue to update this part of the parameters. At the same time, the CPU comprehensively judges based on Module(n)_Set(x)_Sensor(m)_Flag to know which set group is being read and used by the algorithm sub-module, so as to update another set group.

[0054] In this embodiment, the external storage module adopts ping-pong synchronization to perform storage and reading operations, which solves the problem that the frequent update of external storage affects the rapid and accurate transmission of parameters, and ensures the normal operation of dynamic parameter refresh. The number of setgroups in the external storage module is unlimited, and can be set to 2 or more groups according to system performance and configuration requirements, and can be flexibly adjusted; the number of sensorgroups in the set group is also unlimited, and can be 4, 5 or other numbers according to the supported sensor categories.

[0055] In this embodiment, the status flag signal feedback is used to timely feedback the update and use status of each sub-storage space regarding the first image processing configuration parameter, which effectively ensures the parameter calculation, external storage and data interaction within the module, and reduces the bus transmission pressure and power consumption. If there is no status flag signal, the module does not know whether to use the first image processing configuration parameter. Each frame needs to read the parameters and transmit the parameters from the external storage unit. Such access operations bring great power consumption and bus transmission pressure. Secondly, the parts involved in data interaction cannot quickly and effectively know each other's situation, so the process of dynamic parameter refresh cannot be effectively completed, affecting the image processing effect of the entire ISP.

[0056] Optionally, the transfer unit may be used to cache the first image processing configuration parameter.

[0057] As an optional embodiment, the present invention also provides an ISP parameter configuration system suitable for multi-sensor scenarios, and its structure and signal flow relationship are as follows: Figure 4 shown.

[0058] like Figure 4 As shown in the figure, the ISP parameter configuration system for multi-sensor scenarios consists of four parts: CPU, storage unit, transfer unit, and ISP module.

[0059] The ISP module calculates the current environment information based on the current image information and transmits it to the CPU. The CPU calculates the image processing configuration parameters that match the current environment information based on the feedback environment information and the pre-set parameter calculation method, including table parameters with large data volume and control parameters with small data volume. The CPU stores the table parameters in the storage unit and writes the control parameters directly into the ISP module through the bus.

[0060] For the storage unit, only table parameters with large data volume are stored. Two sets of storage, set0 and set1, are used internally to ensure that the data acquisition and CPU writing of table parameters can be carried out synchronously under normal operation of the ISP module. Set0 / 1 is further divided into M sub-parts internally to ensure that the parameter access processes between sensors are independent of each other and do not interfere with each other. Each sub-part is further divided into N sub-storage spaces. Each sub-storage space of each sub-part corresponds to an algorithm module in the ISP module, and has a corresponding status flag signal. The status flag signal is used to feedback the update and use of the parameters stored in the corresponding sub-storage space. This two-set storage and flag signal feedback method realizes the need for parameter transmission in every frame, and the reading and writing of the corresponding part of the storage at any time, which effectively reduces the bus transmission pressure and ensures the timely and fast transmission of parameters.

[0061] In this embodiment, the external storage unit is generally divided into two parts, set0 and set1. Each part is specifically divided into multiple sub-parts, depending on the sensor category. In each sub-part, a certain table storage space (sub-storage space) is allocated to each algorithm module. The CPU changes Module(n) accordingly according to the table class parameters of the currently updated sensor(m).

[0062] _Set(x)_Sensor(m)_Flag, transfer the update status of each part of the external storage to the module, and write the table type parameters into the corresponding storage part to complete the storage control of the table type parameters in the external storage. Each algorithm module in the isp module sends a corresponding address request to the external storage unit through the transfer unit according to the image status and parameter update status of the current frame and the next frame, and reads the table type parameters of the corresponding part. Among them, sensor(m) refers to the sensor that needs to update the image processing configuration parameters based on the environmental information feedback.

[0063] Ping-pong synchronization is used in the external storage unit to store and read operations, which solves the problem of frequent updates of external storage affecting the fast and accurate transmission of parameters, and ensures the normal operation of dynamic parameter refresh. The number of setgroups in the external storage unit is unlimited, and can be set to 2 or more groups according to system performance and configuration requirements, and can be flexibly adjusted; the number of sensorgroups in the setgroup is also unlimited, and can be 4, 5 or other numbers according to the supported sensor categories.

[0064] The transfer unit is used to transfer table parameters between the ISP module and the storage unit. The ISP module sends a parameter read request to the transfer unit based on the parameter refresh status of the next frame image, using a custom signal protocol; the transfer unit transfers the parameter read request to the storage unit using a universal bus protocol. The transfer unit has a buffering function and can support internal back pressure of the module without affecting the normal working state of the module. Tables with large data volumes are transferred using transfers, effectively reducing the transmission pressure on the CPU.

[0065] Different types of parameters are transmitted to the ISP module through different channels. The control parameters are characterized by small data volume, fast update frequency, and high delay requirements. For these parameters, the CPU directly transmits them to the ISP algorithm modules through the bus, with minimal delay; the talbe parameters are characterized by large data volume, which are updated with changes in environmental conditions such as light, and the update frequency is relatively slow. For these parameters, the CPU first stores them in an external storage unit, and then indirectly transmits them to the algorithm modules through the transfer unit.

[0066] The method of transmitting parameters in different channels effectively balances the CPU load pressure under a single channel while meeting the delay requirements of different parameters. At the same time, this method is particularly suitable for scenarios where parameters need to be dynamically updated.

[0067] Inside each ISP algorithm module, for control parameters with small data volume, registers are directly used for storage, which will not waste resources and is convenient for subsequent debugging. One set of confreg and M sets of workreg are used for storage. Confreg is directly connected to the bus and can be configured at any time. Workreg is used inside the module and the parameters of confreg are taken at the appropriate time. One set of workreg corresponds to one sensor. This dual register configuration method prolongs the configuration time interval and effectively reduces the CPU load pressure.

[0068] In this embodiment, if Figure 5As shown, the control logic diagram of the algorithm submodule in the image processing module. Among them, SENSOR_ID_REFRESH indicates the sensor_id corresponding to the next frame. Specifically, the sensor order corresponding to the image can be determined according to the image frame rate and the sensor on state, thereby determining the sensor_id corresponding to the next frame. SET_GROUP_MUX indicates which set of the storage unit the algorithm module can read from, which can be determined according to the status flag signal Module(n)_Set(x)_Sensor(m)_Flag. Assuming that the sensor_id corresponding to the next frame is 2, for algorithm module 1, the status flag signal Module1_Set0_Sensor2_Flag of the corresponding sub-storage space in storage unit set0 is pulled high, and the status flag signal Module1_Set1_Sensor2_Flag of the corresponding sub-storage space in storage unit set1 is cleared, then the read operation can be performed from set0. FLAG_CLEAR indicates the clearing operation of the status flag signal of the corresponding sub-storage space. The algorithm module can specifically clear the corresponding ModuleName_SetM_SensorN_Flag according to the parameter update status and the parameter usage status inside the module, and feed it back to the CPU. More specifically, assuming that algorithm module 1 reads the table-type parameters from the sub-storage space corresponding to Module1_Set0_Sensor2_Flag, Module1_Set0_Sensor2_Flag is cleared. TABLE_FSM is the core control state machine inside the algorithm module, which is responsible for determining which sensor parameters are stored in table0 / 1 inside the algorithm module and which table is used in the current frame. Based on the information provided by the above four parts, each algorithm module can determine whether to send a parameter read request to the external storage unit and which part of the table-type parameters to request, complete the reading of the table-type parameters, and determine which table to write the table-type parameters required for the next frame according to the state machine to complete the storage of the table-type parameters. For example, the sensor corresponding to the next frame of image is sensor2, and the table-type parameters corresponding to sensor2 are updated. Algorithm module 1 receives the parameter update notification sent by the CPU, and then algorithm module 1 determines that it needs to read the updated table-type parameters of sensor2 from the storage unit for parameter configuration of the next frame of image. Algorithm module 1 checks the status flag signals of the corresponding sub-storage spaces in set0 and set1. The high status flag signal means that the corresponding sub-storage space stores updated table-type parameters for algorithm module 1 to read.Algorithm module 1 determines which internal table to use to store the updated table-like parameters corresponding to sensor 2 according to the core state machine, completes the reading and storage of the parameters, and then clears the raised status flag signal.

[0069] In order to further reduce the CPU load pressure, control parameters are configured using dual registers when they are directly transmitted through the transmission channel. In each algorithm module, a set of confreg and multiple sets of workreg are used. Confreg is directly connected to the CPU through the bus for CPU configuration at any time; workreg takes the data of confreg and stores it at the appropriate time for internal use in the module. Using confreg, the limited time available for the configuration process is extended to any time, avoiding the CPU's short-term centralized configuration and reducing the CPU load pressure.

[0070] The algorithm module uses a ping-pong access method, using two sets of tables, one for reading the current frame and one for pre-fetching the next frame. No matter how many sensor categories need to be compatible, each ISP algorithm module only needs to use two sets of tables to obtain the latest image processing configuration parameters for calculation in real time. Different from the traditional method of having multiple sets of tables for multiple types of sensors, it can save a lot of storage resources and provide the latest image processing configuration parameters to each module in real time.

[0071] For table-type parameters with large data volumes, two sets of mem storage, table0 and table1, are used internally to read the module and refresh and write the parameters, respectively. The ping-pong access operation between the two ensures that the latest and most accurate parameters are provided to the module, effectively improving the image processing effect.

[0072] Through this embodiment, under the premise of transferring storage from the ISP to the external storage, the effective dynamic refresh of parameters is ensured, which mainly includes two aspects: first, the first image processing configuration parameters are correctly accessed by the internal and external storage units of the module, and second, the first image processing configuration parameters can be quickly and accurately transmitted to the inside of the module. In short, it is the accuracy and speed of the dynamic refresh of parameters.

[0073] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0074] It should be noted that the above modules can be implemented by software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.

[0075] Optionally, in this embodiment, the above-mentioned storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store computer programs.

[0076] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, and optionally, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order than here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0077] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A parameter configuration system, characterized in that: include: A storage module, used for storing the first image processing configuration parameter whose data volume is greater than a first threshold value through two data sets; a transfer module, connected to the storage unit, and used for transmitting the first image processing configuration parameter between the image processing module and the storage unit; An image processing module, used to perform image processing according to the first image processing configuration parameters, and to calculate environmental information based on the image information and transmit it to the processing module; The processing module is used to update the first image processing configuration parameter according to the environmental information and a preset parameter processing strategy.

2. The parameter configuration system according to claim 1, characterized in that: The image processing module is provided with a plurality of algorithm submodules, each algorithm submodule is used to send a parameter reading request to the external storage module, complete the reading of the first image processing configuration parameter, determine the module storage address of the read first image processing configuration parameter, and complete the storage of the read first image processing configuration parameter.

3. The parameter configuration system according to claim 1, characterized in that: The image processing module is used to set a refresh state of a first image processing configuration parameter corresponding to a target sensor and send a parameter reading request to the transfer module; The transfer module is used to transfer the parameter reading request to the storage module.

4. The parameter configuration system according to claim 3, characterized in that: The image processing module is used to set a refresh state of the first image processing configuration parameter corresponding to the target sensor state, and send a parameter reading request to the transfer module using a custom signal protocol; The transfer module is used to transfer the parameter reading request to the storage module using a universal bus protocol.

5. The parameter configuration system according to claim 1, characterized in that: The image processing module is used to set a first memory and a second memory to store the first image processing configuration parameters, the first memory is used to read the first image processing configuration parameters, and the second memory is used to refresh and write the first image processing configuration parameters.

6. The parameter configuration system according to claim 1, characterized in that: The processing module is also used to update the second image processing configuration parameters; the image processing module is used to set the first type register and the second type register to store the second image processing configuration parameters, the second type register is used for the image processing module, and the data volume of the second image processing configuration parameters is less than the second threshold.

7. The parameter configuration system according to claim 6, characterized in that: The first type of register is directly connected to the processing module through a bus, so as to be configured by the processing module at any time; the second type of register takes the data of the first type of register and stores it at an appropriate time for internal use by the image processing module.

8. The parameter configuration system according to claim 1, characterized in that: The storage space for storing each data set in the storage module is divided into M sub-parts, and each sub-part of each storage space corresponds to a sensor; each sub-part is divided into N sub-storage spaces, and each sub-storage space of each sub-part corresponds to an algorithm sub-module of the image processing module; each sub-storage space is set with a corresponding status flag signal, and the status flag signal is used to identify the update and use of the first image processing configuration parameter in the corresponding sub-storage space.

9. The parameter configuration system according to claim 8, characterized in that: The image processing module is configured to read the required first image processing configuration parameters from the storage module and store them inside the image processing module. After the first image processing configuration parameters are stored inside, the high potential corresponding to the status flag signal corresponding to the storage space where the first image processing configuration parameters are located is cleared.

10. The parameter configuration system according to claim 1, characterized in that: The transfer module is used to cache the first image processing configuration parameter requested by the image processing module.

Images