Image frame data identification method and related equipment

Abstract

The invention provides an image frame data identification method and related equipment. The method comprises the steps that an image sensor obtains image frame data; the image sensor sets snapshot identification information in the image frame data, wherein the snapshot identification information is used for indicating that the image frame data is snapshot frame data or non-snapshot frame data; and transmitting the image frame data to a system on chip. According to the method, the snapshot identification information can be directly added into the obtained image frame data by the image sensor, so that the system on chip can directly receive the image frame data containing the snapshot identification information, the snapshot frame data and the non-snapshot frame data can be directly identified, and the identification accuracy is improved.

Description

Technical Field

[0001] The present application relates to the field of image processing, and more specifically, to an image frame data recognition method, an image frame data recognition device, an image frame data recognition system, an electronic device, a chip system and a computer-readable storage medium. Background Art

[0002] In a scene involving target capture, an image sensor can capture images during the process of capturing video images. However, the exposure parameters used by the image sensor when capturing video images are generally different from those used when capturing images, resulting in different performances of the image frame data obtained by the image sensor at the capture moment and the non-capture moment in terms of exposure, depth of field or dynamic effects. Among them, the capture moment refers to the moment of capturing, and the non-capture moment refers to the moment of capturing video images. After receiving the image frame data from the image sensor, the back-end system on chip (SOC) needs to separate the image frame data corresponding to the capture moment and the non-capture moment, so as to perform different image processing operations on the image frame data corresponding to the capture moment and the non-capture moment. The current separation technology of capture frames and non-capture frames mainly assumes that the time interval between the SOC or field programmable gate array (FPGA) sending the capture control signal to the image sensor and the image sensor sending the image frame data to the SOC is fixed. For example, the second image frame data received after the SOC or FPGA sends a capture control signal to the image sensor can be used as the capture frame, and the other image frame data can be used as non-capture frame data. However, when the load of the central processing unit (CPU) of the SOC is high and the bandwidth of the double data rate synchronous dynamic random access memory (DDR SDRAM) is high, there will be a large deviation between the time interval between the SOC or FPGA sending the capture control signal to the image sensor and the time interval between the image sensor sending the image frame data to the SOC. For example, the SOC can receive the image frame data corresponding to the capture moment after a long delay, or the image frame data corresponding to the capture moment is abnormally lost, etc., which makes it difficult to correctly separate the capture frame data and the non-capture frame data, and then it is difficult to perform subsequent image processing, affecting the visual experience.

[0003] Therefore, how to improve the accuracy of identifying captured frame data and non-captured frame data has become an urgent problem to be solved. Summary of the invention

[0004] The present application provides an image frame data recognition method, an image frame data recognition device, an image frame data recognition system, an electronic device, a chip system and a computer-readable storage medium, which can improve the accuracy of recognizing captured frame data and non-captured frame data.

[0005] In a first aspect, a method for identifying image frame data is provided. The method comprises: an image sensor obtains image frame data; the image sensor sets snapshot identification information in the image frame data, the snapshot identification information is used to indicate whether the image frame data is snapshot frame data or non-snap frame data; and the image frame data is transmitted to a system on chip (SOC).

[0006] In an embodiment of the present application, the image sensor can directly add snapshot identification information to the obtained image frame data, so that the SOC can directly receive the image frame data containing the snapshot identification information, and then directly identify the snapshot frame data and non-snapshot frame data, thereby improving the recognition accuracy.

[0007] In combination with the first aspect, in certain implementations of the first aspect, when the image frame data is transmitted via the mobile industry processor interface MIPI transmission protocol, the snapshot identification information is set in a virtual channel VC identifier.

[0008] In combination with the first aspect, in certain implementations of the first aspect, when the image frame data is transmitted via a low voltage differential signal LVDS transmission protocol, the snapshot identification information is set in a synchronization code.

[0009] In the embodiment of the present application, the image sensor can use the existing VC identifier or synchronization code to carry the snapshot identification information when transmitting the image frame data through the transmission protocol, thereby saving resource overhead.

[0010] In combination with the first aspect, in certain implementations of the first aspect, the snapshot identification information is set in the blanking line data of the image frame data, and / or the snapshot identification information is set in the pixel value of a preset pixel of the image frame data.

[0011] In an embodiment of the present application, the image sensor can directly set the capture identification information in the blanking line data of the image frame data or the pixel value of the preset pixel, so that the on-chip system can directly receive the image frame data containing the capture identification information.

[0012] In combination with the first aspect, in certain implementations of the first aspect, the snapshot identification information includes first snapshot identification information. When the snapshot condition is met, the image sensor obtains first image frame data based on a first exposure parameter, and the first exposure parameter is an exposure parameter when the snapshot condition is met; the image sensor sets the first snapshot identification information in the first image frame data, and the first snapshot identification information is used to indicate that the first image frame data is snapshot frame data.

[0013] In an embodiment of the present application, the image sensor can obtain image frame data using corresponding exposure parameters when the capture conditions are met, and set capture identification information in the image frame data, thereby facilitating the on-chip system to identify the image frame data as capture frame data.

[0014] In combination with the first aspect, in certain implementations of the first aspect, the snapshot identification information also includes second snapshot identification information. When the snapshot condition is not met, the image sensor obtains second image frame data based on a second exposure parameter, where the second exposure parameter is an exposure parameter when the snapshot condition is not met, and the second exposure parameter is different from the first exposure parameter; the image sensor sets the second snapshot identification information in the second image frame data, and the second snapshot identification information is used to indicate that the second image frame data is non-capture frame data.

[0015] In an embodiment of the present application, the image sensor can use corresponding exposure parameters to obtain image frame data when the capture conditions are not met, and set capture identification information in the image frame data, thereby facilitating the on-chip system to identify the image frame data as non-capture frame data.

[0016] In combination with the first aspect, in certain implementations of the first aspect, the capture condition includes at least one of the following: receiving a first exposure parameter, reaching a preset time, receiving a capture control signal, and the presence of an object meeting the preset condition in the captured picture.

[0017] In an embodiment of the present application, the image sensor can capture a picture when at least one of the following conditions is met: receiving a first exposure parameter, reaching a preset time, receiving a capture control signal, or the presence of an object that meets preset conditions in the captured picture, thereby obtaining captured frame data.

[0018] In a second aspect, a method for identifying image frame data is provided. The method comprises: a system on chip receives image frame data from an image sensor, the image frame data includes snapshot identification information, and the snapshot identification information is used to indicate whether the image frame data is snapshot frame data or non-snapshot frame data; the system on chip determines whether the image frame data is snapshot frame data or non-snapshot frame data according to the snapshot identification information.

[0019] In an embodiment of the present application, the on-chip system can receive image frame data from an image sensor, and the image frame data contains snapshot identification information, so that the snapshot frame data and non-snapshot frame data can be directly identified based on the snapshot identification information, thereby improving the recognition accuracy.

[0020] In combination with the second aspect, in certain implementations of the second aspect, when the image frame data is transmitted via the mobile industry processor interface MIPI transmission protocol, the snapshot identification information is set in a virtual channel VC identifier.

[0021] In combination with the second aspect, in certain implementations of the second aspect, when the image frame data is transmitted via a low voltage differential signal LVDS transmission protocol, the snapshot identification information is set in a synchronization code.

[0022] In an embodiment of the present application, the on-chip system can directly determine whether the image frame data is captured frame data or non-captured frame data through the VC identifier or synchronization code in the image frame data, thereby improving the accuracy of identifying captured frame data and non-captured frame data.

[0023] In combination with the second aspect, in certain implementations of the second aspect, the snapshot identification information is set in the blanking line data of the image frame data, and / or the snapshot identification information is set in the pixel value of a preset pixel of the image frame data.

[0024] In an embodiment of the present application, the on-chip system can directly determine whether the image frame data is captured frame data or non-captured frame data through the blanking line data of the image frame data or the pixel value of the preset pixel, thereby improving the accuracy of identifying captured frame data and non-captured frame data.

[0025] In combination with the second aspect, in certain implementations of the second aspect, a first exposure parameter and / or a second exposure parameter is sent, the first exposure parameter is an exposure parameter when the snapshot condition is met, the second exposure parameter is an exposure parameter when the snapshot condition is not met, and the second exposure parameter is different from the first exposure parameter.

[0026] In combination with the second aspect, in certain implementations of the second aspect, the capture condition includes at least one of the following: the image sensor receives a first exposure parameter, a preset time is reached, the image sensor receives a capture control signal, and there is an object that meets the preset conditions in the picture captured by the image sensor.

[0027] In an embodiment of the present application, the on-chip system can send different exposure parameters to the image sensor, so that the image sensor can use different exposure parameters when the capture conditions are met and when the capture conditions are not met, thereby obtaining capture frame data or non-capture frame data.

[0028] In combination with the second aspect, in some implementations of the second aspect, a capture control signal is sent, where the capture control signal is used to instruct the image sensor to acquire capture frame data.

[0029] In the embodiment of the present application, the on-chip system can instruct the image sensor to capture images, thereby obtaining captured frame data.

[0030] In a third aspect, an image frame data recognition device is provided, wherein the device includes a module for implementing the first aspect or any possible implementation manner of the first aspect.

[0031] In a fourth aspect, an image frame data recognition device is provided, wherein the device comprises a module for implementing the second aspect or any possible implementation manner of the second aspect.

[0032] In a fifth aspect, an image frame data recognition system is provided, which includes the image frame data recognition device as described in the third aspect and the fourth aspect.

[0033] In a sixth aspect, an electronic device is provided. The electronic device includes a processor, the processor is used to couple with a memory, read and execute instructions and / or program codes in the memory, so as to execute the method as described in the first aspect, the second aspect, any possible implementation of the first aspect, or any possible implementation of the second aspect.

[0034] In a seventh aspect, a chip system is provided. The chip system includes a logic circuit, the logic circuit is used to couple with an input / output interface, transmit data through the input / output interface, and execute the method as described in the first aspect, the second aspect, any possible implementation of the first aspect, or any possible implementation of the second aspect.

[0035] In an eighth aspect, a computer-readable storage medium is provided. The computer-readable storage medium includes computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method as described in the first aspect, the second aspect, any possible implementation of the first aspect, or any possible implementation of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 It is a schematic structural diagram of an image frame data recognition system according to an embodiment of the present application.

[0037] Figure 2 It is a timing diagram of sending exposure control signals and receiving image frame data according to an embodiment of the present application.

[0038] Figure 3 It is a schematic diagram comparing non-capture frame data and capture frame data according to an embodiment of the present application.

[0039] Figure 4 It is a schematic flow chart of an image frame data recognition method according to an embodiment of the present application.

[0040] Figure 5 It is a schematic flowchart of an image frame data recognition method according to another embodiment of the present application.

[0041] Figure 6 The figure is a schematic diagram of an image sensor transmitting image frame data to a system on chip according to an embodiment of the present application.

[0042] Figure 7 is a schematic diagram of an image sensor transmitting image frame data to a system on chip according to another embodiment of the present application.

[0043] Figure 8 It is a structural diagram of an image frame data recognition device according to an embodiment of the present application.

[0044] Fig. 9 It is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0045] The technical solution in this application will be described below in conjunction with the accompanying drawings.

[0046] The embodiments of the present application will present various aspects, embodiments or features around a system including multiple devices, components, modules, etc. It should be understood and appreciated that each system may include additional devices, components, modules, etc., and / or may not include all devices, components, modules, etc. discussed in conjunction with the figures. In addition, combinations of these schemes may also be used.

[0047] In addition, in the embodiments of the present application, words such as "exemplary" and "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the word "exemplary" is intended to present concepts in a concrete way.

[0048] The business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field can know that with the evolution of technology and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0049] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear at different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0050] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can be represented by: including the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0051] The method in the embodiment of the present application can be applied to various scenarios that require identification or separation of different image frame data. The method in the embodiment of the present application can also be applied to scenes involving target capture, such as intelligent transportation system (ITS) scenarios and multi-exposure scenarios. The image sensor in the embodiment of the present application can be, for example, a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The embodiment of the present application does not limit the specific type of the system on chip SOC or the specific modules included in the SOC.

[0052] Figure 1 It is a schematic structural diagram of an image frame data recognition system provided in an embodiment of the present application. Figure 1 The system 100 in the embodiment includes an image sensor 110 and a system on chip 120 .

[0053] The system on chip 120 may directly send a control signal to the image sensor 110. The control signal may include an exposure control signal and / or a capture control signal. The exposure control signal includes an exposure parameter, and the exposure parameter may include an exposure time and / or a gain. The exposure time is used to adjust the length of time the shutter is open. When the exposure time is long, the image sensor receives more light, and the obtained image frame data is brighter when displayed. When the exposure time is short, the image sensor receives less light, and the obtained image frame data is darker when displayed. The gain is used to adjust the degree of amplification of the signal. When the gain is large, the degree of amplification of the signal is large, resulting in the image frame data obtained by the image sensor being brighter when displayed, but at the same time, the noise in the image frame data is increased. When the gain is small, the degree of amplification of the signal is small, resulting in the image frame data obtained by the image sensor being darker when displayed, but at the same time, the degree of amplification of the noise in the image frame data is also small. The capture control signal is used to instruct the image sensor 110 to capture and obtain image frame data, and the image frame data is captured frame data.

[0054] The image sensor 110 can capture video images, and can also perform snapshots, and send the obtained image frame data to the on-chip system 120. The image frame data can be image frame data obtained when capturing video images, that is, the image frame data can be non-snapshot frame data. Alternatively, the image frame data can be image frame data obtained when performing snapshots, that is, the image frame data can be snapshot frame data.

[0055] In some embodiments, for example, in an ITS scenario, the system 100 may further include an FPGA 130 . The FPGA 130 may receive a control signal from the system on chip 120 , and send the control signal to the image sensor 110 .

[0056] In some embodiments, at least two of the image sensor 110, the system on chip 120, and the FPGA 130 may be located in the same electronic device. Alternatively, at least two of the image sensor 110, the system on chip 120, and the FPGA 130 may be located in different electronic devices.

[0057] In some embodiments, the image sensor 110 may obtain image frame data according to the exposure parameters. Specifically, the image sensor 110 may adjust the exposure time and / or gain according to the exposure parameters received each time, thereby obtaining image frame data. Alternatively, the image sensor may adjust the exposure time and / or gain according to the preset exposure parameters, thereby obtaining image frame data.

[0058] Since the video image captured by the image sensor 110 and the captured image need to be displayed differently, for example, the captured video image needs to be brighter when displayed, but some details in the video image can be blurred. The captured image can be darker when displayed, but some details need to be made clearer. Therefore, the exposure parameters used by the image sensor 110 at the capture moment are generally different from the exposure parameters used at the non-capture moment. The capture moment refers to the moment when the capture is performed, and the non-capture moment refers to the moment when the video image is captured.

[0059] For example, for a target moving at a faster speed, the image sensor uses a shorter exposure time at the capture moment and a longer exposure time at the non-capture moment.

[0060] It should be understood that the exposure parameters used by the image sensor 110 at multiple non-capture moments may be the same or different. The exposure parameters used by the image sensor 110 at multiple capture moments may be the same or different.

[0061] For example, the timing diagram of the system on chip 120 sending the exposure control signal and receiving the image frame data is as follows: Figure 2 As shown. Figure 2 It can be seen that the system on chip 120 sends exposure control signals at t1, t2, t3, t4, t5, and t6 respectively. Among them, the exposure control signals sent at t1, t2, t4, t5, and t6 are used by the image sensor 110 to capture video images, and the exposure control signal sent at t3 is used by the image sensor 110 to capture images. The exposure control signal sent at t3 is different from the exposure control signals sent at t1, t2, t4, t5, and t6. At least two of the exposure control signals sent at t1, t2, t4, t5, and t6 can be the same or different. The system on chip 120 can also send exposure control signals at t7, t8, t9, and t10 respectively. 10 ,t 11 ,t 12 The image frame data from the image sensor 110 is received at time t7. Among them, time t7 is later than time t2, and time t7 is earlier than time t3. The image frame data received at time t7 is obtained by the image sensor 110 according to the exposure control signal at time t1. Similarly, time t8 is later than time t3, and time t8 is earlier than time t4. The image frame data received at time t8 is obtained by the image sensor 110 according to the exposure control signal at time t2. Time t9 is later than time t4, and time t9 is earlier than time t5. The image frame data received at time t9 is obtained by the image sensor 110 according to the exposure control signal at time t3. 10 ,t 11 ,t 12 The image frame data received at each moment is similar to the above description and will not be repeated here.

[0062] When the time interval between the system on chip 120 sending the exposure control signal and receiving the image frame data is relatively fixed, the system on chip 120 can determine whether the received image frame data is captured frame data or non-captured frame data according to the time when the exposure control signal is sent. For example, it is assumed that the second image frame data received after sending the exposure control signal is determined as captured frame data. If the exposure control signal sent at time t3 is used for the image sensor 110 to capture, the system on chip 120 can determine that the image frame data obtained at time t9 is captured frame data. However, the time interval between the system on chip 120 sending the exposure control signal and receiving the image frame data may have a large deviation. For example, when the CPU load of the system on chip 120 is high or the DDRSDRAM bandwidth is high, the third image frame data received after sending the exposure control signal is the captured frame data, and at this time, it is difficult for the system on chip 120 to correctly identify the captured frame data or the non-captured frame data. It should be understood that the above problem will also exist when the FPGA 130 sends the exposure control signal to the image sensor 110, and for the sake of simplicity, it will not be repeated here.

[0063] Meanwhile, in a scene involving target capture, after obtaining the captured frame data or the non-captured frame data, the system on chip 120 needs to perform different image processing operations on the captured frame data and the non-captured frame data, so as to facilitate the recognition of the target in the image. In other words, the system on chip 120 needs to correctly identify the captured frame data and the non-captured frame data, so as to facilitate the performance of different image processing operations, and then facilitate the recognition of the target in the image.

[0064] For example, the image after the system on chip 120 performs different image processing operations on the captured frame data and the non-captured frame data is as follows: Figure 3 shown. Figure 3 (a) in the figure is the image obtained after image processing of non-captured frame data. Figure 3 (b) in the figure is the image obtained after image processing of the captured frame data. Figure 3 It can be seen that Figure 3 (a) and (b) in the figure differ in terms of brightness, contrast, and picture details. Figure 3 (b) in the figure makes it easier to recognize detailed information such as the license plate number and driver in the image.

[0065] Figure 4 It is a schematic flowchart of the image frame data recognition method provided in an embodiment of the present application. Figure 4 The method in can be Figure 1 The image sensor 110 in is executed. Figure 4 The method comprises the following steps.

[0066] S410: The image sensor obtains image frame data.

[0067] The image sensor can convert the optical signal in the captured image into an electrical signal, and then convert the electrical signal into a digital signal to obtain image frame data.

[0068] In some embodiments, the image sensor may obtain image frame data according to exposure parameters. The exposure parameters include exposure time and / or gain. The exposure parameters can be found in Figure 1 Description in .

[0069] For example, the image sensor may receive exposure parameters from the system on chip or FPGA, and obtain an image frame data according to each exposure parameter received, and the image frame data is used to display an image.

[0070] Exemplarily, the image sensor may obtain at least one image frame data according to at least one preset exposure parameter, wherein each image frame data corresponds to one exposure parameter, and each image frame data is used to be displayed as an image.

[0071] In some embodiments, the image frame data includes a valid data set and a blank line data set. The valid data set includes at least one valid data, each valid data in the at least one valid data is used to determine the pixel value of a pixel in the image when displayed. The blank line data set includes at least one blank line data, each blank line data in the at least one blank line data is not used to determine the pixel value of any pixel in the image when displayed.

[0072] S420: The image sensor sets the capture identification information in the image frame data.

[0073] The image sensor may set snapshot identification information in the image frame data, and the snapshot identification information is used to indicate whether the image frame data is snapshot frame data or non-snap frame data.

[0074] In some embodiments, the image sensor may set first identification information in the first image frame data. The first image frame data is image frame data obtained at the capture moment. In other words, the first image frame data is image frame data obtained when the capture condition is met. The first identification information is used to indicate that the first image frame data is captured frame data.

[0075] In some embodiments, the image sensor may set second identification information in the second image frame data. The second image frame data is image frame data obtained at a non-capture moment. In other words, the second image frame data is image frame data obtained when the capture condition is not met. The second identification information is used to indicate that the second image frame data is non-capture frame data.

[0076] Exemplarily, the capture condition includes at least one of the following: receiving a first exposure parameter, reaching a preset time, receiving a capture control signal, and the presence of an object meeting a preset condition in the captured image.

[0077] Exemplarily, the image sensor uses different exposure parameters when obtaining the first image frame data and the second image frame data.

[0078] Exemplarily, the image sensor may set the first identification information only in the first image frame data. Alternatively, the image sensor may set the second identification information only in the second image frame data. Alternatively, the image sensor may set the first identification information in the first image frame data and set the second identification information in the second image frame data.

[0079] When different transmission protocols are used to transmit the image frame data, the snapshot identification information can be set in different identification information. For example, when the image frame data is transmitted using the mobile industry processor interface (MIPI) transmission protocol, the snapshot identification information can be set in a virtual channel (VC) identifier. When the image frame data is transmitted using the low-voltage differential signaling (LVDS) transmission protocol, the snapshot identification information can be set in a synchronization code. For example, the synchronization code can be a start of active video (SAV) and / or an end of active video (EAV).

[0080] Exemplarily, when transmitting image frame data through the MIPI transmission protocol, the image sensor may set the VC identifier of the first image frame data to a first value, and set the VC identifier of the second image frame data to a second value. The second value is a value other than the first value. For example, the first value may be 1, and the second value may be 0, 2, 3, etc.

[0081] Similarly, when transmitting image frame data through the LVDS transmission protocol, the image sensor may set the synchronization code of the first image frame data to a first value, and set the synchronization code of the second image frame data to a second value.

[0082] In some embodiments, the image sensor may set the capture identification information in the blanking line data of the image frame data, and / or the image sensor may set the capture identification information in the pixel value of a preset pixel of the image frame data.

[0083] Exemplarily, the image sensor may set the capture identification information in each blank line data of the image frame data. Alternatively, the image sensor may set the capture identification information in part of the blank line data of the image frame data. The part of the blank line data may be blank line data of a preset position or a preset area.

[0084] For example, the image sensor may set each blank line data of the first image frame data to a first value, and set each blank line data of the second image frame data to a second value. Alternatively, the image sensor may set each blank line data of a preset position of the first image frame data to a first value, and set each blank line data of a preset position of the second image frame data to a second value.

[0085] Exemplarily, the preset pixel of the image frame data may be one or more pixels. That is, the image sensor may set the snapshot identification information in the pixel value of the preset one or more pixels. For example, the image sensor may set the pixel value of each preset pixel of the first image frame data to a first value, and set the pixel value of each preset pixel of the second image frame data to a second value.

[0086] Exemplarily, when transmitting image frame data via the MIPI transmission protocol, the image sensor may set the capture identification information in at least one of the following: a VC identifier, blanking line data, or a pixel value of a preset pixel. When transmitting image frame data via the LVDS transmission protocol, the image sensor may set the capture identification information in at least one of the following: a synchronization code, blanking line data, or a pixel value of a preset pixel.

[0087] S430 , the image sensor transmits the image frame data to the on-chip system.

[0088] The image sensor can transmit image frame data to the system on chip, and the image frame data includes snapshot identification information.

[0089] In some embodiments, the system on chip and the image sensor may be located in the same electronic device, or the system on chip and the image sensor may be located in different electronic devices, which is not limited in the embodiments of the present application.

[0090] In some embodiments, after receiving the image frame data from the image sensor, the on-chip system can determine whether the image frame data is captured frame data or non-capture frame data according to the capture identification information in the image frame data.

[0091] Exemplarily, when transmitting image frame data via the MIPI transmission protocol, the system on chip can determine whether the image frame data is captured frame data or non-capture frame data by at least one of the following: VC identifier, blanking line data, pixel value of a preset pixel. When transmitting image frame data via the LVDS transmission protocol, the system on chip can determine whether the image frame data is captured frame data or non-capture frame data by at least one of the following: synchronization code, blanking line data, pixel value of a preset pixel.

[0092] In some embodiments, the system on chip may further perform a first image processing operation on the image frame data after determining that the image frame data is captured frame data. The system on chip may further perform a second image processing operation on the image frame data after determining that the image frame data is non-captured frame data. The first image processing operation is different from the second image processing operation.

[0093] In an embodiment of the present application, the image sensor can directly add snapshot identification information to the obtained image frame data, so that the on-chip system can directly receive the image frame data containing the snapshot identification information, and then directly identify the snapshot frame data and non-snapshot frame data, thereby improving the recognition accuracy.

[0094] Figure 5 It is a schematic flow chart of the image frame data recognition method provided in an embodiment of the present application. Figure 5 The method in can be Figure 1 The system 100 in is executed. Figure 5 The method comprises the following steps.

[0095] S510: The image sensor obtains exposure parameters.

[0096] The image sensor can receive exposure parameters from the system on chip or FPGA. The exposure parameters include exposure time and / or gain. The exposure parameters can be found in Figure 1 Description in .

[0097] In some embodiments, the image sensor may continuously receive exposure parameters, and only receive one exposure parameter each time. In other words, the image sensor may receive multiple exposure parameters at multiple different times.

[0098] In some embodiments, the image sensor may receive exposure parameters only once, and the exposure parameters include a first exposure parameter and a second exposure parameter. The first exposure parameter and the second exposure parameter are different. In other words, the image sensor may store the first exposure parameter and the second exposure parameter after receiving them, and use different exposure parameters at the capture moment and the non-capture moment.

[0099] S520: The image sensor determines whether a capture condition is met.

[0100] The image sensor can determine whether the snapshot condition is met, thereby executing step S530 when the snapshot condition is met, and executing step S550 when the snapshot condition is not met.

[0101] In some embodiments, the capture condition includes at least one of the following: receiving a first exposure parameter, reaching a preset time, receiving a capture control signal, and the presence of an object meeting the preset condition in the captured image.

[0102] Exemplarily, the image sensor may determine that the snapshot condition is satisfied when the time reaches a preset moment. The preset moment may be a specific moment, or the preset moment may be determined according to a preset period. For example, the preset moment may be 9 a.m. Alternatively, when the preset period is 1 minute, the preset moment may be a moment at intervals of 1 second starting from the start moment. The embodiment of the present application does not limit the start moment.

[0103] Exemplarily, the image sensor may determine that the capture condition is met after receiving the capture control signal. The capture control signal may come from a system on chip or an FPGA, which is not limited in the embodiments of the present application. In other words, the system on chip or the FPGA may send a capture control signal to the image sensor. The capture control signal is used to instruct the image sensor to obtain the capture frame data.

[0104] Exemplarily, the image sensor may determine that the capture condition is met when it is determined that there is an object that meets the preset condition in the captured image. The object that meets the preset condition may be, for example, a pedestrian or vehicle that violates traffic regulations. Alternatively, the object that meets the preset condition may be, for example, an object that behaves abnormally.

[0105] S530: The image sensor obtains first image frame data according to the first exposure parameter.

[0106] When the snapshot condition is met, the image sensor may adjust the exposure parameter according to the first exposure parameter to obtain the first image frame data. The first exposure parameter may be the exposure parameter just received by the image sensor. Alternatively, the first exposure parameter may be determined by the image sensor from the exposure parameter set, and the first exposure parameter is the exposure parameter when the snapshot condition is met.

[0107] S540: The image sensor sets first capture identification information in the first image frame data.

[0108] After obtaining the first image frame data, the image sensor may set first snapshot identification information in the first image frame data. The first snapshot identification information is used to indicate that the first image frame data is snapshot frame data.

[0109] Exemplarily, when transmitting the first image frame data through the MIPI transmission protocol, the image sensor may set the first snapshot identification information in at least one of the following items: a VC identifier, blanking line data, and a pixel value of a preset pixel. When transmitting the image frame data through the LVDS transmission protocol, the image sensor may set the first snapshot identification information in at least one of the following items: a synchronization code, blanking line data, and a pixel value of a preset pixel.

[0110] For example, the image sensor may set at least one of the VC identifier in the first image frame data, each blanking line data at a preset position, or the pixel value of each preset pixel to the first value. Alternatively, the image sensor may set at least one of the synchronization code in the first image frame data, each blanking line data at a preset position, or the pixel value of each preset pixel to the first value. The embodiment of the present application does not limit the specific value of the first value, for example, it may be 0, 1, 2, etc.

[0111] S550: The image sensor obtains second image frame data according to the second exposure parameter.

[0112] When the snapshot condition is not met, the image sensor may adjust the exposure parameter according to the second exposure parameter to obtain the second image frame data. The second exposure parameter may be the exposure parameter just received by the image sensor. Alternatively, the second exposure parameter may be determined by the image sensor from the exposure parameter set, and the second exposure parameter is the exposure parameter when the snapshot condition is not met.

[0113] S560: The image sensor sets second capture identification information in the second image frame data.

[0114] After obtaining the second image frame data, the image sensor may set second snapshot identification information in the second image frame data. The second snapshot identification information is used to indicate that the second image frame data is non-snapshot frame data.

[0115] Exemplarily, when transmitting the second image frame data via the MIPI transmission protocol, the image sensor may set the second snapshot identification information to at least one of the following: a VC identifier, blanking line data, or a pixel value of a preset pixel. When transmitting the image frame data via the LVDS transmission protocol, the image sensor may set the second snapshot identification information to at least one of the following: a synchronization code, blanking line data, or a pixel value of a preset pixel.

[0116] For example, the image sensor may set at least one of the VC identifier in the second image frame data, each blanking line data at a preset position, or the pixel value of each preset pixel to a second value. Alternatively, the image sensor may set at least one of the synchronization code in the second image frame data, each blanking line data at a preset position, or the pixel value of each preset pixel to a second value. The second value is a value different from the first value. The embodiment of the present application does not limit the specific value of the second value, for example, it may be 0, 1, 2, etc.

[0117] S570: The image sensor transmits the first image frame data or the second image frame data to the system on chip.

[0118] The image sensor may transmit the first image frame data or the second image frame data to the on-chip system. The first image frame data includes the first snapshot identification information, and the second image frame data includes the second snapshot identification information.

[0119] In some embodiments, the image sensor may transmit the first image frame data or the second image frame data to the system on chip via a MIPI or LVDS transmission protocol.

[0120] S580, the system on chip identifies captured frame data or non-captured frame data.

[0121] After the system on chip obtains the first image frame data, it can determine that the first image frame data is captured frame data according to the first capture identification information in the first image frame data. Alternatively, after the system on chip obtains the second image frame data, it can determine that the second image frame data is non-capture frame data according to the second capture identification information in the second image frame data.

[0122] Exemplarily, when transmitting image frame data through the MIPI transmission protocol, the system on chip can determine that the image frame data is captured frame data when the value of at least one of the VC identifier in the image frame data, each blanking line data at a preset position, and the pixel value of each preset pixel is a first value. Alternatively, the system on chip can determine that the image frame data is non-captured frame data when the value of at least one of the VC identifier in the image frame data, each blanking line data at a preset position, and the pixel value of each preset pixel is a second value.

[0123] Exemplarily, when transmitting image frame data through the LVDS transmission protocol, the system on chip can determine that the image frame data is captured frame data when the value of at least one of the synchronization code in the image frame data, each blanking line data at a preset position, and the pixel value of each preset pixel is a first value. Alternatively, the system on chip can determine that the image frame data is non-captured frame data when the value of at least one of the synchronization code in the image frame data, each blanking line data at a preset position, and the pixel value of each preset pixel is a second value.

[0124] For example, assuming that the image frame data is transmitted via the MIPI transmission protocol, the schematic diagram of the image frame data transmitted from the image sensor to the system on chip is as follows: Figure 6 or Figure 7 It should be understood that the example of image frame data transmission via LVDS is similar to the following example, and will not be described here for brevity.

[0125] exist Figure 6 In the embodiment, the image sensor can adjust the exposure parameters at a preset period, and use the first image frame data obtained according to the first exposure parameter as the captured frame data, and use the second image frame data obtained according to the second exposure parameter as the non-captured frame data. The image sensor can set the VC identifier of the first image frame data to VC1, and set the VC identifier of the second image frame data to VC0. Figure 6 As shown, the image sensor can transmit image frame data 1 to the on-chip system. Since the VC identifier in the image frame data 1 is VC0, the on-chip sensor can determine that the image frame data 1 is non-snapshot frame data. Similarly, the image sensor can transmit image frame data 2 to the on-chip system. Since the VC identifier in the image frame data 2 is VC1, the on-chip sensor can determine that the image frame data 2 is snapshot frame data. The image sensor can transmit image frame data 3 to the on-chip system. Since the VC identifier in the image frame data 3 is VC0, the on-chip sensor can determine that the image frame data 3 is non-snapshot frame data. The image sensor can transmit image frame data 4 to the on-chip system. Since the VC identifier in the image frame data 4 is VC1, the on-chip sensor can determine that the image frame data 4 is snapshot frame data. From Figure 6 It can be seen that since the image sensor adjusts the exposure parameters at a preset period and obtains the captured frame data according to the preset exposure parameters, the VC identifier in the image frame data received by the on-chip system also presents a regularity of the preset period.

[0126] exist Figure 7 In the example, the image sensor can capture images when the capture conditions are met. The image sensor sets the VC identifier of the image frame data obtained at the capture time to VC1, and sets the VC identifier of the image frame data obtained at the non-capture time to VC0. Figure 7As shown, the image sensor can transmit image frame data 5 to the system on chip. Since the VC identifier in the image frame data 5 is VC0, the system on chip can determine that the image frame data 5 is non-snapshot frame data. Similarly, the image sensor can transmit image frame data 6 to the system on chip. Since the VC identifier in the image frame data 6 is VC0, the on-chip sensor can determine that the image frame data 6 is non-snapshot frame data. The image sensor can transmit image frame data 7 to the system on chip. Since the VC identifier in the image frame data 7 is VC1, the on-chip sensor can determine that the image frame data 7 is snapshot frame data. The image sensor can transmit image frame data 8 to the system on chip. Since the VC identifier in the image frame data 8 is VC0, the on-chip sensor can determine that the image frame data 8 is non-snapshot frame data.

[0127] In an embodiment of the present application, the image sensor can directly add snapshot identification information to the obtained image frame data, so that the on-chip system can directly receive the image frame data containing the snapshot identification information, and then directly identify the snapshot frame data and non-snapshot frame data, thereby improving the recognition accuracy.

[0128] Figure 8 It is a structural schematic diagram of the image frame data recognition device provided in an embodiment of the present application. Figure 8 The device 800 includes an acquisition module 810 and a processing module 820. Figure 8 The device 800 is used to implement the above Figure 4 or Figure 5 The functionality of an image sensor or system on chip in the illustrated method embodiment.

[0129] When the device 800 is used to implement Figure 4 or Figure 5 The functions of the image sensor in the method embodiment shown are: the acquisition module 810 is used to acquire image frame data; the processing module 820 is used to set snapshot identification information in the image frame data, the snapshot identification information is used to indicate whether the image frame data is snapshot frame data or non-snap frame data, and transmit the image frame data to the on-chip system. Figure 4 or Figure 5 The image frame data and snapshot identification information are similar and will not be repeated here.

[0130] In some embodiments, when the apparatus 800 is used to implement Figure 4 or Figure 5 The functions of the image sensor in the method embodiment shown are: the acquisition module 810 is specifically used to obtain the first image frame data according to the first exposure parameter when the snapshot condition is met; the processing module 820 is specifically used to set the first snapshot identification information in the first image frame data. Figure 4 or Figure 5 The capture conditions, the first exposure parameters, and the first image frame data are similar and will not be repeated here.

[0131] In some embodiments, when the apparatus 800 is used to implement Figure 4 or Figure 5 The functions of the image sensor in the method embodiment shown are: the acquisition module 810 is specifically used to obtain the second image frame data according to the second exposure parameter when the snapshot condition is not met; the processing module 820 is specifically used to set the second snapshot identification information in the second image frame data. Figure 4 or Figure 5 The second exposure parameter and the second image frame data are similar and will not be described again here.

[0132] When the device 800 is used to implement Figure 4 or Figure 5 The functions of the system on chip in the method embodiment shown are as follows: the acquisition module 810 is used to receive image frame data from the image sensor, and the image frame data includes snapshot identification information; the processing module 820 is used to determine whether the image frame data is snapshot frame data or non-snapshot frame data according to the snapshot identification information. Figure 4 or Figure 5 The image frame data and snapshot identification information are similar and will not be repeated here.

[0133] In some embodiments, when the apparatus 800 is used to implement Figure 4 or Figure 5 The function of the system on chip in the method embodiment shown is: the processing module 820 is also used to send the first exposure parameter and / or the second exposure parameter. Figure 4 or Figure 5 The first exposure parameter and the second exposure parameter in are similar and will not be described again here.

[0134] In some embodiments, when the apparatus 800 is used to implement Figure 4 or Figure 5 The function of the system on chip in the method embodiment shown is: the processing module 820 is also used to send a capture control signal. Figure 4 or Figure 5 The capture control signal is similar to that in , and will not be repeated here.

[0135] For more detailed description of the acquisition module 810 and the processing module 820, refer to Figure 4 or Figure 5 Related description in the method embodiment shown.

[0136] Fig. 9It is a structural block diagram of an electronic device provided according to an embodiment of the present application. Fig. 9 The electronic device 900 shown includes: a processor 901 , a memory 902 , and a communication interface 903 . The processor 901 , the memory 902 , and the communication interface 903 communicate with each other via a bus 904 .

[0137] In some embodiments, the electronic device 600 may further include a receiver and / or a transmitter. The receiver is used to receive information or data from other devices, and the transmitter is used to send information or data stored in the memory 902 to other devices. The other devices are devices connected to the electronic device 600.

[0138] The method disclosed in the above embodiment of the present invention can be applied to the processor 901, or implemented by the processor 901. The processor 901 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 901 or the instructions in the form of software. The processor 901 can implement or execute the methods, steps and logic block diagrams disclosed in the embodiment of the present invention. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present invention can be directly embodied as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software module can be located in the memory 902. The processor 901 reads the instructions in the memory 902 and completes the steps of the above method in combination with its hardware.

[0139] The memory 902 may store instructions for executing the methods in the above-described embodiments. The memory 902 may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Among them, the nonvolatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct rambus DRAM (DRDRAM). It should be noted that the memory of the system and method described herein is intended to include but is not limited to these and any other suitable types of memory. The processor 901 can execute the instructions stored in the memory 902 and complete the steps in the above embodiments in combination with other hardware. The specific working process and beneficial effects can refer to the description in the above embodiments.

[0140] In addition to the data bus, the bus 904 may also include a power bus, a control bus, a status signal bus, etc. However, for the sake of clarity, various buses are labeled as the bus 904 in the figure.

[0141] An embodiment of the present application further provides an image frame data recognition system, which includes the image sensor and the system on chip described in the above embodiment.

[0142] In some embodiments, the image frame data recognition system may further include: Figure 1 FPGA 130 in.

[0143] The present application also provides a chip system, which includes a logic circuit, which is used to couple with an input / output interface and transmit data through the input / output interface to execute the above embodiment. Figure 4 or Figure 5 The various steps included in.

[0144] According to the method provided in the embodiments of the present application, the present application also provides a computer program product, which includes: a computer program code, when the computer program code is run on a computer, the computer executes each step in the above embodiments.

[0145] The embodiment of the present application also provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the following Figure 4 or Figure 5 The various steps included in.

[0146] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0147] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0148] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0149] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0150] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0151] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0152] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for identifying image frame data, characterized in that: include: The image sensor obtains image frame data; The image sensor sets snapshot identification information in the image frame data, and the snapshot identification information is used to indicate whether the image frame data is snapshot frame data or non-snap frame data; The image sensor transmits the image frame data to a system on chip (SOC).

2. The method according to claim 1, characterized in that When the image frame data is transmitted via the mobile industry processor interface MIPI transmission protocol, the snapshot identification information is set in a virtual channel VC identifier.

3. The method according to claim 1, characterized in that When the image frame data is transmitted via a low voltage differential signal (LVDS) transmission protocol, the snapshot identification information is set in a synchronization code.

4. The method according to any one of claims 1 to 3, characterized in that The snapshot identification information is set in the blanking line data of the image frame data, and / or the snapshot identification information is set in the pixel value of a preset pixel of the image frame data.

5. The method according to any one of claims 1 to 4, characterized in that The snapshot identification information includes first snapshot identification information, and the image sensor obtains image frame data, including: When the snapshot condition is met, the image sensor obtains first image frame data according to a first exposure parameter, where the first exposure parameter is an exposure parameter when the snapshot condition is met; The image sensor sets the capture identification information in the image frame data, including: The image sensor sets the first snapshot identification information in the first image frame data, and the first snapshot identification information is used to indicate that the first image frame data is the snapshot frame data.

6. The method according to claim 5, characterized in that The snapshot identification information further includes second snapshot identification information, and the method further includes: When the snapshot condition is not met, the image sensor obtains second image frame data according to a second exposure parameter, where the second exposure parameter is an exposure parameter when the snapshot condition is not met, and the second exposure parameter is different from the first exposure parameter; The image sensor sets the capture identification information in the image frame data, including: The image sensor sets the second snapshot identification information in the second image frame data, and the second snapshot identification information is used to indicate that the second image frame data is non-snapshot frame data.

7. The method according to claim 5 or 6, characterized in that: The capture condition includes at least one of the following: receiving the first exposure parameter, reaching a preset time, receiving a capture control signal, and the presence of an object meeting the preset condition in the captured picture.

8. A method for identifying image frame data, characterized in that: include: The system on chip (SOC) receives image frame data from an image sensor, wherein the image frame data includes snapshot identification information, and the snapshot identification information is used to indicate whether the image frame data is snapshot frame data or non-snap frame data; The system on chip (SOC) determines whether the image frame data is captured frame data or non-captured frame data according to the capture identification information.

9. The method according to claim 8, characterized in that When the image frame data is transmitted via the mobile industry processor interface MIPI transmission protocol, the snapshot identification information is set in a virtual channel VC identifier.

10. The method according to claim 8, characterized in that When the image frame data is transmitted via a low voltage differential signal (LVDS) transmission protocol, the snapshot identification information is set in a synchronization code.

11. The method according to any one of claims 8 to 10, characterized in that The snapshot identification information is set in the blanking line data of the image frame data, and / or the snapshot identification information is set in the pixel value of a preset pixel of the image frame data.

12. The method according to any one of claims 8 to 11, characterized in that The method further comprises: Send a first exposure parameter and / or a second exposure parameter, where the first exposure parameter is an exposure parameter when a snapshot condition is met, and the second exposure parameter is an exposure parameter when the snapshot condition is not met, and the second exposure parameter is different from the first exposure parameter.

13. The method according to claim 12, characterized in that The capture condition includes at least one of the following: the image sensor receives the first exposure parameter, a preset time is reached, the image sensor receives a capture control signal, and an object that meets the preset condition exists in the picture captured by the image sensor.

14. The method according to any one of claims 8 to 13, characterized in that The method further comprises: A capture control signal is sent, where the capture control signal is used to instruct the image sensor to acquire capture frame data.

15. An image frame data recognition device, characterized in that: include: An acquisition module, used for obtaining image frame data; A processing module, used for setting snapshot identification information in the image frame data, wherein the snapshot identification information is used for indicating whether the image frame data is snapshot frame data or non-snap frame data; The processing module is also used to transmit the image frame data to a system on chip (SOC).

16. The device according to claim 15, characterized in that When the image frame data is transmitted via the mobile industry processor interface MIPI transmission protocol, the snapshot identification information is set in a virtual channel VC identifier.

17. The device according to claim 15, characterized in that When the image frame data is transmitted via a low voltage differential signal (LVDS) transmission protocol, the snapshot identification information is set in a synchronization code.

18. The device according to any one of claims 15 to 17, characterized in that The snapshot identification information is set in the blanking line data of the image frame data, and / or the snapshot identification information is set in the pixel value of a preset pixel of the image frame data.

19. The device according to any one of claims 15 to 18, characterized in that The capture identification information includes first capture identification information, and the acquisition module is specifically used to obtain first image frame data according to a first exposure parameter when the capture condition is met, and the first exposure parameter is an exposure parameter when the capture condition is met; The processing module is specifically used to set the first snapshot identification information in the first image frame data, and the first snapshot identification information is used to indicate that the first image frame data is the snapshot frame data.

20. The device according to claim 19, characterized in that The capture identification information also includes second capture identification information, and the acquisition module is further used to obtain second image frame data according to a second exposure parameter when the capture condition is not met, wherein the second exposure parameter is an exposure parameter when the capture condition is not met, and the second exposure parameter is different from the first exposure parameter; The processing module is further used to set the second snapshot identification information in the second image frame data, and the second snapshot identification information is used to indicate that the second image frame data is non-snapshot frame data.

21. The device according to claim 19 or 20, characterized in that The capture condition includes at least one of the following: receiving the first exposure parameter, reaching a preset time, receiving a capture control signal, and the presence of an object meeting the preset condition in the captured picture.

22. An image frame data recognition device, characterized in that: include: An acquisition module, used for receiving image frame data from an image sensor, wherein the image frame data includes snapshot identification information, and the snapshot identification information is used for indicating whether the image frame data is snapshot frame data or non-snap frame data; The processing module is used to determine whether the image frame data is captured frame data or non-captured frame data according to the captured identification information.

23. The device according to claim 22, characterized in that When the image frame data is transmitted via the mobile industry processor interface MIPI transmission protocol, the snapshot identification information is set in a virtual channel VC identifier.

24. The device according to claim 22, characterized in that When the image frame data is transmitted via a low voltage differential signal (LVDS) transmission protocol, the snapshot identification information is set in a synchronization code.

25. The device according to any one of claims 22 to 24, characterized in that The snapshot identification information is set in the blanking line data of the image frame data, and / or the snapshot identification information is set in the pixel value of a preset pixel of the image frame data.

26. The device according to any one of claims 22 to 25, characterized in that The processing module is also used to send a first exposure parameter and / or a second exposure parameter, where the first exposure parameter is an exposure parameter when a snapshot condition is met, and the second exposure parameter is an exposure parameter when the snapshot condition is not met, and the second exposure parameter is different from the first exposure parameter.

27. The device according to claim 26, characterized in that The capture condition includes at least one of the following: the image sensor receives the first exposure parameter, a preset time is reached, the image sensor receives a capture control signal, and an object that meets the preset condition exists in the picture captured by the image sensor.

28. The device according to any one of claims 22 to 27, characterized in that The processing module is further used to send a capture control signal, and the capture control signal is used to instruct the image sensor to capture.

29. An image frame data recognition system, characterized in that: Comprising the device as claimed in any one of claims 15 to 21 and the device as claimed in any one of claims 22 to 28.

30. An electronic device, characterized in that: The system comprises a processor, wherein the processor is coupled to a memory, and is configured to read and execute instructions and / or program codes in the memory, so as to perform the method according to any one of claims 1 to 14.

31. A chip system, characterized in that: include: A logic circuit, the logic circuit is used to be coupled to an input / output interface, and transmit data through the input / output interface to execute the method according to any one of claims 1 to 14.

32. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method according to any one of claims 1 to 14.

Images