Image acquisition method, circuit, device, electronic device and storage medium

Abstract

The present disclosure provides an image acquisition method, circuit, device, electronic device and storage medium, and relates to the field of image processing technology. The above method includes: detecting the first pixel of an image frame for video signals output by at least two sensors respectively; if the first pixel of an image frame is detected for the video signal output by any of the at least two sensors, starting to count the video signal; if the number obtained by the count reaches a preset number, re-detecting the first pixel of the image frame for the video signals output by at least two sensors; for each of the at least two sensors, if the first pixel of the video signal is detected, storing the image frame output by the sensor. The present disclosure can avoid the problem of the inability to align the video signals of each sensor and the poor real-time performance when multiple sensors are required to simultaneously acquire the same scene by detecting the first pixel of the image frame twice.

Description

Technical Field

[0001] The present disclosure relates to the field of image processing technology, and in particular to an image acquisition method, circuit, device, electronic device and storage medium. Background Art

[0002] In the process of video processing, the resolution of a single image processor is not enough, and multiple image processors need to be used to collect video data for processing in a splicing manner. In this method, if the sensors of the acquisition circuits corresponding to the multiple image processors cannot be aligned, then the video frames spliced ​​from the collected video data may have "tearing" and other problems that affect the video quality.

[0003] In related technologies, the sensors can be time-aligned with each other, and then each sensor embeds a timestamp in each frame of video it captures. In post-processing, the image frames captured by different sensors are aligned by comparing the timestamps in different sensors. However, this process is heavily dependent on post-processing, and the alignment technology cannot be performed in a timely manner, resulting in poor real-time performance. Summary of the invention

[0004] In view of this, the purpose of the present disclosure is to propose an image acquisition method, circuit, device, electronic device and storage medium, which can solve the existing problems in a targeted manner.

[0005] Based on the above-mentioned purpose, in a first aspect, the present disclosure proposes an image acquisition method, comprising: detecting the first pixel of an image frame for video signals output by at least two sensors respectively; if the first pixel of an image frame is detected for the video signal output by any one of the at least two sensors, starting to count the video signal; if the number obtained by the count reaches a preset number, re-detecting the first pixel of the image frame for the video signals output by the at least two sensors; for each of the at least two sensors, if the first pixel of the video signal is detected, storing the image frame output by the sensor.

[0006] In a second aspect, an image acquisition circuit is also provided, and the acquisition circuit includes: at least two sensors, at least two registers respectively connected to the at least two sensors, a counter connected to the at least two registers, and a memory connected to the counter; the at least two registers are used to respectively receive the video signals output by the at least two sensors, and output a counting start signal if the first pixel of the image frame is detected for the video signal; the counter is used to start counting the video signal if the counting start signal is received, and output a detection signal to the at least two registers if the counting result reaches a preset number; the at least two registers are also used to re-detect the first pixel of the image frame for the video signal output by the at least two sensors if the detection signal is received, and transfer the image frame to the memory if the first pixel of the image frame is detected; the memory is used to store the image frame from the at least two registers.

[0007] According to a third aspect, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method described in the first aspect.

[0008] According to a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and the computer program is executed by a processor to implement any method described in the first aspect.

[0009] In a fifth aspect, a computer program product is also provided, including a computer program, wherein the computer program is executed by a processor to implement any method described in the first aspect.

[0010] In general, the present disclosure has at least the following beneficial effects: by detecting the first pixel of the image frame twice, the problem of the video signals of each sensor being unable to be aligned and having poor real-time performance when multiple sensors are required to simultaneously capture the same scene is avoided. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the multiple drawings represent the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings only depict some embodiments disclosed in accordance with the present disclosure and should not be regarded as limiting the scope of the present disclosure.

[0012] Figure 1 A schematic diagram showing an output signal of a sensor according to an embodiment of the present disclosure;

[0013] Figure 2 A flow chart of an image acquisition method according to an embodiment of the present disclosure is shown;

[0014] Figure 3 A schematic diagram of an image acquisition circuit according to an embodiment of the present disclosure is shown;

[0015] Figure 4 A schematic diagram of an image acquisition device according to an embodiment of the present disclosure is shown;

[0016] Figure 5 A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure is shown;

[0017] Figure 6 A schematic diagram of a storage medium provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0018] The present disclosure is further described in detail below in conjunction with the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It is also necessary to explain that, for ease of description, only the parts related to the relevant invention are shown in the accompanying drawings.

[0019] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0020] Each sensor has its own output signal to the acquisition circuit, which are clock (clk), data (data) and the first pixel, and the first pixel arrives at the same time as the rising edge.

[0021] Because multiple sensors are involved, their output signals will most likely not reach the edge of the acquisition chip at the same time. However, due to the existence of the system synchronization mechanism, these signals will definitely be close to each other (for example, a few clock cycles to dozens of clock cycles are possible). This situation can be called loose synchronization. For such a loosely synchronized system, the acquisition side circuit must use certain strategies to achieve synchronous acquisition. The acquisition circuit must first capture the rising edge of the frame header before it can start storing data, otherwise the captured data will be incomplete. Figure 1 As shown, if the start time of acquisition is between T0 and T1 shown in the figure, it is possible that only the second sensor sensor2 captures the first pixel of the image frame, while sensor1, sensor3 and sensor4 will miss the first pixel, resulting in asynchrony between the multiple groups of image frames captured by each sensor.

[0022] Figure 2 The image acquisition method of the present disclosure is shown. In an embodiment of the present disclosure, the method includes:

[0023] Step S201 : detecting the first pixel of an image frame of video signals output by at least two sensors respectively.

[0024] Step S202: if the first pixel of an image frame is detected in the video signal output by any sensor of the at least two sensors, start counting the video signal.

[0025] Step S203: if the counted number reaches a preset number, re-detect the first pixel of the image frame of the video signals output by at least two sensors.

[0026] Step S204: for each sensor of the at least two sensors, if the first pixel of the video signal is detected, the image frame output by the sensor is stored.

[0027] In this embodiment, the execution subject of the image acquisition method can detect the first pixel of each image frame for the first time at any time, and re-detect the first pixel of the image frame after detecting and counting a preset number. The above-mentioned preset number can be any value less than the number of video signals corresponding to one image frame.

[0028] In some optional implementations of this embodiment, if the counted number reaches a preset number, it may include: if the counted number is greater than half of the number of video signals corresponding to one image frame.

[0029] In this implementation, the above-mentioned preset number may be half of the number of video signals corresponding to one image frame.

[0030] This embodiment detects the first pixel of the image frame twice, thereby avoiding the problem that the video signals of each sensor cannot be aligned and the real-time performance is poor when multiple sensors are required to simultaneously capture the same scene.

[0031] In some optional implementations of any embodiment of the present disclosure, if a target level signal is detected for an image frame output by any one of the at least two sensors, the target level signal is output to a counter to start the counter to start counting, wherein the target level signal is a high level or a low level.

[0032] In some optional implementations of any embodiment of the present disclosure, if the number obtained by counting reaches a preset number, the first pixel of the image frame is re-detected for the video signals output by at least two sensors, including: if the number obtained by timing reaches the preset number, a target level signal is generated to trigger re-detection of the first pixel of the image frame for the video signals output by at least two sensors.

[0033] Figure 3 FIG. 2 shows an image acquisition circuit according to an embodiment of the present disclosure. Figure 3As shown, the image acquisition circuit includes: at least two sensors, at least two registers respectively connected to the at least two sensors, a counter connected to the at least two registers, and a memory connected to the counter; the at least two registers are used to respectively receive the video signals output by the at least two sensors, and output a counting start signal if the first pixel of the image frame is detected for the video signal; the counter is used to start counting the video signal if the counting start signal is received, and output a detection signal to the at least two registers if the counting result reaches a preset number; the at least two registers are also used to re-detect the first pixel of the image frame for the video signal output by the at least two sensors if the detection signal is received, and transmit the image frame to the memory if the first pixel of the image frame is detected; the memory is used to store the image frame from the at least two registers.

[0034] Optionally, the counter is further used to re-detect the first pixel of the image frame for the video signals output by at least two sensors if the counting time corresponding to the number obtained by counting is greater than half of the time taken to capture one image frame.

[0035] Optionally, the acquisition circuit also includes: a selector, wherein the at least two registers are connected to the selector through an OR gate; the at least two registers are also used to latch a target level signal; the OR gate is used to be in an on state when receiving a target level signal latched by any register, and transmit the target level signal to the selector; the selector is used to output the counting start signal to the counter if the target level signal is received.

[0036] like Figure 3 As shown, the strategy of the present disclosure is to start re-detecting the first pixel (i.e., the frame header) of the image frame at time T2, so that the first pixel of all sensors can be collected by the acquisition circuit. The selection strategy of time T2 is as follows: start detecting the first pixel from any time, rather than avoiding the period between T0 and T1. Start counting after detecting the first pixel of any sensor, and restart detecting the first pixel when the number of counted clocks corresponds to half of the time taken for a frame of image. This time, each sensor starts storing data as soon as it detects the first pixel.

[0037] The present disclosure provides an image acquisition device, which is used to execute the image acquisition method described in the above embodiment. Figure 4As shown, the device includes: a first detection unit 401, configured to detect the first pixel of an image frame for the video signals output by at least two sensors respectively; a counting unit 402, configured to start counting the video signal if the first pixel of the image frame is detected for the video signal output by any of the at least two sensors; a second detection unit 403, configured to re-detect the first pixel of the image frame for the video signals output by the at least two sensors if the number obtained by counting reaches a preset number; and a storage unit 404, configured to store the image frame output by each of the at least two sensors if the first pixel of the video signal is detected.

[0038] The image acquisition device provided by the above-mentioned embodiment of the present disclosure and the image acquisition method provided by the embodiment of the present disclosure are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.

[0039] The embodiment of the present disclosure also provides an electronic device corresponding to the image acquisition method provided in the above embodiment, so as to execute the above image acquisition method. The embodiment of the present disclosure is not limited.

[0040] Please refer to Figure 5 , which shows a schematic diagram of an electronic device provided by some embodiments of the present disclosure. Figure 5 As shown, the electronic device 50 includes: a processor 500, a memory 501, a bus 502 and a communication interface 503, and the processor 500, the communication interface 503 and the memory 501 are connected via the bus 502; the memory 501 stores a computer program that can be run on the processor 500, and the processor 500 executes the method provided in any of the aforementioned embodiments of the present disclosure when running the computer program.

[0041] The memory 501 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 503 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used.

[0042] The bus 502 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. The memory 501 is used to store programs, and the processor 500 executes the programs after receiving the execution instruction. The image acquisition method disclosed in any implementation of the aforementioned embodiment of the present disclosure may be applied to the processor 500, or implemented by the processor 500.

[0043] The processor 500 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 500 or the instruction in the form of software. The above processor 500 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present disclosure can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in conjunction with the embodiments of the present disclosure can be directly embodied as a hardware decoding processor to be executed, or a combination of hardware and software modules in the decoding processor can be executed. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 501, and the processor 500 reads the information in the memory 501 and completes the steps of the above method in combination with its hardware.

[0044] The electronic device provided by the embodiment of the present disclosure and the image acquisition method provided by the embodiment of the present disclosure are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by them.

[0045] The present disclosure also provides a computer-readable storage medium corresponding to the image acquisition method provided in the above embodiment. Figure 6 The computer-readable storage medium shown is a CD 60 on which a computer program (ie, a program product) is stored. When the computer program is run by a processor, the image acquisition method provided in any of the aforementioned embodiments will be executed.

[0046] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical or magnetic storage media, which are not listed here one by one.

[0047] The computer-readable storage medium provided by the above-mentioned embodiments of the present disclosure and the image acquisition method provided by the embodiments of the present disclosure are based on the same inventive concept, and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.

[0048] It should be noted that:

[0049] In the above text, the term "comprises", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be noted that the scope of the method and device in the embodiments of the present disclosure is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0050] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present disclosure, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present disclosure.

[0051] The embodiments of the present disclosure are described above in conjunction with the accompanying drawings, which are only specific implementation modes of the present disclosure. However, the present disclosure is not limited to the above-mentioned specific implementation modes. The above-mentioned specific implementation modes are merely illustrative and not restrictive. Under the guidance of the present disclosure, ordinary technicians in this field can also make many forms without departing from the purpose of the present disclosure and the scope of protection of the claims, all of which are within the protection of the present disclosure.

Claims

1. A method for collecting images, characterized in that: include: Detecting the first pixel of the image frame of the video signals output by at least two sensors respectively; If the first pixel of the image frame is detected in the video signal output by any sensor of the at least two sensors, start counting the video signal; If the counted number reaches a preset number, re-detecting the first pixel of the image frame of the video signals output by at least two sensors; For each of the at least two sensors, if a first pixel of a video signal is detected, an image frame output by the sensor is stored.

2. The method according to claim 1, characterized in that If the counted number reaches the preset number, including: If the counted number is greater than half of the number of video signals corresponding to one image frame.

3. The method according to claim 1, characterized in that The starting of counting of the video signal comprises: If a target level signal is detected for an image frame output by any one of the at least two sensors, the target level signal is output to a counter to start the counter to start counting, wherein the target level signal is a high level or a low level.

4. The method according to claim 1, characterized in that: If the counted number reaches a preset number, re-detecting the first pixel of the image frame of the video signals output by at least two sensors includes: If the number obtained by timing reaches the preset number, a target level signal is generated to trigger re-detection of the first pixel of the image frame of the video signals output by at least two sensors.

5. An image acquisition circuit, characterized in that: The acquisition circuit includes: at least two sensors, at least two registers respectively connected to the at least two sensors, a counter connected to the at least two registers, and a memory connected to the counter; The at least two registers are used to respectively receive the video signals output by the at least two sensors, and output a counting start signal if the first pixel of an image frame is detected for the video signal; The counter is configured to start counting of the video signal upon receiving the counting start signal, and output a detection signal to the at least two registers if the counting result reaches a preset number; The at least two registers are further used to, if the detection signal is received, re-detect the first pixel of the image frame of the video signals output by the at least two sensors, and if the first pixel of the image frame is detected, transmit the image frame to the memory; The memory is used to store the image frames from the at least two registers.

6. The acquisition circuit according to claim 5, characterized in that: The counter is further used to re-detect the first pixel of the image frame for the video signals output by at least two sensors if the counting time corresponding to the number obtained by counting is greater than half of the time taken to capture one image frame.

7. The acquisition circuit according to claim 6, characterized in that: Also includes: A selector, wherein the at least two registers are connected to the selector via an OR gate; The at least two registers are further used to latch the target level signal; The OR gate is used to be in a conducting state when receiving a target level signal latched by any register, and transmit the target level signal to the selector; The selector is used to output the counting start signal to the counter if the target level signal is received.

8. An image acquisition device, characterized in that: include: A first detection unit is configured to detect a first pixel of an image frame from video signals output by at least two sensors respectively; a counting unit configured to start counting the video signal if a first pixel of an image frame is detected for the video signal output by any one of the at least two sensors; A second detection unit is configured to re-detect the first pixel of the image frame of the video signals output by the at least two sensors if the counted number reaches a preset number; The storage unit is configured to store the image frame output by each sensor of the at least two sensors if the first pixel of the video signal is detected.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: The processor runs the computer program to implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the method according to any one of claims 1 to 7.

Images