Frame synchronization method, system, device and storage medium based on image data

By connecting multiple ISPs and image processing platforms in the synchronization control unit, using the synchronization request signal and frame transmission signal for timestamping, the problem of ISP type limitation and frame synchronization under the DVP interface in the prior art is solved, and the problem of the ISP type limitation and frame synchronization under the DVP interface cannot be achieved is realized. Efficient frame synchronization for multiple ISPs.

CN118678173BActive Publication Date: 2024-11-22SHENZHEN ZHONGXIN CHUANGZHAN TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411155670.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-22
Publication Date
2024-11-22
Estimated Expiration
2044-08-22

AI Technical Summary

Technical Problem

The existing frame synchronization method is difficult to apply to multiple types of image signal processors (ISPs), especially low-performance ISPs, and cannot achieve frame synchronization under the digital video port (DVP) interface.

Method used

By connecting at least two image signal processors and the image processing platform in the synchronization control unit, using the synchronization request signal and the frame transmission start/end signal for timestamping, generating a pulse width modulated signal for frame synchronization, which is suitable for various ISP types , does not rely on a specific sensor interface or powerful SOC-like ISP.

Benefits of technology

The frame synchronization of multiple types of ISPs is realized, which improves the applicability and efficiency of frame synchronization, avoids the problem that ISPs cannot time stamp images, and passes on the function of timestamp marking to a more powerful image processing platform.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118678173B_ABST
    Figure CN118678173B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides a frame synchronization method and system, device, and storage medium based on image data, which belongs to the field of communication technology. The method includes: at the start time of the frame when the first image signal processor transmits the first image data, receiving a first synchronization request signal sent by the first image signal processor; sending a first target chip select signal and a frame transmission start signal corresponding to the first synchronization request to the image processing platform; at the end time of the frame when the first image signal processor transmits the first image data, receiving a second synchronization request signal sent by the first image signal processor; based on the second synchronization request signal, sending a frame transmission end signal to the image processing platform, so as to timestamp the first image data according to the received frame transmission start signal and frame transmission end signal. The embodiment of the present application can be applied to the frame synchronization of various ISPs, improve the applicability of frame synchronization based on image data, and ensure the efficiency of frame synchronization.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a frame synchronization method and system, device, and storage medium based on image data. Background Art

[0002] Frame synchronization is a method to ensure data synchronization, that is, both the sender and the receiver can process data at a predetermined frame rate to ensure that the data of both parties remains consistent. In the current multi-camera application scenarios of image acquisition and processing systems, such as robot vision, panoramic video, augmented reality, and autonomous driving, frame synchronization based on image data is becoming increasingly important.

[0003] At present, the frame synchronization method of the related technology usually adopts the method of adding timestamps, that is, the image signal processor (ISP) can add the corresponding time in each frame of the image when outputting the image data, and the back-end system determines the real-time nature of the image according to the timestamp of each frame of the image; or, the frame synchronization function of the image sensor itself, such as vertical synchronization (VSync, also known as vertical synchronization), can be used, and the data between multiple sensors can be synchronized by relying on the VSync signal. However, for the first method, it can only be adapted to ISPs of the system-on-chip (SOC) type with powerful performance, and it is required that it has a very accurate time scale, and it cannot be applied to more types of ISPs. For the second method, since VSync can only be used through the mobile industry processor interface (MIPI interface) and ISP connection, if the digital video port (DVP interface) is used to connect to the ISP, the frame synchronization function cannot be used. Therefore, how to provide a frame synchronization method based on image data that can be applied to various types of ISPs and ensure the efficiency of frame synchronization has become a technical problem that needs to be solved urgently. Summary of the invention

[0004] The main purpose of the embodiments of the present application is to propose a frame synchronization method and system, device, and storage medium based on image data, which can be applicable to frame synchronization of various types of ISPs, improve the applicability of frame synchronization based on image data, and ensure the efficiency of frame synchronization.

[0005] To achieve the above-mentioned purpose, a first aspect of an embodiment of the present application proposes a frame synchronization method based on image data, which is applied to a synchronization control unit, wherein the synchronization control unit is respectively connected to at least two image signal processors and an image processing platform for communication, and each of the image signal processors is connected to the image processing platform for communication, and the method includes:

[0006] At the start time of a frame in which the first image data is transmitted by the first image signal processor, a first synchronization request signal sent by the first image signal processor is received; wherein the first synchronization request signal is a signal generated by the first image signal processor in response to a received frame synchronization signal, and the frame synchronization signal is a signal generated by the image processing platform to start a frame synchronization function;

[0007] Determine a first target chip select signal corresponding to the first synchronization request, and send the first target chip select signal and a corresponding frame transmission start signal to the image processing platform; wherein the first target chip select signal is in a first level state, and the image processing platform is used to determine an image signal processor corresponding to the first synchronization request according to the first level state;

[0008] At the end moment of the frame in which the first image data is transmitted by the first image signal processor, receiving a second synchronization request signal sent by the first image signal processor; wherein the second synchronization request signal is a signal generated by the first image signal processor based on the corresponding first frame parameter;

[0009] Based on the second synchronization request signal, a corresponding frame transmission end signal is sent to the image processing platform, so as to time-stamp the first image data according to the received frame transmission start signal and the frame transmission end signal.

[0010] In some embodiments, at the start time of a frame transmission of the first image data by the first image signal processor, before receiving a first synchronization request signal sent by the first image signal processor, the method further includes:

[0011] Acquire frame synchronization parameters of at least two of the image signal processors, the frame synchronization parameters including a target frame rate and a target frame number;

[0012] Determining pulse modulation parameters based on the target frame rate and the target number of frames;

[0013] A pulse width modulation signal is generated based on the pulse modulation parameter, and the pulse width modulation signal is sent to each of the image signal processors for pulse width modulation.

[0014] In some embodiments, receiving a first synchronization request signal sent by the first image signal processor at the start time of a frame in which the first image data is transmitted by the first image signal processor includes:

[0015] Determine an edge signal of the pulse width modulation signal in the level conversion process as a trigger signal, and trigger the transmission of the first image data to the image processing platform when each trigger signal is generated;

[0016] After the first image signal processor receives the trigger signal, a first synchronization request signal sent by the first image signal processor is received.

[0017] In some embodiments, the method further comprises:

[0018] At the start time of a frame in which the second image signal processor transmits the second image data, receiving a third synchronization request signal sent by the second image signal processor; wherein the third synchronization request signal is a signal generated by the second image signal processor in response to the received frame synchronization signal;

[0019] Determine a second target chip select signal corresponding to the third synchronization request, and send the second target chip select signal and a corresponding frame transmission start signal to the image processing platform; wherein the second target chip select signal is in a second level state, and the image processing platform is used to determine an image signal processor corresponding to the second synchronization request according to the second level state;

[0020] At the end time of the frame in which the second image data is transmitted by the second image signal processor, receiving a fourth synchronization request signal sent by the second image signal processor; wherein the fourth synchronization request signal is a signal generated by the second image signal processor based on the corresponding second frame parameter;

[0021] Based on the fourth synchronization request signal, a corresponding frame transmission end signal is sent to the image processing platform, so as to time-stamp the second image data according to the received frame transmission start signal and the frame transmission end signal.

[0022] In some embodiments, before determining the first target chip select signal corresponding to the first synchronization request and sending the first target chip select signal and the corresponding frame transmission start signal to the image processing platform, the method further includes:

[0023] When synchronization request signals sent by at least two image signal processors are received simultaneously, obtaining processor configuration parameters of each image signal processor;

[0024] Arrange the synchronization request signals of at least two image signal processors based on the processor configuration parameters to obtain a signal list;

[0025] Based on the signal list, synchronization request signals of at least two image signal processors and corresponding frame transmission start signals are sent to the image processing platform in sequence.

[0026] In some embodiments, the frame synchronization signal is generated by:

[0027] Performing interface detection on the image signal processor performing image data transmission to obtain an interface type;

[0028] The frame synchronization signal is generated based on the interface type and the corresponding interface protocol.

[0029] In some embodiments, determining a first target chip select signal corresponding to the first synchronization request includes:

[0030] constructing a chip select signal group based on the number of the image signal processors, the chip select signal group including a plurality of candidate chip select signals;

[0031] The first target chip select signal is determined from the candidate chip select signals based on the index number of the first image signal processor.

[0032] To achieve the above object, a second aspect of an embodiment of the present application proposes a frame synchronization system based on image data, the system comprising:

[0033] An image processing platform, used for generating a frame synchronization signal and sending the frame synchronization signal to at least two image signal processors; wherein the frame synchronization signal is a signal for starting a frame synchronization function;

[0034] at least two image signal processors, configured to send a first synchronization request signal to a synchronization control unit at a start time of a frame of first image data transmitted by the first image signal processor, and the at least two image signal processors are further configured to send a second synchronization request signal to the synchronization control unit at a finish time of a frame of the first image data transmitted by the first image signal processor; wherein the first synchronization request signal is a signal generated by the first image signal processor in response to the received frame synchronization signal, and the second synchronization request signal is a signal generated by the first image signal processor based on a corresponding first frame parameter;

[0035] A synchronization control unit, used to receive the first synchronization request signal, determine the first target chip select signal corresponding to the first synchronization request, and send the first target chip select signal and the corresponding frame transmission start signal to the image processing platform. The synchronization control unit is also used to receive the second synchronization request signal, and based on the second synchronization request signal, send the corresponding frame transmission end signal to the image processing platform, so as to timestamp the first image data according to the received frame transmission start signal and the frame transmission end signal; wherein the first target chip select signal is in a first level state, and the image processing platform is used to determine the image signal processor corresponding to the first synchronization request according to the first level state.

[0036] To achieve the above objective, a third aspect of an embodiment of the present application provides a computer device, including:

[0037] at least one memory;

[0038] at least one processor;

[0039] at least one computer program;

[0040] The at least one computer program is stored in the at least one memory, and the at least one processor executes the at least one computer program to implement the method described in the first aspect above.

[0041] To achieve the above-mentioned purpose, the fourth aspect of the embodiments of the present application proposes a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program is used to enable a computer to execute the method described in the first aspect above.

[0042] The frame synchronization method and system, device, and storage medium based on image data proposed in the embodiments of the present application receive a first synchronization request signal sent by the first image signal processor at the start time of a frame when the first image signal processor transmits the first image data. The first synchronization request signal is a signal generated by the first image signal processor in response to the received frame synchronization signal. The frame synchronization signal is a signal generated by the image processing platform to start the frame synchronization function; further, determine a first target chip select signal corresponding to the first synchronization request, and send the first target chip select signal and the corresponding frame transmission start signal to the image processing platform. The first target chip select signal is in a first level state, and the image processing platform is used to determine the image signal processor corresponding to the first synchronization request according to the first level state; further, at the end time of the frame when the first image signal processor transmits the first image data, receive a second synchronization request signal sent by the first image signal processor. The second synchronization request signal is a signal generated by the first image signal processor based on the corresponding first frame parameter; further, send a corresponding frame transmission end signal to the image processing platform based on the second synchronization request signal, so as to timestamp the first image data according to the received frame transmission start signal and frame transmission end signal. The embodiment of the present application connects at least two image signal processors with an image processing platform through a synchronization control unit, and sends a corresponding frame transmission start signal and a frame transmission end signal to the image processing platform based on the received synchronization request signal, so as to realize the timestamp marking of the image data for frame synchronization. Compared with the related art, the method provided by the present application does not rely on a specific sensor interface for frame synchronization, and does not rely on a powerful SOC-type ISP, and can be applied to the frame synchronization of various types of ISPs, thereby improving the applicability of frame synchronization based on image data and ensuring the efficiency of frame synchronization. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 is a structural diagram of a frame synchronization system based on image data provided by an embodiment of the present application;

[0044] Figure 2 This is a first flow chart of a frame synchronization method based on image data provided by an embodiment of the present application;

[0045] Figure 3 yes Figure 2 A flowchart of step S210 in FIG.

[0046] Figure 4 is a second flow chart of a frame synchronization method based on image data provided in an embodiment of the present application;

[0047] Figure 5 yes Figure 2 A flowchart of step S220 in FIG.

[0048] Figure 6 is a third flow chart of a frame synchronization method based on image data provided in an embodiment of the present application;

[0049] Figure 7 It is a hardware structure diagram of the computer device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0051] It should be noted that, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first", "second", etc. in the specification, claims and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0052] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0053] First, some nouns involved in this application are analyzed:

[0054] Frame rate: refers to the number of frames displayed per second in a video or animation. Frame rate indicates the smoothness and continuity of media display. Frame rate is usually expressed in "fps" (Frames Per Second). Frame rate defines how many still images (frames) are displayed in one second, and these images are played in a continuous manner, so that the human eye perceives a dynamic effect.

[0055] Mobile Industry Processor Interface (MIPI): is a serial interface standard for mobile devices, mainly used to connect various chips and sensors inside mobile devices, such as displays, cameras, touch screens, memory, etc.

[0056] Image Signal Processor (ISP): It is a device used to process the image signal output by the image signal sensor. It occupies a core and dominant position in the camera system and is an important device in the camera.

[0057] Vertical synchronization (VSync, also known as vertical synchronization): is a technology used to synchronize the graphics rendering of video display with the refresh rate of the display device to avoid screen tearing.

[0058] Digital Video Port (DVP interface): is a digital video interface standard, mainly used for parallel transmission of video and image signals in electronic devices. The DVP interface transmits image data through a set of parallel signal lines, including data lines, synchronization signal lines, and control signal lines.

[0059] Frame synchronization is a method to ensure data synchronization, that is, both the sender and the receiver can process data at a predetermined frame rate to ensure that the data of both parties are consistent. In the current multi-camera application scenarios of image acquisition and processing systems, such as robot vision, panoramic video, augmented reality, and autonomous driving, due to problems such as signal transmission delay and asynchrony in the multi-camera system, image misalignment and misaligned splicing (referring to the two cameras due to asynchrony in exposure time, or due to transmission delay, the platform receives two frames of data, and there is an obvious position or time error) often lead to asynchrony between image frames. Ensuring that the final output image data is strictly synchronized in time can improve the accuracy and efficiency of image processing, and also ensure that the system obtains the accurate frame time of a single camera. Therefore, frame synchronization based on image data is becoming more and more important.

[0060] At present, the frame synchronization method of the related technology usually adopts the method of adding timestamps, that is, the image signal processor (ISP) can add the corresponding time in each frame of the image when outputting the image data, and the back-end system determines the real-time nature of the image according to the timestamp of each frame of the image; or, the frame synchronization function of the image sensor itself can be used without relying on the external ISP and system, such as vertical synchronization (VSync, also known as vertical synchronization). When the sensor outputs the image data, it relies on the VSync signal to synchronize the data between multiple sensors. However, for the first method, it can only be adapted to the ISP of the system-on-chip (SOC) type with powerful performance, and it is required that it has its own very accurate time scale, and the ISP manufacturer needs to open the interface of the image software coding to achieve it. If the ISP based on C51 is used, or the ISP manufacturer has not developed the image software coding (and, most manufacturers currently have not developed the image software coding), then it is impossible to insert the timestamp in the image and realize the frame synchronization function. Therefore, this method cannot be applied to more types of ISPs. For the second method, since VSync can only be used through the Mobile Industry Processor Interface (MIPI interface) and ISP connection, if the Digital Video Port (DVP interface) is used to connect to the ISP, the frame synchronization function cannot be used. Therefore, how to provide a frame synchronization method based on image data that can be applied to various types of ISPs and ensure the efficiency of frame synchronization has become a technical problem that needs to be solved urgently.

[0061] Based on this, the embodiments of the present application provide a frame synchronization method and system, device, and storage medium based on image data, which can be applicable to frame synchronization of various types of ISPs, improves the applicability of frame synchronization based on image data, and ensures the efficiency of frame synchronization.

[0062] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0063] AI basic technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics, etc. AI software technologies mainly include computer vision technology, robotics technology, biometrics technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0064] The frame synchronization method based on image data provided in the embodiment of the present application relates to the field of artificial intelligence technology. The frame synchronization method based on image data provided in the embodiment of the present application can be applied to a terminal, can also be applied to a server side, and can also be software running in a terminal or a server side. In some embodiments, the terminal can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc.; the server side can be configured as an independent physical server, or can be configured as a server cluster or a distributed system composed of multiple physical servers, and can also be configured as a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN) and big data and artificial intelligence platforms; the software can be an application that implements a frame synchronization method based on image data, etc., but is not limited to the above forms.

[0065] The present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network personal computers (Personal Computer, PC), minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0066] It should be noted that in each specific implementation of the present application, when it comes to the need to perform relevant processing based on data related to the user's identity or characteristics, such as user information, user image data, etc., the user's permission or consent will be obtained first, and the collection, use and processing of these data will comply with relevant laws, regulations and standards. In addition, when the embodiment of the present application needs to obtain the user's sensitive personal information, the user's separate permission or consent will be obtained through a pop-up window or jump to a confirmation page. After clearly obtaining the user's separate permission or consent, the necessary user-related data for the normal operation of the embodiment of the present application will be obtained.

[0067] See also Figure 1 , Figure 1 1 is an optional structural diagram of a frame synchronization system based on image data provided in an embodiment of the present application. The frame synchronization system 100 provided in an embodiment of the present application includes a synchronization control unit, at least two image signal processors and an image processing platform. The synchronization control unit is respectively connected to the at least two image signal processors and the image processing platform in communication, and each image signal processor is connected to the image processing platform in communication. It should be noted that: Figure 1 Only a scenario including two image signal processors (ISP-1 and ISP-2) is shown, and the following embodiments are all described in terms of a scenario with two image signal processors. However, the frame synchronization system 100 of the present application may also have three, four, etc. image signal processors without limitation.

[0068] See also Figure 2 , Figure 2 It is an optional flowchart of the frame synchronization method based on image data provided in an embodiment of the present application. Figure 2 The method may specifically include but is not limited to steps S210 to S240. Figure 2 These four steps are introduced in detail.

[0069] Step S210, receiving a first synchronization request signal sent by the first image signal processor at the start time of a frame of first image data transmitted by the first image signal processor;

[0070] Step S220, determining a first target chip select signal corresponding to the first synchronization request, and sending the first target chip select signal and a corresponding frame transmission start signal to the image processing platform;

[0071] Step S230, receiving a second synchronization request signal sent by the first image signal processor at the end time of the frame transmission of the first image data by the first image signal processor;

[0072] Step S240: Send a corresponding frame transmission end signal to the image processing platform based on the second synchronization request signal, so as to timestamp the first image data according to the received frame transmission start signal and frame transmission end signal.

[0073] In the above embodiment, the embodiment of the present application connects at least two image signal processors and the image processing platform through a synchronization control unit, and sends a corresponding frame transmission start signal and a frame transmission end signal to the image processing platform based on the received synchronization request signal, so as to realize the timestamp marking of the image data for frame synchronization. Compared with the related art, the method provided by the present application does not rely on a specific sensor interface for frame synchronization, and does not rely on a powerful SOC-type ISP, and is also applicable to a C51-type ISP with lower performance, that is, the present application can be applied to the frame synchronization of various types of ISPs, which improves the applicability of frame synchronization based on image data, and because the signals are all sent quickly, the efficiency of frame synchronization can be guaranteed.

[0074] In step S210 of some embodiments, the first image data refers to image data used by the first image signal processor for frame synchronization, the first synchronization request signal is a signal generated by the first image signal processor in response to a received frame synchronization signal, and the frame synchronization signal is a signal generated by the image processing platform to start the frame synchronization function. Specifically, the image processing platform will send a frame synchronization signal to each image signal processor to inform the corresponding image signal processor that the frame synchronization function needs to be started. The image signal processor may be an independent image device such as an ISP and a camera, which is used to output images, such as ISP-1, ISP-2, etc., which are not limited here. The first image signal processor is one of the at least two image signal processors that are communicatively connected to the synchronization control unit and the image processing platform. At this time, at the start moment of the frame when the first image signal processor transmits the first image data, the first synchronization request signal sent by the first image signal processor is received. Figure 1 As shown, when the image signal processor and the synchronization control unit are connected via a general-purpose input / output GPIO (General-Purpose Input / Output), and the first image signal processor is ISP-1, then at the start time of a frame in which the first image signal processor transmits the first image data, ISP-1 can send a first synchronization request signal to the synchronization control unit via GPIO-1.

[0075] It should be noted that the image processing platform can be a computer system, a host system, a tablet computer, etc., and the synchronization control unit can be set on the image signal processor or on the image processing platform, which is not limited here.

[0076] In some embodiments, the frame synchronization signal is generated by:

[0077] Performing interface detection on an image signal processor that transmits image data to obtain an interface type;

[0078] Generates a frame synchronization signal based on the interface type and the corresponding interface protocol.

[0079] In the above embodiment, since there are many types of image signal processors, such as MIPI, USB, analog high definition, etc., and different types may have different transmission protocols, how the ISP communicates with devices such as image sensors is determined. Therefore, according to the different interface types of the image signal processor, the image processing platform generates frame synchronization signals in different processes. For example, when the interface type is a USB video class (USB Video Class, UVC, a protocol standard defined for USB video capture devices) interface, the image processing platform generates a frame synchronization signal based on the UVC protocol. In addition, the frame synchronization signal generation process can also be based on a serial peripheral interface (Serial Peripheral interface, SPI) protocol, an asynchronous full-duplex serial communication protocol (Universal Asynchronous Receiver / Transmitter, UART), etc.

[0080] See also Figure 3 , Figure 3 is an optional flowchart of step S210 provided in the embodiment of the present application. Step S210 may specifically include but is not limited to steps S310 to S320. Figure 3 These two steps are introduced in detail.

[0081] Step S310, determining an edge signal of the pulse width modulation signal in the level conversion process as a trigger signal, and triggering the transmission of the first image data to the image processing platform when each trigger signal is generated;

[0082] Step S320: The first image signal processor receives a trigger signal and receives a first synchronization request signal sent by the first image signal processor.

[0083] In steps S310 to S320 of some embodiments, the synchronization control unit sends a periodic pulse width modulation signal (Pulse-Width Modulation, PWM) to each image signal processor for controlling the working state of each image signal processor. In addition, the synchronization control unit can flexibly control the start, shutdown or adjustment of the working mode of the image signal processor by adjusting the duty cycle of the PWM signal, thereby achieving precise control of image signal processing. The synchronization control unit determines that an edge signal of the pulse width modulation signal during the level conversion process is a trigger signal, such as determining that the trigger signal is a rising edge signal or a falling edge signal of the pulse width modulation signal. Further, when each image signal processor receives a trigger signal, such as a PWM rising edge signal, it is the frame start time that triggers the transmission of the first image data to the image processing platform, and can generate a first synchronization request signal containing frame start information. Further, the synchronization control unit can receive the first synchronization request signal sent by the first image signal processor.

[0084] In some embodiments, see Figure 4 , Figure 4 4 is another optional flow chart of the frame synchronization method based on image data provided by the embodiment of the present application. Before step S210, the frame synchronization method provided by the present application may also include but is not limited to steps S410 to S430. Figure 4 These three steps are introduced in detail.

[0085] Step S410, obtaining frame synchronization parameters of at least two image signal processors;

[0086] Step S420, determining pulse modulation parameters based on the target frame rate and the target number of frames;

[0087] Step S430 : generating a pulse width modulation signal based on the pulse modulation parameter, and sending the pulse width modulation signal to each image signal processor for pulse width modulation.

[0088] In steps S410 to S430 of some embodiments, the frame synchronization parameters include a target frame rate (i.e., the number of frames to be processed per second) and a target number of frames (which may be the total number of frames for frame synchronization or the total number of frames within a specific time), and pulse modulation parameters are determined based on the target frame rate and the target number of frames. The pulse modulation parameters may include the frequency and duty cycle of the pulses, thereby affecting the generation of a pulse width modulation signal (i.e., a PWM signal). Furthermore, a pulse width modulation signal is generated based on the pulse modulation parameters, and the pulse width modulation signal directly affects how the image signal processor processes the incoming image data. This PWM signal will be sent to each image signal processor so that it can perform synchronization processing according to the received PWM signal, realize coordinated processing and output of frames, and ensure that the entire image signal link can be accurately synchronized as expected. The present application sends a periodic PWM signal to each image signal processor through a synchronization control unit, thereby ensuring that multiple image processors can process image data at the same time.

[0089] In the above embodiments, the present application can achieve precise synchronization between multiple image signal processors, thereby ensuring that in a multi-camera or multi-channel image processing system, each ISP can process image data in a coordinated and consistent manner, ensuring the synchronization of image frames, and improving the quality of the final image and performance in the application.

[0090] In step S220 of some embodiments, the first target chip select signal refers to a chip select signal used by the synchronization control unit to inform the image processing platform of which image signal processor is currently being synchronized. When the first target chip select signal is in a first level state, the image processing platform can determine the first image signal processor corresponding to the first synchronization request signal according to the first level state. Further, the synchronization control unit can send the first target chip select signal and the corresponding frame transmission start signal to the image processing platform. At this time, the image processing platform can know the image signal processor currently performing frame synchronization according to the first target chip select signal, and record the corresponding frame start time according to the frame transmission start signal.

[0091] It should be noted that the first level state can be a high level state (i.e., representing 1) or a low level state (i.e., representing 0), and each level state of the first target chip select signal can indicate an image signal processor, so that one chip select signal (Chip Select, CS signal) can correspond to two image signal processors. For example, when the first target chip select signal can correspond to the first image signal processor and the second image signal processor, the first image signal processor and the second image signal processor are connected to the same synchronization control unit and image processing platform, and the first target chip select signal is in a high level state (i.e., the signal is pulled high), indicating that the first image signal processor is currently performing frame synchronization, and the first target chip select signal is in a low level state (i.e., the signal is pulled low), indicating that the second image signal processor is currently performing frame synchronization.

[0092] In some embodiments, see Figure 5 , Figure 5 is an optional flow chart of step S220 provided in the embodiment of the present application. Step S220 may specifically include but is not limited to step S510 to step S520. Figure 5 These two steps are introduced in detail.

[0093] Step S510, constructing a chip selection signal group based on the number of image signal processors;

[0094] Step S520 : determining a first target chip select signal from candidate chip select signals based on the index number of the first image signal processor.

[0095] In steps S510 to S520 of some embodiments, when determining the first target chip select signal, a chip select signal group may be first constructed based on the number of image signal processors, and the chip select signal group includes multiple candidate chip select signals. Further, the first target chip select signal is determined from the candidate chip select signals based on the index number of the first image signal processor, and the index number is used to represent a number corresponding to a level state of the candidate chip select signal that is preset. For example, the chip select signal group includes candidate chip select signals S0 and candidate chip select signals S1, and when the candidate chip select signals S0 and candidate chip select signals S1 are both in a high level state, they may correspond to an image signal processor with an index number of N1, when the candidate chip select signal S0 is in a high level state and the candidate chip select signal S1 is in a low level state, they may correspond to an image signal processor with an index number of N2, when the candidate chip select signal S0 is in a low level state and the candidate chip select signal S1 is in a high level state, they may correspond to an image signal processor with an index number of N3, and when the candidate chip select signals S0 and candidate chip select signals S1 are both in a low level state, they may correspond to an image signal processor with an index number of N4.

[0096] It should be noted that the number of candidate chip select signals included in the chip select signal group is related to the number of image signal processors connected to the synchronization control unit, that is, the number of image signal processors and the number of candidate chip select signals are in an exponential relationship, that is, 2 to the power of the number of candidate chip select signals is the number of image signal processors, so that multiple CS signals can be added according to actual needs. For example, the number of candidate chip select signals is 3, , then 8 image signal processors can be represented at this time, and since each candidate chip select signal can include a high level state (that is, representing 1) and a low level state (that is, representing 0), a 3-bit binary number can be used to represent the level state of an image signal processor, so that the image processing platform can clearly know which image signal processor the current signal is related to.

[0097] It should be noted that if Figure 1 As shown, at the frame start time when the first image signal processor transmits the first image data and the second image signal processor transmits the second image data, the synchronization control unit can receive the first synchronization request signal sent by ISP-1 through GPIO-1 and the third synchronization request signal sent by ISP-2 through GPIO-3. Further, the synchronization control unit can use the high level state and low level state of a CS signal to represent the two image signal processors, that is, by pulling the CS signal high or low, the image processing platform is informed of which ISP signal is currently being used. Furthermore, since the synchronization control signal processes each image signal processor separately, the synchronization control signal can send the corresponding frame transmission start signal to the image processing platform through GPIO-5, and the image processing platform can record the frame start time of the corresponding image data.

[0098] In step S230 of some embodiments, the first image signal processor may send a second synchronization request signal to the synchronization control unit at the end of the frame of the first image data, where the second synchronization request signal is a signal generated by the first image signal processor based on the corresponding first frame parameters. The second synchronization request signal is used to inform the synchronization control platform that the image frame in the current first image data has been transmitted. The first frame parameters are parameters related to the first image data, and may include the number of image frames in the first image data, the time interval for transmitting each image frame, etc.

[0099] In step S240 of some embodiments, after receiving the second synchronization request signal indicating the end of frame synchronization, the synchronization control unit may send a corresponding frame transmission end signal to the image processing platform. Further, the image processing platform may timestamp the image frame in the corresponding image data according to the time corresponding to the received frame transmission start signal and the time corresponding to the received frame transmission end signal, thereby achieving the purpose of frame synchronization.

[0100] It should be noted that if Figure 1 As shown, at the frame end time when the first image signal processor transmits the first image data and the second image signal processor transmits the second image data, the synchronization control unit can receive the second synchronization request signal sent by ISP-1 through GPIO-2 and the fourth synchronization request signal sent by ISP-2 through GPIO-4. Further, the synchronization control unit can send the corresponding frame transmission end signal to the image processing platform through GPIO-6, and the image processing platform can record the frame end time of the corresponding image data. It should be noted that since the signal transmission is very fast, the short delay in the transmission process can be ignored.

[0101] In some embodiments, see Figure 6 , Figure 6 This is another optional flow chart of the frame synchronization method based on image data provided in the embodiment of the present application. The frame synchronization method provided in the embodiment of the present application may also include but is not limited to steps S610 to S640. Figure 6 These four steps are introduced in detail.

[0102] Step S610, receiving a third synchronization request signal sent by the second image signal processor at the start time of a frame of second image data transmission by the second image signal processor;

[0103] Step S620, determining a second target chip select signal corresponding to the third synchronization request, and sending the second target chip select signal and a corresponding frame transmission start signal to the image processing platform;

[0104] Step S630, receiving a fourth synchronization request signal sent by the second image signal processor at the end time of the frame transmission of the second image data by the second image signal processor;

[0105] Step S640: Send a corresponding frame transmission end signal to the image processing platform based on the fourth synchronization request signal, so as to timestamp the second image data according to the received frame transmission start signal and frame transmission end signal.

[0106] In steps S610 to S640 of some embodiments, the third synchronization request signal is a signal generated by the second image signal processor in response to the received frame synchronization signal. The fourth synchronization request signal is a signal generated by the second image signal processor based on the corresponding second frame parameter. The second frame parameter is a parameter related to the second image data, which may include the number of image frames in the second image data, the time interval for transmitting each image frame, etc. The second target chip select signal refers to a chip select signal used by the synchronization control unit to inform the image processing platform which image signal processor is currently. In addition, when the second target chip select signal is in the second level state, the image processing platform can determine the second image signal processor corresponding to the second synchronization request according to the second level state.

[0107] In the above embodiment, when performing frame synchronization for each image signal processor, the present application will combine the corresponding synchronization request signal, chip select signal and level status, so that the image processing platform can clearly know the frame start time and frame end time of the corresponding image signal processor, thereby transferring the step of marking the timestamp to a more powerful platform, and having stronger applicability in the field of frame synchronization.

[0108] In some embodiments, before step S220, the frame synchronization method provided in the embodiment of the present application may further include:

[0109] When synchronization request signals sent by at least two image signal processors are received simultaneously, obtaining processor configuration parameters of each image signal processor;

[0110] Arranging synchronization request signals of at least two image signal processors based on processor configuration parameters to obtain a signal list;

[0111] Based on the signal list, synchronization request signals of at least two image signal processors and corresponding frame transmission start signals are sent to the image processing platform in sequence.

[0112] In the above embodiment, when the synchronization control unit simultaneously receives synchronization request signals sent by multiple image signal processors (such as simultaneously receiving the first synchronization request signal sent by ISP-1 through GPIO-1 and the third synchronization request signal sent by ISP-2 through GPIO-3), the processor configuration parameters of each image signal processor can be obtained respectively, and the processor configuration parameters may include: processor model, image resolution, frame rate setting, data transmission rate, memory usage, etc. Further, based on the processor configuration parameters, the processing capacity of each image signal processor can be determined, so as to arrange the synchronization request signals of at least two image signal processors to obtain a signal list, which is equivalent to a priority list, which can ensure that the subsequent transmission is carried out in an appropriate order to maximize efficiency and ensure real-time performance. Further, based on the generated signal list, the system will send the synchronization request signal of each image signal processor and the corresponding frame transmission start signal to the image processing platform in sequence, and execute steps S220 to S240 in sequence.

[0113] In the above embodiments, in order to achieve coordinated work of multiple image signal processors, the present application enables effective synchronization and signal transmission when processing image data of multiple channels or multiple cameras to ensure image quality and processing speed. Signals can be arranged based on processor configuration parameters to optimize the collaborative processing effect of multiple ISPs and improve the performance of the overall system.

[0114] The video stream recognition device of the present application can obtain the original video data stream collected by the video acquisition device based on the image sensor based on the data stream receiving channel, and decode the original video data stream according to the preset key area data to obtain the full pixel video stream and the key area video stream. Afterwards, the embodiment of the present application can recognize and output the video streams corresponding to the images in different areas according to the data collected by the same video acquisition device, and output the video streams corresponding to the images in different areas through different transmission channels at the same time, which can meet more video stream requirements at the same time and improve the efficiency of video stream recognition output.

[0115] The frame synchronization method based on image data provided by the present application can realize the timestamp marking of the image data for frame synchronization by designing a synchronization control unit to bridge multiple ISPs and image processing platforms, and sending the corresponding frame transmission start signal and frame transmission end signal to the image processing platform based on the received synchronization request signal. Compared with the related art, the method provided by the present application does not rely on a specific sensor interface for frame synchronization, does not need to use the sensor's vsync function, and does not rely on a powerful SOC-type ISP. It can be applied to the frame synchronization of various types of ISPs, avoids the problem that the ISP cannot timestamp the image, improves the applicability of frame synchronization based on image data, and transfers the step of marking the timestamp to a more powerful image processing platform, which can ensure the efficiency of frame synchronization.

[0116] See also Figure 1 The frame synchronization system based on image data provided in the embodiment of the present application specifically includes:

[0117] An image processing platform, used for generating a frame synchronization signal and sending the frame synchronization signal to at least two image signal processors; wherein the frame synchronization signal is a signal for starting a frame synchronization function;

[0118] At least two image signal processors are used to send a first synchronization request signal to the synchronization control unit at the start time of the frame of the first image data transmitted by the first image signal processor, and the at least two image signal processors are also used to send a second synchronization request signal to the synchronization control unit at the end time of the frame of the first image data transmitted by the first image signal processor; wherein the first synchronization request signal is a signal generated by the first image signal processor in response to the received frame synchronization signal, and the second synchronization request signal is a signal generated by the first image signal processor based on the corresponding first frame parameter;

[0119] A synchronization control unit is used to receive a first synchronization request signal, determine a first target chip select signal corresponding to the first synchronization request, and send the first target chip select signal and the corresponding frame transmission start signal to the image processing platform. The synchronization control unit is also used to receive a second synchronization request signal, and based on the second synchronization request signal, send the corresponding frame transmission end signal to the image processing platform, so as to timestamp the first image data according to the received frame transmission start signal and frame transmission end signal; wherein the first target chip select signal is in a first level state, and the image processing platform is used to determine the image signal processor corresponding to the first synchronization request according to the first level state.

[0120] It should be noted that the image data-based frame synchronization system of the embodiment of the present application is used to implement the image data-based frame synchronization method of the above-mentioned embodiment. The image data-based frame synchronization system of the embodiment of the present application corresponds to the aforementioned image data-based frame synchronization method. Please refer to the aforementioned image data-based frame synchronization method for the specific processing process, which will not be repeated here.

[0121] The embodiment of the present application also provides a computer device, which includes: at least one memory, at least one processor, and at least one computer program, wherein the at least one computer program is stored in the at least one memory, and the at least one processor executes the at least one computer program to implement any of the frame synchronization methods based on image data in the above embodiments. The computer device can be any intelligent terminal including a tablet computer, a vehicle-mounted computer, etc.

[0122] See also Figure 7 , Figure 7 The hardware structure of a computer device according to another embodiment is illustrated. The computer device includes:

[0123] The processor 710 may be implemented by a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;

[0124] The memory 720 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 720 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 720, and the processor 710 calls and executes the frame synchronization method based on image data in the embodiment of this application;

[0125] Input / output interface 730, used to implement information input and output;

[0126] Communication interface 740, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.);

[0127] bus 750 , which transmits information between the various components of the device (e.g., processor 710 , memory 720 , input / output interface 730 , and communication interface 740 );

[0128] The processor 710 , the memory 720 , the input / output interface 730 , and the communication interface 740 are connected to each other in communication within the device via the bus 750 .

[0129] An embodiment of the present application further provides a storage medium, which is a computer-readable storage medium. The computer-readable storage medium stores a computer program, and the computer program is used to enable a computer to execute the frame synchronization method based on image data in the above embodiment.

[0130] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0131] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0132] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0133] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0134] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0135] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0136] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0137] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0138] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0139] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0140] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.

[0141] The preferred embodiments of the present invention are described with reference to the accompanying drawings, but the scope of the present invention is not limited by the above. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the present invention.

Claims

1. A frame synchronization method based on image data, characterized in that: Applied to a synchronization control unit, the synchronization control unit is respectively connected to at least two image signal processors and an image processing platform, each of the image signal processors is connected to the image processing platform, and the method includes: At the start time of a frame in which the first image data is transmitted by the first image signal processor, a first synchronization request signal sent by the first image signal processor is received; wherein the first synchronization request signal is a signal generated by the first image signal processor in response to a received frame synchronization signal, and the frame synchronization signal is a signal generated by the image processing platform to start a frame synchronization function; Determine a first target chip select signal corresponding to the first synchronization request signal, and send the first target chip select signal and a corresponding frame transmission start signal to the image processing platform; wherein the first target chip select signal is in a first level state, and the image processing platform is used to determine an image signal processor corresponding to the first synchronization request signal according to the first level state; At the end moment of the frame of the first image data transmitted by the first image signal processor, receiving a second synchronization request signal sent by the first image signal processor; wherein the second synchronization request signal is a signal generated by the first image signal processor based on the corresponding first frame parameter; Based on the second synchronization request signal, a corresponding frame transmission end signal is sent to the image processing platform, so as to time-stamp the first image data according to the received frame transmission start signal and the frame transmission end signal.

2. The method according to claim 1, characterized in that At the start time of a frame transmission of the first image data by the first image signal processor, before receiving a first synchronization request signal sent by the first image signal processor, the method further includes: Acquire frame synchronization parameters of at least two of the image signal processors, the frame synchronization parameters including a target frame rate and a target frame number; Determining pulse modulation parameters based on the target frame rate and the target number of frames; A pulse width modulation signal is generated based on the pulse modulation parameter, and the pulse width modulation signal is sent to each of the image signal processors for pulse width modulation.

3. The method according to claim 2, characterized in that The step of receiving a first synchronization request signal sent by the first image signal processor at the start time of a frame in which the first image data is transmitted by the first image signal processor comprises: Determine an edge signal of the pulse width modulation signal in the level conversion process as a trigger signal, and trigger the transmission of the first image data to the image processing platform when each trigger signal is generated; After the first image signal processor receives the trigger signal, a first synchronization request signal sent by the first image signal processor is received.

4. The method according to claim 1, characterized in that: The method further comprises: At the start time of a frame in which the second image signal processor transmits the second image data, receiving a third synchronization request signal sent by the second image signal processor; wherein the third synchronization request signal is a signal generated by the second image signal processor in response to the received frame synchronization signal; Determine a second target chip select signal corresponding to the third synchronization request signal, and send the second target chip select signal and a corresponding frame transmission start signal to the image processing platform; wherein the second target chip select signal is in a second level state, and the image processing platform is used to determine the image signal processor corresponding to the third synchronization request signal according to the second level state; At the end time of the frame in which the second image data is transmitted by the second image signal processor, receiving a fourth synchronization request signal sent by the second image signal processor; wherein the fourth synchronization request signal is a signal generated by the second image signal processor based on the corresponding second frame parameter; Based on the fourth synchronization request signal, a corresponding frame transmission end signal is sent to the image processing platform, so as to time-stamp the second image data according to the received frame transmission start signal and the frame transmission end signal.

5. The method according to claim 4, characterized in that Before determining the first target chip select signal corresponding to the first synchronization request and sending the first target chip select signal and the corresponding frame transmission start signal to the image processing platform, the method further includes: When synchronization request signals sent by at least two image signal processors are received simultaneously, obtaining processor configuration parameters of each image signal processor; Arrange the synchronization request signals of at least two image signal processors based on the processor configuration parameters to obtain a signal list; Based on the signal list, synchronization request signals of at least two image signal processors and corresponding frame transmission start signals are sent to the image processing platform in sequence.

6. The method according to any one of claims 1 to 5, characterized in that: The frame synchronization signal is generated in the following manner: Performing interface detection on the image signal processor performing image data transmission to obtain an interface type; The frame synchronization signal is generated based on the interface type and the corresponding interface protocol.

7. The method according to any one of claims 1 to 5, characterized in that: The determining a first target chip select signal corresponding to the first synchronization request signal includes: constructing a chip select signal group based on the number of the image signal processors, the chip select signal group including a plurality of candidate chip select signals; The first target chip select signal is determined from the candidate chip select signals based on the index number of the first image signal processor.

8. A frame synchronization system based on image data, characterized in that: The system comprises: An image processing platform, used for generating a frame synchronization signal and sending the frame synchronization signal to at least two image signal processors; wherein the frame synchronization signal is a signal for starting a frame synchronization function; at least two image signal processors, configured to send a first synchronization request signal to a synchronization control unit at a start time of a frame of first image data transmitted by the first image signal processor, and the at least two image signal processors are further configured to send a second synchronization request signal to the synchronization control unit at a finish time of a frame of the first image data transmitted by the first image signal processor; wherein the first synchronization request signal is a signal generated by the first image signal processor in response to the received frame synchronization signal, and the second synchronization request signal is a signal generated by the first image signal processor based on a corresponding first frame parameter; A synchronization control unit, used to receive the first synchronization request signal, determine the first target chip select signal corresponding to the first synchronization request signal, and send the first target chip select signal and the corresponding frame transmission start signal to the image processing platform. The synchronization control unit is also used to receive the second synchronization request signal, and based on the second synchronization request signal, send the corresponding frame transmission end signal to the image processing platform, so as to timestamp the first image data according to the received frame transmission start signal and the frame transmission end signal; wherein the first target chip select signal is in a first level state, and the image processing platform is used to determine the image signal processor corresponding to the first synchronization request signal according to the first level state.

9. A computer device, characterized in that: include: at least one memory; at least one processor; at least one computer program; The at least one computer program is stored in the at least one memory, and the at least one processor executes the at least one computer program to implement: The method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer readable storage medium stores a computer program, and the computer program is used to cause a computer to execute: The method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • TEMPORAL SYNCHRONIZATION circuit and METHODS FOR synchronizing sensor data

    CN113132453A

  • Display synchronization method, electronic equipment and readable storage medium

    CN114630007A

  • Image processing method and device, electronic equipment and computer readable medium

    CN118075558A

  • Image processing method, hybrid image sensor, electronic equipment and storage medium

    CN118214933A

  • Display control apparatus, display control method, and program

    US20140028656A1