Image data transmission method and system

Abstract

The present application discloses an image data transmission method and system, the image data transmission method is applied to an image data transmission system, the image data transmission system includes an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit connected in sequence, the image acquisition unit is connected to the image correction unit via a first channel, the image correction unit is connected to the display control unit via a second channel, the method includes: based on the application identifier of the acquired first target application, determining that the image data transmission system is in a first working mode, wherein the first working mode is a working mode that does not require displaying images to the user. By improving the transmission and management methods of image data, the present application can reduce memory usage and processing delay while maintaining high performance, and provide flexible operating modes to adapt to different application scenarios.

Description

Technical Field

[0001] The present application relates to the technical field of data transmission, and in particular to a method and system for image data transmission. Background Art

[0002] In image data transmission systems, efficient data flow management and processing are key to achieving high-performance vision applications. For example, image data captured by a vehicle's camera serial interface (CSI) is transmitted to an image correction unit for necessary correction before being displayed.

[0003] The Any Shape Warp Engine (ASW) or Display Controller (DC) must wait for the camera serial interface or image warp unit to completely write a frame of data to memory before it can begin reading and processing. This leads to inherent delays in the data processing process and takes up a lot of space, making it impossible to meet user real-time requirements. Summary of the Invention

[0004] The present invention aims to provide an image data transmission method and system. The image data transmission method is applied to an image data transmission system. The image data transmission system includes an image acquisition unit, a first storage unit, an image correction unit, a second storage unit, and a display control unit connected in sequence. The image acquisition unit is connected to the image correction unit via a first channel, and the image correction unit is connected to the display control unit via a second channel. The method includes:

[0005] Based on the obtained application identifier of the first target application, determining that the image data transmission system is in a first operating mode, wherein the first operating mode is an operating mode that does not require displaying images to a user;

[0006] When it is determined that the image data transmission system is in the first working mode, the image acquisition unit and the image correction unit enable the first channel for communication, and the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit.

[0007] When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit;

[0008] In response to the acquired application identifier of the second target application, switching the first operating mode to a second operating mode, wherein the second operating mode is an operating mode requiring displaying an image to a user, and the first target application and the second target application are different applications;

[0009] When it is determined to switch to the second working mode, the image correction unit and the display control unit enable the second channel for communication, and the frame rate of the image correction unit is the same as the frame rate of the display control unit.

[0010] When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit;

[0011] When the second channel is enabled, the state of the first channel is determined; if the state of the first channel is enabled, the frame rate of the image acquisition unit is adjusted to be the same as the frame rate of the display control unit.

[0012] As an optional embodiment, determining that the image data transmission system is in the first operating mode based on the acquired application identifier of the first target application includes:

[0013] When it is determined that the first target application is started, obtaining an application identifier of the first target application;

[0014] The image data transmission system is determined to be in a first working mode based on the application identifier and a file mapping table, wherein the file mapping table includes a mapping relationship between a target application and its corresponding working mode.

[0015] As an optional embodiment, the image acquisition unit and the image correction unit enable the first channel to communicate, including:

[0016] When at least one line of the first frame image data is written into the first storage unit, the image acquisition unit generates a counting signal, wherein the counting signal is used to represent the number of lines of the first frame image data written into the first storage unit;

[0017] Based on the counting signal and a first threshold, the image acquisition unit generates a first reading signal;

[0018] The first reading signal is sent to the image correction unit through the first channel.

[0019] As an optional embodiment, the method further includes:

[0020] Based on the counting signal, the image acquisition unit generates a status signal;

[0021] The status signal is sent to the image correction unit through the first channel, wherein the status signal indicates that the image acquisition unit is in a valid working state.

[0022] As an optional embodiment, when the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit, including:

[0023] Determine a first writing position of the first storage unit, wherein the first writing position includes a writing start point and a writing end point, and a plurality of writing rows are between the writing start point and the writing end point;

[0024] The image acquisition unit writes the first frame of image data in sequence from the writing start point to the writing end point, wherein the first frame of image data includes a plurality of lines of image data;

[0025] When the writing amount reaches a first threshold, the image correction unit starts reading the first frame of image data from the writing starting point;

[0026] When the plurality of writing lines are fully written, the image acquisition unit writes again from the writing starting point.

[0027] As an optional embodiment, when the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit, including:

[0028] determining a second writing position of the second storage unit, wherein the second writing position includes a first writing area and a second writing area;

[0029] The image correction unit writes the second frame image data into the first writing area;

[0030] When the first writing area is full, the image correction unit switches writing the second frame image data into the first writing area to writing into the second writing area, and the display control unit reads the second frame image data from the first writing area.

[0031] As an optional embodiment, the image correction unit and the display control unit enable the second channel for communication, including:

[0032] When the first writing area is fully written, the image correction unit generates a second reading signal, and the second reading signal is sent to the display control unit through the second channel;

[0033] Based on the second read signal, the display control unit reads the second frame image data from the first writing area, and the image correction unit switches writing the second frame image data into the first writing area to writing into the second writing area;

[0034] When the second writing area is fully written, the image correction unit generates a third reading signal, and the third reading signal is sent to the display control unit through the second channel;

[0035] When the display control unit completes reading the first writing area, the display control unit generates a first completion signal, and the first completion signal is sent to the image correction unit through the second channel;

[0036] Based on the first completion signal and the third read signal, the display control unit reads the second frame image data from the second writing area, and the image correction unit switches writing the second frame image data into the second writing area to writing into the first writing area.

[0037] As an optional embodiment, the method further includes:

[0038] When it is determined that the image data transmission system is in the first operating mode, the image correction unit processes the first frame image data read from the first storage unit so that the processed first frame image data is valid image data.

[0039] As an optional embodiment, the method further includes:

[0040] In the case where it is determined that the first channel and the second channel are enabled at the same time, the first frame image data is the same as or different from the second frame image data, and the first threshold is the same as or different from the second threshold.

[0041] The present application also aims to provide an image data transmission system, comprising an image acquisition unit, a first storage unit, an image correction unit, a second storage unit, and a display control unit connected in sequence, wherein the image acquisition unit is connected to the image correction unit via a first channel, and the image correction unit is connected to the display control unit via a second channel, and further comprising:

[0042] a determining unit configured to determine, based on the acquired application identifier of the first target application, that the image data transmission system is in a first operating mode, wherein the first operating mode is an operating mode that does not require displaying images to a user;

[0043] a first transmission unit configured to, when determining that the image data transmission system is in the first operating mode, enable the image acquisition unit and the image correction unit to communicate through the first channel, wherein the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit;

[0044] When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit;

[0045] a switching unit configured to, in response to the acquired application identifier of a second target application, switch the first operating mode to a second operating mode, wherein the second operating mode is an operating mode requiring displaying an image to a user, and the first target application and the second target application are different applications;

[0046] a second transmission unit configured to, when determining to switch to the second operating mode, enable the image correction unit and the display control unit to communicate through the second channel, wherein the frame rate of the image correction unit is the same as the frame rate of the display control unit;

[0047] When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit;

[0048] An adjustment unit is configured to determine the state of the first channel when the second channel is enabled, and if the state of the first channel is enabled, adjust the frame rate of the image acquisition unit to be the same as the frame rate of the display control unit.

[0049] The beneficial effects of the embodiments of the present application are:

[0050] By improving the transmission and management methods of image data, this application can reduce memory usage and processing delay while maintaining high performance, and provide flexible operating modes to adapt to different application scenarios, thereby improving the performance of visual applications and user experience.

[0051] Among them, this application avoids the need to store entire frames of data by optimizing the data processing process, thereby greatly reducing memory usage. This not only saves memory costs, but also improves the operating efficiency of the system. Through the collaborative work and synchronous data processing of multiple modules, this application enables the system to achieve ultra-low latency data transmission and processing, allowing the image to be presented more quickly, meeting application scenarios that require rapid response, thereby enhancing security and real-time performance. The system of this application can adjust the operating mode according to different usage environments and performance requirements, thereby ensuring performance while also meeting diverse application needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 This is a flowchart of the image data transmission method according to an embodiment of the present application;

[0053] Figure 2The process of step S10 of the image data transmission method of the embodiment of the present application is as follows Figure 1 ;

[0054] Figure 3 This is a flowchart of step S20 of the image data transmission method according to an embodiment of the present application;

[0055] Figure 4 This is a flowchart of step S21 of the image data transmission method according to an embodiment of the present application;

[0056] Figure 5 This is a flowchart of step S41 of the image data transmission method according to an embodiment of the present application;

[0057] Figure 6 This is a flowchart of step S40 of the image data transmission method according to an embodiment of the present application;

[0058] Figure 7 This is a structural block diagram of an image data transmission system according to an embodiment of the present application;

[0059] Figure 8 The process of step S10 of the image data transmission method of the embodiment of the present application is as follows Figure 2 ;

[0060] Figure 9 This is a structural block diagram of the first working mode of an embodiment of the present application;

[0061] Figure 10 This is a structural block diagram of the second working mode of an embodiment of the present application;

[0062] Figure 11 A schematic diagram of the interaction between the image correction unit and the display control unit according to an embodiment of the present application;

[0063] Figure 12 This is a structural block diagram of another second working mode of an embodiment of the present application;

[0064] Figure 13 A schematic diagram of the delay and memory usage of an embodiment of the present application. DETAILED DESCRIPTION

[0065] Various aspects and features of the present application are described herein with reference to the accompanying drawings.

[0066] It should be understood that various modifications may be made to the embodiments of the present application. Therefore, the above description should not be considered as limiting, but merely as an example of an embodiment. Other modifications within the scope and spirit of the present application will occur to those skilled in the art.

[0067] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present application and, together with the general description of the present application given above and the detailed description of the embodiments given below, serve to explain the principles of the present application.

[0068] These and other characteristics of the present application will become apparent from the following description of a preferred form of embodiment given as a non-limiting example with reference to the accompanying drawings.

[0069] It should also be understood that although the present application has been described with reference to certain specific examples, those skilled in the art will readily be able to implement many other equivalent forms of the present application.

[0070] The above and other aspects, features and advantages of the present application will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

[0071] Specific embodiments of the present application will be described hereinafter with reference to the accompanying drawings; however, it should be understood that the embodiments described are merely examples of the present application and may be implemented in a variety of ways. Familiar and / or repetitive functions and structures are not described in detail to avoid obscuring the present application with unnecessary or redundant details. Therefore, the specific structural and functional details described herein are not intended to be limiting, but rather serve merely as a basis and representative basis for the claims to teach those skilled in the art to variously utilize the present application with substantially any suitable detailed structure.

[0072] This specification may use the phrases "in one embodiment," "in another embodiment," "in a further embodiment," or "in other embodiments," which may all refer to one or more of the same or different embodiments according to the present application.

[0073] In the prior art, the image correction unit only begins reading data after the camera's serial interface has completely written a frame to memory. The display controller only begins reading data after the image correction unit has processed the data and has completely written it to memory. This consumes at least two frame buffer (FB) height lines of writing time along the path.

[0074] The camera serial interface requires two FB (height lines) of memory space to store data. The image correction unit also requires two FB (height lines) of memory space to store data. Furthermore, each process is relatively independent. For a frame of image, the next module cannot proceed until the previous one has completed processing. This results in significant latency and memory usage.

[0075] In view of the above content, the embodiment of the present application provides an image data transmission method, which is applied to an image data transmission system, such as Figure 12 As shown, the image data transmission system includes an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit connected in sequence, the image acquisition unit is connected to the image correction unit through a first channel, and the image correction unit is connected to the display control unit through a second channel.

[0076] The first channel and the second channel are additional channels, which enable the image acquisition unit and the image correction unit to communicate, and enable the image correction unit and the display control unit to communicate.

[0077] like Figure 1 As shown, the image data transmission method dynamically adjusts the working mode according to the needs of the target application to optimize resource utilization and improve performance. The method includes:

[0078] S100. Based on the obtained application identifier of the first target application, determine that the image data transmission system (hereinafter referred to as system) is in a first operating mode, wherein the first operating mode is an operating mode that does not require displaying images to the user.

[0079] In this embodiment, the first step in transmitting image data is to determine the operating mode of the image data transmission system. The first operating mode corresponding to the target application is determined by using the application identifier of the first target application. For example, when image data is used for background data analysis or image processing, it is not necessary to display the image to the user.

[0080] Different target applications have different application identifiers, and different mode identifiers indicate which operating mode the target application should use. The operating modes are divided according to different scenarios or requirements when the target application is used.

[0081] S200: When it is determined that the image data transmission system is in the first operating mode, the image acquisition unit and the image correction unit enable the first channel for communication, and the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit.

[0082] When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit.

[0083] In this embodiment, when the image data transmission system is in the first operating mode, the image acquisition unit and the image correction unit communicate via the first channel at the same frame rate to ensure synchronous transmission of image data and avoid data processing delays caused by frame rate mismatch. Frame rate is typically measured in frames per second (FPS) and determines the smoothness of the displayed image.

[0084] If the writing speed of the image acquisition unit does not match the reading speed of the image correction unit, data overflow in the first storage unit may occur, thereby causing data loss or buffer overflow.

[0085] When the amount of data written by the image acquisition unit to the first storage unit reaches a preset first threshold, the image correction unit begins to read data from the first storage unit. The first threshold can be set to a certain proportion of the storage capacity of the first storage unit, such as half or a quarter of the storage capacity, to ensure that sufficient image data is stored before the data is read.

[0086] S300: In response to the acquired application identifier of the second target application, switch the first operating mode to a second operating mode, wherein the second operating mode is an operating mode requiring displaying an image to a user, and the first target application and the second target application are different applications;

[0087] In this embodiment, the system switches the operating mode from the first operating mode to the second operating mode in response to the application identifier of the second target application. The second operating mode requires displaying images to the user, such as real-time monitoring or a driver assistance system.

[0088] S400: When it is determined to switch to the second operating mode, the image correction unit and the display control unit enable the second channel for communication, and the frame rate of the image correction unit is the same as the frame rate of the display control unit.

[0089] When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit.

[0090] In this embodiment, in the second working mode, the image correction unit and the display control unit communicate via the second channel at the same frame rate. That is, the image data is processed or displayed at a consistent speed, thereby ensuring the continuity and real-time performance of the image.

[0091] When the amount of data written into the second storage unit by the image correction unit reaches a preset second threshold, the display control unit begins reading data from the second storage unit. The second threshold is set to ensure that the display control unit has sufficient data to continuously display images while preventing the reading operation from interfering with the writing operation of the image correction unit.

[0092] S500: Determine the state of the first channel when the second channel is enabled; if the state of the first channel is enabled, adjust the frame rate of the image acquisition unit to be the same as the frame rate of the display control unit.

[0093] In this embodiment, when the second channel is enabled, the system checks the status of the first channel. If the first channel is still enabled, the system adjusts the frame rate of the image acquisition unit to the same frame rate as the display control unit to ensure synchronous data transmission.

[0094] At this point, the image data acquired by the image acquisition unit is stored in the first storage unit. The image correction unit reads the image data from the first storage unit, processes it, and stores it in the second storage unit. The display control unit reads the processed image data from the second storage unit and displays it. The image processing performed by the image correction unit includes, but is not limited to, noise reduction, white balance adjustment, and color correction to ensure image quality.

[0095] When the image data transmission system of the present application is in operation, the system first determines the current operating mode based on the obtained application identifier. If the application identifier indicates that image display is not required (such as a data storage application), the system is set to the first operating mode; if image display is required (such as a screen projection application), it is set to the second operating mode.

[0096] In the first working mode, the image acquisition unit and the image correction unit communicate at the same frame rate through the first channel. When the amount written to the first storage unit reaches a first threshold, the image correction unit starts to read data from the first storage unit for processing.

[0097] In the second working mode, the image correction unit and the display control unit communicate at the same frame rate through the second channel. When the writing amount of the second storage unit reaches the second threshold, the display control unit starts to read the corrected image data from the second storage unit for display.

[0098] Furthermore, when switching from the first operating mode to the second operating mode, the system checks the status of the first channel. If the first channel is still enabled, the system adjusts the frame rate of the image acquisition unit to the same as the frame rate of the display control unit to ensure synchronous data transmission.

[0099] In this case, the image acquisition unit, image correction unit, and display control unit operate in conjunction with each other at the same frame rate. The image acquisition unit writes the acquired image data to the first storage unit. When the amount written to the first storage unit reaches a first threshold, the image correction unit begins reading data from the first storage unit for processing. The image correction unit writes the processed image data to the second storage unit. When the amount written to the second storage unit reaches a second threshold, the display control unit begins reading the corrected image data from the second storage unit for display.

[0100] The system of the present invention can flexibly switch operating modes according to different application requirements, adapting to different usage scenarios. By dynamically adjusting the operating mode and frame rate, the system can more efficiently process and transmit image data, reducing memory usage and processing latency. Furthermore, by precisely controlling the timing of data reading and writing, the system can more effectively utilize storage and processing resources.

[0101] For example, 1) Figure 8 and Figure 9 As shown, when the driver is driving the car normally, the driver turns on the driving recorder, the corresponding application of the driving recorder (the first target application) is opened, the system obtains the application identifier of the driving recorder application, and switches to the first working mode according to the application identifier.

[0102] In the first operating mode, based on the application identifier, the system determines that the first channel is enabled. Raw image data captured by the camera serial interface (image acquisition unit) is stored in the first memory (first storage unit). When the amount of raw image data stored in the first memory reaches one-tenth of the first memory's storage capacity (a first threshold), the image correction unit reads the raw image data from the first memory and stores or processes the image data before storing it. At this point, the captured image data is stored and does not need to be displayed to the driver or passengers.

[0103] 2) If Figure 8 and Figure 10 As shown, when the driver is driving the car normally, the passenger in the front passenger seat opens the video playback application (the second target application), the system obtains the application identifier of the video playback application, and switches to the second working mode according to the application identifier.

[0104] In the second operating mode, the system activates the second channel based on the application identifier. The image correction unit corrects the acquired raw image data (video from the internet, a mobile phone, or a tablet) so that the image appears normal when projected onto a display surface. For example, if the display surface is glass, the processed image can adapt to the curved surface of the glass.

[0105] The processed image data is stored in a second memory (second storage unit). When the amount of processed image data stored in the second memory reaches half of the second memory's storage capacity (a second threshold), the display control unit reads the processed image data from the second memory and displays it. At this point, the acquired image data needs to be displayed to the vehicle's passengers.

[0106] 3) If Figure 8 and Figure 12As shown, when a driver is driving a car normally, he wants to use an electronic rearview mirror to improve his perception of the situation behind the vehicle. At this time, the image data needs to be processed quickly and displayed to the user.

[0107] The driver turns on the electronic rearview mirror, and the corresponding application of the electronic rearview mirror (the second target application) is opened. The system obtains the application identifier of the application recorded in the driving record and switches to the second working mode according to the application identifier.

[0108] In the second operating mode, based on the application identifier, the system determines that both the first and second channels are enabled. The raw image data acquired by the camera serial interface (image acquisition unit) is stored in the first memory (first storage unit). When the amount of raw image data stored in the first memory reaches one-tenth of the first memory's storage capacity (a first threshold), the image correction unit reads the raw image data from the first memory and processes the image data. The processed image data is stored in the second memory (second storage unit). When the amount of processed image data stored in the second memory reaches one-half of the second memory's storage capacity (a second threshold), the display control unit reads the processed image data from the second memory and displays the image data.

[0109] In one embodiment, if Figure 2 and Figure 8 As shown, the determining that the image data transmission system is in the first working mode based on the obtained application identifier of the first target application includes:

[0110] S101: When it is determined that a first target application is started, obtain an application identifier of the first target application.

[0111] In this embodiment, when the system monitors the startup status of multiple applications, an application in the startup state among the multiple applications is the first target application, and an application that is subsequently started is the second target application.

[0112] S102: Determine that the image data transmission system is in a first operating mode based on the application identifier and a file mapping table, wherein the file mapping table includes a mapping relationship between a target application and its corresponding operating mode.

[0113] In this embodiment, the system consults the file mapping table and determines the corresponding operating mode based on the application identifier. If the application identifier corresponds to an operating mode that requires displaying images to the user, the system needs to switch to the second operating mode; if the application identifier corresponds to an operating mode that does not require displaying images to the user, the system needs to switch to the first operating mode.

[0114] After determining the working mode, the system synchronizes the frame rates of the image acquisition unit and the image correction unit and / or the frame rates of the image correction unit and the display control unit to ensure efficient data transmission.

[0115] The first target application and the second target application are different and have different application identifiers, and different application identifiers correspond to different working modes. Therefore, when the system recognizes different application identifiers and determines that they require different working modes, it is necessary to switch the working mode.

[0116] In addition, if the first target application is the same as the second target application, it means that their application types are the same or the requirements provided to the user during operation are the same, for example, neither needs to display images to the user or both need to display images to the user. Therefore, even if the system recognizes different application identifiers, it determines based on the application identifier that the required working modes are the same, and there is no need to switch the working mode at this time.

[0117] By determining the operating mode based on the application identifier, the system can flexibly adjust its operating mode according to different application requirements, thereby optimizing resource utilization and performance. By synchronizing frame rates and timely data transmission, the system can reduce data processing delays and increase image processing speed.

[0118] In one embodiment, if Figure 3 and Figure 9 As shown, the image acquisition unit and the image correction unit enable the first channel to communicate, including:

[0119] S201 . When at least one line of the first frame image data is written into the first storage unit, the image acquisition unit generates a counting signal, wherein the counting signal is used to represent the number of lines of the first frame image data written into the first storage unit.

[0120] In this embodiment, the image acquisition unit begins to capture an image of the environment and writes the data into the first storage unit. Each time a line of image data is written into the first storage unit, the image acquisition unit generates a counting signal to record the number of lines written, which facilitates subsequent processing and storage.

[0121] S202: Based on the counting signal and a first threshold, the image acquisition unit generates a first reading signal.

[0122] In this embodiment, when the number of rows indicated by the counting signal reaches a preset first threshold, the image acquisition unit generates a first read signal, wherein the first threshold may be 10 rows.

[0123] S203 : Send the first reading signal to the image correction unit through the first channel.

[0124] In this embodiment, the first read signal instructs the image correction unit to start reading the image data in the first storage unit. After receiving the read signal, the image correction unit starts reading the image data from the first storage unit and performs necessary correction processing.

[0125] For example, in a dashcam, when the camera begins recording and writes image data to the first memory, the system generates a count signal (csi_lint_cnt) to track the number of lines written. When the image acquisition unit reaches a set threshold (e.g., 10 lines of image data have been written), the system generates a first read signal, instructing the image correction unit to begin reading data for processing. The image correction unit reads the image data and begins processing the recorded image data to ensure that relevant video information can be quickly acquired and analyzed in the event of an accident.

[0126] The present invention, through the mechanism of counting and reading signals, ensures efficient transmission of image data between the first storage unit and the image correction unit, reducing the risk of data loss and errors. This method allows the image correction unit to immediately begin processing data when specific conditions are met (such as when the write volume reaches a first threshold), thereby improving the real-time nature of data processing. By controlling the timing of data reads, system resources, such as storage and processing capacity, can be more efficiently utilized, particularly in situations with large data volumes or limited processing capabilities.

[0127] In one embodiment, if Figure 3 and Figure 9 As shown, the method further includes:

[0128] S204: Based on the counting signal, the image acquisition unit generates a status signal;

[0129] S205 . The status signal is sent to the image correction unit through the first channel, wherein the status signal indicates that the image acquisition unit is in a valid working state.

[0130] In this embodiment, the status signal (csi_rdy) allows the image correction unit to understand the working status of the image acquisition unit, thereby ensuring the effectiveness of data transmission.

[0131] If, during the image data transmission process, the counting signal is sent without an accompanying status signal, or the status signal displays an abnormality, this means that there is a problem with the communication between the image acquisition unit and the image correction unit, or there is a problem with the image acquisition unit.

[0132] In this case, if the status signal is missing, the image acquisition unit may resend the counting signal and wait for the status signal to be regenerated to ensure the integrity and reliability of data transmission.

[0133] If the status signal indicates an anomaly, the image acquisition unit can initiate an anomaly detection process to determine if the problem is due to a hardware failure, software error, or communication interference. The unit then issues an alarm, prompting the operator to conduct an inspection or intervention. If a problem occurs on the primary channel, a switchover to a backup communication channel can be performed to ensure data transmission is not affected. The system can also be designed to automatically recover, for example, by pausing data transmission, waiting for a period of time or attempting self-diagnosis, and then restarting data transmission.

[0134] In the present invention, through the transmission of the status signal, the image correction unit can timely understand the working status of the image acquisition unit, thereby improving the reliability of data transmission and the stability of the system.

[0135] In one embodiment, if Figure 4 As shown, when the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit, including:

[0136] S211. Determine a first writing position of the first storage unit, wherein the first writing position includes a writing start point and a writing end point, and a plurality of writing rows are between the writing start point and the writing end point.

[0137] In this embodiment, the write start point is the starting position of data writing, and the write end point is the ending position of data writing. Determining the write position helps manage storage space, ensures that data can be written in an orderly manner, and avoids data overwriting or loss.

[0138] S212. The image acquisition unit writes the first frame of image data in sequence from the writing start point to the writing end point, wherein the first frame of image data includes multiple lines of image data.

[0139] In this embodiment, the image data is written into the storage unit row by row in order. This sequential writing method ensures the integrity and readability of the image data and facilitates subsequent image processing and analysis.

[0140] S213 : When the writing amount reaches a first threshold, the image correction unit starts reading the first frame of image data from the writing starting point.

[0141] In this embodiment, the image correction unit can start processing immediately when the data volume reaches the first threshold, thereby improving the real-time performance of data processing.

[0142] S214 . When the plurality of writing rows are fully written, the image acquisition unit writes again from the writing starting point.

[0143] In this embodiment, a cyclic writing mechanism is used to ensure continuous data collection and storage, thereby avoiding data loss due to insufficient storage space.

[0144] For example, the storage unit (such as an SD card) of the driving recorder is divided into multiple write rows. The system determines the write start point as the initial position of the storage unit and the write end point as a certain position of the storage unit for subsequent writing of image data.

[0145] When the camera starts recording a video, the image acquisition unit writes the captured image data line by line into the first storage unit. For example, the first few lines of data of the first frame of image are written into the first few lines of the storage unit.

[0146] When the amount of data written to the first storage unit reaches a set first threshold (e.g., 10 lines of image data have been written), the image acquisition unit generates a first read signal, which is sent via a first channel to the image correction unit, instructing it to begin reading the first frame of image data. Upon receiving the first read signal, the image correction unit begins reading the data from the write starting point and performs processing, such as denoising and correction.

[0147] Once the write row in the first storage unit is full, the image acquisition unit restarts writing new image data from the starting point, forming a cyclic write mechanism. This ensures that the dashcam can continuously record video without interruption due to insufficient storage space. In this way, the system can efficiently manage image data acquisition, storage, and processing, ensuring that the dashcam can record and save important image data in real time while driving.

[0148] By precisely controlling the write position and the first threshold, the present invention ensures efficient and stable data transmission. The image correction unit can immediately begin processing when the data volume reaches the first threshold, improving the real-time nature of data processing. A cyclic write mechanism ensures that data is correctly stored in the first storage unit, preventing data loss.

[0149] In one embodiment, if Figure 5 and Figure 11 As shown, when the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit, including:

[0150] S411, determining a second writing position of the second storage unit, wherein the second writing position includes a first writing area and a second writing area;

[0151] In this embodiment, the system determines a second write location in the second storage unit, which is divided into two areas: a first write area and a second write area. These two areas together constitute the storage space for the second frame of image data. This partitioning allows the system to switch to the next area after one area is full, thus achieving continuous data writing and reading.

[0152] S412, the image correction unit writes the second frame image data into the first writing area;

[0153] In this embodiment, the image data is first stored in the first partition of the second storage unit. Writing in sequence ensures the organization and integrity of the data and facilitates subsequent reading and processing. The second writing area can also be set as the first partition.

[0154] S413. When the first writing area is full, the image correction unit switches writing the second frame image data into the first writing area to writing into the second writing area, and the display control unit reads the second frame image data from the first writing area.

[0155] In this embodiment, when the first writing area is full, the image correction unit switches to the second writing area for writing. Simultaneously, the display control unit starts to read the second frame of image data from the first writing area.

[0156] By switching to the second writing area when the first writing area is full, the present invention ensures continuous data writing and avoids data loss or delays caused by waiting for storage space. The display control unit can read data from the first writing area in a timely manner, improving the real-time nature of data processing. The system can dynamically adjust resource allocation based on data volume, improving overall system efficiency.

[0157] For example, the second storage unit of the vehicle-mounted video surveillance system is divided into two areas: a first writing area and a second writing area. For example, if the total capacity of the storage unit is 32 GB, each area may be set to 16 GB.

[0158] When the vehicle is started, the front camera begins capturing road conditions and writing image data to the first writing area. The system may record 1080p video at 30 frames per second, and the data is written sequentially to the first area.

[0159] When the first writing area is nearly full (e.g., when the 16GB space is exhausted), the system automatically switches to the second writing area to continue writing new image data. Simultaneously, the display control unit begins reading the recorded video stream from the first writing area for real-time display on the vehicle infotainment system screen or for further processing and analysis.

[0160] In this way, the in-vehicle video surveillance system can continuously record and process image data in an ever-changing traffic environment, providing drivers with real-time road condition information and enhancing driving safety. Furthermore, this dual-workspace mechanism helps optimize data storage and access efficiency when storage space is limited.

[0161] In one embodiment, if Figure 6 and Figure 11 As shown, the image correction unit and the display control unit enable the second channel for communication, including:

[0162] S401 : When the first writing area is fully written, the image correction unit generates a second reading signal, and the second reading signal is sent to the display control unit through the second channel.

[0163] In this embodiment, the second read signal prompts the display control unit that the data in the first writing area is ready to be read, and the image correction unit is ready to switch to the second writing area to continue writing data.

[0164] S402: Based on the second read signal, the display control unit reads the second frame of image data from the first writing area, and the image correction unit switches writing the second frame of image data from the first writing area to writing the second frame of image data into the second writing area.

[0165] In this embodiment, the display control unit reads the second frame image data from the first writing area based on the second read signal, and the image correction unit switches the data writing from the first writing area to the second writing area, ensuring continuous writing and reading of data, and the data flow will not be interrupted even when one area is full.

[0166] S403: When the second writing area is full, the image correction unit generates a third reading signal, and the third reading signal is sent to the display control unit through the second channel;

[0167] In this embodiment, the third read signal prompts the display control unit that the data in the second write area is ready to be read and is ready for the next data switching.

[0168] S404: When the display control unit completes reading the first writing area, the display control unit generates a first completion signal, and the first completion signal is sent to the image correction unit through the second channel;

[0169] In this embodiment, the first completion signal confirms that the data in the first writing area has been successfully read, allowing the image correction unit to safely switch the writing area.

[0170] S405 . Based on the first completion signal and the third read signal, the display control unit reads the second frame image data from the second writing area, and the image correction unit switches writing the second frame image data into the second writing area to writing into the first writing area.

[0171] In this embodiment, the display control unit reads the second frame image data from the second writing area, and the image correction unit switches the data writing from the second writing area back to the first writing area, completing a cycle of writing and reading process, ensuring the continuous flow of data and effective use of storage space.

[0172] Specifically, the image correction unit writes the acquired image data into the first writing area of ​​the second storage unit.

[0173] When the first writing area is full, the image correction unit generates a second read signal (FB_Rdy) and sends it to the display control unit through the second channel. After receiving the second read signal, the display control unit begins reading the second frame of image data from the first writing area. At the same time, the image correction unit switches data writing to the second writing area.

[0174] When the second writing area is full, the image correction unit generates a third read signal (FB_Frm_Start) and sends it to the display control unit through the second channel. After reading the first writing area, the display control unit generates a first completion signal (FB_Done) and sends it to the image correction unit through the second channel.

[0175] Based on the first completion signal and the third read signal, the display control unit begins reading the second frame of image data from the second writing area. Simultaneously, the image correction unit switches data writing back to the first writing area. The system continues to monitor the status of the writing area and generates appropriate signals when necessary to ensure continuous data writing and reading.

[0176] By automatically switching write zones and generating corresponding read signals when full, the present invention ensures continuous data writing and reading, avoiding data loss and delays. The display control unit can promptly read data from the corresponding write zone, improving the real-time nature of data processing. Furthermore, through signal generation and response, the system can flexibly process data streams, ensuring stable and reliable data transmission.

[0177] For example, in an advanced driver assistance system (ADAS) of a car, when the data from the front camera fills up the first writing area, the image correction unit notifies the display control unit to start reading the data and simultaneously starts writing new data into the second writing area.

[0178] The display control unit reads data from the first writing area for real-time display, while the image correction unit writes new data into the second writing area.

[0179] When the second writing area is also filled, the image correction unit notifies the display control unit to prepare to read the data in the second writing area. After the display control unit finishes reading the data in the first writing area, it notifies the image correction unit that it can safely switch the writing area.

[0180] At this time, the display control unit starts to read data from the second writing area, and the image correction unit switches back to the first writing area to continue writing new data, completing the cycle.

[0181] In one embodiment, the method further comprises:

[0182] When it is determined that the image data transmission system is in the first operating mode, the image correction unit processes the first frame image data read from the first storage unit so that the processed first frame image data is valid image data.

[0183] In this embodiment, the image correction unit not only needs to read the first frame image data from the first storage unit, but also needs to process the first frame image data to ensure that the processed first frame image data is valid image data.

[0184] During image acquisition, some invalid or redundant image areas may be captured. The image correction unit removes these invalid areas, ensuring valid data for subsequent processing and analysis. This also reduces storage space usage, allowing limited storage resources to be used to store more useful image information.

[0185] For example, in a car's Advanced Driver Assistance System (ADAS), the images captured by the camera may contain important information such as vehicles, pedestrians, and traffic signs, but they may also contain some invalid background areas. The image correction unit crops and corrects this image data, removing the redundant background areas while retaining critical traffic information, providing accurate data support for subsequent image analysis and decision-making.

[0186] In one embodiment, the method further comprises:

[0187] In the case where it is determined that the first channel and the second channel are enabled at the same time, the first frame image data is the same as or different from the second frame image data, and the first threshold is the same as or different from the second threshold.

[0188] In this embodiment, the image data transmission system can simultaneously enable the first channel and the second channel for communication. In this mode, the first frame image data and the second frame image data can be the same or different, and the first threshold and the second threshold can also be the same or different.

[0189] Specifically, the image acquisition unit stores the acquired first frame image data into the first storage unit, the image correction unit reads the first frame image data from the first storage unit and processes it, the processed first frame image data is stored into the second storage unit, and the display control unit reads the first frame image data from the second storage unit and displays it. At this time, the image acquisition unit, the image correction unit and the display control unit transmit the same frame image data to each other, that is, the first frame image data and the second frame image data are the same.

[0190] When the image acquisition unit completes writing the first frame of image data, it continues to acquire the second frame of image data and writes it into the first storage unit, while the image correction unit and the display control unit still read the first frame of image data. At this time, two frames of image data are transmitted between the image acquisition unit, the image correction unit and the display control unit, that is, the first frame of image data and the second frame of image data are different.

[0191] The system of the present invention can flexibly process the same or different image data according to application requirements, improving the system's adaptability and flexibility. By setting different thresholds, the system can optimize data transmission efficiency, and higher thresholds can be set for more important or larger data frames to prioritize processing.

[0192] In another embodiment, the frame rate of the image acquisition unit and the image correction unit is a first frame rate, and the frame rate of the image correction unit and the display control unit is a second frame rate. The first frame rate and the second frame rate are different because the source of the image data transmitted between the image acquisition unit and the image correction unit is the image acquisition unit, but the source of the image data transmitted between the image correction unit and the display control unit is obtained from other memories in the system, and is not captured by the image acquisition unit.

[0193] At this time, although the image data transmission system can flexibly process a large amount of image data and ensure the real-time transmission and processing of key information, the image transmitted between the image acquisition unit and the image correction unit and the image transmitted between the image correction unit and the display control unit are different images because the sources of the images are different.

[0194] In summary, the image data transmission method specifically includes:

[0195] 1) If Figure 9 As shown, the system is set to the first working mode by default, and the working mode is determined according to the application identifier of the first target application. If it is the first working mode (no image display is required), the process continues.

[0196] In the first working mode, the image acquisition unit and the image correction unit participate in image data transmission, communicate with each other through a first channel, and enable the same frame rate for image data transmission.

[0197] The image acquisition unit acquires image data and writes it into the first storage unit. When the written amount reaches a first threshold, the image correction unit starts to read data from the first storage unit for processing. At this time, the written image data and the read image data are staggered.

[0198] The image correction unit processes the first frame of image data to ensure that the processed data is valid image data. In the first working mode, the processed data can be used for further analysis or storage instead of display.

[0199] The image correction unit detects the status signal csi_rdy and the counting signal csi_lint_cnt of the port of the image acquisition unit. Whenever csi_rdy and csi_lint_cnt are detected, the image correction unit generates a first read signal to inform the image correction unit of the row number of the data written into the first memory by the image acquisition unit, indicating that when the image acquisition unit runs to this row, the image correction unit is started to process the image. After that, the image correction unit will continue to work non-stop following the image acquisition unit.

[0200] In this operating mode, the output buffer of the image acquisition unit (i.e., the input buffer of the image correction unit) serves as the first memory. This first memory can employ a circular feedback loop (CFB) when storing and reading data, effectively reducing first memory usage. In normal operating mode, the buffer size required for the first memory is typically a full frame buffer (FB), determined by its width, height, and bits per pixel (bpp), calculated as width * height * bpp. In CFB mode, however, the required buffer size can be smaller than a full frame buffer.

[0201] 2) If Figure 10 and Figure 11 As shown, if it is the second working mode (needing to display an image), then jump to the corresponding processing flow. When the system needs to switch to the second working mode, the image correction unit and the display control unit communicate through the second channel, enabling the same frame rate for data transmission. At this time, the first channel is closed.

[0202] The image correction unit writes the corrected second frame image data into the second storage unit. When the writing amount reaches a second threshold, the display control unit starts to read data from the second storage unit for display.

[0203] When the image correction unit stores the processed image data in the first writing area of ​​the second memory and the first writing area is full, the image correction unit generates a second read signal (FB_Rdy) and sends it to the display control unit, causing the display control unit to read the data in the first writing area. Simultaneously, the image correction unit switches to writing data to the second writing area.

[0204] The display control unit generates a first completion signal (FB_Done) when it completes reading the first writing area and sends it to the image correction unit. After the image correction unit receives the first completion signal and the second writing area is full, it generates a third read signal (FB_Frm_Start) and sends it to the display control unit, allowing the display control unit to read the data from the second writing area. At the same time, the image correction unit switches to writing data to the first writing area. In this operating mode, the image correction unit continues to work non-stop with the display control unit.

[0205] During this time, if the second writing area is full but the display control unit has not yet finished reading the first writing area, it is necessary to wait for the display control unit to finish reading the first writing area. Alternatively, if the display control unit has finished reading but the second writing area is not full, it is necessary to wait for the second writing area to be full. Only then can the writing area between the image correction unit writing and the display control unit reading be switched.

[0206] This operating mode utilizes a line-based ping-pong frame buffer (LFB) to significantly reduce the overhead of the image correction unit's output buffer (i.e., the display control unit's input buffer). In normal operating mode, the buffer size required for the second memory is typically equal to a full frame buffer (FB). However, in LFB mode, the required buffer size can be smaller than a full frame buffer, effectively reducing memory usage.

[0207] The following table shows an example of FB size and buffer overhead for line-based ping-pong frame buffer mode.

[0208]

[0209] 3) In addition, if Figure 12 As shown, if the first channel remains turned on in the second working mode, that is, the first channel and the second channel are enabled at the same time, the system can process the same or different image data frames and set the same or different thresholds as needed.

[0210] When the image acquisition unit, image correction unit, and display control unit are in synchronized mode, their frame rates are the same, enabling rapid image data transmission and processing, resulting in rapid image display. In this synchronized mode, all three modules begin processing the same frame of image data almost simultaneously, resulting in very low latency across the entire data path.

[0211] And since only a small number of rows of data (perhaps only a few rows) need to be stored during the processing, the demand for storage is greatly reduced and the memory overhead is reduced.

[0212] This synchronization mode is particularly suitable for occasions with high real-time requirements, such as automotive ADAS systems and video surveillance systems. It can ensure real-time transmission and processing of image data and improve the response speed and efficiency of the system.

[0213] For example, a car driver needs to monitor the vehicle's surroundings in real time using an onboard camera system. In this case, the image acquisition unit captures image data from the camera at a frame rate of 30 fps. The image correction unit processes this data at the same 30 fps, performing tasks such as noise reduction and white balance adjustment. The display control unit then outputs the processed data to the display at a 30 fps frame rate.

[0214] like Figure 13 As shown, the delay is:

[0215] T1 + T2 = (M + N) lines / Pixel Frequency

[0216] Memory usage is:

[0217] M + 2N lines * Pixel bpp

[0218] Among them, the value range of M and N is M:[1,height], N: [1, height / 2], T0 indicates that the image acquisition unit starts writing the data of the new frame into the memory, T1 indicates that the image correction unit starts reading the data of this frame, and T2 indicates that the display control unit starts reading the data of this frame.

[0219] In another embodiment, the image acquisition unit and the image correction unit may also adopt the LFB mode to write and read data, and the image correction unit and the display control unit may also adopt the CFB mode to write and read data.

[0220] An embodiment of the present application also provides an image data transmission system, which includes an image acquisition unit, a first storage unit, an image correction unit, a second storage unit, and a display control unit connected in sequence, wherein the image acquisition unit is connected to the image correction unit via a first channel, and the image correction unit is connected to the display control unit via a second channel. The image correction unit is also connected to a lookup table (LUT), which is used for color management and conversion. The lookup table can convert a set of RGB values ​​into another set of RGB values, thereby changing the exposure and color of the picture. The display control unit is connected to a display unit, which is used to display an image. The display unit can be a liquid crystal module or an LED module, etc.

[0221] like Figure 7 As shown, the image data transmission system also includes:

[0222] a determining unit configured to determine, based on the acquired application identifier of the first target application, that the image data transmission system is in a first operating mode, wherein the first operating mode is an operating mode that does not require displaying images to a user;

[0223] a first transmission unit configured to, when determining that the image data transmission system is in the first operating mode, enable the image acquisition unit and the image correction unit to communicate through the first channel, wherein the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit;

[0224] When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit;

[0225] a switching unit configured to, in response to the acquired application identifier of a second target application, switch the first operating mode to a second operating mode, wherein the second operating mode is an operating mode requiring displaying an image to a user, and the first target application and the second target application are different applications;

[0226] a second transmission unit configured to, when determining to switch to the second operating mode, enable the image correction unit and the display control unit to communicate through the second channel, wherein the frame rate of the image correction unit is the same as the frame rate of the display control unit;

[0227] When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit;

[0228] An adjustment unit is configured to determine the state of the first channel when the second channel is enabled, and if the state of the first channel is enabled, adjust the frame rate of the image acquisition unit to be the same as the frame rate of the display control unit.

[0229] An embodiment of the present application further provides an electronic device, including a processor and a memory, wherein the memory stores an executable program, and the memory executes the executable program to perform the steps of the method described above.

[0230] An embodiment of the present application further provides a storage medium, which carries one or more computer programs. When the one or more computer programs are executed by a processor, the steps of the method described above are implemented.

[0231] An embodiment of the present application further provides a computer program product, comprising a computer program / instruction, wherein the computer program / instruction, when executed by a processor, implements the steps of the control method as described above.

[0232] The vehicle in the embodiments of this application may be "automobile," "vehicle," "complete vehicle," or other similar terms, including general motor vehicles, such as sedans, SUVs, MPVs, buses, trucks, and other cargo or passenger vehicles, watercraft including various ships and boats, and aircraft, including hybrid vehicles, electric vehicles, fuel vehicles, plug-in hybrid vehicles, fuel cell vehicles, and other alternative fuel vehicles. A hybrid vehicle refers to a vehicle with two or more power sources, and an electric vehicle includes a pure electric vehicle and an extended-range electric vehicle, etc., which is not specifically limited in this application.

[0233] It should be understood that in the embodiments of the present application, the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0234] It should also be understood that the memory mentioned in the embodiments of the present invention may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAMbus RAM (DR RAM).

[0235] It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, the memory (storage module) is integrated into the processor.

[0236] It should be noted that the memory described herein is intended to include, but not be limited to, these and any other suitable types of memory.

[0237] In addition to the data bus, the bus may also include a power bus, a control bus, a status signal bus, etc. However, for the sake of clarity, various buses are labeled as buses in the figure.

[0238] It should also be understood that the first, second, third, fourth and various numerical numbers involved in this document are only distinctions made for the convenience of description and are not intended to limit the scope of this application.

[0239] It should be understood that the term "and / or" in this document simply describes a relationship between related objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, the character " / " in this document generally indicates that the related objects are in an "or" relationship.

[0240] During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor or by instructions in the form of software. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it will not be described in detail here.

[0241] In various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0242] Those skilled in the art will appreciate that the various illustrative logical blocks (ILBs) and steps described in conjunction with the embodiments disclosed herein can be implemented using electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.

[0243] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0244] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0245] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0246] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server or data center to another website, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape) or an optical medium (e.g., a DVD) or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0247] The above embodiments are merely exemplary embodiments of the present application and are not intended to limit the scope of the present application. The scope of protection of the present application is defined by the claims. Those skilled in the art may make various modifications or equivalent substitutions to the present application within the essence and scope of protection of the present application, and such modifications or equivalent substitutions shall also be deemed to fall within the scope of protection of the present application.

Claims

1. A method for transmitting image data, characterized in that: Applied to an image data transmission system, the image data transmission system comprises an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit connected in sequence, the image acquisition unit is connected to the image correction unit via a first channel, the image correction unit is connected to the display control unit via a second channel, the method comprises: Based on the obtained application identifier of the first target application, determining that the image data transmission system is in a first working mode, wherein the first working mode is a working mode that does not need to display images to a user; When it is determined that the image data transmission system is in the first working mode, the image acquisition unit and the image correction unit enable the first channel for communication, and the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit. When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit; In response to the acquired application identifier of the second target application, switching the first working mode to a second working mode, wherein the second working mode is a working mode that requires displaying an image to a user, and the first target application and the second target application are different applications; When it is determined to switch to the second working mode, the image correction unit and the display control unit enable the second channel for communication, and the frame rate of the image correction unit is the same as the frame rate of the display control unit. When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit; The state of the first channel is determined when the second channel is enabled, and if the state of the first channel is enabled, the frame rate of the image acquisition unit is adjusted to be the same as the frame rate of the display control unit.

2. The image data transmission method according to claim 1, characterized in that: The determining that the image data transmission system is in the first working mode based on the acquired application identifier of the first target application includes: When it is determined that the first target application is started, obtaining an application identifier of the first target application; Based on the application identifier and the file mapping table, the image data transmission system is determined to be in the first working mode, wherein the file mapping table includes a mapping relationship between a target application and its corresponding working mode.

3. The image data transmission method according to claim 1, characterized in that: The image acquisition unit and the image correction unit enable the first channel to communicate, including: When at least one line of the first frame image data is written into the first storage unit, the image acquisition unit generates a counting signal, wherein the counting signal is used to represent the number of lines of the first frame image data written into the first storage unit; Based on the counting signal and a first threshold, the image acquisition unit generates a first reading signal; The first read signal is sent to the image correction unit through the first channel.

4. The image data transmission method according to claim 3, characterized in that: The method further comprises: Based on the counting signal, the image acquisition unit generates a status signal; The status signal is sent to the image correction unit through the first channel, wherein the status signal indicates that the image acquisition unit is in a valid working state.

5. The image data transmission method according to claim 1, characterized in that: When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit, including: Determine a first write position of the first storage unit, wherein the first write position includes a write start point and a write end point, and a plurality of write rows are between the write start point and the write end point; The image acquisition unit writes the first frame of image data in sequence from the writing start point to the writing end point, wherein the first frame of image data includes a plurality of lines of image data; When the writing amount reaches a first threshold, the image correction unit starts reading the first frame of image data from the writing starting point; When the plurality of writing lines are fully written, the image acquisition unit writes again from the writing starting point.

6. The image data transmission method according to claim 1, characterized in that: When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit, including: Determine a second writing position of the second storage unit, wherein the second writing position includes a first writing area and a second writing area; The image correction unit writes the second frame image data into the first writing area; When the first writing area is full, the image correction unit switches writing the second frame image data into the first writing area to writing into the second writing area, and the display control unit reads the second frame image data from the first writing area.

7. The image data transmission method according to claim 6, characterized in that: The image correction unit and the display control unit enable the second channel to communicate, including: When the first writing area is fully written, the image correction unit generates a second reading signal, and the second reading signal is sent to the display control unit through the second channel; Based on the second read signal, the display control unit reads the second frame image data from the first writing area, and the image correction unit switches writing the second frame image data into the first writing area to writing into the second writing area; When the second writing area is fully written, the image correction unit generates a third reading signal, and the third reading signal is sent to the display control unit through the second channel; When the display control unit completes reading the first writing area, the display control unit generates a first completion signal, and the first completion signal is sent to the image correction unit through the second channel; Based on the first completion signal and the third read signal, the display control unit reads the second frame image data from the second writing area, and the image correction unit switches writing the second frame image data in the second writing area to writing in the first writing area.

8. The image data transmission method according to claim 1, characterized in that: The method further comprises: When it is determined that the image data transmission system is in the first working mode, the image correction unit processes the first frame image data read from the first storage unit so that the processed first frame image data is valid image data.

9. The image data transmission method according to claim 1, characterized in that: The method further comprises: In the case where it is determined that the first channel and the second channel are enabled at the same time, the first frame image data is the same as or different from the second frame image data, and the first threshold is the same as or different from the second threshold.

10. An image data transmission system, characterized in that: The device comprises an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit connected in sequence, wherein the image acquisition unit is connected to the image correction unit via a first channel, and the image correction unit is connected to the display control unit via a second channel, and further comprises: A determining unit configured to determine, based on the acquired application identifier of the first target application, that the image data transmission system is in a first working mode, wherein the first working mode is a working mode that does not require displaying images to a user; a first transmission unit configured to, when determining that the image data transmission system is in the first working mode, enable the image acquisition unit and the image correction unit to communicate through the first channel, and the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit; When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit; a switching unit configured to switch the first working mode to a second working mode in response to the acquired application identifier of the second target application, wherein the second working mode is a working mode that requires displaying an image to a user, and the first target application and the second target application are different applications; a second transmission unit configured to, when it is determined to switch to the second working mode, enable the image correction unit and the display control unit to communicate through the second channel, and the frame rate of the image correction unit is the same as the frame rate of the display control unit; When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit; An adjustment unit is configured to determine the state of the first channel when the second channel is enabled, and if the state of the first channel is enabled, adjust the frame rate of the image acquisition unit to be the same as the frame rate of the display control unit.

Images