Image data transmission method and system

Abstract

The invention discloses an image data transmission method and system, the image data transmission method is applied to the image data transmission system, and the image data transmission system comprises an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit which are connected in sequence. The image acquisition unit is connected with the image correction unit through a first channel, the image correction unit is connected with the display control unit through a second channel, and the method comprises the following steps: determining that the image data transmission system is in a first working mode based on an obtained application identifier of a first target application, the first working mode is a working mode in which an image does not need to be displayed to a user. By improving the transmission and management modes of the image data, the system can maintain high performance, reduce memory occupation, reduce processing delay and provide a flexible operation mode to adapt to different application scenes.

Description

Technical Field

[0001] The present application relates to the technical field of data transmission, and in particular to a method and system for image data transmission. Background Art

[0002] In image data transmission systems, efficient management and processing of data streams is the key to achieving high-performance visual applications. For example, the image data captured by the vehicle’s camera serial interface (CSI) will be transmitted to the image correction unit for necessary correction before being displayed.

[0003] The image correction unit (Any Shape Warp Engine, ASW) or display controller (DisplayContoller, DC) must wait for the camera serial interface or image correction unit to completely write a frame of data to the memory before it can start reading and processing. This causes inherent delays in the data processing process and occupies more space, which cannot meet the user's real-time requirements. Summary of the invention

[0004] The purpose of the embodiment of the present application is to provide an image data transmission method and system, the image data transmission method is applied to an image data transmission system, the image data transmission system comprises an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit connected in sequence, the image acquisition unit is connected to the image correction unit through a first channel, the image correction unit is connected to the display control unit through a second channel, the method comprises: Based on the obtained application identifier of the first target application, determining that the image data transmission system is in a first working mode, wherein the first working mode is a working mode that does not need to display images to a user; When it is determined that the image data transmission system is in the first working mode, the image acquisition unit and the image correction unit enable the first channel for communication, and the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit. When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit; In response to the acquired application identifier of the second target application, switching the first working mode to a second working mode, wherein the second working mode is a working mode that requires displaying an image to a user, and the first target application and the second target application are different applications; When it is determined to switch to the second working mode, the image correction unit and the display control unit enable the second channel for communication, and the frame rate of the image correction unit is the same as the frame rate of the display control unit. When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit; The state of the first channel is determined when the second channel is enabled, and if the state of the first channel is enabled, the frame rate of the image acquisition unit is adjusted to be the same as the frame rate of the display control unit.

[0005] As an optional embodiment, determining that the image data transmission system is in the first working mode based on the acquired application identifier of the first target application includes: When it is determined that the first target application is started, obtaining an application identifier of the first target application; Based on the application identifier and the file mapping table, the image data transmission system is determined to be in the first working mode, wherein the file mapping table includes a mapping relationship between a target application and its corresponding working mode.

[0006] As an optional embodiment, the image acquisition unit and the image correction unit enable the first channel to communicate, including: When at least one line of the first frame image data is written into the first storage unit, the image acquisition unit generates a counting signal, wherein the counting signal is used to represent the number of lines of the first frame image data written into the first storage unit; Based on the counting signal and a first threshold, the image acquisition unit generates a first reading signal; The first read signal is sent to the image correction unit through the first channel.

[0007] As an optional embodiment, the method further includes: Based on the counting signal, the image acquisition unit generates a status signal; The status signal is sent to the image correction unit through the first channel, wherein the status signal indicates that the image acquisition unit is in a valid working state.

[0008] As an optional embodiment, when the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit, including: Determine a first write position of the first storage unit, wherein the first write position includes a write start point and a write end point, and a plurality of write rows are between the write start point and the write end point; The image acquisition unit writes the first frame of image data in sequence from the writing start point to the writing end point, wherein the first frame of image data includes a plurality of lines of image data; When the writing amount reaches a first threshold, the image correction unit starts reading the first frame of image data from the writing starting point; When the plurality of writing lines are fully written, the image acquisition unit writes again from the writing starting point.

[0009] As an optional embodiment, when the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit, including: Determine a second writing position of the second storage unit, wherein the second writing position includes a first writing area and a second writing area; The image correction unit writes the second frame image data into the first writing area; When the first writing area is full, the image correction unit switches writing the second frame image data into the first writing area to writing into the second writing area, and the display control unit reads the second frame image data from the first writing area. As an optional embodiment, the image correction unit and the display control unit enable the second channel for communication, including: When the first writing area is fully written, the image correction unit generates a second reading signal, and the second reading signal is sent to the display control unit through the second channel; Based on the second read signal, the display control unit reads the second frame image data from the first writing area, and the image correction unit switches writing the second frame image data into the first writing area to writing into the second writing area; When the second writing area is fully written, the image correction unit generates a third reading signal, and the third reading signal is sent to the display control unit through the second channel; When the display control unit completes reading the first writing area, the display control unit generates a first completion signal, and the first completion signal is sent to the image correction unit through the second channel; Based on the first completion signal and the third read signal, the display control unit reads the second frame image data from the second writing area, and the image correction unit switches writing the second frame image data in the second writing area to writing in the first writing area.

[0010] As an optional embodiment, the method further includes: When it is determined that the image data transmission system is in the first working mode, the image correction unit processes the first frame image data read from the first storage unit so that the processed first frame image data is valid image data.

[0011] As an optional embodiment, the method further includes: In the case where it is determined that the first channel and the second channel are enabled at the same time, the first frame image data is the same as or different from the second frame image data, and the first threshold is the same as or different from the second threshold.

[0012] The purpose of the embodiment of the present application is to provide an image data transmission system, comprising an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit connected in sequence, wherein the image acquisition unit is connected to the image correction unit via a first channel, and the image correction unit is connected to the display control unit via a second channel, and further comprising: A determining unit configured to determine, based on the acquired application identifier of the first target application, that the image data transmission system is in a first working mode, wherein the first working mode is a working mode that does not require displaying images to a user; a first transmission unit configured to, when determining that the image data transmission system is in the first working mode, enable the image acquisition unit and the image correction unit to communicate through the first channel, and the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit; When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit; a switching unit configured to switch the first working mode to a second working mode in response to the acquired application identifier of the second target application, wherein the second working mode is a working mode that requires displaying an image to a user, and the first target application and the second target application are different applications; a second transmission unit configured to, when it is determined to switch to the second working mode, enable the image correction unit and the display control unit to communicate through the second channel, and the frame rate of the image correction unit is the same as the frame rate of the display control unit; When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit; An adjustment unit is configured to determine the state of the first channel when the second channel is enabled, and if the state of the first channel is enabled, adjust the frame rate of the image acquisition unit to be the same as the frame rate of the display control unit.

[0013] The beneficial effects of the embodiments of the present application are: By improving the transmission and management methods of image data, the system can reduce memory usage and processing delay while maintaining high performance, and provide flexible operating modes to adapt to different application scenarios, thereby improving the performance of visual applications and user experience.

[0014] Among them, this application avoids the need to store the entire frame of data by optimizing the data processing process, thereby greatly reducing the amount of memory used. Not only does it save memory costs, but it also improves the operating efficiency of the system. Through the collaborative work and synchronous data processing of multiple modules, the system can achieve ultra-low latency data transmission and processing, so that the picture can be presented more quickly, meeting the application scenarios that require rapid response, and enhancing security and real-time performance. The system of this application can adjust the operating mode according to different usage environments and performance requirements, so as to meet diverse application needs while ensuring performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a flowchart of the image data transmission method according to an embodiment of the present application; Figure 2 The process of step S10 of the image data transmission method of the embodiment of the present application is as follows: Figure 1 ; Figure 3 This is a flowchart of step S20 of the image data transmission method according to an embodiment of the present application; Figure 4 This is a flowchart of step S21 of the image data transmission method according to an embodiment of the present application; Figure 5 This is a flowchart of step S41 of the image data transmission method according to an embodiment of the present application; Figure 6 This is a flowchart of step S40 of the image data transmission method according to an embodiment of the present application; Figure 7 This is a structural block diagram of the image data transmission system according to an embodiment of the present application; Figure 8 The process of step S10 of the image data transmission method of the embodiment of the present application is as follows: Figure 2 ; Fig. 9 This is a structural block diagram of the first working mode of an embodiment of the present application; Fig.10 This is a structural block diagram of the second working mode of an embodiment of the present application; Fig.11 A schematic diagram of the interaction between the image correction unit and the display control unit in an embodiment of the present application; Fig.12 This is a structural block diagram of another second working mode of an embodiment of the present application; Fig.13 A schematic diagram of the delay and memory usage of an embodiment of the present application. DETAILED DESCRIPTION

[0016] Various aspects and features of the present application are described herein with reference to the accompanying drawings.

[0017] It should be understood that various modifications may be made to the embodiments of the present application. Therefore, the above description should not be considered as limiting, but only as an example of an embodiment. Other modifications within the scope and spirit of the present application will occur to those skilled in the art.

[0018] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present application and, together with the general description of the present application given above and the detailed description of the embodiments given below, serve to explain the principles of the present application.

[0019] These and other characteristics of the present application will become apparent from the following description of a preferred form of embodiment given as a non-limiting example with reference to the accompanying drawings.

[0020] It should also be understood that although the present application has been described with reference to some specific examples, those skilled in the art will be able to readily implement many other equivalent forms of the present application.

[0021] The above and other aspects, features and advantages of the present application will become more apparent in view of the following detailed description when taken in conjunction with the accompanying drawings.

[0022] Specific embodiments of the present application are described hereinafter with reference to the accompanying drawings; however, it should be understood that the embodiments applied for are merely examples of the present application, which may be implemented in a variety of ways. Well-known and / or repeated functions and structures are not described in detail to avoid unnecessary or redundant details that obscure the present application. Therefore, the specific structural and functional details applied for herein are not intended to be limiting, but merely serve as a basis and representative basis for the claims to teach those skilled in the art to use the present application in a variety of ways with substantially any suitable detailed structure.

[0023] This specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," all of which may refer to one or more of the same or different embodiments according to the present application.

[0024] In the prior art, the image correction unit starts to read data only after the camera serial interface has completely written a frame to the memory. The data processed by the image correction unit must be completely written to the memory before the display controller starts to read the data. This consumes at least two frame buffer (FB) height lines of writing time on the path.

[0025] The camera serial interface needs to occupy two FB (height lines) of memory space to store data. The image correction unit also needs two FB (height lines) of memory space to store data. In addition, each process is relatively independent. For a frame of image, the next module can only process after the previous module has finished processing, which has a large delay and occupies a lot of memory.

[0026] In view of the above content, an embodiment of the present application provides an image data transmission method, which is applied to an image data transmission system, such as Fig.12 As shown, the image data transmission system includes an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit connected in sequence, the image acquisition unit is connected to the image correction unit through a first channel, and the image correction unit is connected to the display control unit through a second channel.

[0027] The first channel and the second channel are additional channels, which enable the image acquisition unit and the image correction unit to communicate, and enable the image correction unit and the display control unit to communicate.

[0028] like Figure 1 As shown, the image data transmission method dynamically adjusts the working mode according to the requirements of the target application to optimize resource usage and improve performance. The method includes: S100. Based on the obtained application identifier of the first target application, determine that the image data transmission system (hereinafter referred to as the system) is in a first working mode, wherein the first working mode is a working mode that does not require displaying images to the user.

[0029] In this embodiment, the first step of image data transmission is to determine the working mode of the image data transmission system, and determine the first working mode corresponding to the image data transmission system when using the target application through the application identifier of the first target application. For example, when the image data is used for background data analysis or image processing, it is not necessary to display the image to the user.

[0030] Different target applications have different application identifiers, and different mode identifiers indicate which working mode the target application should use. The working modes are divided according to different scenarios or requirements when the target application is used.

[0031] S200: When it is determined that the image data transmission system is in the first working mode, the image acquisition unit and the image correction unit enable the first channel for communication, and the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit. When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit.

[0032] In this embodiment, when the image data transmission system is in the first working mode, the image acquisition unit and the image correction unit communicate at the same frame rate through the first channel to ensure synchronous transmission of image data and avoid data processing delays caused by frame rate mismatch. The frame rate is usually measured in frames per second (FPS), which determines the smoothness of the displayed image.

[0033] If the writing speed of the image acquisition unit does not match the reading speed of the image correction unit, data overflow of the first storage unit may occur, thereby causing data loss or buffer overflow.

[0034] When the amount of data written by the image acquisition unit to the first storage unit reaches a preset first threshold, the image correction unit starts to read data from the first storage unit. The first threshold can be set to a certain proportion of the first storage unit, such as half or a quarter of the storage capacity, to ensure that sufficient image data is stored before the data is read.

[0035] S300, in response to the acquired application identifier of the second target application, switching the first working mode to a second working mode, wherein the second working mode is a working mode that requires displaying an image to a user, and the first target application and the second target application are different applications; In this embodiment, the system switches the operating mode from the first operating mode to the second operating mode in response to the application identifier of the second target application. The second operating mode requires displaying images to the user, such as real-time monitoring or a driver assistance system.

[0036] S400: When it is determined to switch to the second working mode, the image correction unit and the display control unit enable the second channel for communication, and the frame rate of the image correction unit is the same as the frame rate of the display control unit. When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit.

[0037] In this embodiment, in the second working mode, the image correction unit and the display control unit communicate at the same frame rate through the second channel, that is, the processing or display of image data is performed at a consistent speed, thereby ensuring the continuity and real-time performance of the image.

[0038] When the amount of data written by the image correction unit to the second storage unit reaches a preset second threshold, the display control unit starts to read data from the second storage unit. The second threshold is set to ensure that the display control unit has enough data to continuously display images, while avoiding interference of the reading operation with the writing operation of the image correction unit.

[0039] S500: determining the state of the first channel when the second channel is enabled, and if the state of the first channel is enabled, adjusting the frame rate of the image acquisition unit to be the same as the frame rate of the display control unit.

[0040] In this embodiment, when the second channel is enabled, the system checks the status of the first channel. If the first channel is still enabled, the system adjusts the frame rate of the image acquisition unit to be the same as the frame rate of the display control unit to ensure synchronous transmission of data.

[0041] At this time, the image data acquired by the image acquisition unit is stored in the first storage unit, the image correction unit reads the image data from the first storage unit, stores it in the second storage unit after processing, and the display control unit reads the processed image data from the second storage unit and displays it. The image processing performed by the image correction unit includes but is not limited to denoising, white balance adjustment, color correction, etc. to ensure image quality.

[0042] When the image data transmission system of the present application is working, the system first determines the current working mode based on the obtained application identifier. If the application identifier indicates that the image does not need to be displayed (such as a data storage application), the system is set to the first working mode; if the image needs to be displayed (such as a screen projection application), it is set to the second working mode.

[0043] In the first working mode, the image acquisition unit and the image correction unit communicate at the same frame rate through the first channel. When the writing amount of the first storage unit reaches the first threshold, the image correction unit starts to read data from the first storage unit for processing.

[0044] In the second working mode, the image correction unit and the display control unit communicate at the same frame rate through the second channel. When the writing amount of the second storage unit reaches the second threshold, the display control unit starts to read the corrected image data from the second storage unit for display.

[0045] Furthermore, when switching from the first working mode to the second working mode, the system checks the status of the first channel. If the first channel is still enabled, the system adjusts the frame rate of the image acquisition unit to the same frame rate as the display control unit to ensure synchronous transmission of data.

[0046] In this case, the image acquisition unit, the image correction unit and the display control unit work together at the same frame rate. The image acquisition unit writes the acquired image data into the first storage unit. When the writing amount of the first storage unit reaches the first threshold value, the image correction unit starts to read the data from the first storage unit for processing. The image correction unit writes the processed image data into the second storage unit. When the writing amount of the second storage unit reaches the second threshold value, the display control unit starts to read the corrected image data from the second storage unit for display.

[0047] The system of the present invention can flexibly switch working modes according to different application requirements and adapt to different usage scenarios. By dynamically adjusting the working mode and frame rate, the system can process and transmit image data more efficiently, reducing memory usage and processing delay. Moreover, by accurately controlling the timing of reading and writing data, the system can more effectively utilize storage and processing resources.

[0048] For example, 1) Figure 8 and Fig. 9 As shown, when the driver is driving the car normally, the driver turns on the driving recorder, the corresponding application (first target application) of the driving recorder is opened, the system obtains the application identifier of the driving recorder application, and switches to the first working mode according to the application identifier.

[0049] In the first working mode, according to the application identifier, the system determines that the first channel is enabled. The original image data acquired by the camera serial interface (image acquisition unit) is stored in the first memory (first storage unit). When the amount of the original image data stored in the first memory reaches one tenth of the storage capacity of the first memory (first threshold), the image correction unit reads the original image data from the first memory and stores or processes the image data before storing. At this time, the acquired image data is used for storage and does not need to be displayed to the driver or passengers.

[0050] 2) If Figure 8 and Fig.10As shown, when the driver is driving the car normally, the passenger in the front passenger seat opens the video playback application (the second target application), the system obtains the application identifier of the video playback application, and switches to the second working mode according to the application identifier.

[0051] In the second working mode, the system determines that the second channel is enabled according to the application identifier. The image correction unit corrects the acquired original image data (video on the Internet, video on a mobile phone or tablet) so that the image can be displayed normally when it is projected onto the display surface. For example, when the display surface is glass, the processed image can adapt to the curved surface structure of the glass.

[0052] The processed image data is stored in the second memory (second storage unit). When the amount of the processed image data stored in the second memory reaches one-half of the storage capacity of the second memory (second threshold), the display control unit reads the processed image data from the second memory and displays the image data. At this time, the acquired image data needs to be displayed to the passengers.

[0053] 3) If Figure 8 and Fig.12 As shown, when the driver is driving the car normally, he wants to use the electronic rearview mirror to improve his perception of the situation behind the vehicle. At this time, the image data needs to be processed quickly and displayed to the user.

[0054] The driver turns on the electronic rearview mirror, and the corresponding application (second target application) of the electronic rearview mirror is opened. The system obtains the application identifier of the application in the driving record and switches to the second working mode according to the application identifier.

[0055] In the second working mode, according to the application identifier, the system determines that both the first channel and the second channel are enabled. The original image data acquired by the camera serial interface (image acquisition unit) is stored in the first memory (first storage unit). When the amount of the original image data stored in the first memory reaches one tenth of the storage capacity of the first memory (first threshold), the image correction unit reads the original image data from the first memory and processes the image data. The processed image data is stored in the second memory (second storage unit). When the amount of the processed image data stored in the second memory reaches one half of the storage capacity of the second memory (second threshold), the display control unit reads the processed image data from the second memory and displays the image data.

[0056] In one embodiment, if Figure 2 and Figure 8 As shown, the determining that the image data transmission system is in the first working mode based on the acquired application identifier of the first target application includes: S101. When it is determined that a first target application is started, obtain an application identifier of the first target application.

[0057] In this embodiment, when the system monitors the startup status of multiple applications, the application in the startup state among the multiple applications is the first target application, and the application started subsequently is the second target application.

[0058] S102: Determine that the image data transmission system is in a first working mode based on the application identifier and the file mapping table, wherein the file mapping table includes a mapping relationship between a target application and its corresponding working mode.

[0059] In this embodiment, the system consults the file mapping table and determines the corresponding working mode according to the application identifier. If the application identifier corresponds to a working mode that requires displaying images to the user, the system needs to switch to the second working mode; if the application identifier corresponds to a working mode that does not require displaying images to the user, the system needs to switch to the first working mode.

[0060] After determining the working mode, the system will synchronize the frame rates of the image acquisition unit and the image correction unit and / or the frame rates of the image correction unit and the display control unit to ensure efficient data transmission.

[0061] The first target application is different from the second target application, and has different application identifiers, and different application identifiers correspond to different working modes. Therefore, when the system recognizes different application identifiers and determines that the required working modes are different, the working mode needs to be switched.

[0062] In addition, if the first target application is the same as the second target application, it means that their application types are the same or the requirements provided to the user during operation are the same, for example, neither needs to display images to the user or both need to display images to the user. Therefore, even if the system recognizes different application identifiers, it can be determined based on the application identifier that the required working modes are the same, and there is no need to switch the working mode.

[0063] The present invention determines the working mode based on the application identifier, and the system can flexibly adjust its working mode according to different application requirements, thereby optimizing resource usage and performance. By synchronizing the frame rate and timely data transmission, the system can reduce the delay of data processing and improve the speed of image processing.

[0064] In one embodiment, if Figure 3 and Fig. 9 As shown, the image acquisition unit and the image correction unit enable the first channel to communicate, including: S201. When at least one line of the first frame image data is written into the first storage unit, the image acquisition unit generates a counting signal, wherein the counting signal is used to represent the number of lines of the first frame image data written into the first storage unit.

[0065] In this embodiment, the image acquisition unit starts to capture the environment image and writes the data into the first storage unit. Whenever the first storage unit writes a line of image data, the image acquisition unit generates a counting signal to record the number of lines written, which is helpful for subsequent processing and storage.

[0066] S202: Based on the counting signal and a first threshold, the image acquisition unit generates a first reading signal.

[0067] In this embodiment, when the number of rows indicated by the counting signal reaches a preset first threshold, the image acquisition unit generates a first read signal, wherein the first threshold may be 10 rows.

[0068] S203 . Send the first reading signal to the image correction unit through the first channel.

[0069] In this embodiment, the first read signal instructs the image correction unit to start reading the image data in the first storage unit. After receiving the read signal, the image correction unit starts reading the image data from the first storage unit and performs necessary correction processing.

[0070] Exemplarily, in a driving recorder, when the camera starts recording and writes image data to the first memory, the system generates a counting signal (csi_lint_cnt) to track the number of lines written. When the amount of writing of the image acquisition unit reaches a set threshold (such as 10 lines of image data written), the system generates a first read signal to indicate that the image correction unit can start reading data for processing. The image correction unit reads the image data and starts processing the recorded image data to ensure that relevant video information can be quickly acquired and analyzed in the event of an accident.

[0071] The present invention can ensure the effective transmission of image data between the first storage unit and the image correction unit through the mechanism of counting signals and reading signals, and reduce the risk of data loss and errors. The method allows the image correction unit to start processing data immediately when a specific condition (such as the amount of writing reaches a first threshold) is met, thereby improving the real-time nature of data processing. By controlling the timing of data reading, system resources such as storage and processing capabilities can be more effectively utilized, especially when the amount of data is large or the processing capability is limited.

[0072] In one embodiment, if Figure 3 and Fig. 9 As shown, the method also includes: S204, the image acquisition unit generates a status signal based on the counting signal; S205. The status signal is sent to the image correction unit through the first channel, wherein the status signal indicates that the image acquisition unit is in a valid working state.

[0073] In this embodiment, the state signal (csi_rdy) can allow the image correction unit to understand the working state of the image acquisition unit to ensure the effectiveness of data transmission.

[0074] If during the image data transmission process, the counting signal is sent without an accompanying status signal, or the status signal displays an abnormality, this means that there is a problem with the communication between the image acquisition unit and the image correction unit or there is a problem with the image acquisition unit.

[0075] In this case, if the status signal is missing, the image acquisition unit may resend the counting signal and wait for the status signal to be regenerated to ensure the integrity and reliability of data transmission.

[0076] If the status signal shows an abnormality, the image acquisition unit can start the abnormality detection process to check whether the problem is caused by hardware failure, software error or communication interference, and issue an alarm to prompt the operator to check or intervene. If there is a problem with the first channel, it can switch to the backup communication channel to ensure that data transmission is not affected. And the system can be designed to recover automatically, for example, suspend data transmission, wait for a period of time or try self-diagnosis, and then restart data transmission.

[0077] In the present invention, through the transmission of the status signal, the image correction unit can timely understand the working status of the image acquisition unit, thereby improving the reliability of data transmission and the stability of the system.

[0078] In one embodiment, if Figure 4 As shown, when the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit, including: S211. Determine a first write position of the first storage unit, wherein the first write position includes a write start point and a write end point, and a plurality of write rows are between the write start point and the write end point.

[0079] In this embodiment, the write start point is the start position of data writing, and the write end point is the end position of data writing. Determining the write position helps manage storage space, ensure that data can be written in an orderly manner, and avoid data overwriting or loss.

[0080] S212. The image acquisition unit writes the first frame of image data in sequence from the writing start point to the writing end point, wherein the first frame of image data includes a plurality of lines of image data.

[0081] In this embodiment, the image data is written into the storage unit row by row in the order of rows. This sequential writing method ensures the integrity and readability of the image data and facilitates subsequent image processing and analysis.

[0082] S213: When the writing amount reaches a first threshold, the image correction unit starts reading the first frame of image data from the writing starting point.

[0083] In this embodiment, the image correction unit can start processing immediately when the data volume reaches the first threshold, thereby improving the real-time performance of data processing.

[0084] S214: When the plurality of writing rows are fully written, the image acquisition unit writes again from the writing starting point.

[0085] In this embodiment, a cyclic writing mechanism is used to ensure continuous data collection and storage, thereby avoiding data loss due to insufficient storage space.

[0086] Exemplarily, the storage unit (such as SD card) of the driving recorder is divided into a plurality of write rows. The system determines the write start point as the start position of the storage unit and the write end point as a certain position of the storage unit, so as to subsequently write the image data.

[0087] When the camera starts recording a video, the image acquisition unit writes the captured image data into the first storage unit line by line. For example, the first few lines of data of the first frame of image are written into the first few lines of the storage unit.

[0088] When the amount of data written in the first storage unit reaches a set first threshold (e.g., 10 lines of image data are written), the image acquisition unit generates a first read signal, and the first read signal is sent to the image correction unit through the first channel, instructing it to start reading the first frame of image data. After receiving the first read signal, the image correction unit starts to read the data from the writing starting point and performs processing, such as denoising and correction.

[0089] Once the write row of the first storage unit is full, the image acquisition unit will restart writing new image data from the write starting point, forming a circular write mechanism. This ensures that the dashcam can continue to record video without interruption due to insufficient storage space. In this way, the system can efficiently manage the acquisition, storage and processing of image data, ensuring that the dashcam can record and save important image data in real time while driving.

[0090] The present invention can ensure the high efficiency and stability of data transmission by accurately controlling the writing position and the first threshold. The image correction unit can start processing immediately when the data volume reaches the first threshold, thereby improving the real-time performance of data processing. The cyclic writing mechanism ensures that the data is correctly stored in the first storage unit, thereby avoiding data loss.

[0091] In one embodiment, if Figure 5 and Fig.11 As shown, when the amount of the second frame image data written by the image correction unit into the second storage unit after correction reaches a second threshold, the display control unit reads the second frame image data from the second storage unit, including: S411, determining a second writing position of the second storage unit, wherein the second writing position includes a first writing area and a second writing area; In this embodiment, the system determines the second writing position of the second storage unit, which is divided into two areas: a first writing area and a second writing area. These two areas together constitute the storage space for the second frame image data. This partitioning allows the system to switch to another area after one area is filled, thereby achieving continuous data writing and reading.

[0092] S412, the image correction unit writes the second frame image data into the first writing area; In this embodiment, the image data is first stored in the first partition of the second storage unit, and writing in sequence ensures the organization and integrity of the data, which facilitates subsequent reading and processing. The second writing area can also be set as the first partition.

[0093] S413. When the first writing area is full, the image correction unit switches writing the second frame image data into the first writing area to writing into the second writing area, and the display control unit reads the second frame image data from the first writing area. In this embodiment, when the first writing area is full, the image correction unit switches to the second writing area for writing. At the same time, the display control unit starts to read the second frame of image data from the first writing area.

[0094] The present invention can ensure continuous data writing by switching to the second writing area when the first writing area is full, avoiding data loss or delay caused by waiting for storage space. The display control unit can read data from the first writing area in time, improving the real-time performance of data processing. The system can dynamically adjust resource allocation according to the amount of data, thereby improving the overall efficiency of the system.

[0095] Exemplarily, the second storage unit of the vehicle-mounted video monitoring system is divided into two areas: a first writing area and a second writing area. For example, if the total capacity of the storage unit is 32 GB, each area may be set to 16 GB.

[0096] When the vehicle is started, the front camera starts to capture the road conditions and writes the image data to the first writing area. The system may record 1080p video at 30 frames per second, and the data is written sequentially to the first area.

[0097] When the first writing area is close to full (e.g. 16GB space is exhausted), the system automatically switches to the second writing area to continue writing new image data. At the same time, the display control unit starts reading the recorded video stream from the first writing area for real-time display on the screen of the vehicle infotainment system or for further processing and analysis.

[0098] In this way, the vehicle video surveillance system can ensure continuous recording and processing of image data in a constantly changing traffic environment, providing drivers with real-time road condition information and enhancing driving safety. At the same time, this dual workspace mechanism also helps to optimize data storage and access efficiency when storage space is limited.

[0099] In one embodiment, if Figure 6 and Fig.11 As shown, the image correction unit and the display control unit enable the second channel to communicate, including: S401 . When the first writing area is fully written, the image correction unit generates a second reading signal, and the second reading signal is sent to the display control unit through the second channel.

[0100] In this embodiment, the second read signal prompts the display control unit that the data in the first writing area is ready to be read, and the image correction unit is ready to switch to the second writing area to continue writing data.

[0101] S402: based on the second read signal, the display control unit reads the second frame of image data from the first writing area, and the image correction unit switches writing the second frame of image data into the first writing area to writing into the second writing area; In this embodiment, the display control unit reads the second frame image data from the first writing area based on the second read signal, and the image correction unit switches the data writing from the first writing area to the second writing area, ensuring continuous writing and reading of data, and the data flow will not be interrupted even when one area is full.

[0102] S403: when the second writing area is fully written, the image correction unit generates a third reading signal, and the third reading signal is sent to the display control unit through the second channel; In this embodiment, the third read signal prompts the display control unit that the data in the second writing area is ready to be read and is ready for the next data switching.

[0103] S404: When the display control unit completes reading the first writing area, the display control unit generates a first completion signal, and the first completion signal is sent to the image correction unit through the second channel; In this embodiment, the first completion signal confirms that the data in the first writing area has been successfully read, allowing the image correction unit to safely switch the writing area.

[0104] S405. Based on the first completion signal and the third read signal, the display control unit reads the second frame image data from the second writing area, and the image correction unit switches writing the second frame image data into the second writing area to writing into the first writing area.

[0105] In this embodiment, the display control unit reads the second frame image data from the second writing area, and the image correction unit switches the data writing from the second writing area back to the first writing area, completing a cycle of writing and reading, ensuring the continuous flow of data and effective use of storage space.

[0106] Specifically, the image correction unit writes the acquired image data into the first writing area of ​​the second storage unit.

[0107] When the first writing area is full, the image correction unit generates a second read signal (FB_Rdy) and sends it to the display control unit through the second channel. After receiving the second read signal, the display control unit starts to read the second frame image data from the first writing area, and the image correction unit switches the data writing to the second writing area.

[0108] When the second writing area is full, the image correction unit generates a third read signal (FB_Frm_Start) and sends it to the display control unit through the second channel. After reading the first writing area, the display control unit generates a first completion signal (FB_Done) and sends it to the image correction unit through the second channel.

[0109] Based on the first completion signal and the third read signal, the display control unit starts to read the second frame of image data from the second writing area, and the image correction unit switches the data writing back to the first writing area. The system continues to monitor the status of the writing area and generates corresponding signals when necessary to ensure continuous writing and reading of data.

[0110] The present invention ensures continuous writing and reading of data by automatically switching the writing area and generating corresponding reading signals when the writing is full, thereby avoiding data loss and delay. The display control unit can read data from the corresponding writing area in time, thereby improving the real-time performance of data processing. Furthermore, through the generation and response of signals, the system can flexibly process data streams, thereby ensuring the stability and reliability of data transmission.

[0111] For example, in an advanced driver assistance system (ADAS) of a car, when the data from the front camera fills up the first writing area, the image correction unit notifies the display control unit to start reading the data and simultaneously starts writing new data in the second writing area.

[0112] The display control unit reads data from the first writing area for real-time display, and the image correction unit writes new data into the second writing area.

[0113] When the second writing area is also filled, the image correction unit notifies the display control unit to prepare to read the data in the second writing area, and after the display control unit finishes reading the data in the first writing area, notifies the image correction unit that it can safely switch the writing area.

[0114] At this time, the display control unit starts to read data from the second writing area, and the image correction unit switches back to the first writing area to continue writing new data, completing the cycle.

[0115] In one embodiment, the method further comprises: When it is determined that the image data transmission system is in the first working mode, the image correction unit processes the first frame image data read from the first storage unit so that the processed first frame image data is valid image data.

[0116] In this embodiment, the image correction unit not only needs to read the first frame image data from the first storage unit, but also needs to process the first frame image data to ensure that the processed first frame image data is valid image data.

[0117] During the image acquisition process, some invalid or redundant image areas may be captured. Through the processing of the image correction unit, these invalid areas are removed, ensuring that the data for subsequent processing and analysis is valid. In addition, this can reduce the storage space occupied, so that limited storage resources can be used to save more useful image information.

[0118] For example, in the advanced driver assistance system (ADAS) of a car, the images captured by the camera may contain important information such as vehicles, pedestrians, and traffic signs, but may also contain some invalid background areas. The image correction unit removes redundant background areas and retains key traffic information by cropping and correcting these image data, thereby providing accurate data support for subsequent image analysis and decision-making.

[0119] In one embodiment, the method further comprises: In the case where it is determined that the first channel and the second channel are enabled at the same time, the first frame image data is the same as or different from the second frame image data, and the first threshold is the same as or different from the second threshold.

[0120] In this embodiment, the image data transmission system can enable the first channel and the second channel for communication at the same time. In this mode, the first frame image data and the second frame image data can be the same or different, and the first threshold and the second threshold can also be the same or different.

[0121] Specifically, the image acquisition unit stores the acquired first frame image data into the first storage unit, the image correction unit reads and processes the first frame image data from the first storage unit, the processed first frame image data is stored in the second storage unit, and the display control unit reads and displays the first frame image data from the second storage unit. At this time, the image acquisition unit, the image correction unit and the display control unit transmit the same frame image data to each other, that is, the first frame image data and the second frame image data are the same.

[0122] When the image acquisition unit completes writing the first frame of image data, it continues to acquire the second frame of image data and writes it into the first storage unit, while the image correction unit and the display control unit still read the first frame of image data. At this time, two frames of image data are transmitted between the image acquisition unit, the image correction unit and the display control unit, that is, the first frame of image data and the second frame of image data are different.

[0123] The system of the present invention can flexibly process the same or different image data according to application requirements, thereby improving the adaptability and flexibility of the system. By setting different thresholds, the system can optimize the efficiency of data transmission, and a higher threshold can be set for more important or larger data frames for priority processing.

[0124] In another embodiment, the frame rate of the image acquisition unit and the image correction unit is a first frame rate, and the frame rate of the image correction unit and the display control unit is a second frame rate. The first frame rate is different from the second frame rate because the source of the image data transmitted between the image acquisition unit and the image correction unit is the image acquisition unit, but the source of the image data transmitted between the image correction unit and the display control unit is obtained from other memories in the system, not acquired by the image acquisition unit.

[0125] At this time, although the image data transmission system can flexibly process a large amount of image data and ensure the real-time transmission and processing of key information, the image transmitted between the image acquisition unit and the image correction unit and the image transmitted between the image correction unit and the display control unit are different images because the sources of the images are not the same.

[0126] In summary, the image data transmission method specifically includes: 1) If Fig. 9 As shown, the system is set to the first working mode by default, and the working mode is determined according to the application identifier of the first target application. If it is the first working mode (no image display is required), the process continues.

[0127] In the first working mode, the image acquisition unit and the image correction unit participate in the image data transmission. The image acquisition unit and the image correction unit communicate through the first channel and enable the same frame rate to perform image data transmission.

[0128] The image acquisition unit acquires image data and writes it into the first storage unit. When the writing amount reaches a first threshold, the image correction unit starts to read data from the first storage unit for processing, and at this time, the written image data and the read image data are staggered.

[0129] The image correction unit processes the first frame of image data to ensure that the processed data is valid image data. In the first working mode, the processed data can be used for further analysis or storage instead of display.

[0130] The image correction unit detects the status signal csi_rdy and the counting signal csi_lint_cnt of the port of the image acquisition unit, and generates a first read signal whenever csi_rdy and csi_lint_cnt are detected, thereby informing the image correction unit of the row number of the data written into the first memory by the image acquisition unit, indicating that when the image acquisition unit runs to this row, the image correction unit is started to process the image, and then the image correction unit will continue to work without stopping following the image acquisition unit.

[0131] In this working mode, the output buffer of the image acquisition unit (i.e., the input buffer of the image correction unit) is the first memory. When storing and reading data, the first memory can adopt a circular feedback mode (Circular FB, CFB), which can effectively reduce the usage of the first memory. In the normal working mode, the buffer size required by the first memory is usually a complete frame buffer (FB), and its size is determined by the width (width), height (height) and the number of bits per pixel (bpp), and the calculation formula is width * height * bpp. In CFB mode, the required buffer size can be smaller than a complete frame buffer.

[0132] 2) If Fig.10 and Fig.11 As shown, if it is the second working mode (need to display an image), jump to the corresponding processing flow. When the system needs to switch to the second working mode, the image correction unit communicates with the display control unit through the second channel and enables the same frame rate for data transmission. And, at this time, the first channel is closed.

[0133] The image correction unit writes the corrected second frame image data into the second storage unit. When the writing amount reaches the second threshold value, the display control unit starts to read data from the second storage unit for display.

[0134] When the image correction unit stores the processed image data in the first writing area of ​​the second memory, when the first writing area is full, the image correction unit generates a second read signal (FB_Rdy) and sends it to the display control unit, so that the display control unit reads the data in the first writing area. At the same time, the image correction unit switches to write data to the second writing area.

[0135] The display control unit completes reading the first writing area and generates a first completion signal (FB_Done), and sends it to the image correction unit. The image correction unit receives the first completion signal, and when the second writing area is full, the image correction unit generates a third read signal (FB_Frm_Start) and sends it to the display control unit, so that the display control unit reads the data in the second writing area. At the same time, the image correction unit switches to writing data to the first writing area. In this working mode, the image correction unit will continue to work with the display control unit.

[0136] During this period, if the second writing area is full but the display control unit has not finished reading the first writing area, it is necessary to wait for the display control unit to finish reading the first writing area. Alternatively, if the display control unit has finished reading but the second writing area is not full, it is necessary to wait for the second writing area to be full. Only then can the writing area written by the image correction unit and the writing area read by the display control unit be switched.

[0137] In this working mode, a line based Ping Pang Frame Buffer (LFB) is used, which can significantly reduce the overhead of the output buffer of the image correction unit (i.e., the input buffer of the display control unit). In the normal working mode, the buffer size required by the second memory is usually equal to a complete frame buffer (FB), but in the LFB mode, the required buffer size can be less than a complete frame buffer, thereby effectively reducing the memory usage.

[0138] The following table shows an example of FB size and buffer overhead for line-based ping-pong frame buffer mode.

[0139]

[0140] 3) In addition, if Fig.12 As shown, if the first channel remains turned on in the second working mode, that is, the first channel and the second channel are enabled at the same time, the system can process the same or different image data frames and set the same or different thresholds as needed.

[0141] At this time, when the three modules of the image acquisition unit, image correction unit and display control unit are in synchronization mode, their frame rates are the same to achieve fast image data transmission and processing, so as to quickly display the image. In this synchronization mode, the three modules start processing the image data of the same frame almost at the same time, making the delay of the entire data path very low.

[0142] And because only a small number of rows of data (perhaps only a few rows) need to be stored during the processing, the demand for storage is greatly reduced and the memory overhead is reduced.

[0143] This synchronization mode is particularly suitable for occasions with high real-time requirements, such as automotive ADAS systems, video surveillance systems, etc. It can ensure real-time transmission and processing of image data and improve the response speed and efficiency of the system.

[0144] For example, a driver of a car needs to monitor the situation around the vehicle in real time through the on-board camera system. In this case, the image acquisition unit captures image data from the camera at a frame rate of 30fps, the image correction unit processes the data at the same 30fps frame rate, such as denoising, white balance adjustment, etc., and the display control unit outputs the processed data to the display screen at a frame rate of 30fps.

[0145] like Fig.13 As shown, the delay is: T1 + T2 = (M + N) lines / Pixel Frequency Memory usage is: M + 2N lines * Pixel bpp Among them, the value range of M and N is M: [1, height], N: [1, height / 2], T0 indicates that the image acquisition unit starts writing the data of a new frame into the memory, T1 indicates that the image correction unit starts reading the data of this frame, and T2 indicates that the display control unit starts reading the data of this frame.

[0146] In another embodiment, the image acquisition unit and the image correction unit may also adopt the LFB mode to write and read data, and the image correction unit and the display control unit may also adopt the CFB mode to write and read data.

[0147] The embodiment of the present application also provides an image data transmission system, which includes an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit connected in sequence, wherein the image acquisition unit is connected to the image correction unit via a first channel, and the image correction unit is connected to the display control unit via a second channel. The image correction unit is also connected to a lookup table (LUT), which is used for color management and conversion, and it can convert a set of RGB values ​​into another set of RGB values, thereby changing the exposure and color of the picture. The display control unit is connected to a display unit, and the display unit is used to display an image. The display unit can be a liquid crystal module or an LED module, etc.

[0148] like Figure 7 As shown, the image data transmission system also includes: A determining unit configured to determine, based on the acquired application identifier of the first target application, that the image data transmission system is in a first working mode, wherein the first working mode is a working mode that does not require displaying images to a user; a first transmission unit configured to, when determining that the image data transmission system is in the first working mode, enable the image acquisition unit and the image correction unit to communicate through the first channel, and the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit; When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit; a switching unit configured to switch the first working mode to a second working mode in response to the acquired application identifier of the second target application, wherein the second working mode is a working mode that requires displaying an image to a user, and the first target application and the second target application are different applications; a second transmission unit configured to, when it is determined to switch to the second working mode, enable the image correction unit and the display control unit to communicate through the second channel, and the frame rate of the image correction unit is the same as the frame rate of the display control unit; When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit; An adjustment unit is configured to determine the state of the first channel when the second channel is enabled, and if the state of the first channel is enabled, adjust the frame rate of the image acquisition unit to be the same as the frame rate of the display control unit.

[0149] An embodiment of the present application further provides an electronic device, including a processor and a memory, wherein the memory stores an executable program, and the memory executes the executable program to perform the steps of the method described above.

[0150] An embodiment of the present application further provides a storage medium, wherein the storage medium carries one or more computer programs, and when the one or more computer programs are executed by a processor, the steps of the method described above are implemented.

[0151] An embodiment of the present application also provides a computer program product, including a computer program / instruction, characterized in that when the computer program / instruction is executed by a processor, the steps of the control method as described above are implemented.

[0152] The vehicle in the embodiments of the present application may be "car", "vehicle" and "entire vehicle" or other similar terms including general motor vehicles, such as sedans, SUVs, MPVs, buses, trucks and other cargo or passenger vehicles, watercraft including various ships and boats, and aircraft, etc., including hybrid vehicles, electric vehicles, fuel vehicles, plug-in hybrid vehicles, fuel cell vehicles and other alternative fuel vehicles. Among them, hybrid vehicles refer to vehicles with two or more power sources, and electric vehicles include pure electric vehicles, extended-range electric vehicles, etc., which are not specifically limited in the present application.

[0153] It should be understood that in the embodiments of the present application, the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.

[0154] It should also be understood that the memory mentioned in the embodiments of the present invention may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DR RAM).

[0155] It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, the memory (storage module) is integrated in the processor.

[0156] It should be noted that the memory described herein is intended to include, without being limited to, these and any other suitable types of memory.

[0157] In addition to the data bus, the bus may also include a power bus, a control bus, a status signal bus, etc. However, for the sake of clarity, various buses are marked as buses in the figure.

[0158] It should also be understood that the first, second, third, fourth and various numerical numbers involved in this document are only distinctions made for the convenience of description and are not intended to limit the scope of the present application.

[0159] It should be understood that the term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0160] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software modules in a processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.

[0161] In various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0162] Those skilled in the art will appreciate that the various illustrative logical blocks (ILBs) and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or in a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0163] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0164] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0165] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0166] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape) or an optical medium (e.g., a DVD) or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0167] The above embodiments are only exemplary embodiments of the present application and are not intended to limit the present application. The protection scope of the present application is defined by the claims. Those skilled in the art may make various modifications or equivalent substitutions to the present application within the essence and protection scope of the present application, and such modifications or equivalent substitutions shall also be deemed to fall within the protection scope of the present application.

Claims

1. A method for transmitting image data, characterized in that: Applied to an image data transmission system, the image data transmission system comprises an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit connected in sequence, the image acquisition unit is connected to the image correction unit via a first channel, the image correction unit is connected to the display control unit via a second channel, the method comprises: Based on the obtained application identifier of the first target application, determining that the image data transmission system is in a first working mode, wherein the first working mode is a working mode that does not need to display images to a user; When it is determined that the image data transmission system is in the first working mode, the image acquisition unit and the image correction unit enable the first channel for communication, and the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit. When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit; In response to the acquired application identifier of the second target application, switching the first working mode to a second working mode, wherein the second working mode is a working mode that requires displaying an image to a user, and the first target application and the second target application are different applications; When it is determined to switch to the second working mode, the image correction unit and the display control unit enable the second channel for communication, and the frame rate of the image correction unit is the same as the frame rate of the display control unit. When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit; The state of the first channel is determined when the second channel is enabled, and if the state of the first channel is enabled, the frame rate of the image acquisition unit is adjusted to be the same as the frame rate of the display control unit.

2. The image data transmission method according to claim 1, characterized in that: The determining that the image data transmission system is in the first working mode based on the acquired application identifier of the first target application includes: When it is determined that the first target application is started, obtaining an application identifier of the first target application; Based on the application identifier and the file mapping table, the image data transmission system is determined to be in the first working mode, wherein the file mapping table includes a mapping relationship between a target application and its corresponding working mode.

3. The image data transmission method according to claim 1, characterized in that: The image acquisition unit and the image correction unit enable the first channel to communicate, including: When at least one line of the first frame image data is written into the first storage unit, the image acquisition unit generates a counting signal, wherein the counting signal is used to represent the number of lines of the first frame image data written into the first storage unit; Based on the counting signal and a first threshold, the image acquisition unit generates a first reading signal; The first read signal is sent to the image correction unit through the first channel.

4. The image data transmission method according to claim 3, characterized in that: The method further comprises: Based on the counting signal, the image acquisition unit generates a status signal; The status signal is sent to the image correction unit through the first channel, wherein the status signal indicates that the image acquisition unit is in a valid working state.

5. The image data transmission method according to claim 1, characterized in that: When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit, including: Determine a first write position of the first storage unit, wherein the first write position includes a write start point and a write end point, and a plurality of write rows are between the write start point and the write end point; The image acquisition unit writes the first frame of image data in sequence from the writing start point to the writing end point, wherein the first frame of image data includes a plurality of lines of image data; When the writing amount reaches a first threshold, the image correction unit starts reading the first frame of image data from the writing starting point; When the plurality of writing lines are fully written, the image acquisition unit writes again from the writing starting point.

6. The image data transmission method according to claim 1, characterized in that: When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit, including: Determine a second writing position of the second storage unit, wherein the second writing position includes a first writing area and a second writing area; The image correction unit writes the second frame image data into the first writing area; When the first writing area is full, the image correction unit switches writing the second frame image data into the first writing area to writing into the second writing area, and the display control unit reads the second frame image data from the first writing area.

7. The image data transmission method according to claim 6, characterized in that: The image correction unit and the display control unit enable the second channel to communicate, including: When the first writing area is fully written, the image correction unit generates a second reading signal, and the second reading signal is sent to the display control unit through the second channel; Based on the second read signal, the display control unit reads the second frame image data from the first writing area, and the image correction unit switches writing the second frame image data into the first writing area to writing into the second writing area; When the second writing area is fully written, the image correction unit generates a third reading signal, and the third reading signal is sent to the display control unit through the second channel; When the display control unit completes reading the first writing area, the display control unit generates a first completion signal, and the first completion signal is sent to the image correction unit through the second channel; Based on the first completion signal and the third read signal, the display control unit reads the second frame image data from the second writing area, and the image correction unit switches writing the second frame image data in the second writing area to writing in the first writing area.

8. The image data transmission method according to claim 1, characterized in that: The method further comprises: When it is determined that the image data transmission system is in the first working mode, the image correction unit processes the first frame image data read from the first storage unit so that the processed first frame image data is valid image data.

9. The image data transmission method according to claim 1, characterized in that: The method further comprises: In the case where it is determined that the first channel and the second channel are enabled at the same time, the first frame image data is the same as or different from the second frame image data, and the first threshold is the same as or different from the second threshold.

10. An image data transmission system, characterized in that: The device comprises an image acquisition unit, a first storage unit, an image correction unit, a second storage unit and a display control unit connected in sequence, wherein the image acquisition unit is connected to the image correction unit via a first channel, and the image correction unit is connected to the display control unit via a second channel, and further comprises: A determining unit configured to determine, based on the acquired application identifier of the first target application, that the image data transmission system is in a first working mode, wherein the first working mode is a working mode that does not require displaying images to a user; a first transmission unit configured to, when determining that the image data transmission system is in the first working mode, enable the image acquisition unit and the image correction unit to communicate through the first channel, and the frame rate of the image acquisition unit is the same as the frame rate of the image correction unit; When the amount of the first frame of image data written by the image acquisition unit into the first storage unit reaches a first threshold, the image correction unit reads the first frame of image data from the first storage unit; a switching unit configured to switch the first working mode to a second working mode in response to the acquired application identifier of the second target application, wherein the second working mode is a working mode that requires displaying an image to a user, and the first target application and the second target application are different applications; a second transmission unit configured to, when it is determined to switch to the second working mode, enable the image correction unit and the display control unit to communicate through the second channel, and the frame rate of the image correction unit is the same as the frame rate of the display control unit; When the amount of the corrected second frame image data written by the image correction unit into the second storage unit reaches a second threshold, the display control unit reads the second frame image data from the second storage unit; An adjustment unit is configured to determine the state of the first channel when the second channel is enabled, and if the state of the first channel is enabled, adjust the frame rate of the image acquisition unit to be the same as the frame rate of the display control unit.

Images