Video image data processing method and device, electronic equipment and storage medium

Abstract

The invention provides a video image data processing method and device, electronic equipment and a storage medium, and relates to the technical field of video image data processing, and the method comprises the steps: obtaining a data request initiated by a source end service; the data request comprises a data storage request and a data reading request; in response to the data storage request, storing first video image data pointed by the data storage request through a preset intermediate cache, and storing the first video image data in a memory through the intermediate cache; or in response to the data reading request, feeding back second video image data pointed by the data reading request to the source end service through a preset intermediate cache; the second video image data comprises the video image data read from the memory by the intermediate cache. By adopting the technical scheme provided by the invention, the low-delay requirement of the source end service for processing the video image data can be ensured.

Description

Technical Field

[0001] This application relates to the field of video image data processing technology, and in particular to a method, apparatus, electronic device, and storage medium for processing video image data. Background Technology

[0002] Currently, electronic devices typically store video image data in dynamic random access memory, such as Double Data Rate Synchronous Dynamic Random Access Memory (DDR). Thus, when a source service needs to use or store video image data, it must directly interact with the memory.

[0003] However, since most of the business data in the overall electronic device system needs to interact with the memory at the same time, when the source business has high latency requirements for reading or storing video image data, the latency requirements for reading or storing video image data cannot be guaranteed due to the presence of other high-bandwidth applications in the system. Summary of the Invention

[0004] The main objective of this application is to provide a method, apparatus, electronic device, and storage medium for processing video image data, aiming to ensure the low latency requirements of source-end services for processing video image data.

[0005] To achieve the above objectives, a first aspect of this application proposes a method for processing video image data, the method being applied to an electronic device, the method comprising: Obtain data requests initiated by the source service; the data requests include data storage requests and data read requests. In response to the data storage request, the first video image data pointed to by the data storage request is stored through a preset intermediate cache, and the first video image data is stored in the memory through the intermediate cache; or, In response to the data read request, the second video image data pointed to by the data read request is fed back to the source service through a preset intermediate cache; the second video image data includes the video image data read from the memory by the intermediate cache.

[0006] In some embodiments, storing the first video image data in memory via the intermediate buffer includes: The system detects whether the first video image data stored in the intermediate cache has reached a preset data sufficiency standard. The data sufficiency standard is used to characterize whether the amount of the first video image data stored has reached a first threshold, and / or whether the remaining storage space of the intermediate cache has reached a second threshold. The first threshold is determined based on the total amount of the first video image data, and the second threshold is determined based on the available storage space allocated by the intermediate cache for the source service. If the stored first video image data is detected to meet the data sufficient standard, the stored first video image data is stored in the memory through the intermediate buffer.

[0007] In some embodiments, the method further includes: Detect the target video image data in the video image data already stored in the memory that meets the usage requirements of the source-end service; The target video image data is read from the memory through the intermediate buffer.

[0008] In some embodiments, reading the target video image data from the memory via the intermediate buffer includes at least one of the following: Before receiving the data read request initiated by the source service, the target video image data is read from the memory through the intermediate cache; In the process of responding to the data read request and feeding back the second video image data to the source service through the intermediate cache, the target video image data is read from the memory through the intermediate cache.

[0009] In some embodiments, the source service includes a first service and a second service; the data request includes a first data storage request initiated by the first service, a first data read request initiated by the first service, a second data storage request initiated by the second service, and a second data read request initiated by the second service. The data request initiated by the source service includes at least one of the following: Obtain the first data storage request initiated by the first service, and obtain the second data read request initiated by the second service; Obtain the first data read request initiated by the first service, and obtain the second data storage request initiated by the second service; Obtain the first data storage request initiated by the first service, and obtain the second data storage request initiated by the second service; Obtain the first data read request initiated by the first service, and obtain the second data read request initiated by the second service.

[0010] In some embodiments, after obtaining the first data storage request initiated by the first service and the second data read request initiated by the second service, the method further includes: In response to the first data storage request, the third video image data pointed to by the first data storage request is stored through the intermediate cache, and the third video image data is stored in the memory through the intermediate cache. In response to the second data read request, the fourth video image data pointed to by the second data read request is fed back to the second service through the intermediate cache. The third video image data includes the first video image data, and the fourth video image data includes the second video image data.

[0011] In some embodiments, after storing the third video image data in memory via the intermediate buffer, the method further includes: If the source service meets the preset service termination conditions, the storage space corresponding to the intermediate cache is released; the preset service termination conditions include the achievement of business objectives, the closure of all key business nodes, and / or the integrity and consistency of core business data.

[0012] To achieve the above objectives, a second aspect of this application provides a video image data processing apparatus applied to an electronic device, the apparatus comprising: The acquisition module is used to acquire data requests initiated by the source business; the data requests include data storage requests and data reading requests. A data processing module is configured to, in response to the data storage request, store the first video image data pointed to by the data storage request through a preset intermediate cache, and store the first video image data in a memory through the intermediate cache; or, in response to the data read request, feed back the second video image data pointed to by the data read request to the source service through a preset intermediate cache; the second video image data includes the video image data read from the memory by the intermediate cache.

[0013] To achieve the above objectives, a third aspect of this application provides an electronic device, which includes a processor and a memory, wherein the memory stores a computer program, and the processor executes the computer program to implement the video image data processing method described in the first aspect.

[0014] To achieve the above objectives, a fourth aspect of the present application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the video image data processing method described in the first aspect.

[0015] To achieve the above objectives, a fifth aspect of the present application provides a computer program product, which includes a computer program that, when executed by a processor, implements the video image data processing method described in the first aspect above.

[0016] The video image data processing method, apparatus, electronic device, computer-readable storage medium, and computer program product proposed in this application embodiment obtain data requests initiated by source-end services; the data requests include data storage requests and data reading requests; in response to the data storage request, the first video image data pointed to by the data storage request is stored through a preset intermediate cache, and the first video image data is stored in a memory through the intermediate cache; or, in response to the data reading request, the second video image data pointed to by the data reading request is fed back to the source-end service through a preset intermediate cache; the second video image data includes video image data read from the memory by the intermediate cache.

[0017] Therefore, compared to processing video image data through interaction between dynamic random access memory / cache and the source service, this embodiment utilizes an intermediate cache between the source service and the memory for related processing of video image data. Specifically, when the source service initiates a data storage request requiring video image data to be stored in memory, the source service first writes the video image data to the intermediate cache, which then writes the video image data to memory. Conversely, when the source service initiates a data read request requiring video image data to be read from memory, the intermediate cache reads the video image data from memory for the source service's use. Thus, for the source service, the intermediate cache serves as its new storage space. By isolating the uncertain latency of memory with a certain amount of storage space, the intermediate cache ensures the low latency requirements of the source service.

[0018] Furthermore, since the intermediate cache can release the system storage resources it occupies when there are no source services that need to be cached in the system, it can be used by other services for storage. Thus, the embodiments of this application can balance the latency requirements of source services for reading or storing video image data with the efficient utilization of system storage resources, thereby ensuring the performance improvement of source services in processing video image data and the optimized allocation of system resources. Attached Figure Description

[0019] Figure 1The flowchart illustrating the steps of the video image data processing method provided in this application embodiment is shown in some embodiments. Figure 2 for Figure 1 A detailed flowchart of step S102; Figure 3 The structural schematic diagrams of the video image data processing method provided in the embodiments of this application are shown in some embodiments; Figure 4 A schematic diagram of the intermediate buffer writing data process involved in some embodiments of the video image data processing method provided in this application; Figure 5 A flowchart illustrating the steps of the video image data processing method provided in this application in other embodiments; Figure 6 A schematic diagram of the intermediate buffer reading process involved in some embodiments of the video image data processing method provided in this application; Figure 7 A flowchart illustrating the steps of the video image data processing method provided in this application in some other embodiments; Figure 8 The video image data processing method provided in the embodiments of this application is illustrated in some complete embodiments as a scenario of releasing intermediate cache storage space; Figure 9 This is a schematic diagram of the structure of the video image data processing apparatus provided in the embodiments of this application; Figure 10 This is a schematic diagram of the hardware structure of the video image data processing device provided in the embodiments of this application. Detailed Implementation

[0020] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0021] It should be noted that although functional modules are divided in the device schematic diagram and a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first," "second," etc., in the specification, claims, and the aforementioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0022] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0023] First, the overall concept of the video image data processing method provided in the embodiments of this application will be explained.

[0024] In source-end services that process video image data (such as real-time monitoring, high-definition video encoding / decoding, and machine vision inspection), dynamic random access memory (such as double data rate synchronous dynamic random access memory, DDR) has become the core carrier for video image data storage and interaction. Whether it is the real-time access of video image data by source-end services (such as image rendering and feature analysis) or the temporary caching and long-term storage of video image data, data read and write interactions must be completed between the source-end services and the memory. The efficient utilization of memory is directly related to the overall operating efficiency of the service, and its position as the system's data interaction hub is very clear, supporting various business application scenarios with high real-time and high bandwidth requirements.

[0025] Under the existing system architecture, the interaction between source-end services and storage for video image data faces two key challenges, which traditional solutions struggle to effectively address. Firstly, when the system stores video image data in Dynamic Random Access Memory (DDR), the source end also needs to interact with the data via DDR. When services have high latency requirements for video image data (such as smooth transmission of real-time video surveillance footage or millisecond-level response times in industrial vision inspection), other high-bandwidth applications running simultaneously (such as big data processing and multi-channel data acquisition) can preempt DDR bandwidth resources, leading to prolonged read / write latency for video image data. This prevents the system from guaranteeing low latency requirements, thus impacting service stability and reliability. Secondly, while using a high-speed cache memory (CACHE) can alleviate DDR access pressure to some extent by temporarily storing frequently accessed video image data in the CACHE, reducing direct calls to DDR, this approach carries the risk of resource waste. Specifically, when services do not need to access video image data frequently via the CACHE, the system storage resources occupied by the CACHE cannot be utilized by other services, resulting in low storage resource utilization, contradicting the need for efficient system resource allocation.

[0026] In summary, existing solutions for storing and retrieving video image data have significant shortcomings. First, when multiple services share DDR bandwidth, the efficiency of video image data interaction for services with high latency requirements cannot be guaranteed. Second, the cache method leads to wasted storage resources in non-use scenarios. These two issues make it difficult for the system to achieve a balance between meeting the low-latency requirements of services for video image data and achieving efficient utilization of system storage resources. This restricts the performance improvement of video image data processing services and the optimization of system resource allocation, thus necessitating a better technical solution.

[0027] To address this, embodiments of this application provide a method, apparatus, electronic device, computer-readable storage medium, and computer program product for processing video image data, aiming to balance the latency requirements of source-end services for reading or storing video image data with the efficient utilization of system storage resources, thereby ensuring performance improvement of source-end services in processing video image data and optimized allocation of system resources.

[0028] The video image data processing method, apparatus, electronic device, computer-readable storage medium, and computer program product proposed in this application embodiment obtain data requests initiated by source-end services; the data requests include data storage requests and data reading requests; in response to the data storage request, the first video image data pointed to by the data storage request is stored through a preset intermediate cache, and the first video image data is stored in a memory through the intermediate cache; or, in response to the data reading request, the second video image data pointed to by the data reading request is fed back to the source-end service through a preset intermediate cache; the second video image data includes video image data read from the memory by the intermediate cache.

[0029] Therefore, compared to processing video image data through interaction between dynamic random access memory / cache and the source service, this embodiment utilizes an intermediate cache between the source service and the memory for related processing. Specifically, when the source service initiates a data storage request requiring video image data to be stored in memory, the source service first writes the video image data to the intermediate cache, which then writes it to memory. Conversely, when the source service initiates a data read request requiring video image data to be read from memory, the intermediate cache retrieves the video image data from memory for the source service's use. Thus, for the source service, the intermediate cache becomes its new storage space. The intermediate cache isolates the uncertain latency of memory with a certain amount of storage space, thereby ensuring the low latency requirements of the source service. Furthermore, since the intermediate cache can free up system storage resources for other services when there are no source services requiring caching, this embodiment balances the latency requirements of the source service for reading or storing video image data with the efficient utilization of system storage resources, thereby ensuring improved performance of the source service in processing video image data and optimized allocation of system resources.

[0030] It should be noted that, in this embodiment, the intermediate cache can be a specialized data storage and control structure customized for the image data format of the source service, serving as an intermediate cache between the memory and the source service. In some embodiments, the intermediate cache may include a controller and a portion of system storage resources controlled by the controller. Furthermore, when there is no service requiring caching in the system, the system storage resources occupied by the intermediate cache can be released for storage use by other services.

[0031] Next, the video image data processing method, apparatus, electronic device, computer-readable storage medium, and computer program product provided in the embodiments of this application will be specifically described through the following embodiments, and the video image data processing method provided in the embodiments of this application will be described in detail first.

[0032] It should be noted that in all specific embodiments of this application, when processing data related to user identity or characteristics, such as user information, user behavior data, user historical data, and user location information, user permission or consent is obtained first. Furthermore, the collection, use, and processing of this data comply with relevant laws, regulations, and standards. In addition, when embodiments of this application require access to sensitive personal information of users, separate permission or consent from the user is obtained through pop-ups or redirection to confirmation pages. Only after obtaining the user's separate permission or consent is the necessary user-related data required for the proper functioning of these embodiments acquired.

[0033] It should be noted that the video image data processing method provided in this application embodiment can be applied to a terminal, a server, or software running on either a terminal or a server. In some embodiments, the terminal can be an electronic device such as a mobile phone, tablet computer, laptop computer, or desktop computer. The server can be a server terminal device, configured as an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms. The software can be an application implementing the video image data processing method, a computer program, and a storage medium carrying the computer program. It should be understood that, based on different design needs of actual applications, in different feasible embodiments, the terminal, server, and software applying the video image data processing method provided in this application embodiment can, of course, be other forms not listed here, and the video image data processing method provided in this application embodiment does not specifically limit these.

[0034] Furthermore, the video image data processing method provided in this application can also be used in numerous general-purpose or special-purpose computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer computer devices, personal computers (PCs), minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. This application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform specific tasks or implement specific abstract data types. This application can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In a distributed computing environment, program modules can reside in local and remote computer storage media, including storage devices.

[0035] For ease of understanding and explanation, the following text will use the video image data processing method provided in the embodiments of this application for electronic devices as examples to describe the various specific embodiments of this application in detail. The implementation of the video image data processing method provided in the embodiments of this application for any of the above-described subject matter can refer to the specific embodiments of the video image data processing method for electronic devices described below.

[0036] Please refer to Figure 1 , Figure 1 The flowchart illustrates the steps of the video image data processing method provided in some embodiments of this application. It should be understood that, although... Figure 1 The flowcharts illustrating subsequent steps show the execution order of some method steps. However, based on different design needs in practical applications, the video image data processing method provided in this application embodiment can, of course, employ a different execution order of method steps than shown in the figures. That is, Figure 1 The order of the method steps shown does not constitute a limitation on the execution logical order of the video image data processing method provided in the embodiments of this application. Any other order based on... Figure 1 Reasonable changes to the sequence of steps shown should be included within the protection scope of the video image data processing method provided in the embodiments of this application.

[0037] like Figure 1 As shown, in some embodiments, the video image data processing method provided in this application may include steps S101 to S103 as shown below.

[0038] Step S101: Obtain the data request initiated by the source service; the data request includes data storage request and data read request.

[0039] During operation, when a relevant source-end service (such as real-time monitoring, high-definition video encoding / decoding, machine vision inspection, etc., also referred to as the source end) needs to store video image data in or retrieve video image data from the memory, the electronic device receives a data request initiated by that source-end service. Specifically, when the source-end service needs to store video image data in the memory, it initiates a data storage request, which the electronic device then receives. Conversely, when the source-end service needs to retrieve video image data from the memory, it initiates a data read request, which the electronic device then receives.

[0040] Step S102: In response to the data storage request, the first video image data pointed to by the data storage request is stored through a preset intermediate cache, and the first video image data is stored in the memory through the intermediate cache.

[0041] It should be noted that the first video image data referred to in the data storage request refers to video image data that needs to be written to the memory for storage, either sent by the source service along with the data storage request, or video image data that needs to be written to the memory for storage, sent by the source service before or after initiating the data storage request. Regardless of whether the first video image data is sent to the memory by the source service along with the data storage request or sent separately from the data storage request, the first video image data is associated with the data storage request.

[0042] After receiving a data request initiated by the source service, if the data request is a data storage request, the electronic device responds to the data storage request by first writing the first video image data associated with the data storage request sent by the source service into an intermediate buffer for storage, and then the intermediate buffer writes the first video image data into the memory for storage.

[0043] For example, the electronic device has customized a special data storage and control structure for the image data format of the source end (source end service), which acts as an intermediate cache between the memory DDR and the source end. When the source end needs to store the first video image data in the DDR, the source end initiates a data storage request. The electronic device responds by first writing the first video image data into the intermediate cache, and then the intermediate cache writes the first video image data into the DDR a second time.

[0044] Step S103: In response to the data read request, the second video image data pointed to by the data read request is fed back to the source service through a preset intermediate cache; the second video image data includes the video image data read from the memory by the intermediate cache.

[0045] It should be noted that the second video image data referred to in the data read request can be video image data pre-stored in memory and / or intermediate cache by the electronic device for use by relevant source-end services. For example, the second video image data can be the first video image data stored in the intermediate cache by the aforementioned electronic device in response to a data storage request. Alternatively, the second video image data can also be video image data (including the first video image data or other video image data previously stored in memory by other services) that the electronic device has retrieved from memory via the intermediate cache. Regardless of whether the second video image data is stored in the intermediate cache or memory, it is always associated with the data read request.

[0046] After receiving a data request from the source service, if the data request is a data read request, the electronic device responds to the data read request by returning the second video image data associated with the data read request from the intermediate cache to the source service for its use. Specifically, the electronic device can return the second video image data currently stored in the intermediate cache (i.e., data that has not yet been written to memory or is being written to memory) to the source service via the intermediate cache. Alternatively, the electronic device can return the second video image data that has been previously retrieved from memory via the intermediate cache. Or, the electronic device can simply return the second video image data that has been previously retrieved from memory via the intermediate cache.

[0047] For example, when the source needs to read the second video image data from the memory of the electronic device, the electronic device reads the second video image data from the memory DDR in advance through an intermediate buffer. Then, in response to the data read request initiated by the source, the electronic device returns the second video image data to the source through the intermediate buffer for the source to use.

[0048] In this embodiment, during operation, when a relevant source service needs to store video image data in or retrieve video image data from the memory, the electronic device acquires the data storage request or data read request initiated by that source service. If the data request is a data storage request, the electronic device responds by writing the first video image data associated with the data storage request sent by the source service into an intermediate cache for storage, and then the intermediate cache writes the first video image data back into the memory for storage. If the data request is a data read request, the electronic device responds by returning the second video image data associated with the data read request from the intermediate cache to the source service for its use.

[0049] Therefore, compared to processing video image data through interaction between dynamic random access memory / cache and the source service, this embodiment utilizes an intermediate cache between the source service and the memory for related processing. Specifically, when the source service initiates a data storage request requiring video image data to be stored in memory, the source service first writes the video image data to the intermediate cache, which then writes it to memory. Conversely, when the source service initiates a data read request requiring video image data to be read from memory, the intermediate cache retrieves the video image data from memory for the source service's use. Thus, for the source service, the intermediate cache becomes its new storage space. The intermediate cache isolates the uncertain latency of memory with a certain amount of storage space, thereby ensuring the low latency requirements of the source service. Furthermore, since the intermediate cache can free up system storage resources for other services when there are no source services requiring caching, this embodiment balances the latency requirements of the source service for reading or storing video image data with the efficient utilization of system storage resources, thereby ensuring improved performance of the source service in processing video image data and optimized allocation of system resources.

[0050] Please refer to Figure 2 , Figure 2 for Figure 1 A detailed flowchart of step S102.

[0051] like Figure 2 As shown, in some embodiments, the step S102 described above, "data storing the first video image in the memory through the intermediate buffer", includes, but is not limited to, steps S201 and S202 as shown below.

[0052] Step S201: Detect whether the first video image data stored in the intermediate cache has reached a preset data sufficiency standard; the data sufficiency standard is used to characterize that the amount of data of the first video image data stored has reached a first threshold, and / or, the remaining storage space of the intermediate cache has reached a second threshold, the first threshold is determined based on the total amount of data of the first video image data, and the second threshold is determined based on the available storage space allocated by the intermediate cache for the source service.

[0053] When an electronic device writes the first video image data to memory via an intermediate buffer, it can first check if the data in the intermediate buffer is sufficient. If the data in the intermediate buffer is sufficient, the controller of the intermediate buffer can write the first video image data already stored in the intermediate buffer to the memory. In other words, the electronic device can detect whether the first video image data stored in the intermediate buffer meets a preset data sufficiency standard. If the stored first video image data meets the data sufficiency standard, it confirms that the data in the intermediate buffer is sufficient; if the stored first video image data does not meet the data sufficiency standard, it confirms that the data in the intermediate buffer is insufficient.

[0054] In some embodiments, the electronic device can detect whether the amount of first video image data stored in the intermediate buffer has reached a first threshold, and if the amount of data reaches the first threshold, confirm that the first video image data stored in the intermediate buffer has reached a sufficient data standard. Here, the first threshold can be determined based on the total amount of the first video image data. For example, the first threshold can be 80% of the total amount of the first video image data.

[0055] In some embodiments, the electronic device can also detect whether the remaining storage space in the intermediate cache after storing the first video image data that has been written has reached a second threshold. If the remaining storage space has reached the second threshold, it confirms that the first video image data stored in the intermediate cache meets the data sufficiency standard. Here, the second threshold is determined based on the available storage space allocated by the intermediate cache for source-end services. For example, assuming the intermediate cache allocates 1GB of storage space for storing video image data from source-end services, the second threshold can be 20% of that 1GB.

[0056] Step S202: If the stored first video image data is detected to meet the data sufficient standard, the stored first video image data is stored in the memory through the intermediate buffer.

[0057] When the electronic device detects that the first video image data stored in the intermediate buffer has reached a sufficient data standard, it writes the first video image data stored in the intermediate buffer into the memory for storage through the controller of the intermediate buffer.

[0058] In some embodiments, the electronic device stores first video image data through an intermediate cache. When the first video image data stored in the intermediate cache reaches a sufficient data standard, the controller of the intermediate cache writes the first video image data stored in the intermediate cache into the memory. This process continues in remote services, always ensuring that there is sufficient data in the terminal cache, until all the first video image data has been written.

[0059] For example, such as Figure 3 As shown, the electronic device includes a source (Service 1 / Service 2, or more), an intermediate buffer, DDR memory, and a bus for data transmission (Bus 1 and Bus 2, which can be combined into one bus). Based on this, the process of the electronic device writing data through the intermediate buffer is as follows: Figure 4 As shown, the source (Service 1) writes the data (first video image data) to the intermediate buffer structure. When there is enough data in the intermediate buffer, the intermediate buffer controller writes the data (the first video image data already stored in the intermediate buffer) to DDR. This process continues in the service, always ensuring that there is enough data in the buffer, until all data has been written.

[0060] Please refer to Figure 5 , Figure 5 The following are schematic flowcharts illustrating the steps of the video image data processing method provided in this application embodiment in other embodiments.

[0061] like Figure 5 As shown, in some embodiments, the video image data processing method provided in this application may further include steps S501 and S502 as shown below.

[0062] Step S501: Detect the target video image data in the video image data stored in the memory that meets the usage requirements of the source service.

[0063] Step S502: Read the target video image data from the memory through the intermediate buffer.

[0064] When an electronic device needs to read video image data from memory for a source service, it first checks the memory for target video image data that meets the requirements of the source service. Then, the electronic device can read the target video image data from the memory through the controller of the intermediate buffer, store the read target video image data in the intermediate buffer, and return the video image data to the source service.

[0065] In some embodiments, when an electronic device detects target video image data in the video image data already stored in the memory that meets the usage requirements of the source service, the detection can focus on the correlation between the usage requirements of the source service and the video image data. Here, usage requirements include currently explicitly required usage and potential future usage requirements. Based on this, the electronic device can verify, layer by layer, from dimensions such as requirement definition, data attributes, business scenarios, and access links, whether target video image data that meets the usage requirements of the source service exists in the video image data already stored in the memory.

[0066] In some embodiments, step S502 above, reading the target video image data from the memory through the intermediate buffer, can be implemented by at least one of the following methods 1 and 2.

[0067] Method 1: Before obtaining the data read request initiated by the source service, read the target video image data from the memory through the intermediate cache.

[0068] After determining the target video image data that meets the requirements of the source service, the electronic device can read the target video image data from the memory through the intermediate cache controller before receiving the data read request initiated by the source service, and store the read target video image data in the intermediate cache. Thus, after receiving the data read request from the source service, the electronic device can return the target video image data as secondary video image data to the source service through the intermediate cache for its use.

[0069] Method 2: In the process of responding to the data read request and feeding back the second video image data to the source service through the intermediate cache, the target video image data is read from the memory through the intermediate cache.

[0070] After determining the target video image data that meets the needs of the source service, the electronic device can also read the target video image data from the memory through the intermediate cache controller during the process of responding to the data reading request initiated by the source service and feeding back the second video image data to the source service through the intermediate cache. The read target video image data is then returned to the source service as the second video image data for the source service to use.

[0071] For example, the process of an electronic device reading data through an intermediate cache is as follows: Figure 6As shown, before the service begins, the electronic device reads the data (target video image data) from the DDR memory into the intermediate buffer for storage. When the source (service 1) initiates a read operation (data read request), the intermediate buffer returns the data (second video image data) to the source. Furthermore, during the service process, the intermediate buffer continuously reads data from the DDR and stores it in the intermediate buffer, ensuring sufficient data supply to the source until all data has been read.

[0072] In this embodiment, video image data is stored and retrieved using an intermediate cache via an electronic device, thereby isolating the uncertain latency of full memory access. This approach offers adjustable latency resistance and a simple structure. Furthermore, by sharing system-level storage and utilizing the intermediate cache mechanism, the low-latency impact of other services on the specified video image data is isolated, ensuring the continuity of related services.

[0073] In some embodiments, the source service includes a first service and a second service; the data request includes a first data storage request initiated by the first service, a first data read request initiated by the first service, a second data storage request initiated by the second service, and a second data read request initiated by the second service.

[0074] Based on this, step S101 above: obtaining the data request initiated by the source service can be achieved through at least one of the following methods 1 to 4.

[0075] Method 1: Obtain the first data storage request initiated by the first service, and obtain the second data read request initiated by the second service.

[0076] During operation, the electronic device can initiate a data write operation as needed, and at the same time, the second service can initiate a data read operation as needed. In this way, the electronic device can obtain the first data storage request initiated by the first service and the second data read request initiated by the second service.

[0077] Method 2: Obtain the first data read request initiated by the first service, and obtain the second data storage request initiated by the second service.

[0078] During operation, the electronic device can initiate a data read operation as needed, and at the same time, the second service can initiate a data write operation as needed. In this way, the electronic device can obtain the first data read request initiated by the first service and the second data storage request initiated by the second service.

[0079] Method 3: Obtain the first data storage request initiated by the first service, and obtain the second data storage request initiated by the second service.

[0080] During operation, the electronic device can initiate a data write operation as needed by the first service and the second service as needed. In this way, the electronic device can obtain the first data storage request initiated by the first service and the second data storage request initiated by the second service.

[0081] Method 4: Obtain the first data read request initiated by the first service, and obtain the second data read request initiated by the second service.

[0082] During operation, the electronic device can initiate a data read operation as needed by the first service and the second service as needed. In this way, the electronic device can obtain the first data read request initiated by the first service and the second data read request initiated by the second service.

[0083] For example, such as Figure 3 As shown, the intermediate cache structure in the electronic device can be configured to support N service flows running simultaneously, wherein each service flow can only be a read cache or a write cache at any given time.

[0084] In some embodiments, after obtaining the first data storage request initiated by the first service and the second data read request initiated by the second service through the above-described method 1, the electronic device can simultaneously respond to different data requests initiated by the first service and the second service.

[0085] Based on this, the video image data processing method provided in the embodiments of this application may further include the following steps: In response to the first data storage request, the third video image data pointed to by the first data storage request is stored through the intermediate cache, and the third video image data is stored in the memory through the intermediate cache. In response to the second data read request, the fourth video image data pointed to by the second data read request is fed back to the second service through the intermediate cache. The third video image data includes the first video image data, and the fourth video image data includes the second video image data.

[0086] After receiving a first data storage request initiated by a first service and a second data read request initiated by a second service, the electronic device responds to both requests simultaneously. It stores the third video image data associated with the first data storage request sent by the first service through an intermediate cache, and then writes the third video image data already stored in the intermediate cache back to the memory for further storage. Simultaneously, the electronic device also returns the fourth video image data associated with the second data read request from the intermediate cache to the second service for use by the source service. Here, the third video image data can be the aforementioned first video image data, and the fourth video image data can be the aforementioned second video image data.

[0087] In this embodiment, by setting an intermediate buffer through an electronic device to support N service streams running simultaneously, it is possible to simultaneously support the storage or retrieval of multiple video image streams with different services based on the intermediate buffer, thereby further improving the performance of processing video image data.

[0088] Please refer to Figure 7 , Figure 7 A flowchart illustrating the steps of the video image data processing method provided in some embodiments of this application.

[0089] like Figure 7 As shown, in some embodiments, after step S102 above: in response to the data storage request, the first video image data pointed to by the data storage request is stored through a preset intermediate cache, and the first video image data is stored in the memory through the intermediate cache, the video image data processing method provided in this application embodiment may further include step S701 as shown below.

[0090] Step S701: If the source service meets the preset service termination conditions, release the storage space corresponding to the intermediate cache; the preset service termination conditions include the achievement of business objectives, the closure of all key business nodes, and / or the integrity and consistency of core business data.

[0091] After the electronic device rewrites all the first video image data sent by the source service into the memory through the intermediate buffer, if it detects that the source service meets the preset service termination conditions, that is, the service goal of the source service is achieved, all key service nodes are closed, and / or the core service data is complete and consistent, the electronic device determines that there is no service that needs to be cached in the system. At this time, the electronic device releases the storage space corresponding to the intermediate buffer for other services to use normally.

[0092] For example, such as Figure 8As shown, when an electronic device determines that there are no services in the system that require intermediate buffering for video image data processing, the storage space corresponding to that intermediate buffer can be released for other services to use normally. In this way, by reusing system-level storage resources, the utilization rate of system storage resources can be maximized.

[0093] Please see Figure 9 This application also provides a video image data processing apparatus, which can be applied to electronic devices to implement the above-described video image data processing method.

[0094] like Figure 9 As shown, the video image data processing apparatus provided in this embodiment includes an acquisition module 901 and a data processing module 902. Wherein, The acquisition module 901 is used to acquire data requests initiated by the source service; the data requests include data storage requests and data reading requests. The data processing module 902 is configured to, in response to the data storage request, store the first video image data pointed to by the data storage request through a preset intermediate cache, and store the first video image data in the memory through the intermediate cache; or, in response to the data read request, feed back the second video image data pointed to by the data read request to the source service through a preset intermediate cache; the second video image data includes the video image data read from the memory by the intermediate cache.

[0095] In some embodiments, the data processing module 902 is further configured to detect whether the first video image data stored in the intermediate cache has reached a preset data sufficiency standard; the data sufficiency standard is used to characterize that the amount of data of the stored first video image data has reached a first threshold, and / or that the remaining storage space of the intermediate cache has reached a second threshold, wherein the first threshold is determined based on the total amount of data of the first video image data, and the second threshold is determined based on the available storage space allocated by the intermediate cache for the source service; and, when it is detected that the stored first video image data has reached the data sufficiency standard, the stored first video image data is stored in the memory through the intermediate cache.

[0096] In some embodiments, the data processing module 902 is further configured to detect target video image data in the video image data stored in the memory that meets the usage requirements of the source service; and to read the target video image data from the memory through the intermediate cache.

[0097] In some embodiments, the data processing module 902 is further configured to read the target video image data from the memory through the intermediate cache before obtaining the data read request initiated by the source service; and to read the target video image data from the memory through the intermediate cache during the process of feeding back the second video image data to the source service through the intermediate cache in response to the data read request.

[0098] In some embodiments, the source service includes a first service and a second service; the data request includes a first data storage request initiated by the first service, a first data read request initiated by the first service, a second data storage request initiated by the second service, and a second data read request initiated by the second service; the acquisition module 901 is further configured to acquire the first data storage request initiated by the first service, and acquire the second data read request initiated by the second service; acquire the first data read request initiated by the first service, and acquire the second data storage request initiated by the second service; acquire the first data storage request initiated by the first service, and acquire the second data storage request initiated by the second service; acquire the first data read request initiated by the first service, and acquire the second data read request initiated by the second service.

[0099] In some embodiments, the data processing module 902 is further configured to, in response to the first data storage request, store the third video image data pointed to by the first data storage request through the intermediate cache, store the third video image data in the memory through the intermediate cache, and, in response to the second data read request, feed back the fourth video image data pointed to by the second data read request to the second service through the intermediate cache. The third video image data includes the first video image data, and the fourth video image data includes the second video image data.

[0100] In some embodiments, the data processing module 902 is further configured to release the storage space corresponding to the intermediate cache when the source-end service meets the preset service termination conditions; the preset service termination conditions include the achievement of business objectives, the closure of all key business nodes, and / or the integrity and consistency of core business data.

[0101] It should be noted that the specific implementation of the video image data processing device provided in this application embodiment is basically the same as the specific implementation of the video image data processing method described above, and will not be repeated here.

[0102] Please see Figure 10This application also provides a video image data processing device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the above-mentioned visual language model evaluation method.

[0103] like Figure 10 As shown, in some embodiments, the video image data processing device provided in this application includes: The processor 1001 can be implemented using a general-purpose central processing unit (CPU), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this application. The memory 1002 can be implemented as a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 1002 can store the operating system and other applications. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 1002 and is called and executed by the processor 1001 to execute the video image data processing method of the embodiments of this application. Input / output interface 1003 is used to implement information input and output; The communication interface 1004 is used to enable communication and interaction between this device and other devices. Communication can be achieved through wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.). Bus 1005 transmits information between various components of the device (e.g., processor 1001, memory 1002, input / output interface 1003, and communication interface 1004); The processor 1001, memory 1002, input / output interface 1003 and communication interface 1004 are connected to each other within the device via bus 1005.

[0104] This application also provides an electronic device, which includes a processor and a memory. The memory stores a computer program, and the processor executes the computer program to implement the above-described video image data processing method.

[0105] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described video image data processing method.

[0106] Memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs. Furthermore, memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory may optionally include memory remotely located relative to the processor, and these remote memories can be connected to the processor via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0107] This application also provides a computer program product, including a computer program. The steps implemented by the computer program when executed by a processor are basically the same as those in the specific embodiments of the video image data processing method described above, and will not be repeated here.

[0108] The embodiments described in this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. As those skilled in the art will know, with the evolution of technology and the emergence of new application scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.

[0109] Those skilled in the art will understand that the technical solutions shown in the figures do not constitute a limitation on the embodiments of this application, and may include more or fewer steps than shown, or combine certain steps, or different steps.

[0110] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0111] Those skilled in the art will understand that all or some of the steps, apparatuses, or functional modules / units in the methods disclosed above can be implemented as software, firmware, hardware, or suitable combinations thereof.

[0112] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, apparatus, product, or device that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.

[0113] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0114] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0115] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0116] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0117] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes multiple instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing programs, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0118] The preferred embodiments of the present application have been described above with reference to the accompanying drawings, but this does not limit the scope of the claims of the present application. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and substance of the embodiments of the present application shall be within the scope of the claims of the present application.

Claims

1. A method of processing video image data, characterized by, The method is applied to an electronic device, and the method comprises: obtaining a data request initiated by a source service; the data request comprises a data storage request and a data reading request; in response to the data storage request, storing first video image data pointed by the data storage request in a preset intermediate cache, and storing the first video image data in a storage through the intermediate cache; or, in response to the data reading request, feeding back second video image data pointed by the data reading request to the source service through the preset intermediate cache; the second video image data comprises video image data read from the storage by the intermediate cache.

2. The method of claim 1, wherein, The storing of the first video image data in the storage through the intermediate cache comprises: detecting whether the stored first video image data in the intermediate cache reaches a preset data sufficient standard; the data sufficient standard is used to represent that a data amount of the stored first video image data reaches a first threshold value, and / or a remaining storage space of the intermediate cache reaches a second threshold value, the first threshold value is determined based on a total data amount of the first video image data, and the second threshold value is determined based on an available storage space of the intermediate cache divided for the source service; in a case where it is detected that the stored first video image data reaches the data sufficient standard, storing the stored first video image data in the storage through the intermediate cache.

3. The method of claim 1, wherein, The method further comprises: detecting target video image data meeting a use demand of the source service in video image data stored in the storage; reading the target video image data from the storage through the intermediate cache.

4. The method of claim 3, wherein, The reading of the target video image data from the storage through the intermediate cache comprises at least one of the following: reading the target video image data from the storage through the intermediate cache before obtaining the data reading request initiated by the source service; reading the target video image data from the storage through the intermediate cache in a process of feeding back the second video image data to the source service through the intermediate cache in response to the data reading request.

5. The method according to any one of claims 1 to 4, characterized in that, The source service comprises a first service and a second service; the data request comprises a first data storage request initiated by the first service, a first data reading request initiated by the first service, a second data storage request initiated by the second service, and a second data reading request initiated by the second service; The obtaining of the data request initiated by the source service comprises at least one of the following: obtaining the first data storage request initiated by the first service, and obtaining the second data reading request initiated by the second service; obtaining the first data reading request initiated by the first service, and obtaining the second data storage request initiated by the second service; obtaining the first data storage request initiated by the first service, and obtaining the second data storage request initiated by the second service; The first data read request initiated by the first service is acquired, and the second data read request initiated by the second service is acquired.

6. The method of claim 5, wherein, After the first data storage request initiated by the first service is acquired, and the second data read request initiated by the second service is acquired, the method further comprises: In response to the first data storage request, the third video image data pointed to by the first data storage request is stored through the intermediate cache, and the third video image data is stored in the memory through the intermediate cache, and in response to the second data read request, the fourth video image data pointed to by the second data read request is fed back to the second service through the intermediate cache; The third video image data includes the first video image data, and the fourth video image data includes the second video image data.

7. The method of claim 6, wherein, After the third video image data is stored in the memory through the intermediate cache, the method further comprises: In the case that the source service meets the preset service end condition, the storage space corresponding to the intermediate cache is released; the preset service end condition includes service target achievement, service key node all closed loop, and / or service core data complete and consistent.

8. An apparatus for processing video image data, characterized by The device is applied to an electronic device, and the device comprises: An acquisition module is configured to acquire a data request initiated by a source service; the data request comprises a data storage request and a data read request; A data processing module is configured to, in response to the data storage request, store first video image data pointed to by the data storage request through a preset intermediate cache, and store the first video image data in a memory through the intermediate cache; or, in response to the data read request, feed back second video image data pointed to by the data read request to the source service through the preset intermediate cache; the second video image data comprises video image data read from the memory by the intermediate cache.

9. An electronic device, comprising: The electronic device comprises a processor and a memory, and the memory stores a computer program; when the processor executes the computer program, the video image data processing method in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program; when the computer program is executed by a processor, the video image data processing method in any one of claims 1 to 7 is implemented.

Images