Storage processing method and device of video image information data, storage medium

CN118820515BActive Publication Date: 2026-08-21JINAN INSPUR DATA TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410868238.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-06-28
Publication Date
2026-08-21
Estimated Expiration
2044-06-28

AI Technical Summary

Technical Problem

[0004]本申请实施例提供了一种视频图像信息数据的存储处理方法、装置、存储介质,以至少解决相关技术中对视频图像信息数据的数据存储和数据处理过程的灵活性差、数据处理效率低的问题

Benefits of technology

[0021]在本申请实施例中,先接收待处理视频图像信息数据,再按照数据内容对所述待处理视频图像信息数据进行数据分离,得到数据分离结果,其中,所述数据分离结果包括所述待处理视频图像信息数据中的对象数据和结构化属性数据,所述对象数据用于描述所述待处理视频图像信息数据中的对象,所述结构化属性数据用于描述所述待处理视频图像信息数据中对应对象的特征属性,最后,根据对象类型对所述对象数据和所述结构化属性数据进行数据存储和数据处理。本申请实施例通过按照数据内容和对象类型对视频图像信息数据进行数据存储处理,实现了提升视频图像信息数据存储处理的灵活性、提高数据过期监测与清除、数据检索、数据分析等数据处理过程的灵活性和效率的技术效果,进而解决了相关技术中视频图像信息数据的存储处理的问题。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118820515B_ABST
    Figure CN118820515B_ABST
Patent Text Reader

Abstract

The embodiment of the application provides a kind of video image information data storage processing method, device, storage medium, wherein, the method comprises: receiving video image information data to be processed;According to data content, the data separation of video image information data to be processed is carried out, and data separation result is obtained, wherein, data separation result includes object data and structured attribute data in video image information data to be processed;According to object type, object data and structured attribute data are stored and processed.The application solves the problem of video image information data storage processing in related art, and improves the flexibility of video image information data storage processing, improves the flexibility and efficiency of data expiration monitoring and cleaning, data retrieval, data analysis and other data processing processes.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of security monitoring technology, and more specifically, to a method, apparatus, and storage medium for storing and processing video image information data. Background Technology

[0002] In the field of security monitoring technology, the application scenarios for storing video image information data are mostly data reading and a few data writing. Therefore, the data storage method of video image information data directly affects the data reading efficiency and thus the efficiency of subsequent data processing. Based on the existing data storage methods, the processing of video image information data by related technologies has the following problems: (1) When monitoring and clearing expired data, batch data operations cannot be performed, and only data can be monitored and cleared one by one; (2) When searching for data, searches can only be performed within the data range of the view library system; (3) When performing data applications such as image search and image deployment, useful object data cannot be read quickly, resulting in increased data reading load and latency. In other words, the poor flexibility of the data storage method for video image information data in related technologies leads to poor flexibility and low data processing efficiency in the data processing process.

[0003] There are no effective solutions yet to address the problems of poor flexibility and low efficiency in the storage and processing of video image information data in related technologies. Summary of the Invention

[0004] This application provides a method, apparatus, and storage medium for storing and processing video image information data, in order to at least solve the problems of poor flexibility and low efficiency in the storage and processing of video image information data in related technologies.

[0005] According to one embodiment of this application, a method for storing and processing video image information data is provided, comprising: receiving video image information data to be processed; performing data separation on the video image information data to be processed according to data content to obtain a data separation result, wherein the data separation result includes object data and structured attribute data in the video image information data to be processed, the object data being used to describe objects in the video image information data to be processed, and the structured attribute data being used to describe characteristic attributes of corresponding objects in the video image information data to be processed; and storing and processing the object data and the structured attribute data according to object type.

[0006] In an exemplary embodiment, the object data is stored based on a first storage system, and the structured attribute data is stored based on a second and a third storage system. The storage functions of the first, second, and third storage systems are different. Storing the object data and structured attribute data according to the object type includes: determining a first naming result based on the object type and the reception date of the video image information data to be processed; searching for any storage bucket in the first storage system according to the first naming result to obtain a first search result, wherein the first search result is used to determine whether a first storage bucket exists in the first storage system, and the first storage bucket is named using the first naming result; in response to determining that the first storage bucket exists in the first storage system based on the first search result, storing the object data in the first storage bucket and obtaining the storage path of the object data; in response to determining that the first storage bucket does not exist in the first storage system based on the first search result, storing the object data in the first storage system based on the first naming result. The system creates a first storage bucket, stores the object data in the first storage bucket, and obtains the storage path of the object data; updates the storage path of the structured attribute data according to the storage path of the object data, and clears the object data after the update is completed; caches the structured attribute data in the second storage system; during the consumption of the structured attribute data in the second storage system, searches for any index in the third storage system according to the first naming result to obtain a second search result, wherein the second search result is used to determine whether the first index exists in the third storage system, and the first index is named using the first naming result; in response to determining that the first index exists in the third storage system based on the second search result, stores the structured attribute data in the storage location corresponding to the first index; in response to determining that the first index does not exist in the third storage system based on the second search result, creates the first index in the third storage system based on the first naming result, and stores the structured attribute data in the storage location corresponding to the first index.

[0007] In an exemplary embodiment, data processing of the object data and the structured attribute data according to the object type includes: receiving a data storage cycle read instruction and reading the data storage cycle of the object data of the object type to be monitored based on the data storage cycle read instruction, and simultaneously starting a data monitoring task; determining a second naming result based on the object type to be monitored and the data storage cycle; searching for any index in a third storage system according to the second naming result to obtain a third search result, wherein the third search result is used to determine whether a second index exists in the third storage system, and the second index is named using the second naming result; responding to the determination that the second index exists in the third storage system based on the third search result, reading the creation time of the second index from the third storage system; comparing the creation time with the storage time limit of the object data of the object type to be monitored to obtain a comparison result, wherein the storage time limit is determined by the data storage cycle, and the comparison result is used to determine whether the creation time exceeds the storage time limit; responding to the determination that the creation time exceeds the storage time limit based on the comparison result, determining that the structured attribute data in the second index has expired, deleting the second index from the third storage system, and deleting the storage bucket named with the second naming result from the first storage system.

[0008] In an exemplary embodiment, data processing of the object data and the structured attribute data according to the object type includes: receiving a data retrieval instruction and parsing the retrieval conditions in the data retrieval instruction to obtain a parsing result, wherein the parsing result is used to determine whether calculation is required on the object data to be retrieved, and the object data to be retrieved is the object data included in the retrieval conditions; responding to the determination based on the parsing result that calculation is required on the object data to be retrieved, determining a naming result for the object data to be retrieved based on the object type and the receipt date of the object data to be retrieved; searching for any bucket in the first storage system according to the naming result of the object data to be retrieved to obtain a fourth search result, wherein the fourth search result includes the bucket to be retrieved named with the naming result of the object data to be retrieved; traversing any bucket to be retrieved to obtain the object data to be retrieved corresponding to the bucket to be retrieved; and calculating the object data to be retrieved according to the retrieval conditions to obtain the data retrieval result corresponding to the data retrieval instruction.

[0009] In an exemplary embodiment, the method for storing and processing video image information data further includes: in response to the parsing result determining that no calculation is needed for the data to be retrieved, determining a naming result for the data to be retrieved based on the object type and the receiving date of the data to be retrieved; searching for any index in a third storage system according to the naming result of the data to be retrieved to obtain a fifth search result, wherein the fifth search result includes a second index, the second index being named according to the naming result of the data to be retrieved; and retrieving any structured attribute data in the second index according to the search conditions to obtain a data retrieval result corresponding to the data retrieval instruction.

[0010] In an exemplary embodiment, data processing of the object data and the structured attribute data according to the object type includes: receiving a data analysis instruction and determining the object type and target time period of the object data to be analyzed based on the data analysis instruction, wherein the target time period is used to determine the receipt date of the object data to be analyzed; searching for any bucket in the first storage system according to the naming result of any object data to be analyzed to obtain a sixth search result, wherein the sixth search result includes the bucket to be analyzed named according to the naming result of the object data to be analyzed; traversing the object data to be analyzed corresponding to any bucket to be analyzed; and performing data analysis on any object data to be analyzed according to the data analysis task to obtain the data analysis result corresponding to the data analysis instruction.

[0011] In an exemplary embodiment, the method for storing and processing video image information data further includes: determining target structured attribute data of the object data to be updated based on the data analysis result, wherein the target structured attribute data is obtained by structuring the object data to be updated during the data analysis process; determining a third naming result based on the object type and the receipt date of the object data to be updated; searching for any index in a third storage system according to the third naming result to obtain a seventh search result, wherein the seventh search result includes the third index, and the third index is named according to the third naming result; searching for any structured attribute data in the third index according to the data identifier to obtain an eighth search result, wherein the eighth search result includes the structured attribute data to be updated corresponding to the object data to be updated; and updating the structured attribute data to be updated using the target structured attribute data.

[0012] According to another embodiment of this application, a storage and processing apparatus for video image information data is provided, comprising: a data receiving module for receiving video image information data to be processed; a data separation module for separating the video image information data to be processed according to data content to obtain a data separation result, wherein the data separation result includes object data and structured attribute data in the video image information data to be processed, the object data being used to describe objects in the video image information data to be processed, and the structured attribute data being used to describe characteristic attributes of corresponding objects in the video image information data to be processed; and a data storage processing module for storing and processing the object data and the structured attribute data according to object type.

[0013] In an exemplary embodiment, the object data is stored based on a first storage system, and the structured attribute data is stored based on a second and a third storage system. The storage functions of the first, second, and third storage systems are different. The data storage processing module includes: a data storage unit, configured to: determine a first naming result based on the object type and the reception date of the video image information data to be processed; search for any storage bucket in the first storage system according to the first naming result to obtain a first search result, wherein the first search result is used to determine whether a first storage bucket exists in the first storage system, and the first storage bucket is named using the first naming result; in response to determining that the first storage bucket exists in the first storage system based on the first search result, store the object data in the first storage bucket and obtain the storage path of the object data; in response to determining that the first storage bucket does not exist in the first storage system based on the first search result, create the object data in the first storage system based on the first naming result. The system includes: storing the object data in a first storage bucket; obtaining the storage path of the object data; updating the storage path of the structured attribute data according to the storage path of the object data, and clearing the object data after the update; caching the structured attribute data in a second storage system; during the consumption of the structured attribute data in the second storage system, searching for any index in the third storage system according to the first naming result to obtain a second search result, wherein the second search result is used to determine whether the first index exists in the third storage system, and the first index is named using the first naming result; in response to determining that the first index exists in the third storage system based on the second search result, storing the structured attribute data in the storage location corresponding to the first index; in response to determining that the first index does not exist in the third storage system based on the second search result, creating the first index in the third storage system based on the first naming result, and storing the structured attribute data in the storage location corresponding to the first index.

[0014] In an exemplary embodiment, the data storage processing module further includes: a data detection unit, configured to receive a data storage cycle read instruction and read the data storage cycle of object data of the object type to be monitored based on the data storage cycle read instruction, and simultaneously start a data monitoring task; determine a second naming result based on the object type to be monitored and the data storage cycle; search for any index in the third storage system according to the second naming result to obtain a third search result, wherein the third search result is used to determine whether a second index exists in the third storage system, and the second index is named using the second naming result; in response to determining that the second index exists in the third storage system based on the third search result, read the creation time of the second index from the third storage system; compare the creation time with the storage time limit of the object data of the object type to be monitored to obtain a comparison result, wherein the storage time limit is determined by the data storage cycle, and the comparison result is used to determine whether the creation time exceeds the storage time limit; in response to determining that the creation time exceeds the storage time limit based on the comparison result, determine that the structured attribute data in the second index has expired, delete the second index from the third storage system, and delete the storage bucket named with the second naming result from the first storage system.

[0015] In an exemplary embodiment, the data storage processing module further includes: a first data retrieval unit, configured to receive a data retrieval instruction and parse the retrieval conditions in the data retrieval instruction to obtain a parsing result, wherein the parsing result is used to determine whether it is necessary to perform calculations on the data to be retrieved, and the data to be retrieved is object data included in the retrieval conditions; responding to the determination based on the parsing result that it is necessary to perform calculations on the data to be retrieved, determining a naming result for any one of the data to be retrieved based on the object type and the receipt date of any one of the data to be retrieved; searching for any one of the storage buckets in the first storage system according to the naming result of any one of the data to be retrieved to obtain a fourth search result, wherein the fourth search result includes the storage bucket to be retrieved named according to the naming result of any one of the data to be retrieved; traversing any one of the storage buckets to be retrieved to obtain the data to be retrieved corresponding to the storage bucket to be retrieved; and performing calculations on the data to be retrieved according to the retrieval conditions to obtain the data retrieval result corresponding to the data retrieval instruction.

[0016] In an exemplary embodiment, the data storage processing module further includes: a second data retrieval unit, configured to, in response to the parsing result determining that no calculation is required on the data to be retrieved, determine a naming result for the data to be retrieved based on the object type and the receipt date of the data to be retrieved; search for any index in a third storage system according to the naming result of the data to be retrieved to obtain a fifth search result, wherein the fifth search result includes a second index, the second index being named according to the naming result of the data to be retrieved; and retrieve any structured attribute data in the second index according to the search conditions to obtain a data retrieval result corresponding to the data retrieval instruction.

[0017] In an exemplary embodiment, the data storage processing module further includes: a data analysis unit, configured to receive a data analysis instruction and determine the object type and target time period of the object data to be analyzed based on the data analysis instruction, wherein the target time period is used to determine the receipt date of the object data to be analyzed; search for any bucket in the first storage system according to the naming result of any object data to be analyzed to obtain a sixth search result, wherein the sixth search result includes the bucket to be analyzed named according to the naming result of the object data to be analyzed; traverse the object data to be analyzed corresponding to any bucket to be analyzed; perform data analysis on any object data to be analyzed according to the data analysis task to obtain the data analysis result corresponding to the data analysis instruction.

[0018] In an exemplary embodiment, the data storage processing module further includes: a data application unit, configured to: determine target structured attribute data of the object data to be updated based on the data analysis results, wherein the target structured attribute data is obtained by structuring the object data to be updated during the data analysis process; determine a third naming result based on the object type and the receipt date of the object data to be updated; search for any index in a third storage system according to the third naming result to obtain a seventh search result, wherein the seventh search result includes the third index, and the third index is named according to the third naming result; search for any structured attribute data in the third index according to the data identifier to obtain an eighth search result, wherein the eighth search result includes the structured attribute data to be updated corresponding to the object data to be updated; and update the structured attribute data to be updated using the target structured attribute data.

[0019] According to yet another embodiment of this application, a computer-readable storage medium is also provided, wherein a computer program is stored therein, and the computer program is configured to perform the steps in any of the above method embodiments when it is run.

[0020] According to yet another embodiment of this application, an electronic device is also provided, including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0021] In this embodiment, video image information data to be processed is first received, and then the data to be processed is separated according to the data content to obtain a data separation result. The data separation result includes object data and structured attribute data from the video image information data to be processed. The object data describes the objects in the video image information data to be processed, and the structured attribute data describes the characteristic attributes of the corresponding objects in the video image information data to be processed. Finally, the object data and the structured attribute data are stored and processed according to the object type. This embodiment, by storing and processing video image information data according to data content and object type, achieves the technical effect of improving the flexibility of video image information data storage and processing, and enhancing the flexibility and efficiency of data processing processes such as data expiration monitoring and clearing, data retrieval, and data analysis, thereby solving the problem of video image information data storage and processing in related technologies. Attached Figure Description

[0022] Figure 1 This is a hardware structure outline of a server device for a video image information data storage and processing method according to an embodiment of this application. Figure 2

[0023] Figure 2 This is a flowchart of a video image information data storage and processing method according to an embodiment of this application. Figure 2

[0024] Figure 3 This is a schematic diagram of an optional video image information data storage and processing system according to an embodiment of this application. Figure 2

[0025] Figure 4 This is a schematic diagram of another optional video image information data storage and processing system according to an embodiment of this application. Figure 2

[0026] Figure 5 A schematic diagram of a video image information data storage process according to an embodiment of this application. Figure 2

[0027] Figure 6 A schematic diagram of a data expiration monitoring and clearing process for video image information data according to an embodiment of this application. Figure 2

[0028] Figure 7 A schematic diagram of a data retrieval process for video image information data according to an embodiment of this application. Figure 2

[0029] Figure 8 This is a schematic diagram of a data application process for video image information data according to an embodiment of this application. Figure 2

[0030] Figure 9 This is a structural block diagram of a video image information data storage and processing device according to an embodiment of this application. Detailed Implementation

[0031] The embodiments of this application will be described in detail below with reference to the accompanying drawings and examples.

[0032] It should be noted that the terms "first," "second," etc., in the specification, claims, and drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0033] The methods and embodiments provided in this application can be executed on a server device or a similar computing device. Taking running on a server device as an example, Figure 1 This is a hardware structure block diagram of a server device for a video image information data storage and processing method according to an embodiment of this application. Figure 1 As shown, the server device may include one or more ( Figure 1 Only one is shown in the diagram. A processor 102 (which may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.) and a memory 104 for storing data are also shown. The server device may further include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the server equipment described above. For example, the server equipment may also include components that are more... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.

[0034] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the video image information data storage and processing method in this embodiment. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, thus implementing the above-described method. The memory 104 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to server devices via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0035] The transmission device 106 is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider for the server device. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 may be a Radio Frequency (RF) module used for wireless communication with the Internet.

[0036] This embodiment provides a method for storing and processing video image information data. Figure 2 This is a flowchart of a method for storing and processing video image information data according to an embodiment of this application, such as... Figure 2 As shown, the process includes the following steps:

[0037] Step S202: Receive the video image information data to be processed;

[0038] In the field of security monitoring technology, video image information data can refer to video clips, images, and related files, descriptive information, and other data. It should be noted that video image information data can be stored in a view library, which can be used to provide basic services that support the application of video image information.

[0039] Step S204: Perform data separation on the video image information data to be processed according to the data content to obtain data separation results. The data separation results include object data and structured attribute data in the video image information data to be processed. The object data is used to describe the objects in the video image information data to be processed, and the structured attribute data is used to describe the characteristic attributes of the corresponding objects in the video image information data to be processed.

[0040] In this application, an object-oriented approach can be used to describe video image information. Depending on the content of the described data, the video image information data can be separated into object data and structured attribute data. Object data refers to the objects in the video image information data, which may include video clips, images, files related to the video clips (images), and other video information objects, as well as objects such as people, vehicles, items, scenes, and video image tags contained within each video information object. Video clips, images, and files related to the video clips (images) can be considered as basic video image information objects, while objects such as people, vehicles, items, scenes, and video image tags contained within video information objects can be considered as semantic attribute objects of video image information. Structured attribute data can refer to one or more characteristic attributes corresponding to each object in the video image information data. As an optional implementation, structured attribute data can describe specific characteristic attributes of objects in the form of "key-value pairs".

[0041] Step S206: Store and process the object data and the structured attribute data according to the object type.

[0042] When storing and processing data, object data and structured attribute data can be flexibly stored and processed flexibly and efficiently according to the type of video image information objects in the object data.

[0043] In this embodiment, video image information data to be processed is first received, and then the data to be processed is separated according to the data content to obtain a data separation result. The data separation result includes object data and structured attribute data from the video image information data to be processed. The object data describes the objects in the video image information data to be processed, and the structured attribute data describes the characteristic attributes of the corresponding objects in the video image information data to be processed. Finally, the object data and the structured attribute data are stored and processed according to the object type. This embodiment, by storing and processing video image information data according to data content and object type, achieves the technical effect of improving the flexibility of video image information data storage and processing, and enhancing the flexibility and efficiency of data processing processes such as data expiration monitoring and clearing, data retrieval, and data analysis, thereby solving the problem of video image information data storage and processing in related technologies.

[0044] This application also provides a video image information data storage and processing system for performing a video image information data storage and processing method, such as... Figure 3As shown, the video image information data storage and processing system can receive video image information data, store, manage, and forward the received video image information data. Furthermore, the video image information data storage and processing system can also provide video image information data management and service capabilities for video image information data storage and processing system applications.

[0045] To adapt to the needs of system expansion, functional expansion, and supporting software upgrades, Figure 3 The video image information data storage and processing system shown adopts a modular design, mainly involving modules such as the business layer, storage layer, infrastructure layer, application layer, operation and maintenance management, security management, and standard protocol management. Furthermore, key devices (such as servers), key data (such as interface protocols), and key modules (such as business services and data storage) are backed up or redundant to improve system fault tolerance and recovery capabilities. Modules affecting overall system performance are clustered and configured to support dynamic load balancing. In addition, the system can be designed with self-testing and fault diagnosis functions, enabling rapid identification of the fault point when a system failure occurs, facilitating timely restoration to normal operation. Figure 3 As shown, the system can access front-end devices and systems and effectively interconnect with other external systems through interface protocols specified by standards such as GA / T1400.

[0046] The business layer provides the basic support capabilities required by the system for services such as task scheduling, transmission switching, and standard gateways. Video image information data access in the business layer refers to accessing video image-related data from various video image acquisition devices and systems at the data front end based on business needs, utilizing functions such as data exploration, data definition, and data reading, and completing the access processing of video image data. Optionally, based on the type of data accessed, video image information data access can be divided into image data access and business-focused data access. Image data access refers to the access of data related to video image objects such as people, vehicles, items, events, and locations; this data can include video clips, images, and feature values. Business-focused data access refers to accessing relevant data from other systems as needed, such as equipment information, deployment tasks, and subscription tasks.

[0047] The storage layer can be configured across multiple storage systems to store different data content within the video image information data. Optionally, the storage layer includes a distributed object storage system (first storage system), a KAFKA structured attribute data cache (second storage system), and an ES structured attribute data storage system (third storage system). The distributed object storage system can store large quantities of data such as video clips, images, files, and feature data, where secure sharing and system input / output requirements are high. The KAFKA structured attribute data cache utilizes the distributed message queue KAFKA to cache structured attribute data within the video image information data, improving the real-time write performance of structured attributes for video image information objects. The ES structured attribute data storage system organizes, manages, and stores structured attribute data within the video image information data based on the distributed database ES (ElasticSearch), providing retrieval capabilities with high access performance requirements for video image information data in different application scenarios.

[0048] Operation and maintenance management can include, but is not limited to: equipment management, operation monitoring, fault maintenance, and operation status. It can be used to perform standardized, refined, and intelligent operation and maintenance management of front-end equipment, operating environment, and application services to improve the overall operational capabilities of the system.

[0049] Security management can include physical security and security infrastructure resources. Physical security can be guaranteed by video transmission networks, information networks, or other private networks that meet security release standards. Security infrastructure resources can include, but are not limited to, identity management, authentication management, access control management, password management, audit management, asset management, and security posture management.

[0050] Standard protocol management refers to the system connecting to front-end devices and application systems through standard interface protocols (such as GA / T1400) to facilitate effective interconnection and interoperability between the system and other external systems.

[0051] It should be noted that, to enhance system security, access authentication can be performed on front-end devices, application devices, and users before video image data is connected to the system. Specifically, for example, each front-end device (e.g., cameras, sensors) can be registered before connecting to the system. Registration information includes the device's unique identifier, model, and version. Upon device connection, the registration information is compared with preset security access standards to verify compliance. For users needing system access, accounts can be pre-created and associated with user identities to ensure account uniqueness. Different permissions can be assigned to different user roles. When logging into the system, users can be authenticated using various methods (e.g., SMS verification codes, biometric information).

[0052] In an exemplary embodiment, in the technical solution provided in step S206 above, the object data is stored based on a first storage system, and the structured attribute data is stored based on a second storage system and a third storage system. The storage functions of the first storage system, the second storage system, and the third storage system are different. Storing the object data and the structured attribute data according to the object type includes:

[0053] Step S271: Determine the first naming result based on the object type and the date of receipt of the video image information data to be processed;

[0054] Step S272: Search for any storage bucket in the first storage system according to the first naming result to obtain the first search result, wherein the first search result is used to determine whether the first storage bucket exists in the first storage system, and the first storage bucket is named using the first naming result;

[0055] Step S273: Based on the first search result, if the first storage bucket is determined to exist in the first storage system, the object data is stored in the first storage bucket, and the storage path of the object data is obtained.

[0056] Step S274: Based on the first search result, it is determined that the first storage bucket does not exist in the first storage system. Based on the first naming result, the first storage bucket is created in the first storage system, the object data is stored in the first storage bucket, and the storage path of the object data is obtained.

[0057] Step S275: Update the storage path of the structured attribute data according to the storage path of the object data, and clear the object data after the update is completed;

[0058] Step S276: Cache the structured attribute data to the second storage system;

[0059] Step S277: During the process of consuming the structured attribute data in the second storage system, any index in the third storage system is searched according to the first naming result to obtain a second search result. The second search result is used to determine whether the first index exists in the third storage system. The first index is named using the first naming result.

[0060] Step S278: Based on the second search result, if the first index is determined to exist in the third storage system, the structured attribute data is stored in the storage location corresponding to the first index.

[0061] Step S279: Based on the second search result, if it is determined that the first index does not exist in the third storage system, the first index is created in the third storage system based on the first naming result, and the structured attribute data is stored in the storage location corresponding to the first index.

[0062] The following combination Figure 4 , Figure 5 The data storage process for video image information data in this application is described.

[0063] As an optional implementation method, such as Figure 4 As shown, after receiving video image information data, the system's video image information data access service parses the data content and separates object data and structured attribute data based on the parsing results. Object data can be stored in a first storage system with small file aggregation capabilities, while structured attribute data is typically stored in a third storage system. However, because the third storage system creates multi-level indexes during data storage, resulting in low data write performance and inability to perform tasks such as reporting data peaks, this application uses a second storage system to cache the structured attribute data to improve its write performance and smooth out peak data spikes. It should be noted that the first storage system can periodically store object data based on object type and date (e.g., storing object data of the same object within a day in a single bucket), and the third storage system can periodically store the structured attribute data of the same object based on object type and date (e.g., storing structured attribute data of the same object within a day in a storage location corresponding to a single index).

[0064] like Figure 5 As shown, assuming that the storage cycle of multiple storage systems is one day, after separating the video image information data into object data and structured attribute data, for the object data, the data type (referring to the object type) and access date (i.e., the receipt date) of the object data are used as the first naming result. The system searches for a storage bucket with the same name in the distributed object storage system (i.e., the first storage system). If it exists, the object data is stored in the storage bucket with the same name. If it does not exist, it proves that the object data is the first object data to be stored for the corresponding object type. Therefore, a storage bucket named with the first naming result is created in the distributed object storage system, and the object data is stored in the created storage bucket. The distributed storage system returns the storage path of each object data to update the storage path of the structured attribute data. After returning the storage path, the object data is cleared.

[0065] Still as Figure 5As shown, for the structured attribute data of the same object, after receiving the structured attribute data, it is first cached in the KAFKA structured attribute data cache (i.e., the second storage system). Then, it checks whether there is a first index in the ES structured attribute data store (i.e., the third storage system) named using a first naming result generated based on the object type corresponding to the structured attribute data and the access date of the structured attribute data. When the first index exists, the structured attribute data is stored in the storage location corresponding to the first index and the storage path of the structured attribute data is returned. When the first index does not exist, it proves that the structured attribute data is the first structured attribute data to be stored for the corresponding object type. Therefore, a first index named using the first naming result is created in the ES structured attribute data store, and the structured attribute data is stored in the storage location corresponding to the created first index.

[0066] Through the above embodiments, object data and structured attribute data are stored according to the data content and object type of video image information data, so that the data storage method can meet the performance requirements such as data access performance requirements and data security sharing requirements, thereby improving the overall performance of the system.

[0067] In an exemplary embodiment, in the technical solution provided in step S206 above, data processing of the object data and the structured attribute data according to the object type includes:

[0068] Step S281: Receive the data storage cycle read instruction and read the data storage cycle of the object data of the object type to be monitored based on the data storage cycle read instruction, and start the data monitoring task at the same time.

[0069] Step S282: Determine the second naming result based on the type of the object to be monitored and the data storage period;

[0070] Step S283: Search for any index in the third storage system according to the second naming result to obtain the third search result. The third search result is used to determine whether the second index exists in the third storage system. The second index is named using the second naming result.

[0071] Step S284: Based on the third search result, the response determines that the second index exists in the third storage system, and reads the creation time of the second index from the third storage system;

[0072] Step S285: Compare the creation time with the storage time limit of the object data of the object type to be monitored to obtain a comparison result, wherein the storage time limit is determined by the data storage period, and the comparison result is used to determine whether the creation time exceeds the storage time limit;

[0073] Step S286: Based on the comparison result, if the creation time exceeds the storage time limit, determine that the structured attribute data in the second index has expired, delete the second index from the third storage system, and delete the storage bucket named after the second naming result from the first storage system.

[0074] The following combination Figure 6 This application describes the process for monitoring and clearing expired video image information data.

[0075] As an optional implementation method, such as Figure 6 As shown, after receiving the data storage cycle read instruction for the object data of the object type to be monitored, the data storage cycle of the video image information data corresponding to the object data of the object type to be monitored is obtained, and the data storage cycle is sent to the video image information data monitoring service module of the system. Then, according to the object type to be monitored and the data storage cycle, the corresponding index (i.e., the second index) within a certain time range (e.g., data storage cycle + 2 days ago) is searched in the ES structured attribute data storage. Further, it is determined whether the difference between the current time and the creation time of the second index exceeds the data storage cycle, that is, whether the creation time of the second index exceeds the storage time limit. When it is determined that the creation time of the second index exceeds the storage time limit, the second index is deleted from the ES structured attribute data storage, and the storage bucket with the same name as the second index is deleted from the distributed object storage system, thereby realizing batch data expiration monitoring and clearing.

[0076] Through the above embodiments, when monitoring and clearing video image information data, data monitoring and clearing are not performed on every piece of object data or structured attribute data. Instead, the creation time of the corresponding index in the third storage system is checked according to the object type to see if it exceeds the storage time limit. When it is determined that the creation time of the corresponding index exceeds the storage time limit, the index is directly deleted from the third storage system to achieve fast and batch clearing of expired structured attribute data. The corresponding storage bucket is also directly deleted from the first storage system to achieve fast and batch clearing of expired object data. This ensures that data expiration monitoring and clearing does not affect the read and write performance of normal data and improves the efficiency of data expiration monitoring and clearing.

[0077] In an exemplary embodiment, in the technical solution provided in step S206 above, data processing of the object data and the structured attribute data according to the object type includes:

[0078] Step S291: Receive a data retrieval instruction and parse the retrieval conditions in the data retrieval instruction to obtain a parsing result. The parsing result is used to determine whether it is necessary to calculate the data to be retrieved. The data to be retrieved is the object data contained in the retrieval conditions.

[0079] Step S292: Based on the parsing result, the response determines that the data to be retrieved needs to be calculated, and determines the naming result of the data to be retrieved according to the object type of any data to be retrieved and the receiving date of the data to be retrieved.

[0080] Step S293: Search for any storage bucket in the first storage system according to the naming result of any one of the data to be retrieved, and obtain a fourth search result, wherein the fourth search result includes the storage bucket to be retrieved named according to the naming result of any one of the data to be retrieved.

[0081] Step S294: Traverse any bucket to be searched to obtain the data of the object to be searched corresponding to any bucket to be searched;

[0082] Step S295: Calculate the data of the object to be retrieved according to the retrieval conditions to obtain the data retrieval result corresponding to the data retrieval instruction.

[0083] Furthermore, in one exemplary embodiment, the method for storing and processing the video image information data further includes:

[0084] Step S296: In response to the parsing result determining that no calculation is needed for the data to be retrieved, the naming result of the data to be retrieved is determined based on the object type of any data to be retrieved and the receiving date of the data to be retrieved.

[0085] Step S297: Search for any index in the third storage system according to the naming result of any one of the data to be retrieved to obtain a fifth search result, wherein the fifth search result includes a second index, and the second index is named according to the naming result of any one of the data to be retrieved;

[0086] Step S298: Search for any one structured attribute data in the second index according to the search conditions to obtain the data search result corresponding to the data search instruction.

[0087] The following combination Figure 7 The data retrieval process for video image information data in this application is described.

[0088] As an optional implementation method, such as Figure 7As shown, after receiving a data retrieval instruction for the object to be retrieved, the instruction is parsed to determine whether analysis and calculation of the object data are required. If analysis and calculation are determined, the system enumerates and searches for buckets named using the object type and receipt date of any object data item. It then returns the object data stored in each bucket, and analyzes and calculates the returned object data according to the retrieval conditions corresponding to the instruction, thus obtaining the calculation result corresponding to the retrieval instruction. It should be noted that after each return of the enumeration result, the distributed object storage system checks whether the traversal and reading of the buckets corresponding to the retrieval conditions has been completed. If the traversal and reading are not complete, the enumeration and search process is repeated.

[0089] Still as Figure 7 As shown, when the parsing determines that no analysis or calculation of the object data is required, taking the data retrieval task corresponding to the data retrieval instruction as an example of querying the feature attributes of the object data to be retrieved, the object type corresponding to any object data to be retrieved and the receipt date of the object data to be retrieved are used as the naming result. The second index named with the naming result is searched from the ES structured attribute data storage, and the structured attribute data that meets the retrieval conditions in the storage location corresponding to the second index is returned, thereby obtaining the retrieval result corresponding to the data retrieval instruction.

[0090] Through the above embodiments, when retrieving video image information data, the data retrieval scope can be flexibly determined according to the retrieval conditions, thereby improving the data retrieval efficiency.

[0091] In an exemplary embodiment, in the technical solution provided in step S206 above, data processing of the object data and the structured attribute data according to the object type includes:

[0092] Step S2101: Receive data analysis instructions and determine the object type and target time period of the data to be analyzed based on the data analysis instructions, wherein the target time period is used to determine the date of receipt of the data to be analyzed;

[0093] Step S2102: Search for any storage bucket in the first storage system according to the naming result of any object data to be analyzed, and obtain the sixth search result, wherein the sixth search result includes the storage bucket to be analyzed named according to the naming result of the object data to be analyzed.

[0094] Step S2103: Traverse the data of the objects to be analyzed corresponding to any bucket to be analyzed;

[0095] Step S2104: Perform data analysis on any data of the object to be analyzed according to the data analysis task to obtain the data analysis result corresponding to the data analysis instruction.

[0096] Furthermore, in one exemplary embodiment, the method for storing and processing the video image information data further includes:

[0097] Step S2105: Determine the target structured attribute data of the object data to be updated based on the data analysis results, wherein the target structured attribute data is obtained by structuring the object data to be updated during the data analysis process;

[0098] Step S2106: Determine the third naming result based on the object type of the object data to be updated and the receipt date of the object data to be updated;

[0099] Step S2107: Search for any index in the third storage system according to the third naming result to obtain the seventh search result, wherein the seventh search result includes the third index, and the third index is named according to the third naming result;

[0100] Step S2108: Search for any structured attribute data in the third index according to the data identifier to obtain the eighth search result, wherein the eighth search result includes the structured attribute data to be updated corresponding to the object data to be updated;

[0101] Step S2109: Update the structured attribute data to be updated using the target structured attribute data.

[0102] The following combination Figure 8 The data application process of the video image information data in this application is described.

[0103] As an optional implementation method, such as Figure 8As shown, when the system executes data application tasks requiring data analysis, such as graph-based deployment and structured computation, after receiving a data analysis instruction, it parses the instruction and determines, based on the parsing result, that it needs to obtain object data of a certain data type (i.e., the object type of the object data to be analyzed) for a certain day (i.e., the target time period). Using the object type of any object data to be analyzed and any receiving date within the target time period as the naming result, it searches for the bucket to be analyzed in the distributed object storage system that uses this naming result. It then traverses each object data within the bucket and returns the enumerated object data to the application layer's analysis system. Further, based on the data analysis task, it can perform structured processing on the returned object data (object data to be updated) to obtain the desired target structured attribute data. Then, using the object type of the object data to be updated and the receiving date of the object to be updated as the third naming result, it searches for the third index named using this third naming result in the ES structured attribute data storage. Finally, it replaces the structured attribute data to be updated in the storage location corresponding to the third index with the target structured attribute data to complete the data analysis task.

[0104] Through the above embodiments, in data application processes such as image-based deployment and structured calculation of video image information data that only require reading object data, it is possible to completely avoid reading structured attribute data and perform concurrent reading of object data, thereby improving data application efficiency.

[0105] In this application, the execution order of any data processing procedure can be interchanged. That is, the execution order of any procedure in the above steps S281 to S286 (data expiration monitoring and clearing), S291 to S298 (data retrieval), and S2101 to S2109 (data application) can be interchanged.

[0106] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0107] This embodiment also provides a storage and processing apparatus for video image information data. This apparatus is used to implement the above embodiments and preferred embodiments, and details already described will not be repeated. As used below, the term "module" can refer to a combination of software and / or hardware that performs a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0108] Figure 9 This is a structural block diagram of a video image information data storage and processing apparatus according to an embodiment of this application, such as... Figure 9 As shown, the device includes:

[0109] Data receiving module 902 is used to receive video image information data to be processed;

[0110] The data separation module 904 is used to separate the video image information data to be processed according to the data content to obtain a data separation result. The data separation result includes object data and structured attribute data in the video image information data to be processed. The object data is used to describe the objects in the video image information data to be processed, and the structured attribute data is used to describe the characteristic attributes of the corresponding objects in the video image information data to be processed.

[0111] The data storage and processing module 906 is used to store and process the object data and the structured attribute data according to the object type.

[0112] The aforementioned device stores and processes video image information data according to its content and object type, thereby improving the flexibility of video image information data storage and processing, enhancing the flexibility and efficiency of data processing processes such as data expiration monitoring and clearing, data retrieval, and data analysis. This solves the problem of video image information data storage and processing in related technologies.

[0113] In an exemplary embodiment, the object data is stored based on a first storage system, and the structured attribute data is stored based on a second storage system and a third storage system. The storage functions of the first storage system, the second storage system, and the third storage system are different. The data storage processing module includes:

[0114] Data storage unit 961 (not shown in the figure) is used to determine a first naming result based on the object type and the reception date of the video image information data to be processed; search for any storage bucket in the first storage system according to the first naming result to obtain a first search result, wherein the first search result is used to determine whether a first storage bucket exists in the first storage system, and the first storage bucket is named using the first naming result; in response to determining that the first storage bucket exists in the first storage system based on the first search result, store the object data in the first storage bucket and obtain the storage path of the object data; in response to determining that the first storage bucket does not exist in the first storage system based on the first search result, create the first storage bucket in the first storage system based on the first naming result, store the object data in the first storage bucket, and obtain the storage path of the object data; and according to the storage of the object data... The path update is performed on the storage path of the structured attribute data, and the object data is cleared after the update is completed; the structured attribute data is cached in the second storage system; during the consumption of the structured attribute data in the second storage system, any index in the third storage system is searched according to the first naming result to obtain a second search result, wherein the second search result is used to determine whether the first index exists in the third storage system, and the first index is named using the first naming result; in response, if the second search result determines that the first index exists in the third storage system, the structured attribute data is stored in the storage location corresponding to the first index; in response, if the second search result determines that the first index does not exist in the third storage system, the first index is created in the third storage system based on the first naming result, and the structured attribute data is stored in the storage location corresponding to the first index.

[0115] In one exemplary embodiment, the data storage processing module further includes:

[0116] The data expiration monitoring and clearing unit 962 (not shown in the figure) is used to receive a data storage cycle read instruction and read the data storage cycle of object data of the object type to be monitored based on the data storage cycle read instruction, and simultaneously start a data monitoring task; determine a second naming result according to the object type to be monitored and the data storage cycle; search for any index in the third storage system according to the second naming result to obtain a third search result, wherein the third search result is used to determine whether a second index exists in the third storage system, and the second index is named using the second naming result; responding to the determination that the second index exists in the third storage system based on the third search result, read the creation time of the second index from the third storage system; compare the creation time with the storage time limit of the object data of the object type to be monitored to obtain a comparison result, wherein the storage time limit is determined by the data storage cycle, and the comparison result is used to determine whether the creation time exceeds the storage time limit; responding to the determination that the creation time exceeds the storage time limit based on the comparison result, determine that the structured attribute data in the second index has expired, delete the second index from the third storage system, and delete the storage bucket named with the second naming result from the first storage system.

[0117] In one exemplary embodiment, the data storage processing module further includes:

[0118] The first data retrieval unit 963 (not shown in the figure) is used to receive a data retrieval instruction and parse the retrieval conditions in the data retrieval instruction to obtain a parsing result. The parsing result is used to determine whether calculation is needed for the data to be retrieved, where the data to be retrieved is the object data included in the retrieval conditions. In response to the determination that calculation is needed for the data to be retrieved based on the parsing result, the unit determines the naming result of any one of the data to be retrieved based on its object type and the date of receipt. It searches for any one of the storage buckets in the first storage system according to the naming result of the data to be retrieved, obtaining a fourth search result. The fourth search result includes storage buckets named according to the naming result of the data to be retrieved. It traverses any one of the storage buckets to be retrieved to obtain the data to be retrieved corresponding to that storage bucket. It then performs calculations on the data to be retrieved according to the retrieval conditions to obtain the data retrieval result corresponding to the data retrieval instruction.

[0119] In one exemplary embodiment, the data storage processing module further includes:

[0120] The second data retrieval unit 964 (not shown in the figure) is used to, in response to the parsing result determining that no calculation is needed for the data to be retrieved, determine the naming result of the data to be retrieved based on the object type and the receipt date of the data to be retrieved; search for any index in the third storage system according to the naming result of the data to be retrieved to obtain a fifth search result, wherein the fifth search result includes a second index, the second index being named according to the naming result of the data to be retrieved; and retrieve any structured attribute data in the second index according to the search conditions to obtain the data retrieval result corresponding to the data retrieval instruction.

[0121] In one exemplary embodiment, the data storage processing module further includes:

[0122] The data application unit 965 (not shown in the figure) is used to receive data analysis instructions and determine the object type and target time period of the data to be analyzed based on the data analysis instructions, wherein the target time period is used to determine the receipt date of the data to be analyzed; search for any bucket in the first storage system according to the naming result of any data to be analyzed, and obtain a sixth search result, wherein the sixth search result includes the bucket to be analyzed named according to the naming result of the data to be analyzed; traverse the data to be analyzed corresponding to any bucket to be analyzed; perform data analysis on any data to be analyzed according to the data analysis task, and obtain the data analysis result corresponding to the data analysis instruction.

[0123] In one exemplary embodiment, the data storage processing module further includes:

[0124] The data application unit 965 (not shown in the figure) is further configured to determine the target structured attribute data of the object data to be updated based on the data analysis results, wherein the target structured attribute data is obtained by structuring the object data to be updated during the data analysis process; determine a third naming result based on the object type and the receipt date of the object data to be updated; search for any index in the third storage system according to the third naming result to obtain a seventh search result, wherein the seventh search result includes the third index, and the third index is named according to the third naming result; search for any structured attribute data in the third index according to the data identifier to obtain an eighth search result, wherein the eighth search result includes the structured attribute data to be updated corresponding to the object data to be updated; and update the structured attribute data to be updated using the target structured attribute data.

[0125] It should be noted that the above modules can be implemented by software or hardware. For the latter, they can be implemented in the following ways, but are not limited to: all the above modules are located in the same processor; or, the above modules are located in different processors in any combination.

[0126] Embodiments of this application also provide a computer-readable storage medium storing a computer program, wherein the computer program is configured to execute the steps in any of the above method embodiments when run.

[0127] In one exemplary embodiment, the aforementioned computer-readable storage medium may include, but is not limited to, various media capable of storing computer programs, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard disk, magnetic disk, or optical disk.

[0128] Embodiments of this application also provide an electronic device, which includes a memory and a processor. The memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0129] In one exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0130] Specific examples in this embodiment can be found in the examples described in the above embodiments and exemplary implementations, and will not be repeated here.

[0131] Obviously, those skilled in the art should understand that the modules or steps of this application described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. They can be implemented using computer-executable program code, and thus can be stored in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those presented here, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, this application is not limited to any particular combination of hardware and software.

[0132] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the principles of this application should be included within the protection scope of this application.

Claims

1. A method for storing and processing video image information data, characterized in that, include: Receive video image information data to be processed; The video image information data to be processed is separated according to the data content to obtain a data separation result. The data separation result includes object data and structured attribute data in the video image information data to be processed. The object data is used to describe the objects in the video image information data to be processed, and the structured attribute data is used to describe the characteristic attributes of the corresponding objects in the video image information data to be processed. The object data and the structured attribute data are stored and processed according to the object type; The object data is stored based on a first storage system, and the structured attribute data is stored based on a second and a third storage system. The first storage system is a distributed object storage system, the second storage system is a KAFKA structured attribute data cache, and the third storage system is an ES structured attribute data storage system. Storing the object data and the structured attribute data according to the object type includes: determining a first naming result based on the object type and the reception date of the video image information data to be processed; searching for any bucket in the first storage system according to the first naming result to obtain a first search result, wherein the first search result is used to determine whether a first bucket exists in the first storage system, and the first bucket is named using the first naming result; and responding by determining the... The first storage system contains a first storage bucket. The object data is stored in the first storage bucket, and the storage path of the object data is obtained. The storage path of the structured attribute data is updated according to the storage path of the object data, and the object data is cleared after the update. The structured attribute data is cached in the second storage system. During the consumption of the structured attribute data in the second storage system, any index in the third storage system is searched according to the first naming result to obtain a second search result. The second search result is used to determine whether the first index exists in the third storage system, and the first index is named using the first naming result. In response, based on the second search result, it is determined that the first index exists in the third storage system, and the structured attribute data is stored in the storage location corresponding to the first index. Data processing of the object data and the structured attribute data according to the object type includes: receiving a data storage cycle read instruction and reading the data storage cycle of the object data of the object type to be monitored based on the data storage cycle read instruction, and simultaneously starting a data monitoring task; determining a second naming result based on the object type to be monitored and the data storage cycle; searching for any index in the third storage system according to the second naming result to obtain a third search result, wherein the third search result is used to determine whether a second index exists in the third storage system, and the second index is named using the second naming result; responding to the determination that the second index exists in the third storage system based on the third search result, reading the creation time of the second index from the third storage system; comparing the creation time with the storage time limit of the object data of the object type to be monitored to obtain a comparison result, wherein the storage time limit is determined by the data storage cycle, and the comparison result is used to determine whether the creation time exceeds the storage time limit; responding to the determination that the creation time exceeds the storage time limit based on the comparison result, determining that the structured attribute data in the second index has expired, deleting the second index from the third storage system, and deleting the storage bucket named with the second naming result from the first storage system.

2. The method for storing and processing video image information data according to claim 1, characterized in that, Storing the object data and the structured attribute data according to the object type includes: The response determines that the first storage bucket does not exist in the first storage system based on the first search result, creates the first storage bucket in the first storage system based on the first naming result, stores the object data in the first storage bucket, and obtains the storage path of the object data; The response determines that the first index does not exist in the third storage system based on the second search result, creates the first index in the third storage system based on the first naming result, and stores the structured attribute data in the storage location corresponding to the first index.

3. The method for storing and processing video image information data according to claim 1, characterized in that, Data processing of the object data and the structured attribute data according to the object type includes: The system receives a data retrieval instruction and parses the retrieval conditions in the instruction to obtain a parsing result. The parsing result is used to determine whether it is necessary to perform calculations on the data to be retrieved, where the data to be retrieved is the object data contained in the retrieval conditions. The response determines that the data to be retrieved needs to be calculated based on the parsing result, and determines the naming result of the data to be retrieved based on the object type of any data to be retrieved and the receiving date of the data to be retrieved. The fourth search result is obtained by searching any bucket in the first storage system according to the naming result of any one of the target data to be searched. The fourth search result includes the target bucket named according to the naming result of any one of the target data to be searched. Traverse any bucket to be searched to obtain the data of the object to be searched corresponding to any bucket to be searched; The data of the object to be retrieved is calculated based on the search criteria to obtain the data retrieval result corresponding to the data retrieval instruction.

4. The method for storing and processing video image information data according to claim 3, characterized in that, The method for storing and processing video image information data further includes: In response to the parsing result determining that no calculation is required for the data to be retrieved, the naming result of the data to be retrieved is determined based on the object type of any data to be retrieved and the receiving date of the data to be retrieved. The fifth search result is obtained by searching any index in the third storage system according to the naming result of any one of the data to be retrieved. The fifth search result includes the second index, which is named according to the naming result of any one of the data to be retrieved. Based on the search criteria, any structured attribute data in the second index is retrieved to obtain the data retrieval result corresponding to the data retrieval instruction.

5. The method for storing and processing video image information data according to claim 1, characterized in that, Data processing of the object data and the structured attribute data according to the object type includes: Receive data analysis instructions and determine the object type and target time period of the data to be analyzed based on the data analysis instructions, wherein the target time period is used to determine the date of receipt of the data to be analyzed; The sixth search result is obtained by searching for any storage bucket in the first storage system according to the naming result of any object data to be analyzed. The sixth search result includes the storage bucket to be analyzed named according to the naming result of the object data to be analyzed. Iterate through the data of the objects to be analyzed corresponding to any bucket to be analyzed; According to the data analysis task, perform data analysis on any object to be analyzed to obtain the data analysis result corresponding to the data analysis instruction.

6. The method for storing and processing video image information data according to claim 5, characterized in that, The method for storing and processing video image information data further includes: Based on the data analysis results, the target structured attribute data of the object data to be updated is determined, wherein the target structured attribute data is obtained by structuring the object data to be updated during the data analysis process; The third naming result is determined based on the object type of the object data to be updated and the receipt date of the object data to be updated; The seventh search result is obtained by searching for any index in the third storage system according to the third naming result, wherein the seventh search result includes the third index, and the third index is named according to the third naming result; The system searches for any structured attribute data in the third index according to the data identifier to obtain the eighth search result, wherein the eighth search result includes the structured attribute data to be updated corresponding to the object data to be updated; The target structured attribute data is used to update the structured attribute data to be updated.

7. A storage and processing device for video image information data, characterized in that, This method is used to implement the video image information data storage and processing method according to any one of claims 1 to 6. The device includes: The data receiving module is used to receive video image information data to be processed; The data separation module is used to separate the video image information data to be processed according to the data content to obtain the data separation result. The data separation result includes object data and structured attribute data in the video image information data to be processed. The object data is used to describe the objects in the video image information data to be processed, and the structured attribute data is used to describe the characteristic attributes of the corresponding objects in the video image information data to be processed. The data storage and processing module is used to store and process the object data and the structured attribute data according to the object type.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, it implements the steps of the video image information data storage and processing method according to any one of claims 1 to 6.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the video image information data storage and processing method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Video data processing method and device

    CN114205641A

  • Object storage life cycle management method, management device, equipment and medium

    CN114489511A