Audio and video media database construction method, system and device and medium

Abstract

The invention discloses an audio and video media database construction method, system and device and a storage medium, and the method comprises the following steps: issuing a task list to a plurality of edge nodes, so that the plurality of edge nodes analyze the task list, determine a target node, a task data type and a task data quantity, enabling the target node to collect and upload task data according to the task data type and the task data quantity; wherein the target node is any node in the plurality of edge nodes; and determining an audio and video media database according to the task data. The problem of data collection repetition can be reduced, and the data collection efficiency is improved. The method can be widely applied to the technical field of data processing.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a method, system, device and storage medium for constructing an audio-visual media database. Background Art

[0002] With the rise of digital media, individuals and families have a growing need to manage audio and video content. Users not only require basic storage functions, but also expect to build a personalized media library to facilitate detailed classification, efficient search and convenient management of audio and video content.

[0003] In the related art, the central node is often set to directly send the collection instruction value to the edge node, so that the edge node performs audio and video data collection and builds the audio and video media database at the central node. However, this method often easily causes multiple edge nodes to process and collect the same audio and video data at the same time, resulting in duplicate collection data and reduced data collection efficiency. Therefore, there are still technical problems that need to be solved in the related art. Summary of the invention

[0004] The purpose of this application is to solve one of the technical problems existing in the prior art to at least a certain extent.

[0005] To this end, an object of an embodiment of the present application is to provide a method, system, device and storage medium for constructing an audio-visual media database, which can reduce the problem of duplicate collected data and improve the efficiency of data collection.

[0006] In order to achieve the above-mentioned technical objectives, the technical solution adopted by the embodiments of the present application includes: a method for constructing an audio-visual media database, comprising: sending a task list to a number of edge nodes so that the several edge nodes parse the task list, determine the target node, the task data type and the amount of task data, and enable the target node to collect and upload the task data according to the task data type and the amount of task data; wherein the target node is any one of the several edge nodes; receiving the task data uploaded by the target node and determining the audio-visual media database based on the task data.

[0007] In summary, the present application can send a task list to several edge nodes, so that the several edge nodes can parse the task list, determine the target node, the task data type and the amount of task data, and make the target node collect and upload the task data according to the task data type and the amount of task data; wherein the target node is any one of the several edge nodes; then receive the task data uploaded by the target node and determine the audio-visual media database according to the task data. The present application can reduce the risk of repeated collection of task data by several edge nodes and improve the efficiency of data collection by sending a task list to several edge nodes and determining the target node among several edge nodes to perform the collection and upload of task data.

[0008] In addition, the method for constructing an audio-visual media database according to the above embodiment of the present invention may also have the following additional technical features:

[0009] Further, in an embodiment of the present application, the target node collects and uploads the task data according to the task data type and the task data quantity, including:

[0010] The target node collects corresponding task data and records the amount of task data according to the task data type;

[0011] When the amount of the task data is greater than a first preset threshold, the target node uploads the task data.

[0012] Further, in an embodiment of the present application, the target node collects corresponding task data and records the amount of task data according to the task data type, including:

[0013] The target node collects corresponding video task data and records the amount of video data according to the video type;

[0014] or

[0015] The target node collects corresponding audio task data and records the amount of audio data according to the audio type.

[0016] Further, in an embodiment of the present application, the target node collects and uploads the task data according to the task data type and the task data quantity, and further includes:

[0017] When the amount of task data is less than or equal to the first preset threshold, the target node returns to the step of collecting corresponding task data and recording the amount of task data according to the task data type.

[0018] Furthermore, in the embodiment of the present application, determining the audio-visual media database according to the task data includes:

[0019] Extract the task file name, task file type and task content summary of the task data;

[0020] The task data is classified according to the task file name, the task file type and the task content summary to obtain an audio-visual media database.

[0021] Further, in the embodiment of the present application, the task data is classified according to the task file name, the task file type and the task content summary to obtain the audio-visual media database, including:

[0022] When the similarity between the task file name and the preset file name is greater than a second preset threshold, determining that the task data is the task data corresponding to the preset file name in the audio-visual media database;

[0023] When the similarity between the task file name and the preset file type is greater than a third preset threshold, determining that the task data is the task data corresponding to the preset file type in the audio-visual media database;

[0024] When the similarity between the task file name and the preset content summary is greater than a fourth preset threshold, the task data is determined to be the task data in the audio-visual media database corresponding to the preset content summary.

[0025] Further, in the embodiment of the present application, the second preset threshold is equal to the third preset threshold, and the third preset threshold is equal to the fourth preset threshold.

[0026] On the other hand, the embodiment of the present application further provides a system for constructing an audio-visual media database, including:

[0027] A first processing unit is used to send a task list to a plurality of edge nodes, so that the plurality of edge nodes parse the task list, determine a target node, a task data type, and a task data quantity, and enable the target node to collect and upload task data according to the task data type and the task data quantity; wherein the target node is any one of the plurality of edge nodes;

[0028] The second processing unit is used to receive the task data uploaded by the target node and determine the audio-visual media database according to the task data.

[0029] On the other hand, the present application also provides a video media database construction device, comprising:

[0030] at least one processor;

[0031] at least one memory for storing at least one program;

[0032] When the at least one program is executed by the at least one processor, the at least one processor implements a method for constructing an audio-visual media database as described in any one of the invention contents.

[0033] In addition, the present application also provides a computer-readable storage medium, which stores processor-executable instructions, and the processor-executable instructions are used to execute a method for constructing an audio-visual media database as described in any of the above items when executed by the processor.

[0034] The advantages and benefits of the present application will be partially given in the following description, and partially become apparent from the following description, or be understood through the practice of the present application:

[0035] The present application can send a task list to several edge nodes, so that the several edge nodes parse the task list, determine the target node, the task data type and the amount of task data, and make the target node collect and upload the task data according to the task data type and the amount of task data; wherein the target node is any one of the several edge nodes; then receive the task data uploaded by the target node and determine the audio-visual media database according to the task data. The present application can reduce the risk of repeated collection of task data by several edge nodes and improve the efficiency of data collection by sending a task list to several edge nodes and determining the target node among several edge nodes to perform the collection and upload of task data. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 A schematic diagram of the steps of a method for constructing an audio-visual media database in a specific embodiment of the present invention;

[0037] Figure 2 A schematic diagram of the steps of collecting and uploading task data by a target node according to the task data type and task data quantity in a specific embodiment of the present invention;

[0038] Figure 3 A schematic diagram of the steps of collecting corresponding task data and recording the amount of task data according to the task data type in a specific embodiment of the present invention;

[0039] Figure 4 A schematic diagram of the steps of collecting and uploading task data by a target node according to the task data type and task data quantity in another specific embodiment of the present invention;

[0040] Figure 5 A schematic diagram of the steps of determining an audio-visual media database according to task data in a specific embodiment of the present invention;

[0041] Figure 6A schematic diagram of the steps of classifying task data according to task file names, task file types and task content summaries to obtain an audio-visual media database in a specific embodiment of the present invention;

[0042] Figure 7 A schematic diagram of the architecture of node deployment in a specific embodiment of the present invention;

[0043] Figure 8 A schematic flow chart of a method for collecting, storing and retrieving audio and video data in a specific embodiment of the present invention;

[0044] Fig. 9 A schematic diagram of the structure of a video and audio media database construction system in a specific embodiment of the present invention;

[0045] Fig.10 It is a structural schematic diagram of an audio-visual media database construction device in a specific embodiment of the present invention. DETAILED DESCRIPTION

[0046] The following describes in detail the embodiments of the present invention in conjunction with the accompanying drawings to illustrate the principles and processes of the audio-visual media database construction method, system, device and storage medium in the embodiments of the present invention.

[0047] Reference Figure 1 , Figure 1 Schematic diagram of the steps of a method for constructing an audio-visual media database provided by an embodiment of the present application. Figure 1 In the method for constructing the audio-visual media database, the method may include but is not limited to step S101 and step S102.

[0048] S101. Send a task list to several edge nodes so that the several edge nodes parse the task list, determine the target node, task data type and task data quantity, and enable the target node to collect and upload task data according to the task data type and task data quantity; wherein the target node is any one of the several edge nodes.

[0049] It is understandable that there may be several edge nodes. Each task list may correspond to a target node for executing a task. Each task list may correspond to a task type that needs to be executed. Each task list may correspond to the number of task data that needs to be executed. The task types that need to be executed may include collecting film and television data and collecting audio data. Exemplarily, among several edge nodes, node a is used as the target node. Target node a may correspond to collecting 10 film and television data.

[0050] In some feasible embodiments of the application, the processor can establish a wired or wireless connection with several edge nodes. After the connection is established, the processor can send a task list to several edge nodes. After receiving the task list, several edge nodes can parse the target node, task data type and task data quantity for executing the task. The target node collects and uploads the task data according to the task data type and the task data quantity; wherein the target node is any one of the several edge nodes.

[0051] It should be noted that the above-mentioned wired connection method may include a connection between a mobile device and a processing module, and may also include a connection between a processing module and a hardware device, as well as a wired connection between other devices currently known or to be developed in the future and the processing module; and the above-mentioned wireless connection method may include but is not limited to 3G / 4G / 5G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (Ultra Wide Band) connection, and other wireless connection methods currently known or to be developed in the future.

[0052] S102, receiving task data uploaded by the target node and determining the audio-visual media database according to the task data.

[0053] It is understandable that in the audio-visual media database, different task file names can correspond to several task files. Different task file types can correspond to several task files. Different task content summaries can correspond to several task files. Task file types can be used as a class of several task files, task content summaries can be used as a class of several task files, and task file names can be used as a class of several task files. There can be multiple classes in the audio-visual media database, and each class can correspond to several task files.

[0054] In some embodiments of the present application, the processor may receive task data uploaded by the target node and classify the task data, and finally obtain an audio-visual media database after each task data is classified.

[0055] In summary, the present application can issue a task list to several edge nodes so that the several edge nodes can parse the task list, determine the target node, the task data type and the amount of task data, and enable the target node to collect and upload the task data according to the task data type and the amount of task data. The target node is any one of the several edge nodes. Then the task data uploaded by the target node is received and the audio-visual media database is determined based on the task data. The present application can reduce the risk of repeated collection of task data by several edge nodes and improve the efficiency of data collection by determining the target node to perform the collection and upload of task data among several edge nodes through the task list issued to several edge nodes.

[0056] Further, refer to Figure 2 , Figure 2 This is a schematic diagram of the steps of collecting and uploading task data by a target node according to the task data type and task data quantity in an embodiment of the present application. Figure 2 In the step, the step may include step S201-step S202.

[0057] S201. The target node collects corresponding task data and records the amount of task data according to the task data type.

[0058] S202: When the amount of task data is greater than a first preset threshold, the target node uploads the task data.

[0059] In some feasible embodiments of the present application, the target node collects corresponding task data and records the amount of task data according to the task data type. When the amount of task data is greater than a first preset threshold, the target node uploads the task data.

[0060] It can be understood that the first preset threshold value can be any value, and the specific value of the threshold value can be modified according to the specific needs of the user.

[0061] Further, refer to Figure 3 , Figure 3 is a schematic diagram of the steps of collecting corresponding task data and recording the amount of task data according to the task data type in an embodiment of the present application, Figure 3 This step may include step S301 or step S302.

[0062] S301. The target node collects corresponding video task data according to the video type and records the amount of video data.

[0063] or

[0064] S302: The target node collects corresponding audio task data and records the amount of video data according to the audio type.

[0065] In some feasible embodiments of the present application, the target node collects corresponding video task data and records the amount of video data according to the video type. When the amount of task data is greater than a first preset threshold, the target node uploads the task data.

[0066] In some other feasible embodiments of the present application, the target node collects the corresponding audio task data and records the amount of video data according to the audio type. When the amount of task data is greater than a first preset threshold, the target node uploads the task data.

[0067] Further, refer to Figure 4 , Figure 4This is another schematic diagram of the steps of collecting and uploading task data by the target node according to the task data type and task data quantity in one embodiment of the present application. Figure 4 In the step, the step may also include:

[0068] S203. When the amount of task data is less than or equal to the first preset threshold, the target node returns to the step where the target node collects the corresponding task data and records the amount of task data according to the task data type.

[0069] In some feasible embodiments of the present application, the target node collects corresponding task data and records the amount of task data according to the task data type. When the amount of task data is greater than a first preset threshold, the target node uploads the task data. When the amount of task data is less than or equal to the first preset threshold, the target node returns to the step where the target node collects corresponding task data and records the amount of task data according to the task data type.

[0070] It can be understood that the first preset threshold value can be any value, and the specific value of the threshold value can be modified according to the specific needs of the user.

[0071] Further, refer to Figure 5 , Figure 5 This is a schematic diagram of the steps of determining the audio-visual media database according to task data in one embodiment of the present application. Figure 5 In the step, the step may include step S401-step S402.

[0072] S401, extracting the task file name, task file type and task content summary of the task data.

[0073] S402: Classify the task data according to the task file name, task file type and task content summary to obtain an audio-visual media database.

[0074] In some feasible embodiments of the present application, the processor can extract the task file name, task file type and task content summary of the task data. After obtaining the task file name, task file type and task content summary, the processor can classify the task data according to the task file name, task file type and task content summary to obtain the audio-visual media database.

[0075] Further, refer to Figure 6 , Figure 6 This is a schematic diagram of the steps of classifying task data according to task file name, task file type and task content summary in one embodiment of the present application to obtain an audio-visual media database. Figure 6 In this step, this step may include step S501 or step S502 or step S503.

[0076] S501, when the similarity between the task file name and the preset file name is greater than a second preset threshold, determining that the task data is the task data corresponding to the preset file name in the audio-visual media database;

[0077] S502: when the similarity between the task file name and the preset file type is greater than a third preset threshold, determining that the task data is task data corresponding to the preset file type in the audio-visual media database;

[0078] S503: When the similarity between the task file name and the preset content summary is greater than a fourth preset threshold, determine that the task data is the task data corresponding to the preset content summary in the audio-visual media database.

[0079] In some feasible embodiments of the present application, the processor can extract the task file name, task file type and task content summary of the task data. When the similarity between the task file name and the preset file name is greater than the second preset threshold, the processor can determine that the task data is the task data corresponding to the preset file name in the audio-visual media database; when the similarity between the task file name and the preset file type is greater than the third preset threshold, the processor can determine that the task data is the task data corresponding to the preset file type in the audio-visual media database; when the similarity between the task file name and the preset content summary is greater than the fourth preset threshold, the processor can determine that the task data is the task data corresponding to the preset content summary in the audio-visual media database.

[0080] Further, in the embodiment of the present application, the second preset threshold is equal to the third preset threshold, and the third preset threshold is equal to the fourth preset threshold. It can be understood that the second preset threshold, the third preset threshold and the fourth preset threshold can be any value, and the specific value of the threshold can be modified according to the specific needs of the user.

[0081] The specific implementation principle of this application is described below with reference to the accompanying drawings:

[0082] The service of this embodiment adopts a multi-node deployment architecture, deploying the data collection task management terminal, media resource library management service and two search engine clusters in the central node, and deploying the data collection service in the edge nodes such as Jiangsu, Zhejiang, Shanghai or Guangdong. Figure 7 .

[0083] In some embodiments, the method flow of the present invention for collecting, storing, and retrieving audio and video data may specifically include steps S010 to S040.

[0084] S010. The data collection task management terminal issues a task list.

[0085] Specifically, first, determine on the data collection task management end whether the task to be collected is film and television data or music data. Secondly, determine the data source for collection (such as partner data source, Internet data source, etc.). Finally, determine the service node for running the collection task (such as choosing to perform this collection task at the Jiangsu and Guangdong edge nodes) and the target amount of data to be collected (such as selecting the number of data items and year, etc.). After completing the above steps, the data collection task management end will determine the data collection scope of the current task, automatically split the task list according to the number of running nodes and services, save the task list to the database, and send the task list to the corresponding data collection service.

[0086] S020. The data collection service collects data from the audio and video data source, records the collection progress, and formats the audio and video data.

[0087] Specifically, after receiving the task list, the data collection service parses it and starts collecting film, television or music data from the data source. After successfully collecting data, the collection progress of the task list is recorded locally. When the collection progress of the task list is greater than 80%, or the collected film and television data or music data reaches 80% of the quantity described in the task, the data is formatted and the data receiving interface of the media library management service of the central node is called to transmit the formatted film, television or music data to the central node. When the task list is completed, the data collection service reports the task execution status to the data collection task management terminal through the interface.

[0088] S030. Media asset library management services merge and store collected data.

[0089] Specifically, after the media library management service receives the formatted film, television or music data transmitted by each node, it uses a data double-write method to write the audio and video data to the audio and video data storage service in the primary and backup availability zones at the same time to ensure real-time synchronization of cluster data. The core storage of the audio and video data storage service is a distributed search engine, which uses a dual-cluster disaster recovery deployment architecture in the primary and backup availability zones of the central node to ensure the reliability and security of data storage. The film and television data stored in the search engine includes names, directors, actors, plot summaries, posters, etc. Music data includes names, albums, singers or covers, etc.

[0090] S040. Media asset library management service analyzes and matches data to build a user-personalized media asset library.

[0091] Specifically, after the collection and storage of audio and video data, the media library management service is also responsible for analyzing the basic metadata of the user's film, television, and music media files, matching them with the audio and video data in the audio and video data storage service, and building a personalized media library exclusive to the user. The media library management service retrieves all the user's media files according to the classification of film, television, and music, and performs similarity matching between the content summary of the media file and the film and television data and music data in the audio and video data storage service. The file names of the film and television data and music data in the audio and video data storage service are matched with the file names of the media files for similarity, and the film and television data and music data with a similarity greater than 85% are classified into a category of files corresponding to the file names of the media files, and the user's media files and audio and video data are associated and automatically classified to build the user's media library, and finally output functions such as intelligent classification and display of audio and video files, multi-dimensional conditional search, and one-click playback to the user;

[0092] In some embodiments, the method flow of the present invention for collecting, storing, and retrieving audio and video data may specifically include steps S110 to S140.

[0093] S110. The data collection task management terminal issues a task list.

[0094] Specifically, first, determine on the data collection task management end whether the task to be collected is film and television data or music data. Secondly, determine the data source for collection (such as partner data source, Internet data source, etc.). Finally, determine the service node for running the collection task (such as choosing to perform this collection task at the Jiangsu and Guangdong edge nodes) and the target amount of data to be collected (such as selecting the number of data items and year, etc.). After completing the above steps, the data collection task management end will determine the data collection scope of the current task, automatically split the task list according to the number of running nodes and services, save the task list to the database, and send the task list to the corresponding data collection service.

[0095] S120, the data collection service collects data from the audio and video data source, records the collection progress, and formats the audio and video data.

[0096] Specifically, after receiving the task list, the data collection service parses it and starts collecting film, television or music data from the data source. After successfully collecting data, the collection progress of the task list is recorded locally. When the collection progress of the task list is greater than 90%, or the collected film and television data or music data reaches 90% of the quantity described in the task, the data is formatted and the data receiving interface of the media library management service of the central node is called to transmit the formatted film, television or music data to the central node. When the task list is completed, the data collection service reports the task execution status to the data collection task management terminal through the interface.

[0097] S130, the media resource library management service merges and stores the collected data.

[0098] Specifically, after the media library management service receives the formatted film, television or music data transmitted by each node, it uses a data double-write method to write the audio and video data to the audio and video data storage service in the primary and backup availability zones at the same time to ensure real-time synchronization of cluster data. The core storage of the audio and video data storage service is a distributed search engine, which uses a dual-cluster disaster recovery deployment architecture in the primary and backup availability zones of the central node to ensure the reliability and security of data storage. The film and television data stored in the search engine includes names, directors, actors, plot summaries, posters, etc. Music data includes names, albums, singers, and covers, etc.

[0099] S140, the media resource library management service analyzes and matches data to build a user personalized media resource library.

[0100] Specifically, after the collection and storage of audio and video data, the media library management service is also responsible for analyzing the basic metadata of the user's film, television, and music media files, matching them with the audio and video data in the audio and video data storage service, and building a personalized media library exclusive to the user. The media library management service retrieves all the user's media files according to the classification of film, television, and music, and matches the file types of the media files with the film and television data and music data in the audio and video data storage service. The file names of the film and television data and music data in the audio and video data storage service are matched with the file names of the media files. The film and television data and music data with a similarity greater than 90% are classified into a category of files corresponding to the file names of the media files. The user's media files and audio and video data are associated and automatically classified to build the user's media library, and finally output functions such as intelligent classification and display of audio and video files, multi-dimensional conditional search, and one-click playback to the user.

[0101] In some embodiments, the method flow of the present invention for collecting, storing, and retrieving audio and video data may specifically include steps S210 to S240.

[0102] S210, the data collection task management terminal issues a task list.

[0103] Specifically, first, determine on the data collection task management end whether the task to be collected is film and television data or music data. Secondly, determine the data source for collection (such as partner data source, Internet data source, etc.). Finally, determine the service node for running the collection task (such as choosing to perform this collection task at the Jiangsu and Guangdong edge nodes) and the target amount of data to be collected (such as selecting the number of data items and year, etc.). After completing the above steps, the data collection task management end will determine the data collection scope of the current task, automatically split the task list according to the number of running nodes and services, save the task list to the database, and send the task list to the corresponding data collection service.

[0104] S220, the data collection service collects data from the audio and video data source, records the collection progress, and formats the audio and video data.

[0105] Specifically, after receiving the task list, the data collection service parses it and starts collecting film, television or music data from the data source. After successfully collecting data, the collection progress of the task list is recorded locally. When the collection progress of the task list is greater than 85%, or the collected film and television data or music data reaches 85% of the quantity described in the task, the data is formatted and the data receiving interface of the media library management service of the central node is called to transmit the formatted film, television or music data to the central node. When the task list is completed, the data collection service reports the task execution status to the data collection task management terminal through the interface.

[0106] S230: The media resource library management service merges and stores the collected data.

[0107] Specifically, after the media library management service receives the formatted film, television or music data transmitted by each node, it uses a data double-write method to write the audio and video data to the audio and video data storage service in the primary and backup availability zones at the same time to ensure real-time synchronization of cluster data. The core storage of the audio and video data storage service is a distributed search engine, which uses a dual-cluster disaster recovery deployment architecture in the primary and backup availability zones of the central node to ensure the reliability and security of data storage. The film and television data stored in the search engine includes names, directors, actors, plot summaries, posters, etc. Music data includes names, albums, singers or covers, etc.

[0108] S240, the media resource library management service analyzes and matches data to build a user personalized media resource library.

[0109] Specifically, after the collection and storage of audio and video data, the media library management service is also responsible for analyzing the basic metadata of the user's film, television, and music media files, matching them with the audio and video data in the audio and video data storage service, and building a personalized media library exclusive to the user. The media library management service retrieves all the user's media files according to the classification of film, television, and music, and matches the file names of the media files with the film and television data and music data in the audio and video data storage service. The file names of the film and television data and music data in the audio and video data storage service are matched with the file names of the media files for similarity. The film and television data and music data with a similarity greater than 80% are classified into a category of files corresponding to the file names of the media files. The user's media files and audio and video data are associated and automatically classified to build the user's media library, and finally output functions such as intelligent classification and display of audio and video files, multi-dimensional conditional search, and one-click playback to the user.

[0110] In some embodiments, the method flow of the present invention for collecting, storing, and retrieving audio and video data may specifically include steps S310 to S340.

[0111] S310, the data collection task management terminal issues a task list.

[0112] Specifically, first, determine on the data collection task management end whether the task to be collected is film and television data or music data. Secondly, determine the data source for collection (such as partner data source, Internet data source, etc.). Finally, determine the service node for running the collection task (such as choosing to perform this collection task at the Jiangsu and Guangdong edge nodes) and the target amount of data to be collected (such as selecting the number of data items and year, etc.). After completing the above steps, the data collection task management end will determine the data collection scope of the current task, automatically split the task list according to the number of running nodes and services, save the task list to the database, and send the task list to the corresponding data collection service.

[0113] S320, the data collection service collects data from the audio and video data source, records the collection progress, and formats the audio and video data.

[0114] Specifically, after receiving the task list, the data collection service parses it and starts collecting film, television or music data from the data source. After successfully collecting data, the collection progress of the task list is recorded locally. When the collection progress of the task list is greater than 75%, or the collected film and television data or music data reaches 75% of the quantity described in the task, the data is formatted and the data receiving interface of the media library management service of the central node is called to transmit the formatted film, television or music data to the central node. When the task list is completed, the data collection service reports the task execution status to the data collection task management terminal through the interface.

[0115] S330, the media resource library management service merges and stores the collected data.

[0116] Specifically, after the media library management service receives the formatted film, television or music data transmitted by each node, it uses a data double-write method to write the audio and video data to the audio and video data storage service in the primary and backup availability zones at the same time to ensure real-time synchronization of cluster data. The core storage of the audio and video data storage service is a distributed search engine, which uses a dual-cluster disaster recovery deployment architecture in the primary and backup availability zones of the central node to ensure the reliability and security of data storage. The film and television data stored in the search engine includes names, directors, actors, plot summaries, posters, etc. Music data includes names, albums, singers or covers, etc.

[0117] S340: The media resource library management service analyzes and matches data to build a user-personalized media resource library.

[0118] Specifically, after the collection and storage of audio and video data, the media library management service is also responsible for analyzing the basic metadata of the user's film, television, and music media files, matching them with the audio and video data in the audio and video data storage service, and building a personalized media library exclusive to the user. The media library management service retrieves all the user's media files according to the classification of film, television, and music, and matches the file names of the media files with the film and television data and music data in the audio and video data storage service. The file names of the film and television data and music data in the audio and video data storage service are matched with the file names of the media files for similarity. The film and television data and music data with a similarity greater than 70% are classified into a category of files corresponding to the file names of the media files, and the user's media files and audio and video data are associated and automatically classified to build the user's media library, and finally output functions such as intelligent classification and display of audio and video files, multi-dimensional conditional search, and one-click playback to the user.

[0119] In summary, the audio-visual media database construction method of the present application has the following advantages:

[0120] This application proposes a method for constructing an audio-visual media database for a multi-node audio-visual data collection service. The method adopts a stateless design and solves the problem of duplicate collection tasks by issuing a task list. The method supports deployment on edge nodes and simultaneous operation. The method makes full use of the computing, bandwidth and other resources of edge nodes, supports simultaneous operation of multiple nodes, and has high data collection efficiency.

[0121] This application proposes a media library management service method that integrates audio and video data and media files. By building a user-personalized media library, this application has the ability to output audio and video files for intelligent classification, display, and multi-dimensional fast search.

[0122] This application proposes a multi-cluster disaster recovery method for storing massive audio and video data. The method has retrieval services, supports the storage of massive data, multi-dimensional full-text search, horizontal expansion and other features, and the method can adopt a multi-cluster disaster recovery deployment architecture according to disaster recovery needs to improve the reliability and security of data storage.

[0123] In addition, refer to Fig. 9 ,and Figure 1Corresponding to the method, an embodiment of the present application also provides an audio-visual media database construction system, which may include a first processing unit 1001 and a second processing unit 1002. The first processing unit 1001 can be used to send a task list to a number of edge nodes, so that the several edge nodes parse the task list, determine the target node, the task data type and the amount of task data, and enable the target node to collect and upload task data according to the task data type and the amount of task data. The target node is any one of the several edge nodes. The second processing unit 1002 can be used to receive the task data uploaded by the target node and determine the audio-visual media database based on the task data.

[0124] It should be noted that the first processing unit may be any integrated circuit unit or microprocessor unit obtained by integrating a chip having a processing function and its peripheral circuits through existing integration technology. The first processing unit and the second processing unit may also be any integrated circuit module or microprocessor module obtained by integrating a chip having a processing function and its peripheral circuits through existing integration technology. The first processing unit and the second processing unit may also include one or more memories. One or more memories may be used to store specific algorithms for data processing in this application.

[0125] In some embodiments of the present application, the first processing unit 1001 and the second processing unit 1002 can be set in the same gateway or device with a processor. The first processing unit 1001 can send a task list to several edge nodes through the chip inside its own processor, so that several edge nodes parse the task list, determine the target node, the task data type and the amount of task data, and enable the target node to collect and upload the task data according to the task data type and the amount of task data; wherein the target node is any one of the several edge nodes. The second processing unit 1002 can determine the audio-visual media database based on the obtained task data. The first processing unit 1001 can be any unit connected to the processor inside the gateway or device. The first processing unit 1001 can transmit the acquired data to the processor through a wired or wireless connection with the processor of the first processing unit 1002. The processor of the first processing unit 1002 can process the data through the internal chip, and finally obtain the audio-visual media database. The specific device connection mode and device setting of the acquisition unit 1001 and the first processing unit 1002 are not limited.

[0126] It should be noted that the contents of the above-mentioned audio-visual media database construction method embodiment are all applicable to the audio-visual media database construction system embodiment. The functions specifically implemented by the audio-visual media database construction system embodiment are the same as those of the above-mentioned audio-visual media database construction method embodiment, and the beneficial effects achieved are also the same as those achieved by the above-mentioned audio-visual media database construction method embodiment.

[0127] and Figure 1 Corresponding to the method, the embodiment of the present application also provides an audio-visual media database construction device, the specific structure of which can be referred to Fig.10 ,include:

[0128] at least one processor 1011;

[0129] At least one memory 1012, used to store at least one program;

[0130] When at least one program is executed by at least one processor, the at least one processor implements the audio-visual media database construction method.

[0131] The contents of the above method embodiments are all applicable to the present device embodiments. The functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0132] and Figure 1 Corresponding to the method, an embodiment of the present application further provides a computer-readable storage medium, which stores processor-executable instructions, and the processor-executable instructions are used to execute the audio-visual media database construction method when executed by the processor.

[0133] The contents of the above-mentioned audio-visual media database construction method embodiment are all applicable to the present storage medium embodiment. The functions specifically implemented by the present storage medium embodiment are the same as those of the above-mentioned audio-visual media database construction method embodiment, and the beneficial effects achieved are also the same as those achieved by the above-mentioned audio-visual media database construction method embodiment.

[0134] In some optional embodiments, the function / operation mentioned in the block diagram may not occur in the order mentioned in the operation diagram. For example, depending on the function / operation involved, the two boxes shown in succession can actually be executed substantially simultaneously or the boxes can sometimes be executed in reverse order. In addition, the embodiment presented and described in the flow chart of the application is provided by way of example, for the purpose of providing a more comprehensive understanding of technology. The disclosed method is not limited to the operation and logic flow presented herein. Optional embodiments are expected, wherein the order of various operations is changed and the sub-operation described as a part of a larger operation is performed independently.

[0135] In addition, although the present application is described in the context of functional modules, it should be understood that, unless otherwise specified, one or more of the functions and / or features can be integrated into a single physical device and / or software module, or one or more functions and / or features can be implemented in a separate physical device or software module. It is also understood that a detailed discussion of the actual implementation of each module is unnecessary for understanding the present application. More specifically, in view of the properties, functions, and internal relationships of the various functional modules in the device disclosed herein, the actual implementation of the module will be understood within the conventional techniques of the engineer. Therefore, those skilled in the art can implement the present application set forth in the claims without excessive experimentation using ordinary techniques. It is also understood that the specific concepts disclosed are merely illustrative and are not intended to limit the scope of the present application, which is determined by the full scope of the attached claims and their equivalents.

[0136] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several programs to enable a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0137] The logic and / or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable programs for implementing the logical functions, and may be embodied in any computer-readable medium for use by a program execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch and execute a program from a program execution system, device or apparatus), or in conjunction with such program execution systems, devices or apparatuses. For purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use by a program execution system, device or apparatus, or in conjunction with such program execution systems, devices or apparatuses.

[0138] More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be a paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering or, if necessary, processing in another suitable manner, and then stored in a computer memory.

[0139] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable program execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0140] In the above description of this specification, the description with reference to the terms "one embodiment / example", "another embodiment / example" or "certain embodiments / examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0141] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present application, and that the scope of the present application is defined by the claims and their equivalents.

[0142] The above is a specific description of the preferred implementation of the present application, but the present application is not limited to the described embodiments. Technical personnel familiar with the field may make various equivalent modifications or substitutions without violating the spirit of the present application. These equivalent modifications or substitutions are all included in the scope defined by the claims of the present application.

Claims

1. A method for constructing an audio-visual media database, characterized in that: The following steps are involved: Sending a task list to a plurality of edge nodes, so that the plurality of edge nodes parse the task list, determine a target node, a task data type, and a task data quantity, and enable the target node to collect and upload task data according to the task data type and the task data quantity; The target node is any one of the edge nodes; The task data uploaded by the target node is received and an audio-visual media database is determined according to the task data.

2. A method for constructing an audio-visual media database according to claim 1, characterized in that: The target node collects and uploads the task data according to the task data type and the task data quantity, including: The target node collects corresponding task data and records the amount of task data according to the task data type; When the amount of the task data is greater than a first preset threshold, the target node uploads the task data.

3. A method for constructing an audio-visual media database according to claim 2, characterized in that: The target node collects corresponding task data and records the amount of the task data according to the task data type, including: The target node collects corresponding video task data and records the amount of video data according to the video type; or The target node collects corresponding audio task data and records the amount of audio data according to the audio type.

4. The method for constructing an audio-visual media database according to claim 2, characterized in that: The target node collects and uploads the task data according to the task data type and the task data quantity, further comprising: When the amount of task data is less than or equal to the first preset threshold, the target node returns to the step of collecting corresponding task data and recording the amount of task data according to the task data type.

5. The method for constructing an audio-visual media database according to claim 1, characterized in that: Determining the audio-visual media database according to the task data includes: Extract the task file name, task file type and task content summary of the task data; The task data is classified according to the task file name, the task file type and the task content summary to obtain an audio-visual media database.

6. A method for constructing an audio-visual media database according to claim 5, characterized in that: The task data is classified according to the task file name, the task file type and the task content summary to obtain an audio-visual media database, including: When the similarity between the task file name and the preset file name is greater than a second preset threshold, determining that the task data is the task data corresponding to the preset file name in the audio-visual media database; When the similarity between the task file name and the preset file type is greater than a third preset threshold, determining that the task data is the task data corresponding to the preset file type in the audio-visual media database; When the similarity between the task file name and the preset content summary is greater than a fourth preset threshold, the task data is determined to be the task data in the audio-visual media database corresponding to the preset content summary.

7. A method for constructing an audio-visual media database according to claim 6, characterized in that: The second preset threshold is equal to the third preset threshold, and the third preset threshold is equal to the fourth preset threshold.

8. A system for constructing an audio-visual media database, characterized in that: include: A first processing unit is used to send a task list to a plurality of edge nodes, so that the plurality of edge nodes parse the task list, determine a target node, a task data type and a task data quantity, and enable the target node to collect and upload task data according to the task data type and the task data quantity; The target node is any one of the edge nodes; The second processing unit is used to receive the task data uploaded by the target node and determine the audio-visual media database according to the task data.

9. A device for constructing an audio-visual media database, characterized in that include: at least one processor; at least one memory for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements a method for constructing an audio-visual media database as described in any one of claims 1-7.

10. A computer-readable storage medium storing instructions executable by a processor, characterized in that: The processor-executable instructions are used to execute a method for constructing an audio-visual media database as described in any one of claims 1-7 when executed by the processor.

Images