A video and audio media database construction method, system, device and medium

Abstract

The application discloses a video and audio media library construction method, system and device and a storage medium. The method comprises the following steps: issuing a task list to a plurality of edge nodes, so that the plurality of edge nodes analyze the task list, determine a target node, a task data type and a task data quantity, and make the target node collect and upload task data according to the task data type and the task data quantity; wherein the target node is any node in the plurality of edge nodes; and a video and audio media library is determined according to the task data. The application can reduce the problem of repeated data collection and improve the efficiency of data collection. The application can be widely applied to the technical field of data processing.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, and particularly relates to a video and audio media library construction method, system and device and a storage medium. BACKGROUND

[0002] With the rise of digital media, the management demand of personal and family for video and audio content is increasing. Users not only require basic storage function, but also expect to construct a personalized media library so as to classify video and audio content in detail, search efficiently and manage conveniently.

[0003] In the related art, a central node is often set to directly issue a collection instruction to an edge node, so that the edge node executes video and audio data collection and constructs a video and audio media library at the central node. However, this method often causes multiple edge nodes to simultaneously process collection of a video and audio data, resulting in repeated collection of data and reduced efficiency of data collection. Therefore, there are still technical problems to be solved in the related art. SUMMARY

[0004] The present application aims to at least partly solve one of the technical problems in the prior art.

[0005] To this end, an object of the embodiments of the present application is to provide a video and audio media library construction method, system, device and storage medium, which can reduce the problem of repeated collection of data and improve the efficiency of data collection.

[0006] To achieve the above technical purpose, the technical solution adopted by the embodiments of the present application comprises: a video and audio media library construction method, comprising: issuing a task list to a plurality of edge nodes, so that the plurality of edge nodes analyze the task list, determine a target node, a task data type and a task data quantity, and make the target node collect and upload task data according to the task data type and the task data quantity; wherein the target node is any one of the plurality of edge nodes; receiving the task data uploaded by the target node and determining a video and audio media library according to the task data.

[0007] To sum up, the application can issue a task list to a plurality of edge nodes, so that the plurality of edge nodes analyze the task list, determine a target node, a task data type, and a task data quantity, and the target node collects and uploads task data according to the task data type and the task data quantity; the target node is any node in the plurality of edge nodes; then the target node uploads the task data and determines an audio-visual media library according to the task data. The application can reduce the risk of repeated collection of task data by the plurality of edge nodes and improve the efficiency of data collection by issuing a task list to the plurality of edge nodes to determine a target node to collect and upload task data.

[0008] In addition, the method for constructing an audio-visual media library according to the above-mentioned embodiments of the application can have the following additional technical features:

[0009] Further, in the embodiments of the application, the target node collects and uploads task data according to the task data type and the task data quantity, including:

[0010] The target node collects corresponding task data according to the task data type and records the task data quantity;

[0011] When the task data quantity is greater than a first preset threshold, the target node uploads the task data.

[0012] Further, in the embodiments of the application, the target node collects corresponding task data according to the task data type and records the task data quantity, including:

[0013] The target node collects corresponding video task data according to the video type and records the quantity of video data;

[0014] Or

[0015] The target node collects corresponding audio task data according to the audio type and records the quantity of audio data.

[0016] Further, in the embodiments of the application, the target node collects and uploads task data according to the task data type and the task data quantity, further including:

[0017] When the task data quantity is less than or equal to the first preset threshold, the target node returns to the step of collecting corresponding task data according to the task data type and recording the task data quantity.

[0018] Further, in the embodiments of the application, the determination of an audio-visual media library according to the task data includes:

[0019] extract a task file name, a task file type and a task content abstract of the task data;

[0020] classify the task data according to the task file name, the task file type and the task content abstract to obtain an audio-visual media library.

[0021] Further, in the embodiments of the present application, the classifying the task data according to the task file name, the task file type and the task content abstract to obtain an audio-visual media library comprises:

[0022] when the similarity between the task file name and the preset file name is greater than a second preset threshold, determining that the task data is the task data corresponding to the preset file name in the audio-visual media library;

[0023] when the similarity between the task file name and the preset file type is greater than a third preset threshold, determining that the task data is the task data corresponding to the preset file type in the audio-visual media library;

[0024] when the similarity between the task file name and the preset content abstract is greater than a fourth preset threshold, determining that the task data is the task data corresponding to the preset content abstract in the audio-visual media library.

[0025] Further, in the embodiments of the present application, the second preset threshold is equal to the third preset threshold, and the third preset threshold is equal to the fourth preset threshold.

[0026] On the other hand, the embodiments of the present application also provide an audio-visual media library construction system, comprising:

[0027] a first processing unit configured to issue a task list to a plurality of edge nodes, so that the plurality of edge nodes analyze the task list, determine a target node, a task data type and a task data quantity, and make the target node collect and upload task data according to the task data type and the task data quantity; wherein the target node is any one of the plurality of edge nodes;

[0028] a second processing unit configured to receive the task data uploaded by the target node and determine an audio-visual media library according to the task data.

[0029] On the other hand, the present application also provides an audio-visual media library construction device, comprising:

[0030] at least one processor;

[0031] at least one memory configured to store at least one program;

[0032] When the at least one program is executed by the at least one processor, the at least one processor implements the video and audio media library construction method according to any one of the above.

[0033] In addition, the application further provides a computer readable storage medium, wherein the computer readable storage medium stores processor executable instructions, and the processor executable instructions are used for executing the video and audio media library construction method according to any one of the above when executed by a processor.

[0034] The advantages and beneficial effects of the application will be partially given in the following description, partially become obvious from the following description, or be understood through the practice of the application:

[0035] The application can issue a task list to a plurality of edge nodes, so that the plurality of edge nodes analyze the task list, determine a target node, a task data type and a task data quantity, and so that the target node collects and uploads task data according to the task data type and the task data quantity; wherein the target node is any one of the plurality of edge nodes; and then receive the task data uploaded by the target node and determine a video and audio media library according to the task data. The application can reduce the risk of repeated collection of task data by the plurality of edge nodes and improve the efficiency of data collection by issuing a task list to the plurality of edge nodes to determine a target node to perform the collection and uploading of task data in the plurality of edge nodes. BRIEF DESCRIPTION OF DRAWINGS

[0036] Figure 1 A step schematic diagram of a video and audio media library construction method in one embodiment of the application;

[0037] Figure 2 A step schematic diagram of the target node collecting and uploading task data according to the task data type and the task data quantity in one embodiment of the application;

[0038] Figure 3 A step schematic diagram of the target node collecting corresponding task data according to the task data type and recording the task data quantity in one embodiment of the application;

[0039] Figure 4 A step schematic diagram of the target node collecting and uploading task data according to the task data type and the task data quantity in another embodiment of the application;

[0040] Figure 5 A step schematic diagram of determining a video and audio media library according to task data in one embodiment of the application;

[0041] Figure 6A step schematic diagram of classifying task data according to a task file name, a task file type and a task content abstract to obtain an audio-visual media library in a specific embodiment of the present application;

[0042] Figure 7 A schematic diagram of a node deployment architecture in a specific embodiment of the present application;

[0043] Figure 8 A method flow schematic diagram of audio-visual data collection, storage and retrieval in a specific embodiment of the present application;

[0044] Figure 9 A structure schematic diagram of an audio-visual media library construction system in a specific embodiment of the present application;

[0045] Figure 10 A structure schematic diagram of an audio-visual media library construction device in a specific embodiment of the present application. DETAILED DESCRIPTION

[0046] The principles and processes of the audio-visual media library construction method, system, device and storage medium in the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0047] Reference Figure 1 , Figure 1 is a step schematic diagram of an audio-visual media library construction method provided by the embodiments of the present application. In Figure 1 , the audio-visual media library construction method can include but is not limited to step S101 and step S102.

[0048] S101, a task list is issued to a plurality of edge nodes, so that the plurality of edge nodes analyze the task list, determine a target node, a task data type and a task data quantity, and the target node collects and uploads task data according to the task data type and the task data quantity; wherein the target node is any node in the plurality of edge nodes.

[0049] It can be understood that there can be a plurality of edge nodes. Each task list can correspond to a target node performing a task. Each task list can correspond to a task type to be performed. Each task list can correspond to a quantity of task data to be performed. The task type to be performed can include collecting video data and collecting audio data. Illustratively, in the plurality of edge nodes, a node a serves as a target node. The target node a node can correspond to collecting 10 video data.

[0050] In some possible embodiments of the application, the processor can establish wired or wireless connections with the plurality of edge nodes. After the connections are established, the processor can issue a task list to the plurality of edge nodes. After receiving the task list, the plurality of edge nodes can parse the target node for executing the task, the task data type, and the task data quantity. The target node collects and uploads the task data according to the task data type and the task data quantity, wherein the target node is any one of the plurality of edge nodes.

[0051] It should be noted that the above wired connection mode can include the connection between the mobile device and the processing module, and can also include the connection between the processing module and the hardware device, and the wired connection between other now known or future developed devices and the processing module; and the above wireless connection mode can include but is not limited to 3G / 4G / 5G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (Ultra Wide Band) connection, and other now known or future developed wireless connection modes.

[0052] S102, receiving the task data uploaded by the target node and determining the audio and video media library according to the task data.

[0053] It can be understood that in the audio and video media library, different task file names can correspond to a plurality of task files. Different task file types can correspond to a plurality of task files. Different task content abstracts can correspond to a plurality of task files. The task file type can be a class of the plurality of task files, the task content abstract can be a class of the plurality of task files, and the task file name can be a class of the plurality of task files. There can be multiple classes in the audio and video media library, and each class can correspond to a plurality of task files.

[0054] In some embodiments of the application, the processor can receive the task data uploaded by the target node and classify the task data, and finally obtain the audio and video media library classified according to each task data.

[0055] In summary, the application can issue a task list to the plurality of edge nodes, so that the plurality of edge nodes parse the task list, determine the target node, the task data type, and the task data quantity, and make the target node collect and upload the task data according to the task data type and the task data quantity. The target node is any one of the plurality of edge nodes. Then receive the task data uploaded by the target node and determine the audio and video media library according to the task data. The application determines the target node to execute the collection and uploading of the task data in the plurality of edge nodes through the task list issued to the plurality of edge nodes, which can reduce the risk of repeated collection of task data by the plurality of edge nodes and improve the efficiency of data collection.

[0056] Further, referring to Figure 2 , Figure 2 is a step diagram of collecting and uploading task data by the target node according to the type of task data and the number of task data in an embodiment of the present application. In Figure 2 , the step can include step S201-step S202.

[0057] S201, the target node collects corresponding task data according to the type of task data and records the number of task data.

[0058] S202, when the number of task data is greater than a first preset threshold, the target node uploads the task data.

[0059] In some feasible embodiments of the present application, the target node collects corresponding task data according to the type of task data and records the number of task data. When the number of task data is greater than a first preset threshold, the target node uploads the task data.

[0060] It can be understood that the first preset threshold can be any value, and the specific value of the threshold can be modified according to the specific needs of the user.

[0061] Further, referring to Figure 3 , Figure 3 is a step diagram of collecting and uploading task data by the target node according to the type of task data and the number of task data in an embodiment of the present application. In Figure 3 , the step can include step S301 or step S302.

[0062] S301, the target node collects corresponding video task data according to the type of video and records the number of video data.

[0063] or

[0064] S302, the target node collects corresponding audio task data according to the type of audio and records the number of video data.

[0065] In some feasible embodiments of the present application, the target node collects corresponding video task data according to the type of video and records the number of video data. When the number of task data is greater than a first preset threshold, the target node uploads the task data.

[0066] In some other feasible embodiments of the present application, the target node collects corresponding audio task data according to the type of audio and records the number of video data. When the number of task data is greater than a first preset threshold, the target node uploads the task data.

[0067] Further, referring to Figure 4 , Figure 4is another step schematic diagram of collecting and uploading the task data by the target node according to the task data type and the task data quantity in an embodiment of the present application. In Figure 4 , the step can further include:

[0068] S203, when the task data quantity is less than or equal to the first preset threshold, the target node returns to step S201 of collecting the corresponding task data according to the task data type and recording the task data quantity.

[0069] In some feasible embodiments of the present application, the target node collects the corresponding task data according to the task data type and records the task data quantity. When the task data quantity is greater than the first preset threshold, the target node uploads the task data. When the task data quantity is less than or equal to the first preset threshold, the target node returns to step S201 of collecting the corresponding task data according to the task data type and recording the task data quantity.

[0070] It can be understood that the first preset threshold can be any value, and the specific value of the threshold can be modified according to the specific needs of the user.

[0071] Further, referring to Figure 5 , Figure 5 is a step schematic diagram of determining the audio and video media library according to the task data in an embodiment of the present application. In Figure 5 , the step can include step S401-step S402.

[0072] S401, extracting the task file name, the task file type and the task content abstract of the task data.

[0073] S402, classifying the task data according to the task file name, the task file type and the task content abstract to obtain the audio and video media library.

[0074] In some feasible embodiments of the present application, the processor can extract the task file name, the task file type and the task content abstract of the task data. After obtaining the task file name, the task file type and the task content abstract, the processor can classify the task data according to the task file name, the task file type and the task content abstract to obtain the audio and video media library.

[0075] Further, referring to Figure 6 , Figure 6 is a step schematic diagram of classifying the task data according to the task file name, the task file type and the task content abstract to obtain the audio and video media library in an embodiment of the present application. In Figure 6 , this step can include step S501 or step S502 or step S503.

[0076] S501, when the similarity between the task file name and the preset file name is greater than a second preset threshold, determining that the task data is the task data corresponding to the preset file name in the audio-visual media library;

[0077] S502, when the similarity between the task file name and the preset file type is greater than a third preset threshold, determining that the task data is the task data corresponding to the preset file type in the audio-visual media library;

[0078] S503, when the similarity between the task file name and the preset content abstract is greater than a fourth preset threshold, determining that the task data is the task data corresponding to the preset content abstract in the audio-visual media library.

[0079] In some possible embodiments of the present application, the processor can extract the task file name, the task file type and the task content abstract of the task data. When the similarity between the task file name and the preset file name is greater than the second preset threshold, the processor can determine that the task data is the task data corresponding to the preset file name in the audio-visual media library; when the similarity between the task file name and the preset file type is greater than the third preset threshold, the processor can determine that the task data is the task data corresponding to the preset file type in the audio-visual media library; and when the similarity between the task file name and the preset content abstract is greater than the fourth preset threshold, the processor can determine that the task data is the task data corresponding to the preset content abstract in the audio-visual media library.

[0080] Further, in the embodiments of the present application, the second preset threshold is equal to the third preset threshold, and the third preset threshold is equal to the fourth preset threshold. It can be understood that the second preset threshold, the third preset threshold and the fourth preset threshold can be any value, and the specific value of the threshold can be modified according to the specific needs of the user.

[0081] The specific implementation principles of the present application will be described below in conjunction with the accompanying drawings:

[0082] The service of the present embodiment adopts a multi-node deployment architecture, and a data collection task management terminal, a media asset library management service and two search engine clusters are deployed in a central node, and a data collection service is deployed in an edge node in Jiangsu, Zhejiang, Shanghai or Guangdong. For details, see Figure 7 .

[0083] In some embodiments, the method flow of the present application for audio-visual data collection, storage and retrieval can specifically include steps S010-S040.

[0084] S010, the data collection task management terminal issues a task list.

[0085] Specifically, first, it is determined whether the current collection task is a video or music data collection task. Second, the data source (such as a partner data source or an Internet data source) is determined. Finally, the service node (such as a node at the edge of Jiangsu and Guangdong) and the target data volume (such as the number of data items and the year) are determined. After the above steps are completed, the data collection task management end determines the data collection range of the current task, automatically divides the task list according to the number of running nodes and services, saves the task list to the database, and distributes the task list to the corresponding data collection service.

[0086] S020, the data collection service collects data from the video data source, records the collection progress, and formats the video data.

[0087] Specifically, after the data collection service receives the task list, it parses the task list and starts collecting video or music data from the data source. After successfully collecting the data, the collection progress of the task list is recorded locally. When the collection progress of the task list is greater than 80% or the collected video or music data reaches 80% of the task volume, the data is formatted and the data receiving interface of the central node's media library management service is called to transmit the formatted video or music data to the central node. When the task list is completed, the data collection service reports the task execution status to the data collection task management end through the interface.

[0088] S030, the media library management service merges and stores the collected data.

[0089] Specifically, after the media library management service receives the formatted video or music data transmitted by each node, it uses the data double-writing method to write the video data into the video data storage service of the primary and secondary available zones, ensuring real-time synchronization of cluster data. The core storage of the video data storage service is a distributed search engine, which uses a dual-cluster disaster recovery deployment architecture in the primary and secondary available zones of the central node to ensure the reliability and security of data storage. The video data stored in the search engine includes name, director, actor, plot synopsis, poster, etc. The music data includes name, album, singer, or cover, etc.

[0090] S040, the media library management service analyzes and matches the data to build a user personalized media library.

[0091] Specifically, after the collection and storage of audio-visual data, the media asset library management service is responsible for analyzing the basic metadata of the user's video and music media files, matching with the audio-visual data in the audio-visual data storage service, and building a personalized media asset library for the user. The media asset library management service retrieves all the user's media files according to the classification of video and music, and performs similarity matching on the content summary of the media files and the video and music data in the audio-visual data storage service. The file names of the video and music data in the audio-visual data storage service are matched with the file names of the media files, and the video and music data with a similarity greater than 85% are classified into the file corresponding to the file name of the media file, and the user's media files and audio-visual data are associated and automatically classified to build the user's media asset library, and finally output the functions of intelligent classification and display of audio-visual files, multi-dimensional condition search and one-key play to the user;

[0092] In some embodiments, the method flow of the present application for collecting, storing and retrieving audio-visual data can specifically include steps S110-S140.

[0093] S110, the data collection task management end issues a task list.

[0094] Specifically, first, the data collection task management end determines whether the current collection task is video data or music data. Second, the data source for collection is determined (such as a cooperative party data source, an Internet data source, etc.). Finally, the service node for running the collection task is determined (such as selecting a Jiangsu and Guangdong edge node to execute the current collection task) and the target data volume for collection is determined (such as selecting the number of data and the year, etc.). After the above steps are completed, the data collection task management end determines the data collection range of the current task, automatically divides the task list according to the number of running nodes and services, saves the task list to the database, and issues the task list to the corresponding data collection service.

[0095] S120, the data collection service collects data from the audio-visual data source, records the collection progress, and formats the audio-visual data.

[0096] Specifically, after receiving the task list, the data collection service parses it and starts collecting video or music data from the data source. After successfully collecting the data, the collection progress of the task list is recorded locally, and when the collection progress of the task list is greater than 90% or the collected video or music data reaches 90% of the task volume, the data is formatted and the data receiving interface of the media asset library management service of the center node is called to transmit the formatted video or music data to the center node. When the task list is completed, the data collection service reports the task execution to the data collection task management end through the interface.

[0097] S130, the media asset library management service merges and stores the collected data.

[0098] Specifically, after receiving the formatted video or music data transmitted by each node, the media library management service writes the video or audio data into the video or audio data storage service of the primary and standby available zones in a double-write manner, ensuring real-time synchronization of cluster data. The core storage of the video or audio data storage service is a distributed search engine, which is deployed in a dual-cluster disaster recovery architecture in the primary and standby available zones of the central node, ensuring the reliability and security of data storage. The video data stored in the search engine includes name, director, actor, plot synopsis, poster, etc. The music data includes name, album, singer, and cover, etc.

[0099] S140, the media library management service analyzes and matches the data to build a personalized media library for the user.

[0100] Specifically, after the video or audio data is collected and stored, the media library management service is responsible for analyzing the basic metadata of the user's video or music media files and matching them with the video or audio data in the video or audio data storage service to build a personalized media library for the user. The media library management service retrieves all the user's media files by category, and performs similarity matching on the file types of the media files and the video or audio data in the video or audio data storage service. The file names of the video or audio data in the video or audio data storage service are matched with the file names of the media files, and the video or audio data with a similarity greater than 90% is classified into the corresponding category of the media file name. The user's media files and video or audio data are associated and automatically classified to build the user's media library, and finally output the functions of intelligent classification and display of video or audio files, multi-dimensional conditional search, and one-key play to the user.

[0101] In some embodiments, the method flow of the present application for video or audio data collection, storage, and retrieval can specifically include steps S210-S240.

[0102] S210, the data collection task management end issues a task list.

[0103] Specifically, first, determine whether the current collection task is video data or music data in the data collection task management end. Second, determine the data source for collection (such as partner data source, Internet data source, etc.). Finally, determine the service node for running the collection task (such as selecting the Jiangsu and Guangdong edge nodes to execute the current collection task) and the target data volume for collection (such as selecting the number of data and the year, etc.). After the above steps are completed, the data collection task management end determines the data collection range of the current task, automatically divides the task list according to the number of running nodes and services, saves the task list to the database, and issues the task list to the corresponding data collection service.

[0104] S220, the data collection service collects data from the video and audio data source, records the collection progress, and formats the video and audio data.

[0105] Specifically, after the data collection service receives the task list, it parses the task list and starts collecting video or music data from the data source. After successfully collecting the data, the collection progress of the task list is recorded locally. When the collection progress of the task list is greater than 85%, or the collected video or music data reaches 85% of the task quantity, the formatted video or music data is transmitted to the central node after being formatted, and the data receiving interface of the media library management service of the central node is called. When the task list is completed, the data collection service reports the task execution to the data collection task management end through the interface.

[0106] S230, the media library management service merges and stores the collected data.

[0107] Specifically, after the media library management service receives the formatted video or music data transmitted by each node, it uses the data double-writing method to write the video and audio data into the video and audio data storage service of the primary and secondary available zones at the same time, ensuring real-time synchronization of cluster data. The core storage of the video and audio data storage service is a distributed search engine, which is deployed in a dual-cluster disaster recovery architecture in the primary and secondary available zones of the central node, ensuring the reliability and security of data storage. The video data stored in the search engine includes name, director, actor, plot synopsis, poster, etc. The music data includes name, album, singer, or cover, etc.

[0108] S240, the media library management service analyzes and matches the data to build a user personalized media library.

[0109] Specifically, after the video and audio data is collected and stored, the media library management service is responsible for analyzing the basic metadata of the user's video and music media files and matching them with the video and audio data in the video and audio data storage service to build a user-specific personalized media library. The media library management service retrieves all the user's media files by video and music classification, and performs similarity matching on the file names of the media files and the video and audio data in the video and audio data storage service. The file names of the video and audio data in the video and audio data storage service are matched with the file names of the media files, and the video and audio data with a similarity greater than 80% is classified into the file corresponding to the file name of the media file. The user's media files and video and audio data are associated and automatically classified to build the user's media library, and finally output the functions of intelligent classification and display of video and audio files, multi-dimensional condition search, and one-key play to the user.

[0110] In some embodiments, the method flow of the present application for video and audio data collection, storage, and retrieval can include steps S310-S340. In some embodiments, the method flow of the present application for video and audio data collection, storage, and retrieval can include steps S310-S340.

[0111] S310, the data collection task management end issues a task list.

[0112] Specifically, first, the data collection task management end determines whether the current collection task is a video or music data. Second, the data source (such as a cooperative party data source, an Internet data source, etc.) is determined. Finally, the service node (such as selecting a Jiangsu and Guangdong edge node to execute the current collection task) and the target data volume (such as the number of data and the year, etc.) are determined. After the above steps are completed, the data collection task management end determines the data collection range of the current task, automatically divides the task list according to the number of running nodes and services, saves the task list to the database, and issues the task list to the corresponding data collection service.

[0113] S320, the data collection service collects data from the video data source, records the collection progress, and formats the video data.

[0114] Specifically, after the data collection service receives the task list, it parses the task list and starts collecting video or music data from the data source. After successfully collecting the data, the collection progress of the task list is recorded locally. When the collection progress of the task list is greater than 75%, or the collected video data or music data reaches 75% of the task volume, the data is formatted, and the data receiving interface of the central node's media library management service is called to transmit the formatted video or music data to the central node. When the task list is completed, the data collection service reports the task execution to the data collection task management end through the interface.

[0115] S330, the media library management service merges and stores the collected data.

[0116] Specifically, after the media library management service receives the formatted video or music data transmitted by each node, it uses the data double-writing method to write the video data into the video data storage service of the primary and secondary available zones, ensuring real-time synchronization of cluster data. The core storage of the video data storage service is a distributed search engine, which uses a dual-cluster disaster recovery deployment architecture in the primary and secondary available zones of the central node to ensure the reliability and security of data storage. The video data stored in the search engine includes name, director, actor, plot introduction, poster, etc. The music data includes name, album, singer, or cover, etc.

[0117] S340, the media library management service analyzes and matches the data to build a user personalized media library.

[0118] Specifically, after the collection and storage of audio-visual data, the media asset library management service is responsible for analyzing the basic metadata of the user's video and music media files, matching with the audio-visual data in the audio-visual data storage service, and constructing the user's personalized media asset library. The media asset library management service retrieves all the user's media files according to the classification of video and music, and performs similarity matching on the file names of the media files and the video and music data in the audio-visual data storage service. The file names of the video and music data in the audio-visual data storage service are matched with the file names of the media files, and the video and music data with a similarity greater than 70% are classified into the file corresponding to the file name of the media file, and the user's media files and audio-visual data are associated and automatically classified to construct the user's media asset library, and finally output the functions of intelligent classification and display of audio-visual files, multi-dimensional condition search, one-key play and the like to the user.

[0119] In summary, the audio-visual media library construction method of the present application has the following advantages:

[0120] The present application proposes an audio-visual media library construction method of a multi-node audio-visual data collection service. The method adopts a stateless design and solves the problem of repeated collection tasks through the task list issuing mode. The method supports edge node deployment and simultaneous operation. The method fully utilizes the computing, bandwidth and other resources of the edge node, supports multi-node simultaneous operation, and has high data collection efficiency.

[0121] The present application proposes a media asset library management service method integrating audio-visual data and media files. By constructing a user's personalized media asset library, the present application has the ability to output intelligent classification, display and multi-dimensional fast search of audio-visual files.

[0122] The present application proposes a multi-cluster disaster recovery mass audio-visual data storage method. The method has a retrieval service, supports mass data storage, multi-dimensional full-text search, horizontal expansion and other characteristics, and the method can adopt a multi-cluster disaster recovery deployment architecture according to the disaster recovery needs, improving the reliability and security of data storage.

[0123] In addition, with reference to Figure 9 , and Figure 1corresponding to the method, the embodiments of the present application also provide an audio-visual media library construction system, which can include a first processing unit 1001 and a second processing unit 1002. The first processing unit 1001 can be used to distribute a task list to a plurality of edge nodes, so that the plurality of edge nodes analyze the task list, determine a target node, a task data type, and a task data quantity, and the target node collects and uploads the task data according to the task data type and the task data quantity. The target node is any one of the plurality of edge nodes. The second processing unit 1002 can be used to receive the task data uploaded by the target node and determine an audio-visual media library according to the task data.

[0124] It should be noted that the first processing unit can be any integrated circuit unit or microprocessor unit obtained by integrating a processing function chip and its peripheral circuit through existing integrated technology. The first processing unit and the second processing unit can also be any integrated circuit module or microprocessor module obtained by integrating a processing function chip and its peripheral circuit through existing integrated technology. The first processing unit and the second processing unit can also include one or more memories. The one or more memories can be used to store specific algorithms for data processing in the present application.

[0125] In some embodiments of the present application, the first processing unit 1001 and the second processing unit 1002 can be arranged in the same gateway or device with a processor. The first processing unit 1001 can distribute a task list to a plurality of edge nodes through a chip in the processor itself, so that the plurality of edge nodes analyze the task list, determine a target node, a task data type, and a task data quantity, and the target node collects and uploads the task data according to the task data type and the task data quantity. The target node is any one of the plurality of edge nodes. The second processing unit 1002 can determine an audio-visual media library according to the obtained task data. The first processing unit 1001 can be any unit connected with the processor in the gateway or the device. The first processing unit 1001 can transmit the obtained data to the processor through wired or wireless connection with the processor of the second processing unit 1002. The processor of the first processing unit 1002 can process the data through the internal chip, and finally obtain the audio-visual media library. The specific device connection mode and device arrangement of the first processing unit 1001 and the second processing unit 1002 are not limited.

[0126] It should be noted that the contents of the above-mentioned video and audio media library construction method embodiments are applicable to the present video and audio media library construction system embodiments, the functions specifically implemented by the present video and audio media library construction system embodiments are the same as those of the above-mentioned video and audio media library construction method embodiments, and the beneficial effects achieved by the present video and audio media library construction system embodiments are also the same as those achieved by the above-mentioned video and audio media library construction method embodiments.

[0127] Corresponding to the method of Figure 1 , the embodiments of the present application also provide a video and audio media library construction device, the specific structure of which can refer to Figure 10 , comprising:

[0128] at least one processor 1011;

[0129] at least one memory 1012 for storing at least one program;

[0130] When the at least one program is executed by the at least one processor, the at least one processor implements the video and audio media library construction method.

[0131] The contents of the above-mentioned method embodiments are applicable to the present device embodiments, the functions specifically implemented by the present device embodiments are the same as those of the above-mentioned method embodiments, and the beneficial effects achieved by the present device embodiments are also the same as those achieved by the above-mentioned method embodiments.

[0132] Corresponding to the method of Figure 1 , the embodiments of the present application also provide a computer readable storage medium, wherein the processor executable instructions are stored, the processor executable instructions are used to execute the video and audio media library construction method when executed by the processor.

[0133] The contents of the above-mentioned video and audio media library construction method embodiments are applicable to the present storage medium embodiments, the functions specifically implemented by the present storage medium embodiments are the same as those of the above-mentioned video and audio media library construction method embodiments, and the beneficial effects achieved by the present storage medium embodiments are also the same as those achieved by the above-mentioned video and audio media library construction method embodiments.

[0134] In some alternative embodiments, the functions / operations mentioned in the block diagram can not occur in the order mentioned in the operation diagram. For example, depending on the functions / operations involved, two blocks shown in succession can actually be executed substantially simultaneously or the blocks can sometimes be executed in reverse order. In addition, the embodiments presented and described in the flowcharts of the present application are provided by way of example, with the purpose of providing a more comprehensive understanding of the technology. The disclosed method is not limited to the operations and logical flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed and in which sub-operations described as part of larger operations are independently executed.

[0135] Furthermore, although the present application is described in the context of functional modules, it is to be understood that one or more of the functions and / or features can be integrated in a single physical device and / or software module, or one or more functions and / or features can be implemented in separate physical devices or software modules. It is also to be understood that detailed discussion of the actual implementation of each module is unnecessary to an understanding of the present application. Rather, the actual implementation is to be understood within the context of the properties, functions and internal relationships of the various functional modules disclosed herein. Accordingly, the skilled artisan will appreciate the implementation of the present application as set forth in the claims following the detailed description hereinabove, without undue experimentation, using ordinary skill in the art along with the benefit of the present disclosure. It is also to be understood that the particular concepts disclosed are illustrative in nature only and are not intended to limit the scope of the present application as it is defined by the appended claims and equivalents thereof.

[0136] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, and the computer software product is stored in a storage medium, and includes a plurality of programs used to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0137] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a list of ordered steps for implementing logical functions, and can be specifically embodied in any computer readable medium for program execution system, device or equipment (such as a computer-based system, a system including a processor, or other system that can take programs from program execution system, device or equipment and execute them) or in conjunction with these program execution systems, devices or equipment. For the purpose of the present specification, "computer readable medium" can be any device that can contain, store, communicate, propagate or transport programs for program execution system, device or equipment or in conjunction with these program execution systems, devices or equipment.

[0138] More specific examples (a non-exhaustive list) of the computer-readable medium include the following: an electrical connection (electronic) having one or more wires, a portable computer diskette (magnetic), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can also be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, for example, via optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.

[0139] It should be understood that aspects of the application can be implemented in hardware, software, firmware or combinations thereof. In the above described embodiments, multiple steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable program executing system. For example, if implemented in hardware, and as in another embodiment, any of the following technologies, known in the art, or combinations thereof, can be used: discrete logic circuitry having logic gates for implementing logic functions upon an application of data signals, application specific integrated circuits having appropriate combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), and the like.

[0140] In the above description of the present specification, the description referring to the terms "one embodiment", "another embodiment", or "certain embodiments" or the like means that a specific feature, structure, material or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. The illustrative expressions of the above terms do not necessarily refer to the same embodiment or example in the present specification. Also, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0141] Although the embodiments of the present application have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, alternatives and variations to these embodiments can be made without departing from the principles and spirit of the application, the scope of which is defined by the claims and their equivalents.

[0142] The above is a specific description of the preferred embodiments of the present application, but the present application is not limited to the described embodiments, and those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of the present application, and these equivalent modifications or substitutions are included in the scope defined by the claims of the present application.

Claims

1. A method for constructing an audio-visual media database, characterized in that, Includes the following steps: A task list is sent to several edge nodes so that the edge nodes can parse the task list, determine the target node, the task data type, and the task data quantity, and the target node can collect and upload the task data according to the task data type and the task data quantity. The target node is any one of the edge nodes; Receive the task data uploaded by the target node and determine the audio-visual media database based on the task data; The step of determining the audio-visual media database based on the task data includes: Extract the task file name, task file type, and task content summary from the task data; Based on the task file name, the task file type, and the task content summary, the task data is classified to obtain an audio-visual media database. Before sending the task list to several edge nodes, the data collection range of the current task is determined by the data collection task management terminal. Within the data collection range, the task list is automatically segmented according to the number of edge nodes running data collection services and the number of data collection services deployed on each edge node, and the segmented task list is saved to the database so that the segmented task list can be sent to the corresponding data collection service. After the data acquisition service successfully acquires the task data, the data acquisition service records the acquisition progress of the task list locally. When the acquisition progress of the task list is greater than a preset acquisition progress threshold, the data acquisition service formats the task data and transmits the formatted task data to the central node. After completing the task list, the data acquisition service reports the task execution status to the data acquisition task management terminal.

2. The method for constructing an audio-visual media database according to claim 1, characterized in that, The target node collects and uploads task data based on the task data type and the quantity of task data, including: The target node collects corresponding task data and records the number of task data according to the task data type; When the amount of task data exceeds a first preset threshold, the target node uploads the task data.

3. The method for constructing an audio-visual media database according to claim 2, characterized in that, The target node collects corresponding task data and records the quantity of task data according to the task data type, including: The target node collects corresponding video task data and records the number of video data according to the video type; or The target node collects corresponding audio task data and records the number of audio data based on the audio type.

4. The method for constructing an audio-visual media database according to claim 2, characterized in that, The target node collects and uploads task data according to the task data type and the task data quantity, and also includes: When the number of task data is less than or equal to the first preset threshold, the target node returns the step of collecting the corresponding task data and recording the number of task data according to the task data type.

5. The method for constructing an audio-visual media database according to claim 1, characterized in that, The step of classifying the task data according to the task file name, the task file type, and the task content summary to obtain an audio-visual media database includes: When the similarity between the task file name and the preset file name is greater than the second preset threshold, the task data is determined to be the task data in the audio-visual media database corresponding to the preset file name. When the similarity between the task file name and the preset file type is greater than a third preset threshold, the task data is determined to be the task data in the audio-visual media database that corresponds to the preset file type. When the similarity between the task file name and the preset content summary is greater than a fourth preset threshold, the task data is determined to be the task data in the audio-visual media database that corresponds to the preset content summary.

6. The method for constructing an audio-visual media database according to claim 5, characterized in that, The second preset threshold is equal to the third preset threshold, and the third preset threshold is equal to the fourth preset threshold.

7. A system for constructing an audio-visual media database, characterized in that, include: The first processing unit is configured to send a task list to a number of edge nodes, so that the edge nodes can parse the task list, determine the target node, the task data type and the task data quantity, and enable the target node to collect and upload task data according to the task data type and the task data quantity. The target node is any one of the edge nodes; The second processing unit is used to receive the task data uploaded by the target node and determine the audio-visual media database based on the task data. The step of determining the audio-visual media database based on the task data includes: Extract the task file name, task file type, and task content summary from the task data; Based on the task file name, the task file type, and the task content summary, the task data is classified to obtain an audio-visual media database. Before sending the task list to several edge nodes, the data collection range of the current task is determined by the data collection task management terminal. Within the data collection range, the task list is automatically segmented according to the number of edge nodes running data collection services and the number of data collection services deployed on each edge node, and the segmented task list is saved to the database so that the segmented task list can be sent to the corresponding data collection service. After the data acquisition service successfully acquires the task data, the data acquisition service records the acquisition progress of the task list locally. When the acquisition progress of the task list is greater than a preset acquisition progress threshold, the data acquisition service formats the task data and transmits the formatted task data to the central node. After completing the task list, the data acquisition service reports the task execution status to the data acquisition task management terminal.

8. An audio-visual media database construction device, characterized in that... include: At least one processor; At least one memory for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the audio-visual media database construction method as described in any one of claims 1-6.

9. A computer-readable storage medium storing processor-executable instructions, characterized in that, The processor-executable instructions, when executed by the processor, are used to perform the audio-visual media database construction method as described in any one of claims 1-6.

Images