Media resource management system, media resource generation method, device, and medium
A media resource management system that adds tags to media materials and categorizes them into sets solves the problem of time-consuming manual searches and enables efficient media resource production.
Patent Information
- Application Number
- CN202110348526.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-03-31
- Publication Date
- 2025-12-30
- Estimated Expiration
- 2041-05-12
AI Technical Summary
The large number of media materials in existing technologies leads to time-consuming manual searches and low efficiency in media resource production.
It provides a media resource management system, which adds material tags to media materials through a tag generation module, divides materials into collections using a material segmentation module, and generates media resources using a media resource editing module.
There's no need to manually search for media materials; media resources can be created directly from a collection of materials, improving production efficiency.
Smart Images

Figure CN115146088B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of computer, in particular to a media resource management system, a media resource management method, a media resource generation method, a computer device and a computer readable storage medium. BACKGROUND
[0002] With the development of computer technology, video producers can use electronic devices to shoot media materials anytime and anywhere. With the increase of shooting time, the number of media materials will also increase sharply.
[0003] In the related art, media resource producers need to find the required media materials in a large number of media materials during the production of videos, and use the found media materials to produce videos, which are a kind of media resources.
[0004] However, due to the large number of media materials, manual searching of media materials requires a lot of time, resulting in low efficiency of media resource production. SUMMARY
[0005] The embodiments of the present application provide a media resource management system, a media resource management method, a media resource generation method, a computer device and a computer readable storage medium, which can improve the efficiency of media resource production. The technical solution is as follows:
[0006] On the one hand, a media resource management system is provided, which includes a label generation module, a material division module and a media resource editing module.
[0007] The label generation module is configured to perform content recognition on a plurality of media materials to obtain a plurality of material labels, each material label corresponding to a media material, and the material label being used to indicate the material content of the corresponding media material.
[0008] The material division module is configured to divide the plurality of media materials into a plurality of media material sets according to the material types of the plurality of media materials and the plurality of material labels, each media material set including at least two media materials of different types, and the material labels of the at least two media materials of different types satisfying a target condition.
[0009] The media resource editing module is configured to determine a plurality of target media material sets from the plurality of media material sets in response to a selection instruction for the plurality of media material sets, and generate a media resource based on the plurality of target media material sets.
[0010] In some embodiments, the system further includes:
[0011] A media resource query module is configured to perform any of the following:
[0012] In response to the media query request, the media query tag carried in the media query request is matched with the plurality of media tags; in response to the similarity between the media query tag and any media tag in the plurality of media tags meeting a first similarity condition, the media corresponding to the any media tag is determined as the media corresponding to the media query request.
[0013] In response to the segment query request, the segment query tag carried in the segment query request is matched with the plurality of segment tags; in response to the similarity between the segment query tag and any segment tag in the plurality of segment tags meeting a second similarity condition, the resource segment corresponding to the any segment tag is determined as the resource segment corresponding to the segment query request.
[0014] In response to the resource query request, the resource query tag carried in the resource query request is matched with the resource tag; in response to the similarity between the resource query tag and the resource tag meeting a third similarity condition, the media resource is determined as the media resource corresponding to the resource query request.
[0015] In some embodiments, the system further comprises a media acquisition module, configured to perform any of the following:
[0016] In response to a media upload request, the plurality of media is acquired corresponding to the media upload request.
[0017] In response to a resource scanning instruction on a target storage location, the plurality of media is acquired stored in the target storage location by performing resource scanning on the target storage location.
[0018] The plurality of media carried by a live stream is acquired.
[0019] In some embodiments, the media acquisition module is further configured to perform security verification on the plurality of media; in response to all the plurality of media passing the security verification, the step of performing content identification on the plurality of media by the tag generation module is executed; in response to any media in the plurality of media failing the security verification, the any media is deleted.
[0020] In some embodiments, the media acquisition module is further configured to pre-process the plurality of media to obtain the plurality of media after pre-processing.
[0021] In some embodiments, the system further comprises:
[0022] The permission identification module is configured to determine an account permission of an account logged in the system, and determine a plurality of candidate media material sets from the plurality of media material sets, the candidate media material sets being media material sets matched with the account permission.
[0023] The media resource editing module is further configured to, in response to a selection instruction for the plurality of candidate media material sets, determine a plurality of target media material sets selected from the plurality of candidate media material sets, and generate the media resource based on the plurality of target media material sets.
[0024] In some embodiments, the permission identification module is configured to determine an account group to which an account logged in the system belongs, and determine an account permission corresponding to the account group as the account permission of the account.
[0025] In some embodiments, the system further comprises:
[0026] The media resource auditing module is configured to perform content identification on the media resource to obtain resource content information of the media resource.
[0027] In response to the resource content information indicating that the media resource does not contain target content, the media resource is determined as a first type of media resource, the target content being content that is not allowed to be published, and the first type of media resource being a media resource allowed to be published.
[0028] In response to the resource content information indicating that the media resource contains the target content, the media resource is determined as a second type of media resource, the second type of media resource being a media resource not allowed to be published.
[0029] In some embodiments, the media resource auditing module is configured to perform content identification on a plurality of resource frames of the media resource respectively to obtain a plurality of resource frame content information respectively corresponding to the plurality of resource frames.
[0030] In response to a similarity between each of the resource frame content information and target content information satisfying a content similarity condition, the resource content information of the media resource is determined as the media resource not containing the target content, the target content information being content information of the target content.
[0031] In some embodiments, the media resource auditing module is configured to perform template matching on the plurality of resource frames of the media resource respectively using a target content template, in response to the plurality of resource frames all not matching the target content template, the media resource is determined as the first type of media resource, and in response to any one of the plurality of resource frames matching the target content template, the media resource is determined as the second type of media resource.
[0032] In some embodiments, the media resource auditing module is further configured to acquire a plurality of artificial auditing information of the media resource respectively published by a plurality of accounts, the accounts being accounts logged in the system; and determine the media resource as the first type of media resource in response to the plurality of artificial auditing information all indicating that the media resource does not contain the target content.
[0033] In some embodiments, the media resource auditing module is further configured to determine the media resource as the second type of media resource in response to any one of the plurality of artificial auditing information indicating that the media resource contains the target content.
[0034] In some embodiments, the media resource auditing module is further configured to send the media resource to a target account in response to any one of the plurality of artificial auditing information indicating that the media resource contains the target content, the target account being an account whose auditing authority meets a target authority condition; determine the media resource as the second type of media resource in response to artificial auditing information published by the target account indicating that the media resource contains the target content; and determine the media resource as the first type of media resource in response to artificial auditing information published by the target account indicating that the media resource does not contain the target content.
[0035] In some embodiments, the media resource auditing module is further configured to determine the media resource as the second type of media resource in response to the resource content information indicating that the media resource does not contain the target content and the plurality of artificial auditing information all indicating that the media resource contains the target content.
[0036] In some embodiments, the media resource editing module is further configured to add a watermark on the media resource.
[0037] In some embodiments, the system further comprises:
[0038] A media resource sending module configured to send the media resource to a target terminal in response to a sending instruction of the media resource, the target terminal being a terminal indicated by the sending instruction.
[0039] In some embodiments, the system further comprises:
[0040] A log recording module configured to record at least one of a running log, an operation log, an account login log, and an alarm log of the system.
[0041] In some embodiments, the material type comprises at least two of the following: a media material, an audio material, and a text material.
[0042] In one aspect, a media resource management method is provided, the method comprising:
[0043] performing content recognition on a plurality of media materials to obtain a plurality of material tags, each of the material tags corresponding to a media material, the material tag being used to indicate material content of the corresponding media material;
[0044] dividing the plurality of media materials into a plurality of media material sets according to material types of the plurality of media materials and the plurality of material tags, each of the media material sets including at least two media materials of different types, material tags of the at least two media materials of different types satisfying a target condition;
[0045] in response to a selection instruction on the plurality of media material sets, determining a plurality of target media material sets selected from the plurality of media material sets, and generating a media resource based on the plurality of target media material sets.
[0046] In some embodiments, the generating the media resource based on the plurality of target media material sets comprises:
[0047] sending the plurality of target media material sets to a media resource editing client, importing the plurality of target media material sets into an engineering file of the media resource by the media resource editing client, and generating the media resource based on the engineering file.
[0048] In some embodiments, the generating the media resource based on the engineering file comprises:
[0049] performing editing on the plurality of media material sets in the engineering file using an editing tool to obtain a plurality of edited media material sets, and splicing the plurality of edited media material sets to obtain the media resource.
[0050] In some embodiments, the generating the media resource based on the plurality of target media material sets comprises:
[0051] transcoding the plurality of media material sets in the engineering file to obtain a plurality of proxy media material sets corresponding to the plurality of media material sets in the engineering file respectively, each of the proxy media material sets having a lower occupied space than the corresponding media material set in the engineering file, sending the plurality of proxy media material sets to the media resource editing client, importing the plurality of proxy media material sets into the engineering file by the media resource editing client, and generating the media resource based on the plurality of proxy media material sets and the plurality of media material sets in the engineering file.
[0052] In some embodiments, the generating the media resource based on the multiple proxy media material sets and the media material set in the multiple engineering files comprises:
[0053] clipping the multiple proxy media material sets to obtain multiple clipped proxy media material sets, splicing the multiple clipped proxy media material sets to obtain a proxy media resource, in response to a determination instruction for the proxy media resource, clipping the media material set in the multiple engineering files in the clipping manner of the multiple proxy media material sets to obtain multiple clipped media material sets, and splicing the multiple clipped media material sets to obtain the media resource.
[0054] In some embodiments, the method further comprises:
[0055] In response to the account logged into the system having engineering editing authority for the engineering file, the step of sending the multiple target media material sets to the media resource editing client is performed.
[0056] In some embodiments, the content recognition of the multiple media materials to obtain multiple material tags comprises:
[0057] extracting features of the multiple media materials respectively to obtain material features of each of the media materials;
[0058] based on the material features of the multiple media materials and multiple reference material features stored in a media material library, obtaining the multiple material tags, each of the reference material features corresponding to a media material in the media material library.
[0059] In some embodiments, the obtaining the multiple material tags based on the material features of the multiple media materials and multiple reference material features stored in a media material library comprises:
[0060] for any media material in the multiple media materials, obtaining a similarity between the material feature of the any media material and the multiple reference material features, in response to the similarity between any reference material feature and the material feature of the any media material meeting a feature similarity condition, determining a material tag of a media material corresponding to the any reference material feature as a material tag of the any media material.
[0061] In some embodiments, the method further comprises:
[0062] obtaining a supplement tag of any of the plurality of media materials, the supplement tag being a material tag of a material published by an account registered in the system; and determining the supplement tag and the material tag of the any of the plurality of media materials as a material tag set of the any of the plurality of media materials.
[0063] In some embodiments, the method further comprises:
[0064] updating the material tag of the any of the plurality of media materials with a material tag corresponding to the material tag update request in response to a material tag update request of the any of the plurality of media materials.
[0065] In some embodiments, the method further comprises any of:
[0066] performing content identification on the plurality of resource segments of the media resource to obtain a plurality of segment tags corresponding to the plurality of resource segments respectively;
[0067] performing content identification on the media resource to obtain a resource tag of the media resource.
[0068] In some embodiments, the method further comprises any of:
[0069] matching a material query tag carried in the material query request with the plurality of material tags in response to a material query request of the plurality of media materials; and determining a media material corresponding to the any of the plurality of material tags as a media material corresponding to the material query request in response to a similarity between the material query tag and the any of the plurality of material tags meeting a first similarity condition.
[0070] matching a segment query tag carried in the segment query request with the plurality of segment tags in response to a segment query request of the media resource; and determining a resource segment corresponding to the any of the plurality of segment tags as a resource segment corresponding to the segment query request in response to a similarity between the segment query tag and the any of the plurality of segment tags meeting a second similarity condition.
[0071] matching a resource query tag carried in the resource query request with the resource tag in response to a resource query request of the media resource; and determining the media resource as a media resource corresponding to the resource query request in response to a similarity between the resource query tag and the resource tag meeting a third similarity condition.
[0072] In some embodiments, the method further comprises any of:
[0073] obtaining the plurality of media materials corresponding to the material upload request in response to a material upload request.
[0074] performing resource scanning at the target storage location in response to a resource scanning instruction for the target storage location, and obtaining the plurality of media materials stored in the target storage location;
[0075] obtaining the plurality of media materials carried by the live streaming.
[0076] In some embodiments, before the content identification of the plurality of media materials to obtain a plurality of material tags, the method further comprises:
[0077] performing security verification on the plurality of media materials, in response to all of the plurality of media materials passing the security verification, performing the step of content identification of the plurality of media materials; and in response to any of the plurality of media materials failing the security verification, deleting the any of the plurality of media materials.
[0078] In some embodiments, the method further comprises:
[0079] preprocessing the plurality of media materials to obtain the plurality of media materials after preprocessing.
[0080] In some embodiments, the method further comprises:
[0081] determining an account permission of an account logged into the system; and determining a plurality of candidate media material sets from the plurality of media material sets, the candidate media material sets being material sets matching the account permission.
[0082] in response to a selection instruction for the plurality of candidate media material sets, determining a plurality of target media material sets selected from the plurality of candidate media material sets, and generating the media resource based on the plurality of target media material sets.
[0083] In some embodiments, the determining of the account permission of the account logged into the system comprises:
[0084] determining an account group to which the account logged into the system belongs; and determining an account permission corresponding to the account group as the account permission of the account.
[0085] In some embodiments, after the generating of the media resource based on the plurality of target media material sets, the method further comprises:
[0086] performing content identification on the media resource to obtain resource content information of the media resource.
[0087] determining the media resource as a first type of media resource in response to the resource content information indicating that the media resource does not contain target content, the target content being content that is not allowed to be published, and the first type of media resource being a media resource that is allowed to be published;
[0088] determining the media resource as a second type of media resource in response to the resource content information indicating that the media resource contains the target content, the second type of media resource being a media resource that is not allowed to be published.
[0089] In some embodiments, the content identification of the media resource to obtain the resource content information of the media resource includes:
[0090] respectively identifying content of a plurality of resource frames of the media resource to obtain a plurality of resource frame content information respectively corresponding to the plurality of resource frames;
[0091] determining the resource content information of the media resource as the media resource not containing the target content in response to a similarity between each of the resource frame content information and target content information meeting a content similarity condition, the target content information being content information of the target content.
[0092] In some embodiments, the method further includes:
[0093] respectively performing template matching on the plurality of resource frames of the media resource using a target content template, determining the media resource as the first type of media resource in response to the plurality of resource frames all not matching the target content template, and determining the media resource as the second type of media resource in response to any one of the plurality of resource frames matching the target content template.
[0094] In some embodiments, the method further includes:
[0095] obtaining a plurality of artificial review information of the media resource respectively published by a plurality of accounts, the accounts being accounts logged in the system, and determining the media resource as the first type of media resource in response to the plurality of artificial review information all indicating that the media resource does not contain the target content.
[0096] In some embodiments, the method further includes:
[0097] determining the media resource as the second type of media resource in response to any one of the plurality of artificial review information indicating that the media resource contains the target content.
[0098] In some embodiments, the method further includes:
[0099] In response to any one of the plurality of artificial review information indicating that the media resource contains the target content, sending the media resource to a target account, the target account being an account whose review authority meets a target authority condition; in response to artificial review information published by the target account indicating that the media resource contains the target content, determining the media resource as the second type of media resource; in response to artificial review information published by the target account indicating that the media resource does not contain the target content, determining the media resource as the first type of media resource.
[0100] In some embodiments, the method further comprises:
[0101] In response to the resource content information indicating that the media resource does not contain the target content, and the plurality of artificial review information all indicating that the media resource contains the target content, determining the media resource as the second type of media resource.
[0102] In some embodiments, the method further comprises:
[0103] Adding a watermark on the media resource.
[0104] In some embodiments, the method further comprises:
[0105] In response to a sending instruction for the media resource, sending the media resource to a target terminal, the target terminal being a terminal indicated by the sending instruction.
[0106] In some embodiments, the method further comprises:
[0107] Recording at least one of a running log, an operation log, an account login log, and an alarm log of the system.
[0108] In some embodiments, the material type includes at least two of the following: media material, audio material, and text material.
[0109] In one aspect, a media resource generation method is provided, the method comprising:
[0110] In response to obtaining any media material, obtaining a material tag of the media material;
[0111] According to the material tag, determining a media material set to which the media material belongs, the media material set including at least one media material corresponding to the material tag;
[0112] Based on the media material set and the media material, generating a media resource.
[0113] In an aspect, a computer device is provided, which comprises one or more processors and one or more memories, and at least one computer program is stored in the one or more memories, and the computer program is loaded and executed by the one or more processors to implement the media resource management method or implement the media resource generation method.
[0114] In an aspect, a computer readable storage medium is provided, which stores at least one computer program, and the computer program is loaded and executed by a processor to implement the media resource management method or implement the media resource generation method.
[0115] In an aspect, a computer program product or computer program is provided, which comprises program code stored in a computer readable storage medium, and the program code is read by a processor of a computer device from the computer readable storage medium, and the processor executes the program code to make the computer device execute the above-mentioned media resource management method or implement the media resource generation method.
[0116] Through the technical solutions provided by the embodiments of the present application, media material tags can be automatically added to media materials, different types of media materials are combined according to the media material tags to generate a media material set, and when a media resource maker makes a media resource through the media material set, manual media material searching and matching between different types of media materials are no longer needed, and media resource making can be directly completed through the media material set, thereby improving the efficiency of media resource making. BRIEF DESCRIPTION OF DRAWINGS
[0117] To more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative effort on the basis of these drawings.
[0118] Figure 1 is a schematic diagram of an implementation environment of a media resource management method provided by an embodiment of the present application;
[0119] Figure 2 is a structural schematic diagram of a media resource management system provided by an embodiment of the present application;
[0120] Figure 3 is a structural schematic diagram of a media resource management system provided by an embodiment of the present application;
[0121] Figure 4 is a functional architecture schematic diagram of a media resource management system provided by an embodiment of the present application;
[0122] Figure 5 is a flowchart of a media resource management method provided by an embodiment of the present application;
[0123] Figure 6 is a flowchart of a media resource management method provided by an embodiment of the present application;
[0124] Figure 7 is a flowchart of a media resource management method provided by an embodiment of the present application;
[0125] Figure 8 is a flowchart of a media resource management method provided by an embodiment of the present application;
[0126] Figure 9 is a flowchart of a media resource generation method provided by an embodiment of the present application;
[0127] Figure 10 is a structural schematic diagram of a terminal provided by an embodiment of the present application;
[0128] Figure 11 is a structural schematic diagram of a server provided by an embodiment of the present application. DETAILED DESCRIPTION
[0129] In order to make the purpose, technical scheme and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the drawings.
[0130] In the present application, the terms "first", "second", and the like are used to distinguish the same or similar items with basically the same function and purpose, and it should be understood that there is no logical or time sequence dependency between "first", "second", and "nth", and the number and execution order are not limited.
[0131] In the present application, the term "at least one" means one or more, and the term "multiple" means two or more, for example, multiple reference face images means two or more reference face images.
[0132] Artificial intelligence (AI) is the use of digital computers or digital computer-controlled machines to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology of computer science, which tries to understand the essence of intelligence and produce a new intelligent machine that can react in a similar way to human intelligence. Artificial intelligence is to design principles and implementation methods of various intelligent machines, so that machines have the functions of perception, reasoning and decision-making.
[0133] Artificial intelligence technology is a comprehensive discipline, involving a wide range of fields, both hardware and software level technology. Artificial intelligence basic technology generally includes, such as sensors, special artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction system, mechatronics and other technologies. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology and machine learning / deep learning and other major directions.
[0134] Machine learning (ML) is a multi-disciplinary subject, involving probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory and other disciplines. It is a specialized study of how computers simulate or implement human learning behavior to acquire new knowledge or skills, and reorganize existing knowledge sub-models to continuously improve their performance. Machine learning is the core of artificial intelligence and the fundamental approach to making computers intelligent, and its applications are widespread in various fields of artificial intelligence. Machine learning and deep learning usually include artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and teaching learning.
[0135] The computer device provided by the embodiments of the present application can be implemented as a terminal or a server. The implementation environment composed of a terminal and a server is introduced below.
[0136] Figure 1 is an implementation environment schematic diagram of a media resource management method provided by the embodiments of the present application, see Figure 1 The implementation environment can include a terminal 110 and a server 140. The media resource management system provided by the embodiments of the present application is deployed on the server 140. The terminal 110 is connected to the server 140 through a wireless network or a wired network, so as to access the media resource management system.
[0137] In some embodiments, the terminal 110 is a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, a smart television, etc., but is not limited thereto. The terminal 110 is installed and runs an application program supporting media resource editing, media resource management and media resource auditing.
[0138] In some embodiments, the server 140 is a stand-alone physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud service, cloud database, cloud computing, cloud function, cloud storage, network service, cloud communication, middleware service, domain name service, security service, content delivery network (CDN), and big data and artificial intelligence platform. In some embodiments, the media resource management system provided by the embodiments of the present application is deployed on the server 140, and a user can access the media resource management system on the server 140 through a network connection between the terminal 110 and the server 140.
[0139] In some embodiments, the terminal 110 refers to one of a plurality of terminals, and the embodiments of the present application are only exemplified by the terminal 110.
[0140] Those skilled in the art can know that the number of terminals or servers described above can be more or less. For example, the terminal described above is only one, or the terminal described above is several tens or several hundreds, or more, at this time, the above implementation environment also includes other terminals. The number of terminals and the type of equipment are not limited in the embodiments of the present application.
[0141] In some embodiments, the technical solutions provided by the embodiments of the present application can be applied to a blockchain system, that is, the terminal 110 and the server 140 are nodes of the blockchain system, and some basic concepts of the blockchain system are as follows.
[0142] The blockchain is a new application mode of distributed data storage, peer-to-peer transmission, consensus mechanism, encryption algorithm and other computer technologies. The blockchain is essentially a decentralized database, which is a series of data blocks associated using cryptographic methods. Each data block contains information about a batch of network transactions, which is used to verify the validity (anti-fake) of the information and generate the next block. The blockchain can include a blockchain underlying platform, a platform product service layer, and an application service layer.
[0143] The blockchain underlying platform can include user management, basic services, smart contracts, and operation monitoring processing modules. Among them, the user management module is responsible for the identity information management of all blockchain participants, including maintaining public and private key generation (account management), key management, and user real identity and blockchain address correspondence maintenance (permission management), etc., and under authorization, supervises and audits the transaction situation of certain real identities, provides risk control rule configuration (risk audit); the basic service module is deployed on all blockchain node devices to verify the validity of business requests, and after consensus, the valid request is recorded on the storage. For a new business request, the basic service first performs interface adaptation analysis and authentication processing (interface adaptation), then encrypts the business information through a consensus algorithm (consensus management), and after encryption, the complete and consistent transmission is transmitted to the shared ledger (network communication), and recorded and stored; the smart contract module is responsible for contract registration and issuance, contract triggering and contract execution. Developers can define contract logic through a certain programming language, publish it to the blockchain (contract registration), call keys or other event triggers for execution according to the logic of the contract terms, complete the contract logic, and also provide contract upgrade and cancellation functions; the operation monitoring module is mainly responsible for the deployment, configuration modification, contract setting, cloud adaptation of the product release process, and the real-time state visualization output of the product running, such as alarm, monitoring network situation, monitoring node device health status, etc.
[0144] The platform product service layer provides basic capabilities and implementation frameworks for typical applications. Developers can add business features based on these basic capabilities to complete the blockchain implementation of business logic. The application service layer provides application services based on the blockchain solution for business participants to use.
[0145] It should be noted that in the following description of the technical solutions provided by the embodiments of the present application, the media resource management system is deployed on the server as an example. In other possible implementations, the media resource management system can also be deployed on the terminal, and the embodiments of the present application do not limit this.
[0146] Figure 2 is a structural schematic diagram of a media resource management system provided by an embodiment of the present application. Taking the media resource management system deployed on the server 140 described above as an example, referring to Figure 2 , the system includes a label generation module 201, a material division module 202, and a media resource editing module 203.
[0147] The label generation module 201 is configured to perform content recognition on a plurality of media materials to obtain a plurality of material labels, each material label corresponding to a media material, and the material label being used to indicate the material content of the corresponding media material.
[0148] The media material is material used to generate a media resource. In some embodiments, the media material includes at least two of a media material, an audio material, and a text material, and the embodiments are not limited in this regard. The media resource is a video or an audio, and the embodiments are not limited in this regard.
[0149] The material division module 202 is configured to divide the plurality of media materials into a plurality of media material sets according to the material types of the plurality of media materials and the plurality of material tags, each of the plurality of media material sets including at least two media materials of different types, and the material tags of the at least two media materials of different types satisfying a target condition.
[0150] The media resource editing module 203 is further configured to determine a plurality of target media material sets from the plurality of media material sets in response to a selection instruction of the plurality of media material sets, and generate a media resource based on the plurality of target media material sets.
[0151] That is, the division of the media materials has been completed by the material division module 202 of the media resource management system, and the user can directly generate a media resource by selecting a target media material set through the media resource editing module. Taking a video as an example, the efficiency of video production is higher.
[0152] According to the technical solution provided in the embodiments, the media resource management system can automatically add a material tag to a media material, combine media materials of different types according to the material tag, and generate a media material set. When a media resource producer produces a media resource through the media material set, the producer does not need to manually search for media materials and match media materials of different types, and can directly produce a media resource through the media material set, thereby improving the efficiency of media resource production.
[0153] The above Figure 2 The above is a brief introduction to the media resource management system provided in the embodiments, and the following will provide a more detailed introduction to the media resource management system provided in the embodiments with some examples.
[0154] Figure 3 FIG. 1 is a structural schematic diagram of a media resource management system provided in an embodiment of the present application. Taking an example in which the media resource management system is deployed on a server, refer to FIG. 1. Figure 3The system comprises a material obtaining module 301, a label generating module 302, a material dividing module 303, a media resource editing module 304, a permission identifying module 305, a media resource auditing module 306, a media resource querying module 307, a media resource sending module 308, a log recording module 309, and a system management module 310. In some embodiments, the media resource is a video or an audio, and the embodiments of the present application are not limited in this regard. In the following description, the media resource is taken as a video for example.
[0155] The material obtaining module 301 is configured to perform any one of the following:
[0156] In some embodiments, in response to a material uploading request, the material obtaining module 301 obtains a plurality of media materials corresponding to the material uploading request. In some embodiments, this media material obtaining manner is also referred to as manual uploading.
[0157] In this implementation, the user can upload the required media materials to the media resource management system through the material obtaining module 301, so that the media resources produced can meet the actual needs and improve the efficiency of producing media resources.
[0158] For example, in response to a selection instruction of media materials, the terminal loads a plurality of media materials corresponding to the selection instruction. The terminal sends a material uploading request to the material obtaining module 301 through the server, and the material uploading request carries the plurality of media materials. In response to receiving the material uploading request, the material obtaining module 301 sends an acknowledgement instruction to the terminal. In response to the acknowledgement instruction, the terminal uploads the plurality of media materials to the material obtaining module 301, and the material obtaining module 301 obtains the plurality of media materials. In some embodiments, a media resource management client is running on the terminal, and the media resource management client is used to establish communication with the media resource management system. The user can select media materials to be uploaded to the media resource management system through the media resource management client. In response to a selection instruction of media materials on the media resource management client, the media resource management client loads the plurality of selected media materials. In some embodiments, the user can log in an account through the media resource client, and the media resource client sends a material uploading request to the material obtaining module 301, and the material uploading request carries the account. After the material obtaining module 301 obtains the material uploading request, the account can be obtained from the material uploading request, and the account is matched with a plurality of accounts stored in an account database. The account database is a database maintained by the server, and the media resource management system can call data in the account database. The plurality of accounts stored in the account database are accounts with material uploading permissions. In response to the account being the same as any account in the plurality of accounts, the material obtaining module 301 sends an acknowledgement instruction to the terminal through the server. In response to receiving the acknowledgement instruction, the terminal uploads the plurality of media materials to the material obtaining module 301 through the server, and the material obtaining module 301 obtains the plurality of media materials. In some embodiments, the user can log in the account through the media resource management client by scanning a two-dimensional code, an account password, an SMS verification code, or the like. The embodiments of the present application do not limit the way in which the user logs in the account.
[0159] In some embodiments, in response to a resource scanning instruction of a target storage location, the material obtaining module 301 performs resource scanning on the target storage location, and obtains a plurality of media materials stored in the target storage location. For example, the target storage location is a storage of any terminal, or an external storage of the server, and the embodiments of the present application do not limit this. In some embodiments, this way of obtaining media materials is also called automatic scanning.
[0160] In this implementation, the material obtaining module 301 can scan the target storage location, thereby automatically loading media materials from the target storage location without the need for user selection, and the efficiency of human-computer interaction is higher.
[0161] For example, in response to a resource scanning instruction for a target storage location, the material obtaining module 301 sends a resource scanning request to the terminal, and the resource scanning request carries a path of the target storage location. The material obtaining module 301 scans the target storage location of the terminal based on the path of the target storage location, and obtains a plurality of media materials stored in the target storage location. In some embodiments, a media resource management client is running on the terminal, and the media resource management client is configured to establish communication with the media resource management system. A user can issue a resource scanning instruction for a target storage location through the media resource management client, and the material obtaining module 301 sends a resource scanning request to the terminal, and the resource scanning request carries a path of the target storage location. The material obtaining module 301 queries the path of the target storage location based on the file type of the file stored in the target storage location, and obtains a plurality of media materials in the target storage location. In some embodiments, the material obtaining module 301 determines whether the file stored in the target storage location is a media material by the suffix name of the file, and the material obtaining module 301 obtains a plurality of media materials from the target storage location.
[0162] In some embodiments, the material obtaining module 301 obtains a plurality of media materials carried by a live stream. The live stream includes any one of an IP live stream and a live broadcast stream. The IP live stream is a live stream uploaded by a terminal used by a network host. The live broadcast stream is a video stream uploaded by a shooting device that shoots a live scene. The shooting device can establish network communication with the media resource management system, and upload a video stream shot in real time to the material obtaining module 301. For example, in a live show shooting scene, a camera shoots a live show scene, and the camera transmits a video stream shot in real time to the material obtaining module 301.
[0163] In this implementation, the material obtaining module 301 can obtain a plurality of media materials carried by a live stream based on a live stream updated in real time, facilitate timely management of the plurality of media materials, and thus improve the efficiency of video production.
[0164] For example, a video live streaming device establishes a network connection with the media resource management system through a network, and transmits a collected live stream to the material obtaining module 301 in real time. The material obtaining module can obtain a plurality of media materials from the live stream.
[0165] In some embodiments, in response to a media material obtaining request, the material obtaining module 301 obtains a plurality of media materials from a position indicated by the media material obtaining request. That is, the material obtaining module 301 can obtain media materials from a specified position based on a material obtaining request, and this process does not require access of the terminal, and the efficiency of obtaining media materials is high.
[0166] For example, in response to the media material acquisition request, the material acquisition module 301 acquires the address of the media material acquisition from the media material acquisition request, and calls the web crawler to acquire a plurality of media materials from the address.
[0167] It should be noted that the material acquisition module 301 can acquire media materials by any of the above methods, or simultaneously acquire media materials by multiple methods, and the embodiments of the present application do not limit this.
[0168] In some embodiments, the material acquisition module 301 is further configured to perform security verification on the plurality of media materials, and in response to all of the plurality of media materials passing the security verification, performing the step of identifying the content of the plurality of media materials by the tag generation module 302. In response to any of the plurality of media materials failing the security verification, deleting the media material.
[0169] Through this implementation, the material acquisition module 301 can perform security verification on the acquired media materials, and only the media materials that pass the security verification can be used as media materials for subsequent media resource synthesis, thereby improving the security of the media resource management system.
[0170] For example, after the material acquisition module 301 acquires a plurality of media materials, the plurality of media materials are stored in the temporary storage space of the media resource management system. The material acquisition module 301 calls the antivirus component to perform virus scanning on the plurality of media materials in the temporary storage space, and in response to the plurality of media materials not containing virus files, the plurality of media materials are transferred from the temporary storage space to the central storage space for subsequent processing. In some embodiments, the media resource management system is also associated with a public cloud, and in response to the plurality of media materials not containing virus files, the material acquisition module 301 transfers the plurality of media materials from the temporary storage space to the public cloud. In response to the plurality of media materials containing virus files, the material acquisition module 301 deletes the media materials corresponding to the virus files. The remaining media materials are transferred from the temporary storage space to the central storage space.
[0171] In some embodiments, the material obtaining module 301 is further configured to pre-process the plurality of media materials to obtain a plurality of pre-processed media materials. The pre-processing includes at least one of file format conversion and media material scaling. The file format conversion refers to converting the media materials into a preset format for storage, such as converting the format of the obtained media materials into AVI (Audio Video Interleaved). The media material scaling refers to adjusting the media materials to a preset size for storage, such as adjusting the size of the media materials to 1024x1024. The media resource management system can perform subsequent steps based on the plurality of pre-processed media materials. In some embodiments, the process of pre-processing the media materials is also referred to as the process of preparing the media materials.
[0172] In some embodiments, the material obtaining module 301 is further configured to periodically archive the plurality of media materials, i.e., to transfer the media materials that are earlier than a target time point from the central storage of the media resource management system to a fixed storage, which is a storage medium such as an optical disc or a magnetic tape. This can transfer some older media materials to the fixed storage to reduce the occupation of the central storage. In addition, the fixed storage can form a longer storage of the media materials to facilitate subsequent material query.
[0173] In summary, the material obtaining module 301 supports multiple media material obtaining methods. The material obtaining module 301 can obtain media materials through any of the above methods, which are not limited in the embodiments of the present application. Of course, the material obtaining module 301 can also obtain media materials through other methods in addition to the above methods, which are not limited in the embodiments of the present application.
[0174] The tag generating module 302 is configured to identify the content of the plurality of media materials to obtain a plurality of material tags. Each material tag corresponds to a media material, and the material tag is used to indicate the material content of the corresponding media material. In some embodiments, the process of identifying the content of the media materials to obtain the plurality of material tags is also referred to as the process of intelligent programming.
[0175] The media material is a material used to generate a media resource. In some embodiments, the media material includes at least two of a media material, an audio material, and a text material, which are not limited in the embodiments of the present application.
[0176] In some embodiments, the tag generation module 302 is configured to perform feature extraction on each of the plurality of media materials to obtain a material feature of each of the plurality of media materials. The tag generation module 302 is configured to obtain a plurality of material tags based on the material features of the plurality of media materials and a plurality of reference material features stored in a media material library. Each of the plurality of reference material features corresponds to a media material in the media material library. The media material library is a database maintained by the server and accessible by the media resource management system. In some embodiments, the server is configured to periodically update the reference material features stored in the media material library to ensure the richness of the material tags and improve the effectiveness of the tag determination.
[0177] For example, the tag generation module 302 is configured to call the feature extraction model and input the plurality of media materials into the feature extraction model. The tag generation module 302 is configured to perform feature extraction on each of the plurality of media materials by the feature extraction model to obtain a material feature of each of the plurality of media materials. For any of the plurality of media materials, the tag generation module 302 is configured to obtain a similarity between the material feature of the media material and the plurality of reference material features. In response to the similarity between the reference material feature and the material feature of any of the plurality of media materials satisfying a feature similarity condition, the tag generation module 302 is configured to determine a material tag of a media material corresponding to the reference material feature as a material tag of the media material.
[0178] For example, the tag generation module 302 is configured to call the feature extraction model and input the plurality of media materials into the feature extraction model. The tag generation module 302 is configured to perform feature extraction on each of the plurality of media materials by the feature extraction model to obtain a material feature of each of the plurality of media materials. For any of the plurality of media materials, the tag generation module 302 is configured to obtain a similarity between the material feature of the media material and the plurality of reference material features. In response to the similarity between the reference material feature and the material feature of any of the plurality of media materials satisfying a feature similarity condition, the tag generation module 302 is configured to determine a material tag of a media material corresponding to the reference material feature as a material tag of the media material.
[0179] In some embodiments, the tag generation module 302 is further configured to obtain a supplemental tag for any of the plurality of media materials, the supplemental tag being a tag of a material published by an account registered with the system. The tag generation module 302 determines the supplemental tag and the material tag of the media material as a material tag set of the media material. In the material tag set, each of the material tags can be used as a material tag for subsequent material search, i.e., in a subsequent material search, the media resource management system can query the media material corresponding to the material tag set in response to a search request for any of the material tags in the material tag set.
[0180] For example, in response to a tag supplement request for any of the media materials, the tag generation module 302 obtains the supplemental tag carried by the tag supplement request, combines the supplemental tag with the material tag of the media material, and obtains the material tag set of the media material. If the tag generation module 302 automatically generates the material tag of the media material according to the above embodiment, in this embodiment, the user can manually expand the material tag of the media material to improve the richness of the material tag.
[0181] For example, the terminal runs a media resource management client, the media resource management client provides a tag template, the tag template has multiple levels, each level has multiple material tags, each material tag corresponds to multiple material tags of the next level, for example, the tag template includes three levels, the first level includes material tags "sports", "news", and "entertainment", etc., the material tag "sports" includes the second level material tags "basketball", "soccer", and "tennis", etc. The material tag "basketball" includes the third level material tags "A country basketball", "B country basketball", and "C country basketball", etc. The user can set a supplemental tag for the selected media material through the tag template provided by the media resource client. The client triggers a tag supplement request for the selected media material, the tag supplement request carries the supplemental tag set by the user and the identifier of the selected media material. In response to the tag supplement request, the tag generation module 302 obtains the identifier of the selected media material and the supplemental tag set by the user from the tag supplement request, determines the media material based on the identifier of the selected media material, and stores the supplemental tag set by the user and the media material. In some embodiments, the tag template is also referred to as a catalog template. The process of setting a supplemental tag for a media material is also referred to as a manual multi-level cataloging process. Of course, the terminal can update the material template provided by the media resource management client to ensure the accuracy of the material template.
[0182] In some embodiments, the label generation module 302 is further configured to update the material label of any media material in the plurality of media materials in response to a material label update request for the media material. That is, when the material label of a media material is unreasonable, the user can update the material label of the media material to improve the accuracy of subsequent query of the media material.
[0183] For example, in response to a material label update request for any media material, the label generation module 302 acquires the material label carried by the material label update request and replaces the material label of the media material with the material label. If the label generation module 302 determines the material label of the media material in an automatic manner, in this embodiment, the user can manually adjust the automatically generated material label to improve the accuracy of the material label.
[0184] In some embodiments, the label generation module 302 is further configured to crawl the material label of the media material from the network. That is, the label generation module 302 invokes a web crawler tool to crawl the material label corresponding to the media material from the network, which can improve the efficiency of determining the material label.
[0185] In summary, the label generation module 302 supports multiple ways of determining the material label, and the label generation module 302 can determine the material label by any of the above ways, which are not limited in the embodiments of the present application. Of course, the label generation module 302 can determine the material label by other ways in addition to the above ways, which are not limited in the embodiments of the present application.
[0186] The material division module 303 is configured to divide the plurality of media materials into a plurality of media material sets according to the material types of the plurality of media materials and the plurality of material labels, each media material set including at least two media materials of different types, and the material labels of the at least two media materials of different types satisfying a target condition.
[0187] Through the above processing, the media resource management system can divide media materials of different types and having associated labels into a media material set, so that it is not necessary to manually query media materials of different types when producing media resources, and the efficiency of producing media resources is improved.
[0188] In some embodiments, the tag generation module 302 has determined the corresponding material tags for the plurality of media materials respectively, and the material division module 303 matches the corresponding material tags of the media materials under each material type, and divides the media materials in different material types that meet the target condition between the material tags into a media material set. For example, if the material types include media materials and audio materials, the material tag of a media material is "A character", and the material tag of an audio material is also "A character", then the material division module divides the media material and the audio material into a material set.
[0189] In some embodiments, each media material corresponds to a generation time or a generation time period. For example, the generation time of a media material is the time when the shooting device shoots the media material, and the generation time of an audio material is the time when the audio acquisition device acquires the audio material. Before the material division module 303 generates the media material set, the media materials with the same generation time or the generation time period overlapping with each other can also be divided into a media material group. The material division module 303 generates the media material set based on the plurality of media material groups, in combination with the material types and the material tags. That is, for a media material group, the material division module 303 matches the media materials of different types in the media material group based on the material tags, and divides the media materials with matching material tags and different types into a media material set. In this way, the matching of the media materials in time in each media material set can be ensured, and the user does not need to match the media materials in time when producing the media resource, thereby improving the efficiency of subsequent media resource production.
[0190] For example, for a reality show, the shooting device acquires video material A and video material B in time period M, and the audio acquisition device acquires audio material A and audio material B in time period N, and the time period M and the time period N have overlapping parts. Through the above processing process, the material division module 303 can divide the video material A, the video material B, the audio material A and the audio material B into a media material group. In the media material group, if the material tag corresponding to the video material A is character A, the material corresponding to the video material B is character B, the material tag corresponding to the audio material A is also character A, and the material tag corresponding to the audio material B is also character C, then the material division module 303 can divide the media material A and the audio material A into a media material set. In this way, when the user needs to edit the media material with the material tag of character A in subsequent production of the media resource, the media material set corresponding to the material tag A can be directly used, without the need for further searching, thereby improving the efficiency of human-computer interaction.
[0191] The media resource editing module 304 is configured to determine a plurality of target media material sets from the plurality of media material sets in response to a selection instruction of the plurality of media material sets, and generate the media resource based on the plurality of target media material sets.
[0192] That is, the division of the media material has been completed by the media material division module 303 of the media resource management system, and the user selects the target media material set to be edited by the media resource editing module 304, so that the media resource can be directly generated, and the efficiency of the media resource production is higher.
[0193] In some embodiments, the media resource editing module 304 is configured to determine a plurality of target media material sets from the plurality of media material sets in response to a selection instruction of the plurality of media material sets. The media resource editing module 304 sends the plurality of target media material sets to the media resource editing client, and the media resource editing client imports the plurality of target media material sets into an engineering file of the media resource. The media resource editing module 304 generates the media resource based on the engineering file. In some embodiments, the media resource editing client is provided with a quick editing tool and a fine editing tool for the user to use. In some embodiments, the resource editing client can provide a media resource management function, that is, the related functions of the media resource management client can be realized by the media resource editing client, and the function of editing the media resource can also be realized. In the following description, the media resource management client and the media resource editing client are taken as two independent clients for description.
[0194] For example, the media resource management client runs on the terminal, and the user can trigger a selection instruction for a plurality of media material sets through the media resource management client. That is, the media resource management client displays a media material set display interface to show the user a plurality of media material sets through the media material set display interface. The user can select a target media material set through the media material set display interface, and the media resource management client triggers the selection instruction based on the selected target media material set. The selection instruction carries an identifier of the selected target media material set. In response to the selection instruction, the media resource editing module 304 obtains the identifier of the selected target media material set from the selection instruction, and determines a plurality of target media material sets from the plurality of media material sets based on the identifier of the target media material set. The media resource editing module 304 delivers the plurality of target media material sets to the terminal. In response to the selection instruction for the engineering file of the media resource, the terminal imports the plurality of target media material sets into the engineering file of the media resource in the media resource editing client. The media resource editing client is configured to use a clip tool to clip the plurality of media material sets in the engineering file to obtain a plurality of clipped media material sets. In some embodiments, the plurality of media material sets in the engineering file includes the imported target media material sets and previously imported media material sets. That is, the target media material sets are supplementary to the previously imported media material sets, and the embodiments of the present application do not limit this. That is, the user can use the clip tool provided by the media resource editing client to clip the plurality of media material sets in the engineering file to delete unnecessary parts. The media resource editing client is configured to splice the plurality of clipped media material sets to obtain the media resource.
[0195] In some embodiments, the process of editing the media resource by the user through the media resource editing client, that is, the process of editing the engineering file of the media resource. The media resource editing module 304 can store the engineering file of the media resource in real time to ensure that the engineering file of the media resource remains up-to-date. In some embodiments, after a user edits the engineering file of the media resource through the media resource editing client, the user can upload the edited engineering file to the media resource editing module 304 through the media resource editing client, and another user can obtain the edited engineering file from the media resource editing module 304 through the media resource editing client to further edit the edited engineering file through the media resource editing client, thereby realizing the circulation of the engineering file. Different users can edit the media resource, and the media resource does not need to be rendered when circulating between different users, thereby improving the efficiency of media resource editing.
[0196] In some embodiments, the media resource editing module 304 is configured to verify the engineering editing permission of the account logged into the system on the engineering file. In response to the account logged into the system having the engineering editing permission on the engineering file, the step of sending the target media material set to the media resource editing client is performed.
[0197] In this implementation, the media resource editing module 304 is capable of verifying the account logged into the system, and only when the account logged into the system has the engineering editing permission on the engineering file, the media resource editing module 304 sends the target media material set to the media resource editing client, thereby ensuring the security of the media material.
[0198] In some embodiments, the media resource editing module 304 is further configured to transcode the plurality of media material sets in the engineering file to obtain a plurality of proxy media material sets respectively corresponding to the plurality of media material sets in the engineering file, and the occupied space of each proxy media material set is lower than the corresponding media material set in the engineering file. The media resource editing module 304 sends the plurality of proxy media material sets to the media resource editing client, and the media resource editing client imports the plurality of proxy media material sets into the engineering file, and generates the media resource based on the plurality of proxy media material sets and the media material sets in the engineering file.
[0199] In this implementation, the media resource editing module 304 is capable of transcoding the media material set to generate a proxy media material set with smaller volume, and using the proxy media material to edit the media resource, which can reduce the occupation of the computing resources by the media resource editing client when editing the media resource, and improve the efficiency of the media resource editing.
[0200] For example, the media resource editing module 304 is further configured to transcode a plurality of media material sets in the project file to obtain a plurality of proxy media material sets respectively corresponding to the plurality of media material sets in the project file. For example, if a media material set occupies a space of 100 MB, the media resource editing module 304 transcodes the media material set, for example, down-samples the media material, to obtain a proxy media material set of the media material set, which occupies a space of 10 MB. The media resource editing client edits the proxy media material set instead of directly editing the media material set, which can significantly improve the efficiency of media resource editing. The media resource editing module 304 sends the plurality of proxy media material sets and the plurality of media material sets to the media resource editing client. The media resource editing client is further configured to edit the plurality of proxy media material sets to obtain a plurality of edited proxy media material sets. The media resource editing client splices the plurality of edited proxy media material sets to obtain a proxy media resource. In response to a determination instruction for the proxy media resource, the media resource editing client edits the plurality of media material sets in the plurality of project files in the manner of editing the plurality of proxy media material sets to obtain a plurality of edited media material sets. The media resource editing client splices the plurality of edited media material sets to obtain a media resource.
[0201] In some embodiments, the media resource editing module 304 is further configured to add a watermark to the media resource.
[0202] In this implementation, the media resource editing module 304 prevents the media resource from being stolen or leaked by adding a watermark to the media resource.
[0203] For example, the user can select a watermark to be added in the media resource through the media resource editing client, and in some embodiments, the media resource editing client can also show the user the display effect after adding the watermark in the media resource, so as to facilitate the user to adjust the watermark, thereby improving the efficiency of human-computer interaction. For example, the media resource editing client provides multiple watermark templates for the user, and the user can select a watermark to be added in the media resource from the multiple watermark templates. In response to a selection instruction of any watermark template in the multiple watermark templates, the media resource editing client adds the selected watermark template to the media resource preview area, and the media resource is played in the media resource preview area. In some embodiments, the user can adjust the size, position, color and other attributes of the watermark template through the media resource editing client. In response to a watermark template confirmation instruction, the media resource editing client sends a watermark adding request to the media resource editing module 304, and the watermark adding request carries the watermark template and the parameter information of the watermark template, and the parameter information includes the scaling size, adding position, color and other information of the watermark template. The media resource editing module 304 obtains the watermark adding request, obtains the watermark template and the parameter information of the watermark template from the watermark adding request, and adds the watermark template to the media resource based on the indication of the parameter information of the watermark template.
[0204] In some embodiments, after the media resource editing module 304 generates the media resource, in some embodiments, the tag generation module 302 is also used to perform any one of the following:
[0205] In some embodiments, the tag generation module 302 performs content identification on multiple resource segments of the media resource to obtain multiple segment tags corresponding to the multiple resource segments respectively. In some embodiments, the division of the resource segments in the media resource can be performed by the user, that is, the user adds resource segment separation points in the media resource through the media resource editing client, and the media resource between every two separation points is a resource segment of the media resource. Alternatively, the division of the resource segments is automatically performed by the media resource editing module 304, that is, the media resource editing client 304 divides the media resource into multiple resource segments based on the media materials constituting the media resource, and each resource segment corresponds to a first media material. The division method of the resource segment is not limited in the embodiments of the present application.
[0206] For example, the label generation module 302 is configured to perform feature extraction on each of the plurality of resource segments to obtain a segment feature of each resource segment. The label generation module 302 obtains a plurality of segment labels based on the segment features of the plurality of resource segments and a plurality of reference segment features stored in a resource segment library, each reference segment feature corresponding to a resource segment in the resource segment library. The resource segment library is a database maintained by the server, and the media resource management system can call data in the resource segment library. In some embodiments, the server can periodically update the reference segment features stored in the resource segment library to ensure the richness of the segment labels and improve the effect of label determination.
[0207] For example, the label generation module 302 calls the feature extraction model and inputs the plurality of resource segments into the feature extraction model respectively, and performs feature extraction on the plurality of resource segments through the feature extraction model to obtain a segment feature of each resource segment. For any resource segment in the plurality of resource segments, the label generation module 302 obtains a similarity between the segment feature of the resource segment and the plurality of reference segment features. In response to the similarity between the reference segment feature and the segment feature of any resource segment meeting a feature similarity condition, a segment label of a resource segment corresponding to the reference segment feature is determined as a segment label of the resource segment.
[0208] In some embodiments, the label generation module 302 performs content recognition on the media resource to obtain a resource label of the media resource.
[0209] For example, the label generation module 302 is configured to perform feature extraction on the media resource to obtain a resource feature of the media resource. The label generation module 302 obtains a plurality of resource labels based on the resource feature of the media resource and a plurality of reference resource features stored in a media resource library, each reference resource feature corresponding to a media resource in the media resource library. The media resource library is a database maintained by the server, and the media resource management system can call data in the media resource library. In some embodiments, the server can periodically update the reference resource features stored in the media resource library to ensure the richness of the resource labels and improve the effect of label determination.
[0210] For example, the label generation module 302 calls the feature extraction model and inputs the media resource into the feature extraction model, and performs feature extraction on the media resource through the feature extraction model to obtain a resource feature of the media resource. The label generation module 302 obtains a similarity between the resource feature of the media resource and the plurality of reference resource features. In response to the similarity between the reference resource feature and the resource feature of any media resource meeting a feature similarity condition, a resource label of a media resource corresponding to the reference resource feature is determined as a resource label of the media resource.
[0211] In summary, the media resource editing module 304 supports multiple media material editing modes, and the media resource editing module can edit the media material in any of the above modes, which is not limited in the embodiments of the present application. Of course, in addition to the above-mentioned several modes, the media resource editing module 304 can also edit the media material in other modes, such as adjusting the media parameters of the media resource through the media resource editing module 304, such as adjusting the brightness or contrast of the video resource, etc., which is not limited in the embodiments of the present application.
[0212] In some embodiments, the media resource management system further comprises a permission identification module 305 for determining the account permission of the account logged into the system. The material acquisition module 301 determines a plurality of candidate media material sets from a plurality of media material sets, and the candidate media material set is a material set matched with the account permission. The media resource editing module 304 is further configured to determine a plurality of target media material sets selected from the plurality of candidate media material sets in response to a selection instruction of the plurality of candidate media material sets, and generate a media resource based on the plurality of target media material sets.
[0213] In this implementation, the media resource management system can identify the account permission of the account logged into the system through the permission identification module 305, and select the candidate media material set matched with the account permission from the plurality of media material sets, which means that the account logged into the system can only edit the media material set matched with its account permission, thereby improving the security of the media material set.
[0214] For example, a plurality of media materials are stored on the media resource management system, each of the media materials corresponds to a review level, the review level is positively correlated with the account authority, the greater the account authority, the higher the review level. The account authority database is queried by the account authority identification module 305 to determine the account authority of the account logged into the system, and the account authority database stores a plurality of accounts and account authorities corresponding to the plurality of accounts. The material acquisition module 301 determines the review level of the account based on the account authority of the account. A plurality of candidate media material sets corresponding to the review level of the account are determined from a plurality of media materials. In some embodiments, the media resource management client is running on the terminal, and the media resource management client displays a plurality of candidate media material sets, and the user can review the plurality of candidate media material sets through the media resource management client, and trigger a selection instruction for the plurality of candidate media material sets through the media resource client. In response to the selection instruction, the media resource editing module 304 downloads the plurality of selected target media material sets to the media resource editing client, edits the plurality of target media materials through the media resource editing client, obtains the engineering file of the media resource, and the media resource editing module 304 generates the media resource based on the engineering file.
[0215] In some embodiments, the authority identification module 305 is configured to determine the account group to which the account logged into the system belongs. The account authority corresponding to the account group is determined as the account authority of the account. That is, the authority identification module 305 can determine the login authority of the account by determining the account group of the account, without separately determining the account authority of a certain account, thereby improving the efficiency of authority determination.
[0216] For example, a plurality of account groups and a plurality of accounts under each account group are stored in the account database, and the account authority database stores the account authority corresponding to each account group. The account group to which the account belongs is queried in the account database by the authority identification module 305. The account authority corresponding to the account group is determined by the authority identification module 305 in the account authority database, and the account authority corresponding to the account group is determined as the account authority of the account.
[0217] In some embodiments, the media resource management system further comprises a resource auditing module 306 configured to perform content identification on the media resource to obtain resource content information of the media resource. In response to the resource content information indicating that the media resource does not contain the target content, the media resource auditing module 306 determines the media resource as a first type of media resource, the target content is content that is not allowed to be published, and the first type of media resource is a media resource that is allowed to be published. In response to the resource content information indicating that the media resource contains the target content, the media resource auditing module 306 determines the media resource as a second type of media resource, and the second type of media resource is a media resource that is not allowed to be published. In some embodiments, the target content is set by an auditing personnel according to actual conditions, and the embodiments of the present application do not make any limitation in this regard.
[0218] In some embodiments, the media resource auditing module 306 is configured to perform content identification on a plurality of resource frames of the media resource respectively to obtain a plurality of resource frame content information respectively corresponding to the plurality of resource frames. In response to the similarity between each resource frame content information and the target content information satisfying a content similarity condition, the media resource auditing module 306 determines the resource content information of the media resource as the media resource not containing the target content, and the target content information is the content information of the target content. In response to the similarity between any resource frame content information and the target content information not satisfying the content similarity condition, the media resource auditing module 306 determines the resource content information of the media resource as the media resource containing the target content.
[0219] For example, the media resource auditing module 306 is configured to extract features of the plurality of resource frames respectively to obtain resource frame features of each resource frame. The media resource auditing module 306 obtains content information of the plurality of resource frames based on the resource frame features of the plurality of resource frames. In some embodiments, the media resource auditing module 306 represents the content information of each resource frame by a content information vector and represents the target content information by a target content information vector. The media resource auditing module 306 obtains similarities between the plurality of content information vectors and the target content information vector. In response to the similarities between the plurality of content information vectors and the target content information vector being less than a content similarity threshold, the media resource auditing module 306 determines that the resource content information of the media resource does not contain the target content, and the media resource is a first type of media resource. In response to the similarity between any content information vector in the plurality of content information vectors and the target content information vector being greater than or equal to the content similarity threshold, the media resource auditing module 306 determines that the resource content information of the media resource contains the target content, and the media resource is a second type of media resource. In some embodiments, if the media resource is the second type of media resource, the media resource auditing module 306 can delete the second type of media resource, or the media resource auditing module 306 notifies the user that the media resource is the second type of media resource through the media resource management client, and the user can re-edit the media resource through the media resource editing client.
[0220] For example, the media resource auditing module 306 calls a content recognition model, respectively inputs the plurality of resource frames into the content recognition model, and respectively performs convolution processing on the plurality of resource frames through a convolution layer of the content recognition model to obtain resource frame features of each resource frame. The plurality of resource frame features are input into a full connection layer of the content recognition model, and the plurality of resource frame features are respectively processed through the full connection layer to obtain full connection features of each resource frame. The plurality of full connection features are input into a normalization layer of the content recognition model, and the plurality of full connection features are respectively processed through the normalization layer to obtain content information vectors corresponding to each resource frame. The media resource auditing module 306 obtains similarities between the plurality of content information vectors and the target content information vector. In response to the similarities between the plurality of content information vectors and the target content information vector being less than a content similarity threshold, the media resource auditing module 306 determines that the resource content information of the media resource does not contain the target content, and the media resource is a first type of media resource. In response to the similarity between any content information vector in the plurality of content information vectors and the target content information vector being greater than or equal to the content similarity threshold, the media resource auditing module 306 determines that the resource content information of the media resource contains the target content, and the media resource is a second type of media resource.
[0221] In some embodiments, the media resource auditing module 306 is configured to perform template matching on each of the plurality of resource frames of the media resource using the target content template. In response to all of the plurality of resource frames not matching the target content template, the media resource auditing module 306 determines the media resource as the first type of media resource. In response to any of the plurality of resource frames matching the target content template, the media resource auditing module 306 determines the media resource as the second type of media resource.
[0222] In some embodiments, the target content template includes a target text template, a target audio template, and a target media resource template, where the target text template is a text that is not allowed to be published, the target audio template is an audio that is not allowed to be published, and the target media resource template is a media resource that is not allowed to be published. The media resource auditing module 306 performs template matching on the media resource using the target text template, the target audio template, and the target media resource template, respectively. In response to the media resource not matching any of the target text template, the target audio template, and the target media resource template, the media resource auditing module 306 determines the media resource as the first type of media resource. In response to the media resource matching any of the target text template, the target audio template, or the target media resource template, the media resource auditing module 306 determines the media resource as the second type of media resource.
[0223] In some embodiments, the media resource auditing module 306 is further configured to obtain a plurality of artificial auditing information on the media resource published by a plurality of accounts, where the accounts are accounts logged in to the system. In response to all of the plurality of artificial auditing information indicating that the media resource does not contain the target content, the media resource is determined as the first type of media resource. In some embodiments, this implementation is also referred to as multi-person review.
[0224] For example, the plurality of auditing personnel log in to the accounts on different terminals, respectively, where each terminal runs a media resource auditing client, and each auditing personnel can establish a connection with the media resource management system through the media resource auditing client. Each media resource auditing client obtains the media resource to be audited issued by the media resource auditing module, and the auditing personnel can watch the media resource through the media resource auditing client, audit the media resource, publish artificial auditing information on the media resource through the media resource auditing client, and the media resource auditing client uploads the artificial auditing information published by the plurality of accounts to the media resource auditing module 306.
[0225] In some embodiments, the terminals used by the multiple auditors can be terminals of the same type or terminals of different types. For example, one auditor uses a smart phone to audit the media resource, and another auditor uses a desktop computer to audit the media resource. The type of terminal used by the auditor is not limited in the embodiments of the present application. Correspondingly, the media resource auditing client running on the terminal can be a client running on the same platform or a client running on different platforms. For example, one auditor uses a smart phone running an IOS system, and another auditor uses a smart phone running an Android system. The smart phone running the IOS system runs an IOS version of the media resource auditing client, and the smart phone running the Android system runs an Android version of the media resource auditing client. In some embodiments, if the auditor uses a smart phone to audit the media resource, the auditor can also use an applet on the smart phone to audit the media resource. Of course, in addition to using a smart phone to audit the media resource, the auditor can also use a desktop computer to audit the media resource. For example, the auditor can browse a target webpage through the desktop computer to audit the media resource, or the auditor can use a media resource auditing client installed on the desktop computer to audit the media resource. The embodiments of the present application do not limit this.
[0226] It should be noted that the media material management system can open an application programming interface for multiple types of devices and operating systems. Different types of devices and operating systems can establish a connection with the media material management system. The auditor can audit the media resource through various types of devices and operating systems, and the efficiency of human-computer interaction is high.
[0227] On the basis of the above-described embodiments, in some embodiments, the media resource auditing module 306 can further perform any one of the following:
[0228] In some embodiments, the media resource auditing module 306 is further configured to determine the media resource as a second type of media resource in response to any one of the multiple pieces of artificial auditing information indicating that the media resource contains the target content. That is, when multiple auditors audit the media resource at the same time, as long as one piece of artificial auditing information submitted by an auditor indicates that the media resource contains the target content, the media resource auditing module 306 can directly determine the media resource as the second type of media resource, that is, a media resource that is not allowed to be published. In this way, the fault tolerance of resource auditing can be improved.
[0229] In some embodiments, the media resource auditing module 306 is further configured to, in response to any one of the plurality of artificial auditing information indicating that the media resource contains the target content, send the media resource to a target account, the target account being an account whose auditing authority meets a target authority condition. In response to artificial auditing information published by the target account indicating that the media resource contains the target content, the media resource auditing module 306 determines the media resource as a second type of media resource. In response to artificial auditing information published by the target account indicating that the media resource does not contain the target content, the media resource auditing module 306 determines the media resource as a first type of media resource.
[0230] In this implementation, when multiple auditors simultaneously audit the media resource, when there is artificial auditing information published by one of the auditors indicating that the media resource contains the target content, the media resource editing module 306 pushes the media resource to a target account, and the media resource is audited by an auditor of the target account. In some embodiments, the auditing authority of the target account is higher than the auditing authority of the account of any one of the multiple auditors. The media resource auditing module 306 determines the type of the media resource according to the artificial auditing information published by the target account, thereby improving the accuracy of auditing the media resource.
[0231] In some embodiments, the media resource auditing module 306 is further configured to, in response to the resource content information indicating that the media resource does not contain the target content and the plurality of artificial auditing information all indicating that the media resource contains the target content, determine the media resource as a second type of media resource.
[0232] In this implementation, the resource content information is the resource content information obtained by the media resource auditing module 306 through the content recognition model, that is, the auditing information of the media resource automatically generated by the media resource management system. The artificial auditing information is the auditing information of the media resource published by the auditor after watching the media resource, and has higher credibility. Therefore, when the plurality of artificial auditing information all indicate that the media resource contains the target content, the media resource auditing module 306 directly determines the media resource as a second type of media resource, which can timely correct the automatically generated auditing information of the media resource and improve the accuracy of resource auditing.
[0233] In summary, the media resource auditing module 306 supports multiple media resource auditing modes, and the media resource auditing module 306 can audit the media resource through any of the above modes, which is not limited in the embodiments of the application. Of course, in addition to the above-mentioned several ways, the media resource auditing module 306 can also audit the media resource through other ways, which is not limited in the embodiments of the application.
[0234] In some embodiments, the media resource management system further comprises a media resource query module 307 configured to perform any one of the following:
[0235] In some embodiments, in response to a media query request for a plurality of media materials, the media resource query module 307 matches a media query tag carried in the media query request with a plurality of media tags. In response to a similarity between the media query tag and any one of the plurality of media tags satisfying a first similarity condition, the media resource query module 307 determines a media material corresponding to the any one of the plurality of media tags as a media material corresponding to the media query request.
[0236] In this implementation, the media resource query module 307 can provide a media material query function to a user, and the user can obtain a media material corresponding to a media query tag by inputting the media query tag, and the efficiency of the media query is relatively high.
[0237] For example, a media resource management client is running on a terminal, and the media resource management client can establish a network connection with the media resource management system. The media resource management client provides a media material query function, and in response to a media query operation on the media resource management client, a media query request is triggered based on a media query tag indicated by the media query operation. In response to the media query request, the media resource query module 307 obtains the media query tag from the media query request. The media resource query module 307 obtains a similarity between the media query tag and a plurality of media tags of media materials. In response to a similarity between any one of the plurality of media tags and the media query tag being greater than or equal to a first tag similarity threshold, the media resource query module 307 determines a media material corresponding to the any one of the plurality of media tags as a media material corresponding to the media query request. The media resource query module 307 displays the media material to the user through the media resource management client, and the user can view the queried media material through the media resource management client.
[0238] For example, the media resource management client provides a material query interface, and the material query interface displays a query input box and a material query control. The user can input the content to be queried, i.e., a material query label, in the query input box. In response to a click operation on the material query control, the media resource management client triggers a material query request, and the material query request carries the content input by the user in the query input box. In response to the material query request, the media resource query module 307 obtains the material query label from the material query request. If the material query label is represented by a material query vector and the material label is represented by a material label vector, the media resource query module 307 obtains the cosine similarity between the material query vector and the plurality of material label vectors. In response to the cosine similarity between any material label vector in the plurality of material label vectors and the material query vector being greater than or equal to a first label similarity threshold, the media resource query module 307 determines the media material corresponding to the material label as the media material corresponding to the material query request. The media resource query module 307 displays the media material to the user through the media resource management client, and the user can view the queried media material through the media resource management client.
[0239] In some embodiments, in response to a segment query request for a media resource, the media resource query module 307 matches a segment query label carried in the segment query request with a plurality of segment labels. In response to the similarity between the segment query label and any segment label in the plurality of segment labels meeting a second similarity condition, the media resource query module 307 determines the resource segment corresponding to the any segment label as the resource segment corresponding to the segment query request.
[0240] In this implementation, the media resource query module 307 can provide the user with the function of resource segment query, and the user can obtain the resource segment corresponding to the segment query label by inputting the segment query label, and the efficiency of the segment query is relatively high.
[0241] For example, the terminal runs a media resource management client, and the media resource management client can establish a network connection with the media resource management system. The media resource management client is provided with a resource segment query function, and in response to a segment query operation on the media resource management client, a segment query request is triggered based on a segment query label indicated by the segment query operation. In response to the segment query request, the media resource query module 307 obtains the segment query label from the segment query request. The media resource query module 307 obtains the similarity between the segment query label and the segment labels of the plurality of resource segments. In response to the similarity between any one of the plurality of segment labels and the segment query label being greater than or equal to the second label similarity threshold, the media resource query module 307 determines the resource segment corresponding to the segment label as the resource segment corresponding to the segment query request. The media resource query module 307 displays the resource segment to the user through the media resource management client, and the user can view the queried resource segment through the media resource management client.
[0242] For example, the media resource management client is provided with a segment query interface, and the segment query interface displays a query input box and a segment query control. The user can input the content that the user wants to query, i.e., the segment query label, in the query input box. In response to a click operation on the segment query control, the media resource management client triggers a segment query request, and the segment query request carries the content input by the user in the query input box. In response to the segment query request, the media resource query module 307 obtains the segment query label from the segment query request. If the segment query label is represented by a segment query vector and the segment label is represented by a segment label vector, the media resource query module 307 obtains the cosine similarity between the segment query vector and the plurality of segment label vectors. In response to the cosine similarity between any one of the plurality of segment label vectors and the segment query vector being greater than or equal to the second label similarity threshold, the media resource query module 307 determines the resource segment corresponding to the segment label as the resource segment corresponding to the segment query request. The media resource query module 307 displays the resource segment to the user through the media resource management client, and the user can view the queried resource segment through the media resource management client.
[0243] In some embodiments, in response to a resource query request for a media resource, the media resource query module 307 matches the resource query label carried in the resource query request with the resource label. In response to the similarity between the resource query label and the resource label meeting a third similarity condition, the media resource query module 307 determines the media resource as the media resource corresponding to the resource query request.
[0244] In this implementation, the media resource query module 307 can provide the function of resource query for the user, and the user can obtain the media resource corresponding to the material query label by inputting the material query label, and the efficiency of material query is higher.
[0245] For example, the media resource management client is running on the terminal, and the media resource management client can establish a network connection with the media resource management system. The media resource management client provides the function of media resource query, and in response to the resource query operation on the media resource management client, a resource query request is triggered based on the resource query label indicated by the resource query operation. In response to the resource query request, the media resource query module 307 obtains the resource query label from the resource query request. The media resource query module 307 obtains the similarity between the resource query label and the resource label of the media resource. In response to the similarity between the resource label of the media resource and the resource query label being greater than or equal to the third label similarity threshold, the media resource query module 307 determines the media resource as the media resource corresponding to the resource query request. The media resource query module 307 displays the media resource to the user through the media resource management client, and the user can view the queried media resource through the media resource management client.
[0246] For example, the media resource management client is running on the terminal, and the media resource management client can establish a network connection with the media resource management system. The media resource management client provides the function of media resource query, and in response to the resource query operation on the media resource management client, a resource query request is triggered based on the resource query label indicated by the resource query operation. In response to the resource query request, the media resource query module 307 obtains the resource query label from the resource query request. The media resource query module 307 obtains the similarity between the resource query label and the resource label of the media resource. In response to the similarity between the resource label of the media resource and the resource query label being greater than or equal to the third label similarity threshold, the media resource query module 307 determines the media resource as the media resource corresponding to the resource query request. The media resource query module 307 displays the media resource to the user through the media resource management client, and the user can view the queried media resource through the media resource management client.
[0247] In conclusion, the media resource query module 307 supports multiple media resource query modes, and the media resource query module 307 can query the media resource through any of the above modes, which is not limited in the embodiments of the present application. Of course, in addition to the above-mentioned modes, the media resource query module 307 can also query the media resource through other modes, which is not limited in the embodiments of the present application.
[0248] In some embodiments, the media resource management system further includes a media resource sending module 308 configured to send the media resource to a target terminal in response to a sending instruction of the media resource, the target terminal being indicated by the sending instruction.
[0249] In some embodiments, a media resource management client is installed on the terminal, and the media resource management client can establish a network connection with the media resource management system. The media resource management client provides a media resource sending function, and in response to a media resource sending operation of the media resource on the media resource management client, a sending instruction of the media resource is triggered, and the sending instruction carries a target terminal indicated by the media resource sending operation. In response to the sending instruction of the media resource, the media resource sending module 308 sends the media resource to the target terminal. In some embodiments, the target terminal is also a downstream platform of the media resource management system, and the media resource sending module 308 can send the media resource to one downstream platform or multiple downstream platforms at the same time, which is not limited in the embodiments of the present application.
[0250] In some embodiments, the media resource management system further includes a log recording module 309 configured to record at least one of a running log, an operation log, an account login log, and an alarm log of the system.
[0251] Through the log recording module 309, the running and operation of the media resource management system can be recorded, which is convenient for backtracking when problems occur.
[0252] In some embodiments, the media resource management system further includes a system management module 310 configured to set and manage the media resource management system and deploy a server with the media resource management system.
[0253] In order to more clearly illustrate the media resource management system provided by the embodiments of the present application, the following will be described in combination with Figure 4 and the above-mentioned various functional modules.
[0254] Figure 4This is a functional architecture diagram of a media resource management system, in which material acquisition is a function of the system, implemented by the material acquisition module 301. In some embodiments, media materials include any one of video files (video materials), audio files (audio materials), IP live streams, and live broadcast streams.
[0255] Media upload is a function of the media resource management system, implemented by the media acquisition module 301. In some embodiments, media upload includes sub-functions such as uploading to temporary storage, uploading to central storage, uploading to public cloud, scanning and antivirus, file migration, periodic archiving, and uploading to the client. Uploading to temporary storage means uploading media materials to the temporary storage space of the media resource management system. Uploading to central storage means uploading media materials to the central storage space of the media resource management system. Uploading to public cloud means uploading media materials to the public cloud associated with the media resource management system. Scanning and antivirus is the process of performing security verification on the media materials. File migration is the process of transferring media materials from temporary storage space to central storage space or public cloud. Periodic archiving is the process of transferring media materials from central storage to fixed storage. Uploading to the client is the process of transferring media materials to the media resource management client.
[0256] Editing is a function of the media resource management system, implemented by the media resource editing module 303. In some embodiments, editing includes sub-functions such as dot marking, quick web editing, quick editing, and cloud-based editing. Dot marking involves marking dots on the media material, which the user then segments during subsequent quick web editing or quick editing processes. Cloud-based editing refers to the process of remotely communicating with the media resource management system via a terminal to edit the media material.
[0257] Review management is a function of the media resource management system, implemented by the media resource review module 306. In some embodiments, review management includes sub-functions such as automatic review, multi-user review, review permission management, and review tools. Automatic review refers to the process of reviewing content using a content recognition model; in some embodiments, automatic review is also referred to as AI review. Multi-user review allows multiple users to review the same media resource. Review permission management determines an account's review permissions for media resources. Review tools provide application interfaces for media resource review clients on different platforms.
[0258] Catalog management is a function of the media resource management system, which is implemented by the tag generation module 302. Among them, manual multi-level cataloging is the process of manually configuring tags for media materials. Multi-level refers to multiple levels of material tags. For example, the material tag "basketball" is a material tag under the material tag "sports". Basic cataloging is the process of configuring the highest level of material tags for media materials. For example, "sports" is the highest level of material tag. AI cataloging refers to the process of cataloging based on the similarity between the material features of the media materials and the reference material features through a feature extraction model. Web scraping refers to the process of obtaining material tags through web crawlers. Catalog template refers to the arrangement template of the above-mentioned multiple levels of material tags.
[0259] Efficient retrieval is a function of the media resource management system, which is implemented by the media resource query module 307. Among them, fuzzy retrieval refers to the process of searching based on a certain keyword. Condition filtering refers to the user's filtering scheme for the search results. Reverse search, also known as reverse search, is a search from the target state. It is usually performed simultaneously with forward search (bidirectional search). If the newly expanded state in forward search appears in reverse search, connecting the two search paths is a solution. Voice command retrieval refers to the process of the user issuing a voice command in the media resource management client, the media resource management client performing voice recognition on the voice command, obtaining the voice content corresponding to the voice command, and querying based on the voice content information. Picture retrieval refers to the process of the user inputting an image in the media resource management client, the media resource management client performing retrieval based on the image, obtaining media materials corresponding to the image, and displaying the queried media materials to the user.
[0260] Distribution and download is a function of the media resource management system, which is implemented by the media resource sending module 308. Among them, the download client is the process of downloading the media resource management client. Web page download refers to the process of downloading media resources through web pages. Permission and traffic monitoring refers to the monitoring of account download permissions and download traffic. Watermark refers to adding an identifier to the media resource, which does not affect the normal playback of the media resource, but the identifier can indicate the source of the media resource. Distribution management refers to the process of distributing media resources to different terminals.
[0261] Security management is a function of the media resource management system, which is implemented by the permission identification module 305. The functions of alarm / log management are implemented by the log recording module 309. Basic management is implemented by the system management module 310.
[0262] The following will be combined with Figure 5and the above various optional embodiments, the workflow of the media resource management system provided by the embodiments of the present application is described.
[0263] 1. The media resource management system manages the mounting storage device through mounting management, and the media resource management system acquires the media material from the storage device through storage management, that is, the media material first enters the temporary storage space of the media resource management system, and after intelligent cataloging and media material classification, enters the central storage space of the media resource management system. Of course, for live streaming, the media resource management system can make it first enter the temporary storage space of the media resource management system through storage management, and after intelligent cataloging and media material classification, enter the central storage space of the media resource management system.
[0264] 2. The user logs in, and the media resource management system determines the account group (organization) authority to which the logged-in account belongs according to the logged-in account, and matches the corresponding project and project, wherein the account group authority includes at least one of media material authority, live streaming authority and project authority.
[0265] 3. The media resource management system creates projects and project types, and authorizes organizations (account groups). The created projects are managed through project management.
[0266] 4. The user logs in to the media resource management client on the terminal, and when the logged-in account has project authority, the media resource management system imports the media material into the project file. In some embodiments, the media resource management client can display the corresponding available media material based on the account authority.
[0267] 5. When the user opens the media resource editing client, the user can view the project file in the media resource management system, and in some embodiments, according to the project authority of the account group to which the account logged into the media resource management system belongs, it is determined whether the user can view the project file.
[0268] 6. The user can add and import projects or media materials based on the corresponding editing plug-ins through the media resource editing client, so as to realize the continuous editing of the project, wherein the editing includes quick editing and fine editing. If there is no project file, the media resource editing client can create a project file.
[0269] 7. When the user uses the media resource editing client to edit the project file, the user can save and update the project file at any time, and the updated project file can be uploaded to the media resource management system in real time for the next user to continue to use directly, so as to realize the production flow of engineering.
[0270] 8. The media resource editing client can access corresponding media resources with different permissions when editing media materials, such as accessing audio tracks corresponding to media materials.
[0271] All the optional technical solutions described above can be combined to form optional embodiments of the present application, which will not be described again.
[0272] Through the technical solutions provided by the embodiments of the present application, the media resource management system can automatically add material tags to media materials, combine different types of media materials according to the material tags, and generate a media material set. When a media resource producer makes media resources through the media material set, there is no need to manually search for media materials and match different types of media materials. The media resource production can be completed directly through the media material set, thereby improving the efficiency of media resource production.
[0273] After introducing the media resource management system provided by the embodiments of the present application, the media resource management method provided by the embodiments of the present application will be described in combination with the related description of the above media resource management system, see Figure 6 , the method comprises:
[0274] 601. The computer device performs content recognition on a plurality of media materials to obtain a plurality of material tags, each material tag corresponding to a media material, and the material tag being used to indicate the material content of the corresponding media material.
[0275] In some embodiments, the computer device respectively extracts features of the plurality of media materials to obtain material features of each media material. The computer device obtains a plurality of material tags based on the material features of the plurality of media materials and a plurality of reference material features stored in a media material library, each reference material feature corresponding to a media material in the media material library.
[0276] For example, for any media material in the plurality of media materials, the computer device inputs the media material into a feature extraction model, extracts features of the media material through the feature extraction model, and obtains material features of the media material. The computer device obtains the similarity between the material features of the media material and a plurality of reference material features, and in response to the similarity between the reference material feature and the material feature of any media material meeting the feature similarity condition, the computer device determines the material tag of the media material corresponding to the reference material feature as the material tag of the media material.
[0277] In one possible implementation, the computer device obtains a supplement tag for any media material in the plurality of media materials, and the supplement tag is a material tag published by an account logged into the system. The supplement tag and the material tag of any media material are determined as a material tag set of any media material.
[0278] In some embodiments, in response to the material tag updating request for any of the plurality of media materials, the computer device updates the material tag of any of the media materials with the material tag corresponding to the material tag updating request.
[0279] In some embodiments, the electronic device performs content identification on the plurality of resource segments of the media resource, and obtains a plurality of segment tags corresponding to the plurality of resource segments respectively.
[0280] In some embodiments, the electronic device performs content identification on the media resource, and obtains a resource tag of the media resource.
[0281] The above several implementations are performed by the above-mentioned tag generation module 302, and the implementation process is described above in the description of the tag generation module 302, which will not be repeated here.
[0282] In some embodiments, before step 601, the computer device can further perform any one of the following steps:
[0283] In some embodiments, in response to the material uploading request, the computer device obtains a plurality of media materials corresponding to the material uploading request.
[0284] In some embodiments, in response to the resource scanning instruction for the target storage location, the computer device performs resource scanning at the target storage location, and obtains a plurality of media materials stored in the target storage location.
[0285] In some embodiments, the computer device obtains a plurality of media materials carried by the live streaming.
[0286] In some embodiments, the computer device performs security verification on the plurality of media materials, and in response to the plurality of media materials all passing the security verification, performs the step of performing content identification on the plurality of media materials. In response to any of the plurality of media materials failing the security verification, deleting any of the media materials.
[0287] In some embodiments, the computer device pre-processes the plurality of media materials to obtain a plurality of pre-processed media materials.
[0288] The above several implementations are performed by the above-mentioned material obtaining module 301, and the implementation process is described above in the description of the material obtaining module 301, which will not be repeated here.
[0289] 602、The computer device divides the plurality of media materials into a plurality of media material sets according to the material types of the plurality of media materials and the plurality of material tags, each media material set including at least two media materials of different types, and the material tags of the at least two media materials of different types satisfying a target condition.
[0290] In some embodiments, the material type includes at least two of the following: media material, audio material, and text material.
[0291] Step 602 is performed by the material division module 303, and the implementation process is described above in the description of the material division module 303, which will not be repeated here.
[0292] 603. The computer device determines, in response to the selection instruction, a plurality of target media material sets from the plurality of media material sets, and generates a media resource based on the plurality of target media material sets.
[0293] In some embodiments, the computer device sends the plurality of target media material sets to a media resource editing client, and the media resource editing client imports the plurality of target media material sets into an engineering file of the media resource. The media resource is generated based on the engineering file.
[0294] In some embodiments, the computer device generates the media resource based on the engineering file includes:
[0295] The computer device uses a clip tool to clip the plurality of media material sets in the engineering file to obtain a plurality of clipped media material sets. The plurality of clipped media material sets are spliced to obtain the media resource.
[0296] In some embodiments, the computer device generates the media resource based on the plurality of target media material sets includes:
[0297] The computer device transcodes the plurality of media material sets in the engineering file to obtain a plurality of proxy media material sets corresponding to the plurality of media material sets in the engineering file, respectively. The occupied space of each proxy media material set is lower than the corresponding media material set in the engineering file. The plurality of proxy media material sets are sent to the media resource editing client, and the media resource editing client imports the plurality of proxy media material sets into the engineering file. The media resource is generated based on the plurality of proxy media material sets and the media material sets in the plurality of engineering files.
[0298] In some embodiments, the computer device generates the media resource based on the plurality of proxy media material sets and the media material sets in the plurality of engineering files includes:
[0299] The computer device clips the plurality of proxy media material sets to obtain a plurality of clipped proxy media material sets. The plurality of clipped proxy media material sets are spliced to obtain a proxy media resource. In response to a determination instruction for the proxy media resource, media material sets in the plurality of project files are clipped in the clipping manner of the plurality of proxy media material sets to obtain a plurality of clipped media material sets. The plurality of clipped media material sets are spliced to obtain a media resource.
[0300] In some embodiments, the computer device adds a watermark on the media resource.
[0301] The above various embodiments are performed by the media resource editing module 304, and the implementation process is described above in the description of the media resource editing module 304, which will not be repeated here.
[0302] In some embodiments, in response to the account logged into the system having project editing permissions for the project file, the step of sending the plurality of target media material sets to the media resource editing client is performed.
[0303] In some embodiments, the method further comprises:
[0304] The computer device determines the account permissions of the account logged into the system. The computer device determines a plurality of candidate media material sets from the plurality of media material sets, the candidate media material sets being material sets matching the account permissions.
[0305] In response to a selection instruction for the plurality of candidate media material sets, the computer device determines a plurality of target media material sets selected from the plurality of candidate media material sets, and generates a media resource based on the plurality of target media material sets.
[0306] In some embodiments, the computer device determining the account permissions of the account logged into the system comprises:
[0307] The computer device determines an account group to which the account logged into the system belongs. The account permissions corresponding to the account group are determined as the account permissions of the account.
[0308] The above embodiments are performed by the permission identification module 305, and the implementation process is described above in the description of the permission identification module 305, which will not be repeated here.
[0309] In some embodiments, the method further comprises any one of the following:
[0310] In response to the media resource query request, the computer device matches the resource query label carried in the resource query request with the resource label. In response to the similarity between the resource query label and the resource label meeting a third similarity condition, the computer device determines the media resource as the media resource corresponding to the resource query request.
[0311] In response to the media resource query request, the computer device matches the resource query label carried in the resource query request with the resource label. In response to the similarity between the resource query label and the resource label meeting a third similarity condition, the computer device determines the media resource as the media resource corresponding to the resource query request.
[0312] In response to the media resource query request, the computer device matches the resource query label carried in the resource query request with the resource label. In response to the similarity between the resource query label and the resource label meeting a third similarity condition, the computer device determines the media resource as the media resource corresponding to the resource query request.
[0313] The above implementation is performed by the media resource query module 307, and the implementation process is described above with reference to the media resource query module 307, which will not be described here again.
[0314] In some embodiments, after step 603, the computer device can perform any one of steps 604 / 605 and 606, which are not limited by the embodiments of the present application.
[0315] 604. The computer device performs content auditing on the media resource.
[0316] In some embodiments, the computer device performs content identification on the media resource to obtain resource content information of the media resource; in response to the resource content information indicating that the media resource does not contain target content, the computer device determines the media resource as a first type of media resource, the target content is content that is not allowed to be published, and the first type of media resource is a media resource that is allowed to be published; in response to the resource content information indicating that the media resource contains the target content, the computer device determines the media resource as a second type of media resource, and the second type of media resource is a media resource that is not allowed to be published.
[0317] In some embodiments, the computer device performs content identification on the media resource to obtain resource content information of the media resource includes:
[0318] The computer device respectively performs content identification on a plurality of resource frames of the media resource to obtain a plurality of resource frame content information respectively corresponding to the plurality of resource frames.
[0319] In response to the similarity between each resource frame content information and the target content information meeting the content similarity condition, the computer device determines the resource content information of the media resource as the media resource not containing the target content, and the target content information is the content information of the target content.
[0320] In some embodiments, the computer device performs template matching on each of the multiple resource frames of the media resource by using the target content template. In response to all of the multiple resource frames not matching the target content template, the computer device determines the media resource as the first type of media resource. In response to any of the multiple resource frames matching the target content template, the computer device determines the media resource as the second type of media resource.
[0321] In some embodiments, the computer device obtains multiple artificial review information of the media resource respectively published by multiple accounts, and the account is an account logged in the system. In response to all of the multiple artificial review information indicating that the media resource does not contain the target content, the computer device determines the media resource as the first type of media resource.
[0322] In some embodiments, in response to any of the multiple artificial review information indicating that the media resource contains the target content, the computer device determines the media resource as the second type of media resource.
[0323] In some embodiments, in response to any of the multiple artificial review information indicating that the media resource contains the target content, the computer device sends the media resource to a target account, and the target account is an account whose review authority meets a target authority condition. In response to the artificial review information published by the target account indicating that the media resource contains the target content, the computer device determines the media resource as the second type of media resource. In response to the artificial review information published by the target account indicating that the media resource does not contain the target content, the computer device determines the media resource as the first type of media resource.
[0324] In some embodiments, in response to the resource content information indicating that the media resource does not contain the target content and all of the multiple artificial review information indicating that the media resource contains the target content, the computer device determines the media resource as the second type of media resource.
[0325] The above various embodiments are performed by the media resource review module 306, and the implementation process is described above with reference to the description of the media resource review module 306, which will not be repeated here.
[0326] 605, in response to the sending instruction of the media resource, the computer device sends the media resource to a target terminal, and the target terminal is indicated by the sending instruction.
[0327] Step 605 is performed by the media resource sending module 308, and the implementation process is described above with reference to the description of the media resource sending module 308, which will not be repeated here.
[0328] 606. The computer device records at least one of the operation log, the operation log, the account login log, and the alarm log of the system.
[0329] Step 606 is implemented by the log recording module 309 described above, and the implementation process is described above in the description of the log recording module 309, which will not be repeated here.
[0330] Referring to Figure 7 After the media resource management method provided by the embodiment of the present application is used, taking video as an example of the media resource, after the media resource is edited and audited, if the media resource needs to be edited, the user can directly adjust based on the engineering file of the media resource, without the need for multiple transcoding rendering, reducing the consumption of computing resources and improving the efficiency of media resource generation.
[0331] The media resource management method provided by the embodiment of the present application will be described below in combination with Figure 8 and the possible implementation manners described above, taking video as an example of the media resource.
[0332] 1. Media materials are uploaded to the temporary storage space of the media resource management system by manual upload, automatic scanning, upload (IP live stream and live stream), targeted capture or cooperation party injection, etc., wherein the cooperation party injection is that a cooperation user of the media resource management system provided by the present application.
[0333] 2. The uploaded media materials are scanned by an antivirus scanning software, and the scanned media materials that pass are entered into the central storage space of the media resource management system and managed by the media resource management system. The media materials that do not pass the scanning will be deleted and recorded.
[0334] 3. The media resource management system calls a cloud transcoding component to perform operations such as preparation and proxy file generation on the media materials, and places the prepared media materials into a specified directory. In some embodiments, the media resource management system calls the cloud transcoding component to add a dark watermark in the media materials.
[0335] 4. The media resource management system calls an intelligent cataloging component to perform intelligent cataloging on the media materials, and automatically generates corresponding cataloging information such as video, audio, and text.
[0336] 5、If there is an editing requirement, the media material can be edited and produced in the media resource management system, such as video production through rough editing, fine editing and other editing tools, and the produced video is submitted to the finished material for management. In some embodiments, during the production process, the media resource management system can realize project flow and project merging based on project files, wherein the project flow refers to the transfer of project files between different clients, and the project merging refers to the merging of different project files. In some embodiments, the media resource management system can store and archive the media material for subsequent reference.
[0337] 6、The media resource management system calls the intelligent audit component to automatically and intelligently audit the media material, and the passed media material is placed in the to-be-audited media material library.
[0338] 7、The film reviewer manually audits the to-be-audited media material through web film review, terminal film review, applet film review or mobile terminal film review, and submits the corresponding manual audit information. In some embodiments, the media resource management system can add a watermark to the media material.
[0339] 8、The media resource management system calls the intelligent identification tool to automatically and intelligently catalog the passed media material and generates the corresponding catalog information, which is the material tag of the media material. In some embodiments, the media resource management system can also catalog the media material through network crawling.
[0340] 9、The human being selects a corresponding catalog template based on the type of the media material to perform more detailed manual cataloging of the media material, which facilitates subsequent retrieval. The manual cataloging includes at least one of media resource cataloging, segment cataloging and media material cataloging.
[0341] 10、The media resource management system can provide a search query function, and the search function includes any one of fuzzy search, reverse search, image search and voice search.
[0342] 11、The video in the media resource management system is managed for downloading, such as being distributed to a corresponding downstream platform or responding to a download request through download management.
[0343] Through the technical solutions provided in the embodiments of the present application, the material tags can be automatically added to the media material, different types of media materials are combined according to the material tags, a media material set is generated, and when a media resource producer produces a media resource through the media material set, manual media material searching and matching between different types of media materials are no longer needed, and the media resource production can be directly completed through the media material set, thereby improving the efficiency of media resource production.
[0344] The embodiment of the present application further provides a media resource generation method, referring to Figure 9 , the method comprises:
[0345] 901, in response to obtaining any media material, the computer device obtains the material tag of the media material.
[0346] The method that the computer device obtains the media material is described above for the material obtaining module 301, and will not be repeated here. The method that the computer device obtains the material tag of the media material is described above for the tag generation module 302, and will not be repeated here.
[0347] 902, the computer device determines the media material set to which the media material belongs according to the material tag, and the media material set comprises at least one media material corresponding to the material tag.
[0348] The method that the computer device determines the material set is described above for the material division module 303, and will not be repeated here.
[0349] 903, the computer device generates a media resource based on the media material set and the media material.
[0350] The method that the computer device determines the material set is described above for the media resource editing module 304, and will not be repeated here.
[0351] For example, in the process of recording a reality show, the computer device can record which role's audio is recorded in each channel, and through the media resource generation method, the audio material can be automatically matched to the corresponding video material, so that the one-to-one correspondence between the video and the audio no longer needs to be assisted by manual work, and a large amount of time in the later stage is saved.
[0352] Through the technical scheme provided by the embodiment of the present application, the material tag can be automatically added to the media material, different types of media materials can be combined according to the material tag, a media material set is generated, and when a media resource maker makes a media resource through the media material set, manual media material searching and matching between different types of media materials are no longer needed, and the media resource making can be directly completed through the media material set, so that the efficiency of media resource making is improved.
[0353] The above computer device can be realized as a terminal, and the structure of the terminal will be introduced below:
[0354] Figure 10 It is a structure schematic diagram of a terminal provided by the embodiment of the present application.
[0355] Generally, the terminal 1000 comprises one or more processors 1001 and one or more memories 1002.
[0356] The processor 1001 can include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1001 can be implemented in at least one of a hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), a PLA (Programmable Logic Array). The processor 1001 can also include a main processor and a co-processor, the main processor being a processor for processing data in an awake state, also referred to as a CPU (Central Processing Unit), and the co-processor being a low-power processor for processing data in a standby state. In some embodiments, the processor 1001 can be integrated with a GPU (Graphics Processing Unit) that is responsible for rendering and drawing of content to be displayed by the display screen. In some embodiments, the processor 1001 can further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.
[0357] The memory 1002 can include one or more computer-readable storage media that can be non-transitory. The memory 1002 can also include high-speed random access memory and nonvolatile, computer-readable storage media such as one or more magnetic disk storage devices, flash memory devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1002 is used to store at least one computer program for being executed by the processor 1001 to implement the media resource management method or the media resource generation method provided by the method embodiments in the present application.
[0358] In some embodiments, the terminal 1000 can also optionally include a peripheral device interface 1003 and at least one peripheral device. The processor 1001, the memory 1002, and the peripheral device interface 1003 can be connected through a bus or a signal line. Each peripheral device can be connected to the peripheral device interface 1003 through a bus, a signal line, or a circuit board. Specifically, the peripheral device includes at least one of a radio frequency circuit 1004, a display screen 1005, a camera assembly 1006, an audio circuit 1007, a positioning assembly 1008, and a power supply 1009.
[0359] The peripheral interface 1003 can be used to connect at least one I / O (Input / Output) related peripheral device to the processor 1001 and the memory 1002. In some embodiments, the processor 1001, the memory 1002 and the peripheral interface 1003 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1001, the memory 1002 and the peripheral interface 1003 can be implemented on a separate chip or circuit board, and the present embodiments are not limited to this.
[0360] The radio frequency circuit 1004 is used to receive and send RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1004 communicates with communication networks and other communication devices through electromagnetic signals. The radio frequency circuit 1004 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 1004 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and the like.
[0361] The display screen 1005 is used to display a UI (User Interface). The UI can include graphics, text, icons, video, and any combination thereof. When the display screen 1005 is a touch display screen, the display screen 1005 also has the ability to collect touch signals on or above the surface of the display screen 1005. The touch signals can be input as control signals to the processor 1001 for processing. At this time, the display screen 1005 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards.
[0362] The camera assembly 1006 is used to collect images or videos. Optionally, the camera assembly 1006 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is disposed on the front panel of the terminal, and the rear-facing camera is disposed on the back of the terminal.
[0363] The audio circuit 1007 can include a microphone and a speaker. The microphone is used to collect sound waves of the user and the environment, and convert the sound waves into electrical signals input to the processor 1001 for processing, or input to the radio frequency circuit 1004 to realize voice communication.
[0364] The positioning assembly 1008 is used to locate the current geographical position of the terminal 1000 to realize navigation or LBS (Location Based Service).
[0365] The power supply 1009 supplies power to the various components of the terminal 1000. The power supply 1009 can be AC, DC, a disposable battery, or a rechargeable battery.
[0366] In some embodiments, the terminal 1000 further includes one or more sensors 1010. The one or more sensors 1010 include, but are not limited to, an acceleration sensor 1011, a gyroscope sensor 1012, a pressure sensor 1013, a fingerprint sensor 1014, an optical sensor 1015, and a proximity sensor 1016.
[0367] The acceleration sensor 1011 can detect the acceleration magnitude in three coordinate axes of a coordinate system established by the terminal 1000.
[0368] The gyroscope sensor 1012 can detect the body orientation and rotation angle of the terminal 1000. The gyroscope sensor 1012 can cooperate with the acceleration sensor 1011 to collect the 3D motion of the user with respect to the terminal 1000.
[0369] The pressure sensor 1013 can be disposed on the side frame of the terminal 1000 and / or the lower layer of the display screen 1005. When the pressure sensor 1013 is disposed on the side frame of the terminal 1000, the pressure sensor 1013 can detect the holding signal of the user with respect to the terminal 1000. The processor 1001 can perform left-hand or right-hand recognition or a shortcut operation based on the holding signal collected by the pressure sensor 1013. When the pressure sensor 1013 is disposed on the lower layer of the display screen 1005, the processor 1001 can control the operable control on the UI interface based on the pressure operation of the user with respect to the display screen 1005.
[0370] The fingerprint sensor 1014 is used to collect the fingerprint of the user. The processor 1001 can identify the identity of the user based on the fingerprint collected by the fingerprint sensor 1014, or the fingerprint sensor 1014 can identify the identity of the user based on the collected fingerprint.
[0371] The optical sensor 1015 is used to collect the ambient light intensity. In one embodiment, the processor 1001 can control the display brightness of the display screen 1005 based on the ambient light intensity collected by the optical sensor 1015.
[0372] The proximity sensor 1016 is used to collect the distance between the user and the front of the terminal 1000.
[0373] Those skilled in the art can understand that the structure shown in the above embodiments is not a limitation on the terminal 1000, and the terminal 1000 can include more or fewer components than those shown in the drawings, or combine certain components, or use different component arrangements. Figure 10 The structure shown in the above embodiments is not a limitation on the terminal 1000, and the terminal 1000 can include more or fewer components than those shown in the drawings, or combine certain components, or use different component arrangements.
[0374] The computer device can also be implemented as a server. The structure of the server is described below.
[0375] Figure 11 FIG. 11 is a structural diagram of a server according to an embodiment of the present application. The server 1100 can have great differences due to different configurations or performances, and can include one or more processors (CPUs) 1101 and one or more memories 1102. The one or more memories 1102 store at least one computer program, which is loaded and executed by the one or more processors 1101 to implement the method provided by the above-mentioned various method embodiments. Of course, the server 1100 can also have a wired or wireless network interface, a keyboard, an input and output interface, and other components for implementing device functions, and the like, so as to perform input and output. The server 1100 can also include other components for implementing device functions, which are not described herein.
[0376] In exemplary embodiments, a computer-readable storage medium, such as a memory including a computer program, is also provided. The computer program can be executed by a processor to complete the media resource management method or the media resource generation method in the above-mentioned embodiments. For example, the computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, and an optical data storage device, etc.
[0377] In exemplary embodiments, a computer program product or computer program is also provided. The computer program product or computer program includes program code stored in a computer-readable storage medium. A processor of a computer device reads the program code from the computer-readable storage medium, and executes the program code. The processor executes the program code to cause the computer device to perform the above-mentioned media resource management method or media resource generation method.
[0378] In some embodiments, the computer program related to the embodiments of the present application can be deployed to execute on one computer device, or on multiple computer devices located in one place, or on multiple computer devices distributed in multiple places and interconnected through a communication network, which can constitute a blockchain system.
[0379] Those skilled in the art can understand that all or part of the steps of the above-mentioned embodiments can be completed by hardware, or can be instructed by a program to instruct related hardware to complete, and the program can be stored in a computer readable storage medium. The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.
[0380] The above is only an optional embodiment of the present application, and is not used to limit the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.
Claims
1. A media resource management system, characterized by The system comprises a label generation module, a material division module and a media resource editing module; The label generation module is configured to perform content recognition on a plurality of media materials to obtain a plurality of material labels, each of which corresponds to a media material, and the material label is used to indicate the material content of the corresponding media material; The material division module is configured to divide the plurality of media materials into a plurality of media material sets according to the material types of the plurality of media materials and the plurality of material labels, each of the media material sets comprising at least two media materials of different types, the material labels of the at least two media materials of different types satisfying a target condition, and the material types comprising at least two of the following: media material, audio material and text material; The media resource editing module is configured to determine a plurality of target media material sets from the plurality of media material sets in response to a selection instruction for the plurality of media material sets, and generate a media resource based on the plurality of target media material sets.
2. The system of claim 1, wherein, The media resource editing module is configured to send the plurality of target media material sets to a media resource editing client, and the media resource editing client is configured to import the plurality of target media material sets into an engineering file of the media resource; The media resource is generated based on the engineering file.
3. The system of claim 2, wherein, The media resource editing client is configured to use a clip tool to clip the plurality of media material sets in the engineering file to obtain a plurality of clipped media material sets; The plurality of clipped media material sets are spliced to obtain the media resource.
4. The system of claim 2, wherein, The media resource editing module is further configured to transcode the plurality of media material sets in the engineering file to obtain a plurality of proxy media material sets corresponding to the plurality of media material sets in the engineering file respectively, and the occupied space of each proxy media material set is lower than that of the corresponding media material set in the engineering file; The plurality of proxy media material sets are sent to the media resource editing client, and the media resource editing client imports the plurality of proxy media material sets into the engineering file, and generates the media resource based on the plurality of proxy media material sets and the plurality of media material sets in the engineering file.
5. The system of claim 4, wherein, The media resource editing client is further configured to clip the plurality of proxy media material sets to obtain a plurality of clipped proxy media material sets, and splice the plurality of clipped proxy media material sets to obtain a proxy media resource; In response to a determination instruction for the proxy media resource, the plurality of media material sets in the engineering file are clipped using the clipping manner of the plurality of proxy media material sets to obtain a plurality of clipped media material sets; The plurality of clipped media material sets are spliced to obtain the media resource.
6. The system of claim 2, wherein, The media resource editing module is configured to execute the step of sending the plurality of target media material sets to the media resource editing client in response to the account logged into the system having engineering editing permission for the engineering file.
7. The system of claim 1, wherein, The label generation module is configured to perform feature extraction on the plurality of media materials respectively to obtain material features of each of the media materials. Based on the material features of the plurality of media materials and a plurality of reference material features stored in a media material library, the plurality of material labels is obtained, and each of the reference material features corresponds to a media material in the media material library.
8. The system of claim 7, wherein, The label generation module is configured to obtain a similarity between the material feature of any media material in the plurality of media materials and the plurality of reference material features, and in response to the similarity between any reference material feature and the material feature of the any media material meeting a feature similarity condition, determine a material label of a media material corresponding to the any reference material feature as a material label of the any media material.
9. The system of claim 1, wherein, The label generation module is further configured to obtain a supplementary label of any media material in the plurality of media materials, the supplementary label being a material label published by an account registered in the system, and determine the supplementary label and the material label of the any media material as a material label set of the any media material.
10. The system of claim 1, wherein, The label generation module is further configured to, in response to a material label update request for any media material in the plurality of media materials, update the material label of the any media material with a material label corresponding to the material label update request.
11. The system of claim 1, wherein, The label generation module is further configured to perform any of the following: perform content identification on the plurality of resource segments of the media resource to obtain a plurality of segment labels respectively corresponding to the plurality of resource segments; perform content identification on the media resource to obtain a resource label of the media resource.
12. A media resource management method, characterized by, The method comprises: performing content identification on a plurality of media materials to obtain a plurality of material labels, each of the material labels corresponding to a media material, and the material label being used to indicate a material content of the corresponding media material; dividing the plurality of media materials into a plurality of media material sets according to material types of the plurality of media materials and the plurality of material labels, each of the media material sets including at least two media materials of different types, the material labels of the at least two media materials of different types meeting a target condition, and the material types including at least two of the following: media material, audio material, and text material; in response to a selection instruction for the plurality of media material sets, determining a plurality of target media material sets selected from the plurality of media material sets, and generating a media resource based on the plurality of target media material sets.
13. A media resource generation method, characterized by, The method comprises: in response to obtaining any media material, obtaining a material label of the media material; According to the material tag, a media material set to which the media material belongs is determined, the media material set including at least one media material corresponding to the material tag, the media material set being obtained by dividing a plurality of media materials according to material types of the plurality of media materials and a plurality of material tags, each media material set including at least two media materials of different types, material tags of the at least two media materials of different types satisfying a target condition, the material types including at least two of the following: media material, audio material, and text material; Based on the media material set and the media material, a media resource is generated.
14. A computer device, comprising: The computer device includes one or more processors and one or more memories, the one or more memories storing at least one computer program, the computer program being loaded and executed by the one or more processors to implement the media resource management method of claim 12 or the media resource generation method of claim 13.
15. A computer-readable storage medium, characterized in that, The computer readable storage medium stores at least one computer program, the computer program being loaded and executed by the processor to implement the media resource management method of claim 12 or the media resource generation method of claim 13.
Citation Information
Patent Citations
Creative material searching method and device based on creative labels
CN110232131A
Multimedia object arrangement method and device, electronic equipment and storage medium
CN112099709A