Audio and video transmission processing method and device, electronic equipment and storage medium

Abstract

The invention provides an audio and video transmission processing method and apparatus, an electronic device and a storage medium. The method comprises the steps of obtaining a target audio and video function keyword; selecting a specified audio and video processing standardized function part based on the target audio and video function keyword; performing streaming transmission configuration on the audio and video processing standardization function part to complete a processing task of target audio and video transmission; and dynamically adjusting the computing power resource of each computing power server based on the demand of the processing task. According to the invention, by inputting the function keyword of the target audio / video, the configuration of streaming transmission and audio / video regeneration functions is completed, the flexible customization of the functions is realized, and the requirements of different users are met. Standardized function parts are configured at will in the audio and video transmission processing process, so that the whole processing process is more standardized, and the processing stability and reliability are improved. And the number of the computing power servers is dynamically adjusted according to actual task processing requirements, so that resources are optimized.

Description

Technical Field

[0001] The present invention relates to the technical field of audio and video processing, and in particular to a processing method, device, electronic device and computer-readable storage medium for audio and video transmission. Background Art

[0002] The development of audio and video-based applications can be divided into standard modules, mainly including acquisition, encoding, mixing, separation, decoding and output. Video data has a fixed flow in these modules, just like water flowing in a pipe. Different audio and video manufacturers will provide their software development kits (SDKs), including these standard modules. During development, these modules need to be connected to form a complete "pipeline". Obviously, developing such a huge pipeline system each time is a repetitive and useless task.

[0003] In the related technology, when developing applications based on the audio and video software development toolkit SDK provided by video manufacturers, it is necessary to conduct detailed and in-depth research and development work on the complete flow process of video data (such as audio and video encoding and decoding, packaging and transmission, etc.). This process not only involves complex technical details, but also requires a high degree of accuracy and stability. Therefore, the application of the development toolkit SDK is relatively complex and time-consuming. The developed toolkit SDK cannot meet the needs of other users, reduces the flexibility of audio and video software configuration, and wastes resources.

[0004] Therefore, how to achieve standardized configuration in the audio and video transmission process and improve resource optimization is a technical problem that needs to be solved. Summary of the invention

[0005] The present invention provides a method, device, electronic device and storage medium for processing audio and video transmission, so as to at least solve the problem in the related art that the development of audio and video software development kit is complicated and time-consuming, resulting in reduced flexibility in audio and video software configuration and waste of resources. The technical solution of the present invention is as follows:

[0006] According to a first aspect of an embodiment of the present invention, a method for processing audio and video transmission is provided, including:

[0007] Get the target audio and video function keywords;

[0008] Selecting a specified audio and video processing standardized function based on the target audio and video function keyword;

[0009] Performing streaming transmission configuration on the audio and video processing standardized functional component to complete the processing task of the target audio and video transmission;

[0010] Based on the requirements of the processing tasks, the computing resources of each computing server are dynamically adjusted.

[0011] Optionally, the selecting a specified audio and video processing standardized function component based on the target audio and video function keyword includes:

[0012] Based on the target audio and video function keywords, automatically select appropriate audio and video processing standardized function components from a standardized function component library; or

[0013] Based on the target audio and video function keywords, the audio and video processing standardized function components in the standardized function component library are recommended to the user; in response to the user's selection operation instruction, the appropriate audio and video processing standardized function components are selected for the user from the recommended audio and video processing standardized function components.

[0014] Optionally, the step of performing streaming configuration on the audio and video processing standardization functional component to complete the processing task of the target audio and video transmission includes:

[0015] The audio and video processing standardized functional components are combined in the order of audio and video transmission to complete the processing task of the target audio and video transmission.

[0016] Optionally, dynamically adjusting the computing resources of each computing server based on the demand of the processing task includes:

[0017] Based on the requirements of the processing task, the number of instances of the corresponding computing power server is dynamically increased or decreased to achieve the computing power resources required by the processing task.

[0018] Optionally, before obtaining the target audio and video function keyword, the method further includes:

[0019] A standardized functional component library is pre-built, and the standardized functional component library includes: various standardized functional modules, and the standardized functional modules include: functional modules of various links in the audio and video processing process.

[0020] Optionally, before obtaining the target audio and video function keyword, the method further includes:

[0021] Multiple computing servers are pre-configured, where each computing server is a physical server or a virtual server, and each computing server runs independently, or multiple computing servers run in combination.

[0022] Optionally, when dynamically adjusting the computing resources of each computing server, the method further includes:

[0023] Based on the progress of the processing task, the combination of each functional module in the audio and video processing standardized functional component is dynamically adjusted.

[0024] According to a second aspect of an embodiment of the present invention, there is provided a processing device for audio and video transmission, including:

[0025] An acquisition module is used to obtain target audio and video function keywords;

[0026] A selection module, used for selecting a specified audio and video processing standardized function component based on the target audio and video function keyword;

[0027] A first configuration module is used to perform streaming transmission configuration on the audio and video processing standardized functional component to complete the processing task of the target audio and video transmission;

[0028] The first adjustment module is used to dynamically adjust the computing resources of each computing server based on the requirements of the processing task.

[0029] Optionally, the selection module includes: a first selection module; and / or a recommendation module and a second selection module, wherein:

[0030] The first selection module is used to automatically select appropriate audio and video processing standardized function components from a standardized function component library based on the target audio and video function keywords;

[0031] The recommendation module is used to recommend the audio and video processing standardized function components in the standardized function component library to the user based on the target audio and video function keywords;

[0032] The second selection module is used to respond to the user's selection operation instruction and select a suitable audio and video processing standardized functional component from the recommended audio and video processing standardized functional components for the user.

[0033] Optionally, the configuration module is specifically used to combine the audio and video processing standardized functional components according to the order of audio and video transmission to complete the processing task of the target audio and video transmission.

[0034] Optionally, the first adjustment module is specifically used to dynamically increase or decrease the number of instances of the corresponding computing power server based on the requirements of the processing task, so as to achieve the computing power resources required by the processing task.

[0035] Optionally, the device further comprises:

[0036] The construction module is used to pre-construct a standardized function component library before the acquisition module acquires the target audio and video function keywords. The standardized function component library includes: various standardized function modules, and the standardized function modules include: function modules of various links in the audio and video processing process.

[0037] Optionally, the device further comprises:

[0038] The second configuration module is used to pre-configure multiple computing servers before the acquisition module acquires the target audio and video function keywords, wherein each computing server is a physical server or a virtual server, and each computing server runs independently, or multiple computing servers run in combination.

[0039] Optionally, the device further comprises:

[0040] The second adjustment module is used to dynamically adjust the combination of each functional module in the audio and video processing standardized functional component based on the progress of the processing task when the first adjustment module dynamically adjusts the computing resources of each computing server.

[0041] According to a third aspect of an embodiment of the present invention, there is provided an electronic device, including:

[0042] processor;

[0043] a memory for storing instructions executable by the processor;

[0044] The processor is configured to execute the instructions to implement the audio and video transmission processing method as described above.

[0045] According to a fourth aspect of an embodiment of the present invention, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the processing method for audio and video transmission as described above.

[0046] According to a fifth aspect of an embodiment of the present invention, there is provided a computer program product, comprising a computer program or instructions, wherein when the computer program or instructions are executed by a processor of an electronic device, the processing method for audio and video transmission as described above is performed.

[0047] The technical solution provided by the embodiments of the present invention brings at least the following beneficial effects:

[0048] In an embodiment of the present invention, a target audio and video function keyword is obtained; a designated audio and video processing standardized function component is selected based on the target audio and video function keyword; the audio and video processing standardized function component is configured for streaming transmission to complete the processing task of the target audio and video transmission; and based on the requirements of the processing task, the computing power resources of each computing power server are dynamically adjusted. In other words, the embodiment of the present invention completes the configuration of the streaming transmission and audio and video playback functions by inputting the target audio and video function keyword, thereby achieving flexible customization of functions and meeting the needs of different users. The standardized function components in the audio and video transmission processing process are arbitrarily configured, making the entire processing process more standardized and improving the stability and reliability of the processing. According to the requirements of the actual processing tasks, the number and configuration of the computing power servers can be dynamically adjusted to achieve optimal utilization of resources and avoid waste of resources.

[0049] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present invention, and are used together with the specification to explain the principles of the present invention, and do not constitute an improper limitation of the present invention. In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings required for use in the embodiments or the prior art description will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0051] Figure 1 It is a flow chart of a processing method for audio and video transmission provided by an embodiment of the present invention.

[0052] Figure 2 This is another flow chart of a method for processing audio and video transmission provided by an embodiment of the present invention.

[0053] Figure 3 It is a block diagram of a processing device for audio and video transmission provided by an embodiment of the present invention.

[0054] Figure 4 It is a block diagram of a selection module provided by an embodiment of the present invention.

[0055] Figure 5 This is another block diagram of a processing device for audio and video transmission provided by an embodiment of the present invention.

[0056] Figure 6 This is another block diagram of a processing device for audio and video transmission provided by an embodiment of the present invention.

[0057] Figure 7 This is another block diagram of an audio and video transmission processing device provided by an embodiment of the present invention.

[0058] Figure 8 It is a block diagram of an electronic device provided by an embodiment of the present invention.

[0059] Fig. 9 The invention is a block diagram of a device for processing audio and video transmission provided by an embodiment of the invention. DETAILED DESCRIPTION

[0060] In order to enable ordinary persons in the art to better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings.

[0061] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0062] Figure 1 is a flowchart of a method for processing audio and video transmission provided by an embodiment of the present invention, such as Figure 1 As shown, the method comprises the following steps:

[0063] Step 101: Obtain target audio and video function keywords.

[0064] Step 102: Selecting a designated audio and video processing standardized function based on the target audio and video function keyword.

[0065] Step 103: Perform streaming transmission configuration on the audio and video processing standardization function component to complete the processing task of the target audio and video transmission.

[0066] Step 104: Dynamically adjust the computing resources of each computing server based on the requirements of the processing task.

[0067] The processing method for audio and video transmission described in the present invention can be applied to terminals, servers, etc., without limitation herein. The terminal implementation device can be electronic devices such as smart phones, laptops, tablet computers, desktop computers, personal digital assistants (PDAs) and wearable devices. The server can be an independent server or a server cluster, or a server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, intermediate services, domain name services, security services, content distribution networks, or big data and artificial intelligence platforms, etc., without limitation herein.

[0068] Combine the following Figure 1 , the specific implementation steps of a processing method for audio and video transmission provided by an embodiment of the present invention are described in detail.

[0069] In step 101, a target audio and video function keyword is obtained.

[0070] In this step, the user can input the function keyword of the target audio and video through the terminal interface, that is, the system or the server obtains the function keyword of the target audio and video input by the user, wherein the function keyword may include one or more of: resolution, frame rate, encoding format, decoding and transmission format, etc. Of course, other function keywords of the target audio and video may be included according to the specific application scenario, and this embodiment does not limit it.

[0071] In step 102, a designated audio and video processing standardized function is selected based on the target audio and video function keyword.

[0072] In this step, one situation is that based on the target audio and video function keywords, the system or the server automatically selects appropriate audio and video processing standardized function components from the standardized function component library.

[0073] In this way, the system or server automatically selects appropriate audio and video processing standardized function components from the standardized function component library based on the obtained function keywords of the target audio and video and according to the application scenario strategy corresponding to the function keywords.

[0074] Another situation is: based on the functional keywords of the target audio and video, the standardized audio and video processing functional components in the standardized functional component library are recommended to the user; in response to the user's selection operation instructions, the appropriate audio and video processing standardized functional components are selected for the user from the recommended audio and video processing standardized functional components.

[0075] In this way, the system or server recommends standardized audio and video processing functional components in the standardized functional component library to users based on the functional keywords of the target audio and video, that is, displays the standardized audio and video processing functional components to users, and users can input and select operation instructions based on the needs of the functional keywords of the target audio and video. The system or server selects appropriate audio and video processing standardized functional components for the user from the displayed audio and video processing standardized functional components according to the user's selection operation instructions.

[0076] In step 103, the audio and video processing standardization function is configured for streaming transmission to complete the processing task of the target audio and video transmission.

[0077] In this step, the audio and video processing standardized functional parts can be combined in the order of audio and video transmission to complete the processing task of the target audio and video transmission. That is, the system or the server will automatically select the appropriate functional module from the standardized functional parts library according to the functional keywords of the target audio and video input by the user, and then combine the selected functional models in the order of audio and video transmission to complete the processing task of the target audio and video.

[0078] For example, the user can enter the function keyword of the target audio and video through the web interface (that is, the resolution of the audio and video that the user wants to process is 1080P, the frame rate is 60fps, the encoding format is H.264, etc.). After that, the system automatically selects the appropriate function module in the standardized function component for audio and video processing from the standardized function component library based on the keyword.

[0079] In step 104, based on the requirements of the processing tasks, the computing resources of each server are dynamically adjusted.

[0080] In this step, based on the requirements of the processing task, the number of computing servers is dynamically increased or decreased to achieve the computing resources required for the processing task. For example, if the current target audio and video processing task requires a large amount of computing resources, the system or server will automatically increase the number of computing server instances to meet the processing task requirements.

[0081] Furthermore, while the system or service automatically increases the number of instances of the computing server to meet the processing task requirements, the system or service can also dynamically adjust the combination of functional modules according to the progress of the processing task to optimize processing efficiency.

[0082] It should be noted that computing power is the ability of servers in a data center to process data and output results.

[0083] The key point of computing server is computing power, which means a server with strong computing power. The hardware equipment of computing server will be better, and the data processing and storage capabilities will be stronger. Therefore, it is widely used in artificial intelligence, deep learning, robotics and other fields.

[0084] In an embodiment of the present invention, a target audio and video function keyword is obtained; a designated audio and video processing standardized function component is selected based on the target audio and video function keyword; the audio and video processing standardized function component is configured for streaming transmission to complete the processing task of the target audio and video transmission; and based on the requirements of the processing task, the computing power resources of each computing power server are dynamically adjusted. In other words, the embodiment of the present invention completes the configuration of the streaming transmission and audio and video playback functions by inputting the target audio and video function keyword, thereby achieving flexible customization of functions and meeting the needs of different users. The standardized function components in the audio and video transmission processing process are arbitrarily configured, making the entire processing process more standardized and improving the stability and reliability of the processing. According to the requirements of the actual processing tasks, the number and configuration of the computing power servers can be dynamically adjusted to achieve optimal utilization of resources and avoid waste of resources.

[0085] Optionally, in another embodiment, based on the above implementation, before obtaining the target audio and video function keywords, the method may also include: pre-constructing standardized functional parts, the standardized functional parts include: various standardized functional modules, the standardized functional modules include: functional modules of each link in the audio and video processing process; storing the constructed standardized functional parts in the standardized functional parts library.

[0086] In this embodiment, to construct a standardized functional component library, it is necessary to construct a library including various standardized functional modules, which may include various links in the audio and video processing process, such as compression, encoding, decoding, transmission, etc. These functional modules can run independently or in combination to meet different needs. Afterwards, the constructed standardized functional components are stored in the standardized functional component library. For example, a folder named "Audio and Video Processing Functional Component Library" can be created, which is divided into subfolders such as "Compression Module", "Encoding Module", "Decoding Module", and "Transmission Module", and each subfolder contains multiple functional modules.

[0087] In another embodiment, based on the above implementation, before obtaining the target audio and video function keywords, the method may also include: pre-configuring multiple computing servers, wherein each computing server is a physical server or a virtual server, and each computing server operates independently, or multiple computing servers operate in combination.

[0088] In this embodiment, multiple computing servers are preconfigured, and these computing servers can be physical servers or virtual servers. Each computing server can run independently or in combination with other computing servers. Each computing server can select appropriate functional modules from the standardized functional component library as needed, and automatically combine them to complete the audio and video processing tasks. For example, in this embodiment, Amazon EC2 service can be used to create multiple instances as computing servers, but it is not limited to this in specific applications.

[0089] This embodiment configures multiple computing servers so that each computing server automatically combines to complete the processing functions of various standardized audio and video functional modules, greatly improving processing efficiency and reducing the need for manual intervention.

[0090] See also Figure 2 , is another flow chart of a method for processing audio and video transmission provided by an embodiment of the present invention, specifically comprising:

[0091] Step 201: construct a standardized functional component library, wherein the standardized functional component library includes: various standardized functional modules, and the standardized functional modules include: functional modules of various links in the audio and video processing process.

[0092] In this step, it is necessary to build a library containing various standardized functional modules, which is called a standardized functional component library in this embodiment. These standardized functional modules can be various links in the audio and video processing process, such as compression, encoding, decoding, transmission, etc. These standardized functional modules can run independently or in combination to meet different needs. For example, a folder named "Audio and Video Processing Function Component Library" can be created, which is divided into subfolders such as "Compression Module", "Encoding Module", "Decoding Module", and "Transmission Module", and each subfolder contains multiple standardized functional modules.

[0093] Step 202: Pre-configure multiple computing servers, where each computing server is a physical server or a virtual server, and each computing server runs independently, or multiple computing servers run in combination.

[0094] In this step, multiple computing servers need to be pre-configured. These computing servers can be physical servers or virtual servers. Each server can run independently or in combination with other servers. For example, Amazon EC2 service can be used to create multiple instances as computing servers in this embodiment.

[0095] Of course, in this embodiment, the server can also be configured according to each functional module in the standardized functional component library.

[0096] Step 203: Based on the obtained function keywords of the target audio and video, select a standardized function component for audio and video processing from a standardized function component library.

[0097] After pre-building the standardized functional component library and pre-configuring multiple computing servers in step 201 and step 202, first, obtain the functional keywords of the target audio and video input by the user, and then automatically select appropriate audio and video processing standardized functional components from the standardized functional component library based on the functional keywords of the target audio and video.

[0098] Step 204: Perform streaming transmission configuration on the audio and video processing standardization function component to complete the processing task of the target audio and video transmission.

[0099] In this step, the user can configure the streaming and audio and video regeneration functions by inputting the function keywords of the target audio and video, such as resolution, frame rate, encoding format, etc. For example, the user can input the resolution of the audio and video they want to process as 1080P, the frame rate as 60fps, and the encoding format as H.264 through the web page interface. Based on the function keywords, the appropriate audio and video processing standardized function components are selected, and the audio and video processing standardized function components are streamed and configured to complete the processing task of the target audio and video transmission.

[0100] Step 205: Dynamically adjust the computing resources of each computing server based on the requirements of the processing task.

[0101] In the process of processing the processing task, the system will dynamically adjust the computing resources of each computing server according to the needs of the processing task. For example, if the processing task requires a large amount of computing resources, the system will automatically increase the number of server instances to meet the processing task requirements.

[0102] At the same time, the system will dynamically adjust the combination of functional modules according to the progress of processing tasks to optimize processing efficiency.

[0103] The above are the specific operation steps of this embodiment. Through the above method, effective management and control of the audio and video transmission processing process can be achieved, the processing efficiency can be improved, and various needs of users can be met.

[0104] Embodiments of the present invention can be applied in the fields of audio and video processing, live webcasting, online education, telemedicine, virtual reality, etc. First, by configuring multiple computing servers, this technical solution can realize any combination of standardized functional parts in the audio and video transmission processing process, which will greatly improve the efficiency and flexibility of audio and video processing, and meet the market demand for efficient and flexible audio and video processing. Secondly, this technical solution can complete the configuration of streaming and audio and video playback functions by inputting functional keywords of the target audio and video, which will greatly simplify the user's operation, reduce the user's difficulty of use, and improve the user experience, meeting the market demand for simple and easy-to-use audio and video processing products. Finally, the application of this technical solution can effectively solve the standardization problem in the audio and video transmission processing process, improve the quality and stability of audio and video, and meet the market demand for high-quality audio and video.

[0105] It should be noted that, for the method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should know that this implementation disclosure is not limited by the order of the actions described, because according to the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the present invention.

[0106] For ease of understanding, in this embodiment, the application of audio and video data can be imagined as a water pipe in a home. The data flows from the "source water pipe" (collection), through the "filter water pipe" (processing), and to the "destination water pipe" (display). This is the simplest example.

[0107] In this example, the "source water pipe" belongs to the data producer. Its output end in the pipeline is valid and can be connected to the next section of the water pipe. The "end water pipe" belongs to the data consumer. Its input end in the pipeline is valid and can only be connected to the previous section of the water pipe. The "filter water pipe" is responsible for processing data output and has both input and output. When developing an embodiment of the present invention, it is only necessary to develop the audio and video function modules into the above three types of "water pipes" and add them to the framework. Streaming computing spreads a large amount of data over each time point and continuously transmits small batches of data. The data continues to flow and is discarded after calculation.

[0108] See also Figure 3 , is a block diagram of a processing device for audio and video transmission provided by an embodiment of the present invention, the device comprises: an acquisition module 301, a selection module 302, a first configuration module 303 and a first adjustment module 304, wherein,

[0109] An acquisition module 301 is used to acquire target audio and video function keywords;

[0110] A selection module 302 is used to select a specified audio and video processing standardized function based on the target audio and video function keyword;

[0111] The first configuration module 303 is used to perform streaming transmission configuration on the audio and video processing standardization function component to complete the processing task of the target audio and video transmission;

[0112] The first adjustment module 304 is used to dynamically adjust the computing resources of each computing server based on the requirements of the processing task.

[0113] Optionally, in another embodiment, based on the above embodiment, the selection module 302 includes: a first selection module 401; and / or a recommendation module 402 and a second selection module 403, and its structural block diagram is as follows: Figure 4 As shown, Figure 4 Taking the same time as an example,

[0114] The first selection module 401 is used to automatically select appropriate audio and video processing standardized function components from a standardized function component library based on the target audio and video function keywords;

[0115] The recommendation module 402 is used to recommend the audio and video processing standardized function components in the standardized function component library to the user based on the target audio and video function keywords;

[0116] The second selection module 403 is used to respond to the user's selection operation instruction and select a suitable audio and video processing standardized functional component from the recommended audio and video processing standardized functional components for the user.

[0117] Optionally, in another embodiment, based on the above embodiment, the configuration module is specifically used to combine the audio and video processing standardized functional components according to the order of audio and video transmission to complete the processing task of the target audio and video transmission.

[0118] Optionally, in another embodiment, based on the above embodiment, the first adjustment module is specifically used to dynamically increase or decrease the number of instances of the corresponding computing power server based on the requirements of the processing task, so as to achieve the computing power resources required by the processing task.

[0119] Optionally, in another embodiment, based on the above embodiment, the device further includes: a construction module 501, whose structural block diagram is as follows: Figure 5 As shown,

[0120] The construction module 501 is used to pre-construct a standardized function component library before the acquisition module 301 acquires the target audio and video function keywords. The standardized function component library includes: various standardized function modules, and the standardized function modules include: function modules of various links in the audio and video processing process.

[0121] Optionally, in another embodiment, based on the above embodiment, the device further includes: a second configuration module 601, whose structural block diagram is as follows: Figure 6 As shown,

[0122] The second configuration module 601 is used to pre-configure multiple computing servers before the acquisition module 301 acquires the target audio and video function keywords, wherein each computing server is a physical server or a virtual server, and each computing server runs independently, or multiple computing servers run in combination.

[0123] Optionally, in another embodiment, based on the above embodiment, the device further includes: a second adjustment module 701, whose structural block diagram is as follows: Figure 7 As shown, Figure 7 So Figure 6 For example,

[0124] The second adjustment module 701 is used to dynamically adjust the combination of each functional module in the audio and video processing standardized functional component based on the progress of the processing task when the first adjustment module 304 dynamically adjusts the computing resources of each computing server.

[0125] Optionally, an embodiment of the present invention further provides an electronic device, including:

[0126] processor;

[0127] a memory for storing instructions executable by the processor;

[0128] The processor is configured to execute the instructions to implement the audio and video transmission processing method as described above.

[0129] Optionally, an embodiment of the present invention further provides a computer-readable storage medium, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the processing method for audio and video transmission as described above.

[0130] Optionally, an embodiment of the present invention further provides a computer program product, including a computer program or instructions, which implement the above-mentioned processing method for audio and video transmission when executed by a processor of an electronic device.

[0131] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0132] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0133] Figure 8 800 is a block diagram of an electronic device 800 provided in an embodiment of the present invention. For example, the electronic device 800 may be a mobile terminal or a server, and the electronic device is a mobile terminal as an example for explanation in the embodiment of the present invention. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a message transceiver device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0134] Reference Figure 8 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0135] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0136] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0137] The power supply component 806 provides power to the various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

[0138] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0139] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0140] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0141] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0142] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G or 5G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0143] In an embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the processing method for audio and video transmission shown above.

[0144] In an embodiment, a computer-readable storage medium is also provided, and when the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device 800 can execute the processing method for audio and video transmission shown above. For example, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0145] In an embodiment, a computer program product is also provided, including a computer program or instructions. When the computer program or instructions are executed by the processor 820 of the electronic device 800, the electronic device 800 executes the above-mentioned audio and video transmission processing method.

[0146] Fig. 9 900 is a block diagram of a device 900 for processing audio and video transmission provided by an embodiment of the present invention. For example, the device 900 can be provided as a server. Fig. 9 , the apparatus 900 includes a processing component 922, which further includes one or more processors, and a memory resource represented by a memory 932 for storing instructions, such as an application, that can be executed by the processing component 922. The application stored in the memory 932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 922 is configured to execute the instructions to perform the above method.

[0147] The device 900 may also include a power supply component 926 configured to perform power management of the device 900, a wired or wireless network interface 950 configured to connect the device 900 to a network, and an input / output (I / O) interface 958. The device 900 may operate based on an operating system stored in the memory 932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or the like.

[0148] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed by the present invention. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0149] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A method for processing audio and video transmission, characterized in that: include: Get the target audio and video function keywords; Selecting a specified audio and video processing standardized function based on the target audio and video function keyword; Performing streaming transmission configuration on the audio and video processing standardized functional component to complete the processing task of the target audio and video transmission; Based on the requirements of the processing tasks, the computing resources of each computing server are dynamically adjusted.

2. The method for processing audio and video transmission according to claim 1, characterized in that: The step of selecting a specified audio and video processing standardized function based on the target audio and video function keyword includes: Based on the target audio and video function keywords, automatically select appropriate audio and video processing standardized function components from a standardized function component library; or Based on the target audio and video function keywords, the audio and video processing standardized functional components in the standardized functional component library are recommended to the user; in response to the user's selection operation instruction, the appropriate audio and video processing standardized functional components are selected for the user from the recommended audio and video processing standardized functional components.

3. The method for processing audio and video transmission according to claim 1, characterized in that: The step of configuring the audio and video processing standardized functional component in a streaming manner to complete the processing task of the target audio and video transmission includes: The audio and video processing standardized functional components are combined in the order of audio and video transmission to complete the processing task of the target audio and video transmission.

4. The method for processing audio and video transmission according to claim 1, characterized in that: The dynamically adjusting the computing resources of each computing server based on the requirements of the processing task includes: Based on the requirements of the processing task, the number of instances of the corresponding computing power server is dynamically increased or decreased to achieve the computing power resources required by the processing task.

5. The method for processing audio and video transmission according to any one of claims 1 to 4, characterized in that: Before obtaining the target audio and video function keyword, the method further includes: A standardized functional component library is pre-built, and the standardized functional component library includes: various standardized functional modules, and the standardized functional modules include: functional modules of various links in the audio and video processing process.

6. The method for processing audio and video transmission according to any one of claims 1 to 4, characterized in that: Before obtaining the target audio and video function keyword, the method further includes: Multiple computing servers are pre-configured, where each computing server is a physical server or a virtual server, and each computing server runs independently, or multiple computing servers run in combination.

7. The method for processing audio and video transmission according to any one of claims 1 to 4, characterized in that: When dynamically adjusting the computing resources of each computing server, the method further includes: Based on the progress of the processing task, the combination of each functional module in the audio and video processing standardized functional component is dynamically adjusted.

8. A processing device for audio and video transmission, characterized in that: include: An acquisition module is used to obtain target audio and video function keywords; A selection module, used for selecting a specified audio and video processing standardized function component based on the target audio and video function keyword; A first configuration module is used to perform streaming transmission configuration on the audio and video processing standardized functional component to complete the processing task of the target audio and video transmission; The first adjustment module is used to dynamically adjust the computing resources of each computing server based on the requirements of the processing task.

9. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the method for processing audio and video transmission as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method for processing audio and video transmission as described in any one of claims 1 to 7.

Images