Audio and video media transmission method, system, device and storage medium
By dividing audio and video media data segments at the sending end and selecting the transmission method according to the receiving end request and communication environment, the problem of insufficient audio and video transmission experience in the prior art is solved, and high-quality transmission in poor environments is achieved.
Patent Information
- Application Number
- CN202410543469.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-06
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2044-05-06
AI Technical Summary
Existing audio and video transmission technologies have failed to effectively improve the experience of watching audio and video media, especially when the data transmission environment is poor, which may lead to delay or quality degradation.
By dividing audio and video media data segments at the sending end, and selecting appropriate sending methods based on the request form and communication environment of the receiving end, we ensure timely and high-quality transmission of audio and video media data segments.
Even in a poor transmission environment, it is possible to select a suitable transmission method according to the request form of the receiver, thereby improving the viewing experience of audio and video media.
Smart Images

Figure CN118317127B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of audio and video transmission, and in particular relates to an audio and video media transmission method, system, equipment and storage medium. Background Art
[0002] With the continuous development of Internet technology, people's daily lives have become inseparable from audio and video media. How to improve the experience when watching audio and video media has become people's main concern.
[0003] The invention application with publication number CN117240417A discloses an audio and video transmission method and device, the method includes: in response to establishing a communication connection with a receiving end, obtaining audio and video data; adding redundant information to the encrypted or unencrypted audio and video data to prevent data frame loss and damage; sending the audio and video data with redundant information added to the receiving end. By adding redundant information to the encrypted or unencrypted audio and video data, the data frame loss and damage of the audio and video data can be effectively prevented, and the security and integrity of the transmission of audio and video data between the sending end and the receiving end can be improved. In addition, the invention application with publication number CN116436639A provides an audio and video data transmission method, a communication system, an electronic device and a computer-readable storage medium, the method includes: establishing a QUIC connection between the sending end and the receiving end; creating a transmission channel with different encryption strengths between the sending end and the receiving end for different data streams; using the sending end to send different data streams to the receiving end through the transmission channel with corresponding encryption strengths; using the receiving end to obtain the encryption strength of the transmission channel, and decrypting the data stream based on the encryption strength, so that data streams with different encryption strengths can be transmitted for different data streams. However, none of the above invention applications considers how to improve people's experience when watching audio and video media. Therefore, the present invention provides an audio and video media transmission method, system, device and storage medium. Summary of the invention
[0004] The present invention sets a sending end to store different audio and video media data segments, detailed information of different audio and video media data segments, and communication information. The present invention establishes a receiving end to send a request message to the sending end, indicating the required audio and video media data segments and the request form. The sending end selects different ways of sending the required audio and video media data segments to the receiving end according to different request forms. The present invention aims to enhance people's experience when watching audio and video media.
[0005] In order to achieve the above-mentioned object of the invention, the present invention provides an audio and video media transmission method as described below, which mainly includes the following steps:
[0006] The sending end collects audio and video media data, divides the audio and video media data into different audio and video media data segments for storage, wherein the audio and video media data segments include movies, audio, and pictures, and the sending end stores detailed information of the audio and video media data segments, and the sending end also stores communication information, wherein the communication information includes a specific communication address and a sending environment corresponding to the specific communication address;
[0007] The receiving end sends a request message to the sending end, wherein the request message includes the communication address of the receiving end, the audio and video media data segment required by the receiving end, and the request form of the receiving end regarding the required audio and video media data segment;
[0008] The sending end searches for the audio and video media data segments required by the receiving end among the different audio and video media data segments stored in the sending end according to the request message sent by the receiving end, and sends the audio and video media data segments required by the receiving end to the receiving end.
[0009] As a preferred technical solution of the present invention, the detailed information of the audio and video media data segment includes: a unique number corresponding to the audio and video media data segment, the appearance time of the video contained in the audio and video media data segment in the complete video, a feature picture corresponding to the video contained in the audio and video media data segment, the amount of data of the video contained in the audio and video media data segment per unit time, the amount of data of the audio contained in the audio and video media data segment per unit time, and the amount of data of the picture contained in the audio and video media data segment.
[0010] As a preferred technical solution of the present invention, the sending environment corresponding to the specific communication address refers to the amount of data transmitted per unit time through the communication path corresponding to the specific communication address.
[0011] As a preferred technical solution of the present invention, the request form includes a first request form and a second request form, wherein the first request form refers to enabling the sending end to send the audio and video media data segments in a timely manner, and the second request form refers to enabling the sending end to send the audio and video media data segments while giving priority to ensuring the display effect.
[0012] As a preferred technical solution of the present invention, when the request message includes the first request form, the sending end sends the audio and video media data segment required by the receiving end to the receiving end, including the following steps:
[0013] The sending end first calculates the value obtained by dividing the data volume of the picture contained in the audio and video media data segment by the time length of the movie contained in the audio and video media data segment, and then adds the data volume of the movie contained in the audio and video media data segment per unit time and the data volume of the audio contained in the audio and video media data segment per unit time to obtain the sending data volume;
[0014] The sending end determines the specific communication address corresponding to the communication address of the receiving end, determines whether the sending environment corresponding to the determined specific communication address can meet the sending data volume, and if so, sends the audio and video media data segment to the receiving end, otherwise, proceeds to the next step;
[0015] The sending end estimates the specific number of feature images corresponding to the movie contained in the audio and video media data segment that can be sent based on the sending environment corresponding to the determined specific communication address, recalculates the amount of data to be sent, and determines whether the sending environment corresponding to the determined specific communication address can meet the amount of data to be sent. If it can be met, the feature images corresponding to the movie contained in the audio and video media data segment, as well as the audio and images contained in the audio and video media data segment are sent to the receiving end. Otherwise, the step ends.
[0016] As a preferred technical solution of the present invention, when the request message includes the second request form, the sending end sends the audio and video media data segment required by the receiving end to the receiving end, including the following steps:
[0017] The sending end first calculates the value obtained by dividing the data volume of the picture contained in the audio and video media data segment by the time length of the movie contained in the audio and video media data segment, and then adds the data volume of the movie contained in the audio and video media data segment per unit time and the data volume of the audio contained in the audio and video media data segment per unit time to obtain the sending data volume;
[0018] The sending end determines the specific communication address corresponding to the communication address of the receiving end, determines whether the sending environment corresponding to the determined specific communication address can meet the sending data volume, and if so, sends the audio and video media data segment to the receiving end, otherwise, proceeds to the next step;
[0019] The sending end calculates the sum of the data volume of the movie contained in the audio and video media data segment per unit time and the data volume of the audio contained in the audio and video media data segment per unit time as the sending data volume, and determines whether the sending environment corresponding to the determined specific communication address can meet the sending data volume. If it can be met, the picture contained in the audio and video media data segment is sent first, and then the movie and audio contained in the audio and video media data segment are sent. Otherwise, the sending end sends the picture, movie, and audio contained in the audio and video media data segment to the receiving end in sequence.
[0020] As a preferred technical solution of the present invention, the sending end determines the characteristic picture corresponding to the movie contained in the audio and video media data segment, including the following steps:
[0021] The sending end calculates the degree of similarity between each picture and the remaining pictures based on all pictures in the film included in the audio and video media data segment, and determines different picture segments, wherein the degree of similarity between each picture in the picture segment and the previous and next pictures is greater than a preset threshold of the degree of similarity, and calculates the length values of the different picture segments;
[0022] The sending end calculates the average degree of similarity corresponding to each picture, which is the value obtained by dividing the sum of the degrees of similarity between each picture and the rest of the pictures by the total number of pictures, and uses the formula α i =H(x i )×(-d i ) calculates the first eigenvalue of each image, where α i is the first eigenvalue of the i-th image, H is the preset function, d i is the length of the image segment where the i-th image is located, x i is the average similarity of the i-th picture;
[0023] The sending end obtains the second eigenvalue of each picture, uses a weighted coefficient method to the first eigenvalue and the second eigenvalue of each picture to obtain a comprehensive eigenvalue of each picture, and sorts all pictures in descending order according to the comprehensive eigenvalues, and uses a specific number of pictures with the highest sorting as feature pictures.
[0024] The present invention also provides an audio and video media transmission system, comprising the following modules:
[0025] The sending end module is used to collect audio and video media data, divide the audio and video media data into different audio and video media data segments for storage, the audio and video media data segments include movies, audio, and pictures, and is used to store detailed information of the audio and video media data segments, and is also used to store communication information, the communication information includes a specific communication address, and a sending environment corresponding to the specific communication address, and is also used to search for the audio and video media data segments required by the receiving end module in the different audio and video media data segments stored in itself according to the request message sent by the receiving end module, and send the audio and video media data segments required by the receiving end module to the receiving end module;
[0026] The receiving module is used to send a request message to the sending module, where the request message includes the communication address of the receiving module, the audio and video media data segments required by the receiving module, and the request form of the receiving module for the required audio and video media data segments, and is used to display the audio and video media data segments sent by the sending module.
[0027] The present invention also provides a device, comprising a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to implement any one of the above-mentioned methods when executing the computer program.
[0028] The present invention also provides a storage medium, wherein the storage medium stores program instructions, wherein when the program instructions are executed, the device where the storage medium is located is controlled to execute any one of the above methods.
[0029] Compared with the prior art, the beneficial effects of the present invention are at least as follows:
[0030] In the present invention, first, the sending end collects audio and video media data, divides the audio and video media data into different audio and video media data segments for storage, and the sending end stores detailed information of the audio and video media data segments, and the sending end also stores communication information. Secondly, the receiving end sends a request message to the sending end, and the request message includes the communication address of the receiving end, the audio and video media data segments required by the receiving end, and the request form of the receiving end for the required audio and video media data segments. Finally, the sending end searches for the audio and video media data segments required by the receiving end according to the request message sent by the receiving end, and sends the audio and video media data segments required by the receiving end. Through the present invention, even if the sending environment cannot meet the initial data transmission volume, the sending end can also select a suitable method of sending the audio and video media data segments required by the receiving end according to the different request forms of the receiving end, thereby improving people's experience when watching audio and video media. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Figure 1 A flowchart of an audio and video media transmission method of the present invention;
[0032] Figure 2 The present invention is a structural diagram of an audio and video media transmission system. DETAILED DESCRIPTION
[0033] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0034] It is understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but unless otherwise specified, these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, without departing from the scope of this application, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script.
[0035] The present invention provides Figure 1 The audio and video media transmission method shown is mainly implemented by executing the following steps:
[0036] Step 1: The sending end collects audio and video media data, divides the audio and video media data into different audio and video media data segments for storage, the audio and video media data segments include movies, audio, and pictures, and the sending end stores detailed information of the audio and video media data segments, and the sending end also stores communication information, the communication information includes a specific communication address, and a sending environment corresponding to the specific communication address;
[0037] Step 2: The receiving end sends a request message to the sending end, where the request message includes the communication address of the receiving end, the audio and video media data segments required by the receiving end, and the request form of the receiving end for the required audio and video media data segments;
[0038] Step 3: The sending end searches for the audio and video media data segments required by the receiving end among the different audio and video media data segments stored in the sending end according to the request message sent by the receiving end, and sends the audio and video media data segments required by the receiving end to the receiving end.
[0039] Specifically, in order to enhance people's experience when watching audio and video media, the inventor mainly proposed steps 1 to 3. First, the sending end collects audio and video media data, and divides the audio and video media data into different audio and video media data segments for storage. The audio and video media data segments can include movies, audio, and pictures at the same time, that is, movies and pictures can be displayed simultaneously in different areas of a display screen at the receiving end, and audio can be played while the movie is playing. For example, the audio and video media data segments can be divided according to different scenes in the complete movie contained in the audio and video media data. The sending end also stores detailed information of the audio and video media data segments. The content and use of the detailed information will be introduced below. The sending end also stores communication information, and the communication information includes a specific communication address and a sending environment corresponding to the specific communication address. The meaning will be described below. It should be noted that the specific communication address here refers to the communication address segment, such as from 123.456.789.000 to 123.456.789.100. Secondly, the receiving end sends a request message to the sending end to obtain the required audio and video media data segments, wherein the request message includes its own communication address, the audio and video media data segments it needs, and its own request form for the required audio and video media data segments. The introduction to the request form will appear below. Finally, the sending end searches for the audio and video media data segments required by the receiving end in different audio and video media data segments stored in itself according to the request message sent by the receiving end, and sends the audio and video media data segments required by the receiving end to the receiving end. The detailed process of sending the audio and video media data segments required by the receiving end will be introduced below.
[0040] Furthermore, the detailed information of the audio and video media data segment includes: a unique number corresponding to the audio and video media data segment, an appearance time of the video contained in the audio and video media data segment in the complete video, a feature picture corresponding to the video contained in the audio and video media data segment, the amount of data of the video contained in the audio and video media data segment per unit time, the amount of data of the audio contained in the audio and video media data segment per unit time, and the amount of data of the picture contained in the audio and video media data segment.
[0041] Specifically, after the sender completes the division of different audio and video media data segments, it also generates a unique number for each audio and video media data segment, so that in the request message sent by the receiving end to the sending end, the required audio and video media data segment is indicated by specifying the unique number, and when the sender searches for different audio and video media data segments stored in itself, it is also done according to the unique number in the request message. In order to facilitate understanding of the appearance time of the movie contained in the audio and video media data segment in the complete movie, for example, the complete movie includes N pictures, and the movie contained in the first audio and video media data segment corresponds to 4 pictures, then the appearance time of the movie contained in this audio and video media data segment in the complete movie is 1, 2, 3, 4, and so on. The appearance time of the movie contained in other audio and video media data segments in the complete movie, compared with displaying other pictures corresponding to the movie contained in the audio and video media data segment, displaying the feature picture corresponding to the movie contained in the audio and video media data segment can convey more information to people and give people a better viewing experience. The method for determining the feature picture corresponding to the movie contained in the audio and video media data segment will be described below.
[0042] Furthermore, the sending environment corresponding to the specific communication address refers to the amount of data transmitted per unit time through the communication path corresponding to the specific communication address.
[0043] Specifically, people's experience when watching audio and video media is related to the detailed information of the audio and video media data segments stored by the sending end, and the sending environment corresponding to the specific communication address corresponding to the communication address of the receiving end. If the sending environment can meet the amount of sending data calculated based on the detailed information, the calculation method of the amount of sending data will be introduced below, and the receiving end can display the audio and video media data segments in a timely and high-quality manner. If the sending environment cannot meet the amount of sending data calculated based on the detailed information, the display screen of the receiving end may be delayed or even disconnected, or have low quality problems.
[0044] Furthermore, the request form includes a first request form and a second request form, wherein the first request form refers to enabling the sender to send the audio and video media data segments in a timely manner, and the second request form refers to enabling the sender to send the audio and video media data segments while giving priority to ensuring the display effect.
[0045] Specifically, by setting the request form in the request message sent by the receiving end to the sending end, people's different viewing needs can be met, thereby improving people's experience when watching audio and video media. The request form includes a first request form and a second request form. The first request form refers to enabling the sending end to send audio and video media data segments in a timely manner. That is to say, compared with the quality of the display picture of the receiving end, people want to watch the display picture of the receiving end in a timely manner. The second request form refers to enabling the sending end to send audio and video media data segments while giving priority to ensuring the display effect. That is, compared with watching the display picture of the receiving end in a timely manner, people pay more attention to the quality of the display picture of the receiving end. The first request form shortens people's waiting time, and the second request form enables people to watch higher quality pictures.
[0046] Furthermore, in the case where the request message includes the first request form, the sending end sends the audio and video media data segment required by the receiving end to the receiving end, including the following steps:
[0047] Step 1: The sender first calculates the value obtained by dividing the data volume of the picture contained in the audio and video media data segment by the time length of the movie contained in the audio and video media data segment, and then adds the data volume of the movie contained in the audio and video media data segment per unit time and the data volume of the audio contained in the audio and video media data segment per unit time to obtain the sending data volume;
[0048] Step 2: The sending end determines the specific communication address corresponding to the communication address of the receiving end, and determines whether the sending environment corresponding to the determined specific communication address can meet the sending data volume. If it can meet the requirements, the audio and video media data segment is sent to the receiving end. Otherwise, the next step is continued.
[0049] Step 3: The sending end estimates the specific number of feature images corresponding to the movie contained in the audio and video media data segment that can be sent based on the sending environment corresponding to the determined specific communication address, recalculates the amount of data to be sent, and determines whether the sending environment corresponding to the determined specific communication address can meet the amount of data to be sent. If so, the feature images corresponding to the movie contained in the audio and video media data segment, as well as the audio and images contained in the audio and video media data segment are sent to the receiving end. Otherwise, the step ends.
[0050] Specifically, in order to enable people to watch the display screen of the receiving end in time, in step 1, the sending end first calculates the value obtained by dividing the data amount of the picture contained in the audio and video media data segment by the time length of the movie contained in the audio and video media data segment. In order to understand the time length here, for example, the complete movie includes N pictures, and the movie contained in the first audio and video media data segment corresponds to 4 pictures, then the time length corresponding to this audio and video media data segment is 4, and then the data amount of the movie contained in the audio and video media data segment per unit time and the data amount of the audio contained in the audio and video media data segment per unit time are added to obtain the sending data. In step 2, the sending end determines the specific communication address corresponding to the communication address of the receiving end, and determines whether the sending environment corresponding to the determined specific communication address can meet the sending data volume. If it can, the audio and video media data segment is sent to the receiving end, that is, the film, audio, and picture contained in the audio and video media data segment are sent at the same time. Otherwise, continue to step 3. In step 3, the sending end estimates the specific number of feature pictures corresponding to the film contained in the audio and video media data segment that can be sent based on the sending environment corresponding to the determined specific communication address, recalculates the sending data volume, and determines the audio and video media data segment. The process of obtaining the feature pictures corresponding to the movie will be introduced below. In order to facilitate the understanding of the calculation process, for example, the sending environment is to send 210 bits of data per unit time, the movie contained in the audio and video media data segment corresponds to 4 pictures, the amount of data of the movie contained in the audio and video media data segment per unit time is 240 bits, the amount of data of the audio contained in the audio and video media data segment per unit time is 50 bits, and the amount of data of the pictures contained in the audio and video media data segment is 160 bits. The amount of data sent calculated in step 1 is 240+50+160 / 4=330. It can be seen that the sending environment cannot meet the amount of data sent. When the data amounts of the pictures corresponding to the movies contained in the video media data segment are the same, the estimated data amount when sending two feature pictures is (240 / 4)*2+50+160 / 4=210. At this time, the sending environment can meet the sending data amount. The sending end re-judges whether the sending environment corresponding to the determined specific communication address can meet the sending data amount. If it can, a specific number of feature pictures corresponding to the movie contained in the audio and video media data segment, as well as the audio and pictures contained in the audio and video media data segment are sent at the same time. Otherwise, the sending end considers that the audio and video media data segment cannot be transmitted and ends all the steps at the same time.
[0051] Furthermore, in the case where the request message includes the second request form, the sending end sends the audio and video media data segment required by the receiving end to the receiving end, including the following steps:
[0052] Step 1: The sender first calculates the value obtained by dividing the data volume of the picture contained in the audio and video media data segment by the time length of the movie contained in the audio and video media data segment, and then adds the data volume of the movie contained in the audio and video media data segment per unit time and the data volume of the audio contained in the audio and video media data segment per unit time to obtain the sending data volume;
[0053] Step 2: The sending end determines the specific communication address corresponding to the communication address of the receiving end, and determines whether the sending environment corresponding to the determined specific communication address can meet the sending data volume. If it can meet the requirements, the audio and video media data segment is sent to the receiving end. Otherwise, the next step is continued.
[0054] Step 3: The sending end calculates the amount of data of the movie contained in the audio and video media data segment per unit time, and the sum of the amount of data of the audio contained in the audio and video media data segment per unit time as the sending data amount, and determines whether the sending environment corresponding to the determined specific communication address can meet the sending data amount. If it can be met, the picture contained in the audio and video media data segment is sent first, and then the movie and audio contained in the audio and video media data segment are sent. Otherwise, the sending end sends the picture, movie, and audio contained in the audio and video media data segment to the receiving end in sequence.
[0055] Specifically, in order to ensure the quality of the display image at the receiving end that people watch, in step 1, the sending end calculates the amount of data to be sent. The calculation process here is the same as the calculation process described in step 1 above, so it will not be repeated. In step 2, the sending end determines the specific communication address corresponding to the communication address of the receiving end, and determines whether the sending environment corresponding to the determined specific communication address can meet the amount of data to be sent. If it can, the video, audio, and picture contained in the audio and video media data segment are sent at the same time. Otherwise, continue to step 3. The sending end calculates the amount of data per unit time of the video contained in the audio and video media data segment, and compares it with the audio and video media data segment. The sum of the audio data volume contained in the media data segment per unit time is taken as the sending data volume, and whether the sending environment corresponding to the determined specific communication address can meet the sending data volume is determined. If it can be met, the picture contained in the audio and video media data segment is sent first, and then the movie and audio contained in the audio and video media data segment are sent at the same time, so that the receiving end can display the picture first, and then play the movie and audio at the same time without additional waiting time. Otherwise, the sending end sends the picture, movie, and audio contained in the audio and video media data segment in sequence, so that the receiving end displays the picture first, and plays the movie and audio at the same time only after the movie and audio are received.
[0056] Furthermore, the sending end determines a feature picture corresponding to the movie contained in the audio and video media data segment, including the following steps:
[0057] Step 1: The sender calculates the degree of similarity between each picture and the remaining pictures based on all pictures in the movie contained in the audio and video media data segment, and determines different picture segments, where the degree of similarity between each picture in the picture segment and the previous and next pictures is greater than a preset threshold of the degree of similarity, and calculates the length values of different picture segments;
[0058] Step 2: The sender calculates the average similarity of each picture. The average similarity is the sum of the similarity between each picture and the rest of the pictures divided by the total number of pictures, and the formula α is used to calculate the average similarity of each picture. i =H(x i )×(-d i ) calculates the first eigenvalue of each image, where α i is the first eigenvalue of the i-th image, H is the preset function, d i is the length of the image segment where the i-th image is located, x i is the average similarity of the i-th picture;
[0059] Step 3: The sender obtains the second eigenvalue of each image, uses the weighted coefficient method for the first eigenvalue and the second eigenvalue of each image to obtain the comprehensive eigenvalue of each image, and sorts all images in descending order according to the comprehensive eigenvalue, and uses a specific number of images with the highest sorting as feature images.
[0060] Specifically, the process of determining the characteristic picture corresponding to the movie contained in the audio-video media data segment by the sending end is introduced. First, the sending end calculates the degree of similarity between each picture and the remaining pictures based on all the pictures in the movie contained in the audio-video media data segment. For example, the degree of similarity between the pictures can be calculated according to the color distribution, or other methods can be used for calculation, which is not limited. Then the sending end determines different picture segments, and the degree of similarity between each picture in the picture segment and the pictures before and after it is greater than the preset degree of similarity threshold, and calculates the length values of different picture segments, where the length value is the total number of pictures contained in the picture segment, wherein the degree of similarity threshold is set according to the actual application scenario. Secondly, the sending end calculates the average degree of similarity corresponding to each picture, and the average degree of similarity is the value obtained by dividing the sum of the degrees of similarity between each picture and the remaining pictures by the total number of pictures, and the sending end uses the formula α i =H(x i )×(-d i ) calculates the first eigenvalue of each image, where α i is the first eigenvalue of the i-th image, H is the preset function, d i is the length of the image segment where the i-th image is located, x i is the average similarity of the i-th picture, such as H(x i ) can be log10 (x i ), finally, the sending end obtains the second eigenvalue of each picture. For example, the second eigenvalue can be set according to the amount of information that the picture can convey. The more information that can be conveyed, the larger the corresponding second eigenvalue. It can also be set according to the wonderfulness of the picture. The higher the wonderfulness, the larger the corresponding second eigenvalue. The sending end uses the weighted coefficient method for the first eigenvalue and the second eigenvalue of each picture to obtain the comprehensive eigenvalue of each picture. The weights can be set for the first eigenvalue and the second eigenvalue of each picture according to the actual application scenario, and the sending end sorts all pictures in descending order according to the comprehensive eigenvalue, and takes a specific number of pictures with the highest sorting as feature pictures. The specific number here is the same as the specific number estimated above. The first eigenvalue of each picture obtained by considering the relationship between each picture and all pictures, and the feature pictures selected by the second eigenvalue of each picture obtained according to the wonderfulness or the amount of information that can be conveyed can provide people with a better visual experience.
[0061] According to another aspect of the embodiment of the present invention, Figure 2 As shown, an audio and video media transmission system is also provided, including a sending end module and a receiving end module, to implement an audio and video media transmission method described in the above content, wherein the functions of each module are as follows:
[0062] The sending end module is used to collect audio and video media data, divide the audio and video media data into different audio and video media data segments for storage, the audio and video media data segments include movies, audio, and pictures, and is used to store detailed information of the audio and video media data segments, and is also used to store communication information, the communication information includes a specific communication address, and a sending environment corresponding to the specific communication address, and is also used to search for the audio and video media data segments required by the receiving end module in the different audio and video media data segments stored in itself according to the request message sent by the receiving end module, and send the audio and video media data segments required by the receiving end module to the receiving end module;
[0063] The receiving module is used to send a request message to the sending module, where the request message includes the communication address of the receiving module, the audio and video media data segments required by the receiving module, and the request form of the receiving module for the required audio and video media data segments, and is used to display the audio and video media data segments sent by the sending module.
[0064] According to another aspect of an embodiment of the present invention, there is further provided a device, including a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to implement any one of the above methods when executing the computer program.
[0065] According to another aspect of an embodiment of the present invention, a storage medium is provided, wherein the storage medium stores program instructions, wherein when the program instructions are executed, a device where the storage medium is located is controlled to execute any one of the above methods.
[0066] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.
[0067] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The above-mentioned program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0068] The technical features of the above-mentioned embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above-mentioned embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0069] The above-mentioned embodiments only express several implementation methods of the present invention, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.
[0070] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. A method for transmitting audio and video media, characterized in that: The steps include: The sending end collects audio and video media data, divides the audio and video media data into different audio and video media data segments for storage, wherein the audio and video media data segments include movies, audio, and pictures, and the sending end stores detailed information of the audio and video media data segments, and the sending end also stores communication information, wherein the communication information includes a specific communication address and a sending environment corresponding to the specific communication address; The receiving end sends a request message to the sending end, wherein the request message includes the communication address of the receiving end, the audio and video media data segment required by the receiving end, and the request form of the receiving end regarding the required audio and video media data segment; The sending end searches for the audio and video media data segment required by the receiving end in different audio and video media data segments stored in the sending end according to the request message sent by the receiving end, and sends the audio and video media data segment required by the receiving end to the receiving end; The detailed information of the audio and video media data segment includes: a unique number corresponding to the audio and video media data segment, the appearance time of the video contained in the audio and video media data segment in the complete video, a feature picture corresponding to the video contained in the audio and video media data segment, the data volume of the video contained in the audio and video media data segment per unit time, the data volume of the audio contained in the audio and video media data segment per unit time, and the data volume of the picture contained in the audio and video media data segment; The sending end determines the characteristic picture corresponding to the movie contained in the audio and video media data segment, including the following steps: The sending end calculates the degree of similarity between each picture and the remaining pictures based on all pictures in the film included in the audio and video media data segment, and determines different picture segments, wherein the degree of similarity between each picture in the picture segment and the previous and next pictures is greater than a preset threshold of the degree of similarity, and calculates the length values of the different picture segments; The sending end calculates the average degree of similarity corresponding to each picture, and the average degree of similarity is the sum of the degrees of similarity between each picture and the rest of the pictures divided by the total number of pictures, and the formula is used Calculate the first eigenvalue of each image, where For the The first eigenvalue of the image, is the preset function, For the The length of the image segment where the image is located. For the The average similarity of the pictures; The sending end obtains the second eigenvalue of each picture, uses a weighted coefficient method to the first eigenvalue and the second eigenvalue of each picture to obtain a comprehensive eigenvalue of each picture, and sorts all pictures in descending order according to the comprehensive eigenvalues, and uses a specific number of pictures with the highest sorting as feature pictures.
2. The method according to claim 1, characterized in that: The sending environment corresponding to the specific communication address refers to the amount of data transmitted per unit time through the communication path corresponding to the specific communication address.
3. The method according to claim 2, characterized in that The request form includes a first request form and a second request form, wherein the first request form refers to enabling the sender to send the audio and video media data segment in a timely manner, and the second request form refers to enabling the sender to send the audio and video media data segment while giving priority to ensuring the display effect.
4. The method according to claim 3, characterized in that In the case where the request message includes the first request format, the sending end sends the audio and video media data segment required by the receiving end to the receiving end, including the following steps: The sending end first calculates the value obtained by dividing the data volume of the picture contained in the audio and video media data segment by the time length of the movie contained in the audio and video media data segment, and then adds the data volume of the movie contained in the audio and video media data segment per unit time and the data volume of the audio contained in the audio and video media data segment per unit time to obtain the sending data volume; The sending end determines the specific communication address corresponding to the communication address of the receiving end, determines whether the sending environment corresponding to the determined specific communication address can meet the sending data volume, and if so, sends the audio and video media data segment to the receiving end, otherwise, proceeds to the next step; The sending end estimates the specific number of feature images corresponding to the movie contained in the audio and video media data segment that can be sent based on the sending environment corresponding to the determined specific communication address, recalculates the amount of data to be sent, and determines whether the sending environment corresponding to the determined specific communication address can meet the amount of data to be sent. If it can be met, the feature images corresponding to the movie contained in the audio and video media data segment, as well as the audio and images contained in the audio and video media data segment are sent to the receiving end. Otherwise, the step ends.
5. The method according to claim 3, characterized in that: In the case where the request message includes the second request form, the sending end sends the audio and video media data segment required by the receiving end to the receiving end, including the following steps: The sending end first calculates the value obtained by dividing the data volume of the picture contained in the audio and video media data segment by the time length of the movie contained in the audio and video media data segment, and then adds the data volume of the movie contained in the audio and video media data segment per unit time and the data volume of the audio contained in the audio and video media data segment per unit time to obtain the sending data volume; The sending end determines the specific communication address corresponding to the communication address of the receiving end, determines whether the sending environment corresponding to the determined specific communication address can meet the sending data volume, and if so, sends the audio and video media data segment to the receiving end, otherwise, proceeds to the next step; The sending end calculates the sum of the data volume of the movie contained in the audio and video media data segment per unit time and the data volume of the audio contained in the audio and video media data segment per unit time as the sending data volume, and determines whether the sending environment corresponding to the determined specific communication address can meet the sending data volume. If it can be met, the picture contained in the audio and video media data segment is sent first, and then the movie and audio contained in the audio and video media data segment are sent. Otherwise, the sending end sends the picture, movie, and audio contained in the audio and video media data segment to the receiving end in sequence.
6. An audio and video media transmission system, used to implement the method according to any one of claims 1 to 5, characterized in that: Includes the following modules: The sending end module is used to collect audio and video media data, divide the audio and video media data into different audio and video media data segments for storage, the audio and video media data segments include movies, audio, and pictures, and is used to store detailed information of the audio and video media data segments, and is also used to store communication information, the communication information includes a specific communication address, and a sending environment corresponding to the specific communication address, and is also used to search for the audio and video media data segments required by the receiving end module in the different audio and video media data segments stored in itself according to the request message sent by the receiving end module, and send the audio and video media data segments required by the receiving end module to the receiving end module; The receiving module is used to send a request message to the sending module, where the request message includes the communication address of the receiving module, the audio and video media data segments required by the receiving module, and the request form of the receiving module for the required audio and video media data segments, and is used to display the audio and video media data segments sent by the sending module.
7. A device, characterized in that: The method comprises a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to implement the method according to any one of claims 1 to 5 when executing the computer program.
8. A storage medium, characterized in that: The storage medium stores program instructions, wherein when the program instructions are executed, the device where the storage medium is located is controlled to execute the method according to any one of claims 1 to 5.
