Multimedia data processing method and apparatus

Abstract

A multimedia data processing method and apparatus. The method comprises: determining a plurality of pieces of alternative multimedia data corresponding to target multimedia data, wherein the plurality of pieces of alternative multimedia data are obtained by means of processing the target multimedia data on the basis of data characteristics of the target multimedia data, and the data content of each piece of alternative multimedia data matches the data content of the target multimedia data; acquiring object information of a target client; searching the plurality of pieces of alternative multimedia data corresponding to the target multimedia data for alternative multimedia data matching the object information; and sending the found alternative multimedia data to a target client, wherein the target client is used for outputting the found alternative multimedia data. By using the method, it can be ensured that multimedia data issued to a client by a server meets the requirements of an object of the client.

Description

Multimedia data processing method and device Technical Field

[0001] The present application relates to the field of Internet, and in particular to a method and device for processing multimedia data. Background Art

[0002] Publishers can publish multimedia data to a server. For example, if the multimedia data is a video, the server directly sends the video to one or more clients. The clients can only view the video published by the publisher. However, this approach does not take into account the different needs of different clients for the video. Therefore, how to ensure that the multimedia data sent by the server to the client meets the needs of the client is a current problem that needs to be solved.

[0003] Summary of the Invention

[0004] The embodiments of the present application provide a method and apparatus for processing multimedia data, which can ensure that the multimedia data sent by a server to a client meets the requirements of the object of the client.

[0005] In one aspect, an embodiment of the present application provides a method for processing multimedia data, the method comprising:

[0006] determining a plurality of candidate multimedia data corresponding to the target multimedia data, the plurality of candidate multimedia data being obtained by processing the target multimedia data based on data characteristics of the target multimedia data, and wherein data content of each candidate multimedia data matches data content of the target multimedia data;

[0007] Get the target client's object information;

[0008] searching for candidate multimedia data matching the object information among a plurality of candidate multimedia data corresponding to the target multimedia data;

[0009] The found candidate multimedia data is sent to the target client, and the target client is used to output the found candidate multimedia data.

[0010] In one embodiment, the method further includes: obtaining data features of the target multimedia data;

[0011] determining, based on data characteristics of the target multimedia data, whether to generate candidate multimedia data corresponding to the target multimedia data;

[0012] If so, a plurality of candidate multimedia data corresponding to the target multimedia data are generated.

[0013] In one embodiment, the determining, based on the data characteristics of the target multimedia data, whether to generate candidate multimedia data corresponding to the target multimedia data includes:

[0014] comparing data features of the target multimedia data with preset data features in a preset data feature set, wherein different objects have different requirements for multimedia data having the preset data features;

[0015] If there is a preset data feature in the preset data feature set whose similarity with the data feature of the target multimedia data is greater than a preset similarity threshold, it is determined to generate candidate multimedia data corresponding to the target multimedia data.

[0016] In one embodiment, generating a plurality of candidate multimedia data corresponding to the target multimedia data includes:

[0017] acquiring a plurality of gear parameters according to data characteristics of the target multimedia data;

[0018] Adjusting the target multimedia data to obtain multimedia data having parameters that are parameters of each gear position;

[0019] The obtained multiple multimedia data are used as multiple candidate multimedia data corresponding to the target multimedia data.

[0020] In one embodiment, generating a plurality of candidate multimedia data corresponding to the target multimedia data includes:

[0021] adding one or more auxiliary information to the target multimedia data to update the target multimedia data to obtain one or more updated target multimedia data;

[0022] The target multimedia data and the one or more updated target multimedia data are used as multiple candidate multimedia data corresponding to the target multimedia data.

[0023] In one embodiment, the object information includes one or more of the following: object behavior information, object emotion information;

[0024] The searching for candidate multimedia data matching the object information among the plurality of candidate multimedia data corresponding to the target multimedia data includes:

[0025] Searching for candidate multimedia data that matches the object behavior information and / or object emotion information among a plurality of candidate multimedia data corresponding to the target multimedia data.

[0026] On the other hand, an embodiment of the present application provides another method for processing multimedia data, the method comprising:

[0027] collecting object information and sending the object information to a server, wherein the object information is used by the server to search for candidate multimedia data that matches the object information among a plurality of candidate multimedia data corresponding to the target multimedia data, the plurality of candidate multimedia data being obtained by processing the target multimedia data based on data features of the target multimedia data, and wherein data content of each candidate multimedia data matches data content of the target multimedia data;

[0028] receiving the found candidate multimedia data sent by the server;

[0029] The found candidate multimedia data is output.

[0030] In one embodiment, the method further includes: acquiring object estimation information, where the object estimation information is used to indicate whether the object has a requirement for repeated playback of the target multimedia data;

[0031] If the object estimation information indicates that the object has a demand for repeated playback of the target multimedia data, storing the found candidate multimedia data in a memory;

[0032] Upon receiving a request to play the target multimedia data, acquiring the found candidate multimedia data from the memory;

[0033] The found candidate multimedia data is output.

[0034] On the other hand, an embodiment of the present application provides a multimedia data processing device, the multimedia data processing device comprising:

[0035] a processing unit configured to determine a plurality of candidate multimedia data corresponding to target multimedia data, the plurality of candidate multimedia data being obtained by processing the target multimedia data based on data characteristics of the target multimedia data, wherein data content of each candidate multimedia data matches data content of the target multimedia data; obtain object information of a target client; and search for candidate multimedia data matching the object information among the plurality of candidate multimedia data corresponding to the target multimedia data;

[0036] The output unit is configured to send the found candidate multimedia data to the target client, and the target client is configured to output the found candidate multimedia data.

[0037] On the other hand, an embodiment of the present application provides another multimedia data processing device, the multimedia data processing device comprising:

[0038] An input unit, used for collecting object information;

[0039] an output unit, configured to send the object information to a server, wherein the object information is used by the server to search for candidate multimedia data matching the object information among a plurality of candidate multimedia data corresponding to the target multimedia data, the plurality of candidate multimedia data being obtained by processing the target multimedia data based on data features of the target multimedia data, and wherein data content of each candidate multimedia data matches data content of the target multimedia data;

[0040] The input unit is further configured to receive the found candidate multimedia data sent by the server;

[0041] The output unit is further configured to output the found candidate multimedia data.

[0042] On the other hand, an embodiment of the present application provides a server, including a processor, a storage device, and a communication interface, wherein the processor, the storage device, and the communication interface are interconnected, wherein the storage device is used to store a computer program that supports a terminal to execute the above method, the computer program including program instructions, and the processor is configured to call the program instructions and perform the following steps:

[0043] determining a plurality of candidate multimedia data corresponding to the target multimedia data, the plurality of candidate multimedia data being obtained by processing the target multimedia data based on data characteristics of the target multimedia data, and wherein data content of each candidate multimedia data matches data content of the target multimedia data;

[0044] Get the target client's object information;

[0045] searching for candidate multimedia data matching the object information among a plurality of candidate multimedia data corresponding to the target multimedia data;

[0046] The found candidate multimedia data is sent to the target client, and the target client is used to output the found candidate multimedia data.

[0047] On the other hand, an embodiment of the present application provides a client, including a processor, a storage device, and a communication interface, wherein the processor, the storage device, and the communication interface are interconnected, wherein the storage device is used to store a computer program that supports the terminal to execute the above method, the computer program including program instructions, and the processor is configured to call the program instructions and perform the following steps:

[0048] collecting object information and sending the object information to a server, wherein the object information is used by the server to search for candidate multimedia data that matches the object information among a plurality of candidate multimedia data corresponding to the target multimedia data, the plurality of candidate multimedia data being obtained by processing the target multimedia data based on data features of the target multimedia data, and wherein data content of each candidate multimedia data matches data content of the target multimedia data;

[0049] receiving the found candidate multimedia data sent by the server;

[0050] The found candidate multimedia data is output.

[0051] On the other hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program includes program instructions, which, when executed by a processor, enable the processor to execute the multimedia data processing method described in any of the above aspects.

[0052] On the other hand, an embodiment of the present application provides a computer product, which includes a computer program, and the computer program is suitable for being loaded by a processor and executing the multimedia data processing method described in any one of the above aspects.

[0053] In an embodiment of the present application, the multiple alternative multimedia data corresponding to the target multimedia data are obtained by processing the target multimedia data based on the data characteristics of the target multimedia data. For example, assuming that the data characteristics of the target multimedia data indicate that the target multimedia data is a hot video or the data type of the target multimedia data is a tool type, then it indicates that different objects may have different requirements for the target multimedia data. For example, an object that is more interested in the target multimedia data may want to play the target multimedia data with higher data quality, and an object that is less interested in the target multimedia data may want to know the data content of the target multimedia data while the multimedia data is played smoothly. Exemplary data quality can be reflected by parameters such as resolution, frame rate, or bit rate. Based on this, when it is determined that different objects may have different requirements for the target multimedia data based on the data characteristics of the target multimedia data, the target multimedia data is processed to obtain multiple alternative multimedia data corresponding to the target multimedia data, which can facilitate the sending of adapted alternative multimedia data to different clients, thereby ensuring that the multimedia data sent by the server to the client meets the requirements of the object of the client. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0055] FIG1 is a flow chart of a communication system provided by an embodiment of the present application;

[0056] FIG2 is a flow chart of a method for processing multimedia data provided in an embodiment of the present application;

[0057] FIG3 is a flow chart of another method for processing multimedia data provided in an embodiment of the present application;

[0058] FIG4 is a flow chart of another method for processing multimedia data provided in an embodiment of the present application;

[0059] FIG5 is a schematic structural diagram of a multimedia data processing device provided in an embodiment of the present application;

[0060] FIG6 is a schematic diagram of the structure of a server provided in an embodiment of the present application;

[0061] FIG7 is a schematic structural diagram of another multimedia data processing device provided in an embodiment of the present application;

[0062] FIG8 is a schematic diagram of the structure of a client provided in an embodiment of the present application. DETAILED DESCRIPTION

[0063] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0064] The multimedia data processing method provided in the embodiment of the present application can be applied to the communication system shown in Figure 1. The communication system may include a server 101 and at least one client 102. The server 101 establishes a communication connection with any client 102 through any communication method, so that the server 101 can exchange data with the client 102 through the communication connection. Specifically, the target client can be any client that establishes a communication connection with the server 101. The server 101 can determine multiple candidate multimedia data corresponding to the target multimedia data and obtain object information of the target client. Then, the server 101 searches for candidate multimedia data that matches the object information among the multiple candidate multimedia data corresponding to the target multimedia data. Then, the server 101 sends the found candidate multimedia data to the target client, and the target client is used to output the found candidate multimedia data.

[0065] In an exemplary scenario, if a server needs to push target multimedia data to a target client, the server may determine multiple candidate multimedia data corresponding to the target multimedia data, obtain object information of the target client, search for candidate multimedia data matching the object information among the multiple candidate multimedia data corresponding to the target multimedia data, and send the found candidate multimedia data to the target client. The target client may display a playback interface for the candidate multimedia data, and upon receiving a playback instruction for the candidate multimedia data, the target client may output the found candidate multimedia data.

[0066] In another exemplary scenario, the target client may display a playback interface for the target multimedia data. If the target client receives an instruction from the object to play the target multimedia data, the target client may generate a download request for the target multimedia data and send the download request to the server. In response to the download request, the server may determine multiple candidate multimedia data corresponding to the target multimedia data, obtain the object information of the target client, search for candidate multimedia data matching the object information among the multiple candidate multimedia data corresponding to the target multimedia data, and send the found candidate multimedia data to the target client. The target client may output the found candidate multimedia data.

[0067] Among them, the playback instruction for the alternative multimedia data (or target multimedia data) can be generated by the target client when the display time of the playback interface reaches a preset time threshold. Optionally, it can also be generated by the target client in response to the object's playback operation on the alternative multimedia data (or target multimedia data). The playback operation can be, for example, the object clicking the play control in the playback interface, or the object inputting a voice to instruct playback (voice such as "start playing"), etc., which is not limited by the embodiments of the present application.

[0068] To facilitate understanding, the relevant terms involved in the embodiments of this application are explained and illustrated below.

[0069] Target multimedia data: Target multimedia data refers to a certain multimedia data or any multimedia data, that is, multimedia data that the server needs to send to the client. It can be multimedia data pushed by the server to the client, or it can be multimedia data that the client requests the server to send. Multimedia data refers to data presented in the form of graphics, images, sounds, text, animations or videos. For example, the server is a video server, and the client that establishes a communication connection with the server is a video playback client. The target multimedia data can refer to the video data uploaded to the server by the publisher, that is, the video data that the server wants to send to the client. For another example, the server is an audio server, and the client that establishes a communication connection with the server is an audio playback client. The target multimedia data can refer to the audio data uploaded to the server by the publisher, that is, the audio data that the server wants to send to the client.

[0070] Alternative multimedia data: Alternative multimedia data refers to multimedia data that matches the data content of the target multimedia data.

[0071] In one example, there are differences in the data quality of different candidate multimedia data, where the data quality can be reflected by parameters such as resolution, frame rate, bit rate, or clarity. For example, the server can adjust the resolution of the target multimedia data to obtain candidate multimedia data of multiple resolution levels. For example, the resolution of the target multimedia data uploaded to the server by the publisher is 480P (the letter P represents line-by-line scanning, and the number 480 represents vertical resolution, i.e., there are 480 horizontal scanning lines in the vertical direction). The server can adjust the resolution of the target multimedia data to obtain candidate multimedia data with four resolution level parameters, namely, 1080P, 720P, 480P, and 270P. The candidate multimedia data with these four resolution level parameters are the candidate multimedia data corresponding to the target multimedia data, where the difference between the above four candidate multimedia data is only the resolution, and the data content of the above four candidate multimedia data is the same as the data content of the target multimedia data.

[0072] In another example, the plurality of alternative multimedia data include multimedia data with auxiliary information added to the target multimedia data and the target multimedia data. Auxiliary information refers to information that assists in describing the data content of the target multimedia data, such as special effects, annotations, or props. For example, the server may determine the key unit data included in the target multimedia data, and add one or more auxiliary information to the key unit data to obtain one or more alternative multimedia data. The amount of information in the data content of the key unit data may be higher than the amount of information in the data content of other unit data in the target multimedia data. For example, if the target multimedia data is tool-type multimedia data, the key unit data may refer to the unit data that expresses the central idea of ​​the data content of the target multimedia data. For example, if the target multimedia data is entertainment-type multimedia data, the key unit data may refer to the unit data that indicates the climax of the data content of the target multimedia data. For example, if the target multimedia data is competitive multimedia data, the key unit data may refer to the unit data at the highlight moment included in the target multimedia data.

[0073] Object information: Object information refers to information used to predict object needs. Object needs refer to the needs of the object to watch or listen to the target multimedia data. For example, the object hopes to know the data content of the target multimedia data under the premise of smooth multimedia data playback. For example, the object hopes that the data quality of the multimedia data played is high, etc.

[0074] Specifically, object information may include one or more of the following: object behavior characteristics or object emotional information. Object behavior characteristics can be used to characterize the behavior of the subject when viewing or listening to multimedia data. Object behavior characteristics may include one or more of the following: the type of multimedia data the subject is interested in, the type of multimedia data the subject repeatedly views, data types such as entertainment, competitive, or utility, whether the subject performs fast-forward or double-speed playback, and the subject's retention rate / volume, like rate / volume, comment rate / volume, attention rate / volume, collection rate / volume, gift-giving rate / volume, or sharing rate / volume for different types of multimedia data. The object's emotional information can be used to characterize the object's emotions when watching or listening to multimedia data. The object's emotional information may include one or more of the following: the object's facial expressions or vital signs when watching or listening to different types of multimedia data, the object's current facial expressions or vital signs, etc. The object's current facial expressions or vital signs can be understood as the object's facial expressions or vital signs parameters collected by the client in the most recent time period. For example, when the client detects the object's instruction to play the target multimedia data, the object's facial expressions or vital signs parameters are collected. For example, before the server pushes the target multimedia data to the client, it sends a request to the client to obtain the object's emotional information. The client responds to the request to obtain the object's emotional information and collects the object's facial expressions or vital signs parameters. Vital signs parameters may include one or more of the following: heart rate, pulse, blood pressure, body temperature, or respiratory rate.

[0075] In the specific implementation of this application, the objects involved may refer to users, and user-related data, such as object information, etc. When the embodiments of this application are applied to specific products or technologies, user permission or consent must be obtained, and the collection, use and processing of relevant data must comply with local laws, regulations and standards.

[0076] It can be understood that the embodiment of the present application uses the scenario in which pulse multimedia data is video data as an example to introduce the processing scheme for multimedia data mentioned in the embodiment of the present application, and it does not limit the embodiment of the present application. The processing scheme for multimedia data mentioned in the embodiment of the present application can also be applied to scenarios in which other multimedia data are played, such as audio data or text data, etc., and the embodiment of the present application does not limit this.

[0077] In conjunction with the communication system shown in FIG1 , please refer to FIG2 , which is a flow chart of a method for processing multimedia data provided in an embodiment of the present application. The multimedia data processing scheme shown in FIG2 includes but is not limited to steps S201 to S206, wherein:

[0078] S201: The server determines a plurality of candidate multimedia data corresponding to the target multimedia data.

[0079] Specifically, the server may process the target multimedia data based on data characteristics of the target multimedia data to obtain multiple candidate multimedia data corresponding to the target multimedia data, wherein the data content of each candidate multimedia data matches the data content of the target multimedia data, and the server stores the multiple candidate multimedia data corresponding to the target multimedia data in a memory. When the server needs to push the target multimedia data to the target client or receives a download request from the target client, the server may retrieve the multiple candidate multimedia data corresponding to the target multimedia data from the memory.

[0080] Data features refer to attribute information of the target multimedia data, such as the data type of the target multimedia data or whether the target multimedia data is hot data. Hot data refers to data with a popularity higher than a preset threshold. For example, if the target multimedia data is video data, hot data refers to hot videos.

[0081] In one embodiment, the server can obtain data characteristics of the target multimedia data, and determine whether to generate alternative multimedia data corresponding to the target multimedia data based on the data characteristics of the target multimedia data. If so, multiple alternative multimedia data corresponding to the target multimedia data are generated; if not, the server can send the target multimedia data to the target client, or the server can adjust the target multimedia data to generate multimedia data with parameters that are preset gear parameters, and send the multimedia data with parameters that are preset gear parameters to the target client, where the target client refers to a certain client or any client, such as a client to which the server is to push the target multimedia data, or a client to which the server receives a download request for the target multimedia data. The preset gear parameter can refer to the lowest gear parameter among multiple gear parameters. Assuming that the multiple gear parameters refer to the four resolution gear parameters of 1080P, 720P, 480P and 270P, the preset gear parameter can be the resolution of 270P.

[0082] In one embodiment, the server may compare the data features of the target multimedia data with the preset data features in the preset data feature set, where different objects have different requirements for multimedia data with the preset data features. If there is a preset data feature in the preset data feature set whose similarity with the data features of the target multimedia data is greater than a preset similarity threshold, it is determined to generate alternative multimedia data corresponding to the target multimedia data.

[0083] Research has shown that for multimedia data indicated as high-trend data, or multimedia data of a type that will be watched repeatedly, such as tools (such as tutorials), sports or entertainment, different objects may have different demands for the multimedia data. For example, an object that is more interested in the multimedia data may want to play multimedia data with higher data quality, while an object with less interest in the multimedia data may want to know the data content of the multimedia data while ensuring smooth playback of the multimedia data. Based on this, after the server obtains the data features of the target multimedia data, if the data features indicate that the target multimedia data is high-trend data, or the data type of the target multimedia data is tools, sports or entertainment, then the server can generate alternative multimedia data corresponding to the target multimedia data. Exemplarily, the preset data features in the preset data feature set may include one or more of the following: high-trend data, data type is tools, data type is sports, and data type is entertainment.

[0084] In one embodiment, the server may generate multiple candidate multimedia data corresponding to the target multimedia data in the following two ways:

[0085] First, based on the data characteristics of the target multimedia data, multiple gear parameters are obtained, the target multimedia data is adjusted, and multimedia data corresponding to the parameters of each gear parameter is obtained. The obtained multiple multimedia data are used as multiple candidate multimedia data corresponding to the target multimedia data. For a detailed description of the method for generating multiple candidate multimedia data corresponding to the target multimedia data, please refer to the embodiment shown in Figure 3 below.

[0086] Second, one or more auxiliary information is added to the target multimedia data to update the target multimedia data, thereby obtaining one or more updated target multimedia data. The target multimedia data and the one or more updated target multimedia data are used as multiple candidate multimedia data corresponding to the target multimedia data. For a detailed description of the method for generating multiple candidate multimedia data corresponding to the target multimedia data, please refer to the embodiment shown in FIG. 4 .

[0087] S202: The target client obtains the target client's object information.

[0088] In a specific implementation, if the object information includes object behavior information, the target client can obtain the object behavior information of the object in a historical time period through the input device of the terminal device running the target client. The input device can exemplarily include a touch panel, a microphone, or a keypad. If the object information includes object emotion information, the target client can obtain an image of the object through the image acquisition device of the terminal device running the target client, then perform expression recognition processing on the object image to obtain the object's facial expression, and then generate object emotion information based on the facial expression. Alternatively, the target client can collect the object's vital sign parameters through a wearable device worn by the object, and the wearable device can send the collected vital sign parameters to the target client, and the target client can generate object emotion information based on the vital sign parameters.

[0089] In an example, if the server needs to push target multimedia data to the target client, the server may send an object information acquisition request to the target client, and the target client may respond to the object information acquisition request to acquire the object information.

[0090] In another example, when the target client detects a playback instruction for target multimedia data initiated by the object, it can obtain object information, and then the target client can send a download request for the target multimedia data to the server, and the download request can carry the above object information.

[0091] S203: The target client sends the target client's object information to the server.

[0092] S204: The server searches for candidate multimedia data that matches the object information of the target client among the multiple candidate multimedia data corresponding to the target multimedia data.

[0093] Specifically, the server may search for candidate multimedia data that matches the object behavior information and / or the object emotion information among a plurality of candidate multimedia data corresponding to the target multimedia data.

[0094] In one example, if the server determines based on the object behavior information that the object did not perform operations such as fast forwarding or double-speed playback when watching multimedia data in a historical time period, indicating that the object is accustomed to watching multimedia data slowly, then the alternative multimedia data that matches the object behavior information found by the server can be the alternative multimedia data for the target gear parameter.

[0095] In another example, if the server determines based on the subject's emotional information that the subject's facial expression was happy when viewing multimedia data of the same data type as the target multimedia data during a historical time period, indicating that the subject enjoys viewing this type of multimedia data, i.e., the subject is likely to enjoy viewing the target multimedia data, then the alternative multimedia data that the server finds to match the subject's emotional information may be alternative multimedia data with a target gear parameter. Alternatively, if the server determines based on the subject's emotional information that the subject's current facial expression is happy, indicating that the subject is likely to enjoy viewing the target multimedia data, then the alternative multimedia data that the server finds to match the subject's emotional information may be alternative multimedia data with a target gear parameter. The target gear parameter is higher than the gear parameters of other alternative multimedia data in the multiple alternative multimedia data corresponding to the target multimedia data. For example, if the multiple alternative multimedia data corresponding to the target multimedia data are multimedia data with resolutions of 1080P, 720P, 480P, and 270P, respectively, then the alternative multimedia data with a target gear parameter may be multimedia data with a resolution of 1080P.

[0096] In another example, if the server determines based on the object behavior information that the object has a high retention rate / quantity, like rate / quantity, comment rate / quantity, attention rate / quantity, collection rate / quantity, gift giving rate / quantity or sharing rate / quantity when watching multimedia data in a historical time period, it indicates that the object has a high frequency of human-computer interaction when watching multimedia data, that is, the object likes to interact when watching multimedia data, then the alternative multimedia data that matches the object behavior information found by the server can be alternative multimedia data with auxiliary information added, such as alternative multimedia data obtained by adding special effects to the unit data at the highlight moment in the target multimedia data. Optionally, if the alternative multimedia data corresponding to the target multimedia data includes multiple alternative multimedia data with added auxiliary information, the server can select the alternative multimedia data from the multiple alternative multimedia data with added auxiliary information based on the object's retention rate / quantity, like rate / quantity, comment rate / quantity, attention rate / quantity, collection rate / quantity, gift giving rate / quantity or sharing rate / quantity. For example, the higher the retention rate / quantity, like rate / quantity, comment rate / quantity, attention rate / quantity, collection rate / quantity, gift giving rate / quantity or sharing rate / quantity, the more auxiliary information is added in the selected alternative multimedia data.

[0097] In one embodiment, the server may pre-establish a correspondence between object information and gear parameters. After obtaining the target client's object information, the server may obtain the similarity between the target client's object information and the object information corresponding to each gear parameter, and use the candidate multimedia data with the gear parameter having the highest similarity as the candidate multimedia data that matches the target client's object information. Alternatively, the server may pre-establish a correspondence between object information and auxiliary information. After obtaining the target client's object information, the server may obtain the similarity between the target client's object information and the object information corresponding to each auxiliary information, and use the candidate multimedia data with the auxiliary information having the highest similarity as the candidate multimedia data that matches the target client's object information.

[0098] In another embodiment, the server may pre-build a multimedia data matching model, and then train the multimedia data matching model using historical object information of the target client's object when viewing multimedia data in a historical time period and the gear parameters of the multimedia data viewed by the object as samples, thereby obtaining a trained multimedia data matching model, so that the candidate multimedia data matched by the trained multimedia data matching model meets the requirements of the target client's object. After obtaining the target client's object information, the server may call the trained multimedia data matching model to match the target client's object information with multiple gear parameters, thereby obtaining gear parameters that match the target client's object information, and using the candidate multimedia data whose gear parameters are the gear parameters obtained by the trained multimedia data matching model as the candidate multimedia data that matches the target client's object information.

[0099] Optionally, the server may pre-build a multimedia data matching model and then train the multimedia data matching model using historical object information of the target client's object when viewing multimedia data during a historical time period and auxiliary information in the multimedia data viewed by the object as samples, thereby obtaining a trained multimedia data matching model, so that the candidate multimedia data obtained by matching the trained multimedia data matching model meets the requirements of the target client's object. After obtaining the target client's object information, the server may call the trained multimedia data matching model to match the target client's object information with multiple pieces of auxiliary information, obtain the type of auxiliary information that matches the target client's object information, and use the candidate multimedia data to which the auxiliary information of the type obtained by the trained multimedia data matching model is added as the candidate multimedia data that matches the target client's object information.

[0100] S205: The server sends the found candidate multimedia data to the target client.

[0101] S206: The target client outputs the found candidate multimedia data.

[0102] In one embodiment, after the target client outputs the candidate multimedia data, the target client may obtain object prediction information indicating whether the target multimedia data has a requirement for repeated playback. If the object prediction information indicates that the target multimedia data has a requirement for repeated playback, the target client may store the found candidate multimedia data in a memory. Subsequently, upon receiving a playback request for the target multimedia data, the target client may retrieve the found candidate multimedia data from the memory and output the found candidate multimedia data.

[0103] In this embodiment, if the target client predicts that the object will repeatedly watch the alternative multimedia data, the found alternative multimedia data is cached. When the object initiates a replay operation, the target client does not need to download the alternative multimedia data from the server again, but instead obtains the alternative multimedia data from the memory and outputs the alternative multimedia data, thereby saving bandwidth resources.

[0104] In another embodiment, if the object prediction information indicates that the object requires repeated playback of the target multimedia data, and the alternative multimedia data found by the server is not the alternative multimedia data with the highest data quality, the target client may send a data download request to the server, requesting download of the alternative multimedia data with the highest data quality. After the server responds to the data download request and sends the alternative multimedia data with the highest data quality to the target client, the target client may store the alternative multimedia data with the highest data quality in a memory. Then, upon receiving a playback request for the target multimedia data, the target client may retrieve the alternative multimedia data from the memory and output it. The alternative multimedia data with the highest data quality may include the alternative multimedia data with the highest gear parameter or the alternative multimedia data with the largest amount of added auxiliary information. After the alternative multimedia data found by the server has been downloaded, the target client may send a data download request to the server. This can avoid playback lag issues with the alternative multimedia data found by the server currently being output by the target client, ensuring smoother playback of the alternative multimedia data found by the server.

[0105] In this embodiment, the target client caches the alternative multimedia data with the highest data quality. When the object initiates a replay operation, the target client can obtain the alternative multimedia data from the memory and output the alternative multimedia data. It can play the multimedia data smoothly while ensuring the high quality of the played multimedia data, thereby improving user stickiness.

[0106] Among them, the way in which the target client obtains the object estimation information may include: the target client determines, based on the object behavior information, that the object has repeatedly watched multimedia data when watching multimedia data in a historical time period, then the target client can obtain the data type of the multimedia data repeatedly watched by the object. If the data type of the target multimedia data is the same as the data type of the multimedia data repeatedly watched by the object, then it indicates that the object has a demand for repeated playback of the target multimedia data, and then the found alternative multimedia data is stored in the memory; if the data type of the target multimedia data is different from the data type of the multimedia data repeatedly watched by the object, then it indicates that the object does not have a demand for repeated playback of the target multimedia data. Based on this, the server does not need to store the found alternative multimedia data in the memory.

[0107] In an embodiment of the present application, the server can determine multiple alternative multimedia data corresponding to the target multimedia data, wherein the multiple alternative multimedia data are obtained by processing the target multimedia data based on the data characteristics of the target multimedia data, and the data content of each alternative multimedia data matches the data content of the target multimedia data; obtain the object information of the target client; search for alternative multimedia data that matches the object information among the multiple alternative multimedia data corresponding to the target multimedia data; and send the found alternative multimedia data to the target client so that the target client outputs the found alternative multimedia data, thereby ensuring that the multimedia data sent by the server to the client meets the object requirements of the client.

[0108] In conjunction with the communication system shown in FIG1 , please refer to FIG3 , which is a flowchart of another method for processing multimedia data provided in an embodiment of the present application. The multimedia data processing scheme shown in FIG3 includes but is not limited to steps S301 to S309, wherein:

[0109] S301: Acquire data features of target multimedia data.

[0110] S302: Determine whether to generate candidate multimedia data corresponding to the target multimedia data according to data characteristics of the target multimedia data.

[0111] S303: If yes, obtain multiple gear parameters according to the data characteristics of the target multimedia data.

[0112] S304: Adjust the target multimedia data to obtain multimedia data with parameters that are parameters of each gear.

[0113] S305: Use the obtained multiple multimedia data as multiple candidate multimedia data corresponding to the target multimedia data.

[0114] For example, if the data characteristics of the target multimedia data indicate that the target multimedia data is high-heat data, or the data type of the target multimedia data is a tool type, an entertainment type, or a competitive type, then the server can determine to generate alternative multimedia data corresponding to the target multimedia data, and then the server can transcode the target multimedia data to obtain alternative multimedia data with multiple gear parameters. For example, if the target multimedia data is high-heat data, then the server can obtain four gear parameters, namely, resolutions of 1080P, 720P, 480P, and 270P, and then the server can transcode the target multimedia data to obtain multimedia data with resolutions of 1080P, 720P, 480P, and 270P, respectively, and use the multimedia data with resolutions of 1080P, 720P, 480P, and 270P as multiple alternative multimedia data corresponding to the target multimedia data.

[0115] S306: Obtain object information of the target client.

[0116] S307: Search for candidate multimedia data that matches the object information of the target client among the multiple candidate multimedia data corresponding to the target multimedia data.

[0117] In one example, if the object information includes object behavior information, such as the server determines based on the object behavior information that the object is accustomed to watching videos slowly and does not perform operations such as fast forwarding or double-speed playback, then the alternative multimedia data that matches the object information found by the server may be alternative multimedia data with higher-level parameters; otherwise, the alternative multimedia data that matches the object information found by the server may be alternative multimedia data with lower-level parameters.

[0118] In another example, if the object information includes object emotion information, such as if the server determines that the object's favorite data type is multimedia data of the data type of the target multimedia data based on the object emotion information, then the alternative multimedia data that matches the object information found by the server may be alternative multimedia data with higher-level parameters; otherwise, the alternative multimedia data that matches the object information found by the server may be alternative multimedia data with lower-level parameters. For example, if the multiple alternative multimedia data corresponding to the target multimedia data refer to multimedia data with the aforementioned resolutions of 1080P, 720P, 480P, and 270P, then the alternative multimedia data with higher-level parameters may refer to multimedia data with a resolution of 1080P or a resolution of 720P, and the alternative multimedia data with lower-level parameters may refer to multimedia data with a resolution of 480P or a resolution of 270P.

[0119] S308: Send the found candidate multimedia data to the target client, and the target client is used to output the found candidate multimedia data.

[0120] S309: If not, the target multimedia data is sent to the target client, and the target client is used to output the target multimedia data.

[0121] For example, if the data characteristics of the target multimedia data indicate that the target multimedia data is not hot data, or the data type of the target multimedia data is not tool, entertainment or competition, then the server can send the target multimedia data to the target client so that the target client outputs the target multimedia data.

[0122] Optionally, if it is determined based on the data characteristics of the target multimedia data that the alternative multimedia data corresponding to the target multimedia data is not generated, the server may transcode the target multimedia data into only multimedia data with preset gear parameters, and then send the multimedia data with the preset gear parameters to the target client so that the target client can output the multimedia data. The preset gear parameters refer to gear parameters of a lower gear. For example, the gear parameters may include resolutions of 1080P, 720P, 480P, and 270P, and the preset gear parameters may refer to a resolution of 270P or 480P.

[0123] In an embodiment of the present application, data features of target multimedia data are obtained, and based on the data features of the target multimedia data, it is determined whether alternative multimedia data corresponding to the target multimedia data is generated. If so, multiple gear parameters are obtained based on the data features of the target multimedia data, and the target multimedia data is adjusted to obtain multimedia data with parameters as the respective gear parameters. The multiple multimedia data obtained are used as multiple alternative multimedia data corresponding to the target multimedia data, and object information of the target client is obtained. Alternative multimedia data matching the object information is searched for among the multiple alternative multimedia data corresponding to the target multimedia data, and the found alternative multimedia data is sent to the target client. If not, the target multimedia data is sent to the target client, and the transcoding gear of the target multimedia data can be determined based on the data features. More gears can be transcoded for multimedia data with different requirements, and alternative multimedia data matching the object information can be sent down, thereby ensuring that the multimedia data sent by the server to the client meets the object requirements of the client.

[0124] In conjunction with the communication system shown in FIG1 , please refer to FIG4 , which is a flow chart of another method for processing multimedia data provided in an embodiment of the present application. The multimedia data processing scheme shown in FIG4 includes but is not limited to steps S401 to S408, wherein:

[0125] S401: Acquire data features of target multimedia data.

[0126] S402: Determine whether to generate candidate multimedia data corresponding to the target multimedia data according to data characteristics of the target multimedia data.

[0127] S403: If yes, one or more auxiliary information are added to the target multimedia data to update the target multimedia data to obtain one or more updated target multimedia data.

[0128] S404: Use the target multimedia data and one or more updated target multimedia data as multiple candidate multimedia data corresponding to the target multimedia data.

[0129] For example, if the data characteristics of the target multimedia data indicate that the target multimedia data is highly popular data, or the data type of the target multimedia data is a tool, entertainment, or competitive type, then the server can determine to generate candidate multimedia data corresponding to the target multimedia data, and then the server can add one or more auxiliary information to the target multimedia data to obtain multiple candidate multimedia data. For example, if the target multimedia data is highly popular data, then the server can add special effects to the unit data at the highlight moment in the target multimedia data, and use the target multimedia data and the target multimedia data with the added special effects as multiple candidate multimedia data corresponding to the target multimedia data.

[0130] S405: Obtain object information of the target client.

[0131] S406: Search for candidate multimedia data matching the object information of the target client among the multiple candidate multimedia data corresponding to the target multimedia data.

[0132] In one example, if the object information includes object behavior information, such as the server determines that the object likes to interact based on the object behavior information, then the alternative multimedia data that matches the object information found by the server can be the target multimedia data for adding special effects; otherwise, the alternative multimedia data that matches the object information found by the server can be the target multimedia data.

[0133] In another example, if the object information includes object emotion information, such as the server determines that the object's favorite data type is multimedia data of the data type of the target multimedia data based on the object emotion information, then the alternative multimedia data that matches the object information found by the server can be the target multimedia data with added special effects; otherwise, the alternative multimedia data that matches the object information found by the server can be the target multimedia data.

[0134] S407: Send the found candidate multimedia data to the target client, and the target client is used to output the found candidate multimedia data.

[0135] S408: If not, the target multimedia data is sent to the target client, and the target client is used to output the target multimedia data.

[0136] For example, if the data characteristics of the target multimedia data indicate that the target multimedia data is not hot data, or the data type of the target multimedia data is not tool, entertainment or competition, then the server can send the target multimedia data to the target client so that the target client outputs the target multimedia data.

[0137] Optionally, if it is determined based on the data characteristics of the target multimedia data that the alternative multimedia data corresponding to the target multimedia data is not generated, the server may transcode the target multimedia data into multimedia data with preset gear parameters, and then send the multimedia data with preset gear parameters to the target client so that the target client can output the multimedia data. The preset gear parameters refer to gear parameters of a lower gear. For example, the gear parameters may include resolutions of 1080P, 720P, 480P, and 270P, and the preset gear parameters may refer to a resolution of 270P or 480P.

[0138] In an embodiment of the present application, data features of target multimedia data are obtained, and based on the data features of the target multimedia data, it is determined whether alternative multimedia data corresponding to the target multimedia data is generated. If so, one or more auxiliary information are added to the target multimedia data to update the target multimedia data to obtain one or more updated target multimedia data. The target multimedia data and the one or more updated target multimedia data are used as multiple alternative multimedia data corresponding to the target multimedia data, and object information of the target client is obtained. Alternative multimedia data matching the object information is searched for in the multiple alternative multimedia data corresponding to the target multimedia data, and the found alternative multimedia data is sent to the target client. If not, the target multimedia data is sent to the target client, and the auxiliary information to be added to the target multimedia data can be determined based on the data features. One or more auxiliary information are added to multimedia data with different requirements, and alternative multimedia data matching the object information is sent down, thereby ensuring that the multimedia data sent by the server to the client meets the object requirements of the client.

[0139] An embodiment of the present application further provides a computer storage medium, in which program instructions are stored. When the program instructions are executed, they are used to implement the corresponding methods described in the above embodiments.

[0140] Please refer to FIG5 again, which is a schematic structural diagram of a multimedia data processing device provided in an embodiment of the present application.

[0141] In one implementation of the device of the embodiment of the present application, the device includes the following structure.

[0142] The processing unit 501 is configured to determine a plurality of candidate multimedia data corresponding to target multimedia data, the plurality of candidate multimedia data being obtained by processing the target multimedia data based on data characteristics of the target multimedia data, wherein data content of each candidate multimedia data matches the data content of the target multimedia data; obtain object information of a target client; and search for candidate multimedia data matching the object information among the plurality of candidate multimedia data corresponding to the target multimedia data;

[0143] The output unit 502 is configured to send the found candidate multimedia data to the target client, and the target client is configured to output the found candidate multimedia data.

[0144] In one embodiment, the processing unit 501 is further used to: obtain data characteristics of the target multimedia data; determine whether to generate alternative multimedia data corresponding to the target multimedia data based on the data characteristics of the target multimedia data; and if so, generate multiple alternative multimedia data corresponding to the target multimedia data.

[0145] In one embodiment, when determining whether to generate candidate multimedia data corresponding to the target multimedia data based on the data characteristics of the target multimedia data, the processing unit 501 is configured to:

[0146] comparing data features of the target multimedia data with preset data features in a preset data feature set, wherein different objects have different requirements for multimedia data having the preset data features;

[0147] If there is a preset data feature in the preset data feature set whose similarity with the data feature of the target multimedia data is greater than a preset similarity threshold, it is determined to generate candidate multimedia data corresponding to the target multimedia data.

[0148] In one embodiment, when generating the plurality of candidate multimedia data corresponding to the target multimedia data, the processing unit 501 is configured to:

[0149] acquiring a plurality of gear parameters according to data characteristics of the target multimedia data;

[0150] Adjusting the target multimedia data to obtain multimedia data having parameters that are parameters of each gear position;

[0151] The obtained multiple multimedia data are used as multiple candidate multimedia data corresponding to the target multimedia data.

[0152] In one embodiment, when generating the plurality of candidate multimedia data corresponding to the target multimedia data, the processing unit 501 is configured to:

[0153] adding one or more auxiliary information to the target multimedia data to update the target multimedia data to obtain one or more updated target multimedia data;

[0154] The target multimedia data and the one or more updated target multimedia data are used as multiple candidate multimedia data corresponding to the target multimedia data.

[0155] In one embodiment, the object information includes one or more of the following: object behavior information, object emotion information;

[0156] When the processing unit 501 searches for alternative multimedia data that matches the object information among the multiple alternative multimedia data corresponding to the target multimedia data, it is used to: search for alternative multimedia data that matches the object behavior information and / or object emotion information among the multiple alternative multimedia data corresponding to the target multimedia data.

[0157] In an embodiment of the present application, the processing unit 501 can determine multiple alternative multimedia data corresponding to the target multimedia data, wherein the multiple alternative multimedia data are obtained by processing the target multimedia data based on the data characteristics of the target multimedia data, and the data content of each alternative multimedia data matches the data content of the target multimedia data; the processing unit 501 obtains the object information of the target client; the processing unit 501 searches for alternative multimedia data that matches the object information among the multiple alternative multimedia data corresponding to the target multimedia data; the output unit 502 sends the found alternative multimedia data to the target client, so that the target client outputs the found alternative multimedia data, which can ensure that the multimedia data sent by the server to the client meets the object requirements of the client.

[0158] Referring again to FIG. 6 , FIG. 6 is a schematic diagram of the structure of a server provided in an embodiment of the present application. The server in this embodiment of the present application includes a power supply module and other structures, and includes a processor 601, a storage device 602, and a communication interface 603. The processor 601, the storage device 602, and the communication interface 603 can exchange data, and the processor 601 implements the corresponding multimedia data processing method.

[0159] The storage device 602 may include volatile memory, such as random-access memory (RAM); the storage device 602 may also include non-volatile memory, such as flash memory, solid-state drive (SSD), etc.; the storage device 602 may also include a combination of the above types of memory.

[0160] The processor 601 may be a central processing unit (CPU). The processor 601 may also be a combination of a CPU and a GPU. In a server, multiple CPUs and GPUs may be included as needed to perform corresponding data processing. In one embodiment, the storage device 602 is used to store program instructions. The processor 601 may call the program instructions to implement the various methods involved in the embodiments of the present application.

[0161] In a first possible implementation, the processor 601 of the server calls the program instructions stored in the storage device 602 to determine multiple alternative multimedia data corresponding to the target multimedia data, where the multiple alternative multimedia data are obtained by processing the target multimedia data based on the data characteristics of the target multimedia data, and the data content of each alternative multimedia data matches the data content of the target multimedia data; obtains the object information of the target client; searches for alternative multimedia data that matches the object information among the multiple alternative multimedia data corresponding to the target multimedia data; and sends the found alternative multimedia data to the target client through the communication interface 603, and the target client is used to output the found alternative multimedia data.

[0162] In one embodiment, the processor 601 is further used to: obtain data characteristics of the target multimedia data; determine whether to generate alternative multimedia data corresponding to the target multimedia data based on the data characteristics of the target multimedia data; and if so, generate multiple alternative multimedia data corresponding to the target multimedia data.

[0163] In one embodiment, when the processor 601 determines whether to generate candidate multimedia data corresponding to the target multimedia data based on the data characteristics of the target multimedia data, it is configured to:

[0164] comparing data features of the target multimedia data with preset data features in a preset data feature set, wherein different objects have different requirements for multimedia data having the preset data features;

[0165] If there is a preset data feature in the preset data feature set whose similarity with the data feature of the target multimedia data is greater than a preset similarity threshold, it is determined to generate candidate multimedia data corresponding to the target multimedia data.

[0166] In one embodiment, when generating a plurality of candidate multimedia data corresponding to the target multimedia data, the processor 601 is configured to:

[0167] acquiring a plurality of gear parameters according to data characteristics of the target multimedia data;

[0168] Adjusting the target multimedia data to obtain multimedia data having parameters that are parameters of each gear position;

[0169] The obtained multiple multimedia data are used as multiple candidate multimedia data corresponding to the target multimedia data.

[0170] In one embodiment, when generating a plurality of candidate multimedia data corresponding to the target multimedia data, the processor 601 is configured to:

[0171] adding one or more auxiliary information to the target multimedia data to update the target multimedia data to obtain one or more updated target multimedia data;

[0172] The target multimedia data and the one or more updated target multimedia data are used as multiple candidate multimedia data corresponding to the target multimedia data.

[0173] In one embodiment, the object information includes one or more of the following: object behavior information, object emotion information;

[0174] When the processor 601 searches for alternative multimedia data that matches the object information among the multiple alternative multimedia data corresponding to the target multimedia data, it is used to: search for alternative multimedia data that matches the object behavior information and / or object emotion information among the multiple alternative multimedia data corresponding to the target multimedia data.

[0175] In an embodiment of the present application, the processor 601 can determine multiple alternative multimedia data corresponding to the target multimedia data, wherein the multiple alternative multimedia data are obtained by processing the target multimedia data based on the data characteristics of the target multimedia data, and the data content of each alternative multimedia data matches the data content of the target multimedia data; obtain the object information of the target client; search for alternative multimedia data that matches the object information among the multiple alternative multimedia data corresponding to the target multimedia data; and send the found alternative multimedia data to the target client through the communication interface 603, so that the target client outputs the found alternative multimedia data, thereby ensuring that the multimedia data sent by the server to the client meets the object requirements of the client.

[0176] Please refer to FIG. 7 again, which is a schematic structural diagram of another multimedia data processing device provided in an embodiment of the present application.

[0177] In one implementation of the device of the embodiment of the present application, the device includes the following structure.

[0178] Input unit 701, used to collect object information;

[0179] an output unit 702 configured to send the object information to a server, wherein the object information is used by the server to search for candidate multimedia data matching the object information among a plurality of candidate multimedia data corresponding to the target multimedia data, the plurality of candidate multimedia data being obtained by processing the target multimedia data based on data features of the target multimedia data, and wherein data content of each candidate multimedia data matches data content of the target multimedia data;

[0180] The input unit 701 is further configured to receive the found candidate multimedia data sent by the server;

[0181] The output unit 702 is further configured to output the found candidate multimedia data.

[0182] In one embodiment, the apparatus of the embodiment of the present application may further include a processing unit 703, the processing unit 703 being configured to obtain object prediction information, the object prediction information being configured to indicate whether the object has a requirement for repeated playback of the target multimedia data; if the object prediction information indicates that the object has a requirement for repeated playback of the target multimedia data, storing the found candidate multimedia data in a memory;

[0183] When the input unit 701 receives a request to play the target multimedia data, the processing unit 703 obtains the found candidate multimedia data from the memory;

[0184] The output unit 702 is further configured to output the found candidate multimedia data.

[0185] In an embodiment of the present application, the input unit 701 collects object information; the output unit 702 sends the object information to the server, and the object information is used by the server to search for alternative multimedia data that matches the object information among multiple alternative multimedia data corresponding to the target multimedia data. The multiple alternative multimedia data are obtained by processing the target multimedia data based on the data characteristics of the target multimedia data, and the data content of each alternative multimedia data matches the data content of the target multimedia data; the input unit 701 receives the found alternative multimedia data sent by the server; the output unit 702 outputs the found alternative multimedia data, which can ensure that the multimedia data output by the client meets the object requirements of the client.

[0186] Referring again to Figure 8, Figure 8 is a schematic diagram of the structure of a client provided in an embodiment of the present application. The client in this embodiment of the present application includes a power supply module and other structures, and includes a processor 801, a storage device 802, and a communication interface 803. The processor 801, the storage device 802, and the communication interface 803 can exchange data, and the processor 801 implements the corresponding multimedia data processing method.

[0187] The storage device 802 may include volatile memory, such as random-access memory (RAM); the storage device 802 may also include non-volatile memory, such as flash memory, solid-state drive (SSD), etc.; the storage device 802 may also include a combination of the above types of memory.

[0188] Processor 801 may be a central processing unit (CPU). Processor 801 may also be a combination of a CPU and a GPU. In the client, multiple CPUs and GPUs may be included as needed to perform corresponding data processing. In one embodiment, storage device 802 is used to store program instructions. Processor 801 may call program instructions to implement the various methods described above in the embodiments of this application.

[0189] In a first possible implementation, the client's processor 801 calls the program instructions stored in the storage device 802 to collect object information through the communication interface 803 and send the object information to the server, wherein the object information is used by the server to search for alternative multimedia data matching the object information among multiple alternative multimedia data corresponding to the target multimedia data, wherein the multiple alternative multimedia data are obtained by processing the target multimedia data based on the data characteristics of the target multimedia data, and the data content of each alternative multimedia data matches the data content of the target multimedia data; the found alternative multimedia data sent by the server is received through the communication interface 803; and the found alternative multimedia data is output through the communication interface 803.

[0190] In one embodiment, the processor 801 calls the program instructions stored in the storage device 802, and is also used to obtain object prediction information, wherein the object prediction information is used to indicate: whether the object has a requirement for repeated playback of the target multimedia data; if the object prediction information indicates that the object has a requirement for repeated playback of the target multimedia data, the found alternative multimedia data is stored in the memory; when a playback request for the target multimedia data is received, the found alternative multimedia data is obtained from the memory; and the found alternative multimedia data is output through the communication interface 803.

[0191] In an embodiment of the present application, the processor 801 collects object information; sends the object information to the server, and the object information is used by the server to search for alternative multimedia data that matches the object information among multiple alternative multimedia data corresponding to the target multimedia data. The multiple alternative multimedia data are obtained by processing the target multimedia data based on the data characteristics of the target multimedia data, and the data content of each alternative multimedia data matches the data content of the target multimedia data; receives the found alternative multimedia data sent by the server; and outputs the found alternative multimedia data, which can ensure that the multimedia data output by the client meets the object requirements of the client.

[0192] Those skilled in the art will appreciate that all or part of the processes in the above-described embodiments can be implemented by instructing the relevant hardware through a computer program. The program can be stored in a computer-readable storage medium. When executed, the program can include the processes of the above-described embodiments. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM). The computer-readable storage medium can mainly include a program storage area and a data storage area. The program storage area can store an operating system, at least one application required for a function, etc.; the data storage area can store data created based on the use of the blockchain node, etc.

[0193] The above disclosure is only part of the embodiments of the present application, and it is certainly not intended to limit the scope of the rights of the present application. Ordinary technicians in this field can understand that all or part of the processes of the above embodiments and equivalent changes made in accordance with the claims of this application are still within the scope of the present invention.

Claims

1. A method for processing multimedia data, characterized in that: include: Determine a plurality of candidate multimedia data corresponding to the target multimedia data, wherein the plurality of candidate multimedia data are obtained by processing the target multimedia data based on data features of the target multimedia data, and data content of each candidate multimedia data matches data content of the target multimedia data; Get the target client's object information; Searching for candidate multimedia data matching the object information among a plurality of candidate multimedia data corresponding to the target multimedia data; The found candidate multimedia data is sent to the target client, and the target client is used to output the found candidate multimedia data.

2. The method according to claim 1, characterized in that The method further comprises: Acquiring data features of the target multimedia data; Determining whether to generate candidate multimedia data corresponding to the target multimedia data according to data characteristics of the target multimedia data; If so, a plurality of candidate multimedia data corresponding to the target multimedia data are generated.

3. The method according to claim 2, characterized in that The determining, based on the data features of the target multimedia data, whether to generate candidate multimedia data corresponding to the target multimedia data includes: Comparing the data features of the target multimedia data with preset data features in a preset data feature set, wherein different objects have different requirements for multimedia data having the preset data features; If there is a preset data feature in the preset data feature set whose similarity with the data feature of the target multimedia data is greater than a preset similarity threshold, it is determined to generate candidate multimedia data corresponding to the target multimedia data.

4. The method according to claim 2, characterized in that: The generating a plurality of candidate multimedia data corresponding to the target multimedia data comprises: Acquiring a plurality of gear parameters according to data characteristics of the target multimedia data; The target multimedia data is adjusted to obtain multimedia data having parameters as parameters of each gear position; The obtained multiple multimedia data are used as multiple candidate multimedia data corresponding to the target multimedia data.

5. The method according to claim 2, characterized in that: The generating a plurality of candidate multimedia data corresponding to the target multimedia data comprises: Adding one or more auxiliary information to the target multimedia data to update the target multimedia data to obtain one or more updated target multimedia data; The target multimedia data and the one or more updated target multimedia data are used as multiple candidate multimedia data corresponding to the target multimedia data.

6. The method according to claim 1, characterized in that The object information includes one or more of the following: object behavior information, object emotion information; The searching for candidate multimedia data matching the object information among a plurality of candidate multimedia data corresponding to the target multimedia data includes: Searching for candidate multimedia data matching the object behavior information and / or the object emotion information among a plurality of candidate multimedia data corresponding to the target multimedia data.

7. A method for processing multimedia data, characterized in that: include: Collecting object information and sending the object information to a server, wherein the object information is used by the server to search for candidate multimedia data matching the object information among a plurality of candidate multimedia data corresponding to the target multimedia data, wherein the plurality of candidate multimedia data are obtained by processing the target multimedia data based on data features of the target multimedia data, and data content of each candidate multimedia data matches data content of the target multimedia data; Receiving the found candidate multimedia data sent by the server; The found candidate multimedia data is outputted.

8. The method according to claim 7, characterized in that The method further comprises: Obtaining object estimation information, where the object estimation information is used to indicate whether the object has a requirement for repeated playback of the target multimedia data; If the object estimation information indicates that the object has a demand for repeated playback of the target multimedia data, storing the found candidate multimedia data in a memory; When receiving a request to play the target multimedia data, acquiring the found candidate multimedia data from the memory; The found candidate multimedia data is outputted.

9. A multimedia data processing device, characterized in that: The device comprises: A processing unit is used to determine a plurality of candidate multimedia data corresponding to the target multimedia data, wherein the plurality of candidate multimedia data are obtained by processing the target multimedia data based on data features of the target multimedia data, and data content of each candidate multimedia data matches the data content of the target multimedia data; obtain object information of the target client; and search for candidate multimedia data matching the object information in the plurality of candidate multimedia data corresponding to the target multimedia data; The output unit is used to send the found candidate multimedia data to the target client, and the target client is used to output the found candidate multimedia data.

10. A multimedia data processing device, characterized in that: The device comprises: An input unit, used for collecting object information; an output unit, configured to send the object information to a server, wherein the object information is used by the server to search for candidate multimedia data matching the object information among a plurality of candidate multimedia data corresponding to the target multimedia data, wherein the plurality of candidate multimedia data are obtained by processing the target multimedia data based on data features of the target multimedia data, and data content of each candidate multimedia data matches data content of the target multimedia data; The input unit is further used to receive the found candidate multimedia data sent by the server; The output unit is further configured to output the found candidate multimedia data.

Images