Multimedia data processing method and device, multimedia data providing method and device, and system

A multimedia data and processing method technology, applied in the fields of devices and systems, multimedia data processing methods, and multimedia data providing methods, can solve the problem of affecting the user's viewing experience, the amount of video program playback, and the inability of minors to watch the normal video content of sensitive video programs, etc. problems, to achieve the effect of improving viewing experience, ensuring playback volume, and improving accuracy and efficiency

Inactive Publication Date: 2017-07-21

HUAWEI TECH CO LTD

6 Cites 15 Cited by

AI-Extracted Technical Summary

Problems solved by technology

[0005] In order to solve the problem of overall control over sensitive video programs, there are only two cases where sensitive video programs are allowed to play and prohibited to play, resulting in minors being unable to watch normal video co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine

Abstract

The invention discloses a multimedia data processing method, a multimedia data processing device, a multimedia data providing method, a multimedia data providing device and a system, and belongs to the field of playing of multimedia. The multimedia processing method comprises the steps of decoding acquired audio-video data to acquire an audio-video fragment; detecting whether a video program corresponding to the audio-video data includes a parent control identifier; if the video program includes the parent control identifier, acquiring a parent control parameter corresponding to the video program; if the audio-video fragment belongs to the specified audio-video fragment, processing the audio-video fragment according to the parent control parameter; playing the processed audio-video fragment, or stopping playing the audio-video fragment; and if the audio-video fragment does not belong to the specified audio-video fragment, playing the audio-video fragment. According to the methods, the devices and the system provided by the invention, juveniles are prevented from watching sensitive content in the video program without affecting the watching of normal video content in the video program, so that watching experience of the user is enhanced, and the amount of playing the video program is not affected.

Application Domain

Selective content distribution

Technology Topic

Control parametersData processing +2

Image

Examples

Experimental program(1)

Example Embodiment

[0076] In order to make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.

[0077] Please refer to Figure 1A , Which shows a system architecture diagram of a multimedia playback system provided by an embodiment of the present application. The multimedia playback system includes a video playback device 110 and a video server 120.

[0078] The video playback device 110 is an electronic device with audio and video data decoding and playback functions, and the electronic device is a smart phone, a tablet computer, or a personal computer. After the user uses the video playback device 110 to access the video website and selects the video program to watch, the user receives the audio and video data (also known as the audio and video stream) sent by the video server 120 corresponding to the video website via the Internet, so as to perform processing on the received audio and video data. Decoding playback.

[0079] In other possible implementations, such as Figure 1A As shown, the video playback device 110 may be composed of a TV set-top box 111 and a smart TV 112, where the TV set-top box 111 is a cable TV set-top box or an Internet TV set-top box. When the TV set-top box 111 is a cable TV set-top box, the cable TV set-top box converts the digital TV signal sent by the cable TV operator into the audio and video analog signal, and the smart TV 112 analyzes and plays the audio and video analog signal; when the TV set-top box 111 bit In the case of an Internet TV set-top box, the Internet TV set-top box receives the audio and video data provided by the Internet TV operator's server via the Internet, and sends the audio and video data to the smart TV 112 for analysis and playback.

[0080] In the embodiments of this application, such as Figure 1B As shown, when the video program that the user chooses to watch contains sensitive content and requires parental control, the video playback device 110 obtains the audio and video data while also obtaining the parental control parameters corresponding to the video program. Among them, for online on-demand video programs, For language and offline video programs, the parental control parameters are generated in advance; for live video programs, the parental control parameters are generated by the video server 120 in real time. For audio and video clips containing sensitive content, the video playback device 110 uses parental control parameters to process the decoded audio and video clips (obtained by decoding the received audio and video data), and plays the processed audio and video clips; For audio and video clips containing sensitive content, the video playback device 110 normally plays the decoded audio and video clips.

[0081] The video playback device 110 and the video server 120 are connected through a wired or wireless network.

[0082] The video server 120 is a server for providing video programs. The server is a server cluster or cloud computing center composed of several servers. Optionally, the video server 120 is a video server corresponding to a video website, a server corresponding to a cable TV operator, or a server corresponding to a network TV operator. In this embodiment of the application, for sensitive video programs that require parental control, the video server 120 not only provides the corresponding audio and video data to the video playback device 110, but also provides the video playback device 110 with parental control parameters corresponding to the sensitive video program to facilitate the video The playback device 110 performs corresponding processing on the sensitive content in the sensitive video program according to the parental control parameter.

[0083] For ease of description, in the following embodiments, the multimedia processing method is used for Figure 1A The video playback device 110 in the multimedia providing method is used for Figure 1A The video providing device 120 in Figure 2 is taken as an example for description.

[0084] Please refer to figure 2 , Which shows a flowchart of a multimedia processing method provided by an embodiment of the present application. This embodiment uses the multimedia processing method for Figure 1A The video playback device 110 is shown as an example, and the method includes:

[0085] Step 201: Decode the acquired audio and video data to obtain audio and video fragments.

[0086] Optionally, the audio and video data is data of online on-demand video programs provided by the video server, or live data of live video programs provided by the video server, or offline data of offline video programs stored locally by the video playback device.

[0087] Step 202: Detect whether the video program corresponding to the audio and video data contains a parental control identifier. The parental control identifier is used to indicate parental control of the video program.

[0088] For the acquired audio and video data, the video playback device further detects whether the video program corresponding to the audio and video data requires parental control.

[0089] In a possible implementation manner, the video playback device detects whether the video program contains the corresponding parental control identifier, and if the video program contains the corresponding parental control identifier, it is determined that the video program needs parental control; if the video program does not contain The corresponding parental control identifier determines that the video program does not require parental control, and directly plays the decoded audio and video clips. Wherein, the parental control identifier is set by the video server.

[0090] It should be noted that there is no strict sequential relationship between the above steps 201 and 202, that is, steps 201 and 202 can be performed at the same time or step 202 is performed before step 201. This embodiment only takes step 201 before step 202 as an example. The schematic description does not limit the application.

[0091] Step 203: If the video program contains a parental control identifier, obtain a parental control parameter corresponding to the video program. The parental control parameter is used to instruct to perform predetermined processing on a specified audio and video segment in the video program.

[0092] Optionally, when the video program is an online on-demand video program, the parental control parameter is pre-stored by the video server; when the video program is a live video program, the parental control parameter is determined by the video server based on real-time analysis of the live video program The result is generated; when the video program is an offline video program, the parental control parameters are included in the audio and video data of the offline video program.

[0093] Correspondingly, when the video program is an online on-demand video program, the video playback device obtains the complete parental control parameters of the online on-demand video program from the video server, or, according to the current playback process of the video program, obtains the corresponding play time period from the video server When the video program is a live video program, the video playback device receives the parental control parameters pushed by the video server in real time; when the video program is an offline video program, the video playback device collects the locally stored video, audio, and video data Get the parental control parameters.

[0094] Step 204: If the audio and video segment belongs to the designated audio and video segment, process the audio and video segment according to the parental control parameters; play the processed audio and video segment, or stop playing the audio and video segment.

[0095] For sensitive video programs that require parental control, since the sensitive video programs only specify audio and video segments (ie sensitive audio and video segments) that contain sensitive content, in a possible implementation manner, the sensitive video programs are During processing, the video playback device detects whether the current audio and video segment belongs to the designated audio and video segment indicated by the parental control parameter. If the current audio and video segment belongs to the designated audio and video segment, the audio and video segment will be processed according to the processing mode indicated by the parental control parameters; if the current audio and video segment does not belong to the designated audio and video segment, the audio and video segment will be played normally, thus While accurately processing sensitive content, it ensures the normal playback of normal audio and video clips (excluding sensitive content), reducing the impact on users' viewing. Among them, the ways of processing audio and video clips include masking, replacing, skipping, and so on.

[0096] Optionally, the video playback device plays the processed audio and video clip, or stops playing the audio and video clip (frame skipping).

[0097] Step 205: If the audio and video segment does not belong to the specified audio and video segment, the audio and video segment is played.

[0098] If the audio and video segment does not belong to the designated audio and video segment, the video playback device determines that the audio and video segment does not require parental control, and directly plays it.

[0099] To sum up, in this embodiment, when the video playback device detects that the video program to be played contains a parental control identifier, it further obtains the parental control parameters corresponding to the video program, and the currently decoded audio and video clips require parental control. The audio and video clips are processed according to the parental control parameters; when the currently decoded audio and video clips do not require parental control, the decoded audio and video clips are directly played, so as not to affect the normal video content in the video program. In this case, minors are prevented from watching sensitive content in video programs, which improves the user's viewing experience and ensures that the playback volume of video programs is not affected.

[0100] In a possible implementation manner, the parental control parameters include the designated audio and video clips (audio and video clips containing sensitive content) in the video program playing time, and the video playback device is determining whether it needs to decode the audio and video clips currently obtained. During the processing, it is to detect whether the playing moment of the current audio and video clip in the video program belongs to the playing time period of the designated audio and video clip. Illustrative embodiments are used for description below.

[0101] Please refer to Figure 3A , Which shows a flowchart of a multimedia processing method provided by another embodiment of the present application. This embodiment uses the multimedia processing method for Figure 1A The video playback device 110 is shown as an example, and the method includes:

[0102] Step 301: Decode the acquired audio and video data to obtain audio and video fragments.

[0103] In a possible implementation manner, since the video programs provided by the video server are updated quickly, in order to ensure the timeliness of the video programs, the video playback device obtains the programs of the video programs for playback from the video server at predetermined time intervals. Information and display the acquired program information so that users can choose to watch. The program information includes program name, program duration, program introduction, program broadcast address and other information. When the user chooses to watch the corresponding video program according to the displayed program information, the video playback device sends a video program acquisition request to the video server, requesting to acquire the audio and video data of the video program. Optionally, the audio and video data acquired by the video playback device is data of an online on-demand video program or data of a live video program.

[0104] In another possible implementation manner, when the user chooses to watch the offline video program downloaded in the video playback device, the video playback device directly obtains the corresponding audio and video data from the local storage space, instead of obtaining it from the server.

[0105] After obtaining the audio and video data, the video playback device decodes the audio and video data to obtain the corresponding audio and video fragments.

[0106] Step 302: Detect whether the video program corresponding to the audio and video data contains a parental control identifier. The parental control identifier is used to indicate parental control of the video program.

[0107] After the video playback device parses and obtains the audio and video segment, it does not directly play the audio and video segment, but further detects whether the video program to which the audio and video segment belongs needs parental control.

[0108] In a possible implementation manner, the program information obtained by the video playback device from the video server in advance includes a parental control identification bit, and the video playback device determines whether the video program is Parental control is required.

[0109] If it is detected that the parental control flag does not contain a parental control flag, it is determined that the video program does not require parental control, and step 303 is executed; if it is detected that the parental control flag contains a parental control flag, it is determined that the video program requires parental control. Control and execute the following step 304.

[0110] It should be noted that the video playback device may also determine whether the video program needs parental control in other ways, which is not limited in the embodiment of the present application.

[0111] Step 303: If the video program does not contain the parental control identifier, the audio and video clip is played.

[0112] If the video program does not contain the parental control identifier, it means that the video program does not contain sensitive content, and the video playback device directly plays the parsed audio and video clips. When receiving the subsequent audio and video data of the program, the video playback device directly analyzes and plays the audio and video data.

[0113] Step 304: If the video program contains a parental control identifier, display the parental control password input information, and obtain the input password.

[0114] If the video program contains a parental control identifier, it means that the video program contains sensitive content. In order to further determine whether the sensitive content in the video program needs to be processed, the video playback device prompts the user to enter a parental control password.

[0115] Step 305: If the input password is different from the preset parental control password, the parental control parameters corresponding to the video program are obtained, and the parental control parameters are used to instruct to perform predetermined processing on the specified audio and video clips in the video program.

[0116] Optionally, after obtaining the password input by the user, the video playback device detects whether the password input by the user is the same as the preset parental control password. If the password input is different from the preset parental control password, the video playback device determines that it needs sensitive information in the video program. The content is processed, and the parental control parameters corresponding to the video program are obtained; if the input password is the same as the preset parental control password, the video playback device directly plays the audio and video clips (the video program is played normally).

[0117] For different types of video programs, video playback devices obtain parental control parameters in different ways. In a possible implementation, such as Figure 3B As shown, this step includes the following steps.

[0118] Step 305A, when the video program is an online video program on demand, send a parental control parameter acquisition request to the video server, the parental control parameter acquisition request is used to acquire the parental control parameters corresponding to the predetermined time period after the current playing moment; receive the parental control sent by the video server parameter.

[0119] Optionally, since the online video on demand program is generated in advance and requested to be played by the user, that is, such programs have been produced before the user requests it. Therefore, manual or automatic methods can be used in the process of making online video on demand. Identify audio and video clips containing sensitive content in video programs, and generate corresponding parental control parameters for such audio and video clips.

[0120] When receiving a playback request for an online video-on-demand program, the video playback device obtains the parental control parameters corresponding to the predetermined time period after the current playback time from the video server by sending the request according to the current playback time, so as to use the parental control parameters to pair The audio and video clips within the predetermined time period are processed.

[0121] For example, the video playback device obtains that the current playback time is 10:00 (that is, the 10th minute of the video program), and sends a parental control parameter acquisition request to the video server, requesting to acquire the parental control parameters within 20 minutes after the current playback time. (That is, the parental control parameters corresponding to 10:00-30:00); when the playback reaches 30:00, the video playback device sends a parental control parameter acquisition request to the video server again, requesting the parental control within 20 minutes after the current playback time Parameters (that is, parental control parameters corresponding to 30:00-50:00).

[0122] Optionally, the video playback device obtains and stores the complete parental control parameters corresponding to the online on-demand video program from the video server. During subsequent playback, the video playback device processes the audio and video clips according to the complete parental control parameters.

[0123] Step 305B: When the video program is a live video program, the parental control parameters pushed by the video server in real time are received, and the parental control parameters are generated by the video server after real-time audio and image analysis of the live video program.

[0124] Since the live video program is generated in real time and sent to the video playback device in real time or quasi-real time, the parental control parameters corresponding to the live video program cannot be generated in advance. Optionally, for such time-sensitive video programs, the video server uses audio and image analysis technologies to analyze live video programs in real time, so as to analyze the sensitive content contained in the live video programs in real time, and based on the analysis results The generated parental control parameters are pushed to the video playback device. Correspondingly, the video playback device receives and stores the parental control parameters pushed by the video server in real time, so as to process the audio and video clips in real time according to the parental control parameters.

[0125] Step 305C: When the video program is an offline video program, obtain the parental control parameters included in the offline audio and video data.

[0126] Similar to online on-demand video programs, the parental control parameters of offline video programs are pre-generated and stored in offline audio and video data. When parental control of the played offline video programs is required, the video playback device obtains offline audio and video data Contains parental control parameters.

[0127] Optionally, when the offline video program contains a corresponding parental control identifier, but the offline audio and video data does not contain parental control parameters, the video playback device downloads the corresponding parental control parameters from the network according to the program identifier of the offline video program, And then realize the parental control of offline video programs.

[0128] Step 306: Obtain the playing moment of the audio and video clip in the video program.

[0129] Since only the specified audio and video clips in the sensitive video program contain sensitive content, that is, the video playback device only needs to process the audio and video clips that only specify the playback time period. Therefore, the video playback device obtains the playback moment of the current audio and video clip in the video program , And determine whether the current audio and video clip needs to be processed according to the playback moment. Wherein, the playing moment of the audio and video fragment in the video program may be the playing timestamp of the audio and video fragment.

[0130] For example, the video playback device acquires the playback timestamp of the current audio and video segment as 10:15.

[0131] Step 307: Obtain the control period included in the parental control parameter, where the control period is used to indicate the playing period of the designated audio and video clip in the video program.

[0132] In a possible implementation manner, the parental control parameters acquired by the video playback device include at least one control period, which indicates the play period of the designated audio and video segment (including sensitive content) in the video program.

[0133] Schematically, the storage structure of parental control parameters is shown in Table 1.

[0134] Table I

[0135] Control period Sensitive content type 18:12-18:13 Audio 35:29-35:38 video 51:59-52:10 Audio, video

[0136] Step 308: Detect whether the playing moment belongs to the control period.

[0137] After acquiring the playing moment of the current audio and video segment and the control period of the video program, the video playing device detects whether the playing moment belongs to the control period. If the playback moment does not belong to the control period, the video playback device determines that the current audio and video clip does not contain sensitive content, and performs the following steps 309 and 310; if the playback moment falls within the control period, the video playback device determines that the current audio and video clip contains Sensitive content, and perform the following steps 311 to 314.

[0138] Step 309: If the playing time does not belong to the control period, it is determined that the audio and video segment does not belong to the designated audio and video segment.

[0139] For example, in conjunction with Table 1, if the playback time corresponding to the current audio and video segment is 10:15, the video playback device determines that the current audio and video segment does not belong to the designated audio and video segment.

[0140] Step 310: If the audio and video segment does not belong to the specified audio and video segment, the audio and video segment is played.

[0141] Further, the video playback device directly plays the audio and video fragments parsed in step 301 above.

[0142] Step 311: If the playing time belongs to the control period, it is determined that the audio and video segment belongs to the designated audio and video segment.

[0143] For example, as shown in Table 1, if the playback time corresponding to the current audio and video segment is 18:12, the video playback device determines that the current audio and video segment belongs to the designated audio and video segment (for the control period 18:12-18:13).

[0144] Step 312: Obtain the sensitive content type included in the parental control parameter. The sensitive content type is used to indicate the type of sensitive content contained in the specified audio and video clip. The sensitive content type includes audio and/or video.

[0145] For different types of sensitive content, if the same processing method is adopted, it will affect the user's viewing experience. For example, for audio and video clips with sensitive audio content and normal video content, if the audio and video clips are directly shielded, the user's viewing experience will be affected. Therefore, in order to reduce the impact of parental control on user viewing when the parental control is implemented, in a possible implementation manner, the parental control parameters acquired by the video playback device include the sensitive content types corresponding to each control period. . Schematically, the corresponding relationship between the control period and the sensitive content type in the parental control parameters is shown in Table 1.

[0146] When it is determined that the current audio and video segment belongs to the control period, the video playback device further obtains the sensitive content type corresponding to the control period from the parental control parameters.

[0147] For example, in conjunction with Table 1, if the playback time corresponding to the current audio and video clip is 18:12, the video playback device acquires the sensitive content type corresponding to the control period 18:12-18:13 as audio.

[0148] Step 313: Process the audio and video clips according to the processing mode corresponding to the sensitive content type.

[0149] Further, according to the acquired type of sensitive content, the video playback device adopts a corresponding processing method to process the current audio and video segment.

[0150] In a possible implementation, such as Figure 3C As shown, this step includes the following steps.

[0151] In step 313A, when the sensitive content type is audio, the audio of the audio and video clip is shielded.

[0152] When it is determined that the sensitive content in the current audio and video clip is audio, in order to avoid affecting the video image, the video playback device shields the audio in the audio and video clip without processing the video image of the audio and video clip.

[0153] Step 313B: When the sensitive content type is video, the video frame of the audio and video clip is shielded, or the video frame is mosaicked.

[0154] When it is determined that the sensitive content in the current audio and video clip is a video, the video playback device only shields the video image of the audio and video clip, or performs mosaic processing on the video image, but does not process the audio of the audio and video clip.

[0155] Optionally, for sensitive content of the same type but different sensitivity, the video playback device uses different processing methods to process the audio and video clips. In a possible implementation, when the sensitive content type is video, the video playback device further obtains the sensitivity level corresponding to the control period to which the current audio and video clip belongs, and when the sensitivity level is higher than the threshold (the sensitive content is more sensitive) , Shield the video images of audio and video clips; when the sensitivity level is lower than the threshold, perform mosaic processing on the video images.

[0156] Step 313C: When the sensitive content types are audio and video, perform frame skipping processing on the audio and video clips, or replace the audio and video clips.

[0157] When it is determined that the sensitive content in the current audio and video segment is audio and video, the video playback device directly performs frame skipping processing on the audio and video segment (black screen processing can be used for live video programs), or replaces the audio and video segment.

[0158] Step 314: Play the processed audio and video clips.

[0159] After the audio and video clips are processed through the above step 313, the video playback device plays them.

[0160] In this embodiment, when the video playback device determines whether the current audio and video clip needs parental control, it obtains the playback time of the current audio and video clip and the playback time period of the specified audio and video clip that needs parental control. When the playing moment belongs to the playing period, it is determined that the current audio and video clip needs parental control, which realizes the accurate positioning of sensitive content in the video program and improves the accuracy and efficiency of processing the audio and video clip.

[0161] In this embodiment, when the video playback device processes an audio and video clip containing sensitive content, it determines a corresponding processing method according to the type of sensitive content in the audio and video clip, and uses the determined processing method to process the audio and video clip Under the premise of ensuring the processing effect of audio and video clips, reduce the impact of processed audio and video clips on the user's viewing experience.

[0162] In this embodiment, when the sensitive content in the audio and video clip is audio, the video playback device only shields the audio content of the audio and video clip and plays the video screen normally; when the sensitive content in the audio and video clip is video, the video The playback device only shields or mosaics the video images of the audio and video clips, and plays the audio content normally, so as to minimize the impact of audio and video processing on the user's viewing experience.

[0163] In this embodiment, for online on-demand video programs, the video playback device obtains parental control parameters from the video server in a requested manner, so that the parental control parameters are used to process audio and video clips within a period of time after the current playback time, so as to avoid users The waste of resources caused by obtaining complete parental control parameters at one time when the online VOD program is not fully watched;

[0164] For live video programs, the video server performs real-time audio and image analysis on live video programs to generate corresponding parental control parameters, and push them to the video playback device in real time, so that the video playback device can perform real-time parental control parameters on the live video program. Real-time processing of sensitive content;

[0165] For offline video programs, the video playback device obtains the parental control parameters contained in the offline audio and video data, and processes the sensitive content in the offline video programs according to the parental control parameters, thereby achieving shielding of the sensitive content in the offline video program.

[0166] Please refer to Figure 4A , Which shows a flowchart of a multimedia providing method provided by an embodiment of the present application. This embodiment uses the multimedia providing method for Figure 1A The video server 120 is shown as an example, and the method includes:

[0167] Step 401: Receive a video program acquisition request sent by a video playback device, where the video program acquisition request includes an identifier of the video program.

[0168] Since the video program provided by the video server is updated quickly, in order to ensure the timeliness of the video program, in a possible implementation manner, the video server provides the video program information to the video playback device at predetermined time intervals for the video The playback device displays the program information, where the program information includes information such as the program name, program duration, program introduction, and program playback address.

[0169] When the user chooses to watch the corresponding video program according to the displayed program information, the video playback device sends a video program acquisition request to the video server, requesting to acquire the audio and video data of the video program. The corresponding video server receives the video program acquisition request.

[0170] Step 402: Provide audio and video data of the video program to the video playback device according to the video program acquisition request, and the video playback device is used to decode the audio and video data to obtain audio and video fragments.

[0171] Optionally, the video server obtains corresponding audio and video data according to the video program identifier included in the video program obtaining request, and sends it to the video playback device.

[0172] Among them, when the video program requested by the video playback device is an online on-demand video program, the live server sends the stored data to the video playback server in the form of a stream; when the video program requested by the video playback device is a live video program, the live server is Send the live data obtained in real time to the video playback server in the form of a stream.

[0173] Step 403: If the video program contains a parental control identifier, provide parental control parameters corresponding to the video program to the video playback device. The parental control parameters are used to instruct to perform predetermined processing on the specified audio and video clips in the video program, and the video playback device is also used to When the audio and video segment belongs to the designated audio and video segment, the audio and video segment processed by the parental control parameters is played.

[0174] For video programs that require parental control, the video server sets a parental control identifier for them in advance. When it is detected that the video program requested by the video playback device contains a parental control identifier, the video server sends the audio and video data while providing corresponding parental control parameters to the video playback device.

[0175] Optionally, when the requested video program is an online on-demand video program, the video server provides the video playback device with pre-generated parental control parameters; when the requested video program is a live video program, the video server provides the video playback device with real-time generation Parental control parameters.

[0176] Optionally, the parental control parameters provided by the video server include the sensitive content type, and the sensitive content type is used to indicate the type of sensitive content contained in the specified audio and video clips in the video program, and the sensitive content type includes audio and/or video. The video playback device processes the audio and video clips according to the corresponding processing method of the sensitive content type.

[0177] To sum up, in this embodiment, when the video program requested by the video playback device to be played requires parental control, the video server provides audio and video data to the video playback device while providing the video playback device with the parental control parameters of the video program. Enable the video playback device to process the decoded audio and video fragments according to the parental control parameters, and play the processed audio and video fragments; avoid minors without affecting the normal video content in the video program Watching sensitive content in video programs improves the user's viewing experience and ensures that the volume of video programs is not affected.

[0178] In a possible implementation, when the video program requested by the video playback device is an online on-demand video program, such as Figure 4B As shown, the above step 403 includes the following steps.

[0179] Step 403A: When the video program is an online on-demand video program, receive a parental control parameter acquisition request sent by the video playback device. The parental control parameter acquisition request is used to acquire the parental control parameter corresponding to a predetermined time period after the current playing moment.

[0180] Because online VOD programs are generated in advance and requested to be played by users, that is, such programs have been produced before the user requests. Therefore, in the process of making online VOD programs, manual or automatic methods can be used to identify video programs. Contains audio and video clips of sensitive content, and generates corresponding parental control parameters for such audio and video clips.

[0181] When receiving a playback request for an online video-on-demand program, the video playback device obtains the parental control parameters corresponding to the predetermined time period after the current playback time from the video server by sending the request according to the current playback time, so as to use the parental control parameters to pair The audio and video clips within the predetermined time period are processed.

[0182] For example, the parental control parameter acquisition request received by the video server includes the current playback time 10:00 and the scheduled time period of 20 minutes, indicating that the video playback device requests to acquire the parental control parameters corresponding to the 10th to 30th minute of the video program; when the playback reaches 30: At 00:00, the video playback device sends a parental control parameter acquisition request to the video server again. The request includes the current playback time 30:00 and a predetermined period of 20 minutes (request to acquire the parental control parameters corresponding to the 30th to 50th minutes of the video program).

[0183] Step 403B: Provide the parental control parameter indicated by the parental control parameter acquisition request to the video playback device.

[0184] Optionally, the video server searches for the corresponding parental control parameters according to the current playing moment and the predetermined time period contained in the parental control parameter acquisition request, and returns them to the video playback device, so that the video playback device can determine the subsequent playback audio according to the parental control parameters. Parental control of video clips.

[0185] In other possible implementation manners, the video playback device may also request to obtain complete parental control parameters corresponding to the online on-demand video program. Accordingly, the video server provides the found complete parental control parameters to the video playback device.

[0186] In another possible implementation manner, when the video program requested by the video playback device is a live video program, such as Figure 4B As shown, the above step 403 also includes the following steps.

[0187] Step 403C: When the video program is a live video program, perform real-time audio and image analysis on the live video program.

[0188] Since the live video program is generated in real time and sent to the video playback device in real time or quasi-real time, the parental control parameters corresponding to the live video program cannot be generated in advance.

[0189] Optionally, for such video programs with high timeliness, the video server uses audio and image analysis technologies to perform real-time analysis on the live video program, so as to analyze in real time whether the live video program contains sensitive content.

[0190] The embodiments of the present application do not limit which audio and image analysis techniques are used.

[0191] Step 403D: Provide the video playback device with generating parental control parameters based on the analysis result.

[0192] Further, the video server generates corresponding parental control parameters according to the analysis results, and pushes them to the video playback device in real time. Optionally, the parental control parameters generated by the video server include the control period (indicating that the specified audio and video content is in the playing period), the type of sensitive content (audio and/or video), and the sensitivity level (indicating the sensitivity of the sensitive content, the degree of sensitivity The higher the level, the more sensitive the content).

[0193] Correspondingly, the video playback device receives and stores the parental control parameters pushed by the video server in real time, so as to process the audio and video clips in real time according to the parental control parameters.

[0194] In this embodiment, for online on-demand video programs, the video playback device obtains parental control parameters from the video server in a requested manner, so that the parental control parameters are used to process audio and video clips within a period of time after the current playback time, so as to avoid users The waste of resources caused by obtaining complete parental control parameters at one time when the online VOD program is not fully watched;

[0195] For live video programs, the video server performs real-time audio and image analysis on the live video programs to generate corresponding parental control parameters and push them to the video playback device in real time, so that the video playback device can perform real-time parental control parameters on the live video programs. Sensitive content is processed in real time.

[0196] The following are device embodiments of the embodiments of the application. For parts that are not described in detail in the device embodiments, reference may be made to the details in the above method embodiments.

[0197] Please refer to Figure 5 , Which shows a structural block diagram of a video playback device provided by an embodiment of the present application. The video playback device includes: a transceiver 510, a processor 520, and a memory 530.

[0198] The transceiver 510 includes a receiver and a transmitter, which are used to receive external data and send external data, respectively.

[0199] The processor 520 is respectively connected to the transceiver 510 and the memory 530 through a bus.

[0200] The processor 530 includes one or more processing cores. The processor 530 implements a video playback function by running an operating system or an application program module.

[0201] Optionally, the memory 530 may store an operating system 531 and an application module 532 required by at least one function. Optionally, the application module 532 includes a decoding module 532a, a detection module 532b, an acquisition module 532c, a processing module 532d, and a playback module 532e. Among them, the decoding module 532a is used to implement audio and video data decoding related steps; the detection module 532b is used to implement detection related steps; the acquisition module 532c is used to implement acquisition related steps; the processing module 532d is used to implement processing audio and video related steps ; The playing module 532e is used to implement steps related to playing the video.

[0202] In addition, the memory 530 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Except for programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash memory, magnetic disks or optical disks.

[0203] Those skilled in the art can understand, Figure 5 The structure shown in the figure does not constitute a limitation on the video playback device. The video playback device may include more or less components than those shown in the figure, or a combination of certain components, or different component arrangements.

[0204] Please refer to Image 6 , Which shows a block diagram of a multimedia processing device provided by an embodiment of the present application. The device can be implemented as all or part of the video playback device through software, hardware or a combination of both. The device includes: a decoding unit 610, a detection unit 620, an acquisition unit 630, a processing unit 640, and a playback unit 650.

[0205] The decoding unit 610 is used to implement the function of the above step 201 or 301, and other implicit audio and video data decoding related steps;

[0206] The detection unit 620 is configured to implement the functions of the above steps 202, 302, 308, 309, and 311, and other implicit detection-related steps;

[0207] The obtaining unit 630 is configured to implement the functions of steps 203, 304, 305 (including 305A to 305C), 306, and 307, and other implicit steps related to obtaining parental control parameters;

[0208] The processing unit 640 is configured to implement the functions of the above steps 204, 312, and 313 (including 313A to 313C), and other implicit processing related to audio and video steps;

[0209] The playing unit 650 is used to implement the above steps 205, 303, 310, 314 and other implicit steps related to playing audio and video clips.

[0210] Among them, the decoding unit 610 may be Figure 5 The processor 520 in the memory 530 executes the decoding module 532a in the memory 530; the detection unit 620 may be implemented by Figure 5 The processor 520 in the memory 530 executes the detection module 532b in the memory 530; the acquisition unit 630 can be implemented by Figure 5 The processor 520 in the memory 530 executes the acquisition module 532c in the memory 530; the processing unit 640 may be implemented by Figure 5 The processor 520 in the memory 530 executes the processing module 532d in the memory 530; the playback unit 650 can be implemented by Figure 5 The processor 520 in the memory 530 executes the playback module 532e in the memory 530 for implementation.

[0211] Please refer to Figure 7 , Which shows a structural block diagram of a video server provided by an embodiment of the present application. The video server includes a transceiver 710, a processor 720, and a memory 730.

[0212] The transceiver 710 includes a receiver and a transmitter, which are respectively used for receiving external data and sending external data.

[0213] The processor 720 is respectively connected to the transceiver 710 and the memory 730 through a bus.

[0214] The processor 730 includes one or more processing cores. The processor 530 implements a video providing function by running an operating system or an application program module.

[0215] Optionally, the memory 730 may store an operating system 731 and an application program module 732 required by at least one function. Optionally, the application module 732 includes a receiving module 732a and a providing module 732b. Among them, the receiving module 732a is used to implement receiving requests and data-related steps; the providing module 732b is used to implement data-related steps.

[0216] In addition, the memory 730 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Except for programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash memory, magnetic disks or optical disks.

[0217] Those skilled in the art can understand, Figure 7 The structure shown in the figure does not constitute a limitation on the video server, and the video server may include more or less components than those shown in the figure, or a combination of certain components, or different component arrangements.

[0218] Please refer to Picture 8 , Which shows a block diagram of a multimedia providing apparatus provided by an embodiment of the present application. The device can be implemented as all or a part of the video server through software, hardware or a combination of both. The device includes: a receiving unit 810 and a providing unit 820.

[0219] The receiving unit 810 is configured to implement the function of step 401 and other implicitly related steps of receiving the request;

[0220] The providing unit 820 is used to implement the functions of the above steps 402 and 403 (including 403A to 403D), and other implicit steps related to providing audio and video data and parental control parameters.

[0221] Among them, the receiving unit 810 can be Figure 7 The processor 720 in the memory 730 executes the receiving module 732a in the memory 730; the providing unit 820 can be implemented by Figure 7 The processor 720 in the memory 730 executes the implementation of the providing module 732b in the memory 730.

[0222] Those of ordinary skill in the art can understand that all or part of the steps in the foregoing embodiments can be implemented by hardware, or by a program instructing related hardware to be completed. The program can be stored in a computer-readable storage medium. The storage medium mentioned can be a read-only memory, a magnetic disk or an optical disk, etc.

[0223] The above are only exemplary embodiments of this application and are not intended to limit this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in the protection of this application. Within range.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine

Login to view more

PUM

Description & Claims & Application Information

We can also present the details of the Description, Claims and Application information to help users get a comprehensive understanding of the technical details of the patent, such as background art, summary of invention, brief description of drawings, description of embodiments, and other original content. On the other hand, users can also determine the specific scope of protection of the technology through the list of claims; as well as understand the changes in the life cycle of the technology with the presentation of the patent timeline. Login to view more.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine

Login to view more

Classification and recommendation of technical efficacy words

Improve viewing experience
Improve efficiency and accuracy

Multimedia data processing method and device, multimedia data providing method and device, and system

AI-Extracted Technical Summary

Problems solved by technology

Abstract

Image

Examples

Example Embodiment

PUM

Description & Claims & Application Information

Similar technology patents

Positioning method of fault points in power distribution network mixed circuits

Electricity metering equipment fault analysis method and device

A method and system for advertisement insertion in network TV living broadcast program

Malicious application detection system and method for android mobile phone

Method for identifying flow type of soft grain two-phase turbulence based on artificial intelligence

Classification and recommendation of technical efficacy words

Video playing processing method, device, terminal and system

Video frequency broadcast and control method as well as device

System and method for providing adaptive media optimization

Video content pushing method and system

Coordinating Device Interaction To Enhance User Experience

Advertisement playing system and method based on image identification

Feature item selection and weight calculation based text classification method

LSTM deep learning model-based hydropower unit fault diagnosis method and system

Realization method of atrial fibrillation detection based on deep convolutional neural network

Android malicious software detecting platform oriented to mobile internet