Multimedia data control method and device

Abstract

The present invention relates to a method and device for controlling multimedia data, comprising: if the user's voice information is monitored, the voice information is identified to obtain the user's intention information, the user's age and the sensitive word recognition result; if the user's age is less than a preset age, and the sensitive word recognition result indicates that it does not contain sensitive words, at least one multimedia data corresponding to the user's intention information and the category of each multimedia data are obtained; multimedia data whose category meets the preset output conditions is selected as the target output multimedia data for output, thereby filtering the multimedia data and preventing the user from contacting unnecessary multimedia data.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent devices, and in particular to a method and device for controlling multimedia data. Background Art

[0002] With the promotion of online TV programs and online novels, a large number of TV programs and novels can be watched through smart devices. At the same time, various smart devices, such as set-top boxes and TVs, support voice control and search functions. Voice data is collected through the microphone built into the remote control or smart device, and after voice recognition and semantic understanding, the control command is formed, and the smart device responds to the corresponding command. For example, if you say "I want to watch Snow White", the smart device will provide the program content named "Snow White" and the program content and novels related to this name.

[0003] However, it is easy for users to search for content that they do not need. For example, when a minor verbally says "I want to watch Snow White", his original intention is to watch the cartoon "Snow White", but the smart device will provide program content related to "Snow White".

[0004] Therefore, how to prevent users from searching for unnecessary multimedia data is a technical problem that needs to be solved urgently by those skilled in the art. Summary of the invention

[0005] The present invention provides a method and device for controlling multimedia data, so as to solve the technical problem in the prior art that intelligent devices output multimedia data matching user requirements.

[0006] The technical solution of the present invention to solve the above technical problems is as follows:

[0007] A method for controlling multimedia data, comprising:

[0008] If the user's voice information is monitored, the voice information is recognized to obtain the user's intention information, user age and sensitive word recognition results;

[0009] If the user's age is less than a preset age, and the sensitive word recognition result indicates that it does not contain sensitive words, obtaining at least one piece of multimedia data corresponding to the user's intention information and a category of each piece of multimedia data;

[0010] Multimedia data of a category that meets a preset output condition is selected as target output multimedia data for output.

[0011] Furthermore, the multimedia data control method described above further includes:

[0012] If the user's age is younger than the preset age, and the sensitive word recognition result indicates that sensitive words are contained, the current multimedia data being output is maintained.

[0013] Furthermore, the multimedia data control method described above further includes:

[0014] If the user's age is less than a preset age, and the sensitive word recognition result indicates that sensitive words are contained, filtering multimedia data matching the sensitive words in the current multimedia data to obtain filtered multimedia data;

[0015] The filtered multimedia data is output.

[0016] Furthermore, in the above-mentioned multimedia data control method, if the user's age is younger than a preset age, and the sensitive word recognition result indicates that sensitive words are contained, a guiding voice is output.

[0017] Furthermore, the multimedia data control method described above further includes:

[0018] Acquire a user's feedback voice in response to the output guidance voice;

[0019] Determining the user's current emotion according to the feedback voice;

[0020] If the user's current emotion indicates dissatisfaction with the guidance voice, the guidance voice is adjusted and the adjusted guidance voice is output.

[0021] Furthermore, the multimedia data control method described above further includes:

[0022] Obtaining the number of times the guiding voice is adjusted;

[0023] If the number of times reaches a preset threshold, a warning message is generated;

[0024] The warning information is sent to a preset monitoring terminal.

[0025] Furthermore, in the above-mentioned method for controlling multimedia data, the process of classifying each category of the multimedia data includes:

[0026] Dividing according to the collected description information of the multimedia data and / or the perception information of the multimedia data;

[0027] The perception information of the multimedia data includes perception evaluation and / or user emotions during viewing of the multimedia data.

[0028] The present invention also provides a multimedia data control device, comprising:

[0029] The recognition module is used to recognize the user's voice information if it is monitored, and obtain the user's intention information, user age and sensitive word recognition results;

[0030] an acquisition module, configured to acquire at least one piece of multimedia data corresponding to the user intention information and a category of each piece of multimedia data if the user's age is less than a preset age and the sensitive word recognition result indicates that it does not contain sensitive words;

[0031] The output module is used to select multimedia data whose categories meet preset output conditions as target output multimedia data for output.

[0032] The present invention also provides a multimedia data control device, comprising: a processor and a memory;

[0033] The processor is used to execute the multimedia data control program stored in the memory to implement any of the multimedia data control methods described above.

[0034] The present invention also provides a storage medium, wherein the storage medium stores one or more programs, and the one or more programs can be executed to implement any of the multimedia data control methods described above.

[0035] The beneficial effects of the present invention are:

[0036] By monitoring the user's voice information, the voice information is identified to obtain user intention information, user age and sensitive word recognition results; if the user's age is less than the preset age, and the sensitive word recognition result indicates that it does not contain sensitive words, at least one multimedia data corresponding to the user's intention information and the category of each multimedia data are obtained; multimedia data whose category meets the preset output conditions is selected as the target output multimedia data for output, thereby filtering the multimedia data and preventing the user from being exposed to unnecessary multimedia data. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 A flowchart of an embodiment of a method for controlling multimedia data of the present invention;

[0038] Figure 2 A schematic diagram of the structure of an embodiment of a multimedia data control device of the present invention;

[0039] Figure 3 It is a structural schematic diagram of the multimedia data control device of the present invention. DETAILED DESCRIPTION

[0040] The principles and features of the present invention are described below in conjunction with the accompanying drawings. The examples given are only used to explain the present invention and are not used to limit the scope of the present invention.

[0041] Figure 1 FIG. 1 is a flow chart of an embodiment of a method for controlling multimedia data of the present invention, as shown in FIG. Figure 1 As shown, the multimedia data control method of this embodiment may specifically include the following steps:

[0042] 100. If the user's voice information is monitored, the voice information is recognized to obtain the user's intention information, the user's age and sensitive word recognition results;

[0043] In a specific implementation process, the user's voice information can be monitored and collected through a microphone in a remote control or smart device, and then the collected user's voice information is recognized to obtain user intention information, user age, and sensitive word recognition results.

[0044] Specifically, the collected user's voice information can be converted into text, and the user's intention information and sensitive word recognition results can be identified. The user's age can be identified based on the user's voiceprint and other features.

[0045] 101. If the user is younger than a preset age and the sensitive word recognition result indicates that it does not contain sensitive words, obtaining at least one piece of multimedia data corresponding to the user intention information and a category of each piece of multimedia data;

[0046] In a specific implementation process, it is possible to determine whether the user's age is younger than a preset age, thereby determining whether the user is a minor. If the user's age is younger than the preset age, it means that the user is a minor. If the sensitive word recognition result indicates that it does not contain sensitive words, at least one multimedia data corresponding to the user's intention information and the category of each multimedia data can be obtained. The category of each multimedia data can be a superior category, a general category, etc.

[0047] Among them, the process of dividing the categories of each multimedia data includes: dividing according to the collected description information of the multimedia data and / or the perception information of the multimedia data; wherein the perception information of the multimedia data includes perception evaluation and / or user emotions during viewing of the multimedia data.

[0048] In a specific implementation process, when the multimedia data is classified according to the user's emotions during viewing the multimedia data, the smart device can cooperate with other smart terminals. For example, the user's heartbeat and other information during viewing the multimedia data can be collected through a smart bracelet, and then the user's emotions can be determined based on the user's heartbeat, and then the multimedia data corresponding to the user's emotions can be classified into levels, thereby forming a user-specific level and realizing personalized category division. For example, a certain video content may be classified as restricted for user A, and may be classified as general for user B.

[0049] 102. Select multimedia data whose categories meet preset output conditions as target output multimedia data for output.

[0050] Specifically, multimedia data corresponding to the superior class may be selected as target output multimedia data for output.

[0051] The multimedia data control method of this embodiment detects the user's voice information, identifies the voice information, obtains the user's intention information, the user's age and the sensitive word recognition result; if the user's age is less than the preset age, and the sensitive word recognition result indicates that it does not contain sensitive words, obtains at least one multimedia data corresponding to the user's intention information and the category of each multimedia data; selects multimedia data whose category meets the preset output condition as the target output multimedia data for output, thereby filtering the multimedia data and preventing the user from contacting unnecessary multimedia data.

[0052] In a specific implementation process, if the user's age is younger than a preset age and the sensitive word recognition result indicates that sensitive words are contained, the current multimedia data being output is maintained.

[0053] In a specific implementation process, if the user's age is younger than a preset age, and the sensitive word recognition result indicates that it contains sensitive words, the multimedia data matching the sensitive words in the current multimedia data can also be filtered to obtain filtered multimedia data, and the filtered multimedia data can be output.

[0054] Specifically, after the smart device is turned on, there will be a default display list. When the user's age is younger than the preset age and the sensitive word recognition result indicates that it contains sensitive words, in order to ensure that the user cannot see the multimedia data matching the sensitive words from the default interface, the multimedia data matching the sensitive words in the current multimedia data can be filtered to obtain filtered multimedia data, and the filtered multimedia data can be output, further ensuring that the smart device outputs multimedia content that matches the user's needs.

[0055] In a specific implementation process, if the user's age is younger than a preset age, and the sensitive word recognition result indicates that it contains sensitive words, a guiding voice may also be output to enable the user to input voice information again.

[0056] In a specific implementation process, after the user gives feedback on the guidance voice, the user's feedback voice on the output guidance voice can be obtained; according to the obtained feedback voice, the user's current emotion is determined; if the user's current emotion indicates dissatisfaction with the guidance voice, the guidance voice is adjusted and the adjusted guidance voice is output. The number of times the guidance voice is adjusted is counted. If the number of times the guidance voice is adjusted reaches a preset threshold, it indicates that the user's personality may have defects. At this time, an early warning message can be generated; the early warning message is sent to a preset monitoring terminal to notify the user's guardian so that the user's guardian can correct the user's behavior in time.

[0057] In a specific implementation process, if the user's age is greater than or equal to the preset age, the corresponding multimedia data can be directly output according to the user's intention information. However, when the user views the selected multimedia data, the surrounding sounds can be monitored in real time. When the voice information of the user whose age is younger than the preset age is detected, it is determined whether the preset output condition is met according to the category of the currently output multimedia data. If not, the output is stopped to prevent all users from viewing the currently output multimedia data at the same time. If it is met, the output continues.

[0058] The technical solution of the present invention is described below with specific examples:

[0059] (1) Speaker narration, for example, when someone utters “I want to watch Snow White”, the collected user’s voice information is converted into the intention of “I want to watch” and TV programs related to “Snow White” through voice collection, voice recognition, semantic understanding and other technical means.

[0060] (2) Speech recognition technology is used to identify speech and label the speakers as minors or adults.

[0061] (3) The sensitive words in the intent are extracted through sensitive word recognition technology. If there are sensitive words that are not suitable for users younger than the preset age, the intent is not executed, and a prompt is given and the smart device is locked. If there are no sensitive words, such as the user wants to watch "Snow White", the intent is executed.

[0062] (4) Through content search technology, search for TV programs related to "Snow White" in the background database and the Internet, obtain a result list, and save it to the database. The content classification module classifies the programs in the list one by one.

[0063] (5) When the speaker is a user whose age is younger than a preset age, the content whose categories do not meet the preset output conditions is blocked, and only the content that meets the preset output conditions is displayed.

[0064] It should be noted that the method of the embodiment of the present invention can be performed by a single device, such as a computer or a server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present invention, and the multiple devices will interact with each other to complete the method.

[0065] Figure 2 FIG. 1 is a schematic diagram of a structure of an embodiment of a multimedia data control device of the present invention. Figure 2 As shown, the multimedia data control device of this embodiment may include an identification module 20 , an acquisition module 21 and an output module 22 .

[0066] The recognition module 20 is used to recognize the user's voice information if it is monitored, and obtain the user's intention information, user age and sensitive word recognition results;

[0067] An acquisition module 21, configured to acquire at least one piece of multimedia data corresponding to the user intention information and a category of each piece of multimedia data if the user's age is less than a preset age and the sensitive word recognition result indicates that it does not contain sensitive words;

[0068] The output module 22 is used to select multimedia data whose categories meet preset output conditions as target output multimedia data for output.

[0069] The multimedia data control device of this embodiment monitors the user's voice information, identifies the voice information, and obtains user intention information, user age and sensitive word recognition results; if the user's age is younger than the preset age, and the sensitive word recognition result indicates that it does not contain sensitive words, obtains at least one multimedia data corresponding to the user intention information and the category of each multimedia data; selects multimedia data whose category meets the preset output conditions as the target output multimedia data for output, thereby realizing the removal of multimedia data that is not suitable for minors, restricted multimedia data, etc., and preventing minors from being exposed to inappropriate multimedia data.

[0070] In a specific implementation process, the output module 22 is also used to maintain the output of the current multimedia data if the user's age is younger than a preset age and the sensitive word recognition result indicates that sensitive words are contained.

[0071] In a specific implementation process, the output module 22 is also used to filter the multimedia data matching the sensitive words in the current multimedia data if the user's age is younger than a preset age and the sensitive word recognition result indicates that it contains sensitive words, obtain filtered multimedia data, and output the filtered multimedia data.

[0072] Specifically, after the smart device is turned on, there will be a default display list. When the user's age is younger than the preset age and the sensitive word recognition result indicates that it contains sensitive words, in order to ensure that the user cannot see the multimedia data matching the sensitive words from the default interface, the multimedia data matching the sensitive words in the current multimedia data can be filtered to obtain filtered multimedia data, and the filtered multimedia data can be output, further ensuring that the smart device outputs multimedia content that matches minors.

[0073] In a specific implementation process, the output module 22 is also used to output a guiding voice if the user's age is younger than a preset age and the sensitive word recognition result indicates that a sensitive word is contained, so that the user can input voice information again.

[0074] In a specific implementation process, after the user gives feedback on the guidance voice, the user's feedback voice on the output guidance voice can be obtained; according to the obtained feedback voice, the user's current emotion is determined; if the user's current emotion indicates dissatisfaction with the guidance voice, the guidance voice is adjusted and the adjusted guidance voice is output. The number of times the guidance voice is adjusted is counted. If the number of times the guidance voice is adjusted reaches a preset threshold, it indicates that the user's personality may have defects. At this time, an early warning message can be generated; the early warning message is sent to a preset monitoring terminal to notify the user's guardian so that the user's guardian can correct the user's behavior in time.

[0075] In a specific implementation process, the output module 22 is also used to directly output the corresponding multimedia data according to the user intention information if the user's age is greater than or equal to the preset age. However, when the user views the selected multimedia data, the user can monitor the surrounding sounds in real time. When the voice information of the user whose age is younger than the preset age is monitored, it is determined whether the preset output condition is met according to the category of the currently output multimedia data. If not, the output is stopped to prevent adults and minors from viewing the currently output multimedia data at the same time. If it is met, the output continues.

[0076] The device of the above embodiment is used to implement the corresponding method in the above embodiment. Its specific implementation scheme can refer to the method recorded in the above embodiment and the relevant description in the method embodiment, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0077] Figure 3 FIG. 1 is a schematic diagram of the structure of a multimedia data control device of the present invention. Figure 3 As shown, the multimedia data control device of this embodiment may include: a processor 1010 and a memory 1020. Those skilled in the art will appreciate that the device may also include an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other in communication within the device via the bus 1050.

[0078] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0079] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.

[0080] The input / output interface 1030 is used to connect the input / output module 22 to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device can include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device can include a display, a speaker, a vibrator, an indicator light, etc.

[0081] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).

[0082] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).

[0083] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.

[0084] The present invention also provides a storage medium storing one or more programs, wherein the one or more programs can be executed to implement the multimedia data control method of the above embodiment.

[0085] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0086] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples. Within the scope of the present invention, the above embodiments or technical features in different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the present invention as described above, which are not provided in detail for the sake of simplicity.

[0087] In addition, to simplify the description and discussion, and in order not to obscure the present invention, known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided figures. In addition, the devices may be shown in the form of block diagrams to avoid obscuring the present invention, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the present invention will be implemented (i.e., these details should be fully within the scope of understanding of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present invention, it will be apparent to those skilled in the art that the present invention may be implemented without these specific details or with variations in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0088] Although the invention has been described in conjunction with specific embodiments of the invention, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0089] The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A method for controlling multimedia data, characterized in that: include: If the user's voice information is monitored, the voice information is recognized to obtain the user's intention information, user age and sensitive word recognition results; If the user's age is younger than a preset age, and the sensitive word recognition result indicates that it does not contain sensitive words, obtaining at least one piece of multimedia data corresponding to the user's intention information and a category of each of the multimedia data, and selecting multimedia data whose category meets a preset output condition as target output multimedia data for output; If the user's age is younger than the preset age, and the sensitive word recognition result indicates that sensitive words are included, any of the following processing is performed: Maintain the current multimedia data being output, or filtering multimedia data matching the sensitive word in the current multimedia data to obtain filtered multimedia data, and outputting the filtered multimedia data; or Output guidance voice.

2. The method for controlling multimedia data according to claim 1, characterized in that: Also includes: Acquire a user's feedback voice in response to the output guidance voice; Determining the user's current emotion according to the feedback voice; If the user's current emotion indicates dissatisfaction with the guidance voice, the guidance voice is adjusted and the adjusted guidance voice is output.

3. The method for controlling multimedia data according to claim 2, characterized in that: Also includes: Obtaining the number of times the guiding voice is adjusted; If the number of times reaches a preset threshold, a warning message is generated; The warning information is sent to a preset monitoring terminal.

4. The method for controlling multimedia data according to claim 1, characterized in that: The process of classifying each category of the multimedia data includes: Dividing according to the collected description information of the multimedia data and / or the perception information of the multimedia data; The perception information of the multimedia data includes perception evaluation and / or user emotions during viewing of the multimedia data.

5. A multimedia data control device, characterized in that: include: The recognition module is used to recognize the user's voice information if it is monitored, and obtain the user's intention information, user age and sensitive word recognition results; an acquisition module, configured to acquire at least one piece of multimedia data corresponding to the user intention information and a category of each piece of multimedia data if the user's age is less than a preset age and the sensitive word recognition result indicates that it does not contain sensitive words; an output module, configured to select multimedia data of a category satisfying a preset output condition as target output multimedia data for output; and, if the user is younger than a preset age and the sensitive word recognition result indicates that sensitive words are contained, perform any of the following processing: maintain the current multimedia data being output, or filter the multimedia data in the current multimedia data that matches the sensitive words to obtain filtered multimedia data, and output the filtered multimedia data; Alternatively, a guiding voice is output.

6. A multimedia data control device, characterized in that: include: Processor and memory; The processor is used to execute the multimedia data control program stored in the memory to implement the multimedia data control method according to any one of claims 1 to 4.

7. A storage medium, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed to implement the multimedia data control method according to any one of claims 1 to 4.

Images