Intelligent multimedia device playing method and device, computer device and storage medium

Abstract

The application discloses a kind of intelligent multimedia equipment playing method, device, computer equipment and storage medium in the communication technical field involved;The method can when detecting the target user image of intelligent multimedia equipment, identify the user type of target user in target user image;If user type is preset target user type, determine the playing duration that target user plays intelligent multimedia equipment;When playing duration reaches preset playing duration threshold, preset interactive answering page is displayed;The gesture of target user is identified, and the answering gesture of target user is obtained, and the answer of interactive question in interactive answering page is matched with answering gesture, and matching result is obtained, and the answering score of target user is confirmed based on matching result;If answering score does not reach preset playing score threshold, target user continues to play intelligent multimedia equipment is limited.The application can improve the intelligentization of intelligent multimedia equipment playing.

Description

Technical Field

[0001] This application relates to the field of communication technology, specifically to a method, apparatus, computer device, and storage medium for playing intelligent multimedia devices. Background Technology

[0002] In this era of technological explosion, communication technology is applied to all aspects of social life and is closely related to our lives. Intelligent multimedia devices developed based on communication technology are one such example.

[0003] In the process of researching and practicing related technologies, the inventors of this application discovered that current smart multimedia devices, such as smart TVs / boxes, are beginning to be equipped with independent camera modules to capture user actions for interaction, but they cannot accurately control the playback duration of smart multimedia devices, resulting in a low level of intelligence in the playback of smart multimedia devices. Summary of the Invention

[0004] This application provides a method, apparatus, device, and medium for playing intelligent multimedia devices, in order to solve the technical problems in the prior art where the playback duration of intelligent multimedia devices cannot be accurately controlled and the intelligence of intelligent multimedia device playback is relatively low.

[0005] In a first aspect, embodiments of this application provide a method for playing content on a smart multimedia device, including:

[0006] When a target user image of a smart multimedia device is detected, the user type of the target user in the target user image is identified;

[0007] If the user type is a preset target user type, then determine the playback duration of the target user on the smart multimedia device;

[0008] When the playback duration reaches a preset playback duration threshold, a preset interactive quiz page is displayed, which includes at least one interactive question.

[0009] The gestures of the target user are recognized to obtain the target user's answer gestures, and the answer gestures are matched with the answers to the interactive questions on the interactive question-and-answer page to obtain the matching results. The target user's answer score is determined based on the matching results.

[0010] If the answer score does not reach the preset playback score threshold, the target user is restricted from continuing to play the smart multimedia device.

[0011] Optionally, when a target user image of a smart multimedia device is detected, the user type of the target user in the target user image is identified, including:

[0012] Image recognition is performed on the target user image of the intelligent multimedia device to obtain the target user's facial feature information;

[0013] Obtain a preset set of user types, wherein the set of user types includes facial feature information corresponding to multiple user types;

[0014] The facial feature information of the target user is compared with the facial feature information corresponding to the multiple user types;

[0015] Based on the comparison results, the user type of the target user is determined to be the target user type.

[0016] Optionally, when the playback duration reaches a preset playback duration threshold, a preset interactive Q&A page is displayed, including:

[0017] When the playback duration reaches a preset playback duration threshold, the interactive page of the smart multimedia device is displayed, and the interactive page includes a gesture recognition area;

[0018] The gesture image in the gesture recognition area is recognized. If the gesture in the gesture image is recognized as the target gesture, a preset interactive question-and-answer page is displayed.

[0019] Optionally, the interactive quiz page includes a question area, a quiz gesture area, and a gesture recognition result area. The quiz gesture area is used to display the quiz gesture image of the target user. Recognizing the target user's gesture to obtain the target user's quiz gesture includes:

[0020] If it is detected that the target user's gesture in the answer gesture area does not change within a preset time period, then the target answer gesture image in the answer gesture area within the time period is obtained;

[0021] The target answer gesture image is recognized, and the recognition result is displayed in the gesture recognition result area to obtain the target user's answer gesture.

[0022] Optionally, the answer gesture area includes a first answer gesture area and a second answer gesture area, and the step of acquiring the target answer gesture image of the answer gesture area within the time period includes:

[0023] Acquire the answer gesture images of the first answer gesture area and the second answer gesture area within the time period;

[0024] A target answer gesture image is generated based on the answer gesture images of the first answer gesture area and the second answer gesture area.

[0025] Optionally, a target answer gesture image is generated based on the answer gesture image of the first answer gesture region and the answer gesture image of the second answer gesture region, including:

[0026] The answer gesture image of the first answer gesture area is recognized to obtain the first character corresponding to the answer gesture image of the first answer gesture area;

[0027] The answer gesture image of the second answer gesture area is recognized to obtain the second character corresponding to the answer gesture image of the second answer gesture area;

[0028] The first character and the second character are combined to obtain the target answer gesture image.

[0029] Optionally, the interactive quiz page includes N questions, where N is a positive integer. The interactive quiz page includes an answer marking area. The step of recognizing the target user's gestures to obtain the target user's answer gestures, matching the answer gestures with the answers to the interactive questions on the interactive quiz page to obtain a matching result, and determining the target user's answer score based on the matching result, further includes:

[0030] The target gesture images corresponding to the N questions displayed in the question area are obtained from the answer gesture area, and the N questions are displayed in the question area in a preset time order;

[0031] The target gesture images corresponding to the N questions are identified respectively to obtain multiple target answer gestures of the target user;

[0032] Obtain the target solution reference answers for the N questions, and compare the multiple target answer gestures with the target solution reference answers to obtain the answer results for the N questions;

[0033] The answer results of the N questions are marked in the answer marking area, and the answer score of the target user is determined based on the marked answer results.

[0034] Secondly, embodiments of this application provide a smart multimedia device playback apparatus, comprising:

[0035] The identification unit is used to identify the user type of the target user in the target user image when a target user image of a smart multimedia device is detected;

[0036] The duration determination unit is used to determine the playback duration of the target user on the smart multimedia device if the user type is a preset target user type;

[0037] The display unit is used to display the preset interactive quiz page when the playback duration reaches a preset playback duration threshold. The interactive quiz page includes at least one interactive question.

[0038] A matching unit is used to recognize the gestures of the target user, obtain the answer gestures of the target user, match the answer gestures with the answers to interactive questions on the interactive question-answering page to obtain a matching result, and confirm the target user's answer score based on the matching result;

[0039] The limiting unit is used to restrict the target user from continuing to play the smart multimedia device if the answer score does not reach a preset playback score threshold.

[0040] Thirdly, embodiments of this application also provide a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the steps in any of the intelligent multimedia device playback methods provided in embodiments of this application.

[0041] Fourthly, embodiments of this application also provide a storage medium storing multiple instructions, which are applicable to a processor for loading to execute steps in any of the intelligent multimedia device playback methods provided in embodiments of this application.

[0042] Compared with the prior art, the technical solution provided in this application has the following advantages: The method provided in this application can identify the user type of the target user in the target user image when a target user image of a smart multimedia device is detected; if the user type is a preset target user type, the playback duration of the smart multimedia device played by the target user is determined; when the playback duration reaches a preset playback duration threshold, a preset interactive quiz page is displayed, the interactive quiz page including at least one interactive question; the gestures of the target user are recognized to obtain the target user's answer gestures, and the answer gestures are matched with the answers to the interactive questions on the interactive quiz page to obtain a matching result; based on the matching result, the user's answer is confirmed. The method for playing smart multimedia devices proposed in this application first identifies the user type of the target user in front of the smart multimedia device screen. When the user type of the target user is confirmed to be the target user type, it confirms whether the target user has reached the required playback time for the smart multimedia device. If the playback time has reached the required time, the method can control whether to continue playing the smart multimedia device by answering questions. The answer result can be confirmed by recognizing the target user's gestures. This method can realize the control of the playback time of the smart multimedia device through gesture recognition, thereby improving the intelligence of the smart multimedia device playback. Attached Figure Description

[0043] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0044] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0045] One or more embodiments are illustrated by way of example with reference numerals in the accompanying drawings. These illustrations do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are denoted as similar elements. Unless otherwise stated, the figures in the drawings are not to be limited by scale.

[0046] Figure 1 This is a flowchart of the intelligent multimedia device playback method provided in the embodiments of this application;

[0047] Figure 2 This is a facial image capture diagram of the intelligent multimedia device playback method provided in the embodiments of this application;

[0048] Figure 3 This is a playback duration prompt diagram for the intelligent multimedia device playback method provided in the embodiments of this application;

[0049] Figure 4 This is a schematic diagram of an interactive page illustrating the intelligent multimedia device playback method provided in this application embodiment;

[0050] Figure 5 This is a schematic diagram of user gestures in the intelligent multimedia device playback method provided in the embodiments of this application;

[0051] Figure 6 This is a schematic diagram of an interactive Q&A page for a smart multimedia device playback method provided in this application embodiment;

[0052] Figure 7 This is a gesture diagram illustrating the intelligent multimedia device playback method provided in this application embodiment;

[0053] Figure 8 This is a diagram showing the answer score of the intelligent multimedia device playback method provided in this application embodiment;

[0054] Figure 9 This is a diagram of an apparatus for a smart multimedia device playback method provided in an embodiment of this application;

[0055] Figure 10 This is a schematic diagram of the structure of the computer device provided in the embodiments of this application. Detailed Implementation

[0056] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0057] It should be understood that, when used in this specification and the appended claims, the terms "comprising" and "including" indicate the presence of the described features, integrals, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.

[0058] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0059] It should also be further understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0060] As used in this specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if [the described condition or event] is detected" may be interpreted, depending on the context, as "once determined," "in response to determination," "once [the described condition or event] is detected," or "in response to detection of [the described condition or event]."

[0061] To address the technical problem of the inability to accurately control the playback duration of smart multimedia devices and the low level of intelligence in the playback of smart multimedia devices in existing technologies, this application provides a playback method for smart multimedia devices that can control the playback duration of smart multimedia devices through gesture recognition, thereby improving the intelligence of smart multimedia device playback.

[0062] Figure 1 This application provides a method for playing music on a smart multimedia device, which includes:

[0063] S101. When a target user image of a smart multimedia device is detected, identify the user type of the target user in the target user image.

[0064] Among them, intelligent multimedia devices refer to the combination of two or more human-computer interaction information exchange and dissemination media. Intelligent multimedia devices can include devices such as smart TVs, laptops, and desktop computers.

[0065] The target user image refers to an image containing the facial information of the target user. By recognizing the facial information in the target image, the user type of the target user can be determined. Target user images can be acquired using a smart multimedia device equipped with a dedicated camera module, which can be installed anywhere on the smart multimedia device.

[0066] Users can be categorized based on their age, into different user types. For example, users aged 0 to 5 are classified as toddlers, 6 to 14 as children, 15 to 18 as teenagers, 19 to 35 as young adults, 36 to 65 as middle-aged adults, and 66 and above as seniors.

[0067] In one example, such as Figure 2As shown, during video playback on the smart multimedia device, the device can capture the user image of the target user in front of the capture screen timing area. By judging the user's facial age based on the image, the user type of the target user can be determined based on the judgment result. That is, the age group of the target user in front of the camera can be determined based on the judgment result. If the facial age determines that the target user is a child between 6 and 14 years old, the playback time of the target user on the smart multimedia device can be timed separately. If the cumulative playback time for the day exceeds the specified time, an overtime reminder will be triggered. For example, when the cumulative playback time for the day exceeds the specified time, an interactive quiz page of the smart multimedia device can be displayed. The target user can obtain more playback time or maintain the current playback time by answering the questions on the interactive quiz page.

[0068] In one embodiment, the step "when a target user image of a smart multimedia device is detected, identifying the user type of the target user in the target user image" may include:

[0069] Image recognition is performed on the target user image of the intelligent multimedia device to obtain the target user's facial feature information;

[0070] Obtain a preset set of user types, wherein the set of user types includes facial feature information corresponding to multiple user types;

[0071] The facial feature information of the target user is compared with the facial feature information corresponding to the multiple user types;

[0072] Based on the comparison results, the user type of the target user is determined to be the target user type.

[0073] In one example, the user type set can be a pre-set set containing multiple user types. Each user type in the user type set has a mapping relationship with its corresponding facial feature information. When comparing facial feature information, as long as the facial feature information in the user type set that has a similarity to the target user's facial feature information reaches a preset similarity is determined, the corresponding user type can be quickly determined from the user type set according to the mapping relationship, and thus the user type of the target user can be quickly determined.

[0074] S102. If the user type is the preset target user type, then determine the playback duration of the target user on the smart multimedia device.

[0075] Among them, the target user type refers to the type of user. For example, users can be classified according to their age. Users aged 0 to 5 are divided into toddlers, 6 to 14 are children, 15 to 18 are teenagers, 19 to 35 are young adults, 36 to 65 are middle-aged, and 66 and above are elderly. If the target user type is identified as a child, then the playback time of the child on the smart multimedia device can be obtained.

[0076] In one example, users of smart multimedia devices can be categorized into toddlers, children, teenagers, young adults, middle-aged adults, and seniors. The playback time for toddlers can be preset to 0.5 hours, for children to 1 hour, for teenagers to 1.5 hours, for young adults to 2.5 hours, for middle-aged adults to 3 hours, and for seniors to 2 hours. The playback time for each user type can be adjusted at any time and is not limited to the examples given above.

[0077] In one example, such as Figure 2As shown, the playback time for different user types on the smart multimedia device is as follows: 0.5 hours for toddlers, 1 hour for children, 1.5 hours for teenagers, 2.5 hours for young adults, 3 hours for middle-aged users, and 2 hours for seniors. During video playback on the smart multimedia device, if the target user in front of the device's capture frame's timing area is a toddler, the playback time for that toddler can be timed separately. If the total playback time for the day exceeds 0.5 hours, a timeout reminder will be triggered. If the target user in front of the capture frame's timing area is a child, the playback time for that child can be timed separately. If the total playback time for the day exceeds 1 hour, a timeout reminder will be triggered. If the target user in front of the capture frame's timing area is a teenager, the playback time for that teenager can be timed separately. If the total playback time for the day exceeds 1.5 hours, a timeout reminder will be triggered. If the target user in front of the timer area of ​​the captured screen of the smart multimedia device is a young user, the playback time of that young user can be timed separately. If the cumulative playback time for the day exceeds 2.5 hours, a timeout reminder will be triggered. If the target user in front of the timer area of ​​the captured screen of the smart multimedia device is a middle-aged user, the playback time of that middle-aged user can be timed separately. If the cumulative playback time for the day exceeds 3 hours, a timeout reminder will be triggered. If the target user in front of the timer area of ​​the captured screen of the smart multimedia device is an elderly user, the playback time of that elderly user can be timed separately. If the cumulative playback time for the day exceeds 2 hours, a timeout reminder will be triggered.

[0078] In one embodiment, the user types of the smart multimedia device can be categorized into preschool users, children, teenagers, young adults, middle-aged users, and elderly users. The playback duration of the smart multimedia device is only acquired and limited when the target user in front of the capture frame timing area of ​​the smart multimedia device is identified as a child user. The child user can increase or maintain the playback duration by answering questions. When the target user in front of the capture frame timing area of ​​the smart multimedia device is not identified as a child user, no playback duration limit is imposed.

[0079] S103. When the playback duration reaches the preset playback duration threshold, a preset interactive quiz page is displayed, which includes at least one interactive question.

[0080] Specifically, a playback duration threshold is preset for each user type. For example, the playback duration threshold is set to 0.5 hours for toddlers, 1 hour for children, 1.5 hours for teenagers, 2.5 hours for young adults, 3 hours for middle-aged users, and 2 hours for elderly users.

[0081] The interactive quiz page refers to the page where the target user can interact with the smart multimedia device to answer questions. The question area on the interactive quiz page displays the questions that the target user needs to answer, and the gesture area on the interactive quiz page displays the gestures that the target user makes to answer the questions displayed in the question area.

[0082] In one example, taking the gesture area for answering questions as including the camera capture area (left) and the camera capture area (right) as an example, when the playback time reaches a preset playback time threshold, a video playback end prompt page can be displayed. This video playback end prompt page is as follows: Figure 3 As shown, the screen includes the camera capture area (left), the camera capture area (right), and a text prompt in the middle of the page. The text prompt can read, "Today's video has finished playing, but you can play it again after completing the quiz challenge!" or other playback completion prompts. When the video playback completion prompt page reaches its designated display time, the interactive quiz page can be displayed.

[0083] In one embodiment, the step "displaying a preset interactive quiz page when the playback duration reaches a preset playback duration threshold" may include:

[0084] When the playback duration reaches a preset playback duration threshold, the interactive page of the smart multimedia device is displayed, and the interactive page includes a gesture recognition area;

[0085] The gesture image in the gesture recognition area is recognized. If the gesture in the gesture image is recognized as the target gesture, a preset interactive question-and-answer page is displayed.

[0086] The interactive page refers to a page for target users to interact with the smart multimedia device. For example, when the playback time reaches a preset threshold, the target user can answer questions to gain more playback time on the smart multimedia device. Before the question-and-answer session begins, the interactive page of the smart multimedia device can be displayed to allow the target user to prepare. For instance, if the gesture recognition area of ​​the interactive page detects a "like" gesture from the target user, it means that the target user is ready to answer the question, and the interactive question-and-answer page of the smart multimedia device can be displayed to begin answering the question.

[0087] In one example, such as Figure 4 As shown, the interactive page includes a gesture recognition area, i.e. Figure 4 The system includes a camera capture area (left) and a camera capture area (right), a question preparation prompt area, and a gesture recognition result area. Before the question begins, a question preparation prompt can be displayed in the prompt area, such as "Ready? Give a thumbs up with both hands to start answering the question." When the target user's gesture image is captured in the camera capture areas (left) and (right), the gesture image is recognized, and the recognition result is displayed in the gesture recognition result area. If the recognition result in the gesture recognition result area is a thumbs up gesture or an affirmative instruction (such as displaying an OK instruction), it means that the target user is ready to answer the question, and the interactive question answering page of the smart multimedia device can be displayed.

[0088] The camera capture area (left) and camera capture area (right) capture the gestures of the target user's left hand and right hand, respectively, to obtain the gesture images of the target user's left hand and right hand.

[0089] In one example, such as Figure 5 As shown, a clenched fist represents 0, one extended finger represents 1, two extended fingers represent 2, three extended fingers represent 3, four extended fingers represent 4, five extended fingers represent 5, a thumb pointing upwards represents a thumbs-up, and the thumb and index finger touching while extending three fingers represents OK. By capturing the target user's gestures, we can determine what the target user wants to express.

[0090] S104. Recognize the target user's gestures to obtain the target user's answer gestures, match the answer gestures with the answers to interactive questions on the interactive question-answering page to obtain the matching results, and confirm the target user's answer score based on the matching results.

[0091] Among them, answering gestures refer to the gestures made by the target user in order to answer the questions displayed in the question area. These gestures can be captured by the answering gesture area of ​​the smart multimedia device, and the meaning of the gestures is displayed in the gesture recognition result area, which is then matched with the answers to the questions in the question area.

[0092] In one example, such as Figure 6 As shown, the interactive quiz page includes a question area and a gesture area for answering questions. Figure 6The image shows the camera capture area (left) and camera capture area (right), along with the gesture recognition result area. Assuming the question displayed in the question area is "What is 7 plus 8?", after a certain time, the system captures the target user's answering gestures in the camera capture areas (left and right). The numbers represented by the answering gestures in the camera capture areas (left and right) are displayed in the gesture recognition result area. If the gesture recognition result area displays "15", and 7 plus 8 does indeed equal 15, it means the target user answered the question correctly. Then, the target user's score can be determined.

[0093] Furthermore, the final score of a target user can be determined based on the time spent solving the problem and the accuracy of their answers. The shorter the time spent solving the problem, the less the final score is affected.

[0094] In one embodiment, the interactive quiz page includes a question area, a quiz gesture area, and a gesture recognition result area. The quiz gesture area is used to display the quiz gesture image of the target user. The step "recognizing the gesture of the target user to obtain the quiz gesture of the target user" includes:

[0095] If it is detected that the target user's gesture in the answer gesture area does not change within a preset time period, then the target answer gesture image in the answer gesture area within the time period is obtained;

[0096] The target answer gesture image is recognized, and the recognition result is displayed in the gesture recognition result area to obtain the target user's answer gesture.

[0097] The preset time period can be set in advance. For example, any time period such as 2 seconds, 3 seconds, or 4 seconds can be set as the preset time period. Assuming that the preset time period is 2 seconds, if it is detected that the target user's gesture displayed in the answer gesture area of ​​the smart multimedia device does not change within 2 seconds, that is, the target user's gesture is the same action within these 2 seconds, then the image containing the target user's gesture displayed in the answer gesture area within these 2 seconds can be obtained and this image can be used as the target answer gesture image.

[0098] Among them, recognizing the target user's gesture image can identify the information that the gesture is meant to convey, and this information is the recognition result.

[0099] In one embodiment, the answer gesture area includes a first answer gesture area and a second answer gesture area. The step of "acquiring the target answer gesture image of the answer gesture area within the time period" may include:

[0100] Acquire the answer gesture images of the first answer gesture area and the second answer gesture area within the time period;

[0101] A target answer gesture image is generated based on the answer gesture images of the first answer gesture area and the second answer gesture area.

[0102] The first answer gesture area may include the target user's left hand gesture made in the first answer gesture area, and the second answer gesture area may include the target user's right hand gesture made in the first answer gesture area. Alternatively, the first answer gesture area may include the target user's right hand gesture made in the first answer gesture area, and the second answer gesture area may include the target user's left hand gesture made in the first answer gesture area.

[0103] The target answer gesture image can only be obtained by combining the answer gesture images from the first answer gesture area and the second answer gesture area.

[0104] In one embodiment, the step of "generating a target answer gesture image based on the answer gesture image of the first answer gesture region and the answer gesture image of the second answer gesture region" includes:

[0105] The answer gesture image of the first answer gesture area is recognized to obtain the first character corresponding to the answer gesture image of the first answer gesture area;

[0106] The answer gesture image of the second answer gesture area is recognized to obtain the second character corresponding to the answer gesture image of the second answer gesture area;

[0107] The first character and the second character are combined to obtain the target answer gesture image.

[0108] In one example, the question displayed in the question area is "What is 5 plus 5?". Recognizing the answer gesture image in the first answer gesture area, the system identifies the character representing the answer gesture as 1. This means that for the question "What is 5 plus 5?", the target user uses either their left or right hand to represent the gesture "1" in the first answer gesture area. Recognizing the answer gesture image in the second answer gesture area, the system identifies the character representing the answer gesture as 0. This means that for the question "What is 5 plus 5?", the target user uses either their left or right hand to represent the gesture "0" in the second answer gesture area. Therefore, combining the gesture (1) corresponding to the first answer gesture area with the gesture (0) corresponding to the first answer gesture area yields a target answer gesture image containing the number 10. This indicates that the target user's gesture answer for the question "What is 5 plus 5?" is 10.

[0109] In one embodiment, the interactive quiz page includes N questions, where N is a positive integer, and the interactive quiz page includes an answer marking area. The step "recognizing the target user's gestures to obtain the target user's answer gestures, matching the answer gestures with the answers to the interactive questions on the interactive quiz page to obtain a matching result, and confirming the target user's answer score based on the matching result" may further include:

[0110] The target gesture images corresponding to the N questions displayed in the question area are obtained from the answer gesture area, and the N questions are displayed in the question area in a preset time order;

[0111] The target gesture images corresponding to the N questions are identified respectively to obtain multiple target answer gestures of the target user;

[0112] Obtain the target solution reference answers for the N questions, and compare the multiple target answer gestures with the target solution reference answers to obtain the answer results for the N questions;

[0113] The answer results of the N questions are marked in the answer marking area, and the answer score of the target user is determined based on the marked answer results.

[0114] In one example, suppose a target user has reached a playback time threshold on a smart multimedia device and needs to answer questions to gain more playback time. The target user needs to answer N questions to determine their final score. Based on the score, the user can then determine whether they receive more playback time or have their smart multimedia device playback restricted. After answering each question, the user can mark their answer in the answer indicator area on the interactive quiz page, such as... Figure 7 As shown, continue until all N questions are answered, and then calculate the total score based on the correctness of the answers.

[0115] The answer can be marked with "√" or "×" to indicate the answer to the question. "√" means the question was answered correctly, and "×" means the question was answered incorrectly.

[0116] S105. If the answer score does not reach the preset playback score threshold, then the target user will be restricted from continuing to play on the smart multimedia device.

[0117] The playback score threshold can be preset and adjusted later as needed. For example, if the target users are children, the preset playback score threshold for children is 70 points. Later, if adult users find that children can easily reach 70 points in the quiz, the playback score threshold can be set to 80 points or any score higher than 70 points to limit children's access to smart multimedia devices.

[0118] In one example, such as Figure 8 As shown, the target user's total score is displayed in the results area of ​​the score display page based on their answers. This results area can also display the answering time. The target user's total score is affected not only by the correctness of their answers but also by the time taken to answer the questions. The more time spent answering the questions, the greater the impact on the total score.

[0119] In one example, suppose the target user needs to answer N questions. The total score can be obtained by adding up the scores of each question. If other users help answer the questions during the target user's answering process, a leaderboard of answering scores can be displayed in the results area of ​​the answering score display page. The leaderboard includes other users who helped the target user answer the questions, as well as the scores they received.

[0120] In one embodiment, after confirming the target user's answer score based on the matching result, if the answer score reaches the playback score threshold, the time for the target user to continue playing the smart multimedia device is increased.

[0121] As can be seen from the above, the intelligent multimedia device playback method proposed in this application, in specific implementation, can first identify the user type of the target user in front of the intelligent multimedia device screen. When it is confirmed that the user type of the target user is the target user type, it is confirmed whether the target user has played the intelligent multimedia device for the required duration. If the duration has been reached, the playback of the intelligent multimedia device can be controlled by answering a question. The answer result can be confirmed by recognizing the target user's gesture. This method can realize the control of the playback duration of the intelligent multimedia device through gesture recognition, thereby improving the intelligence of the intelligent multimedia device playback.

[0122] To better implement the above methods, this application also provides an intelligent multimedia device playback device, which can be integrated into a computer device. (See reference...) Figure 9 The intelligent multimedia device playback apparatus may include an identification unit 201, a duration determination unit 202, a display unit 203, a matching unit 204, and a limiting unit 205, as follows:

[0123] (1) Identification unit 201;

[0124] The identification unit 201 is used to identify the user type of the target user in the target user image when a target user image of a smart multimedia device is detected.

[0125] In one embodiment, the identification unit 201 includes:

[0126] The first recognition subunit 2011 is used to perform image recognition on the target user image of the intelligent multimedia device to obtain the target user's target facial feature information.

[0127] The first acquisition subunit 2012 is used to acquire a preset user type set, wherein the user type set includes facial feature information corresponding to multiple user types;

[0128] The comparison subunit 2013 is used to compare the target user's facial feature information with the facial feature information corresponding to the multiple user types;

[0129] The type determination subunit 2014 is used to determine the user type of the target user as the target user type based on the comparison result.

[0130] (2) Duration determination unit 202;

[0131] The duration determination unit 202 is used to determine the playback duration of the target user playing the smart multimedia device if the user type is a preset target user type.

[0132] (3) Display unit 203;

[0133] The display unit 203 is used to display the preset interactive quiz page when the playback duration reaches a preset playback duration threshold. The interactive quiz page includes at least one interactive question.

[0134] In one embodiment, the display unit 203 includes:

[0135] The first display subunit 2031 is used to display the interactive page of the smart multimedia device when the playback duration reaches a preset playback duration threshold. The interactive page includes a gesture recognition area.

[0136] The second display subunit 2032 is used to recognize the gesture image of the gesture recognition area. If the gesture in the gesture image is recognized as the target gesture, a preset interactive question-and-answer page is displayed.

[0137] (4) Matching unit 204;

[0138] The matching unit 204 is used to recognize the gestures of the target user, obtain the answer gestures of the target user, match the answer gestures with the answers to the interactive questions on the interactive question-answering page to obtain a matching result, and confirm the target user's answer score based on the matching result.

[0139] In one embodiment, the matching unit 204 includes:

[0140] The detection subunit 2041 is used to acquire the target answer gesture image of the answer gesture area within the preset time period if the target user's gesture does not change within the preset time period.

[0141] The second recognition subunit 2042 is used to recognize the target answer gesture image and display the recognition result in the gesture recognition result area to obtain the target user's answer gesture.

[0142] In one embodiment, the detection subunit 2041 is further configured to acquire answer gesture images of the first answer gesture area and the second answer gesture area within the time period; and generate a target answer gesture image based on the answer gesture images of the first answer gesture area and the second answer gesture area.

[0143] In one embodiment, the detection subunit 2041 is further configured to recognize the answer gesture image of the first answer gesture area to obtain a first character corresponding to the answer gesture image of the first answer gesture area; recognize the answer gesture image of the second answer gesture area to obtain a second character corresponding to the answer gesture image of the second answer gesture area; and combine the first character and the second character to obtain a target answer gesture image.

[0144] In one embodiment, the matching unit 204 further includes:

[0145] The second acquisition subunit 2043 is used to acquire the target gesture images corresponding to the N questions displayed in the question area from the answer gesture area, and the N questions are displayed in the question area in a preset time order;

[0146] The third recognition subunit 2044 is used to recognize the target gesture images corresponding to the N questions respectively, and obtain multiple target answer gestures of the target user;

[0147] The third acquisition subunit 2045 is used to acquire the target solution reference answers corresponding to the N questions, and compare the multiple target answer gestures with the target solution reference answers to obtain the answer results of the N questions;

[0148] The tagging subunit 2046 is used to tag the answer results of the N questions in the answer tagging area, and to determine the answer score of the target user based on the tagged answer results.

[0149] (5) Restriction unit 205;

[0150] The limiting unit 205 is used to restrict the target user from continuing to play the smart multimedia device if the answer score does not reach a preset playback score threshold.

[0151] As can be seen from the above, when the identification unit 201 of the intelligent multimedia device playback device in this application detects the target user image of the intelligent multimedia device, it identifies the user type of the target user in the target user image; then, if the user type is a preset target user type, the duration determination unit 202 determines the playback duration of the intelligent multimedia device played by the target user; when the playback duration reaches a preset playback duration threshold, the display unit 203 displays the preset interactive quiz page, which includes at least one interactive question; the matching unit 204 identifies the gestures of the target user to obtain the answer gestures of the target user, and matches the answer gestures with the answers to the interactive questions in the interactive quiz page to obtain a matching result, and confirms the answer score of the target user based on the matching result; if the answer score does not reach a preset playback score threshold, the restriction unit 205 restricts the target user from continuing to play the intelligent multimedia device.

[0152] The proposed method for playing intelligent multimedia devices, in its specific implementation, first identifies the user type of the target user in front of the intelligent multimedia device screen. When the user type of the target user is confirmed, it checks whether the target user has reached the required playback time for the intelligent multimedia device. If the time has been reached, the playback can be controlled by answering a question. The answer result can be confirmed by recognizing the target user's gesture. This method enables control of the playback time of the intelligent multimedia device through gesture recognition, thereby improving the intelligence of the intelligent multimedia device playback.

[0153] The aforementioned intelligent multimedia device playback device can be implemented as a computer program, which can, for example... Figure 10 It runs on the computer device shown.

[0154] like Figure 10 As shown in the figure, this application provides a computer device including a processor 111, a communication interface 112, a memory 113, and a communication bus 114, wherein the processor 111, the communication interface 112, and the memory 113 communicate with each other through the communication bus 114.

[0155] Memory 113 is used to store computer programs;

[0156] In one embodiment of this application, the processor 111, when executing the program stored in the memory 113, implements the intelligent multimedia device playback method provided in any of the foregoing method embodiments.

[0157] It will be understood by those skilled in the art that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program may be stored in a storage medium, which is a computer-readable storage medium. The computer program is executed by at least one processor in the computer system to implement the process steps of the embodiments of the above methods.

[0158] Therefore, this application also provides a storage medium. This storage medium can be a computer-readable storage medium. The storage medium stores a computer program. When executed by a processor, the computer program causes the processor to perform the intelligent multimedia device playback method provided in any of the foregoing method embodiments.

[0159] The storage medium is a physical, non-transient storage medium, such as a USB flash drive, external hard drive, read-only memory (ROM), magnetic disk, or optical disk, or any other physical storage medium capable of storing program code. The computer-readable storage medium can be non-volatile or volatile.

[0160] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.

[0161] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For example, the division of each unit is merely a logical functional division, and there may be other division methods in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed.

[0162] The steps in the methods of this application embodiment can be adjusted, merged, or deleted according to actual needs. The units in the apparatus of this application embodiment can be merged, divided, or deleted according to actual needs. Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0163] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a terminal, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application.

[0164] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0165] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Since these modifications and variations fall within the scope of the claims and their equivalents, this application also intends to include these modifications and variations.

[0166] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for playing content on an intelligent multimedia device, characterized in that, include: When a target user image of a smart multimedia device is detected, the user type of the target user in the target user image is identified; If the user type is a preset target user type, then determine the playback duration of the target user on the smart multimedia device; When the playback duration reaches a preset playback duration threshold, a preset interactive quiz page is displayed. The interactive quiz page includes at least one interactive question and includes a question area, a quiz gesture area, and a gesture recognition result area. The quiz gesture area is used to display the quiz gesture image of the target user. If it is detected that the target user's gesture in the answer gesture area does not change within a preset time period, then the target answer gesture image in the answer gesture area within the time period is obtained; The target answer gesture image is recognized, and the recognition result is displayed in the gesture recognition result area to obtain the target user's answer gesture. The answer gesture is then matched with the answer to the interactive question on the interactive answer page to obtain a matching result. Based on the matching result, the target user's answer score is confirmed. The answer gesture area includes a first answer gesture area and a second answer gesture area. Obtaining the target answer gesture image of the answer gesture area within the time period includes: obtaining the answer gesture images of the first answer gesture area and the second answer gesture area within the time period; recognizing the answer gesture image of the first answer gesture area to obtain a first character corresponding to the answer gesture image of the first answer gesture area; recognizing the answer gesture image of the second answer gesture area to obtain a second character corresponding to the answer gesture image of the second answer gesture area; and combining the first character and the second character to obtain the target answer gesture image. If the answer score does not reach the preset playback score threshold, the target user is restricted from continuing to play the smart multimedia device.

2. The method according to claim 1, characterized in that, The interactive quiz page includes N questions, where N is a positive integer. The interactive quiz page includes an answer indicator area. The process of recognizing the target user's gestures to obtain the target user's answer gestures, matching the answer gestures with the answers to the interactive questions on the interactive quiz page to obtain a matching result, and determining the target user's answer score based on the matching result, further includes: The target gesture images corresponding to the N questions displayed in the question area are obtained from the answer gesture area, and the N questions are displayed in the question area in a preset time order; The target gesture images corresponding to the N questions are identified respectively to obtain multiple target answer gestures of the target user; Obtain the target solution reference answers for the N questions, and compare the multiple target answer gestures with the target solution reference answers to obtain the answer results for the N questions; The answer results of the N questions are marked in the answer marking area, and the answer score of the target user is determined based on the marked answer results.

3. The method according to claim 1, characterized in that, When a target user image of a smart multimedia device is detected, identifying the user type of the target user in the target user image includes: Image recognition is performed on the target user image of the intelligent multimedia device to obtain the target user's facial feature information; Obtain a preset set of user types, wherein the set of user types includes facial feature information corresponding to multiple user types; The facial feature information of the target user is compared with the facial feature information corresponding to the multiple user types; Based on the comparison results, the user type of the target user is determined to be the target user type.

4. The method according to claim 1, characterized in that, When the playback duration reaches a preset playback duration threshold, a preset interactive Q&A page is displayed, including: When the playback duration reaches a preset playback duration threshold, the interactive page of the smart multimedia device is displayed, and the interactive page includes a gesture recognition area; The gesture image in the gesture recognition area is recognized. If the gesture in the gesture image is recognized as the target gesture, a preset interactive question-and-answer page is displayed.

5. A smart multimedia device playback device, characterized in that, Includes a unit for performing the method as described in any one of claims 1-4.

6. A computer device, characterized in that, The computer device includes a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the method as described in any one of claims 1-4.

7. A computer-readable storage medium, characterized in that, The storage medium stores a computer program that, when executed by a processor, can implement the method as described in any one of claims 1-4.

Images