An information output method, device, terminal and computer-readable storage medium

Abstract

An embodiment of the present invention discloses an information output method, device, terminal, and computer-readable storage medium. The method includes: the terminal acquires a face image and recognizes the facial expression in the face image; obtains corresponding target prompt information according to the facial expression; and outputs the target prompt information, where the target prompt information includes caring words and / or recommended control application information. By implementing the above method, the terminal can make corresponding responses according to the user's expression, increasing the intelligence of the terminal.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular, to an information output method, apparatus, terminal, and computer-readable storage medium. Background Art

[0002] With the rapid development of electronic technology and Internet technology, people's love and dependence on terminals such as smart phones and tablet computers are becoming stronger and stronger. The terminal can make corresponding responses according to the operations input by the user and provide corresponding services.

[0003] However, in existing terminals, the user needs to manually input operations for the terminal to make corresponding responses. When the user does not manually input operations, the terminal cannot intelligently identify the service functions required by the user. Therefore, the intelligence of the terminal is relatively low. Summary of the Invention

[0004] The technical problem to be solved by the embodiments of the present invention is to provide an information output method that can enable the terminal to make corresponding responses according to the user's expression and increase the intelligence of the terminal.

[0005] To solve the above technical problem, a first aspect of the embodiments of the present invention discloses an information output method, the method including:

[0006] The terminal acquires a face image and recognizes the facial expression in the face image;

[0007] Acquire corresponding target prompt information according to the facial expression;

[0008] Output the target prompt information, where the target prompt information includes caring words and / or recommended control application information.

[0009] A second aspect of the embodiments of the present invention discloses an information output apparatus, the apparatus including:

[0010] A recognition module, configured to enable the terminal to acquire a face image and recognize the facial expression in the face image;

[0011] An acquisition module, configured to acquire corresponding target prompt information according to the facial expression;

[0012] An output module, configured to output the target prompt information, where the target prompt information includes caring words and / or recommended control application information.

[0013] In a third aspect of the embodiments of the present invention, a terminal is disclosed, which includes a processor, an input device, an output device, and a memory. The processor, the input device, the output device, and the memory are interconnected. Among them, the memory is used to store a computer program, and the computer program includes program instructions. The processor is configured to call the program instructions to execute the method of the first aspect above.

[0014] In a fourth aspect of the embodiments of the present invention, a computer-readable storage medium is disclosed. The computer storage medium stores a computer program, and the computer program includes program instructions. When the program instructions are executed by a processor, the processor is caused to execute the method of the first aspect above.

[0015] In the embodiments of the present invention, the terminal acquires a face image, identifies the facial expression in the face image, and further obtains corresponding target prompt information according to the facial expression and outputs the target prompt information. The target prompt information includes caring words and / or recommended control application information. By implementing the above method, the terminal can make corresponding responses according to the user's expression, increasing the intelligence of the terminal. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0017] Figure 1 is a schematic flowchart of an information output method provided by an embodiment of the present invention;

[0018] Figure 2 is a schematic flowchart of another information output method provided by an embodiment of the present invention;

[0019] Figure 3 is a schematic flowchart of yet another information output method provided by an embodiment of the present invention;

[0020] Figure 4 is a schematic structural diagram of an information output device provided by an embodiment of the present invention;

[0021] Figure 5 is a schematic structural diagram of a terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0022] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0023] Please refer to Figure 1 , which is a schematic flowchart of an information output method provided by an embodiment of the present invention. The information output method described in this embodiment includes the following steps:

[0024] S101: The terminal acquires a face image and recognizes the facial expression in the face image.

[0025] In the embodiments of the present invention, the terminal may be an electronic device such as a smart phone or a tablet computer, and the facial expression may be "yawn", "cry", "laugh", "close eyes", etc. Specifically, in implementation, when the terminal detects a preset trigger condition, it turns on the camera to acquire the face image of the user operating the terminal and recognize the facial expression in the face image. Among them, the preset trigger condition may be that the current time belongs to a preset time period. Specifically, before the terminal acquires the face image and recognizes the facial expression in the face image, the terminal detects whether the current time is within the preset time range. The preset time range may be different time periods, such as the lunch break time range of 12:00-14:00, or the evening time range of 22:00-2:00, etc. If the terminal detects that the current time is within any time period within the preset time range, the terminal turns on the camera to acquire the face image of the user operating the terminal and recognize the facial expression in the face image. Or, the preset trigger condition may also be an operation instruction input by the user. Specifically, the user may input an operation to turn on the expression recognition mode. After the terminal detects the above operation, it will turn on the expression recognition mode, acquire the face image of the user operating the terminal in real time through the camera, and analyze the facial expression corresponding to the face image. Or, the preset trigger condition may also be that the application program currently running on the terminal is a target application program. The target application program may be a game program, a music program, a video program, etc., which may be preset by the system or set by the user. Then, when the terminal detects that the application program currently running is a target application program, the terminal turns on the camera to acquire the face image of the user operating the terminal and recognize the facial expression in the face image.

[0026] In one implementation, the specific manner for the terminal to recognize a facial expression may be that the terminal acquires a facial image of the user operating the terminal through a camera, and detects whether the acquired facial image matches any reference facial image in a preset database. If so, the expression corresponding to the reference facial image that matches the acquired facial image is determined as the facial expression corresponding to the acquired facial image. Specifically, the terminal may determine whether they match based on the similarity between the facial image and the reference facial image. If the similarity between the facial image and the reference facial image is greater than a preset similarity, it may be determined that the facial image matches the reference facial image. Among them, the specific calculation method of the similarity may be to calculate the first hash value of the facial image and the second hash value of the reference facial image, and determine the Hamming distance between the first hash value and the second hash value, and determine the similarity between the facial image and the reference facial image according to the corresponding relationship between the Hamming distance and the similarity. Among them, the corresponding relationship between the Hamming distance and the similarity may be specifically set by the R & D personnel in advance, and specifically, the smaller the Hamming distance, the greater the similarity. The reference facial images stored in the preset database may be specifically input by the user in advance. Specifically, the user may input multiple facial images in the terminal in advance as reference facial images, and configure a corresponding expression for each reference facial image as the expression corresponding to the reference facial image, and the terminal stores the reference facial images input by the user and the expressions of the reference facial images in the preset database.

[0027] In one implementation, the manner for the terminal to recognize a facial expression may also be to recognize the facial expression based on the camera and the facial expression recognition model. Specifically, the terminal acquires the facial image input by the user through the camera, and the facial expression recognition model determines the facial expression corresponding to the facial image. Among them, the above-mentioned facial expression recognition model may be obtained by using a facial expression recognition algorithm based on a deep convolutional neural network, and is used to determine the facial expression corresponding to the facial image. Specifically, the facial expression recognition model may be trained by using the facial images in the training image set. The training image set includes multiple facial images with preset expressions, and the facial expression recognition model is trained and generated through a deep convolutional neural network. After the facial expression recognition model is determined, when the user uses the terminal, the terminal acquires the user's facial image through the camera, and uses the built-in facial expression recognition model to determine the facial expression corresponding to the user's facial image.

[0028] S102: Obtain the corresponding target prompt information according to the facial expression.

[0029] In the embodiment of the present invention, after the terminal acquires the facial image and recognizes the facial expression in the facial image, the terminal will determine the target prompt information corresponding to the facial expression according to the corresponding relationship between the expression and the prompt information, and obtain the target prompt information, where the target prompt information includes caring words and / or recommended control application information.

[0030] In one implementation, the correspondence between facial expressions and prompt messages can be preset by the system. Specifically, through big data learning, different facial expressions are modeled, and after face recognition, different facial expressions can be automatically corresponded to obtain prompt messages. The correspondence between facial expressions and prompt messages can also be set by the user. Specifically, the user pre-corresponds "yawning" to yawning-type facial expressions, "crying" to crying-type facial expressions, "laughing", "closing eyes" to various input facial expressions, and inputs corresponding prompt messages for various facial expressions to establish the correspondence between facial expressions and prompt messages. For example, the correspondence between the facial expressions of the user set and the prompt messages is shown in Table 1.

[0031] Table 1:

[0032]

[0033] Then when the terminal detects that the facial expression of the user operating the terminal is "yawning", it can determine that the caring message corresponding to the facial expression is "Baby, you should go to bed early so that you can grow taller" and the recommended control application information shown in Table 1. When the terminal detects that the facial expression of the user operating the terminal is "crying", it can determine that the caring message corresponding to the facial expression is "Tomorrow will be a new day" and the recommended control application information shown in Table 1. When the terminal detects that the facial expression of the user operating the terminal is "laughing", it can determine that the caring message corresponding to the facial expression is "In a great mood" and the recommended control application information shown in Table 1. When the terminal detects that the facial expression of the user operating the terminal is "closing eyes", it can determine that the caring message corresponding to the facial expression is "Good night, master" and the recommended control application information shown in Table 1.

[0034] In one implementation, the specific way for the terminal to determine the target prompt message corresponding to the facial expression according to the correspondence between the facial expression and the prompt message can be that the terminal detects whether the facial expression matches any of the reference facial expressions stored in the preset database. If it detects that the facial expression matches any of the reference facial expressions stored in the preset database, it searches for the prompt message corresponding to the reference facial expression that matches the facial expression stored in the preset database. Among them, the preset database stores at least one pre-configured reference facial expression, the prompt messages input for each reference facial expression among at least one reference facial expression, and the correspondence between the facial expression and the prompt message. For example, the reference facial expressions stored in the preset database include "yawning", "crying", "laughing" and "closing eyes". If the facial expression recognized by the terminal is "yawning", the terminal determines that the facial expression matches the reference facial expression ("yawning") stored in the preset database and finds the prompt message corresponding to "yawning" as the target prompt message. If the facial expression recognized by the terminal is anger, the terminal determines that the facial expression does not match any of the reference facial expressions stored in the preset database and ends this process.

[0035] S103: Output the target prompt information, where the target prompt information includes caring terms and / or recommended control application information.

[0036] In an embodiment of the present invention, after the terminal determines the target prompt information corresponding to the facial expression according to the correspondence between the facial expression and the prompt information, it will output the prompt information corresponding to the target expression.

[0037] Specifically, the specific manner for the terminal to output the prompt information corresponding to the target expression may be that the terminal detects the currently running application program, obtains the prompt information output manner corresponding to the application program, and then outputs the target prompt information in the prompt information output manner corresponding to the application program. Among them, different application programs correspond to different prompt information output manners. The prompt information output manner may be a text information output manner, a picture information output manner, or a voice information output manner. The text prompt information output manner and the picture information output manner may be automatically popped up on the terminal screen, slid in from above the terminal screen, slid in from below the terminal screen, etc. The prompt information may be output anywhere on the terminal screen.

[0038] For example, if the currently running application program on the terminal is a game application, and the prompt information output manner corresponding to the game application is to display text prompt information in the upper right corner of the game application interface, then when the terminal is running the game application and detects the "yawn" expression input by the user, the terminal can display caring terms and recommended control application information in the upper right corner of the game application interface to prompt the user.

[0039] Another example is that if the currently running application program on the terminal is a video application, and the prompt information output manner corresponding to the video application is to display picture prompt information in the upper right corner of the video application interface, then when the terminal is running the video application and detects the "yawn" expression input by the user, the terminal can display a picture prompt information in the upper right corner of the video application interface. The picture prompt information may include caring terms and recommended control application information to prompt the user.

[0040] In an embodiment of the present invention, the terminal acquires a face image, identifies the facial expression in the face image, and further obtains the corresponding target prompt information according to the facial expression and outputs the target prompt information. The target prompt information includes caring terms and / or recommended control application information. By implementing the above method, the terminal can make corresponding responses according to the user's expression, increasing the intelligence of the terminal.

[0041] Please refer to Figure 2 , which is a schematic flowchart of another information output method provided by an embodiment of the present invention. The information output method described in this embodiment includes the following steps:

[0042] S201: Detect whether the current time is within a preset time range.

[0043] In the embodiments of the present invention, the terminal may be an electronic device such as a smart phone or a tablet computer. The terminal can detect whether the current time is within a preset time range. Among them, the preset time range can be different time periods. For example, the lunch break time range is 12:00 - 14:00, or the evening time range is 22:00 - 2:00, etc. If it is detected that the current time is within any time period of the preset time range, then step S202 is executed. If the current time is not within the preset time range, then this process ends. Among them, the time range can be set by the user, or the terminal determines it according to the user's operation habits and normal rest periods. Specifically, the overlapping period of the common operation period of the mobile phone and the rest period used by the user can be determined as the preset time range. For example, the terminal finds from the user's historical operation records that the user is used to playing with the mobile phone in the time range of 22:00 - 2:00, and the time range of 22:00 - 2:00 belongs to the rest period, then the terminal can determine the time range of 22:00 - 2:00 as the preset time range.

[0044] S202: The terminal acquires a face image and recognizes the facial expression in the face image.

[0045] In the embodiments of the present invention, the facial expression can be "yawn", "cry", "laugh", "close eyes", etc. The terminal can turn on the camera when detecting a preset trigger condition, acquire the face image of the user operating the terminal, and recognize the facial expression in the face image. Among them, the preset trigger condition can be an operation instruction input by the user. Specifically, the user can input an operation to turn on the expression recognition mode. After the terminal detects the above operation, it will turn on the expression recognition mode, and acquire the face image of the user operating the terminal in real time through the camera, and analyze the corresponding facial expression of the face image. Or, the preset trigger condition can also be that the application program currently running on the terminal is the target application program. Among them, the target application program can be a game program, a music program, a video program, etc., which can be preset by the system or set by the user. Then, when the terminal detects that the application program currently running is the target application program, the terminal turns on the camera to acquire the face image of the user operating the terminal, and recognizes the facial expression in the face image.

[0046] In one implementation, the specific way for the terminal to recognize a facial expression can be that the terminal obtains a facial image of the user operating the terminal through a camera, and detects whether the obtained facial image matches any reference facial image in a preset database. If so, the expression corresponding to the reference facial image that matches the obtained facial image is determined as the facial expression corresponding to the obtained facial image. Specifically, the terminal can determine whether the two match based on the similarity between the facial image and the reference facial image. If the similarity between the facial image and the reference facial image is greater than a preset similarity, it can be determined that the facial image matches the reference facial image.

[0047] In one implementation, the way for the terminal to recognize a facial expression can also be to recognize the facial expression based on the camera and a facial expression recognition model. Specifically, the terminal obtains a facial image input by the user through the camera, and the facial expression recognition model determines the facial expression corresponding to the facial image.

[0048] S203: Detect whether the object corresponding to the facial expression matches the target object, and obtain the corresponding relationship between the expression of the target object and the prompt information.

[0049] In the embodiment of the present invention, after the terminal recognizes the facial expression input to the terminal, it detects whether the object corresponding to the facial expression matches the target object. Among them, the target object can be a child, an adult, or an elderly person. If it is detected that the object corresponding to the facial expression matches the target object, the corresponding relationship between the expression of the target object and the prompt information is obtained.

[0050] In one implementation, the target object is a child. When the terminal detects that the object corresponding to the facial expression input by the user is a child, it determines that the object corresponding to the facial expression matches the target object, and obtains the corresponding relationship between the expression of the target object and the prompt information. For example, the corresponding relationship between the expression of the target object and the prompt information is shown in Table 2.

[0051] Table 2:

[0052]

[0053]

[0054] When the terminal detects that the facial expression of the user operating the terminal is "yawn", and the object corresponding to the facial expression is a child, it can be determined that the care term corresponding to the expression is "Baby, it's time to rest early so that you can grow taller" and the recommended control application information shown in Table 2. When the terminal detects that the facial expression of the user operating the terminal is "yawn", and the object corresponding to the facial expression is an adult, it can be determined that the care term corresponding to the expression is "Master, it's time to rest early. You have to get up early for work tomorrow" and the recommended control application information shown in Table 2. When the terminal detects that the facial expression of the user operating the terminal is "yawn", and the object corresponding to the facial expression is an elderly person, it can be determined that the care term corresponding to the expression is "Go to bed early and get up early to stay in good health" and the recommended control application information shown in Table 2.

[0055] S204: Obtain the corresponding target prompt information according to the facial expression.

[0056] In an embodiment of the present invention, after the terminal recognizes the facial expression input for the terminal, it will determine the target prompt information corresponding to the facial expression according to the correspondence between the expression and the prompt information.

[0057] In one implementation, the specific way for the terminal to determine the target prompt information corresponding to the facial expression according to the correspondence between the expression and the prompt information can be that the terminal detects whether the facial expression matches any of the reference facial expressions stored in the preset database. If it detects that the facial expression matches any of the reference facial expressions stored in the preset database, it will search for the prompt information corresponding to the reference facial expression that matches the facial expression stored in the preset database. Among them, the preset database stores at least one pre-configured reference facial expression, the prompt information input for each reference facial expression among the at least one reference facial expression, and the correspondence between the expression and the prompt information.

[0058] S205: Output the target prompt information, where the target prompt information includes care terms and / or recommended control application information.

[0059] In an embodiment of the present invention, after the terminal determines the target prompt information corresponding to the facial expression according to the correspondence between the expression and the prompt information, it will output the prompt information corresponding to the target expression.

[0060] In one implementation, before outputting the target prompt information, it can be detected whether the current operating state of the terminal is an idle state. Among them, the operating state includes a busy state or an idle state. If it is detected that the current operating state of the terminal is an idle state, step S205 will be executed. If it is detected that the current operating state of the terminal is a busy state, this process can be ended.

[0061] Among them, the idle state can be specifically defined as the state where the application currently running on the terminal is an entertainment application or no application is running. Among them, the entertainment application can be a music application, a video application, a news application, etc. For example, when the application running on the terminal is a video application, it is determined that the terminal is in the idle state. The busy state can be the state where the application currently running is a non-entertainment application. Among them, the non-entertainment application can include a phone application, a text message application, and an office software application, etc. For example, when the application running on the terminal is a phone application, it is determined that the terminal is in the busy state.

[0062] In one implementation, the specific manner for the terminal to output the prompt information corresponding to the target expression can be that the terminal detects the application currently running, obtains the prompt information output manner corresponding to the application, and then outputs the target prompt information in the prompt information output manner corresponding to the application.

[0063] Among them, different applications correspond to different prompt information output manners. The prompt information output manner can be a text information output manner, a picture information output manner, a voice information output manner. The text prompt information output manner and the picture information output manner can be automatically popped up on the terminal screen, slid in from above the terminal screen, slid in from below the terminal screen, etc. The prompt information can be output anywhere on the terminal screen. For example, the prompt information output manner corresponding to the game application is to display text prompt information in the upper right corner of the game application interface, and the prompt information output manner corresponding to the video application is to display picture prompt information in the upper right corner of the video application interface.

[0064] In one implementation, the target prompt information includes at least one recommended control application information. When outputting the target prompt information, the terminal can obtain the current time of the operating terminal, determine the target recommended control application information from the at least one recommended control application information according to the correspondence between the time and the recommended control application information, and output the target recommended control application information. For example, when the terminal detects that the facial expression of the user operating the terminal is "yawn", if the current time when the terminal is running is in the morning, it can be determined that the recommended control application information corresponding to the current time is "Do you want to buy a cup of coffee?", to remind the user whether to buy a cup of coffee to boost energy. If the current time when the terminal is running is in the evening, it can be determined that the recommended control application information corresponding to the current time is "Do you want to open the alarm setting?", to remind the user to set the alarm and go to bed. Another example, when the terminal detects that the facial expression of the user operating the terminal is "closing eyes", if the current time when the terminal is running is in the morning and the alarm is ringing continuously, it will remind the user whether to turn off the alarm. If the current time when the terminal is running is in the evening, the terminal will automatically enter the shutdown application or the power-saving mode, and remind the user that it has entered the corresponding mode or closed the relevant application, and ask whether to resume the original application or the original mode? For all the above application control reminders, if the user performs corresponding operations according to the reminder information, the corresponding application will be controlled to open or close.

[0065] In one implementation, after outputting the target recommended control application information, the terminal can receive a user operation input for the terminal. The user operation includes a gesture operation or a facial expression operation. The terminal controls the recommended control application corresponding to the recommended control application information according to the user operation. For example, when the terminal receives the "OK" gesture or the smiling facial expression input by the user, the recommended control application corresponding to the recommended control application information will be automatically opened. When the terminal receives the "X" gesture or the long-time closing eyes input by the user, the recommended control application corresponding to the recommended control application information will be automatically closed.

[0066] In the embodiment of the present invention, the terminal detects whether the current time is within a preset time range. Then, the terminal obtains a face image and identifies the facial expression in the face image, detects whether the object corresponding to the facial expression matches the target object, and obtains the correspondence between the expression corresponding to the target object and the prompt information. Further, the terminal obtains the corresponding target prompt information according to the facial expression and outputs the target prompt information. The target prompt information includes caring words and recommended control application information. By implementing the above method, the terminal can make corresponding responses according to the user's facial expression, output the recommended control application information according to the user's facial expression, and then open or close the recommended control application according to the user operation, which can more accurately meet the user's needs, avoid accidental opening or closing, and increase the humanization and intelligence of the terminal.

[0067] Please refer to Figure 3 , which is a schematic flowchart of another information output method provided by the embodiment of the present invention. InFigure 3 In the process, the user can pre-enter multiple types of expressions in the terminal expression library. These expressions can be "yawn", "cry", "laugh", etc. For each type of expression, the corresponding prompt information is entered to establish the correspondence between the expression and the prompt information. The correspondence between the human face expressions set by the user and the prompt information can be shown in Table 1. Within the evening time range of 22:00 - 2:00, the terminal turns on the camera and continuously monitors the human face expression of the user operating the terminal. At a certain time, the camera captures the human face image of the user operating the terminal, recognizes that the human face expression in the human face image is a yawn, and detects that the target object corresponding to this human face expression is an adult. Then the terminal determines that this human face expression matches the expression ("yawn") stored in the expression library, and finds the prompt information corresponding to "yawn" as the target prompt information. At this time, the caring message is "Master, it's time to go to bed early. You have to get up early for work tomorrow." and the recommended control application information is "Do you want to open the alarm clock setting?" Before outputting the target prompt information, it is detected that the application program currently running on the terminal is a video application program. Therefore, it can be determined that the current running state of the terminal is an idle state. Further, the output method of the prompt information corresponding to the application being a video is obtained, and the target prompt information is displayed in the upper right corner of the video application interface to prompt the user. When the user wants to enter the recommended control application, make an "OK" gesture or a smiling expression, and the alarm clock setting will be opened. When the user wants to close the recommended application, make an "X" gesture or close the eyes for a long time, and the alarm clock setting will be closed.

[0068] The following will Figure 4 be combined with the attached Figure 4 to introduce the information output device provided by the embodiment of the present invention in detail. It should be noted that the Figure 1 or Figure 2 shown information output device is used to execute the method of the embodiment of the present invention Figure 1 or Figure 2 shown embodiment. For the sake of convenience of description, only the parts related to the embodiment of the present invention are shown. For the specific technical details not disclosed, refer to the

[0069] Please refer to Figure 4 which is a schematic structural diagram of an information output device provided by the present invention. The information output device 40 includes: an identification module 401, an acquisition module 402, an output module 403, and a establishment module 404.

[0070] The identification module 401 is used for the terminal to acquire a human face image and identify the human face expression in the human face image;

[0071] The acquisition module 402 is used to acquire the corresponding target prompt information according to the human face expression;

[0072] An output module 403 is configured to output the target prompt information, where the target prompt information includes caring words and / or recommended control application information.

[0073] In one implementation, the apparatus further includes an establishing module 404, which is specifically configured to:

[0074] Establish a corresponding relationship between at least one reference facial expression and prompt information for the at least one reference facial expression.

[0075] In one implementation, the corresponding relationship is preset by the system or set by the user.

[0076] In one implementation, the recognition module 401 is further configured to:

[0077] Detect whether the current time is within a preset time range;

[0078] If it is detected that the current time is within the preset time range, then perform the steps of the terminal acquiring a facial image and recognizing the facial expression in the facial image.

[0079] In one implementation, the acquiring module 402 is further configured to:

[0080] Detect whether the object corresponding to the facial expression matches the target object;

[0081] If it is detected that the object corresponding to the facial expression matches the target object, then acquire the corresponding relationship between the expression of the target object and the prompt information.

[0082] In one implementation, the acquiring module 402 is specifically configured to:

[0083] Detect whether the facial expression matches any one of the reference facial expressions;

[0084] If there is a match, determine the prompt information corresponding to the reference facial expression that matches the facial expression as the target prompt information.

[0085] In one implementation, the output module 403 is specifically configured to:

[0086] Acquire the current time;

[0087] According to the corresponding relationship between the time and the recommended control application information, determine the target recommended control application information from the at least one recommended control application information;

[0088] Output the target recommended control application information.

[0089] In one implementation, the output module 403 is further configured to:

[0090] The terminal receives user operations, where the user operations include gesture operations and / or facial expression operations;

[0091] Control the recommended control application corresponding to the recommended control application information.

[0092] In an embodiment of the present invention, the recognition module 401 of the terminal acquires a face image and recognizes the facial expression in the face image. Further, the acquisition module 402 acquires corresponding target prompt information according to the facial expression, and the output module 403 outputs the target prompt information. The target prompt information includes caring words and / or recommended control application information. By implementing the above method, the terminal can make corresponding responses according to the user's expression, increasing the intelligence of the terminal.

[0093] Please refer to Figure 5 , which is a schematic structural diagram of a terminal provided by an embodiment of the present invention. As Figure 5 shown, the terminal includes: at least one processor 501, an input device 503, an output device 504, a memory 505, and at least one communication bus 502. Among them, the communication bus 502 is used to realize the connection and communication between these components. Among them, the input device 503 can be a control panel or a microphone, etc., and the output device 504 can be a display screen, etc. Among them, the memory 505 can be a high-speed RAM memory or a non-volatile memory, such as at least one disk memory. Optionally, the memory 505 can also be at least one storage device located far from the aforementioned processor 501. Among them, the processor 501 can be combined with Figure 5 the device described, a set of program codes are stored in the memory 505, and the processor 501, the input device 503, and the output device 504 call the program codes stored in the memory 505 to perform the following operations:

[0094] The processor 501 is used for the terminal to acquire a face image and recognize the facial expression in the face image;

[0095] The processor 501 is used to acquire corresponding target prompt information according to the facial expression;

[0096] The output device 504 is used to output the target prompt information, and the target prompt information includes caring words and / or recommended control application information.

[0097] In one implementation, the processor 501 is further used for:

[0098] Establish a corresponding relationship between at least one reference facial expression and the prompt information for the at least one reference facial expression.

[0099] In one implementation, the corresponding relationship is preset by the system or set by the user.

[0100] In one implementation, the processor 501 is further configured to:

[0101] Detect whether the current time is within a preset time range;

[0102] If it is detected that the current time is within the preset time range, then perform the steps of obtaining a face image input for the terminal input device 503 and recognizing the facial expression in the face image.

[0103] In one implementation, the processor 501 is further configured to:

[0104] Detect whether the object corresponding to the facial expression matches the target object;

[0105] If it is detected that the object corresponding to the facial expression matches the target object, then obtain the corresponding relationship between the expression of the target object and the prompt information.

[0106] In one implementation, the processor 501 is specifically configured to:

[0107] Detect whether the facial expression matches any one of the reference facial expressions;

[0108] If there is a match, determine the prompt information corresponding to the reference facial expression that matches the facial expression as the target prompt information.

[0109] In one implementation, the processor 501 is specifically configured to:

[0110] Obtain the current time;

[0111] According to the corresponding relationship between the time and the recommended control application information, determine the target recommended control application information from the at least one recommended control application information;

[0112] Output the target recommended control application information.

[0113] In one implementation, the processor 501 is further configured to:

[0114] The terminal receives a user operation, and the user operation includes a gesture operation and / or an expression operation;

[0115] Control the recommended control application corresponding to the recommended control application information.

[0116] In an embodiment of the present invention, the processor 501 acquires a face image input by the terminal input device 503, and recognizes the facial expression in the face image. Further, corresponding target prompt information is acquired according to the facial expression, and the output device 504 outputs the target prompt information. The target prompt information includes caring words and / or recommended control application information. By implementing the above method, the terminal can make corresponding responses according to the user's expression, increasing the intelligence of the terminal.

[0117] The module in the embodiment of the present invention can be implemented by a general integrated circuit, such as a CPU (Central Processing Unit), or by an ASIC (Application Specific Integrated Circuit).

[0118] It should be understood that in the embodiment of the present invention, the so-called processor 501 may be a central processing unit (CPU). The processor 501 may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) or other programmable logic devices, discrete element gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0119] The bus 502 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, etc. The bus 502 may be divided into an address bus, a data bus, a control bus, etc. For the sake of representation, Figure 5 it is only represented by a thick line, but it does not mean that there is only one bus or one type of bus.

[0120] In a specific implementation, the processor 501, the input device 503, the output device 504, and the memory 505 described in the embodiment of the present invention may execute the Figure 1 Or Figure 2The implementation manners described in the method embodiments can also implement the implementation manners of the information output device described in the embodiments of the present invention, which will not be elaborated herein.

[0121] In another embodiment of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program, and the computer program includes program instructions. When the program instructions are executed by a processor, the following operations are implemented: the terminal acquires a face image and recognizes the facial expression in the face image. Further, corresponding target prompt information is acquired according to the facial expression, and the target prompt information is output. The target prompt information includes caring words and / or recommended control application information.

[0122] The computer-readable storage medium may be an internal storage unit of the server described in any of the foregoing embodiments, such as the hard disk or memory of the server. The computer-readable storage medium may also be an external storage device of the server, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc. equipped on the server. Further, the computer-readable storage medium may also include both the internal storage unit and the external storage device of the server. The computer-readable storage medium is used to store the computer program and other programs and data required by the server. The computer-readable storage medium may also be used to temporarily store the data that has been output or will be output.

[0123] Those of ordinary skill in the art can understand that all or part of the processes of implementing the above method embodiments can be completed by instructing relevant hardware through a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it may include the processes of the above method embodiments. Among them, the storage medium may be a magnetic disk, an optical disc, a Read-Only Memory (ROM), or a Random Access Memory (RAM), etc.

[0124] Only some embodiments of the present invention are disclosed above. Of course, the scope of the rights of the present invention cannot be limited by this. Those of ordinary skill in the art can understand all or part of the processes of implementing the above embodiments, and the equivalent changes made according to the claims of the present invention still fall within the scope covered by the present invention.

Claims

1. An information output method, characterized in that The method includes: The terminal acquires a face image and recognizes the facial expression in the face image; Obtain corresponding target prompt information according to the facial expression, where the target prompt information includes caring words and / or at least one recommended control application information, and the recommended control application information is for recommending to open or close a function or application that matches the facial expression; Detect whether the current running state of the terminal is an idle state. If so, output the target prompt information, where the idle state is a state where the application currently running on the terminal is an entertainment application or no application is running; Receive a user operation, where the user operation includes a gesture operation and / or an expression operation; control the recommended control application corresponding to the recommended control application information according to the user operation; When the target prompt information includes at least one recommended control application information, the outputting the target prompt information includes: obtaining the current time; determining target recommended control application information from the at least one recommended control application information according to the correspondence between the time and the recommended control application information; outputting the target recommended control application information.

2. The method according to claim 1, wherein Before the terminal acquires a face image and recognizes the facial expression in the face image, the method further includes: Establish a correspondence between at least one reference facial expression and prompt information for the at least one reference facial expression.

3. The method according to claim 2, wherein The correspondence is preset by the system or set by the user.

4. The method according to claim 1, wherein Before the terminal acquires a face image and recognizes the facial expression in the face image, the method further includes: Detect whether the current time is within a preset time range; If it is detected that the current time is within the preset time range, then execute the steps of the terminal acquiring a face image and recognizing the facial expression in the face image.

5. The method according to claim 1, characterized in that, After the terminal acquires a face image and recognizes the facial expression in the face image, and before the step of obtaining corresponding target prompt information according to the facial expression, the method further includes: Detect whether the object corresponding to the facial expression matches the target object; If it is detected that the object corresponding to the facial expression matches the target object, then obtain the correspondence between the expression and the prompt information corresponding to the target object.

6. The method according to claim 2, wherein The obtaining the corresponding target prompt information according to the facial expression includes: Detect whether the facial expression matches any one of the reference facial expressions; If there is a match, determine the prompt information corresponding to the reference facial expression that matches the facial expression as the target prompt information.

7. An information output device, characterized in that, The device includes: An identification module, configured to acquire a face image by the terminal and recognize the facial expression in the face image; An acquisition module, configured to obtain corresponding target prompt information according to the facial expression, where the target prompt information includes caring words and / or at least one recommended control application information, and the recommended control application information is for recommending to open or close a function or application that matches the facial expression; An output module, configured to detect whether the current running state of the terminal is an idle state. If so, output the target prompt information, where the idle state is a state where the application currently running on the terminal is an entertainment application or no application is running; The output module is further configured to receive user operations, where the user operations include gesture operations and / or facial expression operations; and control the recommended control application corresponding to the recommended control application information according to the user operations. When the target prompt information includes at least one piece of recommended control application information, the output module is specifically configured to: obtain the current time; determine target recommended control application information from the at least one piece of recommended control application information according to the correspondence between the time and the recommended control application information; and output the target recommended control application information.

8. A terminal, characterized in that, It includes a processor, an input device, an output device, and a memory, and the processor, the input device, the output device, and the memory are interconnected. Among them, the memory is used to store a computer program, and the computer program includes program instructions. The processor is configured to call the program instructions to execute the method according to any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and the computer program includes program instructions. When the program instructions are executed by a processor, the processor is caused to execute the method according to any one of claims 1-6.

Images