Information processing method, device, electronic device and storage medium

Abstract

The present disclosure discloses an information processing method, device, electronic device, storage medium and program product, and relates to the field of computer technology, in particular to voice technology. The specific implementation scheme is: in response to a request from a local program to call up a social application, call up the social application; if it is determined that the wake-up voice information from the user is correct, receive the voice information through the social application; and if it is determined that the voice information includes instruction information, execute the instruction operation corresponding to the instruction information.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, in particular to voice technology, and specifically to information processing methods, devices, electronic devices, storage media, and program products. Background Art

[0002] With the continuous development of Internet technology and computer technology, the ways of communication between people are becoming more and more diverse. Among them, online social networking, as a social method with the Internet as the medium, makes full use of the Internet to transmit information. It can break the limitations of time and place and realize smooth and accurate information dissemination and communication. Summary of the invention

[0003] The present disclosure provides an information processing method, apparatus, electronic device, storage medium, and program product.

[0004] According to one aspect of the present disclosure, there is provided an information processing method, comprising: in response to a request from a local program for invoking a social application, invoking a social application; in a case where it is determined that the wake-up voice information from the user is correct, receiving voice information through the social application; and in a case where it is determined that the voice information includes instruction information, executing an instruction operation corresponding to the instruction information.

[0005] According to another aspect of the present disclosure, there is provided an information processing device, including: a calling module for calling up a social application in response to a request from a local program for calling up the social application; a voice information receiving module for receiving voice information through the social application when it is determined that the wake-up voice information from the user is correct; and an execution module for executing an instruction operation corresponding to the instruction information when it is determined that the voice information includes instruction information.

[0006] According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method as described above.

[0007] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method as described above.

[0008] According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein the computer program implements the method described above when executed by a processor.

[0009] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0011] Figure 1 A schematic diagram of an application scenario in which a local program calls a social application program is shown schematically;

[0012] Figure 2 An exemplary system architecture to which the information processing method and device according to an embodiment of the present disclosure can be applied is schematically shown;

[0013] Figure 3 The flowchart of the information processing method according to the embodiment of the present disclosure is schematically shown;

[0014] Figure 4 A schematic diagram of a process of invoking a voice interaction function module of a social application according to an embodiment of the present disclosure is shown;

[0015] Figure 5 A schematic diagram of a contact list in a social application according to the present disclosure is schematically shown;

[0016] Figure 6 A block diagram schematically shows an information processing device according to an embodiment of the present disclosure; and

[0017] Figure 7 A block diagram of an electronic device suitable for implementing an information processing method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0018] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0019] With the rapid development of the Internet and the rapid popularization of terminal devices, establishing connections and communicating with others through the Internet has gradually become a mainstream way. Combined with the popularization of big data applications, users can use terminal devices to input text, voice, and image input.

[0020] These different input methods are suitable for different application scenarios. The APP (application program) or system installed in the terminal device can continuously optimize these input methods to better support the application.

[0021] Currently, there are many ways to launch social applications, such as launching an APP through a voice assistant or launching an APP through image recognition.

[0022] The voice assistant calls up a certain APP, for example, the operating system of the iOS system uses the voice assistant to obtain the user's voice command in real time, and triggers the social application to automatically execute the startup operation.

[0023] Figure 1 A schematic diagram of an application scenario in which a local program calls a social application program is shown schematically.

[0024] like Figure 1 As shown, the social application 120 can be opened through the local program 110, such as the voice assistant in the iOS system (terminal device operating system). More specifically, the user can say "Hey voice assistant" to the terminal device to wake up the voice assistant, and then say "Please open social application AA" to the voice assistant to trigger the voice assistant to send a request for opening to the social application AA, so that the social application AA performs the opening operation in response to the request.

[0025] Although the above solution can use local programs such as voice assistants in the operating system to call up social applications. However, the calling operation is limited to opening the application, for example, displaying the home page 130 of the social application, and the functional modules inside the social application are not called up, such as voice interaction and image recognition related functional modules provided in the social application are not available. This results in the need for manual operation of subsequent voice interaction, for example, entering the corresponding chat interface, manually pressing the voice icon 140 for a long time to enter the voice message 150, and realizing voice interaction.

[0026] Embodiments of the present disclosure provide an information processing method, apparatus, electronic device, storage medium, and program product.

[0027] According to an embodiment of the present disclosure, an information processing method may include: in response to a request from a local program to call up a social application, calling up a social application; receiving voice information through the social application when it is determined that the wake-up voice information from the user is correct; and executing an instruction operation corresponding to the instruction information when it is determined that the voice information includes instruction information.

[0028] By using the information processing method provided by the embodiment of the present disclosure, the local program installed in the operating system can be used to voice-activate the social application, and the voice interaction of the social application can also be continuously controlled in the social application through voice commands, voice information, etc. That is, when it is inconvenient for the user to use both hands to operate, other programs can be used to activate the target program, and voice interaction and other operations can be seamlessly connected. The user is provided with support for the whole process of interaction, and finally the voice command support for the whole process from opening the target APP to the interaction in the target APP is realized, thereby improving the user experience.

[0029] In the technical solution disclosed herein, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0030] Figure 2 An exemplary system architecture to which the information processing method and apparatus according to an embodiment of the present disclosure can be applied is schematically shown.

[0031] It should be noted that Figure 2 The examples shown are only examples of system architectures to which the embodiments of the present disclosure can be applied, in order to help those skilled in the art understand the technical content of the present disclosure, but do not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios. For example, in another embodiment, the exemplary system architecture for applying the information processing method and apparatus may include a terminal device, but the terminal device may implement the information processing method and apparatus provided by the embodiments of the present disclosure without interacting with the server.

[0032] like Figure 2 As shown, the system architecture 200 according to this embodiment may include terminal devices 201, 202, 203, a network 204 and a server 205. The network 204 is used to provide a medium for communication links between the terminal devices 201, 202, 203 and the server 205. The network 204 may include various connection types, such as wired and / or wireless communication links, etc.

[0033] The user can use the terminal devices 201, 202, 203 to interact with the server 205 through the network 204 to receive or send messages, etc. Various communication client applications can be installed on the terminal devices 201, 202, 203, such as knowledge reading applications, web browser applications, search applications, instant messaging tools, email clients and / or social platform software, etc. (only as examples).

[0034] The terminal devices 201 , 202 , and 203 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers.

[0035] The server 205 may be a server that provides various services, such as a background management server (only an example) that provides support for the content browsed by the user using the terminal devices 201, 202, and 203. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to the user request) to the terminal device.

[0036] It should be noted that the information processing method provided in the embodiment of the present disclosure can generally be executed by the terminal device 201, 202, or 203. Accordingly, the information processing apparatus provided in the embodiment of the present disclosure can also be set in the terminal device 201, 202, or 203.

[0037] The information processing method provided in the embodiment of the present disclosure may be executed by a server or server cluster that is different from the server 205 and can communicate with the terminal devices 201, 202, 203 and / or the server 205. Accordingly, the information processing apparatus provided in the embodiment of the present disclosure may also be arranged in a server or server cluster that is different from the server 205 and can communicate with the terminal devices 201, 202, 203 and / or the server 205.

[0038] For example, when a user uses a social application to receive or send a voice message, the local program of the terminal devices 201, 202, and 203 responds to the user's voice request and calls up the social application, which can receive the user's voice message and then send the voice message to the server 205, which then sends the voice message to the corresponding recipient. Alternatively, a server or server cluster that can communicate with the terminal devices 201, 202, 203 and / or the server 205 sends the voice message to the corresponding recipient.

[0039] It should be understood that Figure 2 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0040] Figure 3 The flowchart of the information processing method according to the embodiment of the present disclosure is schematically shown.

[0041] like Figure 3 As shown, the method includes operations S310 to S330.

[0042] In operation S310 , in response to a request from a local program to invoke a social application, the social application is invoked.

[0043] In operation S320, in a case where it is determined that the wake-up voice information from the user is correct, voice information is received through the social application.

[0044] In operation S330, in a case where it is determined that the voice information includes instruction information, an instruction operation corresponding to the instruction information is performed.

[0045] According to an embodiment of the present disclosure, a local program may refer to a program installed on a terminal device that can provide a voice interaction function. For example, it may be a built-in application loaded on the terminal device, or it may be a third-party application installed on the terminal device. Among them, the built-in application may be a voice assistant. Among them, the third-party application may be a social application.

[0046] According to an embodiment of the present disclosure, a social application may refer to a social application that can provide functions such as instant reception and sending of messages.

[0047] According to an embodiment of the present disclosure, invoking a social application may refer to opening and calling the social application.

[0048] According to an embodiment of the present disclosure, in response to a request of a local program to call up a social application, the social application may be called up, such as opening the home page of the social application, but is not limited thereto. The voice interaction interface of the social application may also be called up, the image recognition function module of the social application may be called up, or the function module for receiving or sending voice information may be called up.

[0049] According to an embodiment of the present disclosure, the wake-up voice information may be control information for triggering the reception of voice information. The wake-up voice information may be used to identify a specific segment of the received voice information from a continuous speech stream in real time, and extract subsequent important information based on the specific segment.

[0050] According to the embodiments of the present disclosure, the length of the voice information is not limited. For example, it can be a keyword or a sentence. As long as it is voice information containing instruction information, it can be sufficient.

[0051] According to the embodiments of the present disclosure, in the social application, voice broadcast of unread messages, reminder of unread messages, sending messages, and replying messages can be performed. Voice information can be recognized, and instruction information can be determined from the voice information so that the social application performs the instruction operation corresponding to the instruction information.

[0052] By using the embodiments of the present disclosure, in response to a request from a local program to call up a social application, the social application can be automatically called up, and the voice interaction function operation can be continuously and automatically connected in the social application to complete the determination of the correctness of the wake-up voice information from the user, receive the voice information, and then automatically execute the instruction operation corresponding to the instruction information in the voice information. In this way, the user's hands can be freed, the convenience can be improved, and the user experience can be improved.

[0053] Reference below Figure 4-5 , the information processing method provided by the embodiment of the present disclosure is further explained in combination with specific embodiments.

[0054] According to an embodiment of the present disclosure, a request from a local program to launch a social application may be received. In response to the request from the local program to launch the social application, the social application is opened. A launch mode for launching the local program is determined. When the launch mode is determined to be launching the local program through voice instructions, the voice interaction function module of the social application is launched, so that when it is determined that the wake-up voice information from the user is correct, the voice information for the search is received through the voice interaction function module of the social application.

[0055] According to an embodiment of the present disclosure, the voice interaction function module may include a voice interaction interface that provides a voice interaction function, and may also include a voice recognition function module, etc. Any function module that can play a voice interaction role may be used.

[0056] According to other embodiments of the present disclosure, while invoking the voice interaction function module of the social application, the image recognition function module, the conversion function module for converting voice information into text information, and other function modules of the social application may also be invoked.

[0057] According to the embodiments of the present disclosure, when it is determined that the calling mode for calling up the local program is to call up by voice command, it can be preliminarily confirmed that the user is using the social application in a situation where both hands are inconvenient to operate. Therefore, when it is confirmed that the calling mode is to call up the local program by voice command, calling up the voice interaction function module of the social application can make the social application more intelligent, proactive, and close to the actual needs of users.

[0058] Figure 4 The flowchart of invoking the voice interaction function module of the social application according to an embodiment of the present disclosure is schematically shown.

[0059] like Figure 4As shown, a local program 410, such as a voice assistant of an iOS system, sends a call-up request to a social application 420, such as an AA APP. In response to the request, the social application 420 performs an opening operation. The social application 420 determines the calling mode for calling up the voice assistant, and when it is determined that the calling mode is to be called up by voice instructions, calls up the voice interaction function module, and can perform subsequent voice interaction operations coherently and automatically after calling up the voice interaction function module. For example, the voice interaction function module can be used to receive a voice message 430 to be sent, and enter the dialogue interface 440 of the social application, send the voice message 430 to be sent to the corresponding recipient, and display the voice message that has been sent in the dialogue interface 440. It can be understood that when it is determined that the calling mode is not to be called up by voice instructions, only the opening operation can be performed, such as displaying the home interface 450 of the social application.

[0060] According to an embodiment of the present disclosure, the local program may include a voice interaction program. For example, it may be a voice assistant in an iOS system or a voice assistant in an Android system. It may also be other applications that can provide voice interaction functions. As long as it is a program that can be awakened by voice information and provide voice interaction functions when the terminal device is in an unlocked state.

[0061] It should be noted that when a social application is turned on, the voice interaction function module of the social application can also be called up by determining the program type of the local program. For example, when the local program is a voice interaction program, it can be indirectly explained that the local program is called up by voice command, and then it is determined that the user may have difficulty using both hands when using the social application. Therefore, the voice interaction function module of the social application can be called up by determining that the program type of the local program is a voice interaction program. It should be noted that the determination can also be made in both ways. As long as the actual usage status of the user can be determined and a convenient determination method is provided to the user, it is acceptable.

[0062] According to an embodiment of the present disclosure, when the voice interaction function module of a social application is activated, voice prompt information can be output to indicate to the user that the social application has enabled voice interaction operations and can perform voice interaction operations.

[0063] For example, the voice prompt message "Hello, how can I help you?" or "Hello, the message sending function has been activated. Please tell me which friend you want to share your interesting stories with."

[0064] According to an embodiment of the present disclosure, the user can speak a wake-up voice message after hearing the voice prompt message sent by the terminal device.

[0065] According to an exemplary embodiment of the present disclosure, the operation of outputting voice prompt information may not be designed. The user may actively speak the wake-up voice information after a period of time after issuing a voice command to the local program. The wake-up voice information may be collected by a voice collection device and received by a voice interaction function module.

[0066] By utilizing the operation of outputting voice prompt information provided by the embodiments of the present disclosure, users can be reminded in a timely manner, so that users can provide quick feedback, saving time and improving user experience.

[0067] According to an embodiment of the present disclosure, the wake-up voice information can be used to further determine the start point of voice recording, that is, the wake-up voice information can be used as trigger information for voice information recording. In addition, the wake-up voice information can also be used to determine the user identity to improve the safety of the operation.

[0068] According to an embodiment of the present disclosure, a social application may receive a wake-up voice message from a user; determine that the wake-up voice message matches a preset wake-up voice message, and determine that the wake-up voice message is correct; and output voice feedback information so that new wake-up voice message can be input again if the wake-up voice message does not match the preset wake-up voice message.

[0069] According to an embodiment of the present disclosure, the wake-up voice information may be voice information that is consistent with the preset wake-up voice information. The wake-up voice information may be matched with the preset wake-up voice information, and when the two are determined to be the same, the social application is woken up. For example, when the user's "AA AA" wake-up voice information is received and identified and determined to be consistent with the preset wake-up voice information, the social application is woken up, and the subsequent recording and recognition of the voice information may be triggered.

[0070] According to other embodiments of the present disclosure, the wake-up voice information may also be voice information whose voiceprint information is consistent with the voiceprint information of the pre-stored preset wake-up voice information. The social application may collect, identify and store the user's voiceprint information in advance. When the user's wake-up voice information is received, the voiceprint information of the wake-up voice information may be identified and matched with the voiceprint information of the pre-stored preset wake-up voice information. When it is determined that the two are the same, the social application is awakened. For example, when the user's wake-up voice information of "AA AA" is received, and the voiceprint information of the wake-up voice information is identified and determined to be consistent with the voiceprint information of the pre-stored preset wake-up voice information, the social application is awakened, and the subsequent recording and recognition of the voice information can be triggered.

[0071] According to an embodiment of the present disclosure, instruction information in voice information may be determined through the following operations.

[0072] For example, recognizing voice information; and in the case where it is determined that the voice information includes a preset instruction keyword, determining that the voice information includes instruction information.

[0073] According to an embodiment of the present disclosure, recognizing voice information may be to convert the voice information into text information, and then use a text recognition model to recognize keywords or the entire content in the voice information.

[0074] According to an embodiment of the present disclosure, the voice information includes a preset instruction keyword, and the keyword in the recognized voice information or the entire content may be consistent with the preset instruction keyword.

[0075] For example, the voice message is "Send a message to Xiao A". After converting it into a text message, it is determined that it includes the preset instruction keyword "Send message", and then it is determined that the voice message includes instruction information.

[0076] According to the embodiments of the present disclosure, it is possible to more accurately determine whether the voice information includes instruction information by using keyword matching.

[0077] For another example, voice information is recognized; and when it is determined that the similarity between the semantics of the voice information and the semantics of a preset instruction keyword is greater than or equal to a preset similarity threshold, it is determined that the voice information includes instruction information.

[0078] According to an embodiment of the present disclosure, the similarity between the semantics of the voice information and the semantics of the preset instruction keywords can be determined by a semantic recognition model. For example, the voice information is converted into corresponding text information, and the semantic recognition model is used to identify and determine the semantic similarity between the text information corresponding to the voice information and the preset instruction keywords.

[0079] According to the embodiments of the present disclosure, the preset similarity threshold can be formulated according to actual conditions. The higher the similarity threshold is set, the higher the accuracy of determining the instruction information in the voice information can be improved.

[0080] Using the semantic similarity in the embodiment of the present disclosure to determine that the voice information includes instruction information is more flexible and intelligent.

[0081] For example, voice information is recognized; and when it is determined that the voice information includes preset instruction keywords and when it is determined that the similarity between the semantics of the voice information and the semantics of the preset instruction keywords is greater than or equal to a preset similarity threshold, it is determined that the voice information includes instruction information.

[0082] According to the embodiments of the present disclosure, it is possible to jointly determine that voice information includes instruction information through keyword matching and semantic similarity, which can not only improve the accuracy of judgment, but also intelligently identify specific instruction information, providing a basis for subsequent execution of instruction operations corresponding to the instruction information.

[0083] According to an embodiment of the present disclosure, the instruction operation that can be executed includes sending information.

[0084] According to an embodiment of the present disclosure, in response to instruction information, a recipient for receiving information can be searched from a voice message; when it is determined that the recipient is searched among the contacts of a social application, a first prompt message is output, wherein the first prompt message is used to prompt that an operation of sending the message can be performed; a voice message to be sent is recorded; when it is determined to stop recording, the recorded voice message to be sent is sent to the recipient; and when it is determined that the recipient is not searched among the contacts of the social application, a second prompt message is output, wherein the second prompt message is used to prompt that the operation of sending the message cannot be performed.

[0085] According to the embodiments of the present disclosure, it can be understood that the recipient may refer to one or more contact objects in the contact, and may also refer to one or more group objects in the contact.

[0086] According to an embodiment of the present disclosure, the first prompt information may be, for example, "The recipient has been determined, please speak the content to be sent", but is not limited thereto. It only needs to be voice prompt information for prompting the execution of the operation of sending information.

[0087] According to an embodiment of the present disclosure, the second prompt information may be, for example, "The corresponding recipient is not found, please confirm again", but is not limited thereto. It only needs to be a voice prompt information for prompting that the operation of sending the message cannot be performed.

[0088] According to an embodiment of the present disclosure, whether recording can be stopped may be determined through the following operations.

[0089] For example, the volume of the voice information being recorded and to be sent is detected; when it is determined that the volume of the voice information being recorded and to be sent is lower than a preset volume threshold, timing is started; and when it is determined that the timing time is greater than the preset time threshold, the recording operation is stopped.

[0090] According to an embodiment of the present disclosure, the volume of the voice information being recorded and to be sent may refer to sound energy. The volume of the voice information being recorded and to be sent may be determined by detection by a voice recognition function module.

[0091] According to an embodiment of the present disclosure, if the volume of the voice information to be sent being recorded is lower than a preset volume threshold, it can indicate that the user has ended the voice output. It can be understood that the volume of the voice information to be sent being recorded suddenly drops, or even becomes zero, due to the user stopping speaking. In other embodiments of the present disclosure, the recording operation can be stopped when the volume drops suddenly. However, during the user's speaking process, there may be brief pauses due to brief thinking or breathing, that is, the volume drops suddenly. If the recording operation is stopped when the volume drops suddenly, there is a problem of misjudgment, and it is impossible to accurately determine whether the user's actual end point has been reached.

[0092] According to the embodiment of the present disclosure, when it is determined that the volume of the voice information being recorded and to be sent is lower than the preset volume threshold, the time is counted, and when it is determined that the counted time is greater than the preset time threshold, the recording operation is stopped. Not only can the moment when the user stops speaking be accurately identified, but also the problem of misidentifying a short stop as a real end and causing incomplete recording is avoided, thereby improving the accuracy and rationality of the end point judgment.

[0093] It should be noted that the preset time threshold may be 5 seconds, 10 seconds or other preset time lengths, which can be determined according to actual conditions, as long as the end point can be accurately determined and the problem of slow response efficiency caused by too long a time can be avoided.

[0094] According to an embodiment of the present disclosure, the default operation may be to send the recorded voice message to be sent directly to the recipient. According to an embodiment of the present disclosure, the default operation may be to send the voice message according to the default operation format in the social application if the sending format is not indicated in the voice message of the user. However, it is not limited to this. It is also possible to determine the sending format of the recorded voice message to be sent from the voice message, and send the corresponding content according to the sending format.

[0095] According to an embodiment of the present disclosure, when it is determined that the sending format is a voice format, the recorded voice information to be sent can be directly sent.

[0096] According to an embodiment of the present disclosure, in the case where it is determined that the sending format is a text format, the recorded voice information to be sent may be converted into text, and the text may be sent.

[0097] According to an embodiment of the present disclosure, a voice-to-text conversion function module may be used to convert the recorded voice information to be sent into text, and then send the text to the corresponding recipient.

[0098] It should be noted that sending a message may not only refer to sending a message to a certain recipient in the contacts according to the user's voice message, but may also refer to a user replying to a message sent by a recipient after receiving the message from the recipient.

[0099] According to an embodiment of the present disclosure, the above-mentioned operation of sending a message may be used to reply to a message.

[0100] For example, in response to instruction information, a recipient for receiving the information is searched from the voice information; when it is determined that the recipient is found in the contacts of the social application, a first prompt information is output, wherein the first prompt information is used to prompt that an operation of sending the information can be performed; a voice message to be sent is recorded; and when it is determined to stop recording, the recorded voice message to be sent is sent to the recipient.

[0101] By utilizing the information processing method provided by the embodiments of the present disclosure, not only can voice messages to be sent be recorded, but also the recorded voice messages to be sent can be sent and replied to, thereby realizing multifunctional applications while freeing the user's hands and improving the convenience of user use.

[0102] According to an embodiment of the present disclosure, the instruction operation may further include broadcasting information. Information may be broadcasted through the following operations.

[0103] For example, in response to the instruction information, the unread information in the social application is queried; and when it is determined that the unread information is queried in the social application, the name of the sender corresponding to the unread information and the content of the unread information are broadcasted in sequence according to the order of the contact list.

[0104] Figure 5 A schematic diagram of a contact list in a social application according to an embodiment of the present disclosure is schematically shown.

[0105] like Figure 5 As shown, the contact list is displayed on the homepage 510 of the social application, and the arrangement order of the contact list can be sorted according to the arrangement order of the pinyin letters of the contact names, or can be an arrangement order adjusted based on the user's own settings. In the case of determining that unread information is queried in the social application, for example, in the case of unread information with an avatar 520 marked with an unread mark 530, the name 540 of the sender corresponding to the unread information and the content of the unread information can be broadcasted in sequence according to the order of the contact list.

[0106] According to an exemplary embodiment of the present disclosure, the name of the sender corresponding to any unread message and the content of the unread message may also be broadcasted according to the user's voice command. For example, if the user's voice command "Please broadcast AAA's unread messages" is received about reading the recipient AAA, the message sent by the recipient AAA is broadcasted according to the voice command.

[0107] According to an exemplary embodiment of the present disclosure, unread information in a social application can also be queried in real time. When it is determined that new information is received in the social application, the name of the sender of the unread information (i.e., the new information) and the content of the unread information are broadcast in real time.

[0108] According to an embodiment of the present disclosure, when it is determined that there is unread information in a social application, broadcasting the names of senders corresponding to the unread information and the contents of the unread information in sequence according to the order of the contact list may include the following specific operations.

[0109] For example, the format of the content of the unread information is identified; when it is determined that the format of the content of the unread information is a picture, the third prompt information is broadcast, wherein the third prompt information is used to indicate that the content of the unread information is a picture.

[0110] For another example, the format of the content of the unread information is identified; when it is determined that the format of the content of the unread information is voice, the content of the unread information is announced by voice.

[0111] For another example, the format of the content of the unread information is identified; when it is determined that the format of the content of the unread information is text, the text is converted into voice and voice broadcast is performed.

[0112] By using the information processing method provided by the embodiment of the present disclosure, not only can the content of unread information be voice broadcasted, but also the text can be converted into voice and then voice broadcasted, and in addition, the image content can be recognized. The function is powerful.

[0113] By using the information processing method provided by the embodiment of the present disclosure, not only can the content of unread messages be announced by voice, but also prompt information of pictures that cannot be announced can be announced. The traditional reading of unread messages by eyes is changed to listening to unread messages by ears, and the reading method and application scope are expanded to adapt to different application scenarios.

[0114] Figure 6 The block diagram schematically shows an information processing device according to an embodiment of the present disclosure.

[0115] like Figure 6 As shown, the information processing device 600 may include a calling module 610 , a voice information receiving module 620 , and an execution module 630 .

[0116] The invoking module 610 is used to invoke the social application in response to a request from a local program for invoking the social application;

[0117] A voice information receiving module 620 is used to receive the voice information through the social application program when it is determined that the wake-up voice information from the user is correct; and

[0118] The execution module 630 is used to execute the instruction operation corresponding to the instruction information when it is determined that the voice information includes instruction information.

[0119] According to an embodiment of the present disclosure, the tuning module 610 may include a start unit, a tuning mode determination unit, and a tuning unit.

[0120] An opening unit, configured to open the social application in response to a request from the local program for invoking the social application;

[0121] a calling mode determining unit, configured to determine a calling mode for calling a local program; and

[0122] The calling unit is used to call up the voice interaction function module of the social application when it is determined that the calling mode of the local program is to call up the local program through voice commands, so as to receive voice information through the voice interaction function module of the social application when it is determined that the wake-up voice information from the user is correct.

[0123] According to an embodiment of the present disclosure, the local program may include voice interaction molding.

[0124] According to an embodiment of the present disclosure, the information processing device 600 may further include a recognition module, a first instruction determination module, and a second instruction determination module.

[0125] A recognition module, used for recognizing voice information;

[0126] A first instruction determination module, configured to determine that the voice information includes instruction information when it is determined that the voice information includes a preset instruction keyword; and

[0127] The second instruction determination module is used to determine that the voice information includes instruction information when it is determined that the similarity between the semantics of the voice information and the semantics of a preset instruction keyword is greater than or equal to a preset similarity threshold.

[0128] According to an embodiment of the present disclosure, the instruction operation includes sending information.

[0129] According to an embodiment of the present disclosure, the execution module 630 may include a search unit, a first output unit, a recording unit, a sending unit, and a second output unit.

[0130] A search unit, for searching for a recipient for receiving the information from the voice information in response to the instruction information;

[0131] A first output unit, configured to output first prompt information when it is determined that the recipient is found in the contacts of the social application, wherein the first prompt information is used to prompt that an operation of sending the message can be performed;

[0132] A recording unit, used for recording the voice information to be sent;

[0133] A sending unit, used for sending the recorded voice message to be sent to the recipient when it is determined to stop recording;

[0134] The second output unit is used to output second prompt information when it is determined that the recipient is not found in the contacts of the social application, wherein the second prompt information is used to prompt that the operation of sending the message cannot be performed.

[0135] According to an embodiment of the present disclosure, the execution module 630 may further include a detection unit, a timing unit, and a stop unit.

[0136] A detection unit, used for detecting the volume of the voice information being recorded and to be sent;

[0137] A timing unit, for timing when it is determined that the volume of the voice information being recorded and to be sent is lower than a preset volume threshold;

[0138] The stopping unit is used to stop the recording operation when it is determined that the timing time is greater than a preset time threshold.

[0139] According to an embodiment of the present disclosure, the sending unit may include a format determining subunit, a sending subunit, and a converting subunit.

[0140] The format determination subunit is used to determine the sending format of the recorded voice information to be sent from the voice information;

[0141] A sending subunit, configured to directly send the recorded voice information to be sent when the sending format is determined to be a voice format; and

[0142] The conversion subunit is used to convert the recorded voice information to be sent into text and send the text when it is determined that the sending format is a text format.

[0143] According to an embodiment of the present disclosure, the instruction operation may include broadcasting information.

[0144] According to an embodiment of the present disclosure, the execution module 630 may include a query unit and a broadcast unit.

[0145] a query unit, configured to query unread information in a social application in response to the instruction information; and

[0146] The announcement unit is used to announce the names of senders corresponding to the unread information and the contents of the unread information in sequence according to the order of the contact list when it is determined that unread information is found in the social application.

[0147] According to an embodiment of the present disclosure, the announcement unit may include an identification subunit, a first announcement subunit, a second announcement subunit, and a third announcement subunit.

[0148] An identification subunit, used for identifying the format of the content of the unread message;

[0149] The first broadcast sub-unit is used to broadcast the third prompt information when it is determined that the format of the content of the unread information is a picture, wherein the third prompt information is used to indicate that the content of the unread information is a picture;

[0150] The second reporting subunit is used for reporting the content of the unread information by voice when it is determined that the format of the content of the unread information is voice;

[0151] The third broadcasting subunit is used for converting the text into voice and performing voice broadcasting when it is determined that the format of the content of the unread information is text.

[0152] According to an embodiment of the present disclosure, the information processing device 600 may further include a receiving module, a first information determining module, and a second information determining module.

[0153] A receiving module, used for receiving a wake-up voice message from a user;

[0154] A first information determination module, configured to determine that the wake-up voice information is correct when it is determined that the wake-up voice information matches the preset wake-up voice information; and

[0155] The second information determination module is used to output voice feedback information when the wake-up voice information does not match the preset wake-up voice information, so that the user can input new wake-up voice information again.

[0156] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0157] According to an embodiment of the present disclosure, an electronic device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method as described above.

[0158] According to an embodiment of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause a computer to execute the method as described above.

[0159] According to an embodiment of the present disclosure, a computer program product includes a computer program, and when the computer program is executed by a processor, the computer program implements the method as described above.

[0160] Figure 7 A schematic block diagram of an example electronic device 700 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0161] like Figure 7 As shown, the device 700 includes a computing unit 701, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 702 or a computer program loaded from a storage unit 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 can also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0162] A number of components in the device 700 are connected to the I / O interface 705, including: an input unit 706, such as a keyboard, a mouse, etc.; an output unit 707, such as various types of displays, speakers, etc.; a storage unit 708, such as a disk, an optical disk, etc.; and a communication unit 709, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 709 allows the device 700 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0163] The computing unit 701 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 701 performs the various methods and processes described above, such as information processing methods. For example, in some embodiments, the information processing method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 708. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 700 via ROM 702 and / or communication unit 709. When the computer program is loaded into RAM 703 and executed by the computing unit 701, one or more steps of the information processing method described above may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured to perform the information processing method in any other appropriate manner (e.g., by means of firmware).

[0164] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0165] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0166] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0167] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0168] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0169] A computer system may include a client and a server. The client and the server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises through computer programs running on respective computers and having a client-server relationship to each other. The server may be a cloud server, a server in a distributed system, or a server combined with a blockchain.

[0170] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0171] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. An information processing method, comprising: In response to a request from a local program to invoke a social application, invoking the social application; When determining that the wake-up voice information from the user is correct, receiving the voice information through the social application; as well as In the case where it is determined that the voice information includes instruction information, executing an instruction operation corresponding to the instruction information; Wherein, the method further comprises: recognizing the voice information; and When it is determined that the voice information includes a preset instruction keyword and the similarity between the semantics of the voice information and the semantics of the preset instruction keyword is greater than or equal to a preset similarity threshold, it is determined that the voice information includes the instruction information.

2. The method according to claim 1, wherein: In response to the request from the local program for invoking the social application, invoking the social application comprises: In response to a request from the local program to invoke a social application, opening the social application; determining a calling mode for calling the native program; and When it is determined that the startup mode of the local program is to start the local program through voice commands, the voice interaction function module of the social application is started, so that when it is determined that the wake-up voice information from the user is correct, the voice information is received through the voice interaction function module of the social application.

3. The method according to claim 1 or 2, wherein: The local program includes a voice interaction program.

4. The method according to claim 1, wherein: The instruction operation includes sending information; In the case where it is determined that the voice information includes instruction information, executing the instruction operation corresponding to the instruction information includes: In response to the instruction information, searching the voice information for a recipient for receiving the information; When it is determined that the recipient is found in the contacts of the social application, outputting first prompt information, wherein the first prompt information is used to prompt that an operation of sending a message can be performed; Record voice messages to be sent; In the case of determining to stop recording, sending the recorded voice message to be sent to the recipient; When it is determined that the recipient is not found in the contacts of the social application, second prompt information is output, wherein the second prompt information is used to prompt that the operation of sending the message cannot be performed.

5. The method according to claim 4, wherein: In the case where it is determined that the voice information includes instruction information, executing the instruction operation corresponding to the instruction information further includes: Detect the volume of the voice message being recorded and to be sent; When it is determined that the volume of the voice information being recorded and to be sent is lower than a preset volume threshold, timing; When it is determined that the timing time is greater than the preset time threshold, the recording operation is stopped.

6. The method according to claim 4, wherein: In the case of determining to stop recording, sending the recorded voice message to be sent to the recipient includes: Determining the sending format of the recorded voice information to be sent from the voice information; When it is determined that the sending format is a voice format, directly sending the recorded voice information to be sent; and In the case where it is determined that the sending format is a text format, the recorded voice information to be sent is converted into text, and the text is sent.

7. The method according to claim 1, wherein: The instruction operation includes broadcasting information; In the case where it is determined that the voice information includes instruction information, executing the instruction operation corresponding to the instruction information includes: In response to the instruction information, querying the social application for unread information; and When it is determined that unread information is found in the social application, the names of senders corresponding to the unread information and the contents of the unread information are broadcasted in sequence according to the order of the contact list.

8. The method according to claim 7, wherein: When it is determined that there is unread information in the social application, broadcasting the names of senders corresponding to the unread information and the contents of the unread information in sequence according to the order of the contact list includes: Identifying the format of the content of the unread information; When it is determined that the format of the content of the unread information is a picture, broadcasting third prompt information, wherein the third prompt information is used to indicate that the content of the unread information is a picture; When it is determined that the format of the content of the unread message is voice, announcing the content of the unread message by voice; When it is determined that the format of the content of the unread information is text, the text is converted into voice and voice broadcast is performed.

9. The method according to claim 1, further comprising: Receive a wake-up voice message from the user; If it is determined that the wake-up voice information matches the preset wake-up voice information, determining that the wake-up voice information is correct; as well as When the wake-up voice information does not match the preset wake-up voice information, voice feedback information is output so that the user can input new wake-up voice information again.

10. An information processing device, comprising: An invoking module, configured to invoke the social application in response to a request from a local program for invoking the social application; A voice information receiving module, configured to receive the voice information through the social application program when determining that the wake-up voice information from the user is correct; as well as an execution module, configured to execute an instruction operation corresponding to the instruction information when it is determined that the voice information includes instruction information; Wherein, the device further comprises: A recognition module, used for recognizing the voice information; and The instruction determination module is used to determine that the voice information includes the instruction information when it is determined that the voice information includes a preset instruction keyword and the similarity between the semantics of the voice information and the semantics of the preset instruction keyword is greater than or equal to a preset similarity threshold.

11. The device according to claim 10, wherein: The calling module comprises: an opening unit, configured to open the social application in response to a request from the local program for invoking the social application; a calling mode determining unit, configured to determine a calling mode for calling the local program; and The calling unit is used to call up the voice interaction function module of the social application when it is determined that the calling mode of the local program is to call up the local program through voice instructions, so as to receive voice information through the voice interaction function module of the social application when it is determined that the wake-up voice information from the user is correct.

12. The device according to claim 10, wherein: The instruction operation includes sending information; The execution module includes: A search unit, configured to search for a recipient for receiving the information from the voice information in response to the instruction information; A first output unit, configured to output first prompt information when it is determined that the recipient is found in the contacts of the social application, wherein the first prompt information is used to prompt that an operation of sending a message can be performed; A recording unit, used for recording the voice information to be sent; A sending unit, configured to send the recorded voice message to be sent to the recipient when it is determined to stop recording; The second output unit is used to output second prompt information when it is determined that the recipient is not found in the contacts of the social application, wherein the second prompt information is used to prompt that the operation of sending the message cannot be performed.

13. The device according to claim 12, wherein: The execution module also includes: A detection unit, used for detecting the volume of the voice information being recorded and to be sent; A timing unit, configured to start timing when it is determined that the volume of the voice information being recorded and to be sent is lower than a preset volume threshold; The stopping unit is used to stop the recording operation when it is determined that the timing time is greater than a preset time threshold.

14. The device according to claim 12, wherein: The sending unit comprises: A format determination subunit, used to determine the sending format of the recorded voice information to be sent from the voice information; a sending subunit, configured to directly send the recorded voice information to be sent when determining that the sending format is a voice format; and The conversion subunit is used to convert the recorded voice information to be sent into text and send the text when it is determined that the sending format is a text format.

15. The device according to claim 10, wherein: The instruction operation includes broadcasting information; The execution module includes: a query unit, configured to query unread information in the social application in response to the instruction information; and The announcement unit is used to announce the names of senders corresponding to the unread information and the contents of the unread information in sequence according to the order of the contact list when it is determined that unread information is found in the social application.

16. The device according to claim 15, wherein: The broadcast unit comprises: An identification subunit, used for identifying the format of the content of the unread information; a first broadcasting subunit, configured to broadcast third prompt information when it is determined that the format of the content of the unread information is a picture, wherein the third prompt information is used to indicate that the content of the unread information is a picture; A second reporting subunit is used for reporting the content of the unread information by voice when it is determined that the format of the content of the unread information is voice; The third reporting subunit is used for converting the text into voice and performing voice reporting when it is determined that the format of the content of the unread information is text.

17. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 9.

18. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-9.

19. A computer program product, comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 9.

Images