Information prompting method, electronic equipment and computer readable storage medium

Abstract

The invention relates to the technical field of terminals, and provides an information prompting method, electronic equipment and a computer readable storage medium. The method is applied to the electronic equipment, and comprises the following steps: firstly, converting obtained user voice into text information through a first application, and then obtaining the state of the first application; when the first application is in the first state, not displaying the text information in the second application; under the condition that the first application is in the second state, displaying the character information in the second application; wherein the first state indicates that the first application is running, and the second state indicates that the first application is not running. Through the process, the text can be effectively displayed based on the interaction state between the user and the electronic equipment, the user can conveniently check the complete text obtained through conversion, and the experience of the user for checking the text is improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an information prompting method, an electronic device, and a computer-readable storage medium. Background Art

[0002] Most current electronic devices have voice recognition functions. For example, after turning on this function, when a user starts speaking near the microphone of an electronic device, the electronic device can obtain the user's voice through the microphone, convert the user's voice into text, and display it on the screen; or, when an electronic device plays audio or video, the electronic device can obtain the sound of the built-in player, convert the user's voice into text, and display it on the screen.

[0003] In order to ensure the real-time display of text, the current technical solution divides the voice information into voice sections according to the time interval, and converts each voice section into text to obtain multiple text information. In addition, in order to ensure the correctness of the text content, the electronic device will also continuously correct the previously obtained text information through the text information obtained by the subsequent conversion based on the semantics of the context during the voice conversion process. When displaying the text information obtained by voice conversion, the electronic device in the voice conversion process generally directly displays the obtained text information. Then, in the case where each piece of text information corresponds to a prompt message, since the electronic device continuously displays the latest text information, the number of prompt messages of the electronic device continues to increase, and the user cannot fully view all the text information obtained by voice conversion through a prompt message. And the uncorrected text information will also be displayed in the prompt message, and the user cannot accurately view the text information obtained by voice conversion. Summary of the invention

[0004] In view of this, the present application provides an information prompt method, an electronic device and a computer-readable storage medium. Through this method, after the electronic device converts the voice into text, it can effectively display the text based on the interaction state between the user and the electronic device, so that the user can view the complete text obtained by conversion, thereby improving the user's experience of viewing the text.

[0005] In a first aspect, the present application provides an information prompt method, which is applied to an electronic device. The method includes the following process: first, the acquired user voice is converted into text information through a first application, and then the state of the first application is obtained. When the first application is in a second state, the text information is displayed in the second application, and the second state indicates that the first application is not running; wherein, when the first application is in a first state, the text information is not displayed in the second application, and the first state indicates that the first application is running. Through the above process, the text can be effectively displayed based on the interaction state between the user and the electronic device, which is convenient for the user to view the complete text obtained by conversion, thereby improving the user's experience of viewing the text.

[0006] In some examples, the first application is a voice input application, and the second application is a prompt bar application. In this way, the prompt bar of the electronic device can avoid displaying incomplete voice recognition results in the prompt bar during the operation of the voice input application. Therefore, by adopting the above embodiment, it can be ensured that the prompt message is concisely displayed in the prompt bar of the electronic device for the user to view.

[0007] In a possible implementation of the first aspect, obtaining the state of the first application includes: when the first application changes from the second state to the first state, setting the value of the member variable of the first application to a first value through the second application, the first value corresponds to the first state; when the first application changes from the first state to the second state, setting the value of the member variable of the first application to a second value through the second application, the second value corresponds to the second state. By assigning values ​​to the member variables, the state of the first application can be accurately updated and maintained.

[0008] In a possible implementation of the first aspect, the first application is in a first state, including: the value of the member variable is a first value; and the first application is in a second state, including: the value of the member variable is a second value. The value of the member variable of the first application represents the state of the first application, and thus, whether to display text information can be accurately determined by the value of the member variable of the first application. This can avoid displaying incomplete speech recognition results in the prompt bar during the operation of the speech input application.

[0009] In a possible implementation of the first aspect, after the acquired user voice is converted into text information through the first application, the method also includes: the first application sends the text message to the second application; the second application receives the text message; and obtains the status of the first application, including: in response to receiving the text message, the second application obtains the status of the first application.

[0010] In a possible implementation of the first aspect, the electronic device also includes a third application and a fourth application, and the first application sends text information to the second application, including: the first application sends text information to the third application, and the third application is used to store the text information; the fourth application monitors that there is updated text information in the third application and obtains the text information; the fourth application is used to monitor whether the text information stored in the third application is updated; the fourth application sends text information to the second application.

[0011] In some examples, the third application is a clipboard, and the fourth application is a clipboard listening application. The text information obtained by the first application through conversion can be sent to the third application first, so as to be copied from the third application to the second application for display. In this way, efficient information transmission can be achieved through copying.

[0012] In a possible implementation of the first aspect, the method further includes: after acquiring that the first application is in the first state, periodically monitoring the state of the first application, so that the state of the first application can be updated and maintained in a timely manner.

[0013] In a possible implementation of the first aspect, the second state includes a stop state and an abnormal state; the method further includes: the second application periodically monitors the state of the first application; and when determining that the first application switches from the first state to the abnormal state, modifies the value of the member variable of the first application. In this way, it can be ensured that when the first application is in an abnormal state, the text information is displayed in the prompt bar in a timely manner to avoid text loss.

[0014] In a possible implementation of the first aspect, the method also includes: the second application receives a first indication sent by the first application, and determines that the first application switches to the first state; the second application receives a second indication sent by the first application, and determines that the first application switches to the stopped state.

[0015] In a possible implementation manner of the first aspect, not displaying the text information in the second application includes: not displaying the text information in a window of the second application, where the window is displayed at a first position on a display screen of the electronic device.

[0016] In a second aspect, the present application provides an information prompt method, which is applied to an electronic device, and the electronic device includes a fifth application and a sixth application. The method includes: in response to a user's operation of closing the fifth application, stopping displaying the interface of the fifth application, and the fifth application is used to generate subtitle information based on audio information; saving the subtitle information through the sixth application, and the sixth application is used to display the subtitle information; displaying prompt information, and the prompt information is used to indicate the saving result of the sixth application.

[0017] In some examples, the fifth application is a subtitle application, and the sixth application is a designated application such as a text editing application or a text viewing application. The sixth application and the fifth application are independent applications. When the electronic device detects that the user clicks on a control to close the subtitle application, the subtitle application interacts with the designated application and the subtitle file can be saved in the designated application. Afterwards, the retention result is displayed to prompt the user, so that the user can view the retention result of the subtitle file and improve the user's experience of viewing the text.

[0018] In a possible implementation manner of the second aspect, displaying the prompt information includes: the fifth application obtains the saving result generated by the sixth application; and displaying the saving result through the fifth application.

[0019] In a possible implementation manner of the second aspect, the fifth application obtains the saving result generated by the sixth application, including: the fifth application receives the saving result sent by the sixth application.

[0020] In a possible implementation manner of the second aspect, the fifth application obtains the saved result generated by the sixth application, including: the fifth application polls the saved result of the sixth application according to a preset period.

[0021] In a possible implementation of the second aspect, subtitle information is saved through a sixth application, including: in response to a user closing a fifth application, the fifth application sends subtitle information to the sixth application; prompt information is displayed, including: within the first time after sending the subtitle information, the fifth application does not obtain the saving result; the fifth application displays a prompt information, and the prompt information is used to indicate that the subtitle information fails to be saved.

[0022] In a possible implementation manner of the second aspect, after displaying the prompt information, the method further includes: stopping running the fifth application.

[0023] In a possible implementation manner of the second aspect, the method further includes: in response to a user operation of closing the fifth application, stopping the fifth application; and displaying the prompt information, including: displaying the prompt information through a sixth application.

[0024] In a possible implementation manner of the second aspect, the audio information includes audio information corresponding to the audio or video being played by the electronic device, or audio information corresponding to the audio or video acquired by the electronic device.

[0025] In a third aspect, the present application provides an electronic device, the electronic device comprising a display screen, a memory and one or more processors; the display screen, the memory and the processor are coupled; the display screen is used to display an image generated by the processor, the memory is used to store a computer program code, and the computer program code includes a computer instruction; when the processor executes the computer instruction, the electronic device executes:

[0026] Convert the acquired user voice into text information through the first application; obtain the status of the first application; when the first application is in the second state, display the text information in the second application, and the second state indicates that the first application is not running; wherein, when the first application is in the first state, the text information is not displayed in the second application, and the first state indicates that the first application is running.

[0027] When the processor executes the computer instructions, it also causes the electronic device to execute: when the first application changes from the second state to the first state, the value of the member variable of the first application is set to the first value through the second application, and the first value corresponds to the first state; when the first application changes from the first state to the second state, the value of the member variable of the first application is set to the second value through the second application, and the second value corresponds to the second state.

[0028] When the processor executes the computer instruction, the electronic device is also caused to execute: the value of the member variable is the first value; and the value of the member variable is the second value.

[0029] When the processor executes the computer instructions, the electronic device is also caused to execute: the first application sends text information to the second application; the second application receives the text information; in response to receiving the text information, the second application obtains the state of the first application.

[0030] When the processor executes computer instructions, the electronic device also includes a third application and a fourth application, and also enables the electronic device to execute: the first application sends text information to the third application, and the third application is used to store text information; the fourth application monitors whether there is updated text information in the third application and obtains the text information; the fourth application is used to monitor whether the text information stored in the third application is updated; the fourth application sends text information to the second application.

[0031] When the processor executes the computer instruction, it also causes the electronic device to execute: after obtaining that the first application is in the first state, periodically monitoring the state of the first application.

[0032] When the processor executes the computer instruction, the second state includes a stop state and an abnormal state, and also enables the electronic device to execute: the second application periodically monitors the state of the first application; when it is determined that the first application switches from the first state to the abnormal state, the member variable value of the first application is modified.

[0033] When the processor executes the computer instructions, the electronic device also executes: the second application receives the first indication sent by the first application, and determines that the first application switches to the first state; the second application receives the second indication sent by the first application, and determines that the first application switches to the stopped state.

[0034] When the processor executes the computer instruction, it also causes the electronic device to execute: not displaying text information in the window of the second application, and displaying the window at the first position of the display screen of the electronic device.

[0035] In a fourth aspect, the present application provides an electronic device, comprising a display screen, a memory and one or more processors; the display screen, the memory and the processor are coupled; the display screen is used to display an image generated by the processor, the memory is used to store computer program codes, and the computer program codes include computer instructions; when the processor executes the computer instructions, the electronic device executes: in response to a user's operation of closing a fifth application, stopping displaying the interface of the fifth application, the fifth application is used to generate subtitle information based on audio information; saving the subtitle information through a sixth application, the sixth application is used to display the subtitle information; and displaying a prompt message, the prompt message is used to indicate the saving result of the sixth application.

[0036] When the processor executes the computer instructions, the electronic device is also caused to execute: the fifth application obtains the saved result generated by the sixth application; and the saved result is displayed by the fifth application.

[0037] When the processor executes the computer instructions, it also causes the electronic device to execute: the fifth application receives the saved result sent by the sixth application.

[0038] When the processor executes the computer instruction, it also causes the electronic device to execute: the fifth application polls the saved result of the sixth application according to a preset period.

[0039] When the processor executes the computer instructions, it also causes the electronic device to execute: in response to the user closing the fifth application, the fifth application sends subtitle information to the sixth application; and it also causes the electronic device to execute: within the first time after sending the subtitle information, the fifth application does not obtain the saving result; the fifth application displays a prompt message, and the prompt message is used to indicate that the subtitle information fails to be saved.

[0040] When the processor executes the computer instructions, it also causes the electronic device to execute: stop running the fifth application.

[0041] When the processor executes the computer instructions, it also causes the electronic device to execute: in response to the user's operation of closing the fifth application, stop running the fifth application; and also causes the electronic device to execute: display prompt information, including: displaying prompt information through a sixth application.

[0042] When the processor executes the computer instruction, the audio information includes audio information corresponding to the audio or video being played by the electronic device, or audio information corresponding to the audio or video acquired by the electronic device.

[0043] In a fifth aspect, the present application provides a computer-readable storage medium, comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method described in the first aspect and any possible design thereof.

[0044] In a sixth aspect, the present application provides a computer-readable storage medium, comprising computer instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the second aspect above and any possible design thereof.

[0045] In a seventh aspect, the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect and any possible design thereof.

[0046] In an eighth aspect, the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute the method described in the second aspect above and any possible design thereof.

[0047] In a ninth aspect, the present application provides a device, which is included in an electronic device, and the device has the function of implementing the behavior of the electronic device in any of the above aspects and possible implementation methods. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above function. For example, a voice conversion module or unit, a state acquisition module or unit, a display module or unit, an acquisition module or unit, and a storage module or unit, etc.

[0048] In a tenth aspect, an embodiment of the present application provides a chip system, which includes a processor and may also include a memory, for implementing any one of the methods provided in the first to second aspects above. The chip system may be composed of a chip, or may include a chip and other discrete devices.

[0049] It can be understood that the electronic device described in the third aspect and any possible design thereof provided above, the electronic device described in the fourth aspect and any possible design thereof, the computer-readable storage medium described in the fifth aspect, the computer-readable storage medium described in the sixth aspect, the computer program product described in the seventh aspect, and the computer program product described in the eighth aspect are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 A schematic diagram of a display interface of a voice input application provided in an embodiment of the present application;

[0051] Figure 2 A schematic diagram of a display interface of a prompt bar provided in an embodiment of the present application;

[0052] Figure 3 A schematic diagram of an electronic device provided in an embodiment of the present application;

[0053] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0054] Figure 5 A software structure block diagram of an electronic device provided in an embodiment of the present application;

[0055] Figure 6 A schematic diagram of an operation interface provided in an embodiment of the present application;

[0056] Figure 7 A flowchart of an information prompting method provided in an embodiment of the present application;

[0057] Figure 8 A schematic diagram of a voice input application interface provided in an embodiment of the present application;

[0058] Fig. 9 A flowchart of an information prompting method provided in an embodiment of the present application;

[0059] Fig.10 A flowchart of an information prompting method provided in an embodiment of the present application;

[0060] Fig.11 A flowchart of an information prompting method provided in an embodiment of the present application;

[0061] Fig.12 A flowchart of an information prompting method provided in an embodiment of the present application;

[0062] Fig.13 A schematic diagram of a subtitle application interface provided in an embodiment of the present application;

[0063] Fig.14 A schematic diagram of a setting interface of a subtitle application provided in an embodiment of the present application;

[0064] Fig.15 A flowchart of an information prompting method provided in an embodiment of the present application;

[0065] Fig.16 A schematic diagram of a display interface of an information prompt method provided in an embodiment of the present application;

[0066] Fig.17A flowchart of an information prompting method provided in an embodiment of the present application;

[0067] Fig.18 A flowchart of an information prompting method provided in an embodiment of the present application;

[0068] Fig.19 A flowchart of an information prompting method provided in an embodiment of the present application;

[0069] Fig. 20 A flowchart of an information prompting method provided in an embodiment of the present application;

[0070] Fig.21 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0071] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0072] In some embodiments, an electronic device with a voice recognition function can convert voice into text. According to the way the electronic device acquires voice, the voice recognition function of the electronic device can be divided into a voice input sub-function, a subtitle sub-function, etc. according to different actual usage scenarios. Among them, the voice input sub-function means that the electronic device can display the text in the text input box that the user wants to input after the acquired voice is converted into text, so as to assist the user in text input. The subtitle sub-function means that the electronic device can convert the voice in the audio or video into text when playing audio or video, and display the text in the subtitle display area, so that the user can watch the subtitles corresponding to the audio or video. For the convenience of description below, the voice input sub-function and the subtitle sub-function of the present application are explained through the voice input application and the subtitle application respectively.

[0073] In some examples, when the user uses the voice input sub-function of the electronic device, in order to ensure the real-time performance of the electronic device voice-to-text conversion, the electronic device will divide the continuous voice into multiple voice segments according to the order of occurrence in time according to the recognition interval, and recognize the first acquired voice segment. The first acquired front segment voice is converted to obtain the corresponding front text, and the front text is displayed on the display screen of the electronic device. After that, the electronic device converts the later acquired rear segment voice to obtain the corresponding rear text, and displays the rear text on the display screen of the electronic device. For example, the user said "Look, the loquats here. It looks delicious." It took a total of 4 seconds. The first 2 seconds were to say "Look, the loquats here", and the last two seconds were to say "It looks delicious." If the recognition interval of the electronic device is 2 seconds, then the front text recognized by the electronic device is "Look, the loquats here." The rear text recognized by the electronic device is "It looks delicious."

[0074] Finally, in order to ensure the accuracy of the speech-to-text conversion, the electronic device will also analyze the semantics between the previous text and the following text, and correct the previous text and the following text based on the analysis results. For example, based on the meaning of the following text, the typos or homophones in the original previous text can be corrected. As in the example described above, the previous text recognized by the electronic device is "Look, the pipa here", and the electronic device's display screen displays the following Figure 1 The electronic device then recognizes the following text as "looks delicious" and displays the following on the display screen of the electronic device: Figure 1 The electronic device performs semantic analysis on the preceding text and the following text, and can correct the "pipa" in the preceding text to "loquat", and display the following on the display screen: Figure 1 The interface shown in (c).

[0075] In some examples, when a user uses the subtitle sub-function of an electronic device, the electronic device can obtain the voice of the audio or video being played by the electronic device through an audio and video player, and convert the obtained voice into text. The specific conversion process is similar to the conversion process in the voice input sub-function, and will not be repeated here.

[0076] In some embodiments, when a user uses the voice input sub-function provided by the voice input application app1 of the electronic device, such as Figure 1As shown, the electronic device can display the text obtained by voice conversion in the display interface corresponding to the voice input application app1. The electronic device can also display the text obtained by voice conversion in the text input box of other applications, or display the recognition result in a specified interface in the form of a prompt message. In this way, the text obtained by voice conversion can be displayed across applications, providing users with a better user experience.

[0077] In some examples, after the electronic device detects that the user clicks the voice recognition control in the voice input application app1, and detects that the cursor is moved by the user to the text input box of other applications, the voice recognition result will be displayed in the text input box of other text editing applications. In this way, voice input can be implemented.

[0078] In some instances, in order to facilitate users to view the historical content of voice-converted text, after the electronic device detects that the user clicks the voice input auxiliary prompt opening control in the setting interface corresponding to the voice input application app1, the electronic device can display the text converted by voice recognition in the prompt bar in the form of a prompt for the user to view later. Among them, the prompt bar is a display interface corresponding to the prompt bar application, and the prompt bar can be a display bar displayed on the side of the electronic device display screen, and can also be a negative one screen, etc.

[0079] In some embodiments, the electronic device can realize an application independent of the voice input application app1 through the cut and paste function or the copy and paste function provided by the clipboard, and display the text converted by the voice input application app1. In some examples, the voice input application app1 of the electronic device can put the text obtained by voice segment recognition into the clipboard, and then monitor the text content in the clipboard through the clipboard monitoring application. If the clipboard monitoring application monitors that the text in the clipboard is updated, the clipboard monitoring application pastes the text in the clipboard into the text input box or prompt bar of other applications to display the voice recognition text. In order to ensure the real-time performance of voice recognition, the voice recognition module will sequentially put the recognized or corrected text directly into the clipboard, and the clipboard monitoring application will also directly paste the text in the clipboard into the prompt bar, and display the text in the clipboard in the prompt bar in the form of a prompt message. And the prompt message displayed in the prompt bar cannot be modified, so as the voice recognition process advances, the number of prompt messages displayed in the prompt bar will accumulate and increase. Since the display area of ​​the prompt bar is limited, the continuous increase of the prompt message of the prompt bar will also cause the prompt message displayed in the prompt bar to be constantly refreshed.

[0080] For example, the user takes 6 seconds to say "Look, the loquats here. They look delicious. Let's take some back and taste them." The recognition interval of the electronic device is 2 seconds, so the electronic device can successively obtain three voice segments. If the text obtained by the electronic device based on the first voice segment is recognized as "Look, the pipa here", the electronic device can put "Look, the pipa here" into the clipboard, and the clipboard monitoring application monitors that the text in the clipboard is updated, then the clipboard monitoring application pastes the text "Look, the pipa here" in the clipboard to the prompt bar. Figure 2 In the interface shown in (a), the prompt bar of the electronic device displays prompt message 1. Then, if the electronic device recognizes the text "looks delicious" based on the second voice segment, the electronic device can put "looks delicious" into the clipboard, and the clipboard monitoring application monitors that the text in the clipboard is updated, then the clipboard monitoring application pastes the text "looks delicious" in the clipboard into the prompt bar. Figure 2 In the interface shown in (b), the prompt bar of the electronic device adds prompt message 2. After the electronic device obtains the text "It looks delicious", the voice recognition module corrects "Look, the pipa here" to "Look, the loquat here" based on semantic analysis. The voice recognition module then puts "Look, the loquat here" into the clipboard, as described above in the clipboard monitoring and pasting process. Figure 2 In the interface shown in (c), the prompt bar of the electronic device adds prompt message 3. Afterwards, if the text obtained by the electronic device based on the third voice segment recognition is "Take it back and taste it for everyone", the voice recognition module puts "Take it back and taste it for everyone" into the clipboard, and the clipboard monitoring and pasting process described above is as follows. Figure 2 In the interface shown in (d), the prompt bar of the electronic device adds a prompt message 4. It can be seen that Figure 2 (a) to Figure 2 In process (d), as the voice recognition process progresses, the number of prompt messages in the prompt bar of the electronic device continues to increase, resulting in a complete voice message being displayed in multiple prompt messages, and the user is unable to fully view the text content corresponding to the complete voice message.

[0081] Therefore, the present application provides an information prompt method, in which an electronic device obtains voice information through a voice input application, and then recognizes the voice information through a voice recognition module to obtain text information. Then, the electronic device can first send the text information to the clipboard. After the electronic device monitors the change of the text content in the clipboard through the clipboard monitoring application, it will determine the running status of the voice input application. If the voice input application is in a stopped state, the electronic device sends an instruction to the side display bar for displaying the content in the clipboard, so that the side display bar can display the text information currently stored in the clipboard.

[0082] Alternatively, the electronic device may obtain voice information through a subtitle application, and then obtain text information by recognizing the voice information through a voice recognition module. In this process, the electronic device stores the obtained text information in a specified storage path. If the electronic device detects that the user clicks on the exit control of the subtitle application, the electronic device may start a note application and display the text information in the specified storage path in the note application.

[0083] In this way, through the information prompt method provided in the embodiment of the present application, after the electronic device saves the text obtained by voice conversion, the saved text is effectively displayed based on the interaction status between the user and the electronic device, which is convenient for the user to view the complete text obtained by conversion, thereby improving the user's experience of viewing the text.

[0084] The information prompt method provided in the embodiment of the present application can be applied to the electronic device 100. For example, Figure 3 As shown, the electronic device 100 can be a laptop computer 31, a tablet computer 32, a mobile phone 33, a smart screen 34, a vehicle-mounted device, a wearable device (such as a smart watch), an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an artificial intelligence device, or other terminal device with voice recognition and display functions. The operating system installed in the electronic device 100 includes but is not limited to Or other operating systems. The embodiment of the present application does not limit the specific type of the electronic device 100 and the installed operating system.

[0085] Figure 4The structure diagram of the electronic device 100 is shown. The electronic device 100 may include a processor 410, an external memory interface 420, an internal memory 421, a universal serial bus (USB) interface 430, a charging management module 440, a power management module 441, a battery 442, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, an earphone interface 470D, a sensor module 480, a button 490, a motor 491, an indicator 492, a camera 493, a display screen 494, and a subscriber identification module (SIM) card interface 495.

[0086] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0087] The processor 410 may include one or more processing units, for example, the processor 410 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0088] The charging management module 440 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While the charging management module 440 charges the battery 442, it can also power the electronic device through the power management module 441.

[0089] The power management module 441 is used to connect the battery 442, the charging management module 440 and the processor 410. The power management module 441 receives input from the battery 442 and / or the charging management module 440 to power the processor 410, the internal memory 421, the external memory, the display screen 494, the camera 493, and the wireless communication module 460.

[0090] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the wireless communication module 460, etc. The wireless communication function of the electronic device 100 can also be implemented through the antenna 2, the mobile communication module 450, the modem processor and the baseband processor.

[0091] The wireless communication module 460 can provide wireless communication solutions for application in the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0092] The mobile communication module 450 can provide wireless communication solutions including 2G / 3G / 4G / 5G etc. applied on the electronic device 100 .

[0093] In some embodiments, the specific implementation of the wireless communication function of the electronic device can be determined based on the type of electronic device. For example, the wireless communication function can be implemented in electronic devices such as desktop computers, laptops, tablet computers, and mobile phones through the wireless communication module 460. The wireless communication function can also be implemented in electronic devices such as tablet computers and mobile phones through the mobile communication module 450. The antenna 1 is coupled to the wireless communication module 460, and the antenna 2 of the electronic device 100 is coupled to the mobile communication module 450, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0094] The electronic device 100 implements the display function through a GPU, a display screen 494, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen 494 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 410 may include one or more GPUs, which execute program instructions to generate or change display information. The electronic device 100 can implement a shooting function through an ISP, a camera 493, a video codec, a GPU, a display screen 494, and an application processor. The external memory interface 420 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The internal memory 421 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 410 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 421.

[0095] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 470, the speaker 470A, the receiver 470B, the microphone 470C, the headphone jack 470D, and the application processor.

[0096] The audio module 470 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 470 can also be used to encode and decode audio signals. In some embodiments, the audio module 470 can be arranged in the processor 410, or some functional modules of the audio module 470 can be arranged in the processor 410.

[0097] The speaker 470A is used to convert the audio electrical signal into a sound signal. The electronic device 100 can play the audio through the speaker 470A. The electronic device can convert the audio played through the speaker 470A into text information using the subtitle sub-function.

[0098] The microphone 470C is used to convert sound signals into electrical signals. The electronic device 100 can capture voice information through the microphone 470C. The electronic device can convert the audio played through the speaker 470A into text information using the voice input sub-function or the subtitle sub-function.

[0099] The key 490 includes a power key, a volume key, etc. The key 490 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0100] Indicator 492 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0101] The SIM card interface 495 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 495 or pulling it out from the SIM card interface 495. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 495 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 495 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 495 can also be compatible with different types of SIM cards. The SIM card interface 495 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0102] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the electronic device 100 is exemplified.

[0103] Figure 5 1 is a software structure diagram of the electronic device 100 according to an embodiment of the present invention. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces.

[0104] In some embodiments, The system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime ( runtime) and system libraries, as well as the kernel layer.

[0105] The application layer can include a series of application packages. Figure 5 As shown, the application package may include applications such as camera, gallery, calendar, call, Bluetooth, music, video, short message, voice input, clipboard, subtitles, etc.

[0106] The voice input application is used to provide a voice input sub-function. The voice input application can obtain the voice information of the user when speaking and convert the voice information into text information. Afterwards, the electronic device can display the text information converted by the voice input application for the user to view.

[0107] The clipboard is used to provide copy, cut and paste functions. Electronic devices can copy / cut any content to the clipboard, and then paste it into other applications.

[0108] The subtitle application is used to provide a subtitle sub-function. The subtitle application can obtain the voice information in the video or audio played by the electronic device and convert the voice information into text information. Afterwards, the electronic device can display the text information converted by the subtitle application for the user to view.

[0109] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0110] like Figure 5 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0111] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to the application. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon may include a view for displaying text and a view for displaying pictures. The phone manager is used to provide communication functions for the electronic device 100. For example, the management of call status (including connecting, hanging up, etc.). The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify the completion of downloads, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of an icon or scroll bar text, or a notification that appears on the screen in the form of a dialog window.

[0112] Runtime includes core libraries and virtual machines. The runtime is responsible for scheduling and management of the Android system.

[0113] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0114] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0115] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0116] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of multiple common audio and video formats, as well as static image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing. The 2D graphics engine is a drawing engine for 2D drawing.

[0117] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, microphone driver, speaker driver, and sensor driver.

[0118] In the above embodiment, The software architecture of the electronic device is described by taking the system as an example. It should be understood that if the operating system of the electronic device is The software architecture of a system is divided into two parts: user state and kernel state. The user state includes the application layer and the application framework layer, and the kernel state includes runtime and system libraries, as well as the kernel layer. The application layer and application framework layer in user mode, and the kernel layer in kernel mode runtime and system libraries, as well as the kernel layer and Figure 5 The functions of the modules involved are similar, so they will not be described here.

[0119] In some embodiments, after the electronic device detects that the user clicks on the icon corresponding to the voice input application or the icon corresponding to the subtitle application, the voice input application or the subtitle application can be run. In some examples, the display interface of other applications can also include an entry to the voice input application or an entry to the subtitle application. For example, the electronic device can display the operation interface of the shortcut tool application, and the application startup control installed on the electronic device can be displayed in the operation interface. For example, Figure 6As shown in (a), the start control 61 corresponding to the voice input application, the start control 62 corresponding to the subtitle application, etc. For another example, the electronic device may display an operation interface of a third-party application app2, and the start control of the application icon installed in the electronic device may be displayed in the operation interface. Figure 6 As shown in (b), there is a start control 63 corresponding to the voice input application, a start control 64 corresponding to the subtitle application, and the like.

[0120] The following is an example of the workflow of the software and hardware of the electronic device 100 in conjunction with the scenario of capturing voice.

[0121] If the electronic device detects that the user moves the cursor Figure 6 When the start control 61 in the interface shown in (a) performs a cursor click operation, the corresponding hardware interrupt of the electronic device is sent to the kernel layer. The kernel layer processes the cursor click operation into an original input event (including cursor click coordinates, timestamp of cursor click operation, etc.). The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the start control corresponding to the input event. The cursor click operation is a single click operation, and the single click operation corresponds to Figure 6 Taking the start control 61 in (a) corresponding to the voice input application as an example, the shortcut tool application or the third-party application app2 calls the interface of the application framework layer to start the voice input application, and then starts the microphone driver by calling the kernel layer to capture the voice through the microphone 470C. Afterwards, the electronic device can recognize the voice captured by the microphone through the voice recognition module to obtain the recognized text and display the recognized text.

[0122] Among them, electronic equipment passes the test Figure 6 The click operation of the start control 63 in the interface shown in (b) can also trigger the above-mentioned voice recognition and display process, which will not be repeated here.

[0123] In some embodiments, Figure 7 As shown, the embodiment of the present application provides an information prompt method, which includes the following steps:

[0124] S701. In response to a user operation, the electronic device runs a voice input application.

[0125] In some embodiments, the electronic device detects the user's operation of starting the voice input application and determines to start the voice input application. After that, the electronic device starts to run the voice input application, and the voice input application is in a start-up state.

[0126] Optionally, the user's operation of starting the voice input application includes, for example, clicking the voice input application icon, clicking the voice input control in the shortcut toolbar, etc. In some examples, after the voice input application is started, the voice input application automatically enters the start running state, such as automatically entering the start running state after detecting the user's voice. Alternatively, the user may need to manually trigger the voice input application to enter the running state, such as entering the running state after detecting the user clicking the start control.

[0127] Exemplarily, the start running state can also be used to indicate that the voice input application is in a voice recognition state. It should be understood that the start running state can also be described as a running state, etc.

[0128] For example, the electronic device detects that the user clicks Figure 6 The start control 61 in the interface shown in (a) starts the voice input application.

[0129] Afterwards, the voice input application detects the user's voice, the electronic device determines to run the voice input application, and switches its own state to the start running state.

[0130] Alternatively, the voice input application interface displayed by the electronic device may include a control for controlling the microphone to obtain the user's voice, such as Figure 8 The start control 81 shown in (a) of FIG. 8 . After detecting the user's click operation on the start control 81, the electronic device determines to run the voice input application, controls the microphone to start acquiring the user's voice, and the voice input application enters the start running state.

[0131] S702: The voice input application sends a first message to the prompt bar application.

[0132] If the voice input application is in the start-up state, the voice input application may send a first message to the prompt bar application to inform the prompt bar application that the voice input application is in the start-up state.

[0133] S703: The prompt bar application assigns a value of true to a member variable according to the first message.

[0134] In some embodiments, the value of the member variable is used to indicate whether the acquired voice-converted text information needs to be displayed at present. For example, when the voice input application is in a running state, the value of the member variable can be set to true to indicate that the acquired voice-converted text information does not need to be displayed at present. In this way, it is avoided that the prompt bar application displays a large number of text prompts during the user's voice input process, affecting the user's viewing. For another example, when the voice input application is in a stopped state, the value of the member variable can be set to false to indicate that the acquired voice-converted text information needs to be displayed at present. In this way, after the user's voice input is completed, the text prompt can be displayed, and the number of prompts can be reduced while ensuring that the prompt is correct.

[0135] In some embodiments, after receiving the first message sent by the voice input application, the prompt bar application determines that the voice input application is in the running state according to the first message. Then, the prompt bar application may assign a value of true to the member variable.

[0136] In some embodiments, the present application provides an information prompt method, which further includes the following steps (S704-S706):

[0137] S704: In response to the user operation, the electronic device stops running the voice input application.

[0138] Stopping the voice input application includes closing the voice input application or temporarily not detecting the user's voice.

[0139] In some embodiments, the electronic device detects an operation by a user to stop running the voice input application, and determines to stop running the voice input application. Afterwards, the electronic device stops running the voice input application, and the voice input application is in a stopped state.

[0140] Optionally, the user's instruction to stop running the voice input application includes, for example, clicking on the voice input application close control, or clicking on the end control used to stop the voice input application from capturing voice and performing voice recognition conversion, or stopping voice input, etc.

[0141] For example, when the electronic device runs a voice input application, the interface displayed by the electronic device may include a control for controlling the microphone to obtain the user's voice, such as Figure 8 (b) shows the end control 82. The electronic device can detect the user's click operation on the end control 82, and the electronic device can control the microphone to stop acquiring the user's voice, and the voice input application enters a stopped running state.

[0142] S705: The voice input application sends a second message to the prompt bar application.

[0143] When the voice input application changes from the start running state to the stop running state, the voice input application may send a second message to the prompt bar application to inform the prompt bar application that the voice input application will be in the stop running state.

[0144] S706: The prompt bar application assigns a value of false to the member variable according to the second message.

[0145] In some embodiments, the value of the member variable is used to indicate whether the acquired voice-converted text information needs to be displayed. After the electronic device executes step S706, the value of the member variable is false, indicating that the current voice input application will be in a stopped state, and the prompt bar application can display the acquired voice-converted text information.

[0146] In some embodiments, the prompt bar application and the voice input application are two independent applications, and the text information obtained by the voice input application through conversion can be sent to the clipboard first, and then copied from the clipboard to the prompt bar application for display.

[0147] like Fig. 9 As shown, the prompt bar application obtains the text information converted by the voice input application and displays it, including the following steps (S901-S905):

[0148] S901. The voice input application obtains voice information and converts the voice information into text information.

[0149] In some embodiments, the voice input application can receive user voice and convert the user voice into text information through a voice conversion algorithm.

[0150] For example, as described above, the voice input application converts the acquired user voice into text based on the recognition interval to obtain text information. The specific voice conversion method can refer to the prior art, and the embodiment of the present application does not limit this.

[0151] S902: The voice input application sends text information to the clipboard.

[0152] The text information converted by the voice input application can be sent to the clipboard first, so that it can be copied from the clipboard to the prompt bar application for display. In this way, efficient information transmission can be achieved through copying.

[0153] S903: The clipboard sends the text information in the clipboard to the clipboard monitoring application.

[0154] Optionally, the clipboard monitoring application pre-registers a clipboard content change monitoring callback with the clipboard, and the clipboard sends the changed clipboard content to the clipboard after determining that the clipboard content has changed. In this way, after receiving the text information sent by the voice input application, the clipboard can send the text information to the clipboard monitoring application.

[0155] S904: The clipboard monitoring application sends a third message to the prompt bar application.

[0156] The third message is used to instruct the prompt bar application to display the content in the clipboard. In some examples, the third message may carry the latest acquired content in the clipboard, that is, text information.

[0157] S905: The prompt bar application determines whether to display text information based on the third message and the value of the current member variable.

[0158] In some embodiments, the value of the member variable may indicate the state of the voice input application, so after receiving the third message, the prompt bar application may determine whether text information needs to be displayed based on the value of the member variable.

[0159] In one scenario, the prompt bar application determines that the voice input application is already in the start running state, and the prompt bar application can assign the member variable var to true (i.e., execute the following Figure 7 Afterwards, after receiving the third message sent by the clipboard listening application, the prompt bar application determines the value of the member variable. If the value of the member variable is true, the prompt bar application can determine that there is no need to display text information in the prompt bar.

[0160] In another scenario, when the prompt bar application determines that the voice input application is in a stopped state, the prompt bar application can assign the member variable var to false (i.e., execute the following Figure 7 Afterwards, after receiving the third message sent by the clipboard listening application, the prompt bar application determines the value of the member variable. If the value of the member variable is false, the prompt bar application may determine that text information needs to be displayed in the prompt bar.

[0161] For example, the user takes 6 seconds to say "Look, the loquats here look delicious. Let's take some home to taste." The recognition interval of the voice input application is 2 seconds, so the electronic device can successively obtain three voice segments.

[0162] First, if the text obtained by the electronic device based on the first voice segment recognition is "Look, here is the pipa", the electronic device can put "Look, here is the pipa" into the clipboard. When the text in the clipboard is updated, the clipboard will send the text information in the clipboard to the clipboard monitoring application. The clipboard monitoring application sends a third message to the prompt bar application to trigger the prompt bar application to determine whether to display the text information based on the value of the member variable. In the above process, the voice input application continues to receive the user's voice and is in the start running state. Therefore, after receiving the third message, the prompt bar application can determine that the value of the current member variable is true, and can determine not to display the text information. In this way, the prompt bar application will not display the acquired text information "Look, here is the pipa".

[0163] Next, if the text obtained by the electronic device based on the second voice segment recognition is "looks delicious", the electronic device can put "looks delicious" into the clipboard, the text in the clipboard is updated, and the clipboard will send the text information in the clipboard to the clipboard monitoring application. The clipboard monitoring application sends a third message to the prompt bar application to trigger the prompt bar application to determine whether to display the text information based on the value of the member variable. In the above process, the voice input application continues to receive the user's voice and is in the start-up state. Therefore, after receiving the third message, the prompt bar application can determine that the value of the current member variable is true, and can determine not to display the text information. In this way, the prompt bar application will not display the obtained text information "looks delicious".

[0164] Among them, after the electronic device obtains the text "It looks delicious", it will correct "Look, the pipa here" to "Look, the loquat here" based on semantic analysis through the voice input application. The voice input application then puts "Look, the loquat here" into the clipboard. At this time, the text in the clipboard is updated, and the clipboard will send the text information in the clipboard to the clipboard listening application. The clipboard listening application sends a third message to the prompt bar application to trigger the prompt bar application to determine whether to display the text information based on the value of the member variable. At this time, the voice input application continues to receive user voice and is in the start running state. Therefore, after receiving the third message, the prompt bar application can determine that the value of the current member variable is true, and can determine not to display the text information. In this way, the prompt bar application will not display the obtained text information "Look, the loquat here".

[0165] Afterwards, if the electronic device detects that the user Figure 8 By clicking the end control 82 shown in (b), the voice input application can stop capturing voice information and is in a stopped state. Then, the voice input application sends a second message to the prompt bar application, so that the prompt bar application assigns the member variable to false according to the second message.

[0166] Finally, the voice input application can organize and merge the text information obtained by combining the semantic three-way voice conversion to obtain the text information of "Look, the loquats here look delicious. Let's take them back and taste them", and put it into the clipboard. When the text in the clipboard is updated, the clipboard will send the text information in the clipboard to the clipboard listening application. The clipboard listening application sends a third message to the prompt bar application to trigger the prompt bar application to determine whether to display the text information based on the value of the member variable. Since the voice input application is already in a stopped state, the prompt bar application can determine that the value of the current member variable is false after receiving the third message, and can determine to display the text information. At this time, the prompt bar application can display the text information of "Look, the loquats here look delicious. Let's take them back and taste them".

[0167] In this way, the prompt bar of the electronic device can avoid displaying the incomplete voice recognition result in the prompt bar during the operation of the voice input application. Therefore, the above implementation can ensure that the prompt message is displayed concisely in the prompt bar of the electronic device for the user to view.

[0168] In some embodiments, in response to user operations, the electronic device runs a voice input application, and the prompt bar application sets the value of a member variable of the voice input application to true. Among them, during the operation of the voice input application, an exception (such as a crash exception, etc.) may occur due to some unexpected situations. When the voice input application is in an abnormal state, the prompt bar application is often not notified in time. Then, in this case, the prompt bar application maintains the value of the member variable of the voice input application as true, and still cannot display the text information obtained from the clipboard listening application. However, after the voice input application has an exception, it may not send text information to the clipboard, that is, in this case, the text information obtained by the clipboard listening application may be text information obtained by the clipboard from other channels, and not displaying these text information obviously cannot meet user needs. Therefore, after the prompt bar application sets the value of the member variable of the voice input application to true in response to the first message sent by the received voice input application, the running status of the voice input application can also be monitored through the following steps (S1001-S1003), such as Fig.10 As shown:

[0169] S1001. The prompt bar application sends an application running status query request to the process manager.

[0170] S1002: The process manager sends the application running status to the prompt bar application.

[0171] S1003: In response to the abnormal operation of the voice input application, the prompt bar application assigns a value of false to a member variable.

[0172] In some embodiments, the prompt bar application may periodically obtain the list of currently running processes and the running status of each process from the process manager of the operating system of the electronic device. Afterwards, the prompt bar application may search the list of currently running processes to see if there is a voice input application. If not, it indicates that the voice input application has stopped running; if it exists, and the running status of the process corresponding to the voice input application is unresponsive, it indicates that the voice input application is in an abnormal crash state. Therefore, the prompt bar application may assign false to the member variable when the voice input application stops running.

[0173] In this way, after the voice input application converts the voice information into text information, the prompt bar application can determine that the text information needs to be displayed in the prompt bar according to the value of the member variable var being false. In this way, it can be ensured that the text information is displayed in the prompt bar in a timely manner when the voice input application runs abnormally.

[0174] In other embodiments, Fig.11 As shown, after the voice input application obtains voice information and converts the voice information into text information (execute step S1101), the text information can be sent to the clipboard and the clipboard monitoring application respectively (execute step S1102 and execute step S1103). Among them, the text information sent by the voice input application to the clipboard monitoring application is text information A. After the content in the clipboard changes, the text information in the clipboard can be sent to the clipboard monitoring application based on the callback pre-registered by the clipboard monitoring application to the clipboard, such as the clipboard application sends text information B to the clipboard monitoring application based on the callback (execute step S1104). Afterwards, the clipboard monitoring application can compare the text information A sent by the voice input application with the text information B in the clipboard sent by the clipboard to determine whether the text information in the clipboard is the text information obtained by the voice input application converting the voice information. If it is determined that the text information in the clipboard is not the text information obtained by converting the voice information by the voice input application, that is, it is determined that the text information A is different from the text information B (execute step S1105), then the clipboard monitoring application can send a fourth message to the prompt bar application (execute step S1106), so that the prompt bar application displays the text information sent to the clipboard by the voice input application based on the fourth message, that is, text information B (execute step S1107).

[0175] In some examples, Fig.11 There is no order between step S1102 and step S1103, and the voice input application can execute the two steps at the same time.

[0176] For example, the voice input application converts the acquired voice information into text information "Hello, please open the door", and the voice input application sends "Hello, please open the door" to the clipboard and the clipboard listening application respectively. When the content in the clipboard changes to "Hello, please open the door", "Hello, please open the door" is sent to the clipboard listening application based on the pre-registered callback. Then, since the text information obtained by the clipboard listening application from the voice input application is also "Hello, please open the door", the clipboard listening application can determine that the text information in the clipboard is the text information obtained by the voice input application after converting the voice information. In other words, the voice input application is still performing voice recognition at this time, and then the clipboard listening application may not send the fourth message to the prompt bar application, and the prompt bar application does not display the text information sent by the voice input application.

[0177] In some examples, such as in the above process, after the voice input application sends "Hello, please open the door" to the clipboard, before the clipboard sends a message to the clipboard listening application based on the pre-registered callback, the user's operation changes the content in the clipboard. For example, the user cuts the text selected by the cursor through the shortcut key combination "Ctrl key + X key" on the keyboard, or copies the shortcut key combination "Ctrl key + C key". Or, the user right-clicks the text selected by the cursor and selects the cut or copy control. If the text selected by the cursor is "the theme of this course", then in this case, the text sent by the clipboard to the clipboard listening application based on the pre-registered callback is "the theme of this course". Since the text information obtained by the clipboard listening application from the voice input application is "Hello, please open the door", the clipboard listening application can determine that the text information in the clipboard is not the text information obtained by the voice input application converting the voice information. In other words, the voice input application stops voice input. At this time, the clipboard listening application sends a fourth message to the prompt bar application, and the prompt bar application can display the text message "Hello, please open the door" sent by the voice input application.

[0178] Thus, through the above process, the clipboard monitoring application can determine whether the text information in the clipboard is the same as the text obtained by the voice input application through voice conversion based on the text information obtained from the voice input application and the text information fed back by the clipboard based on the registered callback. This ensures that the prompt bar application will not receive the text information converted by the voice input application when the voice input application is in the voice conversion process, and will not display it.

[0179] In addition, in the above process, the prompt bar application no longer needs to pay attention to the running status of the voice input application, and the unnecessary acquisition of text information is reduced. Fig.12As shown, after the electronic device obtains voice information through the voice input application and converts the voice information into text information (i.e., executes step S1201), it sends text information carrying a voice input indication to the clipboard. In some application scenarios, the voice input indication indicates that the voice input application is obtaining the voice information input by the user and identifying the voice information. Alternatively, in other application scenarios, the voice input indication indicates that the voice input application is running. Then, after receiving the text information carrying the voice input indication, the clipboard will not send a message to the clipboard monitoring application. In this way, the clipboard monitoring application will not send a fourth message to the prompt bar application so that the prompt bar application does not display the text content in the clipboard.

[0180] Accordingly, in some application scenarios, the voice input application stops acquiring the voice information input by the user. Alternatively, in other application scenarios, the voice input application is running. The electronic device sends information carrying a voice stop input mark to the clipboard through the voice input application (i.e., executing step S1202). Then, after receiving the information carrying the voice stop input mark, the clipboard will send a message to the clipboard monitoring application (i.e., executing step S1203). In this way, the clipboard monitoring application will send a fifth message to the prompt bar application (i.e., executing step S1204), so that the prompt bar application displays the text content in the clipboard based on the fifth message (i.e., executing step S1205).

[0181] Optionally, in another implementation, the electronic device obtains voice information through the voice input application, converts the voice information into text information, and then sends text information carrying the voice input application identifier to the clipboard. After that, the clipboard does not receive text information carrying the voice input application identifier after a preset time, and the visual voice input application is in a stopped state. At this time, the clipboard can send a message to the clipboard monitoring application, so that the clipboard monitoring application will send a fifth message to the prompt bar application, so that the prompt bar application displays the text content in the clipboard based on the fifth message.

[0182] Alternatively, in the case where the voice input application divides the received voice information into voice segments for recognition. For example, after the voice input application stops capturing the voice information and is in a stopped state, the voice input application can organize and merge the text information obtained by multiple voice conversions to obtain a whole paragraph of text. Afterwards, the voice input application puts the whole paragraph of text and the identifier of the voice input application into the clipboard. After the clipboard receives the text information and the identifier of the voice input application, it can send the text information in the clipboard to the clipboard listening application, so that the clipboard listening application sends a third message to the prompt bar application, triggering the prompt bar application to display the text information in the clipboard.

[0183] In some examples, the clipboard is a native application of the operating system, and the electronic device can send text information carrying a voice input indication or information carrying a voice input stop indication to the clipboard through an interface provided by the operating system.

[0184] The above describes the implementation process of the voice input sub-function of the electronic device, and the following describes the subtitle sub-function of the electronic device in detail.

[0185] For example, the single click operation detected by the electronic device is Figure 6 For example, the control 62 in (a) above is used as an example. The quick tool application calls the interface of the application framework layer to start the subtitle application, and then starts the speaker driver by calling the kernel layer to capture the voice being played by the electronic device through the speaker. After that, the electronic device can recognize the voice played by the speaker through the subtitle application to obtain the recognized text and display the recognized text. Figure 6 Clicking the start control 64 in the interface shown in (b) can also trigger the subtitle sub-function, which will not be described here.

[0186] In some embodiments, Fig.13 In the interface shown, the subtitle in the recognition target control 131 is selected, indicating that the recognition target is subtitles. The electronic device obtains the voice played by the speaker and recognizes the obtained voice. For example, if a video with a person speaking is playing in the electronic device, the electronic device can obtain the voice in the video and convert it into text, and display the text in the display area corresponding to the subtitle application. The dialogue in the recognition target control 131 is selected ( Fig.13 For example, in a scenario where a user uses an electronic device for a video conference, the electronic device obtains the voice currently being played by the electronic device and the voice captured by the microphone from the speaker, recognizes them respectively to obtain text, and finally displays the text in the display area corresponding to the subtitle application.

[0187] Optionally, the user can also set the language type of the subtitles on the subtitle application. Fig.13 By clicking the language type control 132 in the interface shown, the electronic device can display the language type setting interface. In this interface, the user can select the original language type and the target language type. If the original language type is English and the target language type is Chinese, the electronic device can translate the English in the voice content into Chinese. Alternatively, the user can also set the subtitle display mode on the subtitle application. For example, the electronic device detects that the user selects Fig.13By clicking the display mode control 133 in the interface shown, the electronic device can display the subtitle display setting interface. In the subtitle display setting interface, the user can select bilingual subtitles or subtitles in a specified language. If the user selects bilingual subtitles, the electronic device will display the original subtitles and the translated subtitles. If the user specifies to display Chinese subtitles, the electronic device will only display Chinese subtitles.

[0188] In some examples, the user can save the recognized subtitles in a storage path specified by the electronic device or customized by the user. Fig.13 By clicking the save control 134 in the interface shown, the electronic device can display the save path setting interface. The save path can be a storage path or a specified application. If the automatic save path is the storage path, the electronic device can directly save the generated subtitle file in the storage path. In this way, the user can view the subtitle file in the storage path. If the automatic save path is a specified application, the electronic device can directly import the generated subtitle file into the specified application for saving. In this way, the user can open the specified application to view the subtitle file.

[0189] In some examples, the user can also save and set the subtitles obtained by converting the voice in the video using the subtitle application. Fig.14 By clicking the setting control in the interface shown in (a), the electronic device can display the setting interface. Fig.14 As shown in (b), the setting interface includes an automatic save on / off control and an automatic save path. If the user clicks the on / off control to turn on the automatic save function, the user does not have to manually save the acquired subtitles during the subtitle conversion process. The electronic device can automatically save subtitles according to the activated automatic save function. Among them, the timing for the electronic device to automatically save subtitles can be any time point in the subtitle conversion process. For example, the electronic device automatically saves subtitles according to a preset period and preset conditions (such as after a sentence ends), and in response to the user's operation of closing the subtitle application, the automatic save function is triggered to ensure that the subtitles are successfully saved.

[0190] Optionally, the setting interface also includes options for setting the display of subtitles, for example, the original text font style, original text font size, original text font color, translated text font style, translated text font size, translated text font color, background color, and background transparency can be set.

[0191] In some embodiments, Fig.15 As shown, the embodiment of the present application provides another information prompting method, which includes the following steps:

[0192] S1501: The subtitle application detects a user's instruction to close the subtitle application.

[0193] The operation of closing the subtitle application includes, for example, the electronic device detecting a user clicking an operation on a closing control of the subtitle application.

[0194] In some embodiments, after the subtitle application detects the user's instruction to close the subtitle application, the subtitle application can hide the interface of the subtitle application from the display screen of the electronic device, and the subtitle application process is still running in the electronic device. After the interface corresponding to the subtitle application can be hidden from the display screen of the electronic device, since the subtitle application is in the background running state, the subtitle application program can interact with the text viewing and editing application app3 to send an instruction message for saving the subtitle file to the text viewing and editing application app3.

[0195] S1502: The subtitle application generates a subtitle file and saves the subtitle file to a preset saving path.

[0196] The preset saving path is a system default saving path, or a user-defined saving path, etc. Optionally, the system default saving path indicates a saved folder address, etc. The subtitle application has turned on the automatic saving function. Then, in response to the user's instruction to close the subtitle application, the subtitle application can automatically save the generated subtitle file.

[0197] In some embodiments, Fig.14 In the automatic save path check box shown in (b), the folder address is displayed. Then, the subtitle application can directly save the generated subtitle file directly to the folder indicated by the folder address. Afterwards, the subtitle application can display a prompt that the save is successful.

[0198] Alternatively, if Fig.14 As shown in the automatic save path check box shown in (b), the subtitle file needs to be saved in the text viewing and editing application app3 (such as a note application). Then, the subtitle application can first save the generated subtitle file to the system default save path. After that, through the following steps (S1503-S1508), when the subtitle application is closed, the subtitle file generated by the subtitle application is automatically saved to the specified application and the user is prompted.

[0199] S1503. The subtitle application sends instruction information to the file viewing and editing application app3.

[0200] The instruction information is used to instruct the file viewing and editing application app3 to save the subtitle file. Optionally, the instruction information carries a preset saving path, so that the file viewing and editing application app3 can obtain the subtitle file according to the preset saving path. Optionally, the instruction information can also be used to instruct the file viewing and editing application app3 to start.

[0201] S1504. The file viewing and editing application app3 imports the subtitle file from the preset saving path.

[0202] The preset saving path plays a role of file transfer, for example, the preset saving path can be a system default saving path. Then, the subtitle file generated by the subtitle application is first saved in the system default saving path, so that the file viewing and editing application app3 can import the subtitle from the system default saving path.

[0203] S1505. The subtitle application sends a save result query request to the file viewing and editing application app3.

[0204] After step S1503, the subtitle application may send a save result query request to the file viewing and editing application app3 to query whether the file viewing and editing application app3 has completed the saving process.

[0205] S1506. The file viewing and editing application app3 sends the saving result to the subtitle application.

[0206] S1507: The subtitle application displays the saved result.

[0207] In some examples, the saving result includes saving success and saving failure. If the saving result sent by the text viewing and editing application app3 to the subtitle application is saving success, the subtitle application can display a saving success interface; if the saving result sent by the text viewing and editing application app3 to the subtitle application is saving failure, the subtitle application can display a saving failure interface.

[0208] In some examples, the subtitle application may send a save result query request to the text viewing and editing application app3 according to a preset period. For example, the subtitle application starts a timer and sends a save result query request to the text viewing and editing application app3 every 2 seconds. If the save result sent by the text viewing and editing application app3 is received, the save result may be displayed to the user.

[0209] In some examples, if the number of query requests sent by the subtitle application to the text viewing and editing application app3 exceeds a preset value, the subtitle application can prompt the user that the save fails. For example, the startup and save time of the text viewing and editing application app3 is generally within 10 seconds. Then, the subtitle application starts the timer and sends a save result query request to the text viewing and editing application app3 every 2 seconds. If the number of query requests sent by the subtitle application to the text viewing and editing application app3 exceeds 5 times, it can be considered that the text viewing and editing application app3 has failed to save the subtitle file. At this time, a prompt interface for saving failure is displayed to the user.

[0210] In some examples, a control for viewing subtitle files may be provided in the interface corresponding to the saved result displayed by the subtitle application. After the electronic device detects that the user clicks on the control for viewing subtitle files, the subtitle file may be displayed in the specified application. For example, if the user plays an audio and the speaker says "How are you?" in English, the electronic device may display the subtitle file in the specified application based on the language type and subtitle display mode of the subtitles pre-set by the user. Fig.16 The interface shown in (a) in FIG. 1 is as follows. If the electronic device detects that the user clicks the cursor Fig.16 After the control for closing the subtitle application in (a) is used, the electronic device performs the following steps: Fig.15 Finally, after the text viewing and editing application app3 completes the process of importing the subtitle file from the system default path, the electronic device can display the following Fig.16 The interface shown in (b) is displayed to prompt the user that the saving is successful, and the user can directly open the text viewing and editing application app3 to view it. Fig.16 After clicking the view control in (b), the electronic device can display the following Fig.16 The corresponding interface of the text viewing and editing application app3 shown in (c).

[0211] S1508: The subtitle application stops running.

[0212] The subtitle application displays the saving result to the user, and all processes of the subtitle application can stop running in the electronic device.

[0213] In some embodiments, Fig.17 As shown, the embodiment of the present application provides another information prompting method, which includes the following steps:

[0214] S1701: The subtitle application detects a user's instruction to close the subtitle application.

[0215] S1702: The subtitle application generates a subtitle file and saves the subtitle file to a preset saving path.

[0216] S1703. The subtitle application sends instruction information to the file viewing and editing application app3.

[0217] S1704. The file viewing and editing application app3 imports the subtitle file from the preset saving path.

[0218] Among them, the implementation methods of S1701-S1704 can refer to the above-mentioned S1501-S1504, which will not be repeated here.

[0219] S1705: Subtitle application starts countdown.

[0220] The subtitle application may start a countdown according to a preset waiting time. The preset waiting time may be determined based on an estimated time for the file viewing and editing application app3 to start and import the subtitle file from the preset saving path. For example, in general, the time taken for the file viewing and editing application app3 to start and import the subtitle file from the preset saving path does not exceed 10 seconds, so the preset waiting time may be set to 10 seconds.

[0221] Optionally, there is no order of execution between step S1704 and step S1705. Generally, after the subtitle application sends the instruction information to the file viewing and editing application app3, the subtitle application can start the countdown without determining whether the file viewing and editing application app3 imports the subtitle file from the preset saving path.

[0222] S1706. The file viewing and editing application app3 sends the saving result to the subtitle application.

[0223] S1707, the subtitle application displays the saved result.

[0224] S1708. The countdown for applying subtitles ends.

[0225] In some examples, Fig.17 S1706 is executed before the countdown of the subtitle application starts and before the countdown ends. If it is determined that the saving result sent by the text viewing and editing application app3 is received within the preset waiting time, the electronic device displays a prompt interface to the user based on the saving result.

[0226] It should be understood that if it is determined that the saving result sent by the text viewing and editing application app3 is not received within the preset waiting time, that is, after step S1708, the file viewing and editing application app3 does not send the saving result to the subtitle application. At this time, the electronic device can directly display a prompt interface of saving failure.

[0227] In some embodiments, Fig.18 As shown, the embodiment of the present application provides another information prompting method, which includes the following steps:

[0228] S1801: The subtitle application detects a user's instruction to close the subtitle application.

[0229] S1802: The subtitle application generates a subtitle file and saves the subtitle file to a preset saving path.

[0230] S1803. The subtitle application sends instruction information to the file viewing and editing application app3.

[0231] S1804. The file viewing and editing application app3 imports the subtitle file from the preset saving path.

[0232] Among them, the implementation methods of S1801-S1804 can refer to the above-mentioned S101-S1504 and will not be repeated here.

[0233] S1805: The subtitle application stops running.

[0234] Optionally, there is no direct correlation between step S1804 and step S1805. Generally, after the subtitle application sends the instruction information to the file viewing and editing application app3, the subtitle application can stop running without determining whether the file viewing and editing application app3 imports the subtitle file from the preset saving path.

[0235] S1806. The file viewing and editing application app3 generates a saving result.

[0236] S1807. The file viewing and editing application app3 displays the saving result.

[0237] In this way, after the subtitle application stops running directly, the text viewing and editing application app3 can also complete the function of displaying the subtitle saving result. In the above process, reducing the running time of the subtitle application can reduce power consumption and waste of computing resources.

[0238] In this way, when the user sets the subtitle application to be closed, the subtitle file is automatically saved to the designated application. When the electronic device detects that the user clicks the control to close the subtitle application, the subtitle application interacts with the designated application and the subtitle file can be saved in the designated application. Afterwards, the preservation result is displayed to prompt the user, so that the user can view the preservation result of the subtitle file and improve the user's experience of viewing the text.

[0239] like Fig.19 As shown, an embodiment of the present application provides an information prompt method, which is applied to an electronic device, and the method includes the following steps:

[0240] S1901. Convert the acquired user voice into text information through the first application.

[0241] In some examples, the first application is a voice input application, and the first application can receive user voice and convert the user voice into text information through a voice conversion algorithm. As described above, the first application converts the acquired user voice into text based on the recognition interval to obtain text information. Among them, the specific voice conversion method can refer to the existing technology, and the embodiments of the present application are not limited to this.

[0242] S1902. Obtain the status of the first application.

[0243] S1903: Display text information in the second application when the first application is in the second state.

[0244] The second state indicates that the first application is not running. When the first application is in the first state, no text information is displayed in the second application, and the first state indicates that the first application is running.

[0245] In some examples, the first application is in the first state, which may be specifically the first application is in the start running state. Exemplarily, after the first application is started, it may automatically enter the start running state. For example, after detecting the user's voice, the first application automatically enters the start running state. Alternatively, the user may need to manually trigger the first application to enter the running state, such as detecting that the user clicks the start control operation, and the first application enters the running state.

[0246] In some examples, when the first application is in the second state, the first application may be in a stopped state. The stopped state includes closing the first application or the first application is in a state where no user voice is detected during operation.

[0247] In some embodiments, the state of the first application can be obtained through the following process: first, when the first application changes from the second state to the first state, the value of the member variable of the first application is set to a first value through the second application, and the first value corresponds to the first state; when the first application changes from the first state to the second state, the value of the member variable of the first application is set to a second value through the second application, and the second value corresponds to the second state.

[0248] Thus, when the first application is in the first state, the value of the member variable is the first value; and when the first application is in the second state, the value of the member variable is the second value.

[0249] In some embodiments, after the first application converts the acquired user voice into text information, the first application sends the text information to the second application; the second application receives the text information; and then, the state of the first application can be obtained through the following steps. In response to the second application receiving the text information, the second application obtains the state of the first application.

[0250] In some embodiments, after the second application obtains the text information, it determines whether to display the text information according to the value of the member variable of the first application. Exemplarily, the first value can be true and the second value can be false. Then, if the value of the member variable is true, the electronic device can determine that the second application does not need to display the text information. If the value of the member variable is false, it is used to indicate that the current first application will be in a stopped state, and the second application can display the obtained voice-converted text information.

[0251] Thus, when the state of the first application changes, by assigning a value to the member variable, the second application can then determine whether to display a text message in the second application based on the value of the member variable, thereby displaying text in the second application based on the state of the first application.

[0252] In the above embodiment, the electronic device further includes a third application and a fourth application, and the second application can obtain text information through the following process. First, the first application sends the text information to the third application, and the third application is used to store the text information; the fourth application monitors that there is updated text information in the third application and obtains the text information; the fourth application is used to monitor whether the text information stored in the third application is updated; the fourth application sends the text information to the second application.

[0253] In some examples, the fourth application can register a callback with the third application to monitor whether the text information in the third application is updated. The callback is used when there is updated text information in the third application, and the third application sends the updated text information in the third application to the fourth application.

[0254] In some examples, the third application is a clipboard, and the fourth application is a clipboard listening application. The text information obtained by the first application through conversion can be first sent to the third application, so as to be copied from the third application to the second application for display. In this way, efficient information transmission can be achieved through copying.

[0255] In some embodiments, after obtaining that the first application is in the first state, the state of the first application is periodically monitored.

[0256] In some examples, the second application may periodically obtain a list of currently running processes and the running status of each process from a process manager of the operating system of the electronic device, so as to update and maintain the status of the first application in a timely manner.

[0257] In some examples, the second state includes a stop state and an abnormal state. When the state of the first application is periodically monitored, the state of the first application can be periodically monitored by the second application; when it is determined that the first application switches from the first state to the abnormal state, the member variable value of the first application is modified.

[0258] For example, when the state of the first application is periodically monitored, if the second application determines that the first application is still in the first state, the value of the member variable is the first value. If the first application switches from the first state to an abnormal state, the value of the member variable is changed to the second value, so that the text information can be displayed in the second application. In this way, it can be ensured that when the first application is in an abnormal state, the text information is displayed in the prompt bar in a timely manner to avoid text loss.

[0259] In some embodiments, when the running state of the first application changes, an indication may be sent to the second application. In some examples, if the first application switches to the first state, a first indication is sent to the second application. When the second application receives the first indication sent by the first application, it may determine that the first application switches to the first state. If the first application switches to the stopped state, the first indication is sent to the second application. The second application receives the second indication sent by the first application and determines that the first application switches to the stopped state.

[0260] In some embodiments, the text information is not displayed in the window of the second application, and the window is displayed at the first position of the display screen of the electronic device. Figure 2 The prompt bar can be a display bar displayed on the side of the electronic device display screen, or can be a negative one screen, etc.

[0261] like Fig. 20 As shown, the embodiment of the present application further provides an information prompt method, which is applied to an electronic device, the electronic device includes a fifth application and a sixth application, and the method includes the following steps:

[0262] S2001. In response to a user closing an operation of a fifth application, stop displaying an interface of the fifth application, where the fifth application is used to generate subtitle information based on audio information.

[0263] Among them, the fifth application is a subtitle application. Fig.16 As shown in (a), the electronic device detects a user's click operation on the close control and can stop displaying the interface of the fifth application. In some examples, the audio information includes audio information corresponding to the audio or video being played by the electronic device, or audio information corresponding to the audio or video acquired by the electronic device.

[0264] In some embodiments, stopping displaying the interface of the fifth application may mean hiding the interface of the fifth application from the display screen of the electronic device, while the process of the fifth application is still running in the electronic device.

[0265] S2002. Save subtitle information through a sixth application.

[0266] The sixth application is used to display the subtitle information. For example, the sixth application can be a text viewing and editing application app3, a note application, an office application, etc.

[0267] S2003. Display prompt information, where the prompt information is used to indicate the saving result of the sixth application.

[0268] In some embodiments, the prompt information may be displayed through the following process: The fifth application obtains the saved result generated by the sixth application, and displays the saved result through the fifth application.

[0269] In some examples, the retention result obtained by the fifth application can be sent by the sixth application.

[0270] In some examples, the fifth application may poll the saved results of the sixth application according to a preset period.

[0271] In some embodiments, in response to the user closing the fifth application, the fifth application sends subtitle information to the sixth application. Then, the prompt information can be displayed through the following process. First, within the first time after sending the subtitle information, the fifth application does not obtain the saving result; the fifth application displays a prompt information, and the prompt information is used to indicate that the subtitle information fails to be saved.

[0272] For example, the fifth application starts a timer and sends a save result query request to the sixth application every 2 seconds. If the fifth application receives the save result sent by the sixth application, it can display the save result to the user.

[0273] In some embodiments, after the fifth application displays the prompt information, the fifth application may be stopped.

[0274] In some other embodiments, in response to the user closing the fifth application, the fifth application may also be stopped. Then, the prompt information may be displayed through the sixth application.

[0275] In this way, after the fifth application stops running directly, the sixth application can run to complete the function of displaying the subtitle saving results. In this process, the running time of the fifth application is shortened, which can reduce power consumption and waste of computing resources.

[0276] Combination of the above Figure 3-Figure 20 The information prompt method provided by the embodiment of the present application is described in detail. Fig.21 The electronic device provided by the embodiments of the present application is described in detail.

[0277] In one possible design, Fig.21 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.21 As shown, the electronic device 2100 may include: a display unit 2101, a processing unit 2102, and a transceiver unit 2103. In some examples, the display unit 2101, the processing unit 2102, and the transceiver unit 2103 may be Figure 4 The electronic device 2100 can implement the functions of the electronic device involved in the above method embodiment.

[0278] Optionally, the display unit 2101 is used to support the electronic device 2100 to display interface content; and / or to support the electronic device 2100 to execute Figure 7 S701-S706 in; also used to support the electronic device 2100 to execute Fig. 9S901-S905 in; also used to support the electronic device 2100 to execute Fig.10 S1001-S1003 in; also used to support the electronic device 2100 to execute Fig.11 S1101-S1107 in; also used to support the electronic device 2100 to execute Fig.12 S1201-S1205 in; also used to support the electronic device 2100 to execute Fig.15 S1501-S1508 in; also used to support the electronic device 2100 to execute Fig.17 S1701-S1708 in; also used to support the electronic device 2100 to execute Fig.18 S1801-S1807 in; also used to support the electronic device 2100 to execute Fig.19 S1901-S1904 in; also used to support the electronic device 2100 to execute Fig. 20 S2001-S2003 in.

[0279] Optionally, the processing unit 2102 is used to support the electronic device 2100 to execute Figure 7 S701-S706 in; also used to support the electronic device 2100 to execute Fig. 9 S901-S905 in; also used to support the electronic device 2100 to execute Fig.10 S1001-S1003 in; also used to support the electronic device 2100 to execute Fig.11 S1101-S1107 in; also used to support the electronic device 2100 to execute Fig.12 S1201-S1205 in; also used to support the electronic device 2100 to execute Fig.15 S1501-S1508 in; also used to support the electronic device 2100 to execute Fig.17 S1701-S1708 in; also used to support the electronic device 2100 to execute Fig.18 S1801-S1807 in; also used to support the electronic device 2100 to execute Fig.19 S1901-S1904 in; also used to support the electronic device 2100 to execute Fig. 20 S2001-S2003 in.

[0280] Optionally, the transceiver unit 2103 supports the electronic device 2100 to execute Figure 7 S701-S706 in; also used to support the electronic device 2100 to execute Fig. 9 S901-S905 in; also used to support the electronic device 2100 to execute Fig.10 S1001-S1003 in; also used to support the electronic device 2100 to execute Fig.11S1101-S1107 in; also used to support the electronic device 2100 to execute Fig.12 S1201-S1205 in; also used to support the electronic device 2100 to execute Fig.15 S1501-S1508 in; also used to support the electronic device 2100 to execute Fig.17 S1701-S1708 in; also used to support the electronic device 2100 to execute Fig.18 S1801-S1807 in; also used to support the electronic device 2100 to execute Fig.19 S1901-S1904 in; also used to support the electronic device 2100 to execute Fig. 20 S2001-S2003 in.

[0281] Among them, the transceiver unit may include a receiving unit and a sending unit, and may be implemented by a transceiver or a transceiver-related circuit component, and may be a transceiver or a transceiver module. The operations and / or functions of each unit in the electronic device 2100 are respectively to implement the corresponding process of the information prompt method described in the above method embodiment. All relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional unit, and for the sake of brevity, they will not be repeated here.

[0282] Optionally, Fig.21 The electronic device 2100 shown may also include a storage unit ( Fig.21 (not shown), the storage unit stores a program or instruction. When the processing unit 2102 and the transceiver unit 2103 execute the program or instruction, Fig.21 The electronic device 2100 shown can execute the information prompt method described in the above method embodiment.

[0283] Fig.21 The technical effects of the electronic device 2100 shown can refer to the technical effects of the information prompt method described in the above method embodiment, and will not be repeated here.

[0284] In addition to being in the form of electronic device 2100, the technical solution provided in the embodiment of the present application may also be a functional unit or chip in the electronic device, or a device used in conjunction with the electronic device.

[0285] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned electronic device, the electronic device executes each function or step in the above-mentioned method embodiment.

[0286] The embodiment of the present application also provides a computer program product, including a computer program. When the computer program runs on an electronic device, the electronic device executes each function or step in the above method embodiment.

[0287] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0288] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0289] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0290] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0291] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0292] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An information prompting method, characterized in that: Applied to an electronic device, the electronic device includes a first application and a second application, and the method includes: Converting the acquired user voice into text information through the first application; Obtaining a status of the first application; When the first application is in a second state, the text information is displayed in the second application, and the second state indicates that the first application is not running; wherein, when the first application is in a first state, the text information is not displayed in the second application, and the first state indicates that the first application is running.

2. The method according to claim 1, characterized in that The obtaining the state of the first application includes: When the first application changes from the second state to the first state, setting the value of the member variable of the first application to a first value through the second application, the first value corresponding to the first state; When the first application changes from the first state to the second state, the value of the member variable of the first application is set to a second value through the second application, and the second value corresponds to the second state.

3. The method according to claim 2, characterized in that The first application is in a first state, including: the value of the member variable is the first value; and The first application is in the second state, including: the value of the member variable is the second value.

4. The method according to any one of claims 1 to 3, characterized in that After converting the acquired user voice into text information through the first application, the method further includes: The first application sends the text message to the second application; The second application receives the text message; The obtaining the state of the first application includes: In response to receiving the text message, the second application obtains the state of the first application.

5. The method according to claim 4, characterized in that The electronic device further includes a third application and a fourth application, and the first application sends the text message to the second application, including: The first application sends the text information to a third application, and the third application is used to store the text information; The fourth application monitors that there is updated text information in the third application, and obtains the text information; the fourth application is used to monitor whether the text information stored in the third application is updated; The fourth application sends the text information to the second application.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: After acquiring that the first application is in the first state, the state of the first application is periodically monitored.

7. The method according to claim 6, characterized in that The second state includes a stop state and an abnormal state; the method further includes: The second application periodically monitors the status of the first application; When it is determined that the first application switches from the first state to the abnormal state, the value of the member variable of the first application is modified.

8. The method according to claim 7, characterized in that The method further comprises: The second application receives the first indication sent by the first application, and determines that the first application switches to the first state; The second application receives the second instruction sent by the first application and determines that the first application is switched to the stopped state.

9. The method according to any one of claims 1 to 8, characterized in that: The displaying the text information in the second application includes: The text information is displayed in a window of the second application, and the window is displayed at a first position of a display screen of the electronic device.

10. An information prompting method, characterized in that: Applied to an electronic device, the electronic device includes a fifth application and a sixth application, and the method includes: In response to a user closing operation of a fifth application, stopping displaying the interface of the fifth application, wherein the fifth application is used to generate subtitle information according to audio information; The subtitle information is saved by a sixth application, and the sixth application is used to display the subtitle information; Prompt information is displayed, where the prompt information is used to indicate the saving result of the sixth application.

11. The method according to claim 10, characterized in that The displayed prompt information includes: The fifth application obtains the saved result generated by the sixth application; The saving result is displayed by the fifth application.

12. The method according to claim 11, characterized in that The fifth application obtains the saved result generated by the sixth application, including: The fifth application receives the saving result sent by the sixth application.

13. The method according to claim 11, characterized in that The fifth application obtains the saved result generated by the sixth application, including: The fifth application polls the saved result of the sixth application according to a preset period.

14. The method according to any one of claims 11 to 13, characterized in that: The step of saving the subtitle information by using the sixth application includes: In response to a user closing the fifth application, the fifth application sends the subtitle information to the sixth application; The displayed prompt information includes: Within a first time after sending the subtitle information, the fifth application fails to obtain the saving result; The fifth application displays a prompt message, where the prompt message is used to indicate that the subtitle information fails to be saved.

15. The method according to any one of claims 11 to 14, characterized in that: After the prompt information is displayed, the method further includes: The fifth application is stopped.

16. The method according to claim 10, characterized in that The method further comprises: In response to a user's operation of closing the fifth application, stopping the fifth application; The displayed prompt information includes: The prompt information is displayed through the sixth application.

17. The method according to any one of claims 10 to 16, characterized in that: The audio information includes audio information corresponding to the audio or video being played by the electronic device, or audio information corresponding to the audio or video acquired by the electronic device.

18. An electronic device, characterized in that: The electronic device includes a display screen, a memory and one or more processors; the display screen, the memory and the processor are coupled; the display screen is used to display an image generated by the processor, and the memory is used to store computer program code, and the computer program code includes computer instructions; when the processor executes the computer instructions, the electronic device executes the method described in any one of claims 1-9.

19. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method as claimed in any one of claims 1 to 9; or cause the electronic device to execute the method as claimed in any one of claims 10 to 17.

Images