Method for waking up application program and electronic equipment

Abstract

The invention provides a method for awakening an application program and electronic equipment, and the method comprises the steps: a breath awakening processing device sends voice data in first data when the breath awakening processing device detects that the obtained first data is used for indicating breath awakening of a first application program; the breath wake-up software module stores the voice data, starts the first application program and controls the breath wake-up processing device to stop detecting breath wake-up of the first application program; when the first application program successfully calls the breath wake-up software module, a first notification is sent; the breath wake-up software module sends voice data to the first application program; the first application program performs voice recognition on the voice data; the first application program sends a second notification when determining that voice recognition is finished according to the voice data; the breath wake-up software module responds to the second notification to control the breath wake-up processing device to start next breath wake-up. Therefore, wakeup of the application program is realized, and preparation is made for wakeup of the application program.

Description

Method for waking up application program and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on November 16, 2022, with application number 202211438531.X and application name “Method and electronic device for waking up an application”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application belongs to the field of terminal technology, and in particular relates to a method for waking up an application and an electronic device. Background Art

[0003] With the development of voice recognition technology, many electronic devices have added voice assistants (such as YOYO, Xiaoyi, Siri, etc.) to help users complete the human-computer interaction process with electronic devices. Generally speaking, voice assistants are in a dormant state. When users want to use the voice assistant, they can wake it up.

[0004] At present, there are two main technologies for waking up voice assistants: button wake-up and keyword wake-up. In the button wake-up technology, the voice assistant is woken up by the user triggering the button (such as the power button). In the keyword wake-up technology, the voice assistant is woken up by receiving a specific wake-up word input by the user (for example, "Hello, YOYO", "Xiaoyi, Xiaoyi", "Hi Siri")

[0005] However, in the above implementation process, waking up the voice assistant is rather cumbersome, resulting in a low user experience.

[0006] Summary of the Invention

[0007] The present application provides a method and electronic device for waking up an application, which not only realizes the waking up of the current application, but also prepares for the waking up of the next application, thereby improving the user experience.

[0008] In a first aspect, the present application provides a method for waking up an application, which is applied to an electronic device, the electronic device comprising: a first application, a breath-awakening software module, and a breath-awakening processing device;

[0009] The method includes:

[0010] The breath awakening processing device obtains first data;

[0011] The breath awakening processing device sends the voice data in the first data to the breath awakening software module when detecting that the first data is used to instruct the breath to awaken the first application;

[0012] The breath awakening software module stores the voice data, starts the first application, and controls the breath awakening processing device to stop detecting the breath awakening of the first application and continue to obtain the voice data;

[0013] After the first application is started, when the breath awakening software module is successfully called, the first application sends a first notification to the breath awakening software module;

[0014] The breath awakening software module sends voice data to the first application in response to the first notification;

[0015] The first application performs speech recognition on the speech data;

[0016] The first application sends a second notification to the breath awakening software module when determining based on the voice data that the voice recognition is finished;

[0017] In response to the second notification, the breath awakening software module controls the breath awakening processing device to start detecting the next breath awakening of the first application.

[0018] In the above method, when the breath awakening processing device detects the first data for indicating the breath awakening of the first application, the breath awakening software module can start the first application and use the breath awakening technology to wake up the first application, thereby ensuring the convenience and timeliness of starting the first application.

[0019] In addition, when the breath awakening software module starts the first application, it can control the breath awakening processing device to stop detecting the breath awakening of the first application, which can avoid interrupting the current voice recognition and ensure the quality of the current first application voice recognition.

[0020] In addition, the breath awakening software module can control the breath awakening processing device to start detecting the next breath awakening of the first application when the first application determines that the voice recognition is finished, so as to restore the breath awakening function of the first application and prepare for the awakening of the next application.

[0021] It can be seen that this application not only realizes the awakening of the current application, but also prepares for the awakening of the next application, thereby improving the user experience.

[0022] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes:

[0023] When the breath awakening software module does not receive the first notification or the second notification after a preset period of time, the breath awakening processing device is controlled to start detecting the next breath awakening of the first application.

[0024] In the above method, when the breath awakening software module does not receive the first notification or the second notification after a preset period of time, it can be determined that the current first application is not started, or the first application fails to call the breath awakening software module, so that the breath awakening software module cannot receive the first notification or the second notification.

[0025] Thus, the breath awakening software module can control the breath awakening processing device to start detecting the next breath awakening of the first application, so as to facilitate the restoration of the breath awakening function of the voice assistant application.

[0026] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes:

[0027] After the first application is started, the first user interface is displayed;

[0028] The first application displays the speech recognition result in the first user interface.

[0029] Among them, the first user interface can display the voice recognition results, so that the user can understand the voice recognition results in a timely manner, thereby improving the user's usage experience.

[0030] In conjunction with the first aspect, in certain implementations of the first aspect, the breath awakening software module includes: a first software module, and a second software module, the voice data being stored in the second software module;

[0031] After the first application is started, when the breath awakening software module is successfully called, a first notification is sent to the breath awakening software module, including:

[0032] After the first application is started and successfully calls the first software module, the first notification is sent to the first software module;

[0033] The breath awakening software module sends voice data to the first application in response to the first notification, including:

[0034] In response to the first notification, the first software module calls the voice data from the second software module and sends the voice data to the first application.

[0035] The first software module may be an audio policy service module (audio policy service).

[0036] The second software module may be an audio driver (sound trigger-hal).

[0037] In the above method, when the first application successfully calls the first software module, the first software module can call the voice data from the second software module and send the voice data to the first application, so that the first application can receive the voice data in time.

[0038] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes:

[0039] The first software module sends a third notification to the second software module in response to the first notification;

[0040] In response to the third notification, the second software module controls the breath awakening processing device to stop detecting the breath awakening of the first application and continue to obtain voice data.

[0041] In the above method, the second software module can respond to the third notification, control the breath wake-up processing device to detect the breath wake-up of the first application and continue to obtain voice data, and control the breath wake-up processing device to stop detecting the breath wake-up of the first application, so as to avoid interrupting the current voice recognition.

[0042] The quality of the voice recognition of the current first application is ensured again. The breath awakening processing device stops detecting the breath awakening of the first application, which can also save power for the electronic device.

[0043] In conjunction with the first aspect, in certain implementations of the first aspect, the breath awakening software module controls the breath awakening processing device to start detecting the next breath awakening of the first application in response to the second notification, including:

[0044] The first software module sends a fourth notification to the second software module in response to the second notification;

[0045] In response to the fourth notification, the second software module controls the breath awakening processing device to start detecting the next breath awakening of the first application.

[0046] In the above method, when the breath awakening software module starts the first application, the breath awakening processing device can be controlled to stop detecting the breath awakening of the first application, and the second software module controls the breath awakening processing device to stop detecting the breath awakening of the first application in response to the third notification.

[0047] It can be seen that the current breath wake-up processing device has stopped detecting the breath wake-up of the first application. Therefore, the second software module responds to the fourth notification and controls the breath wake-up processing device to start detecting the next breath wake-up of the first application, so as to facilitate the restoration of the breath wake-up function of the first application.

[0048] In conjunction with the first aspect, in certain implementations of the first aspect, the breath awakening software module further includes a third software module and a fourth software module;

[0049] The breath awakening software module stores the voice data, starts the first application, controls the breath awakening processing device to stop detecting the breath awakening of the first application, and continues to obtain the voice data, including:

[0050] The second software module stores the voice data and sends a wake-up event to the third software module;

[0051] The third software module sends a wake-up event to the fourth software module and sends a fifth notification to the second software module in response to the wake-up event;

[0052] The fourth software module starts the first application in response to the wake-up event;

[0053] In response to the fifth notification, the second software module controls the breath awakening processing device to stop detecting the breath awakening of the first application and continue to obtain voice data.

[0054] The third software module may be a sound trigger module.

[0055] The fourth software module may be an audio trigger module (sound trigger).

[0056] In the above method, the fourth software module can start the first application in response to the wake-up event, thereby ensuring the timeliness of starting the first application.

[0057] In addition, since the wake-up event has been triggered, controlling the breath wake-up processing device to stop detecting the breath wake-up of the first application can avoid interrupting the current voice recognition and ensure the quality of the current first application voice recognition.

[0058] In conjunction with the first aspect, in certain implementations of the first aspect, the method further includes:

[0059] The third software module sets a timer in response to the wake-up event and starts timing according to the timer;

[0060] When the third software module determines that the timing of the timer has expired and the first notification or the second notification has not been received, the third software module sends a sixth notification to the second software module;

[0061] In response to the sixth notification, the second software module controls the breath awakening processing device to start detecting the next breath awakening of the first application;

[0062] The third software module stops timing of the timer in response to the first notification.

[0063] In the above method, the setting time of the timer can be used to determine whether the first notification or the second notification is received, so that when the first notification or the second notification is not received, the second software module controls the breath wake-up processing device to start detecting the next breath wake-up of the first application and restore the breath wake-up function.

[0064] In conjunction with the first aspect, in certain implementations of the first aspect, after the first application determines based on the voice data that voice recognition has ended, sending a second notification to the breath awakening software module includes:

[0065] The first application determines that the voice recognition is ended in response to an operation for instructing to end the voice recognition;

[0066] Alternatively, when the first application determines that the speech text corresponding to the speech data satisfies a preset rule, the speech recognition is determined to be finished;

[0067] When determining that the voice recognition is finished, the first application sends a second notification to the first software module.

[0068] Among them, the first application can determine whether the voice recognition is ended in two ways. One is to determine that the voice recognition is ended when the user's instruction to end the voice recognition is received. The other is to determine that the voice recognition is ended when the voice text corresponding to the voice data is a complete word or sentence.

[0069] In addition, when the first application determines that the voice recognition is completed, it sends a second notification to the first software module to facilitate notification of the third software module. The third software module can notify the second software module to control the breath awakening processing device to start detecting the next breath awakening of the first application.

[0070] In conjunction with the first aspect, in certain implementations of the first aspect, the breath awakening processing device includes: an inertia detection sensor, a sound collection sensor, and an audio digital signal processor;

[0071] The first data includes: voice data and gesture data. The breath awakening processing device obtains the first data, including:

[0072] The inertial detection sensor collects gesture data;

[0073] The inertial detection sensor sends gesture data to the audio digital signal processor;

[0074] The sound collection sensor collects voice data;

[0075] The sound collection sensor sends voice data to the audio digital signal processor;

[0076] When the breath awakening processing device detects that the first data is used to instruct the breath to awaken the first application, the breath awakening processing device sends the voice data in the first data to the breath awakening software module, including:

[0077] When the breath awakening processing device detects that the similarity between the gesture data and the preset awakening gesture data is greater than a first threshold, and the similarity between the voice data and the preset awakening breath data is greater than a second threshold, the breath awakening processing device sends the voice data to the breath awakening software module.

[0078] In the above method, the inertial detection sensor can collect gesture data, and the sound collection sensor can collect voice data.

[0079] The breath awakening processing device can detect the gesture data collected by the inertial detection sensor and the voice data collected by the sound collection sensor.

[0080] In a second aspect, the present application provides a device for waking up an application, which is used to trigger an electronic device to execute a function and is used to execute the method for waking up an application in the first aspect and any possible design of the first aspect.

[0081] In a third aspect, the present application provides an electronic device comprising a processor; when the processor executes computer code or instructions in a memory, the electronic device executes the method for waking up an application in the first aspect and any possible design of the first aspect.

[0082] In a fourth aspect, the present application provides an electronic device comprising one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by one or more processors, the electronic device executes the method for waking up an application in the first aspect and any possible design of the first aspect.

[0083] In a fifth aspect, the present application provides a chip system comprising a processor for calling and running a computer program from a memory, so that an electronic device equipped with the chip system executes the method for waking up an application in the first aspect and any possible design of the first aspect.

[0084] In a sixth aspect, the present application provides a computer-readable storage medium comprising a computer program, which, when the computer program runs on an electronic device, enables the electronic device to execute the method for waking up an application in the first aspect and any possible design of the first aspect.

[0085] In a seventh aspect, the present application provides a computer program product, which, when running on a computer, enables the computer to execute the method of waking up an application in the first aspect and any possible design of the first aspect.

[0086] It can be understood that the beneficial effects of the second to seventh aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0087] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0088] FIG1 is a schematic diagram of a scenario of a method for waking up an application program provided by an embodiment of the present application;

[0089] FIG2 is a schematic structural diagram of an electronic device provided in one embodiment of the present application;

[0090] FIG3 is a schematic structural diagram of an electronic device provided in one embodiment of the present application;

[0091] FIG4 is a schematic diagram of the structure of a breath awakening software module provided in one embodiment of the present application;

[0092] FIG5 is a flow chart of a method for waking up an application program according to an embodiment of the present application;

[0093] FIG6 is a flow chart of a method for waking up an application program according to an embodiment of the present application;

[0094] 7A-7E are schematic diagrams of a human-computer interaction interface provided in one embodiment of the present application. DETAILED DESCRIPTION

[0095] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships can exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0096] In the following, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the technical features indicated. Therefore, a feature specified as "first," "second," or "third" may explicitly or implicitly include one or more of the features.

[0097] It should be understood that for a keyword to wake up a voice assistant application (APP):

[0098] After the electronic device collects voice data through a sound collection sensor (for example, a microphone), it sends it to a low-power audio digital signal processing (ADSP). The ADSP detects the voice data through a voice wake-up model.

[0099] When the ADSP detects that the voice data contains a wake-up word that matches the preset wake-up word, the ADSP sends the voice data to the wake-up software module. This process is called level one wake-up.

[0100] The wake-up software module performs text verification and voiceprint verification on the voice data to determine whether the voice data matches the generated voiceprint model. If the voice data matches the voiceprint model, the wake-up software module can then control the launch of the voice assistant application. This process is called secondary wake-up.

[0101] Among them, the keyword wake-up voice assistant application has specific keywords. Each time it is woken up, the voice wake-up model can stop running once and start running once.

[0102] For the Breath Voice Assistant app:

[0103] The electronic device collects voice data through the sound collection sensor and gesture data through the inertial detection sensor, and sends them to the low-power audio digital signal processing (ADSP). The ADSP detects the voice data and gesture data through the breath awakening model.

[0104] Among them, the breath awakening model is used to detect the acquired voice data and gesture data, and to determine whether the similarity between the voice data and the preset awakening breath data is greater than a first threshold, and whether the similarity between the gesture data and the preset awakening gesture data is greater than a second threshold.

[0105] In addition, the original awakening model can be trained using the sample awakening breath data and the sample awakening gesture data to obtain a breath awakening model.

[0106] When the ADSP detects that the similarity between the voice data and the preset wake-up breath data exceeds a first threshold, and the similarity between the gesture data and the preset wake-up gesture data exceeds a second threshold, the ADSP sends the voice data to the breath wake-up software module, which then controls the launch of the voice assistant application.

[0107] It can be seen that for the breath-awakening voice assistant application, there is only one level of awakening process.

[0108] The present application may provide a method for waking up an application, an apparatus for waking up an application, an electronic device, a chip system, a computer-readable storage medium, and a computer program product. When the ADSP detects that the acquired voice data matches the preset wake-up breath data, and the gesture data matches the preset wake-up gesture data, the ADSP may send the detected voice data to the breath wake-up software module. The breath wake-up software module stores the voice data, and controls the voice assistant application to start, and controls the ADSP to stop detecting the acquired data. After the voice assistant application is started, and when the breath wake-up software module is successfully called, the breath wake-up software module may send voice data to the control voice assistant application, so that the control voice assistant application performs voice recognition on the voice data. In addition, when the voice assistant application determines that the voice recognition is over based on the voice data, it may notify the breath wake-up software module, and the breath wake-up software module may control the ADSP to restart and detect the next acquired data.

[0109] Thus, the current wake-up of the application is achieved, ensuring the user's interaction with the electronic device through the voice assistant, preparing for the next wake-up of the application, and improving the user experience.

[0110] The method for waking up an application provided in this application can be applied to an electronic device, which can be an electronic device with display hardware and corresponding software support.

[0111] For example, the electronic device may be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a home appliance, or the like. This application does not impose any restrictions on the specific type of electronic device.

[0112] Please refer to FIG1 , which shows a scenario diagram of a method for waking up an application program provided in an embodiment of the present application.

[0113] As shown in FIG1 , the user can lift the electronic device, place the bottom of the electronic device close to the mouth, and speak into the microphone.

[0114] The electronic device collects the corresponding voice data when the user speaks through the microphone, and the corresponding gesture data when the user lifts the electronic device through the inertial detection sensor, and sends them to the low-power ADSP. The ADSP detects the voice data and gesture data through the breath wake-up model. When the ADSP detects that the similarity between the voice data and the preset wake-up breath data is greater than the first threshold, and the similarity between the gesture data and the preset wake-up gesture data is greater than the second threshold, the ADSP sends the voice data to the breath wake-up software module. The breath wake-up software module controls the startup of the voice assistant.

[0115] Among them, the distance between the electronic device and the user's mouth can be maintained at 0-5cm, which makes it easier for the microphone of the electronic device to accurately collect the user's voice data.

[0116] In addition, the above-mentioned gesture data may be wrist-raising gesture data.

[0117] Among them, from the gesture state indicated by the box A part in the left figure in Figure 1 to the gesture state indicated by the box B part in the right figure, it can be seen that the user can lift the electronic device by raising the wrist gesture, and the inertial detection sensor can collect the wrist-raising gesture data.

[0118] As can be seen from the right picture in Figure 1, after the user raises the electronic device through the wrist-raising gesture, he or she puts his or her mouth close to the microphone of the electronic device to speak, and can emit the breath indicated by part C. The microphone can collect the breath and the voice data corresponding to the breath.

[0119] It should be understood that the above is an example of a scenario and does not limit the scenario of this application.

[0120] For the sake of convenience, FIG2 takes the electronic device 100 as a mobile phone as an example.

[0121] As shown in FIG. 2 , in some embodiments, the electronic device 100 may include a processor 101 and a communication module 102 .

[0122] The processor 101 may include one or more processing units, for example, an application processor (AP), a modem processor, a graphics processor, an image signal processor (ISP), a controller, a memory, a video stream codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors 101.

[0123] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0124] The processor 101 may also include a memory for storing instructions and data.

[0125] In some embodiments, the memory in processor 101 is a high-speed cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 101. If processor 101 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces processor 101's waiting time, and thus improves system efficiency.

[0126] In some embodiments, the processor 101 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0127] The communication module 102 may include an antenna 1 , an antenna 2 , a mobile communication module, and / or a wireless communication module.

[0128] As shown in FIG2 , in some embodiments, the electronic device 100 may further include an external memory interface 105 , an internal memory 104 , a USB interface 106 , a charging management module 107 , a power management module 108 , a battery 109 , and a sensor module 103 .

[0129] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0130] The charging management module 107 is used to receive charging input from a charger, which can be a wireless charger or a wired charger.

[0131] In some wired charging embodiments, the charging management module 107 may receive charging input from a wired charger through the USB interface 106 .

[0132] In some wireless charging embodiments, the charging management module 107 may receive wireless charging input via a wireless charging coil of the electronic device 100. While the charging management module 107 is charging the battery 109, it may also provide power to the electronic device 100 via the power management module 108.

[0133] The power management module 108 is used to connect the battery 109, the charging management module 107, and the processor 101. The power management module 108 receives input from the battery 109 and / or the charging management module 107 and provides power to the processor 101, the internal memory 104, the external memory, and the communication module 102. The power management module 108 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance), etc.

[0134] In some other embodiments, the power management module 108 may also be disposed in the processor 101 .

[0135] In other embodiments, the power management module 108 and the charging management module 107 may also be provided in the same device.

[0136] The external memory interface 105 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 101 via the external memory interface 105 to implement data storage functions. For example, files such as music and video streams can be stored on the external memory card.

[0137] The internal memory 104 can be used to store computer executable program code, and the executable program code includes instructions. The processor 101 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 104. The internal memory 104 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0138] The sensor module 103 in the electronic device 100 may include components such as image sensors, touch sensors, pressure sensors, gyroscope sensors, air pressure sensors, magnetic sensors, acceleration sensors, distance sensors, proximity light sensors, ambient light sensors, fingerprint sensors, temperature sensors, bone conduction sensors, etc., to realize the sensing and / or acquisition functions of different signals.

[0139] Optionally, the electronic device 100 may further include peripheral devices, such as a mouse, buttons, indicator lights, a keyboard, a speaker, a microphone, etc.

[0140] The buttons include a power button, a volume button, etc. The buttons can be mechanical buttons or touch buttons. The electronic device 100 can receive button inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0141] The indicator may be a light indicator, which may be used to indicate the charging status and power level change, and may also be used to indicate messages, missed calls, and notifications, etc.

[0142] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100 .

[0143] In other embodiments, the electronic device 100 may include more or fewer components than shown, or combine some components, separate some components, or arrange the components differently. The components shown may be implemented in hardware, software, or a combination of software and hardware.

[0144] Please refer to Figure 3, which is a schematic diagram of an electronic device provided in an embodiment of the present application. When the method for waking up an application provided in an embodiment of the present application is applied to the electronic device 100 shown in Figure 2, the software in the electronic device 100 can be divided into an application layer 201, an application framework layer 202, and a driver layer 203 as shown in Figure 3.

[0145] As shown in Figure 3, multiple applications may be installed in the application layer 201, which may include a first application, etc. For example, the first application may be a voice assistant application (application, APP).

[0146] The application framework layer 202 may include an audio trigger module, a sound trigger module, an audio policy service module, etc. In addition, the application framework layer 202 may also include an audio service module, an audio trigger service module, an audio flinger module, etc.

[0147] The audio trigger module is used to control the startup of the voice assistant application in the application layer 201. The sound trigger module is used to send a wake-up event to the audio trigger module and send a notification to the audio driver in the driver layer 203 to instruct the breath wake-up model to stop or start running. The audio policy service module is used to establish a voice recognition channel with the voice assistant application in the application layer 201.

[0148] In addition, the audio service module is used to send a startup notification to the audio trigger module in response to the startup notification sent by the voice assistant application of the application layer 201. The audio trigger module is also used to send a startup notification to the audio trigger service module in response to the startup notification sent by the audio service module. The audio trigger service module is used to send a startup notification to the sound trigger module in response to the startup notification sent by the audio trigger module. The sound trigger module is also used to send a notification to the audio policy service module to start running the breath wake-up model in response to the startup notification sent by the audio trigger module. The audio policy service module starts running the breath wake-up model in response to the notification of starting running the breath wake-up model. The audio indication module is used to send a notification to load the breath wake-up model to the audio driver of the driver layer 203 in response to the notification of loading the breath wake-up model sent by the audio policy service module. The audio driver of the driver layer 203 is used to send a notification to the audio digital signal processor of the breath wake-up processing device to instruct the startup of running the breath wake-up model.

[0149] The driver layer 203 is a layer between hardware and software and may include an audio driver (sound trigger-half) and the like.

[0150] The driver layer 203 may be installed with multiple drivers for driving the hardware.

[0151] It should be noted that the application layer 201 , the application framework layer 202 and the driver layer 203 may also include other contents, which are not specifically limited here.

[0152] In addition, FIG3 also shows a breath awakening processing device connected to the driving layer 203 .

[0153] Exemplarily, as shown in FIG3 , the breath awakening processing device may include at least an inertia detection sensor, a sound collection sensor, and an audio digital signal processor.

[0154] The inertial detection sensor is used to collect gesture data. The sound collection sensor is used to collect voice data. The audio signal processor is used to obtain the gesture data collected by the inertial detection sensor and the voice data collected by the sound collection sensor, and detect the gesture data and voice data.

[0155] The application framework layer 202 may include a breath awakening software module.

[0156] The breath awakening software module may include an audio framework and an audio driver (sound trigger-hal).

[0157] As shown in FIG4 , the audio framework may include an audio trigger module (sound trigger), a sound trigger module (sound trigger module), and an audio policy service module (audio policy service).

[0158] As shown in FIG5 , the breath awakening processing device may include an audio digital signal processor (ADSP), a sound collection sensor, and an inertia detection sensor. Both the sound collection sensor and the inertia detection sensor are connected to the ADSP.

[0159] 5 , the specific implementation process of the method for waking up the application program of the present application will be described in detail.

[0160] FIG5 is a flowchart of a method for waking up an application provided in this application.

[0161] As shown in FIG5 , the method can be divided into three different phases, namely, a preparation phase, a startup phase, and an identification phase.

[0162] The preparation phase can be understood as starting the breath wake-up function of the voice assistant application, so that the breath wake-up model in the audio digital signal processor is in a continuous running state.

[0163] The startup phase can be understood as the phase of controlling the startup of the voice assistant application when the voice data and gesture data for waking up the voice assistant application are obtained.

[0164] The recognition stage can be understood as the stage in which the voice assistant application performs voice recognition on the voice data and determines whether to start or stop the breath awakening model based on the status of the voice recognition.

[0165] As shown in FIG5 , the method for waking up an application program of the present application may include:

[0166] Preparation

[0167] S11. Activate the breath wake-up function of the voice assistant application.

[0168] The electronic device can display a method for waking up the voice assistant application on a settings interface. This application does not limit the specific implementation method of the settings interface.

[0169] In some embodiments, the above-mentioned setting interface may include a breath wake-up control, which is used to trigger the breath wake-up function of starting the voice assistant application.

[0170] Among them, this application does not limit the display position, display style, display size and other parameters of the breath wake-up control.

[0171] Thus, after receiving an operation on the breath wake-up control, the electronic device can activate the breath wake-up function of the voice assistant application.

[0172] S12. The voice assistant application sends a notification to the audio trigger module to instruct it to start the audio trigger module.

[0173] Among them, after starting the breath wake-up function, the voice assistant application can send a startup notification to the audio trigger module, and the audio trigger module can be started in response to the startup notification.

[0174] Therefore, after being started, the audio trigger module can receive and send data.

[0175] S13. The audio trigger module is started in response to the notification for instructing to start the audio trigger module, and sends a notification for instructing to start the sound trigger module to the sound trigger module.

[0176] Among them, after being started, the audio trigger module can send a start notification to the sound trigger module, and the sound trigger module can be started in response to the start notification.

[0177] Thus, after being started, the sound trigger module can receive and send data.

[0178] S14. The sound trigger module is started in response to the notification for instructing to start the sound trigger module, and sends a notification for instructing to start running the breath awakening model to the audio driver.

[0179] S15 : In response to the notification instructing to start running the breath awakening model, the audio driver controls the breath awakening model in the audio digital signal processor to start running.

[0180] After being started, the sound trigger module can send a notification to the audio driver to instruct the start of the breath awakening model.

[0181] After receiving the notification for instructing to start running the breath awakening model, the audio driver can control the breath awakening model in the audio digital signal processor to start running.

[0182] Thus, data is prepared for the audio digital signal processor to run the breath awakening module.

[0183] S16: The audio digital signal processor runs the breath awakening model in response to the notification instructing to start running the breath awakening model.

[0184] It should be understood that the audio digital signal processor is a low-power digital signal processor. After the voice assistant application starts the breath wake-up function, the breath wake-up model can be in a continuously running state on the audio digital signal processor, facilitating real-time detection of the received voice data and gesture data.

[0185] During operation, the breath awakening model can continuously detect the received data to determine whether the received data is used to wake up the voice assistant application.

[0186] The data for waking up the voice assistant application is used to indicate that the similarity between the acquired voice data and the preset wake-up breath data is greater than a first threshold, and the similarity between the gesture data and the preset wake-up gesture data is greater than a second threshold.

[0187] In summary, after receiving the user's instructions to perform operations on the breath wake-up control, the electronic device can start the breath wake-up function of the voice assistant application, so that the user can wake up the voice assistant by breath wake-up, ensuring the convenience of waking up the voice assistant application and improving the user experience.

[0188] In addition, after the breath wake-up function of the voice assistant application is activated, the breath wake-up model can be in a continuously running state on the audio digital signal processor, detecting the received data in real time to determine whether the received data is used to wake up the voice assistant application, so as to facilitate waking up the voice assistant application in time when the received data is used to wake up the voice assistant application.

[0189]

Start-up Phase

[0190] S17, the sound collection sensor sends voice data to the audio digital signal processor;

[0191] The sound collection sensor can collect voice data in real time, and after collecting the voice data, the voice data can be sent to the audio digital signal processor.

[0192] In some embodiments, the sound collection sensor is a microphone (MIC).

[0193] S18, the inertial detection sensor sends gesture data to the audio digital signal processor;

[0194] The inertial detection sensor can collect gesture data in real time, and after collecting the gesture data, the gesture data can be sent to the audio digital signal processor.

[0195] S19. When the audio digital signal processor detects that the received data is used to instruct the voice assistant application to wake up, a wake-up event is triggered.

[0196] Based on the description of S16, it can be determined that the breath arousal model in the audio digital signal processor is in a continuous running state. In other words, there are three situations:

[0197] The audio digital signal processor only receives the voice data sent by the sound collection sensor. When the breath awakening model in the audio digital signal processor receives the voice data sent by the sound collection sensor, it detects the voice data.

[0198] The audio digital signal processor only receives the gesture data sent by the hand inertia detection sensor. When the breath arousal model in the audio digital signal processor receives the gesture data sent by the inertia detection sensor, it detects the gesture data.

[0199] The audio digital signal processor simultaneously receives gesture data from the inertial detection sensor and voice data from the sound collection sensor. The breath arousal model in the audio digital signal processor detects the voice data and gesture data from the sound collection sensor.

[0200] If the similarity between the voice data and the preset wake-up breath data is greater than a first threshold, and the similarity between the gesture data and the preset wake-up gesture data is greater than a second threshold, the audio digital signal processor may determine that the voice data and gesture data are data for waking up the voice assistant application. Thus, the audio digital signal processor may trigger a wake-up event.

[0201] In some embodiments, the gesture data is wrist-raising gesture data.

[0202] Assume that the gesture data is wrist-raising gesture data, the electronic device is a mobile phone, and the sound collection sensor is a microphone.

[0203] 1 , when a user lifts up their phone and brings the phone's microphone close to their mouth to speak, the microphone can collect voice data corresponding to what the user says and send the voice data to the audio digital signal processor. The inertial detection sensor can collect gesture data corresponding to the user's wrist raise when they lift up their phone and send the gesture data to the audio digital signal processor.

[0204] After receiving the above-mentioned voice data and gesture data, the audio digital signal processor detects the voice data and gesture data through the breath wake-up model. When it is determined that the similarity between the voice data and the preset wake-up breath data is greater than the first threshold, and the similarity between the gesture data and the preset wake-up gesture data is greater than the second threshold, the audio digital signal processor can trigger a wake-up event.

[0205] S20: The audio digital signal processor sends voice data to the audio driver.

[0206] After triggering a wake-up event, the audio digital signal processor can send the acquired voice data to the audio driver.

[0207] As a result, the audio driver can start storing voice data to prepare the data for the voice assistant application to obtain the voice data.

[0208] S21. The audio driver triggers the buffer to store voice data.

[0209] After receiving the voice data, the audio driver can trigger the audio driver's buffer to store the voice data, thus preparing the data for the voice assistant application to obtain the voice data.

[0210] S22. The audio driver sends a wake-up event to the sound trigger module.

[0211] After receiving the voice data, the audio driver can send a wake-up event to the sound trigger module, so that the sound trigger module can continue to send wake-up events to the audio trigger module.

[0212] There is no particular order between S21 and S22 in terms of timing, and they can be executed sequentially or simultaneously.

[0213] S23. The sound trigger module sends a notification to the audio driver to instruct it to stop running the breath awakening model.

[0214] After receiving the wake-up event, the sound trigger module may send a notification to the audio driver to instruct it to stop running the breath wake-up model.

[0215] Since the awakening event has been triggered, it can be regarded as consuming one awakening event, and the breath awakening model can stop running.

[0216] S24: In response to the notification for instructing to stop running the breath awakening model, the audio driver controls the breath awakening model in the audio digital signal processor to stop running.

[0217] Based on S19, the audio digital signal processor can determine that the received data is data for waking up the voice assistant application and trigger a wake-up event.

[0218] That is to say, in the current wake-up event, the voice assistant application can be woken up based on the voice data, and there is no need for the breath wake-up model in the audio digital signal processor to re-detect whether the acquired voice data is the data used to wake up the voice assistant application.

[0219] Then, after receiving the notification instructing to stop running the breath wake-up model, the audio driver can control the breath wake-up model in the audio digital signal processor to stop running, that is, the breath wake-up model no longer detects whether the received data is the user wake-up voice, and only needs to continue to receive voice data.

[0220] S25. The sound trigger module starts a timer in response to the wake-up event.

[0221] After receiving the wake-up event, the sound trigger module may also start a timer to facilitate the sound trigger module to determine whether a notification indicating the start of voice recognition or a notification indicating the end of voice recognition is received within the timer's timing.

[0222] That is to say, the sound trigger module can determine whether the audio strategy service module is successfully called through the set time of the timer, so that when the call is unsuccessful, a notification for instructing the audio driver to start the breath awakening model is sent.

[0223] In some embodiments, the timing time of the timer is 1-5 seconds.

[0224] For example, the timer setting time is 3s.

[0225] Among them, S23, S25, and S26 have no particular order in terms of timing and can be executed sequentially or simultaneously.

[0226] S26. The sound trigger module responds to the wake-up event and sends the wake-up event to the audio trigger module.

[0227] Among them, after receiving the wake-up event, the sound trigger module can also send a wake-up event to the audio trigger module, so that the audio trigger module can control the startup of the voice assistant application after receiving the wake-up event.

[0228] S27. The audio trigger module controls the voice assistant application to start in response to the wake-up event.

[0229] After receiving the wake-up event, the audio trigger module can determine that the voice assistant application needs to be started. Thus, the audio trigger module can control the voice assistant application to start.

[0230] S28. After the voice assistant application is started, a user interface is displayed.

[0231] After the voice assistant application is started, the electronic device can display a user interface. This application does not limit the specific implementation method of the user interface.

[0232] The user interface may be displayed in a partial area of ​​the current interface of the electronic device, or may be a different interface from the current interface of the electronic device.

[0233] In some embodiments, the above-mentioned setting interface may include a voice assistant floating ball control, which is used to remind the user that the voice assistant application has been started and to trigger the voice assistant application to end voice recognition.

[0234] Among them, this application does not limit the display position, display style, display size and other parameters of the voice assistant floating ball control.

[0235] Thus, after the electronic device displays the above user interface, the user can determine that the voice assistant application has been started.

[0236] In summary, the breath wake-up model in the audio digital signal processor can be in a continuous running state until it is determined that the similarity between the received voice data and the preset wake-up breath data is greater than the first threshold, and the similarity between the received gesture data and the preset wake-up gesture data is greater than the second threshold, and the audio digital signal processor can trigger a wake-up event.

[0237] As a result, the audio digital signal processor can start to report the wake-up event step by step, and control the startup of the voice assistant application through the audio trigger module, ensuring the convenience and timeliness of the startup of the voice assistant application.

[0238] It can be seen that the above-mentioned breath-activated voice assistant technology does not require wake-up words and trigger buttons, simplifies the voice interaction steps, and starts the voice assistant application more quickly.

[0239] In addition, this breath-awakening voice assistant technology allows users to directly approach electronic devices to have conversations, which improves the accuracy of user interaction with electronic devices, reduces the risk of conversation content leakage in terms of privacy protection, and avoids interference with others.

[0240] It should be noted that the survey found that 52% of respondents were worried about the leakage of private information when using voice assistants, and 46% of respondents would feel annoyed when hearing others using voice assistant applications in public places.

[0241] Identification Phase

[0242] S291. After the voice assistant application is started, if the voice policy server is successfully called, a notification is sent to the voice policy server to indicate the start of voice recognition.

[0243] Among them, after the voice assistant application is started, it can start calling the sound policy server. When the call to the sound policy server is successful, the channel between the voice assistant application and the sound policy server can be opened.

[0244] It should be noted that when the voice assistant application calls the sound policy server, there may be two situations: successful and unsuccessful. When the audio channel of the sound policy server is occupied, or when the voice assistant exits after successful startup, the voice assistant application may fail to call the sound policy server.

[0245] For example, after the voice assistant application is started, the recording function of the electronic device is turned on, the audio channel of the sound policy server is occupied, and the voice assistant application cannot successfully call the sound policy server.

[0246] Therefore, when the voice assistant application successfully calls the voice policy server, it can send a notification to the voice policy server to instruct the start of voice recognition.

[0247] The notification indicating the start of voice recognition is used to indicate that the voice assistant application is able to receive voice data and recognize the voice data.

[0248] S292: The sound policy server calls the voice data from the audio driver in response to the notification indicating the start of voice recognition.

[0249] Based on S21, it can be determined that the voice data is stored in the buffer of the audio driver. In addition, based on S291, the sound policy server can receive a notification indicating the start of voice recognition.

[0250] Then, after receiving the notification indicating the start of voice recognition, the sound policy server can determine that the voice assistant application is able to receive voice data and recognize the voice data. The sound policy server calls the voice data from the audio driver to facilitate sending the voice data to the voice assistant application.

[0251] In some embodiments, the sound policy server may carry voice data from the audio driver's buffer via a stream from audio source 1999 .

[0252] S293. After receiving the voice data from the audio driver, the voice policy server sends the voice data to the voice assistant application.

[0253] After the sound policy server obtains the audio data from the audio driver's buffer, it can send the voice data to the voice assistant application so that the voice assistant application can recognize the voice data.

[0254] S294. After receiving the voice data, the voice assistant application recognizes the received voice data.

[0255] Among them, the voice assistant application recognizes the received voice data, not only recognizes the meaning of the voice data, but also converts the voice data into text.

[0256] S295. In response to the notification for instructing the start of speech recognition, the voice policy server sends a notification for instructing the start of speech recognition to the voice trigger module.

[0257] After receiving the notification for instructing the start of speech recognition, the sound policy server may send the notification for instructing the start of speech recognition to the sound trigger module, so as to prepare for the sound trigger module to perform the next operation according to the notification for instructing the start of speech recognition.

[0258] Among them, S292 and S295 have no particular order in terms of timing and can be executed sequentially or simultaneously.

[0259] S296: The sound trigger module turns off the timer in response to the notification indicating the start of voice recognition.

[0260] It is understandable that when the sound trigger module receives the notification indicating the start of voice recognition, it can be determined that the voice assistant application has successfully called the voice policy server.

[0261] Based on S25, the sound trigger module has started the timer.

[0262] Thus, after receiving the notification indicating the start of voice recognition, the sound trigger module can turn off the timer and start the timer to prepare for the next time the voice assistant application is woken up.

[0263] In addition, turning off the timer can also minimize the power consumption of electronic devices.

[0264] S297. In response to the notification indicating the start of speech recognition, the sound trigger module sends a notification to the audio driver indicating the stop of the breath awakening model.

[0265] Among them, S297 is an optional step.

[0266] In addition, the implementation of S297 is similar to that of S23 in the embodiment shown in FIG5 , and will not be repeated here in this application.

[0267] It should be understood that when the voice assistant application is performing voice recognition, if the breath awakening model is running, the awakening event may be triggered again, causing the current voice recognition to be interrupted.

[0268] Therefore, based on S22, the sound trigger module has sent a notification to the audio driver to instruct the breath awakening model to stop running, and the breath awakening model can stop running. To avoid the breath awakening model from starting again for other reasons after stopping running, the sound trigger module can send a notification to the audio driver again to instruct the breath awakening model to stop running, so as to prevent the breath awakening model from starting and triggering the awakening event again.

[0269] Among them, S293 and S296 have no particular order in terms of timing and can be executed sequentially or simultaneously.

[0270] S298: In response to the notification for instructing to stop running the breath awakening model, the audio driver controls the breath awakening model in the audio digital signal processor to stop running.

[0271] Among them, S298 is an optional step.

[0272] Among them, S298 is similar to the implementation of S24 in the embodiment shown in Figure 5, and will not be repeated here in this application.

[0273] S299. When the voice assistant application determines that the voice recognition has ended based on the voice data, the voice assistant application sends a notification indicating the end of the voice recognition to the sound policy server.

[0274] The voice assistant application may use a variety of methods to determine the end of voice recognition based on voice data.

[0275] In some embodiments, when the voice assistant application receives the user's operation of triggering the voice assistant floating ball control in S28 based on the voice data, it can determine that the user wants to end the voice recognition. Thus, the voice assistant application can end the voice recognition in response to the operation on the voice assistant floating ball control.

[0276] In other embodiments, the voice assistant application determines that voice recognition ends when it determines that the voice text corresponding to the received voice data is a complete word or sentence.

[0277] Assume that the voice data is "Have you eaten today?"

[0278] After receiving the sentence “Have you eaten today?”, the voice assistant application can determine that “Have you eaten today?” is a complete sentence, and the voice assistant application can determine that the voice recognition is complete.

[0279] After receiving “eat today”, the voice assistant application can determine that “eat today” is not a complete sentence, and the voice assistant application can determine that the voice recognition is not completed.

[0280] Until the voice assistant application receives "Have you eaten yet?", so that "Eat today" and "Have you eaten yet" form a complete sentence, the voice assistant application can determine that the voice recognition is complete.

[0281] S300: When the voice assistant application determines that voice recognition is complete based on the voice data, the voice assistant application displays the voice recognition result.

[0282] The speech recognition result may be text data corresponding to the speech data, or an interaction result corresponding to the user data.

[0283] In some embodiments, the voice assistant application may convert the voice data into text during the process of recognizing the voice data and display the text on the user interface in S28.

[0284] For example, when the voice data is "today's weather", after the voice assistant application recognizes "today's weather", it can display the text data corresponding to "today's weather" on the user interface.

[0285] In other embodiments, the voice assistant application may display the interaction results corresponding to the voice data on the user interface in S28 after the voice data recognition is completed.

[0286] For example, when the voice data is "today's weather", after the voice assistant application recognizes "today's weather", it can determine that the user wants to know today's weather conditions, and can display the actual conditions such as the current temperature, maximum temperature, and minimum temperature corresponding to today's weather on the user interface.

[0287] S301. In response to a notification indicating the end of speech recognition, the voice policy server sends a notification indicating the end of speech recognition to the voice trigger module.

[0288] After receiving the notification indicating the end of speech recognition, the sound policy server may send the notification indicating the end of speech recognition to the sound trigger module, so as to prepare for the sound trigger module to perform the next operation according to the notification indicating the end of speech recognition.

[0289] S302: In response to the notification indicating the end of speech recognition, the sound trigger module sends a notification indicating the start of the breath awakening model to the audio driver.

[0290] Based on S24, or S22 and S298, it can be determined that the audio driver has controlled the breath wake-up model in the audio digital signal processor to stop running, and the voice assistant application stops the breath wake-up function.

[0291] Therefore, in order to restore the breath wake-up function of the voice assistant application, the sound trigger module can send a notification to the audio driver to instruct the start-up of the breath wake-up model, so that the sound trigger module can control the start-up of the breath wake-up model in the audio digital signal processor, so that the breath wake-up model in the audio digital signal processor can detect the data received next time.

[0292] S303: The audio driver controls the breath awakening model in the audio digital signal processor to start running in response to the notification for instructing to start running the breath awakening model.

[0293] After receiving the notification instructing to start the breath wake-up model, the audio driver can control the breath wake-up model in the audio digital signal processor to start running, so as to restore the breath wake-up function of the voice assistant application, so that the breath wake-up model in the audio digital signal processor can detect the data received next time.

[0294] S311. When the sound trigger module does not receive a notification indicating the start of speech recognition or a notification indicating the end of speech recognition at the end of the timer, it sends a notification to the audio driver indicating the start of the breath awakening model.

[0295] The “×” between the voice assistant application and the audio policy service module indicates that the voice assistant application failed to call the audio policy service module.

[0296] Based on S295, the sound trigger module may receive a notification indicating the start of voice recognition when the voice assistant application successfully calls the audio policy service module.

[0297] Based on S301, after the voice assistant application successfully calls the audio policy service module, and the voice assistant application completes the voice recognition, the sound trigger module can receive a notification indicating the end of the voice recognition.

[0298] Then, when the sound trigger module does not receive a notification for indicating the start of voice recognition or a notification for indicating the end of voice recognition at the end of the timer, it can be determined that the sound trigger module has failed to call the voice assistant application.

[0299] Therefore, in order to restore the breath wake-up function of the voice assistant application, the sound trigger module can send a notification to the audio driver to instruct the start-up of the breath wake-up model, so that the audio driver can control the start-up of the breath wake-up model in the audio digital signal processor.

[0300] S312: In response to the notification for instructing to start running the breath awakening model, the audio driver controls the breath awakening model in the audio digital signal processor to start running.

[0301] Among them, S312 is implemented in a similar manner to S303 in the embodiment shown in Figure 5, and will not be repeated here in this application.

[0302] In summary, when the voice assistant application successfully calls the audio strategy service module, the sound trigger module can send a notification to the audio driver to stop running the breath wake-up module, so that the audio driver controls the breath wake-up model to stop running and avoid interrupting the current voice recognition.

[0303] In addition, when the voice assistant application determines that the voice recognition is finished, the sound trigger module can send a notification to the audio driver to start running the breath wake-up module, so that the audio driver controls the breath wake-up model to start running, thereby restoring the breath wake-up function of the voice assistant application.

[0304] In addition, when the set time of the timer expires and no notification is received to indicate the start of voice recognition or the end of voice recognition, the sound trigger module can send a notification to the audio driver to start running the breath wake-up module, so that the audio driver controls the breath wake-up model to start running, thereby facilitating the restoration of the breath wake-up function of the voice assistant application.

[0305] It can be seen that regardless of whether the voice assistant application successfully calls the audio strategy service module, the sound trigger module can send a notification to the audio driver to start the breath wake-up module, so that the audio driver controls the breath wake-up model to start running, thereby restoring the breath wake-up function of the voice assistant application.

[0306] In other words, the sound trigger module can send a notification to the audio driver at the right time to start the breath wake-up module, so that the audio driver can control the breath wake-up model to start running, which can not only avoid the current voice recognition interruption, but also ensure that the voice assistant application can be woken up normally next time.

[0307] In this application, upon receiving an operation to activate the breath wake-up function of a voice assistant application, the electronic device activates the breath wake-up function, allowing the user to wake up the voice assistant by breath wake-up, thereby improving the user experience. After the breath wake-up function of the voice assistant application is activated, the breath wake-up model can be in a continuously running state on the audio digital signal processor, so that when the received data is data for waking up the voice assistant application, the wake-up event is triggered in a timely manner, so that the voice assistant application can be woken up.

[0308] In addition, when the breath wake-up module in the audio digital signal processor determines that the similarity between the received voice data and the preset breath wake-up data is greater than the first threshold, and the similarity between the received gesture data and the preset wake-up gesture data is greater than the second threshold, it can trigger a wake-up event and report the wake-up event step by step. The voice trigger module controls the startup of the voice assistant application, ensuring the convenience and timeliness of the startup of the voice assistant application.

[0309] In addition, regardless of whether the voice assistant application successfully calls the audio policy service module, the sound trigger module can send a notification to the audio driver to start the breath wake-up module, so that the audio driver controls the breath wake-up model to start running, thereby restoring the breath wake-up function of the voice assistant application.

[0310] It can be seen that the breath-awakening voice assistant application method of the present application is suitable for a variety of target customers, such as white-collar workers, public officials and office workers who use voice assistant applications (accounting for more than 80% of users and covering a wider range of usage scenarios).

[0311] The breath-awakening voice assistant application method of the present application is applicable to multiple typical scenarios, for example, in relatively quiet public places such as coffee shops, western restaurants, or high-speed rail / airport lounges; when users are queuing to enter subway stations, airports, train stations, etc. with luggage in their hands; when users are shopping in supermarkets, shopping malls, etc.; when users are walking their dogs outdoors; when users drive into / out of parking lots, toll booths, communities / parks, and their hands have just been freed from the steering wheel of the car.

[0312] The breath-activated voice assistant application method described in this application is applicable to a variety of needs. It eliminates the need for a wake-up word or trigger button, simplifies voice interaction steps, and enables faster startup of voice assistant applications. Furthermore, users can lean in for conversations, improving the accuracy of user interaction with electronic devices. This also reduces the risk of conversation content being leaked, while also avoiding disruption to others.

[0313] Based on some of the aforementioned embodiments, the method for waking up an application provided by this application is introduced below.

[0314] Exemplarily, the present application provides a method for waking up an application.

[0315] For ease of explanation, the method for waking up an application program in the present application may be executed by the electronic device in FIG. 2 .

[0316] Please refer to FIG6 , which shows a flow chart of a method for waking up an application program provided in an embodiment of the present application.

[0317] As shown in FIG6 , the method for waking up an application provided in the present application is applied to an electronic device, and the electronic device includes: a first application, a breath-awakening software module, and a breath-awakening processing device.

[0318] The electronic device may be a mobile phone, tablet computer, wearable device, vehicle-mounted device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), home appliance, or the like.

[0319] The breath awakening software module may include a first software module, a third software module, a second software module, and a fourth software module.

[0320] As shown in FIG4 , the first software module may be an audio policy service module (audio policy service).

[0321] The third software module may be a sound trigger module.

[0322] The second software module may be an audio driver (sound trigger-hal).

[0323] The fourth software module may be an audio trigger module (sound trigger).

[0324] As shown in FIG3 , the breath awakening processing device may include an audio digital signal processor (ADSP), a sound collection sensor, and an inertia detection sensor.

[0325] The sound collection sensor may be a microphone.

[0326] Specifically, the method for waking up an application provided by this application may include:

[0327] S101. The breath awakening processing device obtains first data.

[0328] The first data may be data received by the audio digital signal sensor in S19 in FIG. 5 .

[0329] The specific implementation of S101 can be found in the description of S17-S19 in FIG5 , which will not be described in detail here.

[0330] S102 : When the breath awakening processing device detects that the first data is used to instruct the breath to awaken the first application program, the breath awakening processing device sends the voice data in the first data to the breath awakening software module.

[0331] The specific implementation of S102 can be found in the description of S19-S20 in FIG5 , which will not be described in detail here.

[0332] S103: The breath awakening software module stores the voice data, starts the first application, and controls the breath awakening processing device to stop detecting the breath awakening of the first application and continue to obtain voice data.

[0333] The first application may be a voice assistant application.

[0334] The specific implementation of S103 can be found in the description of S21-S24 in FIG5 , which will not be described in detail here.

[0335] S104: After the first application is started, when the breath awakening software module is successfully called, the first application sends a first notification to the breath awakening software module.

[0336] The first notification may refer to the description of the notification for indicating the start of voice recognition in S291 in FIG. 5 .

[0337] The specific implementation of S104 can be found in the description of S21-S27 in FIG5 , which will not be described in detail here.

[0338] S105 . The breath awakening software module sends voice data to the first application in response to the first notification.

[0339] The specific implementation of S105 can be found in the description of S292-S295 in Figure 5, and will not be repeated here.

[0340] S106: The first application performs speech recognition on the speech data.

[0341] The specific implementation of S106 can be found in the description of S296 in FIG5 , which will not be described in detail here.

[0342] S107 . When the first application determines that the voice recognition is finished according to the voice data, the first application sends a second notification to the breath awakening software module.

[0343] For the second notification, please refer to the description of the notification for indicating the end of voice recognition in S299 in FIG. 5 .

[0344] The specific implementation of S107 can be found in the description of S299 in FIG5 , which will not be described in detail here.

[0345] S108 : The breath awakening software module controls the breath awakening processing device to start detecting the next breath awakening of the first application in response to the second notification.

[0346] The specific implementation of S108 can be found in the description of S301-302 in FIG5 , which will not be described in detail here.

[0347] In the method for waking up an application of the present application, when the breath awakening processing device detects the first data for indicating that the breath awakens the first application, the first application can be started through the breath awakening software module, thereby ensuring the convenience and timeliness of starting the first application.

[0348] When the breath awakening software module starts the first application, the breath awakening processing device can be controlled to stop detecting the breath awakening of the first application, thereby avoiding interruption of the current voice recognition.

[0349] In addition, the breath awakening software module can control the breath awakening processing device to start detecting the next breath awakening of the first application when the first application determines that the voice recognition is completed, so as to restore the breath awakening function of the first application.

[0350] In some embodiments, the method for waking up an application program of the present application may further include:

[0351] When the breath awakening software module does not receive the first notification or the second notification after a preset period of time, the breath awakening processing device is controlled to start detecting the next breath awakening of the first application.

[0352] The specific implementation of this step can be found in the description of S311-S312 in FIG5 , which will not be described in detail here.

[0353] Among them, when the breath awakening software module does not receive the first notification or the second notification after a preset period of time, it controls the breath awakening processing device to start detecting the next breath awakening of the first application, so as to facilitate the restoration of the breath awakening function of the voice assistant application.

[0354] In some embodiments, the method for waking up an application program of the present application may further include:

[0355] After the first application is started, a first user interface is displayed.

[0356] The first application displays the speech recognition result in the first user interface.

[0357] The first user interface can refer to the interface 14 in FIG. 7D to FIG. 7E , and the description of the user interfaces in S28 and S300 in FIG. 5 .

[0358] The specific implementation of this step can be found in the description of S28 and S300 in FIG5 , which will not be described in detail here.

[0359] Among them, the first user interface can display the voice recognition results, so that the user can understand the voice recognition results in a timely manner, thereby improving the user's usage experience.

[0360] In some embodiments, the breath awakening software module includes: a first software module and a second software module, and the voice data is stored in the second software module.

[0361] In some embodiments, the method of waking up an application program of the present application may include:

[0362] Step 201: After the first application is started and successfully calls a first software module, the first application sends a first notification to the first software module.

[0363] The specific implementation of step 201 can be found in the description of S291 in FIG5 , which will not be described in detail here.

[0364] Step 202: In response to the first notification, the first software module calls the voice data from the second software module and sends the voice data to the first application.

[0365] The specific implementation of step 202 can be found in the description of S293-S295 in Figure 5, and will not be repeated here.

[0366] When the first application successfully calls the first software module, the first software module can call the voice data from the second software module and send the voice data to the first application, so that the first application can receive the voice data in a timely manner.

[0367] In some embodiments, the method for waking up an application program of the present application may further include:

[0368] Step 301: In response to a first notification, a first software module sends a third notification to a second software module.

[0369] Step 301 may include: the first software module sends the first notification to the third software module in response to the first notification; and the third software module sends the third notification to the second software module in response to the first notification.

[0370] The third notification may refer to the description of the notification for instructing to stop running the breath awakening model in S297 in FIG. 5 .

[0371] The specific implementation of step 301 can be found in the description of S295 and S297 in Figure 5, and will not be repeated here.

[0372] Step 302: In response to the third notification, the second software module controls the breath wakeup processing device to stop detecting the breath wakeup of the first application and continue to obtain voice data.

[0373] The specific implementation of step 302 can be found in the description of S297-S298 in Figure 5, and will not be repeated here.

[0374] Among them, controlling the breath awakening processing device to stop detecting the breath awakening of the first application can avoid interrupting the current voice recognition and can once again ensure the quality of the current first application voice recognition.

[0375] In some embodiments, the method of waking up an application program of the present application may include:

[0376] Step 401: The first software module sends a fourth notification to the second software module in response to the second notification.

[0377] Step 401 may include: the first software module sending a second notification to the third software module in response to the second notification; and the third software module sending a fourth notification to the second software module in response to the second notification.

[0378] For the fourth notification, reference may be made to the description of the notification for instructing the start of the breath awakening model in S302 in FIG. 5 .

[0379] The specific implementation of step 401 can be found in the description of S301 - S302 in FIG5 , which will not be described in detail here.

[0380] Step 402: In response to the fourth notification, the second software module controls the breath wake-up processing device to start detecting the next breath wake-up of the first application.

[0381] The specific implementation of step 402 can be found in the description of S303 in FIG5 , which will not be described in detail here.

[0382] The second software module controls the breath awakening processing device to start detecting the next breath awakening of the first application in response to the fourth notification, so as to restore the breath awakening function of the first application.

[0383] In some embodiments, the breath awakening software module further includes a third software module and a fourth software module.

[0384] In some embodiments, the method of waking up an application program of the present application may include:

[0385] Step 501: The second software module stores voice data and sends a wake-up event to the third software module.

[0386] The specific implementation of step 501 can be found in the description of S22 in FIG5 , which will not be described in detail here.

[0387] Step 502: In response to the wake-up event, the third software module sends a wake-up event to the fourth software module and sends a fifth notification to the second software module.

[0388] The fifth notification may refer to the description of the notification for instructing to stop running the breath awakening model in S23 in FIG. 5 .

[0389] The specific implementation of step 502 can be found in the description of S23 and S26 in FIG5 , which will not be described in detail here.

[0390] Step 503: The fourth software module starts the first application in response to the wake-up event.

[0391] The specific implementation of step 503 can be found in the description of S27 in FIG5 , which will not be described in detail here.

[0392] Step 504: In response to the fifth notification, the second software module controls the breath wakeup processing device to stop detecting the breath wakeup of the first application and continue to obtain voice data.

[0393] The specific implementation of step 504 can be found in the description of S24 in FIG5 , which will not be described in detail here.

[0394] It can be seen that the fourth software module can start the first application in response to the wake-up event, thereby ensuring the timeliness and accuracy of starting the first application.

[0395] In addition, since the wake-up event has been triggered, controlling the breath wake-up processing device to stop detecting the breath wake-up of the first application can avoid interrupting the current voice recognition and ensure the quality of the current first application voice recognition.

[0396] In some embodiments, the method for waking up an application program of the present application may further include:

[0397] Step 601: The third software module sets a timer in response to a wake-up event and starts timing according to the timer.

[0398] The specific implementation of step 601 can be found in the description of S25 in FIG5 , which will not be described in detail here.

[0399] Step 602: When the third software module determines that the timer has expired and has not received the first notification or the second notification, the third software module sends a sixth notification to the second software module.

[0400] For the sixth notification, reference may be made to the description of the notification for instructing the start of the breath awakening model in S311 in FIG. 5 .

[0401] The specific implementation of step 602 can be found in the description of S311 in FIG5 , which will not be described in detail here.

[0402] Step 603: In response to the sixth notification, the second software module controls the breath awakening processing device to start detecting the next breath awakening of the first application.

[0403] The specific implementation of step 603 can be found in the description of S312 in FIG5 , which will not be described in detail here.

[0404] Step 604: The third software module stops timing of the timer in response to the first notification.

[0405] The specific implementation of step 604 can be found in the description of S293 in FIG5 , which will not be described in detail here.

[0406] Among them, the setting time of the timer can be used to determine whether the first notification or the second notification is received, so that when the first notification or the second notification is not received, the second software module controls the breath wake-up processing device to start the next breath wake-up of the first application and restore the breath wake-up function.

[0407] In some embodiments, the method of waking up an application program of the present application may include:

[0408] The first application determines that the voice recognition is ended in response to an operation for instructing to end the voice recognition.

[0409] Alternatively, when the first application determines that the voice text corresponding to the voice data satisfies a preset rule, the voice recognition is determined to be finished.

[0410] When determining that the voice recognition is finished, the first application sends a second notification to the first software module.

[0411] The preset rule is that the speech text corresponding to the speech data is a complete word or sentence.

[0412] The specific implementation of the above steps can be found in the description of S299 in Figure 5, which will not be repeated here.

[0413] It can be seen that the first application can determine whether the voice recognition is completed through the above two methods.

[0414] In some embodiments, the breath awakening processing device includes: an inertial detection sensor, a sound collection sensor, and an audio digital signal processor.

[0415] The first data includes: voice data and gesture data.

[0416] In some embodiments, the method of waking up an application program of the present application may include:

[0417] Step 701: The inertial detection sensor collects gesture data;

[0418] Step 702: The inertial detection sensor sends gesture data to the audio digital signal processor.

[0419] The specific implementation of step 701 and step 702 can be found in the description of S18 in FIG5 , which will not be described in detail here.

[0420] Step 703: The sound collection sensor collects voice data;

[0421] Step 704: The sound collection sensor sends voice data to the audio digital signal processor.

[0422] The specific implementation of step 703 and step 704 can be found in the description of S17 in FIG5 , which will not be described in detail here.

[0423] Step 705: When the breath awakening processing device detects that the similarity between the gesture data and the preset awakening gesture data is greater than the first threshold, and the similarity between the voice data and the preset awakening breath data is greater than the second threshold, the breath awakening processing device sends the voice data to the breath awakening software module.

[0424] The specific implementation of step 703 and step 704 can be found in the description of S19 in Figure 5, and will not be repeated here.

[0425] Among them, the inertial detection sensor can collect gesture data, and the sound collection sensor can collect voice data.

[0426] The breath awakening processing device can detect the gesture data collected by the inertial detection sensor and the voice data collected by the sound collection sensor.

[0427] Based on the above description, in combination with Figures 7A-7E, the method for waking up the application of the present application in an electronic device is described in detail. For ease of explanation, Figures 7A-7E take the electronic device as a mobile phone and the first application as a voice assistant application as an example.

[0428] The mobile phone may display an interface 11 as shown in FIG7A , which is used to display icons of various application programs (APPs) installed on the mobile phone. For example, the interface 11 may include a control 101 . The control 101 is used to display an icon for a settings APP.

[0429] After receiving a user triggering operation (such as a click, double-click, or long press operation) on the control 101 shown in FIG. 7A , the mobile phone may change from displaying the interface 11 shown in FIG. 7A to displaying the interface 12 shown in FIG. 7B .

[0430] The interface 12 may include a control 102. The control 102 is used to trigger the setting interface of the voice assistant application.

[0431] After receiving the user's triggering operation on the control 102 shown in FIG. 7B , the mobile phone may change from displaying the interface 12 shown in FIG. 7B to displaying the interface 13 shown in FIG. 7C .

[0432] The interface 13 may include a control 103. The control 103 is used to trigger the breath wake-up function of the voice assistant application.

[0433] After receiving the user's triggering operation on the control 103 shown in Figure 7C, the mobile phone starts the breath wake-up function of the voice assistant application.

[0434] Thus, the voice assistant application can notify the breath awakening software module to start, and the breath awakening software module can notify the breath awakening processing device to detect the acquired data.

[0435] When the breath awakening processing device detects that the acquired data is data for the breath awakening voice assistant application, it sends the voice data in the data to the breath awakening software module.

[0436] The breath awakening software module stores the voice data and controls the startup of the voice assistant application. After the voice assistant application is started, the mobile phone may display an interface 14 as shown in FIG7D .

[0437] In addition, the breath awakening software module can also control the breath awakening processing device to stop detecting the received data and continue to receive the voice data in the above data.

[0438] The interface 14 may include a control 105. The control 105 is used to remind the user that the voice assistant application has been started and to trigger the voice assistant application to end voice recognition.

[0439] After the voice assistant application is started, when the breath awakening software module is successfully called, the breath awakening software module can send voice data to the voice assistant application.

[0440] After receiving the voice data, the voice assistant application can convert the voice data into text data. In this case, the interface 14 may further include a control 104. The control 104 is used to display the text data corresponding to the voice data.

[0441] For example, when the voice data is “Today’s weather”, the text data displayed in the control 104 is “Today’s weather”.

[0442] It should be understood that when the voice data is "today's weather", it means that the user wants to know today's weather conditions.

[0443] After the voice assistant application determines that the voice recognition is completed based on the voice data, the mobile phone can display the interface 14 shown in Figure 7D.

[0444] In addition, after the voice assistant application determines that voice recognition has ended based on the voice data, it notifies the breath wake-up software module, which can then control the breath wake-up processing device to restart and recognize the next received data. In other words, the breath wake-up function of the voice assistant application is restored.

[0445] The interface 14 may further include a control 106. The control 106 is used to display the speech recognition result of the voice assistant application.

[0446] For example, when the voice data is "today's weather", the voice recognition result displayed by the control 106 may be "City A, mostly cloudy, 10% chance of rain, current temperature 14°C, maximum temperature 17°C, minimum temperature 11°C".

[0447] In summary, the voice assistant application can be awakened by breath awakening, and after the voice assistant application determines that the voice recognition is completed, the breath awakening software module can control the breath awakening processing device to restart and recognize the next received data.

[0448] Exemplarily, the present application provides a document processing device, which may include one or more modules for executing the method of waking up the application in the above embodiments.

[0449] Exemplarily, the present application provides an electronic device, comprising a processor; when the processor executes computer code or instructions in a memory, the electronic device executes the method for waking up an application in the foregoing embodiment.

[0450] Exemplarily, the present application provides an electronic device comprising one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device executes the method of waking up the application in the foregoing embodiment.

[0451] It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules that perform the corresponding functions. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0452] In this embodiment, the electronic device can be divided into functional modules according to the above-mentioned method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into a single processing module. The above-mentioned integrated modules can be implemented in the form of hardware. It should be noted that the module division in this embodiment is illustrative and is only a logical functional division. In actual implementation, other division methods may be used.

[0453] In the case where the functional modules are divided according to their respective functions, the electronic device involved in the above embodiments may further include: a receiving module and a determining module. The receiving module and the determining module cooperate with each other to support the electronic device in executing the above steps and / or other processes of the technology described herein.

[0454] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0455] The electronic device provided in this embodiment is used to execute the above-mentioned method of waking up the application program, and thus can achieve the same effect as the above-mentioned implementation method.

[0456] Exemplarily, the present application provides a chip system, which includes a processor for calling and running a computer program from a memory, so that an electronic device equipped with the chip system executes the method of waking up the application in the above embodiment.

[0457] Exemplarily, the present application provides a computer-readable storage medium storing codes or instructions. When the codes or instructions are executed on an electronic device, the electronic device implements the method of waking up the application in the foregoing embodiment.

[0458] Exemplarily, the present application provides a computer program product, which, when executed on a computer, enables an electronic device to implement the method for waking up an application in the foregoing embodiments.

[0459] Among them, the electronic device, computer-readable storage medium, computer program product or chip system provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0460] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0461] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0462] Units described as separate components may or may not be physically separate, and components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0463] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0464] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0465] The above content is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A method for waking up an application, characterized in that: Applied to an electronic device, the electronic device comprises: a first application, a breath awakening software module, and a breath awakening processing device; The method comprises: The breath awakening processing device obtains first data; The breath awakening processing device sends the voice data in the first data to the breath awakening software module when detecting that the first data is used to instruct the breath to awaken the first application; The breath awakening software module stores the voice data, starts the first application, and controls the breath awakening processing device to stop detecting the breath awakening of the first application and continue to obtain voice data; After the first application is started, when the breath awakening software module is successfully called, the first application sends a first notification to the breath awakening software module; The breath awakening software module sends the voice data to the first application in response to the first notification; The first application performs speech recognition on the speech data; The first application sends a second notification to the breath awakening software module when determining, based on the voice data, that voice recognition is finished; In response to the second notification, the breath awakening software module controls the breath awakening processing device to start detecting the next breath awakening of the first application.

2. The method according to claim 1, characterized in that The method further comprises: When the breath awakening software module does not receive the first notification or the second notification after a preset period of time, the breath awakening software module controls the breath awakening processing device to start detecting the next breath awakening of the first application.

3. The method according to claim 1 or 2, characterized in that The method further comprises: After the first application is started, the first user interface is displayed; The first application displays the speech recognition result in the first user interface.

4. The method according to any one of claims 1 to 3, characterized in that The breath awakening software module includes: a first software module and a second software module, and the voice data is stored in the second software module; After the first application is started, when the breath awakening software module is successfully called, a first notification is sent to the breath awakening software module, including: After the first application is started and successfully calls the first software module, the first notification is sent to the first software module; The breath awakening software module sends the voice data to the first application in response to the first notification, including: In response to the first notification, the first software module calls the voice data from the second software module and sends the voice data to the first application.

5. The method according to claim 4, characterized in that The method further comprises: The first software module sends a third notification to the second software module in response to the first notification; In response to the third notification, the second software module controls the breath awakening processing device to stop detecting the breath awakening of the first application and continue to acquire voice data.

6. The method according to claim 5, characterized in that The breath awakening software module controls the breath awakening processing device to start detecting the next breath awakening of the first application in response to the second notification, including: The first software module sends a fourth notification to the second software module in response to the second notification; In response to the fourth notification, the second software module controls the breath awakening processing device to start detecting the next breath awakening of the first application program.

7. The method according to claim 5 or 6, characterized in that The breath awakening software module also includes a third software module and a fourth software module; The breath awakening software module stores the voice data, starts the first application, and controls the breath awakening processing device to stop detecting the breath awakening of the first application and continue to obtain voice data, including: The second software module stores the voice data and sends a wake-up event to the third software module; In response to the wake-up event, the third software module sends the wake-up event to the fourth software module and sends a fifth notification to the second software module; The fourth software module controls the startup of the first application in response to the wake-up event; In response to the fifth notification, the second software module controls the breath awakening processing device to stop detecting the breath awakening of the first application and continue to acquire voice data.

8. The method according to claim 7, characterized in that The method further comprises: The third software module sets a timer in response to the wake-up event and starts timing according to the timer; When the third software module determines that the timing of the timer has expired and the first notification or the second notification has not been received, the third software module sends a sixth notification to the second software module; In response to the sixth notification, the second software module controls the breath awakening processing device to start detecting the next breath awakening of the first application; The third software module stops timing of the timer in response to the first notification.

9. The method according to any one of claims 4 to 8, characterized in that When the first application determines that the voice recognition is completed according to the voice data, the first application sends a second notification to the breath awakening software module, including: The first application determines that the speech recognition is ended in response to an operation for instructing to end the speech recognition; Alternatively, when the first application determines that the speech text corresponding to the speech data satisfies a preset rule, the speech recognition is determined to be ended; When the first application determines that the speech recognition is finished, the first application sends the second notification to the first software module.

10. The method according to any one of claims 1 to 9, characterized in that The breath awakening processing device includes: an inertia detection sensor, a sound collection sensor, and an audio digital signal processor; The first data includes: the voice data and gesture data, and the breath awakening processing device obtains the first data, including: The inertial detection sensor collects gesture data; The inertial detection sensor sends the gesture data to the audio digital signal processor; The sound collection sensor collects voice data; The sound collection sensor sends the voice data to the audio digital signal processor; When the breath awakening processing device detects that the first data is used to instruct the breath to awaken the first application, the breath awakening processing device sends the voice data in the first data to the breath awakening software module, including: When the breath awakening processing device detects that the similarity between the gesture data and the preset awakening gesture data is greater than a first threshold, and the similarity between the voice data and the preset awakening breath data is greater than a second threshold, the breath awakening processing device sends the voice data to the breath awakening software module.

11. An electronic device, characterized in that: include: one or more processors; Memory; and one or more computer programs, wherein the one or more computer programs are stored on the memory, and when the computer programs are executed by the one or more processors, the electronic device executes the method for waking up the application as described in any one of claims 1-10.

12. A chip system, characterized in that: The chip system includes a processor for calling and running a computer program from a memory, so that an electronic device equipped with the chip system executes the method for waking up an application as described in any one of claims 1 to 10.

13. A computer-readable storage medium comprising a computer program, characterized in that When the computer program is run on an electronic device, the electronic device is enabled to execute the method for waking up an application as described in any one of claims 1 to 10.

Images