Voice control method, wearable device and computer-readable storage medium

Abstract

The present application discloses a voice control method, a wearable device and a computer-readable storage medium, wherein the voice control method comprises: obtaining voice information of the environment in which the wearable device is located in real time based on a preset voice acquisition module, and detecting whether the voice information is a control instruction based on a preset instruction analysis set; if so, obtaining the interface layout of the current display page, and extracting the control information of each control on the interface layout; detecting whether the control instruction is a valid control instruction based on all control information; if so, executing the valid control instruction based on a simulated click script mapped by the instruction analysis set. The present application solves the technical problem of how to improve the unfriendly small-screen operation experience of wearable devices such as wristbands.

Description

Technical Field

[0001] The present application relates to the field of voice control, and in particular to a voice control method, a wearable device, and a computer-readable storage medium. Background Art

[0002] With the rapid development of electronic devices and their increasing intelligence, a new type of technological product, the wristwatch, has appeared on the market. As a wearable device, the wristwatch has the advantages of small size and easy portability, providing users with more convenient and interesting terminal products. But at the same time, the screen of the wristwatch is relatively narrow, and the user experience of screen operation is extremely unfriendly, which is particularly inconvenient when encountering scenes such as password input and small buttons. Users are prone to misoperation due to the narrow screen, which brings great inconvenience to users and seriously reduces the user experience. Therefore, how to improve the small-screen operation experience of wearable devices such as wristwatches has become a technical problem that needs to be solved urgently. Summary of the invention

[0003] The main purpose of the present invention is to provide a voice control method, a wearable device and a computer-readable storage medium, aiming to solve the technical problem of how to improve the small-screen operation experience of wearable devices such as wrist machines.

[0004] To achieve the above object, an embodiment of the present invention provides a voice control method, which is applied to a wearable device and includes:

[0005] Acquire voice information of the environment in which the wearable device is located in real time based on a preset voice acquisition module, and detect whether the voice information is a control instruction according to a preset instruction analysis set;

[0006] If so, the interface layout of the currently displayed page is obtained, and the control information of each control on the interface layout is extracted;

[0007] Detecting whether the control instruction is a valid control instruction based on all control information;

[0008] If so, the valid control instruction is executed based on the simulated click script mapped by the instruction analysis set.

[0009] Optionally, the step of detecting whether the voice information is a control instruction according to a preset instruction analysis set includes:

[0010] Extracting all voice keywords in the voice information and confirming the keyword attributes of each voice keyword, wherein the keyword attributes include verb keywords and noun keywords;

[0011] The voice keywords are weighted and scored according to a preset instruction analysis set to obtain a weight score for each voice keyword;

[0012] Obtain the best verb keyword and the best noun keyword with the highest weight score among each voice keyword;

[0013] If it is detected that there is a mapping instruction matching the optimal verb keyword and the optimal noun keyword in the instruction analysis set, the mapping instruction is confirmed as a control instruction.

[0014] Optionally, if it is detected that there is a mapping instruction matching the optimal verb keyword and the optimal noun keyword in the instruction analysis set, the step of confirming the mapping instruction as a control instruction further includes:

[0015] If more than one mapping instruction is detected, the mapping instruction that occupies the smallest memory space among the mapping instructions is confirmed as the control instruction.

[0016] Optionally, the currently displayed page includes a current page identifier, the control information includes a current control identifier, and the step of detecting whether the control instruction is a valid control instruction based on all the control information includes:

[0017] Extracting the target page identifier and the target control identifier in the control instruction;

[0018] Detecting whether there is a current page identifier mapped with a target page identifier on the currently displayed page, and whether there is a current control identifier mapped with a target control identifier in the control information;

[0019] If there is a current page identifier mapped with the target page identifier on the current display page, and if there is a current control identifier mapped with the target control identifier in the control information, it is confirmed that the control instruction is a valid control instruction.

[0020] Optionally, the step of executing the effective control instruction by the simulated click script based on the instruction analysis set mapping includes:

[0021] If it is detected that the control instruction is a specific control instruction, a time progress scroll bar with a preset time value is displayed on the current display page, and the valid control instruction is executed based on the simulated click script mapped by the instruction analysis set after the preset time value.

[0022] Optionally, the step of acquiring voice information of the environment in which the wearable device is located in real time based on a preset voice acquisition module, and detecting whether the voice information is a control instruction according to a preset instruction analysis set includes:

[0023] If a dedicated wake-up command is detected based on a preset voice collection module, voice information of the environment in which the wearable device is located is acquired in real time.

[0024] Optionally, the method further comprises:

[0025] If a user-defined instruction input by the user is detected, all instruction items in the instruction analysis set are output;

[0026] Acquire a selection instruction triggered based on all instruction items, and acquire a specified order of instruction items to be selected corresponding to the selection instruction, wherein the instruction items to be selected include multiple instruction items;

[0027] If an edit combination instruction corresponding to the instruction item to be selected is detected, the instruction items to be selected are combined into a target instruction item in the specified order based on the edit combination instruction, and a rename input box of the target instruction item is output;

[0028] The name input in the rename input box is used as the instruction name of the target instruction item, and the target instruction item is added to the instruction analysis set.

[0029] Optionally, after the step of acquiring voice information of the environment in which the wearable device is located in real time based on a preset voice acquisition module and detecting whether the voice information is a control instruction according to a preset instruction analysis set, the step further includes:

[0030] Performing sound quality recognition on the voice information to obtain a sound quality level of the voice information;

[0031] If the sound quality level is lower than the preset sound quality level, a prompt message for re-inputting the voice information is output.

[0032] In addition, to achieve the above-mentioned purpose, the present invention also provides a wearable device;

[0033] The wearable device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein:

[0034] When the computer program is executed by the processor, the steps of the voice control method described above are implemented.

[0035] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer storage medium;

[0036] The computer storage medium stores a computer program, and when the computer program is executed by the processor, the steps of the voice control method described above are implemented.

[0037] A voice control method, device and computer-readable storage medium proposed in an embodiment of the present invention obtain voice information of the environment in which the wearable device is located in real time based on a preset voice acquisition module, and detect whether the voice information is a control instruction based on a preset instruction analysis set; if so, obtain the interface layout of the current display page, and extract the control information of each control on the interface layout; detect whether the control instruction is a valid control instruction based on all control information; if so, execute the valid control instruction based on the simulated click script mapped by the instruction analysis set. Through the above scheme, wearable devices such as wrist machines can achieve the maximum control optimization experience under the user's voice control, thereby solving the technical problem of unfriendly small-screen operation experience of wearable devices such as wrist machines, avoiding the inconvenience or misoperation encountered by users when entering passwords and clicking small controls due to the narrow screen of wearable devices, thereby improving the controllability of wearable devices and improving the user's control experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0040] Figure 1 A schematic diagram of the hardware structure of an implementation of a wearable device provided in an embodiment of the present invention;

[0041] Figure 2 A hardware schematic diagram of a first perspective of an implementation method of a wearable device is provided for an embodiment of the present application;

[0042] Figure 3 A hardware schematic diagram of a second perspective of an implementation method of a wearable device is provided for an embodiment of the present application;

[0043] Figure 4 A hardware schematic diagram of a third perspective of an implementation method of a wearable device is provided for an embodiment of the present application;

[0044] Figure 5 A hardware schematic diagram of a fourth perspective of an implementation of a wearable device provided in an embodiment of the present application;

[0045] Figure 6 A flow chart of an embodiment of a voice control method is provided for an embodiment of the present application;

[0046] Figure 7 for Figure 6 A detailed flow chart of step S10;

[0047] Figure 8 for Figure 6 Detailed flow chart of step S30;

[0048] Fig. 9 A flow chart of another embodiment of a voice control method is provided for the embodiment of the present application. DETAILED DESCRIPTION

[0049] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0050] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present invention, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0051] The wearable device provided in the embodiment of the present invention includes a smart bracelet, a smart watch, and a mobile terminal such as a smart phone. With the continuous development of screen technology and the emergence of screen forms such as flexible screens and folding screens, mobile terminals such as smart phones can also be used as wearable devices. The wearable device provided in the embodiment of the present invention may include: RF (Radio Frequency) unit, WiFi module, audio output unit, A / V (audio / video) input unit, sensor, display unit, user input unit, interface unit, memory, processor, power supply and other components.

[0052] The following description will take wearable devices as an example. Figure 1 , which is a schematic diagram of the hardware structure of a wearable device for implementing various embodiments of the present invention, the wearable device 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The wearable device structure shown in the figure does not constitute a limitation on the wearable device. The wearable device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0053] Combine the following Figure 1 A detailed introduction to the various components of wearable devices:

[0054] The RF unit 101 can be used for sending and receiving information or receiving and sending signals during a call. Specifically, the RF unit 101 can send uplink information to the base station. In addition, it can also receive downlink information sent by the base station and send it to the processor 110 of the wearable device for processing. The downlink information sent by the base station to the RF unit 101 can be generated based on the uplink information sent by the RF unit 101, or it can be actively pushed to the RF unit 101 after detecting that the information of the wearable device is updated. For example, after detecting that the geographical location of the wearable device has changed, the base station can send a message notification of the geographical location change to the RF unit 101 of the wearable device. After receiving the message notification, the RF unit 101 can send the message notification to the processor 110 of the wearable device for processing. The processor 110 of the wearable device can control the message notification to be displayed on the display panel 1061 of the wearable device; usually, the RF unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication, which can specifically include: communicating with a server in the network system through wireless communication. For example, the wearable device can download file resources from the server through wireless communication, such as downloading applications from the server. After the wearable device completes downloading an application, if the file resources corresponding to the application in the server are updated, the server can push a resource update message notification to the wearable device through wireless communication to remind the user to update the application. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution) and TDD-LTE (Time Division Duplexing-Long Term Evolution), etc.

[0055] In one implementation, the wearable device 100 can access an existing communication network by inserting a SIM card.

[0056] In another embodiment, the wearable device 100 can access the existing communication network by setting an eSIM card (Embedded-SIM). The use of the eSIM card can save the internal space of the wearable device and reduce the thickness.

[0057] It is understandable that although Figure 1 The RF unit 101 is shown, but it is understandable that the RF unit 101 is not a necessary component of the wearable device and can be omitted as needed without changing the essence of the invention. The wearable device 100 can communicate with other devices or communication networks through the wifi module 102 alone, and the embodiments of the present invention are not limited thereto.

[0058] WiFi is a short-range wireless transmission technology. The wearable device can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not a necessary component of the wearable device and can be omitted as needed without changing the essence of the invention.

[0059] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the wearable device 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the wearable device 100 (for example, a call signal receiving sound, a message receiving sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0060] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0061] In one embodiment, the wearable device 100 includes one or more cameras. By turning on the camera, it is possible to capture images, take photos, record videos, etc. The position of the camera can be set as needed.

[0062] The wearable device 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the wearable device 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that recognize the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.

[0063] In one embodiment, the wearable device 100 further includes a proximity sensor. By using the proximity sensor, the wearable device can achieve contactless control and provide more operation modes.

[0064] In one embodiment, the wearable device 100 further includes a heart rate sensor, which can detect the heart rate by being close to the user when worn.

[0065] In one embodiment, the wearable device 100 may further include a fingerprint sensor, which can realize functions such as security verification by reading fingerprints.

[0066] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0067] In one embodiment, the display panel 1061 uses a flexible display screen. When the wearable device using the flexible display screen is worn, the screen can be bent so as to fit better. Optionally, the flexible display screen can use an OLED screen body and a graphene screen body. In other embodiments, the flexible display screen can also be other display materials, and this embodiment is not limited thereto.

[0068] In one embodiment, the display panel 1061 of the wearable device can be in a rectangular shape, which is convenient for wrapping around when worn. In other embodiments, other forms can also be adopted.

[0069] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to user settings and function control of the wearable device. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Specifically, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0070] In one embodiment, one or more buttons may be provided on the side of the wearable device 100. The buttons may be operated in various ways, such as short press, long press, rotation, etc., to achieve various operation effects. There may be multiple buttons, and different buttons may be used in combination to achieve various operation functions.

[0071] Furthermore, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of the touch event. Then, the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Figure 1 In the embodiment, the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the wearable device. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to realize the input and output functions of the wearable device, which is not limited here. For example, when a message notification of an application is received through the radio frequency unit 101, the processor 110 can control the message notification to be displayed in a preset area of ​​the display panel 1061, and the preset area corresponds to a certain area of ​​the touch panel 1071. By performing a touch operation on a certain area of ​​the touch panel 1071, the message notification displayed in the corresponding area on the display panel 1061 can be controlled.

[0072] The interface unit 108 serves as an interface through which at least one external device can be connected to the wearable device 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the wearable device 100 or may be used to transmit data between the wearable device 100 and an external device.

[0073] In one embodiment, the interface unit 108 of the wearable device 100 adopts a contact structure, and is connected to other corresponding devices through the contacts to achieve functions such as charging and connection. The use of contacts can also be waterproof.

[0074] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0075] The processor 110 is the control center of the wearable device. It uses various interfaces and lines to connect the various parts of the entire wearable device. By running or executing the software programs and / or modules stored in the memory 109 and calling the data stored in the memory 109, it performs various functions of the wearable device and processes data, thereby monitoring the wearable device as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0076] The wearable device 100 may also include a power supply 111 (such as a battery) for supplying power to each component. Preferably, the power supply 111 may be logically connected to the processor 110 through a power management system, thereby managing functions such as charging, discharging, and power consumption management through the power management system.

[0077] although Figure 1 Not shown, the wearable device 100 may also include a Bluetooth module, etc., which will not be described in detail herein. The wearable device 100 may be connected to other terminal devices via Bluetooth to achieve communication and information exchange.

[0078] Please refer to Figure 2-Figure 4 , is a schematic diagram of a structure of a wearable device provided in an embodiment of the present invention. The wearable device in the embodiment of the present invention includes a flexible screen. When the wearable device is unfolded, the flexible screen is in a long strip shape; when the wearable device is in a wearing state, the flexible screen is bent into a ring shape. Figure 2 and Figure 3 shows a schematic diagram of the structure of the wearable device when the screen is unfolded. Figure 4 A schematic diagram of the structure when the screen of a wearable device is bent is shown.

[0079] Based on the above embodiments, it can be seen that if the device is a watch, a bracelet or a wearable device, the screen of the device may not cover the strap area of ​​the device, or may cover the strap area of ​​the device. Here, the present application proposes an optional embodiment. In this embodiment, the device may be a watch, a bracelet or a wearable device, and the device includes a screen and a connecting part. The screen may be a flexible screen, and the connecting part may be a strap. Optionally, the screen of the device or the display area of ​​the screen may be partially or completely covered on the strap of the device. Figure 5 As shown, Figure 5 A hardware schematic diagram of an implementation of a wearable device provided in an embodiment of the present application, wherein the screen of the device extends to both sides and partially covers the strap of the device. In other implementations, the screen of the device may also be completely covered on the strap of the device, and the embodiment of the present application is not limited thereto.

[0080] The present invention provides a voice control method, which is mainly applied to wearable devices.

[0081] Specifically, in the first embodiment of the voice control method of the present invention, referring to Figure 6 , the voice control method includes:

[0082] Step S10, based on a preset voice acquisition module, voice information of the environment in which the wearable device is located is acquired in real time, and whether the voice information is a control instruction is detected according to a preset instruction analysis set;

[0083] The voice acquisition module is a collection unit built into the wearable device. In this embodiment, the wearable device receives voice information of the environment in real time through the voice acquisition module. Since the source of the voice information is the outside world, there are multiple sound sources. For example, it may be the murmur of children, the sound of cars driving on the street, or the user's current voice instructions to the wearable device, etc. The sounds formed by these sound sources will be acquired by the voice acquisition module to form voice information. However, whether these voice information have a control effect on the wearable device needs to be further determined.

[0084] In this embodiment, a command analysis set is preset, and the command analysis set refers to a command set pre-set in the wearable device by the developer, which includes a large number of parsed sentence templates of voice command items, which can be used to perform semantic comparison and screening on the received voice information, so as to match the voice information that conforms to the sentence template in the command analysis set. Through the preset command analysis set, the wearable device can detect whether the voice information is a control command. The control command is the voice information that conforms to the voice parsing sentence template in the command analysis set screened by the device.

[0085] Furthermore, assuming that the wearable device maintains the state of real-time voice acquisition for a long time, the voice control module will continue to consume power, and when the wearable device is not replenished, its battery power is in a state of rapid reduction, which will pose a significant challenge to the battery life of the wearable device. Therefore, how to effectively save the power of the wearable device and improve the battery life of the wearable device while maintaining real-time voice information acquisition is the further optimization direction of the current solution.

[0086] Based on the above optimization direction, in another embodiment, the wearable device adopts the technology of voice collection state switching. Specifically, the step of acquiring the voice information of the environment where the wearable device is located in real time based on the preset voice collection module includes:

[0087] If a dedicated wake-up instruction is detected based on a preset voice collection module, the voice information of the environment in which the wearable device is located is obtained in real time.

[0088] In this embodiment, the wearable device presets a dedicated wake-up instruction as a device startup instruction. The voice collection module of the wearable device is divided into two states, the first is the startup instruction collection state; the second is the voice information collection state. If the device is in standby mode, the device in this embodiment is only in the startup instruction collection state, that is, currently only receives voice information related to the dedicated wake-up instruction. Only after receiving the dedicated wake-up instruction, the voice information is subsequently acquired and screened. Otherwise, no matter what voice information is acquired from the environment where the device is located, no operation is performed. If the device obtains the exclusive wake-up instruction in the startup instruction collection state, it directly enters the voice information collection state to acquire, screen and compare the voice information. For example, the exclusive wake-up instruction is "Hello, my wrist machine." When the wearable device is in standby mode, it is in the startup instruction collection state, and the voice collection module operates with low power consumption. If the voice signal soundprint of the outside world does not meet the voiceprint characteristics of the exclusive wake-up instruction, no action is taken. Only when it is detected that the voice signal soundprint meets the voiceprint characteristics of "Hello, my wrist machine.", the voice collection module of the wearable device improves the collection efficiency and enters the voice information collection state. In this way, by switching states, the device can significantly reduce power consumption, thereby improving the voice control endurance of the device. It is understandable that the above-mentioned exclusive wake-up instructions are only examples.

[0089] Step S20: If yes, then obtain the interface layout of the currently displayed page, and extract the control information of each control on the interface layout;

[0090] When the device determines that the voice information is a control command, it locates the current display page in the screen interval currently lit by the device, and obtains the interface layout of the current display page. It can be understood that the current display page of the wearable device is usually full of functional controls, and the positions and intervals of these controls are preset. Therefore, the interface layout of the current display page can be obtained, so as to identify each space on the interface layout and extract the control information of each control. The control information is the attribute information of the current control, including the current control identifier, control length and width, control color, etc.

[0091] Step S30, detecting whether the control instruction is a valid control instruction according to all control information;

[0092] After acquiring the control information, the device can detect whether the current control instruction is a valid control instruction based on the control information of all controls.

[0093] Specifically, refer to Figure 8 , the currently displayed page includes a current page identifier, the control information includes a current control identifier, and the step of detecting whether the control instruction is a valid control instruction based on all the control information includes:

[0094] Step S31, extracting the target page identifier and the target control identifier in the control instruction;

[0095] Step S32, detecting whether there is a current page identifier mapped with a target page identifier on the currently displayed page, and whether there is a current control identifier mapped with a target control identifier in the control information;

[0096] In this embodiment, the current control identifier represents the id number of the current control on the currently displayed page, and the control instruction must specify the target page identifier of the target control page to be controlled and the target control identifier (ie, id number) of the target control to be controlled.

[0097] To determine whether a control instruction is a valid control instruction, the following two aspects need to be confirmed:

[0098] 1. Whether the control command can be executed in the current display page;

[0099] 2. Whether the control instruction can detect the control object to be controlled on the current display page.

[0100] Since the wearable device has only one current display page. Therefore, the device needs to first detect whether the current display page has a current page identifier that matches the target page identifier, and also detect whether the control information has a current page identifier that matches the target control identifier. For example, the target page identifier is point-1, the target control identifier is widget-1, and the current page identifier of the current display page is point-1; the current control identifiers are: widget-1, widget-2, and widget-3. Then the target page identifier and the current page identifier are mapped to each other, and the target control identifier and one of the current control identifiers in the control information are mapped to each other. However, if the current page identifier is point-2, the current page identifier and the target page identifier are not mapped. At this time, the detection result will be that there is no current page identifier mapped to the target page identifier.

[0101] Step S33: if the current page identifier mapped with the target page identifier exists on the current display page, and if the control information contains the current control identifier mapped with the target control identifier, confirm that the control instruction is a valid control instruction.

[0102] If there is both a current page identifier mapped to the target page identifier and a current control identifier mapped to the target control identifier, it proves that the current control instruction is operable and can be implemented by the device in the current state, and is a clear and implementable control instruction.

[0103] Step S40: If yes, then the effective control instruction is executed based on the simulated click script mapped by the instruction analysis set.

[0104] When the control instruction is confirmed to be a valid control instruction, it proves that the voice information in the current environment can be normally recognized and operated by the wearable device. In the instruction analysis set of the device, in addition to the parsing sentence templates of a large number of voice instruction items, it also includes the operation script corresponding to the parsing sentence template. This operation script is a simulated click script program. The simulated click script refers to an automated program that completes the operation steps of the corresponding parsing sentence template, and the parsing sentence template corresponds to the valid control instruction. Therefore, the device can execute the valid control instruction based on the simulated click script mapped by the instruction analysis set. For example, the valid control instruction is "Replace the 'contact a' on the left side of the cursor in the input box with 'contact b'." Then the execution steps of the device will correspond to the simulated click (i.e., the operation script) corresponding to the valid instruction, and locate the "contact a" on the left side of the cursor according to the simulated click, and replace it with "contact a" according to the "contact b" provided in the valid control instruction.

[0105] This application obtains the voice information of the environment in which the wearable device is located in real time based on a preset voice acquisition module, and detects whether the voice information is a control instruction based on a preset instruction analysis set; if so, obtains the interface layout of the current display page, and extracts the control information of each control on the interface layout; detects whether the control instruction is a valid control instruction based on all control information; if so, executes the valid control instruction based on the simulated click script mapped by the instruction analysis set. Through the above scheme, wearable devices such as wrist machines can achieve the maximum control optimization experience under the user's voice control, thereby solving the technical problem of unfriendly small-screen operation experience of wearable devices such as wrist machines, and avoiding the inconvenience or misoperation encountered by users when entering passwords and clicking small controls due to the narrow screen of wearable devices, thereby improving the controllability of wearable devices and improving the user's control experience.

[0106] Further, based on the first embodiment, a second embodiment of the voice control method of the present invention is proposed. In this embodiment, referring to Figure 7 The step of detecting whether the voice information is a control instruction according to a preset instruction analysis set includes:

[0107] Step S11, extracting all voice keywords in the voice information, and confirming the keyword attributes of each voice keyword, wherein the keyword attributes include verb keywords and noun keywords;

[0108] In this embodiment, when the device detects voice information, it will extract all voice keywords in the voice information. The voice keywords are valid words in the voice information. For example, if the voice information is "increase the volume in the music player", the voice keywords extracted by the device are "increase", "music player" and "volume", among which "in" and "of" will be identified as voice particles and omitted. After acquiring the voice keywords, the device will confirm the keyword attributes of each keyword, so as to further confirm the instruction information corresponding to each keyword. In this embodiment, the keyword attributes include verb keywords and noun keywords. The verb keyword represents the device state that needs to be changed by the device, and the noun keyword represents the control object that needs to be changed by the device. Clarifying the keyword attributes helps to clarify the operation content to be performed by the voice information.

[0109] Step S12, weighting and scoring the voice keywords according to a preset instruction analysis set to obtain a weight score for each voice keyword;

[0110] There may be more than one verb keyword (or noun keyword) in the voice keyword. For example, the verb keywords in "click the 'enter' button" include "click" and "enter", and the noun keyword is only "button". Then you need to screen multiple similar keywords and obtain them in the form of weighted scores.

[0111] The weighted scoring is a further extraction of voice keywords. A large number of voice instruction items in the instruction analysis set include a large number of nouns and verbs, which indicates the application degree of the corresponding verbs or nouns. Therefore, the preset instruction analysis set needs to be universal first, and then the newly developed functional instructions. For example, the weight scores of commonly used instructions such as "open the music player" and "reply to text messages" in the instruction analysis set should be set higher, while the weight scores of uncommon instructions such as "open the local device status" and "switch to power saving mode" should be set lower. Of course, the above examples are only based on the frequency of application. The weighted scoring of the instruction analysis set takes the order of keywords, the scope of application scenarios, the number of combinations, and other factors as comprehensive evaluation factors to obtain the most accurate weight score.

[0112] Step S13, obtaining the best verb keyword and the best noun keyword with the highest weight score among the voice keywords;

[0113] Step S14: if it is detected that there is a mapping instruction matching the optimal verb keyword and the optimal noun keyword in the instruction analysis set, the mapping instruction is confirmed as a control instruction.

[0114] According to the weighted scores of voice keywords in the preset command analysis set, the device can obtain the optimal verb keyword and the optimal noun keyword with the highest weight score among the voice keywords. The optimal verb keyword and the optimal noun keyword are used as the command information to be referred to by this voice information, and command matching is performed from the command analysis set to obtain relevant mapping instructions, thereby eliminating meaningless voice keywords. For example, the optimal verb keyword "play" and the optimal noun keyword "xx song"; as well as the optimal verb keyword "open" and the optimal noun keyword "B software", etc. Through the mapping and matching of the above keywords, truly meaningful voice information is located, and voice information with unclear meanings such as "input communication software", "complete music player" and "cut system update" do not belong to control instructions.

[0115] Furthermore, if more than one mapping instruction is detected, the mapping instruction that occupies the smallest memory space among the mapping instructions is confirmed as the control instruction.

[0116] For example, the optimal verb keyword is "open", the optimal noun keyword is "WeChat", and there are three mapping instructions that match the optimal verb keyword and the optimal noun keyword, including: 1. Open WeChat; 2. Open WeChat Moments; 3. Open WeChat Wallet. In this embodiment, the device queries the memory space occupied by each of the three mapping instructions. It can be clearly concluded that instruction 2 and instruction 3 both contain the steps of instruction 1. Therefore, instruction 1 occupies the smallest memory space, and the device will confirm mapping instruction 1 as a control instruction. This solution can provide information feedback to the greatest extent and is scalable. Users can further expand on the executed steps to implement the steps of instruction 2 or instruction 3.

[0117] Furthermore, based on the first embodiment, a third embodiment of the voice control method of the present invention is proposed. In this embodiment, the step of executing the effective control instruction based on the simulated click script mapped by the instruction analysis set includes:

[0118] If it is detected that the control instruction is a specific control instruction, a time progress scroll bar with a preset time value is displayed on the current display page, and the valid control instruction is executed based on the simulated click script mapped by the instruction analysis set after the preset time value.

[0119] It is understandable that when the main control method of the wearable device is voice control, the defects of voice control will also be inherited. For example, voice control requires the user to speak, and speaking is very simple for the user, which also leads to a certain degree of linguistic randomness in voice control. Suppose the current user originally intended to send out "call Zhang San", but because of being too casual, he made a slip of the tongue and sent out "call Li Si". Assuming that there is no error correction mechanism, the user will not be able to cancel the erroneous voice control. This embodiment provides a delayed execution mechanism for specific voice commands so that users can correct errors in time. The method is: when a specific control command is detected, a time progress scroll bar is displayed on the current display page of the device, and the display duration of the scroll bar is a preset time value (such as 2 seconds), so that the user can perform buffering and error correction after issuing the command.

[0120] Specifically, assuming that the current command is "call Zhang San", when the device senses that "call Zhang San" meets the characteristics of the specific control command "call xxx", it will automatically display a 3-second time progress scroll bar on the current display page according to the command mode of the specific control command, and directly execute the control command "call Zhang San" after 3 seconds. If the user finds that the wrong contact has been dialed within 3 seconds, the user can control the device to cancel the call by using the voice command "cancel dial".

[0121] The above examples are only examples, and specific control instructions may include multiple features, such as sending a text message to xxx, paying xxx yuan without a password, etc.

[0122] Further, based on the third embodiment, a fourth embodiment of the voice control method of the present invention is proposed. In this embodiment, referring to Fig. 9 , the method further comprises:

[0123] Step S50, if it is detected that the instruction input by the user is a custom instruction, then all instruction items in the instruction analysis set are output;

[0124] Step S60, obtaining a selection instruction triggered based on all instruction items, and obtaining a specified order of instruction items to be selected corresponding to the selection instruction, wherein the instruction items to be selected include multiple instruction items;

[0125] The voice command items in the command analysis set may lack the user's personalized commands, and the user can customize them. If the user's command customization is detected, the device will output all the command items in the analysis set for the user to query and edit. If the user edits and specifies any two or more command items, the specified order is obtained.

[0126] Step S70, if an edit combination instruction corresponding to the instruction item to be selected is detected, the instruction items to be selected are combined into a target instruction item in the specified order based on the edit combination instruction, and a rename input box of the target instruction item is output;

[0127] Assuming that the user clicks the edit combination button, the specified instruction items are combined and edited in a specified order according to the edit combination instruction to generate a target combination instruction. At the same time, the device prompts the user to perform the renaming process of the target combination instruction.

[0128] Step S80, using the name input in the rename input box as the instruction name of the target instruction item, and adding the target instruction item to the instruction analysis set.

[0129] The user performs customized naming, and after the naming is completed, the target instruction item uses the new name as the instruction name and is added to the instruction analysis set to expand the analysis scope of the specified analysis set.

[0130] Specifically, assuming that the user enters the instruction customization command of "Enter instruction customization settings", the device will output all instruction items. If the user specifies instruction item a and instruction item b, the specified order 1-a, 2-b is obtained. If the user clicks on the edit combination instruction, instruction items a and b are combined and edited in order to generate the target instruction item c (i.e. a+b), and a naming box is displayed to prompt the user to rename it. Finally, the renamed target instruction item c is added to the instruction analysis set.

[0131] Further, based on the fourth embodiment, a fifth embodiment of the voice control method of the present invention is proposed. In this embodiment, after the step of acquiring the voice information of the environment in which the wearable device is located in real time based on the preset voice acquisition module, the step further includes:

[0132] Step S90, performing sound quality recognition on the voice information to obtain the sound quality level of the voice information;

[0133] The sound quality recognition refers to the detection of voiceprint and volume of voice information. In real life, wearable devices and users may be in a noisy environment, which causes the voice information acquired by the device to contain a lot of noise, reducing the accuracy of subsequent voice command detection and analysis. This embodiment performs sound quality recognition on the acquired voice information to confirm the sound quality level of the voice information.

[0134] Specifically, assuming that the user device is in a vegetable market, the user's voice information is mixed with a lot of noises such as hawking in the vegetable market, and the volume of the noise may cover the user's own voice. At this time, the voice information collected by the device will present a large number of voice noise points through voiceprint detection and volume detection. The sound quality level is the sound quality judgment level set by the device, which is a comprehensive judgment result based on the detected voiceprint features and volume features. For example, the sound loss score is set for the voice information: if a disordered voiceprint feature is detected every 0.1 second in the voiceprint of the voice information, the sound loss score is increased by 1, and if a volume fluctuation greater than the preset value is detected every 0.1 second in the sound quality volume feature, the sound loss score is increased by 1. The total sound loss score is accumulated and mapped to the sound quality level judgment table of the sound quality recognition detection. The sound quality levels are level one, level two and level three from high to low. The higher the total sound loss score, the lower the corresponding sound quality level.

[0135] The above embodiments are only examples.

[0136] Step S100: if the sound quality level is lower than a preset sound quality level, output a prompt message for re-inputting the voice information.

[0137] This embodiment sets a preset sound quality level. If the sound quality level is lower than the preset sound quality level, it means that the current sound quality level does not meet the standard and cannot be effectively recognized by the device. At this time, the device outputs a prompt message to re-enter the voice information.

[0138] The present invention also provides a wearable device, the wearable device comprising: a memory, a processor, a communication bus, and a computer program stored in the memory:

[0139] The communication bus is used to realize the connection and communication between the processor and the memory;

[0140] The processor is used to execute the computer program to implement the steps of each embodiment of the above-mentioned voice control method.

[0141] The present invention also provides a computer-readable storage medium, which stores one or more programs. The one or more programs can also be executed by one or more processors to implement the steps of each embodiment of the above-mentioned voice control method.

[0142] The specific implementation of the computer-readable storage medium of the present invention is basically the same as the above-mentioned embodiments of the voice control method, and will not be repeated here.

[0143] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0144] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0145] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0146] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation modes, which are merely illustrative rather than restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims, all of which are within the protection of the present invention.

Claims

1. A voice control method, the method being applied to a wearable device, characterized in that: The voice control method comprises: Acquire voice information of the environment in which the wearable device is located in real time based on a preset voice acquisition module, and detect whether the voice information is a control instruction according to a preset instruction analysis set; If so, the interface layout of the currently displayed page is obtained, and the control information of each control on the interface layout is extracted; Detecting whether the control instruction is a valid control instruction based on all control information; If yes, then executing the valid control instruction based on the simulated click script mapped by the instruction analysis set; The step of detecting whether the voice information is a control instruction according to a preset instruction analysis set comprises: Extracting all voice keywords in the voice information and confirming the keyword attributes of each voice keyword, wherein the keyword attributes include verb keywords and noun keywords; The voice keywords are weighted and scored according to a preset instruction analysis set to obtain a weight score for each voice keyword; Obtain the best verb keyword and the best noun keyword with the highest weight score among each voice keyword; If it is detected that there is a mapping instruction matching the optimal verb keyword and the optimal noun keyword in the instruction analysis set, the mapping instruction is confirmed as a control instruction; If it is detected that there is a mapping instruction matching the optimal verb keyword and the optimal noun keyword in the instruction analysis set, the step of confirming the mapping instruction as a control instruction also includes: If more than one mapping instruction is detected, the mapping instruction that occupies the smallest memory space among the mapping instructions is confirmed as the control instruction.

2. The voice control method according to claim 1, characterized in that: The currently displayed page includes a current page identifier, the control information includes a current control identifier, and the step of detecting whether the control instruction is a valid control instruction based on all the control information includes: Extracting the target page identifier and the target control identifier in the control instruction; Detecting whether there is a current page identifier mapped with a target page identifier on the currently displayed page, and whether there is a current control identifier mapped with a target control identifier in the control information; If there is a current page identifier mapped with the target page identifier on the current display page, and if there is a current control identifier mapped with the target control identifier in the control information, it is confirmed that the control instruction is a valid control instruction.

3. The voice control method according to claim 1, characterized in that: The step of executing the effective control instruction by the simulated click script based on the instruction analysis set mapping comprises: If it is detected that the control instruction is a specific control instruction, a time progress scroll bar with a preset time value is displayed on the current display page, and the valid control instruction is executed based on the simulated click script mapped by the instruction analysis set after the preset time value.

4. The voice control method according to claim 3, characterized in that: The step of acquiring voice information of the environment in which the wearable device is located in real time based on a preset voice acquisition module, and detecting whether the voice information is a control instruction according to a preset instruction analysis set includes: If a dedicated wake-up command is detected based on a preset voice collection module, voice information of the environment in which the wearable device is located is acquired in real time.

5. The voice control method according to claim 4, characterized in that: The method further comprises: If a user-defined instruction input by the user is detected, all instruction items in the instruction analysis set are output; Acquire a selection instruction triggered based on all instruction items, and acquire a specified order of instruction items to be selected corresponding to the selection instruction, wherein the instruction items to be selected include multiple instruction items; If an edit combination instruction corresponding to the instruction item to be selected is detected, the instruction items to be selected are combined into a target instruction item in the specified order based on the edit combination instruction, and a rename input box of the target instruction item is output; The name input in the rename input box is used as the instruction name of the target instruction item, and the target instruction item is added to the instruction analysis set.

6. The voice control method according to any one of claims 1 to 5, characterized in that: After the step of acquiring the voice information of the environment in which the wearable device is located in real time based on the preset voice acquisition module and detecting whether the voice information is a control instruction according to the preset instruction analysis set, the method further includes: Performing sound quality recognition on the voice information to obtain a sound quality level of the voice information; If the sound quality level is lower than the preset sound quality level, a prompt message for re-inputting the voice information is output.

7. A wearable device, characterized in that: The wearable device comprises: A memory, a processor, and a computer program stored in the memory and executable on the processor; When the computer program is executed by the processor, the steps of the voice control method according to any one of claims 1 to 6 are implemented.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the voice control method according to any one of claims 1 to 6 are implemented.

Images