Method, device, terminal and storage medium for responding to control voice

Abstract

The embodiments of the present application disclose a method, device, terminal and storage medium for responding to control voice, which belongs to the field of voice control technology. The embodiments of the present application can be applied in a first terminal, receive the control voice through a microphone, and when the control voice meets the preset conditions, determine the first relative orientation relationship between the front of the user and the first terminal through a positioning component. When the orientation relationship indicates that the front of the user is facing the first terminal, the first terminal will perform the operation corresponding to the control voice. It can be seen that the present application can enable the first terminal to judge the user's orientation through the facing direction of the wearable device, thereby determining whether the wearable device is facing itself, thereby enhancing the ability to intelligently respond to control voice.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of voice control technology, and in particular to a method, device, terminal, and storage medium for responding to control voice. Background Art

[0002] With the development of smart home technology, household appliances in daily life have gradually added intelligent control functions. Among them, voice control is widely used as a common intelligent control method.

[0003] In related technologies, smart devices are equipped with microphones for monitoring user voice. When the user speaks a control voice, the smart device responds to the voice and performs a corresponding action. However, if multiple devices capable of responding to control voice are installed in a home, a chaotic situation may occur where multiple devices respond simultaneously to the user's voice. Summary of the Invention

[0004] The present invention provides a method, device, terminal, and storage medium for responding to control voice. The technical solution is as follows:

[0005] According to one aspect of the present application, a method for responding to a control voice is provided, which is applied to a first terminal, and the method includes:

[0006] Receive control voice through microphone;

[0007] In response to the control voice meeting a preset condition, obtaining, by a positioning component, a first relative orientation relationship between a front face of a user and the first terminal, the user being wearing a wearable device;

[0008] In response to the first relative orientation relationship being a facing relationship, performing the operation corresponding to the control voice, wherein the facing relationship is used to indicate that the front of the user faces the first terminal.

[0009] According to another aspect of the present application, a device for responding to a control voice is provided, which is applied to a first terminal, and includes:

[0010] A voice receiving module is used to receive control voice through a microphone;

[0011] a relationship acquisition module, configured to acquire, in response to the control voice meeting a preset condition, a first relative orientation relationship between the front face of the user and the first terminal through a positioning component;

[0012] The operation execution module is configured to execute the operation corresponding to the control voice in response to the first relative orientation relationship being a facing relationship, where the facing relationship indicates that the front of the user is facing the first terminal.

[0013] According to another aspect of the present application, a terminal is provided, comprising a processor and a memory, wherein the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement the method for responding to control voice as provided in various aspects of the present application.

[0014] According to another aspect of the present application, a computer-readable storage medium is provided, wherein the storage medium stores at least one instruction, and the instruction is loaded and executed by a processor to implement the method of responding to control voice as provided in various aspects of the present application.

[0015] According to one aspect of the present application, a computer program product is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various optional implementations of the aforementioned aspects of responsive control speech.

[0016] The embodiments of the present application can be applied to a first terminal, where a control voice is received via a microphone. When the control voice meets a preset condition, the positioning component determines a first relative orientation relationship between the front face of the user and the first terminal. When the orientation relationship indicates that the front face of the user is facing the first terminal, the first terminal executes the operation corresponding to the control voice. Thus, the present application enables the first terminal to determine the user's orientation based on the direction the wearable device is facing, thereby determining whether the wearable device is facing itself, thereby enhancing the ability to intelligently respond to control voice. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly introduce the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for use in the description of the embodiments of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0018] Figure 1 is a schematic diagram of a first relative orientation relationship provided in an embodiment of the present application;

[0019] Figure 2 is a schematic diagram of a first relative orientation relationship provided in an embodiment of the present application;

[0020] Figure 3Schematic diagram of an application environment of a method for responding to and controlling voice provided in an embodiment of the present application;

[0021] Figure 4 This is a structural block diagram of a first terminal provided by an exemplary embodiment of the present application;

[0022] Figure 5 is a flow chart of a method for responding to control voice provided by an exemplary embodiment of the present application;

[0023] Figure 6 is a flow chart of a method for responding to control voice provided by another exemplary embodiment of the present application;

[0024] Figure 7 is based on Figure 6 A schematic diagram of a projection position relationship provided by the illustrated embodiment;

[0025] Figure 8 is based on Figure 6 The illustrated embodiment provides a schematic diagram of an example of responding to a control voice;

[0026] Figure 9 is based on Figure 6 The illustrated embodiment provides another example schematic diagram of responding to control speech;

[0027] Figure 10 This is a structural block diagram of a device for responding to control voice provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0029] When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are merely examples of devices and methods consistent with certain aspects of the present application as detailed in the appended claims.

[0030] In the description of this application, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "connected" and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to the specific circumstances. In addition, in the description of this application, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.

[0031] In order to facilitate understanding of the solutions shown in the embodiments of the present application, several nouns appearing in the embodiments of the present application are introduced below.

[0032] Control voice: It is a voice spoken by the user, which has the function of controlling the terminal to perform corresponding operations, wherein the control voice may include semantic content and non-semantic content. In one possible way, the control voice may include only the semantic part, that is, the text content corresponding to the control voice has actual language meaning. In another possible way, the control voice may include only the non-semantic part, that is, the content corresponding to the control voice does not correspond to content with actual language meaning, but is controlled by sound features pre-determined with the device, such as sound features such as tone and volume. In another possible way, the control voice includes semantic parts and non-semantic parts, and the first terminal can recognize both parts after receiving the control voice.

[0033] Preset conditions: In this application, the conditions used to indicate that the content of the control speech meets the requirements. When the control speech includes a semantic part, the preset conditions are used to indicate the corresponding semantic content or text template. When the control speech includes a non-semantic part, the preset conditions are used to indicate the corresponding sound feature template. Among them, the control speech meeting the preset conditions indicates that the semantic part in the control speech meets the corresponding semantic content or meets the corresponding text template, and / or, the non-semantic part in the control speech meets the corresponding sound feature template.

[0034] Wearable device: A smart device worn on the user's body. In this embodiment of the present application, the wearable device is a bilaterally symmetrical device worn on the user's head. Optionally, the wearable device may include at least one of smart glasses, smart headphones, smart earrings, or a smart collar. When the wearable device is a smart headset, the smart headset may be a TWS (True Wireless Stereo) headset.

[0035] Optionally, the wearable device includes a first component and a second component. When a wearer wears the wearable device, the first component is located on the left side of the user, and the second component is located on the right side of the user.

[0036] Optionally, in one possible embodiment, the first component and the second component are independent components. The first component is a physical independent device, and the second component is also a physical independent device. For example, when the wearable device is a TWS headset, the first component is the left earphone of the TWS headset, and the second component is the right earphone of the TWS headset. Alternatively, when the wearable device is a smart earring, the first component is the left earring of the smart earring, and the second component is the right earring of the smart earring.

[0037] In another possible implementation, the first component and the second component are components disposed at different locations within the same wearable device. For example, when the wearable device is smart glasses, the first component is disposed in the left temple, and the second component is disposed in the right temple. The first component and the second component are disposed symmetrically about the central axis of the smart glasses.

[0038] The front of a wearable device is used to indicate a reference surface within the wearable device. In one possible approach, the front of a wearable device is the side that faces the same direction as the user's face when the wearable device is worn. In another possible description, the front of a wearable device is a relative concept. If a reference point is specified, the front of the wearable device relative to that reference point is the side of the wearable device that faces the reference point, with the reference point as the origin. When the first component is located clockwise from the second component, the line connecting the first and second components faces the reference point.

[0039] First relative orientation: This indicates the orientation relationship between the user and the first terminal. The orientation relationship between the user's face and the first terminal can be defined as the first relative orientation relationship. When the user's front face is facing the first terminal, the first relative orientation relationship is a face-to-face relationship. Alternatively, when the wearable device's front face is facing away from the first terminal, the first relative orientation relationship is a back-to-back relationship.

[0040] In one classification method of relative orientation, the terminal may divide the 360° range of the user's front orientation into two 180° ranges, wherein the first 180° range is the range facing the orientation indicator, and the other 180° range is the range facing away from the orientation indicator.

[0041] In another classification method of relative orientation relationships, the terminal can divide the 360° range of the user's front orientation into 180° corresponding to the back-facing relationship, 30° range of the front corresponding to the facing relationship, and another 150° range corresponding to the side-facing relationship.

[0042] See Figure 1 , Figure 1 This is a schematic diagram of a first relative orientation relationship provided by an embodiment of the present application. The front of the user is represented by a wearable device worn by the user, and the first terminal obtains the front orientation of the user by locating the wearable device.

[0043] exist Figure 1 In the figure, the front of the wearable device 110 is 1A. When the first terminal 120 is located in the positive half-axis area of ​​the y-axis with the center of the wearable device 110 as the reference coordinate system, the relationship between the wearable device 110 and the first terminal 120 is a face-to-face relationship. When the first terminal 120 is located in the negative half-axis area of ​​the y-axis with the center of the wearable device 110 as the reference coordinate system, the relationship between the wearable device 110 and the first terminal 120 is a back-to-back relationship.

[0044] See Figure 2 , Figure 2 This is a schematic diagram of a first relative orientation relationship provided in an embodiment of the present application.

[0045] exist Figure 2 In the embodiment, the front of the wearable device 110 is 1A. When the first terminal 120 is located in a sector-shaped area of ​​plus or minus 15 degrees from the positive half-axis of the y-axis with the center of the wearable device 110 as the reference coordinate system, that is, when the first terminal 120 is located in a 30-degree sector-shaped area on the front of the wearable device 110, the relationship between the wearable device 110 and the first terminal 120 is a face-to-face relationship. When the first terminal 120 is located in an area other than the aforementioned 30-degree area on the front of the wearable device 110, the relationship between the wearable device 110 and the first terminal 120 is a side-to-side relationship. When the first terminal 120 is located in an area of ​​the negative half-axis of the y-axis with the center of the wearable device 110 as the reference coordinate system, the relationship between the wearable device 110 and the first terminal 120 is a back-to-back relationship.

[0046] Optionally, Figure 2The illustrated embodiment is merely a schematic illustration of the first relative orientation relationship. The present application may also use a sector-shaped area within another angle range where the first terminal 120 is located on the front of the wearable device 110 as the corresponding facing area. Optionally, the angle range may include [0°, 30°]. It should be noted that when the angle range is 0°, it indicates that the first terminal 120 is located on the positive half-axis of the y-axis of the reference coordinate system. The angle may be 5°, 10°, 15°, or 20°.

[0047] exist Figure 2 In the embodiment, the first terminal 121 and the wearable device face each other, the second terminal 122 and the wearable device face each other, and the third terminal 123 and the wearable device face each other.

[0048] It should be noted that in Figure 1 and Figure 2 In the reference coordinate system, the xOy plane is the horizontal plane in the real world.

[0049] Please refer to Figure 3 , Figure 3 This is a schematic diagram of an application environment of a method for responding to control voice provided in an embodiment of the present application.

[0050] Figure 3 The perspective provided is a bird's-eye view, that is, the plane seen from the paper is the horizontal plane, and the direction of the perspective is from the sky to the ground. Figure 3 In the example, the wearable device is a TWS headset. The user 30 wears a left ear headset 311 of the TWS headset on the left ear, and the user 30 wears a right ear headset 312 of the TWS headset on the right ear. Figure 3 In the room shown, the first terminal 120 is located on the front of the TWS headset, and there is a second terminal 130 and a third terminal 140. Among them, the second terminal 130 is located on the side of the TWS headset, and the third terminal 140 is located on the back of the TWS headset.

[0051] exist Figure 3 In the environment shown, if the voice control scheme in the related art is used, when the user speaks the control voice, the first terminal 120, the second terminal 130 and the third terminal 140 will all respond to the control voice, causing confusion. However, according to the method of responding to the control voice provided in the present application, among the three terminals, only the first terminal 120 facing the user will respond to the control voice and perform the corresponding operation, while the second terminal 130 and the third terminal 140 will not respond to the control voice.

[0052] Please refer to Figure 4 , Figure 4 This is a structural block diagram of a first terminal provided by an exemplary embodiment of the present application. Figure 4 As shown, the terminal includes a processor 420, a memory 440, a positioning component 460 and a microphone 480, wherein the memory 440 stores at least one instruction, which is loaded and executed by the processor 420 to implement the method of responding to control voice as described in the various method embodiments of the present application.

[0053] In the present application, the first terminal 400 receives a control voice through a microphone 480; in response to the control voice meeting a preset condition, a first relative orientation relationship between the front of the user and the first terminal is obtained through a positioning component, and the user wears a wearable device; in response to the first relative orientation relationship being a facing relationship, the operation corresponding to the control voice is executed, and the facing relationship is used to indicate that the front of the user is facing the first terminal.

[0054] The first terminal is a smart device with a built-in microphone that can capture user voice. The microphone of the smart device can be in a continuous monitoring state to avoid missing control commands spoken by the user. Optionally, the monitoring state can be set according to a time period or the state of the first terminal itself.

[0055] For example, when the monitoring state is set according to time periods, the first terminal can set 7:30 AM to 10:00 PM every day as the monitoring period, and 10:01 PM to 7:29 AM the next day as the non-monitoring period. The first device can respond to the user's control voice during the monitoring period, and the first terminal turns off the microphone during the non-monitoring period and no longer responds to the user's control voice.

[0056] For example, when the listening state is set according to the state of the first terminal itself, the first terminal can divide its own working state into an awake state, a standby state, and an offline state (the offline state may also be referred to as a shutdown state). When the first terminal is in the awake state or the standby state, the first terminal is in the listening state. When the first terminal is in the offline state, the first terminal is in the non-listening state.

[0057] Optionally, the first terminal may be at least one of a Bluetooth speaker, a smart TV, a smart air conditioner, a smart refrigerator, a sweeping robot, a smart water heater, an air purifier, or a smart lamp. It should be noted that the first terminal may be any electronic device with a microphone.

[0058] Processor 420 may include one or more processing cores. Processor 420 utilizes various interfaces and circuits to connect various components within terminal 400. It executes instructions, programs, code sets, or instruction sets stored in memory 440, and accesses data stored in memory 440 to perform various functions and process data for terminal 400. Optionally, processor 420 may be implemented using at least one of the following hardware forms: digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). Processor 420 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. The CPU primarily processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing content displayed on the display; and the modem handles wireless communications. It is understood that the modem may not be integrated into processor 420 and may be implemented as a separate chip.

[0059] The memory 440 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 440 includes a non-transitory computer-readable storage medium. The memory 440 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 440 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc.; the data storage area may store data involved in the following various method embodiments, etc.

[0060] Positioning component 460 is used to determine the relative orientation relationship with the wearable device. In one possible embodiment, positioning component 460 can determine the distance and angle between the wearable device and the positioning component 460. In terms of positioning implementation principle, positioning component 460 can use UWB (Ultra Wide Band) technology for positioning. Illustratively, positioning component 460 can also use other positioning technologies with positioning accuracy at the centimeter or millimeter level.

[0061] Microphone 480 is used to receive the user's control voice. In one possible implementation, microphone 480 can be a separate component. In another possible implementation, the microphone is a microphone array including multiple microphone units. The embodiments of the present application do not limit the specific implementation of microphone 480.

[0062] Optionally, when the first terminal 400 needs to communicate with other devices, a communication component may be provided in the first terminal 400. The communication component is used to transmit and receive communication signals. The communication component may include at least one of a Bluetooth component, a WiFi component, or a 2.4G / 5G signal radio frequency component. Illustratively, the communication component may also include other electronic components that enable communication, which is not limited in this embodiment of the present application.

[0063] Please refer to Figure 5 , Figure 5 This is a flow chart of a method for responding to control voice provided by an exemplary embodiment of the present application. The method for responding to control voice can be applied to the above Figure 4 In the first terminal shown. Figure 5 In the method of responding to the control voice, the method includes:

[0064] Step 510: Receive control voice via a microphone.

[0065] In an embodiment of the present application, the first terminal has a microphone, which can be a single device or multiple devices. The microphone can be set in different positions in different devices. Schematically, the role of the microphone is to monitor the control voice spoken by the user of the wearable device. In an embodiment of the present application, the microphone can be in a continuous monitoring state so that when voice appears in the environment, the voice can be collected in a timely manner.

[0066] As a possible implementation, this embodiment uses the example of a Bluetooth speaker as the first terminal. If the first terminal is a Bluetooth speaker, the Bluetooth speaker can receive control voice commands through its built-in microphone. A common scenario involves a Bluetooth speaker in a home where it is typically located, receiving the user's voice commands and engaging in voice interaction with the user. Optionally, the Bluetooth speaker can receive control voice commands whose loudness exceeds a preset threshold.

[0067] Step 520: In response to the control voice meeting the preset condition, a first relative orientation relationship between the front of the user and the first terminal is obtained through the positioning component, and the user is wearing a wearable device.

[0068] In the embodiment of the present application, the Bluetooth speaker can first determine whether the control voice meets the preset conditions. In one possible manner, the Bluetooth speaker can locally determine whether the control voice meets the preset conditions.

[0069] In another possible approach, the Bluetooth speaker can transmit the control voice to the cloud, allowing the cloud to determine whether the control voice meets preset conditions.

[0070] After the Bluetooth speaker determines that the control voice meets the preset conditions, the Bluetooth speaker can interact with the wearable device through a built-in positioning component to obtain a first relative orientation relationship between the front face of the user and the first terminal. The positioning component can obtain a distance and angle between the positioning component and a corresponding positioning component in the wearable device, and determine the first relative orientation relationship between the first terminal and the front face of the user based on the distance and angle.

[0071] Step 530: In response to the first relative orientation relationship being a facing relationship, executing an operation corresponding to the control voice, where the facing relationship is used to indicate that the front of the user is facing the first terminal.

[0072] In the embodiment of the present application, the Bluetooth speaker can perform an operation corresponding to the control voice when the first relative orientation relationship is a facing relationship. In this example, the facing relationship is used to indicate that the front of the user is facing the first terminal.

[0073] For an operation corresponding to a control voice command executed by the first terminal, if the control voice command is directed to the first terminal, the first terminal directly responds to the control voice command and executes the corresponding operation. Alternatively, if the control voice command is directed to another device, the first terminal sends a corresponding instruction to the other device based on the control instruction, so that the other device executes the operation corresponding to the control voice command.

[0074] In summary, the method for responding to control voice provided in this embodiment can receive control voice via a microphone and, when the control voice meets preset conditions, determine a first relative orientation relationship between the front face of the user and the first terminal through a positioning component. When this orientation relationship indicates that the front face of the user is facing the first terminal, the first terminal will execute the operation corresponding to the control voice. Thus, this application can enable the first terminal to determine the user's orientation based on the facing direction of the wearable device, thereby determining whether the user is facing itself, thereby enhancing the ability to intelligently respond to control voice.

[0075] Based on the solution disclosed in the previous embodiment, the first terminal can also use a negotiation mechanism to ensure that only one of the multiple terminals responds to the control voice, thereby avoiding confusion that may occur when responding to the control voice. Please refer to the following embodiment.

[0076] See Figure 6 , Figure 6 This is a flow chart of a method for responding to control voice provided by another exemplary embodiment of the present application. The method for responding to control voice can be applied in the terminal shown above. Figure 6 In the method of responding to control voice, the method includes:

[0077] Step 611: In response to the first binding instruction, establish a binding relationship with the control terminal.

[0078] In this example, the first terminal can first establish a binding relationship with the control terminal. When the control terminal is a mobile phone, the first terminal can first establish a binding relationship with the control terminal. The binding relationship can be completed using WiFi technology or Bluetooth technology.

[0079] Optionally, as a possible implementation, the first terminal can be bound to multiple control terminals. In this scenario, a household has multiple members, each of whom can use a control terminal. In this scenario, the household's control terminals can have the same control permissions, which are used to control all smart devices in the household. When the first terminal is bound to the smart household, it forms a binding relationship with each control terminal in the household.

[0080] For example, a first terminal is set up in a family. There are three family members, each of whom uses a control terminal, namely control terminal C1, control terminal C2, and control terminal C3. The first terminal can be bound to each of the three control terminals. In this example, the example of a single control terminal is used.

[0081] Step 612: Receive wearable device information sent by the control terminal.

[0082] Among them, the wearable device information includes first component information and second component information, the first component information includes the component identifier of the first component and the left and right identifiers of the first component, the second component information includes the component identifier of the second component and the left and right identifiers of the second component, the left and right identifiers are used to indicate whether it is on the left or right side of the wearer when worn, and the left and right identifiers of the first component are different from the left and right identifiers of the second component.

[0083] In this example, after binding with the control terminal, the first terminal can receive other wearable device information sent by the control terminal. It should be noted that since the wearable device information received by the first terminal is equivalent to the first terminal performing a subsequent verification process based on the wearable device information. Therefore, the wearable device information needs to be trustworthy information. Under this premise, the embodiment of the present application sets the wearable device information to be sent by the bound control terminal, so that the wearable device information can be trusted.

[0084] Step 613: Store the wearable device information in a local file of the first terminal.

[0085] Schematically, a memory is provided in the first terminal. The first terminal can store the received wearable device information in the memory. Logically speaking, the first terminal stores the information in a local file of the first terminal so that the first terminal can quickly read the information.

[0086] Step 614: Receive control voice via the microphone.

[0087] In the embodiment of the present application, the execution process of step 614 is the same as the execution process of step 510 and will not be repeated here.

[0088] Step 620: Obtain the wearing status of the wearable device.

[0089] In this example, the first terminal can obtain the wearing status of the wearable device. Optionally, the first terminal can pre-arrange a communication protocol with the wearable device, with a designated bit as the wearing bit. For example, the wearable device sends an 8-bit message to the first terminal, with the third bit designated as the wearing bit. When the wearing bit is 1, it indicates that the wearable device is in the wearing state. When the wearing bit is 0, it indicates that the wearable device is not in the wearing state.

[0090] Illustratively, the "worn" state indicates that the wearable device is worn on the user. For example, smart glasses are worn on the user's face, TWS headphones are worn in the user's ears, or a smart neck ring is worn around the user's neck. In this state, the first terminal can determine the wearing state of the wearable device, so that the facing direction of the user determined by the wearable device will not cause a misjudgment that the user is not wearing the wearable device.

[0091] Step 631: In response to the wearing state being the wearing state and the control voice meeting the preset conditions, a first angle between the first component and the first terminal is obtained through the positioning component, and a first distance between the first component and the first terminal is obtained.

[0092] The first terminal can obtain the wearing state of the wearable device and information such as the first angle and the first distance in the same message. Alternatively, the first terminal obtains the wearing state of the wearable device in one message and obtains the wearing state of the wearable device in another message.

[0093] In this example, when the control voice meets the preset conditions, the first terminal uses the positioning component to obtain the first angle between the first component and the first component. It should be noted that the positioning component itself can have the ability to determine angles, such as a UWB component. At the same time, the first terminal can also use the positioning component to determine the straight-line distance between the first component and the first terminal.

[0094] Optionally, the positioning component may be a UWB component, that is, a positioning component designed based on UWB technology.

[0095] Step 632: In response to the control voice meeting the preset condition, a second angle between the second component and the first terminal is obtained through the positioning component, and a second distance between the second component and the first terminal is obtained.

[0096] In this example, when the control voice meets the preset conditions, the first terminal can also obtain the second angle between the second component and the first terminal through the positioning component, and simultaneously obtain the second distance between the second component and the first terminal.

[0097] Optionally, the positioning component may be a UWB component, that is, a positioning component designed based on UWB technology.

[0098] It should be noted that since the second component and the first component are two independent components, the order in which steps 631 and 632 are executed is not mutually exclusive. The first terminal may execute step 631 first and then step 632. Alternatively, the first terminal may execute step 632 first and then step 631. Alternatively, the first terminal may execute steps 631 and 632 simultaneously.

[0099] Step 633 : In response to the difference between the first distance and the second distance being less than a preset threshold, determine the positional relationship between the projections of the first component and the second component on the horizontal plane with the first terminal as a reference point based on the first angle and the second angle.

[0100] In this example, a preset threshold value may be pre-set in the first terminal. For example, the first terminal sets the preset threshold value to 2 centimeters. When the difference between the first distance and the second distance is less than 2 centimeters, the terminal may use the first terminal as a reference point and the first angle and the second angle to determine the projection position relationship of the first component and the second component on the horizontal plane.

[0101] Optionally, the value of the preset threshold value can be any preset value. For example, the preset threshold value can be a value such as 0.5 cm, 1 cm, 2 cm or 3 cm.

[0102] Step 634 , in response to the first terminal being a reference point, the first component is in a clockwise direction relative to the second component, and it is determined that the first relative orientation relationship is a facing relationship.

[0103] Please refer to Figure 7 , Figure 7 is based on Figure 6 The embodiment shown provides a schematic diagram of a projection position relationship. Figure 7 In , the coordinate system is set with the location of the first terminal 700 as the coordinate origin. Figure 7, the first angle is the angle between the line connecting the first component 710 and the first terminal and the positive x-axis of the coordinate system. Similarly, the second angle is the angle between the line connecting the second component 720 and the first terminal and the positive x-axis of the coordinate system. It should be noted that in the embodiment of the present application, the first angle and the second angle can both be inferior angles, that is, the angle range is (0°, 180°). Figure 7 The perspective provided is that of looking down onto a horizontal plane.

[0104] exist Figure 7 In FIG, since the first component 710 is located clockwise relative to the second component 720, the first terminal determines that the orientation relationship between the first component and the front of the wearable device is a facing relationship. It should be noted that, with the first terminal as the vertex, the angle between the first component and the second component is a minor angle.

[0105] Step 641: Receive a second relative orientation parameter of a second terminal via a preset network, where the preset network is a local area network or the Internet.

[0106] Among them, the second relative orientation parameter includes a third distance, a third angle, a fourth distance and a fourth angle. The third distance is the distance between the first component and the second terminal, the third angle is the angle between the first component and the second terminal, the fourth distance is the distance between the second component and the second terminal, and the fourth angle is the angle between the second component and the second terminal.

[0107] It should be noted that the preset network may be a local area network in the home where the first terminal is located. For example, the preset network may be a Wi-Fi local area network provided by a network access point (AP) in the home.

[0108] In another possible implementation, the preset network may also be a network formed by the first terminal and other terminals via a remote network. For example, the preset network may be a 4G network or a 5G network.

[0109] In one possible implementation, the number of second terminals is one. In another possible implementation, the number of second terminals may be multiple. In the network, the first terminal may be a master device, and the relative orientation of all terminals of the mobile phone is output. Optionally, when the network includes an AP, the master device of the network may also be an AP. In short, the master device can determine which terminal is both facing the wearable device and the terminal closest to the wearable device through the second relative orientation parameter and the first relative orientation parameter used to calculate the first relative orientation relationship.

[0110] In one possible implementation scenario, the master device prioritizes the terminal facing the wearable device from among the multiple terminals based on their orientation. If only one of the multiple terminals faces the wearable device, the master device directly determines that terminal as the terminal that responds to the control voice.

[0111] In another possible implementation scenario, if the main device simultaneously determines that at least two terminals are in a face-to-face relationship with the wearable device, the main device will further determine the distances between the multiple terminals and the wearable device, and finally determine one terminal as the terminal that responds to the control voice.

[0112] Step 642: Detect whether the second relative orientation relationship is a facing relationship according to the second relative orientation parameter.

[0113] In this example, the first terminal can detect whether the second relative orientation relationship is a face-to-face relationship based on the second relative orientation parameter. In another possible manner, the first terminal and a master device in a network composed of multiple terminals determine whether the second relative orientation relationship is a face-to-face relationship.

[0114] Step 643: In response to the second relative orientation relationship not being a facing relationship and the first relative orientation relationship being a facing relationship, executing an operation corresponding to the control voice.

[0115] In this example, the first terminal is determined to be the only terminal whose relative orientation relationship with the wearable device is a facing relationship. Therefore, the operation corresponding to the control voice is performed by the first terminal.

[0116] Step 651: In response to the second relative orientation relationship being a facing relationship and the first relative orientation relationship being a facing relationship, obtain a magnitude relationship between the first average distance and the second average distance.

[0117] The first average distance is the average of the first distance and the second distance, and the second average distance is the average of the third distance and the fourth distance.

[0118] Step 652: In response to the first average distance being smaller than the second average distance, executing an operation corresponding to the control voice.

[0119] See Figure 8 , Figure 8 is based on Figure 6 The embodiment shown provides an example schematic diagram of a response control voice. Figure 8 In the embodiment, the wearable device includes a first component 811 and a second component 812. Three terminals are distributed around the wearable device. The three terminals are a first terminal 820, a first second terminal 830, and a second second terminal 840.

[0120] The first terminal 820 can determine, through a built-in UWB component, that the first relative orientation relationship is a face-to-face relationship. The first terminal 820 determines that the first second terminal 830 and the wearable device are not in a face-to-face relationship, but in a side-to-side relationship. The first terminal 820 determines that the second second terminal 840 and the wearable device are not in a face-to-face relationship, but in a back-to-back relationship.

[0121] See Figure 9 , Figure 9 is based on Figure 6 The embodiment shown provides another example schematic diagram of responding to control speech. Figure 9 In the embodiment, the wearable device includes a first component 811 and a second component 812. Three terminals are distributed around the wearable device. The three terminals are a first terminal 820, a first second terminal 830, and a second second terminal 840.

[0122] Among them, the first terminal 820 can determine that the first relative orientation relationship is a face-to-face relationship through the built-in UWB component. At the same time, after receiving the second relative orientation parameter between the first second terminal 830 and the wearable device, it can also determine that the first second terminal 830 and the wearable device are also in a face-to-face relationship according to the second relative orientation parameter.

[0123] In this scenario, the first terminal 820 will further determine which terminal, among all terminals that are in a facing relationship, has the shortest distance to the wearable device. It should be noted that, since in the embodiment of the present application, the wearable device includes a first component and a second component, the distance between the wearable device and the terminal can be the average of the distance between the first component and the terminal and the distance between the second component and the terminal.

[0124] For example, in Figure 9 In the example, the distance between the first terminal and the first component of the wearable device is 2.35 meters, and the distance between the first terminal and the second component of the wearable device is 2.38 meters. Therefore, the distance between the first terminal and the wearable device is determined to be 2.365 meters. At the same time, the distance between the second terminal and the first component of the wearable device is 3.6 meters, and the distance between the second terminal and the first component of the wearable device is 3.62 meters. Therefore, the distance between the second terminal and the wearable device is determined to be 3.61 meters. Because the first terminal is closer to the wearable device than the second terminal, the first terminal determines itself as the device that responds to the control voice.

[0125] Step 660: In response to the control voice being used to wake up the first terminal, wake up the first terminal.

[0126] After determining the device that responded to the control voice, the first terminal can perform different operations based on the actual situation of the control voice. When the control voice is used to wake up the first terminal, the first terminal wakes up. For example, if the control voice contains a wake-up word, the first terminal recognizes that the control voice is used to wake up the first terminal.

[0127] Therefore, when the first terminal determines that it is a terminal that responds to the control voice, the first terminal will directly enter the awake state. Optionally, when the first terminal enters the awake state, the first terminal can play a prompt voice such as "I am here, how can I help you?".

[0128] Step 671: In response to the control voice being an inquiry voice, obtain a reply text corresponding to the inquiry voice.

[0129] In this example, when the control voice is an inquiry voice, the first terminal will obtain the reply text corresponding to the inquiry voice. In this scenario, the first terminal will also have a speech synthesis capability.

[0130] Step 672: perform speech synthesis on the reply text to obtain a reply speech.

[0131] Accordingly, the first terminal performs speech synthesis based on the reply text to obtain a reply voice. In this example, this operation can be performed locally by the first terminal. Alternatively, in another possible implementation, the reply voice is synthesized in the cloud, and the first terminal directly receives the reply voice from the cloud.

[0132] Step 673: Play the reply voice through the speaker.

[0133] Illustratively, when the first terminal obtains the reply voice, the first terminal will directly play the reply voice through the speaker. Optionally, the first terminal can play the reply voice according to one or more preset settings of voice, tone and volume.

[0134] Step 681 : In response to the control voice being used to indicate an actual preset operation, an operation instruction corresponding to the control voice is obtained.

[0135] The operation instruction is used to instruct the corresponding third terminal to perform a preset operation.

[0136] Optionally, when the control voice is used to instruct the device to perform a specific preset operation, the first device will first obtain an instruction corresponding to the control voice.

[0137] It should be noted that the commands corresponding to the control voice are divided into local commands and external commands according to the specific device that executes the commands. Among them, the local commands are executed by the first terminal, and the external commands are executed by a designated terminal other than the first terminal.

[0138] Step 682: According to the operation instruction, control the third terminal to perform the corresponding preset operation.

[0139] In this example, when the operation instruction is an external machine instruction, the first terminal sends the operation instruction to the third terminal, thereby controlling the third terminal to perform a corresponding preset operation.

[0140] In this scenario, the first terminal may be a Bluetooth speaker, and the third terminal may be an air conditioner, a TV, a water heater, an air purifier, a sweeping robot, a smart lamp, or a smart dishwasher.

[0141] Step 683: Execute the preset operation according to the operation instruction.

[0142] In this scenario, the first terminal itself is a device that can perform specific operations. For example, the first terminal can be an air conditioner, a television, a water heater, an air purifier, a sweeping robot, a smart lamp, or a smart dishwasher.

[0143] To sum up, the method provided in this embodiment can indirectly determine the orientation relationship between the user and the first terminal based on the orientation relationship between the wearable device and the first terminal. When it is determined that the wearable device is in a worn state, the orientation relationship is further determined based on the distance and angle between the first component and the second component in the wearable device and the first terminal respectively. When the first terminal and the user are face to face, the first terminal is enabled to respond to the control voice, thereby achieving the effect that the user can control the device he is facing from multiple terminals that can respond to voice when wearing the wearable device.

[0144] The method for responding to control voice provided in this embodiment can also quickly obtain the distance and angle between the wearable device and the first terminal through ultra-wideband UWB technology, thereby improving the accuracy of the first terminal in determining the orientation relationship between the wearable device and the wearable device.

[0145] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0146] Please refer to Figure 10 , Figure 10 This is a block diagram of a device for responding to control voice, provided by an exemplary embodiment of the present application. The device for responding to control voice can be implemented as all or part of a terminal through software, hardware, or a combination of both. The device includes:

[0147] The voice receiving module 1010 is used to receive the control voice through the microphone;

[0148] a relationship acquisition module 1020 for acquiring, in response to the control voice meeting a preset condition, a first relative orientation relationship between the front face of the user and the first terminal through a positioning component, wherein the user is wearing a wearable device;

[0149] The operation execution module 1030 is configured to execute the operation corresponding to the control voice in response to the first relative orientation relationship being a facing relationship, where the facing relationship indicates that the front side of the wearable device faces the first terminal.

[0150] In an optional embodiment, the wearable device involved in the apparatus includes a first component and a second component. When the wearable device is worn, the first component is located on the left side of the user and the second component is located on the right side of the user. The relationship acquisition module 1020 is used to obtain a first angle between the first component and the first terminal through a positioning component, and obtain a first distance between the first component and the first terminal; obtain a second angle between the second component and the first terminal through a positioning component, and obtain a second distance between the second component and the first terminal; in response to the difference between the first distance and the second distance being less than the preset threshold, determine the positional relationship between the projections of the first component and the second component on the horizontal plane with the first terminal as the reference point based on the first angle and the second angle; in response to the first terminal being the reference point, the first component is in the clockwise direction of the second component, and determine that the first relative orientation relationship is the facing relationship.

[0151] In an optional embodiment, the relationship acquisition module 1020 is used to obtain the wearing state of the wearable device; in response to the wearing state being the wearing state, obtain the first angle between the first component and the first terminal, and obtain the first distance between the first component and the first terminal.

[0152] In an optional embodiment, the operation execution module 1030 is configured to receive a second relative orientation parameter of the second terminal via a preset network, the preset network being a local area network or the Internet, the second relative orientation parameter including a third distance, a third angle, a fourth distance, and a fourth angle, the third distance being the distance between the first component and the second terminal, the third angle being the angle between the first component and the second terminal, the fourth distance being the distance between the second component and the second terminal, and the fourth angle being the angle between the second component and the second terminal; detecting whether the second relative orientation relationship is the facing relationship based on the second relative orientation parameter; and executing the operation corresponding to the control voice in response to the second relative orientation relationship not being the facing relationship and the first relative orientation relationship being the facing relationship. Alternatively, the operation execution module 1030 is configured to obtain a magnitude relationship between a first average distance and a second average distance in response to the second relative orientation relationship being the facing relationship and the first relative orientation relationship being the facing relationship, the first average distance being the average of the first distance and the second distance, and the second average distance being the average of the third distance and the fourth distance; and executing the operation corresponding to the control voice in response to the first average distance being less than the second average distance.

[0153] In an optional embodiment, the apparatus further includes a binding module for establishing a binding relationship with a control terminal in response to a first binding instruction; receiving wearable device information sent by the control terminal, the wearable device information including first component information and second component information, the first component information including a component identifier of the first component and left and right identifiers of the first component, the second component information including a component identifier of the second component and left and right identifiers of the second component, the left and right identifiers being used to indicate whether the wearer is on the left or right side when worn, the left and right identifiers of the first component and the left and right identifiers of the second component being different; and storing the wearable device information in a local file of the first terminal.

[0154] In an optional embodiment, the operation execution module 1030 is configured to wake up the first terminal in response to the control voice being used to wake up the first terminal. Alternatively, the operation execution module 1030 is configured to obtain a reply text corresponding to the query voice in response to the control voice being an inquiry voice; perform speech synthesis on the reply text to obtain a reply voice; and play the reply voice through a speaker. Alternatively, the operation execution module 1030 is configured to obtain an operation instruction corresponding to the control voice in response to the control voice being used to indicate an actual preset operation, the operation instruction being used to instruct a corresponding third terminal to perform the preset operation; and control the third terminal to perform the corresponding preset operation according to the operation instruction.

[0155] In an optional embodiment, the operation execution module 1030 is configured to obtain a first angle between the first component and the first terminal and a first distance between the first component and the first terminal using ultra-wideband (UWB) technology. Furthermore, the operation execution module 1030 is configured to obtain a second angle between the second component and the first terminal and a second distance between the second component and the first terminal using ultra-wideband (UWB) technology.

[0156] In summary, the device for responding to control voice provided in the embodiments of the present application can receive control voice via a microphone and, when the control voice meets preset conditions, determine a first relative orientation relationship between the front of the wearable device and the first terminal through a positioning component. When the orientation relationship indicates that the front of the wearable device is facing the first terminal, the first terminal will execute the operation corresponding to the control voice. It can be seen that the present application enables the first terminal to determine the user's orientation based on the facing direction of the wearable device, thereby determining whether the user is facing itself, thereby enhancing the ability to intelligently respond to control voice.

[0157] An embodiment of the present application further provides a computer-readable medium storing at least one instruction, wherein the at least one instruction is loaded and executed by a processor to implement the method of responding to control voice as described in the above embodiments.

[0158] It should be noted that the above embodiments of the apparatus for responding to voice control, when performing the method for responding to voice control, only illustrate the division of the above-mentioned functional modules. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus for responding to voice control provided in the above embodiments and the method for responding to voice control provided in the above embodiments are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0159] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0160] Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

[0161] The above description is merely an exemplary embodiment that can be implemented in the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A method for responding to control speech, characterized in that: Applied in a first terminal, the method includes: Receive control voice through microphone; In response to the control voice meeting a preset condition, obtaining, by a positioning component, a first relative orientation relationship between a front face of a user and the first terminal, wherein the user is wearing a wearable device, the wearable device comprising a first component and a second component, and when the wearable device is worn, the first component is located on a left side of the user, and the second component is located on a right side of the user; In response to the first relative orientation relationship being a facing relationship, executing the operation corresponding to the control voice, wherein the facing relationship is used to indicate that the front of the user is facing the first terminal; The acquiring, by the positioning component, a first relative orientation relationship between the front face of the user and the first terminal includes: A first angle between the first component and the first terminal is obtained through the positioning component, and a first distance between the first component and the first terminal is obtained; a second angle between the second component and the first terminal is obtained through the positioning component, and a second distance between the second component and the first terminal is obtained; in response to a difference between the first distance and the second distance being less than a preset threshold, a positional relationship between the projections of the first component and the second component on a horizontal plane with the first terminal as a reference point is determined based on the first angle and the second angle; in response to the first terminal being a reference point, the first component is in a clockwise direction of the second component, and the first relative orientation relationship is determined to be the facing relationship.

2. The method according to claim 1, characterized in that Before acquiring the first angle between the first component and the first terminal, and acquiring the first distance between the first component and the first terminal, the method further includes: Obtaining the wearing status of the wearable device; In response to the wearing state being the wearing state, the steps of obtaining a first angle between the first component and the first terminal and obtaining a first distance between the first component and the first terminal are performed.

3. The method according to claim 1, characterized in that In response to the first relative orientation relationship being a facing relationship, executing the operation corresponding to the control voice includes: receiving, via a preset network, a second relative orientation parameter of a second terminal, where the preset network is a local area network or the Internet, the second relative orientation parameter including a third distance, a third angle, a fourth distance, and a fourth angle, the third distance being the distance between the first component and the second terminal, the third angle being the angle between the first component and the second terminal, the fourth distance being the distance between the second component and the second terminal, and the fourth angle being the angle between the second component and the second terminal; detecting, according to the second relative orientation parameter, whether the second relative orientation relationship is the facing relationship; In response to the second relative orientation relationship not being the facing relationship and the first relative orientation relationship being the facing relationship, executing the operation corresponding to the control voice; or, In response to the second relative orientation relationship being the facing relationship and the first relative orientation relationship being the facing relationship, obtaining a magnitude relationship between a first average distance and a second average distance, wherein the first average distance is an average of the first distance and the second distance, and the second average distance is an average of the third distance and the fourth distance; In response to the first average distance being smaller than the second average distance, performing the operation corresponding to the control voice.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: In response to the first binding instruction, establishing a binding relationship with the control terminal; Receiving wearable device information sent by the control terminal, the wearable device information including first component information and second component information, the first component information including a component identifier of the first component and left and right identifiers of the first component, the second component information including a component identifier of the second component and left and right identifiers of the second component, the left and right identifiers being used to indicate whether the wearer is on the left or right side of the wearer when worn, the left and right identifiers of the first component and the left and right identifiers of the second component being different; The wearable device information is stored in a local file of the first terminal.

5. The method according to any one of claims 1 to 3, characterized in that: The executing the operation corresponding to the control voice includes: In response to the control voice being used to wake up the first terminal, waking up the first terminal; or, In response to the control voice being an inquiry voice, obtaining a reply text corresponding to the inquiry voice; Performing speech synthesis on the reply text to obtain a reply speech; Playing the reply voice through the speaker; or, In response to the control voice being used to instruct an actual preset operation, obtaining an operation instruction corresponding to the control voice, where the operation instruction is used to instruct a corresponding third terminal to perform the preset operation; According to the operation instruction, the third terminal is controlled to execute the corresponding preset operation.

6. The method according to any one of claims 1 to 3, characterized in that: The acquiring a first angle between the first component and the first terminal, and acquiring a first distance between the first component and the first terminal, includes: Acquire a first angle between the first component and the first terminal, and acquire a first distance between the first component and the first terminal by using ultra-wideband (UWB) technology; The acquiring a second angle between the second component and the first terminal, and acquiring a second distance between the second component and the first terminal, includes: A second angle between the second component and the first terminal is obtained through ultra-wideband UWB technology, and a second distance between the second component and the first terminal is obtained.

7. A device for responding to control voice, characterized in that: Applied in a first terminal, the device includes: A voice receiving module is used to receive control voice through a microphone; a relationship acquisition module, configured to acquire, in response to the control voice meeting a preset condition, a first relative orientation relationship between the front face of a user and the first terminal via a positioning component, wherein the user is wearing a wearable device, the wearable device comprising a first component and a second component, and when the wearable device is worn, the first component is located on the left side of the user and the second component is located on the right side of the user; an operation execution module, configured to execute the operation corresponding to the control voice in response to the first relative orientation relationship being a facing relationship, wherein the facing relationship is used to indicate that the front of the user is facing the first terminal; The relationship acquisition module is configured to acquire a first relative orientation relationship between the front face of the user and the first terminal through a positioning component, including: The relationship acquisition module is used to obtain a first angle between the first component and the first terminal and a first distance between the first component and the first terminal through the positioning component; obtain a second angle between the second component and the first terminal and a second distance between the second component and the first terminal through the positioning component; in response to a difference between the first distance and the second distance being less than a preset threshold, determine, based on the first angle and the second angle, a positional relationship between the projections of the first component and the second component on a horizontal plane with the first terminal as a reference point; and in response to the first terminal being a reference point, determine that the first relative orientation relationship is the facing relationship in a clockwise direction of the first component relative to the second component.

8. A terminal, characterized in that: The terminal includes a processor, a memory connected to the processor, and program instructions stored in the memory. When the processor executes the program instructions, the method for responding to control voice according to any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium storing program instructions, characterized in that: When the program instructions are executed by a processor, the method for responding to control voice according to any one of claims 1 to 6 is implemented.

Images