Interaction method, terminal device, and storage medium
By connecting terminal devices and wearable devices and using motion teaching modes, the system monitors and corrects the motion parameters of user input operations, solving the problem of inaccurate user motion control and improving the accuracy and efficiency of interaction.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2025-12-09
- Publication Date
- 2026-06-18
AI Technical Summary
In existing methods of interaction between wearable devices and terminal devices, the accuracy and efficiency of user action control are relatively low. In particular, when the action parameters do not meet the preset requirements, users cannot quickly identify and correct errors.
By establishing a communication connection between the terminal device and the wearable device, the system monitors the action parameters of the user's input operation and provides prompts when the preset requirements are not met, guiding the user to adjust the action parameters and enter the action teaching mode to correct the error.
It improves the accuracy and efficiency of users controlling wearable devices through motion, ensuring that users can quickly and accurately adjust motion parameters to meet preset requirements.
Smart Images

Figure CN2025141011_18062026_PF_FP_ABST
Abstract
Description
An interaction method, a terminal device, and a storage medium
[0001] This application claims priority to Chinese Patent Application No. 202411818220.5, filed on December 10, 2024, entitled "An Interactive Method and Electronic Device", and to Chinese Patent Application No. 202510180415.X, filed on February 18, 2025, entitled "An Interactive Method, Terminal Device and Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of terminal technology, and in particular to an interaction method, terminal device and storage medium. Background Technology
[0003] Wearable devices (such as headphones) are accessories for mobile phones, computers, and other terminal devices. Users can wear headphones and control the interaction between the headphones and the terminal device through actions (such as head movements or hand movements). For example, a user can control the terminal device to pause music playback by performing a preset hand action (pressing) at a preset position on the headphones (such as the earpiece). If the hand action position and / or the type of hand action is incorrect, the terminal device will not be able to pause music playback. How to improve the accuracy of user interaction between headphones and terminal devices through actions requires further research. Summary of the Invention
[0004] This application provides an interaction method, a terminal device, and a storage medium. Wearable devices or terminal devices can monitor which action parameters of a user's input operation on the wearable device do not meet preset requirements, and correct the action parameters that do not meet the preset requirements, thereby improving the interaction efficiency between the user and the wearable device.
[0005] In a first aspect, this application provides an interaction method applied to an interaction system, characterized in that the interaction system includes a wearable device and a terminal device, and the wearable device and the terminal device establish a communication connection; the method includes: the terminal device sending a first message to the wearable device; after receiving the first message, the wearable device receiving a first operation input by a user, the first operation including one or more action parameters, the one or more action parameters of the first operation including the first action parameter; if the first action parameter of the first operation does not meet a first requirement, the terminal device outputs a first prompt, the first prompt being used to instruct the user to adjust the first action parameter of the second operation when inputting a second operation, the type of the second operation being the same as the type of the first operation.
[0006] Optionally, the wearable device may confirm that the first action parameter of the first operation does not meet the first requirement, or the terminal device may confirm that the first action parameter of the first operation does not meet the first requirement.
[0007] The first operation includes multiple action parameters, which may refer to the first operation including at least two action parameters.
[0008] When the first operation involves multiple action parameters, if the terminal device does not indicate which action parameter in the first operation is erroneous, the user will also be unable to determine which action parameter is incorrect. The user would then need to adjust the action parameters in their input operations to the wearable device sequentially. This method allows the terminal device to indicate which action parameter in the first operation is erroneous, enabling the user to identify the erroneous parameter and adjust it when performing a second operation on the wearable device. This allows the user to quickly and accurately adjust the action parameters in the second operation.
[0009] This method allows wearable devices or terminal devices to monitor which action parameters of the user's input operation on the wearable device do not meet the preset requirements, and to correct the action parameters that do not meet the preset requirements. This can more accurately guide the user to adjust the input operation on the wearable device, improve the accuracy of the user's control of the wearable device through actions, and also improve the interaction efficiency between the user and the wearable device.
[0010] In conjunction with the first aspect, in one possible implementation, the method further includes: if the first action parameter of the first operation does not meet the first requirement, the terminal device also outputs a first reason why the first action parameter of the first operation does not meet the first requirement.
[0011] In this way, the terminal device can also prompt the user about the reason for the error in the first action parameter during the first operation, so that the user can know why the operation is not up to standard.
[0012] In conjunction with the first aspect, in one possible implementation, after the wearable device receives the first message, the method further includes: the wearable device collecting first sensor data, the first sensor data being used to indicate one or more action parameters of the first operation; if the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: if it is confirmed based on the first sensor data that the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt.
[0013] In one possible implementation, the first sensor data is data collected by the wearable device during the process of receiving a first user operation.
[0014] Optionally, the first sensor data may include, but is not limited to, any one or more of the following: acceleration data, angular velocity data, etc.
[0015] In this way, the terminal device or wearable device can confirm, based on sensor data, whether one or more action parameters in the user's input operation on the wearable device meet the preset requirements.
[0016] In conjunction with the first aspect, in one possible implementation, after the terminal device outputs the first prompt, the method further includes: the wearable device receiving a second operation input by the user and acquiring second sensor data, the second sensor data being used to indicate one or more action parameters of the second operation, the one or more action parameters of the second operation including the first action parameter; if it is confirmed based on the second sensor data that the first action parameter of the second operation meets the first requirement, the terminal device outputs a second prompt, the second prompt being used to indicate that the first action parameter of the second operation is correct.
[0017] In this way, when the first operation includes multiple action parameters, the terminal device or wearable device can sequentially confirm whether each of the multiple action parameters of the user's input operation to the wearable device meets the preset requirements. For example, after confirming that the first action parameter of the user's input operation to the wearable device meets the first requirement, the terminal device or wearable device can then confirm whether the second action parameter of the user's input operation to the wearable device meets the second requirement. And if the terminal device or wearable device confirms that the first action parameter meets the first requirement, the terminal device outputs a second prompt.
[0018] In conjunction with the first aspect, in one possible implementation, after the terminal device outputs the second prompt, the method further includes: the wearable device receiving a third operation input by the user and acquiring third sensor data, the third sensor data being used to indicate one or more action parameters of the third operation, the one or more action parameters of the third operation including the second action parameter, the type of the third operation being the same as the type of the first operation; if it is confirmed based on the third sensor data that the second action parameter of the third operation does not meet the second requirement, the terminal device outputs a third prompt, the third prompt being used to instruct the user to adjust the second action parameter of the fourth operation when inputting the fourth operation, the type of the fourth operation being the same as the type of the first operation.
[0019] Thus, when the first operation includes multiple action parameters, the terminal device or wearable device can, after confirming that the first action parameter of the user's input operation to the wearable device meets the first requirement, then confirm whether the second action parameter of the user's input operation to the wearable device meets the second requirement. If it is confirmed that the second action parameter in the third operation does not meet the second requirement, a third prompt is output, which prompts the user to adjust the second action parameter in the input operation to the wearable device.
[0020] In conjunction with the first aspect, in one possible implementation, after the terminal device outputs the second prompt, the method further includes: the wearable device receiving a fourth operation input by the user and acquiring fourth sensor data, the fourth sensor data being used to indicate one or more action parameters of the fourth operation, the one or more action parameters of the fourth operation including the second action parameter; if it is confirmed based on the fourth sensor data that the second action parameter of the fourth operation meets the second requirement, the terminal device outputs a fourth prompt, the fourth prompt being used to indicate that the second action parameter of the fourth operation is correct.
[0021] Thus, when the first operation includes multiple action parameters, the terminal device or wearable device can, after confirming that the first action parameter of the user's input operation to the wearable device meets the first requirement, then confirm whether the second action parameter of the user's input operation to the wearable device meets the second requirement. And if it is confirmed that the second action parameter meets the second requirement, a fourth prompt is output.
[0022] In conjunction with the first aspect, in one possible implementation, one or more action parameters of the first operation further include a second action parameter; the method further includes: if it is confirmed that the first action parameter of the first operation meets the first requirement and the second action parameter of the first operation meets the second requirement, the terminal device outputs a fifth prompt, the fifth prompt being used to indicate that the first operation is correct.
[0023] In this way, when the first operation involves multiple action parameters, the terminal device or wearable device can monitor whether multiple action parameters meet preset requirements in a single operation. And when the terminal device or wearable device confirms that all multiple action parameters meet the preset requirements, the terminal device outputs a fifth prompt.
[0024] In conjunction with the first aspect, in one possible implementation, one or more action parameters of the first operation further include a second action parameter; the method further includes: if it is confirmed that the first action parameter of the first operation meets the first requirement, and the second action parameter of the first operation does not meet the second requirement, the terminal device outputs a sixth prompt, the sixth prompt being used to instruct the user to adjust the second action parameter of the sixth operation when inputting the sixth operation, the type of the sixth operation being the same as the type of the first operation.
[0025] In this way, when the first operation includes multiple action parameters, the terminal device or wearable device can monitor whether the multiple action parameters meet the preset requirements in one operation, and when the terminal device or wearable device confirms that the second action parameter among the multiple action parameters does not meet the second requirement, the terminal device outputs a sixth prompt.
[0026] In conjunction with the first aspect, in one possible implementation, the wearable device receives a first message sent by the terminal device, specifically including: the terminal device receiving a fifth operation input by the user, and in response to the fifth operation, the wearable device receiving the first message sent by the terminal device.
[0027] In this way, the terminal device can send the first message to the wearable device after receiving the fifth operation input by the user.
[0028] In conjunction with the first aspect, in one possible implementation, after the terminal device receives the fifth operation input by the user, the method further includes: the terminal device entering a first action teaching mode, wherein the first requirement is obtained by the terminal device based on the first action teaching mode; after the wearable device obtains the first sensor data, the method further includes: the wearable device sending the first sensor data to the terminal device; if the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: if the terminal device confirms based on the first sensor data that the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt.
[0029] In this way, the terminal device can confirm that the first action parameter in the first operation does not meet the first requirement based on the first sensor data collected by the wearable device.
[0030] In conjunction with the first aspect, in one possible implementation, after the wearable device receives the first message, the method further includes: the wearable device entering a first action teaching mode, wherein the first requirement is obtained by the wearable device based on the first action teaching mode; if the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: if the wearable device confirms based on the first sensor data that the first action parameter of the first operation does not meet the first requirement, the wearable device sends a second message to the terminal device; in response to the second message, the terminal device outputs the first prompt.
[0031] In this way, the wearable device can confirm, based on the first sensor data collected by the wearable device, that the first action parameter in the first operation does not meet the first requirement. Upon confirming that the first action parameter in the first operation does not meet the first requirement, it sends a second message to the terminal device. The second message indicates that the first action parameter in the first operation does not meet the first requirement.
[0032] In conjunction with the first aspect, in one possible implementation, the type of the first operation includes any of the following: nodding operation, shaking operation, and waving operation.
[0033] In conjunction with the first aspect, in one possible implementation, the first action parameter of the first operation includes the movement angle of the first operation, and the second action parameter of the first operation includes the movement speed.
[0034] In conjunction with the first aspect, in one possible implementation, the type of the first operation includes a nodding operation, the first action parameter of the first operation includes a nodding angle, the second action parameter of the first operation includes a nodding speed, the first requirement includes a nodding angle greater than a preset angle, and the second requirement includes a nodding speed greater than a preset speed; or, the type of the first operation includes a head-shaking operation, the first action parameter of the first operation includes a head-shaking angle, the second action parameter of the first operation includes a head-shaking speed, the first requirement includes a head-shaking angle greater than a preset angle, and the second requirement includes a head-shaking speed greater than a preset speed.
[0035] Secondly, this application provides an interaction method, the method comprising: a terminal device sending a first message to a wearable device, the first message being used to instruct the wearable device to receive a first operation input by a user, the first operation including one or more action parameters, the one or more action parameters of the first operation including the first action parameter; if the first action parameter of the first operation does not meet a first requirement, the terminal device outputting a first prompt, the first prompt being used to instruct the user to adjust the first action parameter of the second operation when inputting a second operation, the type of the second operation being the same as the type of the first operation.
[0036] In conjunction with the second aspect, in one possible implementation, the method further includes: if the first action parameter of the first operation does not meet the first requirement, the terminal device also outputs a first reason why the first action parameter of the first operation does not meet the first requirement.
[0037] In conjunction with the second aspect, in one possible implementation, if the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: if it is confirmed based on the first sensor data that the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, wherein the first sensor data is used to indicate one or more action parameters of the first operation, and the first sensor data is collected by the wearable device after receiving the first message;
[0038] In conjunction with the second aspect, in one possible implementation, the first sensor data is data collected by the wearable device during the process of receiving a first user operation.
[0039] In conjunction with the second aspect, in one possible implementation, after the terminal device outputs the first prompt, the method further includes: if the first action parameter of the second operation is confirmed to meet the first requirement based on the second sensor data, the terminal device outputs a second prompt, the second prompt being used to indicate that the first action parameter of the second operation is correct, wherein the second operation is an operation in which the wearable device receives user input after the terminal device outputs the first prompt, the second sensor data being used to indicate one or more action parameters of the second operation, and the one or more action parameters of the second operation including the first action parameter.
[0040] In conjunction with the second aspect, in one possible implementation, after the terminal device outputs the second prompt, the method further includes: if it is confirmed based on the third sensor data that the second action parameter of the third operation does not meet the second requirement, the terminal device outputs a third prompt, the third prompt being used to instruct the user to adjust the second action parameter of the fourth operation when inputting the fourth operation, the type of the fourth operation being the same as the type of the first operation, wherein the third operation is the operation input by the wearable device after the terminal device outputs the second prompt, the third sensor data being used to indicate one or more action parameters of the third operation, the one or more action parameters of the third operation including the second action parameter.
[0041] In conjunction with the second aspect, in one possible implementation, after the terminal device outputs the second prompt, the method further includes: if the second action parameter of the fourth operation is confirmed to meet the second requirement based on the fourth sensor data, the terminal device outputs a fourth prompt, the fourth prompt indicating that the second action parameter of the fourth operation is correct, wherein the fourth operation is the operation in which the wearable device receives user input after the terminal device outputs the second prompt, the fourth sensor data indicating one or more action parameters of the fourth operation, and the one or more action parameters of the fourth operation including the second action parameter.
[0042] In conjunction with the second aspect, in one possible implementation, one or more action parameters of the first operation further include a second action parameter; the method further includes: if it is confirmed that the first action parameter of the first operation meets the first requirement and the second action parameter of the first operation meets the second requirement, the terminal device outputs a fifth prompt, the fifth prompt being used to indicate that the first operation is correct.
[0043] In conjunction with the second aspect, in one possible implementation, one or more action parameters of the first operation further include a second action parameter; the method further includes: if it is confirmed that the first action parameter of the first operation meets the first requirement, and the second action parameter of the first operation does not meet the second requirement, the terminal device outputs a sixth prompt, the sixth prompt being used to instruct the user to adjust the second action parameter of the sixth operation when inputting the sixth operation, the type of the sixth operation being the same as the type of the first operation.
[0044] In conjunction with the second aspect, in one possible implementation, the wearable device receives a first message sent by the terminal device, specifically including: the terminal device receiving a fifth operation input by the user, and in response to the fifth operation, the wearable device receiving the first message sent by the terminal device.
[0045] In conjunction with the second aspect, in one possible implementation, after the terminal device receives the fifth operation input by the user, the method further includes: the terminal device entering a first action teaching mode, wherein the first requirement is obtained by the terminal device based on the first action teaching mode; the terminal device receiving first sensor data sent by the wearable device; if the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: if the terminal device confirms based on the first sensor data that the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt.
[0046] In conjunction with the second aspect, in one possible implementation, if the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: the terminal device receiving a second message sent by the wearable device, the second message being sent after the wearable device confirms based on the first sensor data that the first action parameter of the first operation does not meet the first requirement; in response to the second message, the terminal device outputs a first prompt.
[0047] In conjunction with the second aspect, in one possible implementation, the type of the first operation includes any of the following: nodding operation, shaking operation, and waving operation.
[0048] In conjunction with the second aspect, in one possible implementation, the first action parameter of the first operation includes the movement angle of the first operation, and the second action parameter of the first operation includes the movement speed.
[0049] In conjunction with the second aspect, in one possible implementation, the type of the first operation includes a nodding operation, the first action parameter of the first operation includes a nodding angle, the second action parameter of the first operation includes a nodding speed, the first requirement includes a nodding angle greater than a preset angle, and the second requirement includes a nodding speed greater than a preset speed; or, the type of the first operation includes a head shaking operation, the first action parameter of the first operation includes a head shaking angle, the second action parameter of the first operation includes a head shaking speed, the first requirement includes a head shaking angle greater than a preset angle, and the second requirement includes a head shaking speed greater than a preset speed.
[0050] Thirdly, embodiments of this application provide a terminal device, which includes a processor and a memory, the memory being coupled to the processor, the memory being used to store computer program code, the computer program code including computer instructions, and the processor reading the computer instructions from the memory to cause the terminal device to execute an interaction method provided in any possible implementation of any of the above aspects.
[0051] Fourthly, embodiments of this application provide a wearable device, which includes a processor and a memory coupled to the processor. The memory is used to store computer program code, which includes computer instructions. When the processor reads the computer instructions from the memory, the wearable device executes an interaction method provided in any possible implementation of the first aspect above.
[0052] Fifthly, embodiments of this application provide a computer-readable storage medium including computer instructions that, when executed on a terminal device, cause the terminal device to perform an interaction method provided in any possible implementation of any of the above aspects.
[0053] In a sixth aspect, embodiments of this application provide a computer-readable storage medium including computer instructions that, when executed on a wearable device, cause the wearable device to perform an interaction method provided in any possible implementation of the first aspect described above.
[0054] In a seventh aspect, embodiments of this application provide a computer program product, including computer instructions, which, when executed on a terminal device, cause the terminal device to execute an interaction method provided in any possible implementation of any of the above aspects.
[0055] Eighthly, embodiments of this application provide a computer program product, including computer instructions that, when executed on a wearable device, cause the wearable device to perform an interaction method provided in any possible implementation of the first aspect described above.
[0056] Ninthly, this application provides a chip system including one or more processors, which are used to invoke computer instructions to cause a terminal device to execute an interaction method provided in any possible implementation of any of the above aspects.
[0057] In a tenth aspect, this application provides a chip system including one or more processors, the processors being configured to invoke computer instructions to cause a wearable device to perform an interaction method provided in any possible implementation of the first aspect above.
[0058] For a description of the beneficial effects in aspects two through ten, please refer to the description of the beneficial effects in aspect one; this application will not repeat them here. Attached Figure Description
[0059] Figures 1A and 1B show a set of schematic diagrams of nodding angles;
[0060] Figures 1C-1D show schematic diagrams of another set of nodding angles;
[0061] Figures 2A and 2B show a set of schematic diagrams of head-shaking angles;
[0062] Figures 2C-2D show schematic diagrams of another set of head-shaking angles;
[0063] Figure 3 illustrates the system architecture of a communication system 10 provided in an embodiment of this application;
[0064] Figure 4 shows a schematic diagram of the structure of the terminal device 100;
[0065] Figure 5 shows a schematic diagram of the headphone 200;
[0066] Figure 6 shows a schematic diagram of the software architecture of the terminal device 100;
[0067] Figures 7A-7H show schematic diagrams of the first interactive scenario;
[0068] Figures 8A-8R show schematic diagrams of interactive scenario two;
[0069] Figure 9 shows a schematic diagram of the method flow for an interaction scenario two;
[0070] Figure 10 shows a schematic diagram of the method flow for another interaction scenario two;
[0071] Figures 11A-11J show schematic diagrams of interactive scenario three;
[0072] Figure 12 shows a schematic diagram of the method flow for an interactive scenario three;
[0073] Figure 13 shows a schematic diagram of the method flow for another interaction scenario three;
[0074] Figure 14 shows a flowchart of an interactive method. Detailed Implementation
[0075] The technical solutions in the embodiments of this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the word "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.
[0076] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.
[0077] The term "user interface (UI)" used in the following embodiments of this application refers to the medium interface through which an application or operating system interacts and exchanges information with the user. It realizes the conversion between the internal form of information and the form that the user can accept. The user interface is source code written in a specific computer language such as Java or Extensible Markup Language (XML). The interface source code is parsed and rendered on the electronic device, ultimately presenting content that the user can recognize. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be visible interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets displayed on the screen of an electronic device.
[0078] Wearable devices are accessories for mobile phones, computers, and other terminal devices. Users can wear wearable devices and control the interaction between the wearable device and the terminal device through actions (such as head movements or hand movements).
[0079] Wearable devices can include, but are not limited to, headphones, virtual reality (VR) devices, etc. Headphones can be wireless Bluetooth headphones or neckband headphones, etc.
[0080] The following embodiments of this application use headphones as an example of a wearable device for illustration.
[0081] Users can control the interaction between the headphones and the terminal device through actions (such as head movements or hand movements). For example, a user can perform a preset hand action (such as a press) at a preset position on the headphones (such as the earpiece) to control the terminal device to pause music playback. If the press action is performed in the wrong position, such as a different position than the preset position, and / or the press action is invalid, such as insufficient pressure or insufficient number of presses, or the user inputs a swipe instead of a press, the terminal device will not prompt the user whether the press action is in the wrong position or invalid. The user will not know whether to adjust the position, pressure, number of presses, or action type, and will not be able to quickly and effectively control the terminal device to pause music playback through the headphones.
[0082] Based on the above analysis, this application provides an interaction method. This method is applied to an interaction system including a terminal device and a wearable device. The terminal device and the wearable device establish a communication connection. The terminal device can receive a fifth operation input by the user and enter a first action teaching mode. After receiving the fifth operation input by the user, the terminal device can send a first message to the wearable device. In response to the first message, the wearable device can also enter the first action teaching mode.
[0083] After the wearable device enters the first action teaching mode, it can receive the first operation input by the user and acquire the first sensor data. The first sensor data can be the data acquired by the wearable device during the first operation input by the user.
[0084] Wearable devices or terminal devices can confirm, based on the data from the first sensor, whether one or more action parameters of the first operation meet preset requirements.
[0085] If it is confirmed that one or more action parameters of the first operation do not meet the preset requirements, the terminal device can output a prompt message. This prompt message is used to instruct the user to adjust the input operation for the wearable device so that one or more action parameters of the user's input operation for the wearable device meet the preset requirements.
[0086] Optionally, one or more action parameters of the first operation include, but are not limited to, the first action parameter and the second action parameter. If the first action parameter of the first operation does not meet the first requirement, the terminal device may instruct the user to adjust the first action parameter of the input operation for the wearable device. If the second action parameter of the first operation does not meet the second requirement, the terminal device may instruct the user to adjust the second action parameter of the input operation for the wearable device.
[0087] The first and second requirements can be obtained by wearable devices or terminal devices based on the first action teaching mode. Different action teaching modes correspond to different preset requirements.
[0088] If it is confirmed that one or more action parameters of the first operation meet the preset requirements, the terminal device can also output a prompt message to remind the user that the first operation has been performed correctly.
[0089] This method allows wearable devices or terminal devices to monitor which action parameters of the user's input operation on the wearable device do not meet the preset requirements, and to correct the action parameters that do not meet the preset requirements. This can more accurately guide the user to adjust the input operation on the wearable device, improve the accuracy of the user's control of the wearable device through actions, and also improve the interaction efficiency between the user and the wearable device.
[0090] Optionally, the type of the first operation may include, but is not limited to, head operations, hand operations, etc. Head movements may include, but are not limited to, nodding operations, shaking operations, etc. The first operation may also include other types of movements, which are not limited in this application.
[0091] The following embodiments of this application illustrate the first operation as a nodding operation or a head-shaking operation.
[0092] In some embodiments, the first operation may be a nodding operation, and the wearable device can control the terminal device to answer a call through the user's nodding operation. The first action parameter of the first operation may be the nodding angle, and the second action parameter of the first operation may be the nodding speed. The first requirement of the first action parameter may be that the nodding angle is greater than a preset angle A, and the second requirement of the second action parameter may be that the nodding speed is greater than a preset speed A.
[0093] In one possible implementation, the nodding action can refer to the process of a user's head swinging upwards from its lowest position until it reaches its highest position. The nodding angle can refer to the cumulative angle of the user's head swinging upwards from its lowest position to its highest position. The nodding speed can be obtained based on the nodding angle and the time required for the user's head to swing upwards from its lowest position to its highest position.
[0094] Figures 1A and 1B show a set of schematic diagrams of nodding angles.
[0095] For example, the initial head position can be the position shown by the solid line in Figure 1A(a). The user can swing their head downwards until the user's head reaches the position shown by the dashed line in Figure 1A(a), which can be the lowest point of the head.
[0096] As shown in Figure 1A(b), the angle A of the user swinging their head downwards can be the angle between the initial position of the head and the lowest point of the head.
[0097] The position shown by the solid line in Figure 1B(a) can be the lowest point of the head. After the user's head is at its lowest point, the user can swing their head upwards until the position shown by the dashed line in Figure 1B(a) can be the highest point of the head.
[0098] As shown in Figure 1B(b), the user's nodding angle B can be the angle between the lowest point of the head and the highest point of the head.
[0099] The user's nodding speed can be determined based on the user's nodding angle B and the time required for the user's head to swing from the lowest point to the highest point.
[0100] In other possible implementations, the nodding action can also refer to the process of a user's head swinging downwards from its highest position until it reaches its lowest position. The nodding angle can refer to the cumulative angle of the user's head swinging downwards from its highest position to its lowest position. The nodding speed can be obtained based on the nodding angle and the time required for the user's head to swing downwards from its highest position to its lowest position.
[0101] Figures 1C-1D show schematic diagrams of another set of nodding angles.
[0102] For example, the initial head position can be the position shown by the solid line in Figure 1C(a). The user can swing their head upwards until the user's head reaches the position shown by the dashed line in Figure 1C(a), which can be the highest point of the user's head.
[0103] As shown in Figure 1C(b), the angle C of the user's upward head swing can be the angle between the initial position of the head and the highest point of the head.
[0104] The position shown by the solid line in Figure 1D(a) can be the highest point of the head. After the user's head is at its highest point, the user can swing their head downwards until the position shown by the dashed line in Figure 1D(a) is reached. The position shown by the dashed line in Figure 1D(a) can be the lowest point of the user's head.
[0105] As shown in Figure 1D(b), the user's head nodding angle B can be the angle between the highest point of the user's head and the lowest point of the head.
[0106] The user's nodding speed can be determined based on the user's nodding angle B and the time required for the user's head to swing from the highest point of the head to the lowest point of the head.
[0107] Optionally, the user's nodding angle B and the user's nodding speed can be obtained through a single nodding operation, or through two or more nodding operations.
[0108] In some embodiments, the first action can also be a head-shaking operation, and the wearable device can control the terminal device to reject calls through the user's head-shaking operation. The first action parameter of the first action can be the head-shaking angle, and the second action parameter of the first action can be the head-shaking speed. The first requirement of the first action parameter can be that the head-shaking angle is greater than a preset angle B, and the second requirement of the second action parameter can be that the head-shaking speed is greater than a preset speed B.
[0109] In one possible implementation, head shaking can refer to the process of a user's head swinging from the leftmost position to the right until the user's head is at the rightmost position. The head shaking angle can refer to the cumulative angle of the user's head swinging from the leftmost position to the rightmost position. The head shaking speed can be obtained based on the head shaking angle and the time required for the user's head to swing from the leftmost position to the rightmost position.
[0110] Figures 2A and 2B show a schematic diagram of a set of head-shaking angles.
[0111] For example, the initial head position can be the position shown by the solid line in Figure 2A(a). The user can swing their head to the right until the user's head reaches the position shown by the dashed line in Figure 2A(b), which can be the rightmost position of the head.
[0112] As shown in Figure 2A(c), the angle D of the user's head tilting to the right can be the angle between the initial position of the head and the rightmost position of the head.
[0113] The position shown by the solid line in Figure 2B(a) can be the rightmost position of the head. After the user's head is in the rightmost position, the user can swing their head to the left until the user's head reaches the position shown by the dashed line in Figure 2B(b). The position shown by the dashed line in Figure 2B(b) can be the leftmost position of the head.
[0114] As shown in Figure 2B(c), the user's head shaking angle E can be the angle between the rightmost position of the head and the leftmost position of the head.
[0115] The user's head shaking speed can be obtained based on the user's head shaking angle E and the time required for the user's head to swing from the leftmost position to the rightmost position.
[0116] In one possible implementation, head shaking can refer to the process of a user's head swinging from the rightmost position to the leftmost position until the user's head is at the leftmost position. The head shaking angle can refer to the cumulative angle of the user's head swinging from the rightmost position to the leftmost position. The head shaking speed can be obtained based on the head shaking angle and the time required for the user's head to swing from the rightmost position to the leftmost position.
[0117] Figures 2C-2D show schematic diagrams of another set of head-shaking angles.
[0118] For example, the initial head position can be the position shown by the solid line in Figure 2C(a). The user can swing their head to the left until the user's head reaches the position shown by the dashed line in Figure 2C(b), which can be the leftmost position of the head.
[0119] As shown in Figure 2C(c), the angle F by which the user swings their head to the left can be the angle between the initial position of the head and the leftmost position of the head.
[0120] The position shown by the solid line in Figure 2D(a) can be the leftmost position of the head. After the user's head is in the leftmost position, the user can swing their head to the right until the user's head reaches the position shown by the dashed line in Figure 2D(b). The position shown by the dashed line in Figure 2D(b) can be the rightmost position of the head.
[0121] As shown in (c) of Figure 2D, the user's head shaking angle E can be the angle between the rightmost position of the head and the leftmost position of the head.
[0122] The user's head shaking speed can be obtained based on the user's head shaking angle E and the time required for the user's head to swing from the rightmost position to the leftmost position.
[0123] Optionally, the user's head shaking angle E and the user's head shaking speed can be obtained through one head shaking operation, or through two or more head shaking operations.
[0124] For example, Figure 3 illustrates the system architecture of a communication system 10 provided in an embodiment of this application.
[0125] As shown in Figure 3, the communication system 10 includes a terminal device 100 (e.g., a mobile phone 100) and an earphone 200.
[0126] Terminal device 100 can be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, cellular phone, personal digital assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, artificial intelligence (AI) device, wearable device (e.g., smart bracelet), in-vehicle device, smart home device (e.g., smart TV, smart screen, large screen device, etc.) and / or smart city device. This application embodiment does not impose special limitations on the specific type of terminal device 100.
[0127] The earphone 200 can be a wireless earphone, such as a TWS earphone or a neckband earphone. The earphone 200 can establish a wireless communication connection with the terminal device 100 through near-field communication technology, and then communicate with the terminal device 100 through this wireless communication connection. This application does not specifically limit the aforementioned near-field communication technology. For example, the aforementioned near-field communication technology can be Wireless Fidelity (WiFi) communication technology, Bluetooth communication technology (such as Classic Bluetooth (Basic Rate / Enhanced Data Rate, BR / EDR) or Bluetooth Low Energy (BLE)), Ultra Wide Band (UWB) communication technology, Near Field Communication (NFC) technology, or ZigBee communication technology, etc. The embodiments of this application do not specifically limit this.
[0128] The headset 200 can also be a wired headset. The headset 200 can establish a wired communication connection with the terminal device 100 through the headset jack, and then communicate with the terminal device 100 through the wired communication connection. For example, the headset jack of the terminal device 100 can be a USB interface 130, or a 3.5mm open mobile electronic device platform standard interface, a Cellular Telecommunications Industry Association standard interface, etc.
[0129] In some embodiments, the earphone 200 may include a pair of earpieces (i.e., a left earphone worn on the left ear and a right earphone worn on the right ear). In one possible implementation, when the earphone 200 includes a pair of earpieces, the pair of earpieces may be divided into a main earphone and a secondary earphone. The main earphone can establish a communication connection with the terminal device 100 and communicate directly, while the secondary earphone needs to communicate indirectly with the terminal device 100 through the main earphone. In other possible implementations, when the earphone 200 includes a pair of earpieces, both the left and right earphones can establish a communication connection with the terminal device 100, and the left and right earphones are not distinguished as main and secondary.
[0130] In some embodiments, the earphone 200 may include a single earpiece (i.e., a left earpiece worn on the left ear or a right earpiece worn on the right ear). This single earpiece can establish a communication connection with the terminal device 100 and communicate directly.
[0131] In this embodiment, the terminal device 100 can receive a fifth operation input by the user and enter a first action teaching mode. After receiving the fifth operation input by the user, the terminal device 100 can send a first message to the headset 200, and in response to the first message, the headset 200 can also enter the first action teaching mode.
[0132] After the headset 200 enters the first action teaching mode, the headset 200 can receive the first operation input by the user and acquire the first sensor data. The first sensor data can be the data acquired by the headset 200 during the period of receiving the first operation input by the user.
[0133] The earphone 200 or the terminal device 100 can confirm, based on the data from the first sensor, whether one or more action parameters of the first operation meet the preset requirements.
[0134] If it is confirmed that one or more action parameters of the first operation do not meet the preset requirements, the terminal device 100 can output a prompt message, which is used to instruct the user to adjust the input operation for the headset 200 so that one or more action parameters of the user's input operation for the headset 200 meet the preset requirements.
[0135] Optionally, one or more action parameters of the first operation include a first action parameter and a second action parameter. If the first action parameter of the first operation does not meet a first requirement, the terminal device 100 may instruct the user to adjust the first action parameter of the input operation for the headset 200. If the second action parameter of the first operation does not meet a second requirement, the terminal device 100 may instruct the user to adjust the second action parameter of the input operation for the headset 200.
[0136] The first and second requirements can be derived from the headphones or terminal device based on the first action teaching mode. Different action teaching modes correspond to different requirements.
[0137] If it is confirmed that one or more action parameters of the first operation meet the preset requirements, the terminal device 100 can also output a prompt message to remind the user that the first operation is correct.
[0138] In this way, the terminal device 100 and the headset 200 can jointly monitor whether the user has correctly performed the first operation.
[0139] It should be understood that Figure 3 is only a schematic diagram of the system structure of the communication system provided in the embodiment of this application, and does not constitute a specific limitation on the communication system 10. The communication system 10 may include more or fewer devices than shown in the figure.
[0140] The structure of a terminal device 100 provided in the embodiments of this application is described below.
[0141] Figure 4 shows a schematic diagram of the structure of the terminal device 100.
[0142] Terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0143] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0144] Processor 110 may include one or more processing units, such as application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.
[0145] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.
[0146] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0147] In some embodiments, the processor 110 may include one or more interfaces. These interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. The USB interface 130 is a USB standard-compliant interface, specifically a Mini USB interface, a Micro USB interface, a USB Type-C interface, etc. The USB interface 130 can be used to connect a charger to charge the terminal device 100. In some embodiments, the USB interface 130 can also be used to connect headphones 200 to the terminal device 100 for audio playback.
[0148] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the terminal device 100. While charging the battery 142, the charging management module 140 can also supply power to the terminal device 100 via the power management module 141.
[0149] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.
[0150] The wireless communication function of the terminal device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0151] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.
[0152] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the terminal device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0153] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.
[0154] The wireless communication module 160 can provide solutions for wireless communication applications on the terminal device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, frequency modulate and amplify them, and convert them into electromagnetic waves for radiation via antenna 2. In some embodiments, the terminal device 100 can establish a communication connection with and communicate with the headset 200.
[0155] For example, terminal device 100 can receive a fifth operation and send a first message to headset 200 through the communication connection between the terminal device 100 and headset 200. The first message is used to instruct headset 200 to enter the first action teaching mode.
[0156] In some embodiments, after the headset 200 enters the first action teaching mode, the headset 200 can acquire sensor data of the user's operations on the headset 200 and send the sensor data to the terminal device 100 through a communication connection with the terminal device 100. The sensor data is used by the terminal device 100 to confirm whether one or more action parameters of the user's input operation on the headset 200 meet preset requirements, and if one or more action parameters of the input operation do not meet the preset requirements, prompt the user to adjust the input operation on the headset.
[0157] In other embodiments, after the headset 200 enters the first action teaching mode, the headset 200 can acquire sensor data of the user's operations on the headset 200, and based on the sensor data, confirm whether one or more action parameters of the user's input operation on the headset 200 meet preset requirements. If one or more action parameters of the input operation do not meet the preset requirements, a message is sent to the terminal device 100. In response to the message, the terminal device 100 can prompt the user to adjust the input operation on the headset.
[0158] In some embodiments, antenna 1 of terminal device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling terminal device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0159] Terminal device 100 implements display functions through a GPU, display screen 194, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0160] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a minimized LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include one or N display screens 194, where N is a positive integer greater than 1.
[0161] Terminal device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0162] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise and brightness. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0163] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the terminal device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0164] A digital signal processor (DSP) is used to process digital signals. Besides digital image signals, it can also process other digital signals. For example, when terminal device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0165] Video codecs are used to compress or decompress digital video. Terminal device 100 may support one or more video codecs. Thus, terminal device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.
[0166] NPU stands for Neural Network (NN) Computing Processor. By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in terminal devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0167] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM).
[0168] Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), and double data rate synchronous dynamic random access memory (DDR SDRAM, such as fifth-generation DDR SDRAM, which is generally called DDR5 SDRAM). Non-volatile memory can include disk storage devices and flash memory.
[0169] Flash memory can be classified according to its operating principle, including NOR FLASH, NAND FLASH, 3D NAND FLASH, etc.; according to the level of the storage cell, including single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc.; and according to the storage specification, including universal flash storage (UFS) and embedded multimedia card (eMMC), etc.
[0170] In some embodiments, the internal memory 121 may store requirements corresponding to different action teaching modes. For example, it may include requirements corresponding to the nodding operation teaching mode and the head shaking operation teaching mode. The requirements corresponding to the nodding operation teaching mode may include a nodding angle greater than a preset angle A and a nodding speed greater than a preset speed A. The requirements corresponding to the head shaking operation teaching mode may include a head shaking angle greater than a preset angle B and a head shaking speed greater than a preset speed B.
[0171] The random access memory can be directly read and written by the processor 110. It can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data.
[0172] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110.
[0173] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of the terminal device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, music, video, and other files can be stored in the external non-volatile memory.
[0174] Terminal device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0175] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.
[0176] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The terminal device 100 can listen to music or make hands-free calls through the speaker 170A.
[0177] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the terminal device 100 answers a phone call or voice message, the receiver 170B can be brought close to the listener's ear to hear the voice.
[0178] The microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals.
[0179] The 170D headphone jack is used to connect wired headphones.
[0180] The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals.
[0181] The gyroscope sensor 180B can be used to determine the motion attitude of the terminal device 100. In some embodiments, the angular velocity of the terminal device 100 about three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B.
[0182] The 180C barometric pressure sensor is used to measure barometric pressure.
[0183] The magnetic sensor 180D includes a Hall sensor. The terminal device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover.
[0184] The accelerometer 180E can detect the magnitude of acceleration of the terminal device 100 in various directions (generally three axes).
[0185] Distance sensor 180F is used to measure distance. Terminal device 100 can measure distance via infrared or laser.
[0186] The proximity light sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode.
[0187] The 180L ambient light sensor is used to detect ambient light intensity.
[0188] The fingerprint sensor 180H is used to collect fingerprints.
[0189] The 180J temperature sensor is used to detect temperature.
[0190] The touch sensor 180K, also known as a "touch device," can be placed on the display screen 194. The touch sensor 180K and the display screen 194 together form a touch screen, also known as a "touchscreen." The touch sensor 180K is used to detect touch operations applied to or near it.
[0191] The bone conduction sensor 180M can acquire vibration signals.
[0192] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Terminal device 100 can receive button input and generate key signal inputs related to user settings and function control of terminal device 100.
[0193] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback.
[0194] Indicator 192 can be an indicator light, which can be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0195] The SIM card interface 195 is used to connect the SIM card.
[0196] The structure of an earphone 200 provided in the embodiments of this application is described below.
[0197] Figure 5 shows a schematic diagram of the headphone 200.
[0198] The headset 200 may include a processor 210, a memory 220, a communication module 230, an audio module 240, a speaker 240A, a microphone 240B, a sensor module 250, etc. If the headset 200 is a wireless headset, it may also include a power module 260, a battery 260A, a charging interface 260C, and a power management module 260B.
[0199] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0200] The memory 220 can be used to store program code. In some embodiments, the memory 220 stores requirements corresponding to different action teaching modes. For example, it may include requirements corresponding to a nodding operation teaching mode and a head-shaking operation teaching mode. The requirements corresponding to the nodding operation teaching mode may include a nodding angle greater than a preset angle A and a nodding speed greater than a preset speed A. The requirements corresponding to the head-shaking operation teaching mode may include a head-shaking angle greater than a preset angle B and a head-shaking speed greater than a preset speed B.
[0201] The processor 210 can be used to execute the above-described application code and call relevant modules to implement the functions of the headset 200 in this embodiment. For example, it can enable a virtual or physical connection between the headset 200 and the terminal device 100, receive user operations, acquire sensor data corresponding to the user's input operations, and confirm whether one or more action parameters of the user's input operations on the headset are correct.
[0202] Processor 210 may include one or more processing units, such as digital signal processors (DSPs). Different processing units may be independent devices or integrated into one or more processors 210. Specifically, processor 210 may be an integrated control chip or may consist of circuitry including various active and / or passive components, and the circuitry is configured to perform the functions belonging to processor 210 as described in the embodiments of this application.
[0203] The communication module 230 can be a wired communication module and / or a wireless communication module. The wireless communication module can be used to support data exchange between the headset 200 and other electronic devices or the headset itself, including data exchange via wireless communication technologies such as BT, WLAN (such as WiFi), Zigbee, FM, NFC, IR, or general 2.4G / 5G wireless communication technologies.
[0204] In some embodiments, the wireless communication module can be a Bluetooth chip. The headset 200 can use this Bluetooth chip to pair with and establish a wireless connection with the Bluetooth chips of other electronic devices (e.g., terminal device 100) to achieve wireless communication and business processing with these other electronic devices. This wireless connection can be a physical connection or a virtual connection. Typically, the Bluetooth chip can support basic rate (BR) / enhanced data rate (EDR) Bluetooth and BLE, for example, it can send / receive page messages, send / receive BLE broadcast messages, etc.
[0205] In addition, the wireless communication module may also include an antenna. The wireless communication module receives electromagnetic waves through the antenna, modulates and filters the electromagnetic wave signals, and sends the processed signal to the processor 210. The wireless communication module can also receive signals to be transmitted from the processor 210, modulate and amplify them, and then convert them into electromagnetic waves for radiation through the antenna.
[0206] The audio module 240 can be used to manage audio data, enabling the headset 200 to input and output audio signals, and allowing functions such as making and receiving calls, playing music, and adjusting volume through the headset 200. The audio module 240 may include components such as a speaker 240A (or earpiece, receiver) and a microphone 240B (or microphone, transducer) for outputting audio signals. The speaker 240A can be used to convert audio electrical signals into sound signals and play them. The microphone 240B can be used to convert the acquired sound signals into audio electrical signals.
[0207] The sensor module 250 can detect the necessary information according to different functions of the headphones 200. In some embodiments, the sensor module 250 may include a wear sensor 250A and a motion sensor 205B. The wear sensor 250A can detect whether the user is wearing the headphones. Optionally, the wear sensor 250A may be a proximity sensor, a distance sensor, a temperature sensor, a vibration sensor, etc. The motion sensor 205B may be an accelerometer sensor, a gyroscope sensor, etc.
[0208] When the earphone 200 is a wireless earphone, the power module 260 can provide system power to the wireless earphone, powering each module of the wireless earphone; and support the wireless earphone receiving charging input, etc. The power module 260 may include a battery 260A, a power management unit (PMU) 260B, and a charging interface 260C. The power management unit can receive external charging input; transform the electrical signal input to the charging circuit and provide it to the battery for charging; it can also transform the electrical signal provided by the battery and provide it to other modules such as the wireless communication module, audio module 240, and sensor module 250; and it can prevent the battery from overcharging, over-discharging, short-circuiting, or experiencing overcurrent. In some embodiments, the power module 260 may also include a wireless charging coil for wirelessly charging the wireless earphone. Additionally, the power management module can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). The charging interface 260C can provide a wired connection for charging or communication between the wireless earphone and the earphone case. In some embodiments, this input / output interface can be a USB interface. In other embodiments, the charging interface 260C can be an earphone electrical connector. When the wireless earphones are placed in the earphone case, the wireless earphones can establish an electrical connection with the electrical connector in the earphone case through the earphone electrical connector, thereby charging the battery in the wireless earphones. In other embodiments, after the electrical connection is established, the wireless earphones can also communicate data with the earphone case, for example, they can receive pairing commands from the earphone case.
[0209] The terminal device 100 provided in this application embodiment can run an operating system (OS). This operating system can be various operating systems used in industry, such as operating systems developed based on OpenHarmony, like HarmonyOS; or other operating systems such as Android and iOS mobile operating systems; it can also be various open-source operating systems or their derivatives, such as Linux OS, and other embedded operating systems; or it can be a future new operating system, such as an AI operating system based on artificial intelligence. An operating system is a set of interconnected system software programs that manage and control the operation of the terminal device 100, utilize and run hardware and software resources, and provide public services to organize user interaction. In the terminal device 100, the operating system connects downwards to the physical devices at the hardware layer and provides a runtime environment for application software upwards.
[0210] An operating system typically includes a kernel layer, a middleware layer, and an application layer. The application layer includes applications, which can include system applications and third-party applications. The middleware layer includes a suite of software providing various services to application developers, or frameworks providing services such as databases, multimedia, and graphics, or capabilities such as distributed scheduling and system scaling. For example, the middleware layer may include a framework layer and / or a system service layer. The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The system service layer includes the system's core capabilities, providing services to applications through the framework layer. The kernel layer is the layer between hardware and software. The kernel layer may include hardware drivers and the operating system kernel. In addition to providing hardware drivers, the kernel layer also supports functions such as memory management and system process management.
[0211] The electronic devices we use in our daily lives come in various types and forms, and are applied in a wide range of scenarios. Therefore, based on the different forms and functions of electronic devices, different application scenarios, and different user needs, the operating systems used in these devices may also differ. The basic functions implemented by the terminal device 100 provided in this application can be implemented using a general-purpose operating system or a dedicated operating system. To more clearly illustrate the implementation of the embodiments of this application under a specific operating system, the architecture of HarmonyOS is shown below. Those skilled in the art can deduce the implementation of the embodiments of this application under other specific operating systems, such as Android™.
[0212] For example, as shown in Figure 6, the software architecture of the terminal device 100 can be divided into several layers. In some embodiments, from bottom to top, these layers are: kernel layer, system service layer, framework layer, and application layer. Layers communicate with each other through software interfaces. System functions can be tailored, added, or combined at the subsystem granularity in different device deployment scenarios, and each subsystem can also be tailored, added, or combined at the functional granularity.
[0213] The kernel layer can include: Kernel Abstract Layer (KAL), kernel subsystem, driver subsystem, etc.
[0214] Kernel Abstraction Layer: By shielding the differences between multiple kernels, it provides basic kernel capabilities to the upper layers, including but not limited to process / thread management, memory management, file system, network management, and peripheral device management.
[0215] Kernel Subsystem: Supports the selection of a suitable OS kernel for different resource-constrained devices, including but not limited to Linux kernel, HarmonyOS kernel, LiteOS (Lite Operating System), etc.
[0216] Driver Subsystem: The driver framework is the foundation for the open system hardware ecosystem, providing unified peripheral access capabilities and a framework for driver development and management. The driver framework includes: display drivers, camera drivers, audio drivers, Bluetooth drivers, sensor drivers, etc.
[0217] The system service layer comprises the core capabilities of the system, providing services to applications through the framework layer. This layer includes, but is not limited to, the following subsystems:
[0218] The system's basic capability subsystem set provides fundamental capabilities for the operation, scheduling, and migration of distributed applications across multiple devices. This set may include distributed soft bus, distributed data management, distributed task scheduling, and Ark multi-language runtime; it may also include multi-modal input subsystem, graphics subsystem, security subsystem, and AI subsystem.
[0219] Basic software service subsystem set: provides public and general software services; the basic software service subsystem set may include event notification subsystem, telephone service subsystem, multimedia subsystem, etc.
[0220] Enhanced software service subsystem suite: Provides differentiated enhanced software services for different devices; the enhanced software service subsystem suite may include smart screen proprietary business subsystem, wearable proprietary business subsystem, IoT proprietary business subsystem, etc.
[0221] Hardware service subsystem set: Provides hardware services; the hardware service subsystem set may include location service subsystem, user IAM (Identity and Access Management) subsystem, wearable proprietary hardware service subsystem, biometric identification, IoT proprietary hardware service subsystem, etc.
[0222] Distributed task scheduling enables distributed service management (discovery, synchronization, registration, and invocation), supporting remote startup, remote invocation, remote connection, and migration of applications across devices.
[0223] Distributed data management enables data synchronization, data storage, data sharing, and data access across all scenarios and devices.
[0224] The distributed soft bus provides communication-related capabilities for seamless interconnection between multiple devices, including: WLAN service capabilities, Bluetooth service capabilities, soft bus, inter-process communication RPC (Remote Procedure Call), and StarFlash communication capabilities.
[0225] Ark Multilingual Runtime is a unified compilation runtime platform designed to support the joint compilation and execution of multiple programming languages and multiple chip platforms.
[0226] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The framework layer includes: the ArkUI framework (which provides a complete infrastructure for UI development of system applications, including UI functions such as components, layouts, animations, and interactive events, as well as a real-time interface preview tool), the user application framework, and the Ability framework (an Ability is a lightweight application; the Ability framework schedules and manages the operation and lifecycle of Abilities). Different devices may have different operating systems, and therefore support different APIs.
[0227] The HarmonyOS API is a series of open capabilities provided to support HarmonyOS application development. The HarmonyOS API can be set at the framework layer or independently of the framework layer. The HarmonyOS API includes the Audio API (audio service), Push API (push service), and Account API (account service), among others.
[0228] Applications can include system apps and extended / third-party apps. System apps can include the desktop, control bar, settings, contacts, phone, etc., while extended / third-party apps can include fitness and health apps, etc.
[0229] The following embodiments will be illustrated by taking a mobile phone 100 as an example of a terminal device 100.
[0230] The following section provides a detailed explanation of an interaction method provided in this application, using UI diagrams and flowcharts.
[0231] The application scenarios of the interaction method provided in this application include interaction scenario one, interaction scenario two, and interaction scenario three.
[0232] For example, terminal device 100 may be mobile phone 100. Wearable device 200 may be headset 200.
[0233] One or more motion parameters for a nodding operation include the nodding angle and the nodding speed. One or more motion parameters for a head-shaking operation include the head-shaking angle and the head-shaking speed.
[0234] In the first interactive scenario, if the terminal device 100 and the headset 200 disconnect, or if the headset 200 does not receive any user input for a continuous period of time, the terminal device 100 and the headset 200 can exit the first action teaching mode.
[0235] In interaction scenario two, terminal device 100 or earphone 200 can monitor whether the user's nodding angle is greater than a preset angle A and whether the user's nodding speed is greater than a preset speed A during a nodding operation. Similarly, terminal device 100 or earphone 200 can also monitor whether the user's head shaking angle is greater than a preset angle B and whether the user's head shaking speed is greater than a preset speed B during a head shaking operation.
[0236] In interaction scenario three, terminal device 100 and earphone 200 can monitor whether the user's nodding angle is greater than a preset angle A and whether the user's nodding speed is greater than a preset speed A during multiple nodding operations (e.g., two nodding operations). Similarly, terminal device 100 and earphone 200 can also monitor whether the user's head shaking angle is greater than a preset angle B and whether the user's head shaking speed is greater than a preset speed B during multiple head shaking operations (e.g., two head shaking operations).
[0237] The following embodiments will provide a detailed description of the interaction methods in the above three application scenarios.
[0238] Interaction Scenario 1
[0239] Figures 7A-7H show schematic diagrams of interactive scenario one.
[0240] Figure 7A illustrates a user interface 71 for displaying installed applications. The user interface 71 may include: a status bar 701, a tray icon 702 for frequently used applications, other application icons 703, and a page indicator 704.
[0241] The status bar 701 may include: a mobile communication signal (also known as a cellular signal) indicator, a battery status indicator, a time indicator, a Wi-Fi signal indicator, and a Bluetooth signal indicator. Other application icons 703 include the icon 703A of the Smart Life APP. Other application icons may be distributed across multiple pages, and a page indicator 704 can be used to indicate which page the user is currently viewing.
[0242] As shown in Figures 7A and 7B, after detecting an input operation on the Smart Life APP icon 703A, such as a click, the mobile phone 100 displays the Smart Life APP's user interface. This user interface may include a menu bar 705, which may include various function options of the Smart Life APP, such as home function options, shopping mall function options, scene function options, and my function options. When one function option in the menu bar 705 is selected, the mobile phone 100 can display the user interface corresponding to the selected function option, allowing the user to switch between the selected options. For example, as shown in Figure 7B, when the Smart Life home function option is selected, the mobile phone 100 displays the corresponding user interface 72. The user interface 72 may include a device card 706. The device card 706 displays the logo and image of a Bluetooth headset, indicating that the Bluetooth headset labeled "Huawei Freebuds Pro" can be controlled by the mobile phone 100. The user can view detailed information about the Bluetooth headset labeled "Huawei Freebuds Pro" through the device card 706.
[0243] As shown in Figures 7B and 7C, after detecting an input operation on the device card 706, such as a click operation, the mobile phone 100 can display the control interface 73 of the Bluetooth headset shown in Figure 7C. The control interface 73 includes multiple setting options, such as setting option 707, through which the user can view the specific rules for the user's interaction with the headset through head operation.
[0244] As shown in Figures 7C and 7D, after detecting an input operation applied to setting option 707, such as a click, mobile phone 100 can display user interface 74 as shown in Figure 7D. User interface 74 includes specific rules for user interaction via head gestures and headphones. For example, a user can answer a call by nodding and reject a call by shaking their head. Mobile phone 100 can also receive control rules for user changes to head gestures. User interface 74 also includes option 708, through which the user can access a user interface that enables a head gesture tutorial mode.
[0245] As shown in Figures 7D and 7E, after detecting an input operation on option 708, such as a click operation, the mobile phone 100 can display the user interface 75 shown in Figure 7E. The user interface 75 includes option 709, through which the user can start the head operation teaching mode.
[0246] In some embodiments, if the mobile phone 100 and the headset do not establish a communication connection, the mobile phone 100 cannot enable the head operation teaching mode.
[0247] For example, as shown in Figures 7E and 7F, after detecting an input operation on option 709, such as a click operation, the mobile phone 100 can display the user interface 76 shown in Figure 7F. User interface 76 includes the prompt message "Headphone disconnected, cannot continue" and option 710. The user can use option 710 to stop the mobile phone 100 from displaying user interface 76 and display user interface 75 shown in Figure 7E. User interface 76 includes the prompt message "Headphone disconnected, cannot continue" and option 710. The user can use option 710 to stop the mobile phone 100 from displaying user interface 76 and display user interface 75 shown in Figure 7E.
[0248] In some embodiments, after the head-operation teaching mode is activated on the mobile phone 100, if the headset 200 does not receive any input from the user for a first duration, the headset 200 may send a message to the mobile phone 100, which instructs the mobile phone 100 to exit the head-operation teaching mode.
[0249] For example, as shown in Figures 7G and 7H, after the mobile phone 100 activates the head-operation teaching mode, if the headset 200 does not receive any user input for a first duration, the headset 200 can send a message to the mobile phone 100 instructing it to exit the head-operation teaching mode. In response to the message sent by the headset 200, the mobile phone 100 can display the user interface 77 shown in Figure 7G. The user interface 77 includes the prompt message "Practice interrupted, continue current practice?", which indicates to the user that the head-operation teaching mode has been paused. The user interface 77 also includes an exit practice option 711 and a continue option 712. The user can use the exit practice option 711 to allow the mobile phone 100 to exit the head-operation teaching mode. The user can use the continue option 712 to prevent the mobile phone 100 from exiting the head-operation teaching mode. The headset 200 can continue to monitor whether user input is received. If no user input is received for a second duration, the headset 200 can send a message to the mobile phone 100 instructing it to exit the head-operation teaching mode. After the mobile phone 100 exits the head operation teaching mode, the mobile phone 100 can display the user interface 78 shown in Figure 7H. The user interface 78 includes the prompt message "Unfortunately, the exercise is not completed. You can practice again in 'Head Control'". This prompt message is used to inform the user that the mobile phone 100 has exited the head operation teaching mode.
[0250] Interaction Scenario 2
[0251] In interaction scenario two, terminal device 100 can monitor whether the user has correctly performed a nodding operation during a single nodding action. Correct execution of the nodding operation can mean that one or more action parameters of the nodding operation meet preset requirements, such as a nodding angle greater than preset angle A and a nodding speed greater than preset angle A. Incorrect execution of the nodding operation can mean that one or more action parameters of the nodding operation do not meet preset requirements, such as a nodding angle less than preset angle A and / or a nodding speed less than preset angle A. If the user has not performed the nodding operation correctly, terminal device 100 can prompt the user to adjust the action parameters of the nodding operation, guiding the user to perform the nodding operation correctly.
[0252] Similarly, the terminal device 100 can monitor whether the user has correctly performed a head-shaking operation during a single head-shaking action. Correct execution of the head-shaking operation can mean that one or more action parameters of the head-shaking operation meet preset requirements, such as a head-shaking angle greater than a preset angle B, and a head-shaking speed greater than a preset angle B. Incorrect execution of the head-shaking operation can mean that one or more action parameters of the head-shaking operation do not meet preset requirements, such as a head-shaking angle less than a preset angle B, and / or a head-shaking speed less than a preset angle B. If the user has not performed the head-shaking operation correctly, the terminal device 100 can prompt the user to adjust the action parameters of the head-shaking operation, guiding the user to perform the head-shaking operation correctly.
[0253] Figures 8A-8R show schematic diagrams of interactive scenario two.
[0254] As shown in Figure 8A, after receiving user input for option 709, such as a click, mobile phone 100 can activate the head operation tutorial mode. Once in tutorial mode, mobile phone 100 can guide the user to correctly perform nodding and / or head-shaking operations. If the user does not perform the nodding and / or head-shaking operations correctly, mobile phone 100 can prompt the user to adjust the motion parameters of the nodding and / or head-shaking operations, guiding the user to perform the nodding and / or head-shaking operations correctly.
[0255] After the mobile phone 100 enters the head operation teaching mode, it can send a first message to the headset 200. This first message instructs the headset 200 to also enter the head operation teaching mode. Upon receiving the first message from the mobile phone 100, the headset 200 can begin collecting sensor data. This sensor data is used by the headset 200 or the mobile phone 100 to confirm whether the user's nodding and / or shaking head operations are correct.
[0256] Optionally, after the phone enters the head operation teaching mode, the phone can first monitor whether the user has correctly performed the nodding operation.
[0257] In some embodiments, the mobile phone 100 can play a nodding animation to guide the user to correctly perform a nodding operation. For example, the nodding animation may include multiple animation frames, such as animation frame 801 shown in FIG8B, animation frame 802 shown in FIG8C, animation frame 803 shown in FIG8D, animation frame 804 shown in FIG8E, and animation frame 805 shown in FIG8F.
[0258] It should be noted that the nodding animation may include other animation frames. The animation frames shown in Figures 8B-8E are only used to explain this application and do not constitute a limitation.
[0259] Optionally, during the nodding animation playback on the mobile phone 100, the earphone 200 can receive user input and collect sensor data. Alternatively, the earphone 200 can receive user input and collect sensor data after the nodding animation has finished playing on the mobile phone 100. The earphone 200 or the mobile phone 100 can monitor whether the user has correctly performed the nodding operation based on the sensor data. This application does not limit the timing of the earphone 200 collecting sensor data.
[0260] Optionally, the mobile phone 100 or earphone 200 first confirms whether the nodding angle of the first nodding operation is greater than a preset angle A. If the nodding angle of the first nodding operation is confirmed to be greater than the preset angle A, the mobile phone 100 or earphone 200 then confirms whether the nodding speed of the first nodding operation is greater than a preset speed A. If the nodding angle of the first nodding operation is less than the preset angle A, the mobile phone 100 or earphone 200 may not need to confirm whether the nodding speed of the first nodding operation is greater than the preset speed A, in order to save power consumption of the mobile phone 100 or earphone 200.
[0261] Optionally, the mobile phone 100 or the earphone 200 can also simultaneously confirm whether the nodding speed of the first nodding operation is greater than the preset speed A, and whether the nodding speed is greater than the preset speed A.
[0262] If the headset 200 or mobile phone 100 confirms, based on the sensor data collected by the headset 200, that the user has correctly performed the nodding operation—that is, in the first nodding operation, the nodding angle is greater than a preset angle A, and the nodding speed is greater than a preset angle A—the mobile phone 100 can display the prompt message 806 shown in Figure 8G. The prompt message 806 includes the text "Very good!", and is used to notify the user that the nodding operation has been performed correctly.
[0263] If the headset 200 or mobile phone 100 collects sensor data based on the headset 200 and confirms that the user has not performed the nodding operation correctly, for example, in the first nodding operation, the nodding angle is less than the preset angle A, and / or the nodding speed is less than the preset angle A, the mobile phone 100 can prompt the user to adjust the action parameters of the nodding operation and guide the user to perform the nodding operation correctly.
[0264] For example, if the nodding angle of the first nodding operation is less than the preset angle A, the mobile phone 100 can display the prompt information 807 shown in Figure 8H. The prompt information 807 includes the text "Please increase the nodding angle". The prompt information 807 is used to prompt the user to adjust the nodding angle in order to perform the nodding operation correctly.
[0265] For example, if the nodding speed of the first nodding operation is less than the preset speed A, the mobile phone 100 can display the prompt message 808 shown in Figure 8I. The prompt message 808 includes the text "Please speed up the nodding speed". The prompt message 808 is used to prompt the user to adjust the nodding speed in order to perform the nodding operation correctly.
[0266] Similarly, the mobile phone 100 or the earphone 200 can follow the method shown in Figures 8B-8I until the head nodding angle of the user's head nodding operation is greater than the preset angle A and the head nodding speed is greater than the preset speed A. At this point, the mobile phone 100 can stop guiding the user's head nodding operation.
[0267] After monitoring that the user has correctly performed the nodding operation, the mobile phone 100 can then guide the user to correctly perform the head shaking operation.
[0268] In some embodiments, the mobile phone 100 can play a head-shaking animation to guide the user to correctly perform the head-shaking operation. For example, the head-shaking animation may include multiple animation frames, such as animation frame 809 shown in Figure 8J, animation frame 810 shown in Figure 8K, animation frame 811 shown in Figure 8L, animation frame 812 shown in Figure 8M, and animation frame 813 shown in Figure 8N.
[0269] It should be noted that the head-shaking animation may include other animation frames. The animation frames shown in Figures 8J-8N are only used to explain this application and do not constitute a limitation.
[0270] Optionally, during the head-shaking animation played on the mobile phone 100, the earphone 200 can receive user input and collect sensor data. Alternatively, the earphone 200 can receive user input and collect sensor data after the head-shaking animation has finished playing on the mobile phone 100. The earphone 200 or the mobile phone 100 can monitor whether the user has correctly performed the head-shaking operation based on the sensor data. This application does not limit the timing of the earphone 200 collecting sensor data.
[0271] Optionally, the mobile phone 100 or the headset 200 can first confirm whether the head-shaking angle of the first head-shaking operation is greater than a preset angle B. If the head-shaking angle is confirmed to be greater than the preset angle B, the mobile phone 100 or the headset 200 will then confirm whether the head-shaking speed of the first head-shaking operation is greater than a preset speed B. If the mobile phone 100 or the headset 200 confirms that the head-shaking angle of the first head-shaking operation is less than the preset angle B, the mobile phone 100 or the headset 200 may not need to confirm whether the head-shaking speed of the first head-shaking operation is greater than the preset speed B, in order to save power consumption of the mobile phone 100 or the headset 200.
[0272] Optionally, the mobile phone 100 or the earphone 200 can also simultaneously confirm whether the head shaking speed of the first head shaking operation is greater than the preset speed B.
[0273] If the earphone 200 or mobile phone 100 collects sensor data based on the earphone 200 and confirms that the user has correctly performed the head-shaking operation, that is, in the first head-shaking operation, the head-shaking angle is greater than a preset angle B and the head-shaking speed is greater than a preset angle B, the mobile phone 100 can display the prompt message 814 shown in Figure 80. The prompt message 814 includes the text "Very good!" and is used to notify the user that the head-shaking operation has been performed correctly.
[0274] If the earphone 200 or mobile phone 100 confirms, based on the sensor data collected by the earphone 200, that the user has not performed the head-shaking operation correctly, for example, in the first head-shaking operation, the head-shaking angle is less than the preset angle B, and / or the head-shaking speed is less than the preset angle B, the mobile phone 100 can prompt the user to adjust the action parameters of the head-shaking operation and guide the user to perform the head-shaking operation correctly.
[0275] For example, if the head-shaking angle is less than the preset angle B during the first head-shaking operation, the mobile phone 100 can display the prompt message 815 shown in Figure 8P. The prompt message 815 includes the text "Please increase the head-shaking angle". The prompt message 815 is used to prompt the user to adjust the head-shaking angle in order to correctly perform the head-shaking operation.
[0276] For example, if the head-shaking speed is less than the preset speed B during the first head-shaking operation, the mobile phone 100 can display the prompt message 816 shown in Figure 8Q. The prompt message 816 includes the text "Please increase the head-shaking speed". The prompt message 816 is used to prompt the user to adjust the head-shaking speed in order to perform the head-shaking operation correctly.
[0277] Similarly, the mobile phone 100 or the earphone 200 can follow the method shown in Figures 8J-8Q until the head-shaking angle of the user's head-shaking operation is greater than the preset angle B and the head-shaking speed is greater than the preset speed B. At this point, the mobile phone 100 can stop guiding the user's head-shaking operation.
[0278] Optionally, upon detecting that the user has correctly performed a nodding and / or head-shaking operation, the mobile phone 100 can display the prompt message 817 shown in Figure 8R. The prompt message 817 includes the text "Congratulations, you have successfully completed the head movement training! You can practice again in 'Head Control'." The prompt message 817 is used to indicate to the user that the nodding and / or head-shaking operation has been correctly performed, and the mobile phone 100 will exit the head operation teaching mode. Optionally, the mobile phone 100 can also send a message to the headset 200, instructing the headset 200 to also exit the head operation teaching mode. Optionally, the mobile phone 100 may also exit the head operation teaching mode only after receiving a message from the headset 200.
[0279] Optionally, the mobile phone 100 can also receive user operations and choose to guide the user to correctly perform a nodding operation or a head shaking operation. That is, the mobile phone 100 can only execute the embodiments shown in Figures 8A-8I or only execute the embodiments shown in Figures 8J-8Q.
[0280] Figure 9 shows a schematic diagram of the method flow for an interaction scenario two.
[0281] The method described in Figure 9 includes, but is not limited to, the following steps.
[0282] S901, terminal device 100 and wearable device 200 establish a communication connection.
[0283] For example, terminal device 100 may be mobile phone 100, and wearable device 200 may be headphones 200.
[0284] In some embodiments, the terminal device 100 and the wearable device 200 may establish a wireless communication connection through near-field communication technology, which may include, but is not limited to, any one of the following: WiFi communication technology, Bluetooth communication technology, Bluetooth Low Energy technology, UWB communication technology, NFC technology, ZigBee communication technology, etc.
[0285] In some embodiments, the terminal device 100 and the wearable device 200 may establish a wired communication connection.
[0286] S902, Terminal device 100 receives the fifth operation and enters the first action teaching mode.
[0287] Terminal device 100 can receive a fifth operation and enter the first action teaching mode. Terminal device 100 can obtain preset requirements based on the first action teaching mode. These preset requirements are used by terminal device 100 to confirm whether one or more action parameters of the user's input operation on wearable device 200 are correct.
[0288] For example, the fifth operation could be the input operation for option 709 shown in Figure 8A.
[0289] For example, preset requirements may include a first requirement of the first action parameter and a second requirement of the second action parameter.
[0290] For example, the first action teaching mode can be a nodding operation teaching mode, the first action parameter can be the nodding angle, the first requirement can be that the nodding angle is greater than a preset angle A, the second action parameter can be the nodding speed, and the second requirement can be that the nodding speed is greater than a preset speed A.
[0291] Optionally, after the terminal device 100 enters the nodding operation teaching mode, the terminal device 100 can play a nodding animation. For example, refer to the description in the embodiments shown in Figures 8B-8E.
[0292] For example, the first action teaching mode can be a head-shaking operation teaching mode, the first action parameter can be the head-shaking angle, the first requirement can be that the head-shaking angle is greater than a preset angle B, the second action parameter can be the head-shaking speed, and the second requirement can be that the head-shaking speed is greater than a preset speed B.
[0293] Optionally, after the terminal device 100 enters the head-shaking operation teaching mode, the terminal device 100 can play a head-shaking animation. For example, refer to the description in the embodiments shown in Figures 8J-8N.
[0294] S903, Terminal device 100 sends a first message to wearable device 200, the first message being used to instruct wearable device 200 to enter the first action teaching mode.
[0295] S904, In response to the first message, the wearable device 200 enters the first action teaching mode.
[0296] In response to the fifth operation, the terminal device 100 can send a first message to the wearable device 200, the first message instructing the wearable device 200 to also enter the first action teaching mode. After receiving the first message, the wearable device 200 can also enter the first action teaching mode.
[0297] S905, the wearable device 200 receives the first operation and collects the first sensor data.
[0298] The first type of operation includes, but is not limited to, any of the following: nodding, shaking, waving, etc.
[0299] The wearable device 200 can receive a first operation input by the user and collect first sensor data. The first sensor data may be acquired during the period when the wearable device 200 receives the first operation from the user.
[0300] The first sensor data may include, but is not limited to, any one or more of the following: acceleration data, angular velocity data, etc.
[0301] S906, the wearable device 200 sends the first sensor data to the terminal device 100.
[0302] After acquiring the first sensor data, the wearable device 200 can send the first sensor data to the terminal device 100.
[0303] S907, Terminal device 100 confirms, based on the first sensor data, whether one or more action parameters of the first operation meet the preset requirements.
[0304] After receiving the first sensor data sent by the wearable device 200, the terminal device 100 can confirm, based on the first sensor data, whether one or more action parameters of the first operation meet the preset requirements.
[0305] The terminal device 100 can obtain preset requirements based on the first action teaching mode, and confirm whether one or more action parameters of the first operation meet the preset requirements based on the first sensor data.
[0306] If one or more action parameters of the first operation meet the preset requirements, the terminal device 100 can execute S908.
[0307] If one or more action parameters of the first operation do not meet the preset requirements, the terminal device 100 can execute S909-S910.
[0308] Optionally, one or more action parameters of the first operation may include a first action parameter and a second action parameter. All one or more action parameters of the first operation meet preset requirements, which may mean that the first action parameter meets the first requirement and the second action parameter meets the second requirement.
[0309] One or more action parameters of the first operation do not meet the preset requirements, which may mean that the first action parameter does not meet the first requirement, and / or that the second action parameter does not meet the second requirement.
[0310] Optionally, the terminal device 100 may first confirm whether the first action parameters of the first operation meet the first requirement. If the first action parameters of the first operation meet the first requirement, the terminal device 100 then confirms whether the second action parameters of the first operation meet the second requirement. If the first action parameters of the first operation do not meet the first requirement, the terminal device 100 may not need to confirm whether the second action parameters of the first operation meet the second requirement, which can save power consumption of the terminal device 100.
[0311] Optionally, the terminal device 100 may also simultaneously confirm whether the first action parameter of the first operation meets the first requirement and whether the second action parameter of the first operation meets the second requirement.
[0312] For example, the first operation can be a nodding operation, and one or more action parameters of the first operation can be the nodding angle and the nodding speed of the first operation. The terminal device 100 can acquire a first requirement and a second requirement based on the nodding operation teaching mode. The first requirement can be that the nodding angle is greater than a preset angle A, and the second requirement can be that the nodding speed is greater than a preset speed A. The terminal device 100 can confirm whether the nodding angle and the nodding speed of the first operation meet the preset requirements based on the first sensor data, the first requirement, and the second requirement.
[0313] If the nodding angle of the first operation is greater than the preset angle A, it means that the nodding angle of the first operation meets the first requirement. If the nodding angle of the first operation is less than the preset angle A, it means that the nodding angle of the first operation does not meet the first requirement.
[0314] If the nodding speed of the first operation is greater than the preset speed A, it means that the nodding speed of the first operation meets the second requirement. If the nodding speed of the first operation is less than the preset angle A, it means that the nodding speed of the first operation does not meet the second requirement.
[0315] For example, the first operation can be a head-shaking operation, and one or more action parameters of the first operation can be the head-shaking angle and the head-shaking speed of the first operation. The terminal device 100 can acquire a first requirement and a second requirement based on the head-shaking operation teaching mode. The first requirement can be that the head-shaking angle is greater than a preset angle B, and the second requirement can be that the head-shaking speed is greater than a preset speed B. The terminal device 100 can confirm whether the head-shaking angle of the first operation meets the first requirement and whether the head-shaking speed of the first operation meets the second requirement based on the first sensor data, the first requirement, and the second requirement.
[0316] If the head-shaking angle of the first operation is greater than the preset angle B, it means that the head-shaking angle of the first operation meets the first requirement; if the head-shaking angle of the first operation is less than the preset angle B, it means that the head-shaking angle of the first operation does not meet the first requirement.
[0317] If the head-shaking speed of the first operation is greater than the preset speed B, it means that the head-shaking speed of the first operation meets the second requirement. If the head-shaking speed of the first operation is less than the preset angle B, it means that the head-shaking speed of the first operation does not meet the second requirement.
[0318] S908, Terminal device 100 outputs a fifth prompt, which is used to indicate that the first operation was correct.
[0319] If one or more action parameters of the first operation meet the preset requirements, the terminal device 100 can output a fifth prompt, which is used to indicate that the first operation is correct.
[0320] For example, the first operation can be a nodding operation. If it is confirmed that the nodding angle of the first operation is greater than the preset angle A and the nodding speed of the first operation is greater than the preset speed A, it means that the nodding operation performed by the user is correct. The terminal device 100 can output a fifth prompt, which is used to remind the user that the nodding operation performed is correct.
[0321] For example, the fifth prompt could be the prompt message 806 shown in Figure 8F.
[0322] For example, the first operation can be a head shaking operation. If it is confirmed that the head shaking angle of the first operation is greater than the preset angle B and the head shaking speed of the first operation is greater than the preset speed B, it means that the head shaking operation performed by the user is correct, and the terminal device 100 can output a fifth prompt, which is used to prompt the user that the head shaking operation performed is correct.
[0323] For example, the fifth prompt could be the prompt message 814 shown in Figure 8O.
[0324] S909, Terminal device 100 confirms that the first action parameter of the first operation does not meet the first requirement.
[0325] S910, Terminal device 100 outputs a first prompt, which is used to instruct the user to adjust the first action parameter of the second operation when inputting the second operation. The type of the second operation is the same as the type of the first operation.
[0326] If the terminal device 100 confirms that the first action parameter of the first operation does not meet the first requirement, the terminal device 100 outputs a first prompt. The first prompt is used to instruct the user to adjust the first action parameter of the second operation when inputting the second operation, so that the user can correctly execute the second operation. The type of the second operation is the same as the type of the first operation.
[0327] For example, the first operation can be a nodding operation, the first action parameter can be the nodding angle, and the first requirement can be that the nodding angle is greater than a preset angle A. If the nodding angle of the first operation is less than the preset angle A, the terminal device 100 can output a first prompt, which can be the prompt information 807 shown in Figure 8H.
[0328] For example, the first operation can be a head-shaking operation, the first action parameter can be the head-shaking angle, and the first requirement can be that the head-shaking angle is greater than a preset angle B. If the head-shaking angle of the first operation is less than the preset angle B, the terminal device 100 can output a first prompt, which can be the prompt information 815 shown in Figure 8P.
[0329] In some embodiments, if it is confirmed that the first action parameter of the first operation meets the first requirement, but the second action parameter of the first operation does not meet the second requirement, the terminal device 100 may output a sixth prompt. The sixth prompt is used to instruct the user to adjust the second action parameter of the sixth operation when inputting the sixth operation. The type of the sixth operation is the same as the type of the first operation.
[0330] For example, the first operation can be a nodding operation, the second action parameter can be the nodding speed, and the second requirement can be that the nodding speed is greater than a preset speed A. If the nodding speed of the first operation is less than the preset speed A, the terminal device 100 can output a sixth prompt, which can be the prompt information 808 shown in Figure 8I.
[0331] For example, the first operation can be a head-shaking operation, the second action parameter can be the head-shaking speed, and the second requirement can be that the head-shaking speed is greater than a preset speed B. If the head-shaking speed of the first operation is less than the preset speed B, the terminal device 100 can output a sixth prompt, which can be the prompt information 816 shown in Figure 8Q.
[0332] Using the method shown in the embodiment of Figure 9, the terminal device 100 can identify which of the multiple action parameters of a user's input operation on the wearable device 200 does not meet the preset requirements, and correct the action parameter that does not meet the preset requirements. This can more accurately guide the user to adjust the input operation on the wearable device, improve the accuracy of the user's control of the wearable device through actions, and also improve the interaction efficiency between the user and the wearable device.
[0333] It should be noted that the steps in the embodiment of Figure 9 are only used to explain this application, and this application does not limit the execution order of the steps in the embodiment of Figure 9.
[0334] Figure 10 shows a schematic diagram of the method flow for another interaction scenario.
[0335] The method flow shown in Figure 10 includes, but is not limited to, the following steps.
[0336] S1001, terminal device 100 and wearable device 200 establish a communication connection.
[0337] S1002, Terminal device 100 receives the fifth operation and enters the first action teaching mode.
[0338] S1003, Terminal device 100 sends a first message to wearable device 200, the first message being used to instruct wearable device 200 to enter the first action teaching mode.
[0339] S1004. In response to the first message, the wearable device 200 enters the first action teaching mode.
[0340] S1005, the wearable device 200 receives the first operation and collects the first sensor data.
[0341] S1006. The wearable device 200, based on the data from the first sensor, confirms whether one or more action parameters of the first operation meet preset requirements.
[0342] For a description of S1006, please refer to the description in S907; this application will not repeat it here.
[0343] If one or more action parameters of the first operation meet the preset requirements, the terminal device 100 can execute S1007-S1008.
[0344] If one or more action parameters of the first operation do not meet the preset requirements, the terminal device 100 may execute S1009-S1011.
[0345] S1007, Wearable device 200 sends a third message to terminal device 100.
[0346] S1008. In response to the third message, the terminal device 100 outputs a fifth prompt, which is used to indicate that the first operation was correct.
[0347] If it is confirmed that one or more action parameters of the first operation meet the preset requirements, the wearable device 200 can send a third message to the terminal device 100. In response to the third message, the terminal device 100 can output a fifth prompt, which indicates that the first operation was correct.
[0348] For a description of S1008, please refer to the description in S908; this application will not repeat it here.
[0349] S1009. Confirm that the first action parameter of the first operation does not meet the first requirement.
[0350] S1010, the wearable device 200 sends a second message to the terminal device 100.
[0351] S1011. In response to the second message, the terminal device 100 outputs a first prompt. The first prompt is used to instruct the user to adjust the first action parameter of the second operation when inputting the second operation. The type of the second operation is the same as the type of the first operation.
[0352] If it is confirmed that the first action parameter of the first operation does not meet the first requirement, the wearable device 200 can send a second message to the terminal device 100. In response to the second message, the terminal device 100 can output a first prompt, which instructs the user to adjust the first action parameter of the second operation when inputting the second operation. The type of the second operation is the same as the type of the first operation.
[0353] For a description of S1009 and S1011, please refer to the descriptions in S909 and S910. This application will not repeat them here.
[0354] The embodiment in Figure 10 is similar to the embodiment in Figure 9, except that in the embodiment in Figure 9, the terminal device 100 confirms, based on sensor data, whether one or more action parameters of a user's input operation to the wearable device 200 meet preset requirements. In the embodiment in Figure 10, the wearable device 200 confirms, based on sensor data, whether one or more action parameters of a user's input operation to the wearable device 200 meet preset requirements.
[0355] It should be noted that the steps in the embodiment of Figure 10 are only used to explain this application, and this application does not limit the execution order of the steps in the embodiment of Figure 10.
[0356] Interactive Scenario 3
[0357] In interaction scenario three, the terminal device 100 or the headset 200 can monitor whether multiple action parameters (such as nodding angle and nodding speed) of the user's nodding operations meet preset requirements during multiple nodding operations. For example, in the first nodding operation, the terminal device 100 or the headset 200 can confirm whether the nodding angle is greater than a preset angle A. If the nodding angle in the first nodding operation is greater than the preset angle A, the terminal device 100 or the headset 200 will then confirm whether the nodding speed in the second nodding operation is greater than a preset speed A. If the nodding angle in the first nodding operation is less than the preset angle A, the terminal device 100 or the headset 200 will continue to confirm whether the nodding angle in the second nodding operation is greater than the preset angle A. This process continues until the nodding angle is confirmed to be greater than the preset angle A, at which point the terminal device 100 or the headset 200 will then confirm whether the nodding speed is greater than the preset speed A in the next nodding operation. The terminal device 100 or the headset 200 confirms that the user has correctly performed the nodding operation until the nodding speed exceeds the preset speed A.
[0358] Optionally, the terminal device 100 may first monitor whether the nodding speed in the nodding operation is greater than the preset speed A, and then monitor whether the nodding angle in the nodding operation is greater than the preset angle A.
[0359] Similarly, the terminal device 100 or the headset 200 can monitor whether multiple action parameters (such as head-shaking angle and head-shaking speed) of the user's head-shaking operations meet preset requirements during multiple head-shaking operations. For example, in the first head-shaking operation, the terminal device 100 or the headset 200 can confirm whether the head-shaking angle of the first head-shaking operation is greater than a preset angle B. If the head-shaking angle of the first head-shaking operation is greater than the preset angle B, the terminal device 100 or the headset 200 will then confirm whether the head-shaking speed of the second head-shaking operation is greater than the preset speed B. If the head-shaking angle of the first head-shaking operation is less than the preset angle B, the terminal device 100 or the headset 200 will then continue to confirm whether the head-shaking angle of the second head-shaking operation is greater than the preset angle B. Once the head-shaking angle is confirmed to be greater than the preset angle B, the terminal device 100 or the headset 200 will then confirm whether the head-shaking speed is greater than the preset speed B in the next head-shaking operation. Once the head-shaking speed is greater than the preset speed B, the terminal device 100 or the headset 200 confirms that the user has correctly performed the head-shaking operation.
[0360] Optionally, the terminal device 100 or the earphone 200 may first monitor whether the head shaking speed during the head shaking operation is greater than the preset speed B, and then monitor whether the head shaking angle during the head shaking operation is greater than the preset angle B.
[0361] Figures 11A-11J show schematic diagrams of interactive scenario three.
[0362] For example, terminal device 100 may be mobile phone 100.
[0363] Referring to the description in the embodiment of Figure 8A, after receiving the user's input operation on option 709, such as a click operation, the mobile phone 100 can start the head operation teaching mode.
[0364] After the mobile phone 100 enters the head operation teaching mode, it can send a first message to the headset 200. This first message instructs the headset 200 to also enter the head operation teaching mode. Upon receiving the first message from the mobile phone 100, the headset 200 can begin collecting sensor data. This sensor data is used by the headset 200 or the mobile phone 100 to confirm whether the user's nodding and / or shaking head operations are correct.
[0365] Optionally, after the phone enters the head operation teaching mode, the phone can first monitor whether the user has correctly performed the nodding operation.
[0366] After receiving user input for option 709, mobile phone 100 can display the user interface shown in Figure 11A, which includes options 1101 and 1102. Option 1101 allows the user to use either the headset 200 or the mobile phone 100 to monitor whether the nodding angle and speed of the user's nodding actions are greater than a preset angle A and a preset speed A, respectively, during multiple nodding actions. Option 1102 allows the user to use either the headset 200 or the mobile phone 100 to monitor whether the nodding angle and speed of the user's nodding actions are greater than a preset angle A and a preset speed A, respectively, during a single nodding action.
[0367] For example, as shown in Figure 11A, mobile phone 100 can receive user input operations for option 1101, such as a click operation. In response to the user's input operation, mobile phone 100 or earphone 200 can first detect whether the nodding angle of the user's nodding operation is greater than a preset angle A. If the nodding angle of the user's nodding operation is greater than the preset angle A, mobile phone 100 or earphone 200 will then detect whether the nodding speed of the user's next nodding operation is greater than a preset speed A.
[0368] Optionally, before monitoring whether the user's nodding angle is greater than a preset angle A, the mobile phone 100 can play a nodding animation to guide the user to correctly perform the nodding operation. For example, the nodding animation may include multiple animation frames, which can be referred to the description in the embodiments of Figures 8B-8F.
[0369] Optionally, during the head-nodding animation played on the mobile phone 100, the earphone 200 can receive user input and collect sensor data. Alternatively, the earphone 200 can receive user input and collect sensor data after the head-nodding animation has finished playing on the mobile phone 100. The earphone 200 or the mobile phone 100 can monitor whether the user's head-nodding angle is greater than a preset angle A based on the sensor data. This application does not limit the timing of the earphone 200 collecting sensor data.
[0370] Optionally, during the first nodding operation, the mobile phone 100 or the earphone 200 can confirm whether the nodding angle of the first nodding operation is greater than the preset angle A. If the nodding angle of the first nodding operation is less than the preset angle A, the mobile phone 100 can output the prompt message 1103 shown in Figure 11B. The prompt message 1103 includes the text "Please increase the nodding angle". The prompt message 1103 is used to prompt the user to adjust the nodding angle to correctly perform the nodding operation.
[0371] After outputting prompt message 1103, the user can perform a second nodding operation. The mobile phone 100 or earphone 200 can then confirm whether the nodding angle of the second operation is greater than the preset angle A. If the nodding angle of the second operation is still less than the preset angle A, the mobile phone 100 can output prompt message 1103 as shown in Figure 11B to prompt the user to adjust the nodding angle of the third operation so that the nodding angle of the third operation is greater than the preset angle A. If the nodding angle of the second operation is greater than the preset angle A, the mobile phone 100 can output prompt message 1104 as shown in Figure 11C. Prompt message 1104 includes the text "Nodding angle met," and is used to inform the user that the nodding angle is greater than the preset angle A.
[0372] After the nodding angle of the second nodding operation is greater than the preset angle A, the user can perform a third nodding operation. The mobile phone 100 or the earphone 200 can confirm whether the nodding speed of the third nodding operation is greater than the preset speed A.
[0373] Optionally, before confirming whether the nodding speed of the third nodding operation is greater than the preset speed A, the mobile phone 100 can continue playing the nodding animation, which is also used to guide the user to correctly perform the nodding operation. For example, the nodding animation may include multiple animation frames, which can be referred to the description in the embodiments of Figures 8B-8E.
[0374] Optionally, during the head-nodding animation played on the mobile phone 100, the headset 200 can receive user input and collect sensor data. Alternatively, the headset 200 can receive user input and collect sensor data after the head-nodding animation has finished playing on the mobile phone 100. The headset 200 or the mobile phone 100 can monitor whether the head-nodding speed performed by the user is greater than a preset speed A based on the sensor data. This application does not limit the timing of the headset 200 collecting sensor data.
[0375] Optionally, during the third nodding operation, the mobile phone 100 or the earphone 200 can confirm whether the nodding speed of the third nodding operation is greater than the preset speed A. If the nodding speed of the third nodding operation is less than the preset speed A, the mobile phone 100 can output the prompt message 1105 shown in Figure 11D. The prompt message 1105 includes the text "Please increase the nodding speed". The prompt message 1105 is used to prompt the user to adjust the nodding speed of the fourth nodding operation so that the nodding speed of the fourth nodding operation is greater than the preset speed A.
[0376] After outputting prompt message 1105, the user can perform a fourth nod. The mobile phone 100 or earphone 200 can then confirm whether the nod speed of the fourth nod is greater than the preset speed A. If the nod speed of the fourth nod is still less than the preset speed A, the mobile phone 100 can output prompt message 1105 as shown in Figure 11D, prompting the user to adjust the nod speed of the fifth nod so that it exceeds the preset speed A. If the nod speed of the fourth nod is greater than the preset speed A, the mobile phone 100 can output prompt message 1106 as shown in Figure 11E. Prompt message 1106 includes the text "Nod speed met," indicating that the user's nod speed has exceeded the preset speed A.
[0377] In some embodiments, during multiple nodding operations performed by the user, after the mobile phone 100 or the earphone 200 confirms that the nodding angle is greater than a preset angle A and the nodding speed is greater than a preset speed A, the mobile phone 100 or the earphone 200 may further confirm whether the nodding angle of a single nodding operation performed by the user is greater than the preset angle A and the nodding speed is greater than the preset speed A. For example, refer to the description in the embodiments shown in Figures 8B-8I.
[0378] After confirming that the nodding angle is greater than the preset angle A and the nodding speed is greater than the preset speed A, that is, after the user has correctly performed the nodding operation, the mobile phone 100 or the earphone 200 can continue to guide the user to correctly perform the head shaking operation.
[0379] Before guiding the user to perform a head-shaking operation, the mobile phone 100 can display the user interface shown in Figure 11F, which includes options 1108 and 1109. Option 1108 allows the earphone 200 or mobile phone 100 to monitor whether the head-shaking angle and speed of the user's head-shaking operation are greater than a preset angle B and a preset speed B, respectively, during multiple head-shaking operations. Option 1109 allows the earphone 200 or mobile phone 100 to monitor whether the head-shaking angle and speed of the user's head-shaking operation are greater than a preset angle B and a preset speed B, respectively, during a single head-shaking operation.
[0380] For example, as shown in Figure 11F, mobile phone 100 can receive user input operations for option 1108, such as a click operation. In response to the user's input operation, mobile phone 100 or earphone 200 can first detect whether the head-shaking angle of the user's head-shaking operation is greater than a preset angle B. If the head-shaking angle of the user's head-shaking operation is greater than the preset angle B, mobile phone 100 or earphone 200 will then detect whether the head-shaking speed of the next head-shaking operation performed by the user is greater than a preset speed B.
[0381] Optionally, before monitoring whether the user's head-shaking angle is greater than a preset angle B, the mobile phone 100 can play a head-shaking animation to guide the user to correctly perform the head-shaking operation. For example, the head-shaking animation may include multiple animation frames, which can be referred to the description in the embodiments of Figures 8J-8N.
[0382] Optionally, during the head-shaking animation played on the mobile phone 100, the earphone 200 can receive user input and collect sensor data. Optionally, the earphone 200 can also receive user input and collect sensor data after the head-shaking animation has finished playing on the mobile phone 100. The earphone 200 or the mobile phone 100 can monitor whether the user's head-shaking angle is greater than a preset angle B based on the sensor data. This application does not limit the timing of the earphone 200 collecting sensor data.
[0383] Optionally, during the first head-shaking operation, the mobile phone 100 or the earphone 200 can confirm whether the head-shaking angle of the first head-shaking operation is greater than the preset angle B. If the head-shaking angle of the first head-shaking operation is less than the preset angle B, the mobile phone 100 can output the prompt message 1110 shown in Figure 11G. The prompt message 1110 includes the text "Please increase the head-shaking angle". The prompt message 1110 is used to prompt the user to adjust the head-shaking angle to correctly perform the head-shaking operation.
[0384] After outputting prompt message 1110, the user can perform a second head-shaking operation. The mobile phone 100 or earphone 200 can then confirm whether the head-shaking angle of the second operation is greater than the preset angle B. If the head-shaking angle of the second operation is still less than the preset angle B, the mobile phone 100 can output prompt message 1110 as shown in Figure 11G to prompt the user to adjust the head-shaking angle of the third operation so that the head-shaking angle of the third operation is greater than the preset angle B. If the head-shaking angle of the second operation is greater than the preset angle B, the mobile phone 100 can output prompt message 1111 as shown in Figure 11H. Prompt message 1111 includes the text "Head-shaking angle met," and prompt message 1111 is used to indicate to the user that the head-shaking angle is greater than the preset angle B.
[0385] After the head-shaking angle of the second head-shaking operation is greater than the preset angle B, the user can perform the third head-shaking operation. The mobile phone 100 or the earphone 200 can confirm whether the head-shaking speed of the third head-shaking operation is greater than the preset speed B.
[0386] Optionally, before confirming whether the head-shaking speed of the third head-shaking operation is greater than the preset speed B, the mobile phone 100 may continue playing the head-shaking animation, which is also used to guide the user to correctly perform the head-shaking operation. For example, the head-shaking animation may include multiple animation frames, which can be referred to the description in the embodiments of Figures 8J-8N.
[0387] Optionally, during the head-shaking animation played on the mobile phone 100, the earphone 200 can receive user input and collect sensor data. Optionally, the earphone 200 can also receive user input and collect sensor data after the head-shaking animation has finished playing on the mobile phone 100. The earphone 200 or the mobile phone 100 can monitor whether the head-shaking speed performed by the user is greater than a preset speed B based on the sensor data. This application does not limit the timing of the earphone 200 collecting sensor data.
[0388] Optionally, during the third head-shaking operation, the mobile phone 100 or the earphone 200 can confirm whether the head-shaking speed of the third head-shaking operation is greater than the preset speed B. If the head-shaking speed of the third head-shaking operation is less than the preset speed B, the mobile phone 100 can output the prompt message 1112 shown in Figure 11I. The prompt message 1112 includes the text "Please increase the head-shaking speed". The prompt message 1112 is used to prompt the user to adjust the head-shaking speed of the fourth head-shaking operation so that the head-shaking speed of the fourth head-shaking operation is greater than the preset speed B.
[0389] After outputting prompt message 1112, the user can perform a fourth head-shaking operation. The mobile phone 100 or earphone 200 can then confirm whether the head-shaking speed of the fourth operation is greater than the preset speed B. If the head-shaking speed of the fourth operation is still less than the preset speed B, the mobile phone 100 can output prompt message 1112 as shown in Figure 11I to prompt the user to adjust the head-shaking speed of the fifth operation so that it exceeds the preset speed B. If the head-shaking speed of the fourth operation is greater than the preset speed B, the mobile phone 100 can output prompt message 1113 as shown in Figure 11J. Prompt message 1113 includes the text "Head-shaking speed met," and is used to indicate to the user that their head-shaking speed has exceeded the preset speed B.
[0390] In some embodiments, during multiple head-shaking operations, after the mobile phone 100 or the earphone 200 confirms that the head-shaking angle is greater than a preset angle B and the head-shaking speed is greater than a preset speed B, the mobile phone 100 or the earphone 200 may further confirm whether the head-shaking angle of a single head-shaking operation performed by the user is greater than the preset angle B and the head-shaking speed is greater than the preset speed B. For example, refer to the description in the embodiments shown in Figures 80-80.
[0391] Optionally, if the phone 100 detects that the user has correctly performed a nodding and / or shaking operation, the phone 100 may display the prompt information 817 shown in Figure 8R. Please refer to the description in the embodiment of Figure 8R, which will not be repeated here.
[0392] Optionally, the mobile phone 100 can also receive user operations and choose to guide the user to correctly perform a nodding operation or a head shaking operation. That is, the mobile phone 100 can only execute the embodiments shown in Figures 11A-11E or only execute the embodiments shown in Figures 11F-11J.
[0393] Figure 12 shows a schematic diagram of the method flow for an interactive scenario three.
[0394] The method flow shown in Figure 12 includes, but is not limited to, the following steps.
[0395] S1201, terminal device 100 and wearable device 200 establish a communication connection.
[0396] S1202, Terminal device 100 receives the fifth operation and enters the first action teaching mode.
[0397] S1203, Terminal device 100 sends a first message to wearable device 200, the first message being used to instruct wearable device 200 to enter the first action teaching mode.
[0398] S1204, In response to the first message, the wearable device 200 enters the first action teaching mode.
[0399] S1205, the wearable device 200 receives the first operation and collects the first sensor data.
[0400] S1206, Wearable device 200 sends the first sensor data to terminal device 100.
[0401] For a description of S1201-S1206, please refer to the description of S901-S906; this application will not repeat it here.
[0402] S1207. The terminal device 100 confirms, based on the data from the first sensor, whether the first action parameter of the first operation meets the first requirement.
[0403] The first operation includes one or more action parameters, including a first action parameter and a second action parameter. The terminal device 100 may first confirm whether the first action parameter of the first operation meets a first requirement. If the first action parameter of the first operation meets the first requirement, the terminal device 100 then confirms whether the second action parameter of the second operation meets the second requirement in the user's next input operation to the wearable device 200 (e.g., a second operation). If the first action parameter of the first operation does not meet the first requirement, the terminal device 100 continues to confirm whether the first action parameter of the second operation meets the first requirement in the user's next input operation to the wearable device 200 (e.g., a second operation). This process continues until the first action parameter of the user's input operation to the wearable device 200 is confirmed to meet the first requirement, at which point the terminal device 100 then confirms whether the second action parameter of the user's next input operation to the wearable device 200 meets the second requirement.
[0404] If the first action parameter of the first operation does not meet the first requirement, the terminal device 100 can execute S1208-S1212.
[0405] If the first action parameter of the first operation meets the first requirement, the terminal device 100 can execute S1213-S1222.
[0406] For example, the first operation can be a nodding operation, the first action parameter can be the nodding angle, and the first requirement can be that the nodding angle is greater than a preset angle A. If the first action parameter of the first operation does not meet the first requirement, it can mean that the nodding angle of the first operation is less than the preset angle A. If the first action parameter of the first operation meets the first requirement, it can mean that the nodding angle of the first operation is greater than the preset angle A.
[0407] For example, the first operation can be a head-shaking operation, the first action parameter can be a head-shaking angle, and the first requirement can be that the head-shaking angle is greater than a preset angle B. If the first action parameter of the first operation does not meet the first requirement, it can mean that the head-shaking angle of the first operation is less than the preset angle B. If the first action parameter of the first operation meets the first requirement, it can mean that the head-shaking angle of the first operation is greater than the preset angle B.
[0408] S1208, Terminal device 100 outputs a first prompt, which is used to instruct the user to adjust the first action parameter in the second operation when inputting the second operation.
[0409] If the first action parameter of the first operation does not meet the first requirement, the terminal device 100 can output a first prompt, which is used to instruct the user to adjust the first action parameter of the second operation when inputting the second operation.
[0410] For example, the first operation can be a nodding operation, the first action parameter can be the nodding angle, and the first requirement can be that the nodding angle is greater than a preset angle A. If the nodding angle of the first operation is less than the preset angle A, the terminal device 100 can output a first prompt, which can be the prompt information 1103 shown in Figure 11B.
[0411] For example, the first operation can be a head-shaking operation, the first action parameter can be the head-shaking angle, and the first requirement can be that the head-shaking angle is greater than a preset angle B. If the head-shaking angle of the first operation is less than the preset angle B, the terminal device 100 can output a first prompt, which can be the prompt information 1110 shown in Figure 11G.
[0412] S1209, the wearable device 200 receives the second operation and collects the second sensor data.
[0413] S1210, the wearable device 200 sends the second sensor data to the terminal device 100.
[0414] Optionally, the second sensor data may be collected by the wearable device 200 during the receipt of the second operation. After acquiring the second sensor data, the wearable device 200 may send the second sensor data to the terminal device 100.
[0415] S1211. Based on the data from the second sensor, the wearable device 200 confirms whether the first action parameter of the second operation meets the first requirement.
[0416] In S1207, the terminal device 100, based on the first sensor data, confirms that the first action parameter of the first operation does not meet the first requirement. Therefore, after acquiring the second sensor data, the terminal device 100 needs to further confirm whether the first action parameter of the second operation meets the first requirement.
[0417] For an explanation of how the terminal device 100 confirms whether the first action parameter of the second operation meets the first requirement, please refer to the description in S1207, which will not be repeated here.
[0418] If the first action parameter of the second operation does not meet the first requirement, the terminal device 100 can execute S1212.
[0419] If the first action parameter of the second operation meets the first requirement, the terminal device 100 can execute S1213.
[0420] S1212, terminal device 100 and wearable device 200 execute S1208-S1211 again until it is confirmed that the first action parameter of the user's input operation to wearable device 200 meets the first requirement.
[0421] If the first action parameter of the second operation does not meet the first requirement, the wearable device 200 can receive the user's input operation again and acquire sensor data. The terminal device 100 can continue to confirm whether the first action parameter of the input operation meets the first requirement based on the sensor data, and if the first requirement is not met, output a prompt message. This prompt message is used to prompt the user to adjust the first action parameter of the next input operation to the wearable device 200 until it is confirmed that the first action parameter of the user's input operation to the wearable device 200 meets the first requirement. For example, refer to the description in S1208-S1211.
[0422] S1213, Terminal device 100 outputs a second prompt, the second prompt being used to indicate that the first action parameter of the first operation is correct or the first action parameter of the second operation is correct.
[0423] If the first action parameter of the first operation meets the first requirement, or the first action parameter of the second operation meets the first requirement, the terminal device 100 can output a second prompt, which is used to indicate that the first action parameter of the first operation is correct or the first action parameter of the second operation is correct.
[0424] For example, the first operation or the second operation can be a nodding operation, the first action parameter can be the nodding angle, and the first requirement can be that the nodding angle is greater than a preset angle A. If the nodding angle of the first operation or the second operation is greater than the preset angle A, the terminal device 100 can output a second prompt, which can be the prompt information 1104 shown in Figure 11C.
[0425] For example, the first operation or the second operation can be a head shaking operation, the first action parameter can be the head shaking angle, and the first requirement can be that the head shaking angle is greater than a preset angle B. If the head shaking angle of the first operation or the second operation is greater than the preset angle B, the terminal device 100 can output a second prompt, which can be the prompt information 1111 shown in Figure 11H.
[0426] S1214, The wearable device 200 receives the third operation and collects data from the third sensor.
[0427] S1215, the wearable device 200 sends the third sensor data to the terminal device 100.
[0428] The third sensor data may be collected by the wearable device 200 during the receipt of the third operation. After acquiring the third sensor data, the wearable device 200 may send the third sensor data to the terminal device 100.
[0429] Optionally, in S1207, if the terminal device 100 confirms that the first action parameter of the first operation meets the first requirement, the wearable device 200 may execute S1214 and S1215.
[0430] Optionally, in S1211, if the terminal device 100 confirms that the first action parameter of the second operation meets the first requirement, the wearable device 200 may also execute S1214 and S1215.
[0431] S1216. The terminal device 100 confirms, based on the data from the third sensor, whether the second action parameter of the third operation meets the second requirement.
[0432] The third operation includes one or more action parameters, including a first action parameter and a second action parameter. Prior to S1214, the terminal device 100 has confirmed that the first action parameter of the user's input operation to the wearable device 200 meets the first requirement. After acquiring the third sensor data sent by the wearable device 200, the terminal device 100 needs to confirm whether the second action parameter of the third operation meets the second requirement.
[0433] If the second action parameter of the third operation does not meet the second requirement, the terminal device 100 can execute S1217-S1221.
[0434] If the second action parameter of the third operation meets the second requirement, the terminal device 100 can execute S1222.
[0435] For example, the third operation can be a nodding operation, the second action parameter can be the nodding speed, and the second requirement can be that the nodding speed is greater than a preset speed A. If the second action parameter of the third operation does not meet the second requirement, it can mean that the nodding speed of the third operation is less than the preset speed A. If the second action parameter of the third operation meets the second requirement, it can mean that the nodding speed of the third operation is greater than the preset speed A.
[0436] For example, the third operation can be a head-shaking operation, the second action parameter can be the head-shaking speed, and the second requirement can be that the head-shaking speed is greater than a preset speed B. If the second action parameter of the third operation does not meet the second requirement, it can mean that the head-shaking speed of the third operation is less than the preset speed B. If the second action parameter of the third operation meets the second requirement, it can mean that the head-shaking speed of the third operation is greater than the preset speed B.
[0437] S1217. Terminal device 100 outputs a third prompt, which is used to instruct the user to adjust the second action parameter of the fourth operation when inputting the fourth operation.
[0438] If the second action parameter of the third operation does not meet the second requirement, the terminal device 100 can output a third prompt, which is used to instruct the user to adjust the second action parameter of the fourth operation when inputting the fourth operation.
[0439] For example, the third operation can be a nodding operation, the second action parameter can be the nodding speed, and the second requirement can be that the nodding speed is greater than a preset speed A. If the nodding speed of the third operation is less than the preset speed A, the terminal device 100 can output a third prompt, which can be the prompt information 1105 shown in Figure 11D.
[0440] For example, the third operation can be a head-shaking operation, the second action parameter can be the head-shaking speed, and the second requirement can be that the head-shaking speed is greater than a preset speed B. If the head-shaking speed of the third operation is less than the preset speed B, the terminal device 100 can output a third prompt, which can be the prompt information 1112 shown in Figure 11I.
[0441] S1218, the wearable device 200 receives the fourth operation and collects data from the fourth sensor.
[0442] S1219, Wearable device 200 sends the fourth sensor data to terminal device 100.
[0443] The fourth sensor data may be collected by the wearable device 200 during the receipt of the fourth operation. After acquiring the fourth sensor data, the wearable device 200 may send the fourth sensor data to the terminal device 100.
[0444] S1220, Terminal device 100 confirms, based on the data from the fourth sensor, whether the second action parameter of the fourth operation meets the second requirement.
[0445] In S1216, the terminal device 100 confirms, based on the third sensor data, that the second action parameter of the third operation does not meet the second requirement. Therefore, after acquiring the fourth sensor data, the terminal device 100 needs to further confirm whether the second action parameter of the fourth operation meets the second requirement.
[0446] For an explanation of how the terminal device 100 confirms whether the second action parameter of the fourth operation meets the second requirement, please refer to the description in S1216, which will not be repeated here.
[0447] If the second action parameter of the fourth operation does not meet the second requirement, the terminal device 100 can execute S1221.
[0448] If the second action parameter of the fourth operation meets the second requirement, the terminal device 100 can execute S1222.
[0449] S1221, terminal device 100 and wearable device 200 execute S1217-S1220 again until it is confirmed that the second action parameter of the user's input operation to wearable device 200 meets the second requirement.
[0450] If the second action parameter of the fourth operation does not meet the second requirement, the wearable device 200 can receive the user's input operation again and acquire sensor data. The terminal device 100 can continue to confirm whether the second action parameter of the input operation meets the second requirement based on the sensor data, and if the second requirement is not met, output a prompt message. This prompt message is used to prompt the user to adjust the second action parameter of the next input operation to the wearable device 200 until it is confirmed that the second action parameter of the user's input operation to the wearable device 200 meets the second requirement. For example, refer to the description in S1217-S1220.
[0451] S1222, Terminal device 100 outputs a fourth prompt, which is used to indicate that the second action parameter of the third operation is correct or the second action parameter of the fourth operation is correct.
[0452] If the second action parameter of the third operation meets the second requirement or the second action parameter of the fourth operation meets the second requirement, the terminal device 100 can output a fourth prompt, which is used to indicate that the second action parameter of the third operation is correct or the second action parameter of the fourth operation is correct.
[0453] For example, the third or fourth operation can be a nodding operation, the second action parameter can be the nodding speed, and the second requirement can be that the nodding speed is greater than a preset speed A. If the nodding speed of the third or fourth operation is greater than the preset speed A, the terminal device 100 can output a fourth prompt, which can be the prompt information 1106 shown in Figure 11E.
[0454] For example, the third or fourth operation can be a head-shaking operation, the second action parameter can be the head-shaking speed, and the second requirement can be that the head-shaking speed is greater than a preset speed B. If the head-shaking speed of the third or fourth operation is greater than the preset speed B, the terminal device 100 can output a fourth prompt, which can be the prompt information 1111 shown in Figure 11H.
[0455] In some embodiments, after confirming that the first action parameter of the user's input operation to the wearable device 200 meets the first requirement and the second action parameter meets the second requirement, the terminal device 100 may prompt the user that the first operation has been correctly performed and exit the first action teaching mode. For example, this prompt message may be the prompt message 817 shown in FIG8R.
[0456] Using the method shown in the embodiment of Figure 12, the terminal device 100 can sequentially confirm whether each of the multiple action parameters of the user's input operation on the wearable device 200 meets the preset requirements. After confirming the preset requirements of one of the action parameters of the user's input operation on the wearable device 200, it then confirms whether the next action parameter of the user's next input operation on the wearable device 200 meets the preset requirements. In this way, the terminal device 100 can confirm whether multiple action parameters meet the preset requirements in multiple input operations of the user, which can more accurately guide the user to adjust the input operation on the wearable device, improve the accuracy of the user's control of the wearable device through actions, and also improve the interaction efficiency between the user and the wearable device.
[0457] It should be noted that the steps in the embodiments of Figure 12 are only used to explain this application, and this application does not limit the execution order of the steps in the embodiments of Figure 12.
[0458] Figure 13 shows a schematic diagram of the method flow for another interaction scenario three.
[0459] The method flow shown in Figure 13 includes, but is not limited to, the following steps.
[0460] S1301, terminal device 100 and wearable device 200 establish a communication connection.
[0461] S1302, Terminal device 100 receives the fifth operation and enters the first action teaching mode.
[0462] S1303, Terminal device 100 sends a first message to wearable device 200, the first message being used to instruct wearable device 200 to enter the first action teaching mode.
[0463] S1304, In response to the first message, the wearable device 200 enters the first action teaching mode.
[0464] S1305, the wearable device 200 receives the first operation and collects the first sensor data.
[0465] For a description of S1301-S1305, please refer to the description of S901-S905; this application will not repeat it here.
[0466] S1306, The wearable device 200 confirms, based on the data from the first sensor, whether the first action parameters of the first operation meet the first requirement.
[0467] For a description of S1306, please refer to the description of S1207; this application will not repeat it here.
[0468] If the first action parameter of the first operation does not meet the first requirement, the terminal device 100 and the wearable device 200 can execute S1307-S1311.
[0469] If the first action parameter of the first operation meets the first requirement, the terminal device 100 and the wearable device 200 can execute S1312-S1313.
[0470] S1307, Wearable device 200 sends a second message to terminal device 100.
[0471] S1308. In response to the second message, the terminal device 100 outputs a first prompt, which is used to instruct the user to adjust the first action parameter in the second operation when inputting the second operation.
[0472] If the first action parameter of the first operation does not meet the first requirement, the wearable device 200 may send a second message to the terminal device 100. In response to the second message, the terminal device 100 outputs a first prompt, which instructs the user to adjust the first action parameter of the second operation when inputting the second operation.
[0473] For an introduction to S1308, please refer to the description of S1208; this application will not repeat it here.
[0474] S1309, the wearable device 200 receives the second operation and collects the second sensor data.
[0475] S1310, the wearable device 200 confirms, based on the second sensor data, whether the first action parameter of the second operation meets the first requirement.
[0476] For a description of S1309 and S1310, please refer to the description of S1209 and S1211. This application will not repeat them here.
[0477] If the first action parameter of the second operation does not meet the first requirement, the wearable device 200 can execute S1311.
[0478] If the first action parameter of the second operation meets the first requirement, the terminal device 100 and the wearable device 200 can execute S1312-S1313.
[0479] S1311, the wearable device 200 executes S1308-S1310 again until it is confirmed that the first action parameter of the user's input operation to the wearable device 200 meets the first requirement.
[0480] For a description of S1311, please refer to the description of S1212; this application will not repeat it here.
[0481] S1312, Wearable device 200 sends a third message to terminal device 100.
[0482] S1313 In response to the third message, the terminal device 100 outputs a second prompt, which is used to indicate that the first action parameter of the first operation is correct or the first action parameter of the second operation is correct.
[0483] If the first action parameter of the first operation meets the first requirement, or the first action parameter of the second operation meets the first requirement, the wearable device 200 can send a third message to the terminal device 100. In response to the third message, the terminal device 100 can output a second prompt, which indicates that the first action parameter of the first operation or the first action parameter of the second operation is correct.
[0484] For a description of S1313, please refer to the description of S1213; this application will not repeat it here.
[0485] S1314, Wearable device 200 receives third operation and collects third sensor data.
[0486] S1315, The wearable device 200 confirms, based on the data from the third sensor, whether the second action parameters of the third operation meet the second requirement.
[0487] For a description of S1314 and S1315, please refer to the description of S1214 and S1216. This application will not repeat them here.
[0488] If the second action parameter of the third operation does not meet the second requirement, the terminal device 100 can execute S1316-S1320.
[0489] If the second action parameter of the third operation meets the second requirement, the terminal device 100 can execute S1321-S1322.
[0490] S1316, Wearable device 200 sends a fourth message to terminal device 100.
[0491] S1317. In response to the fourth message, the terminal device 100 outputs a third prompt, which is used to instruct the user to adjust the second action parameter of the fourth operation when inputting the fourth operation.
[0492] If the second action parameter of the third operation does not meet the second requirement, the wearable device 200 may send a fourth message to the terminal device 100. In response to the fourth message, the terminal device 100 may output a third prompt, which instructs the user to adjust the second action parameter of the fourth operation when inputting the fourth operation.
[0493] For a description of S1317, please refer to the description of S1217; this application will not repeat it here.
[0494] S1318, the wearable device 200 receives the fourth operation and collects data from the fourth sensor.
[0495] S1319, The wearable device 200, based on the data from the fourth sensor, confirms whether the second action parameter of the fourth operation meets the second requirement.
[0496] For a description of S1318 and S1319, please refer to the description of S1218 and S1220. This application will not repeat them here.
[0497] If the second action parameter of the fourth operation meets the second requirement, the wearable device 200 and the terminal device 100 can execute S1321-S1322.
[0498] If the second action parameter of the fourth operation does not meet the second requirement, the wearable device 200 can execute S1220.
[0499] S1320, the wearable device 200 executes S1318-S1319 again until it is confirmed that the second action parameter of the user's input operation on the wearable device 200 meets the second requirement.
[0500] For a description of S1320, please refer to the description of S1222; this application will not repeat it here.
[0501] S1321, Wearable device 200 sends a fifth message to terminal device 100.
[0502] S1322. In response to the fifth message, the terminal device 100 outputs a fourth prompt, which is used to indicate that the second action parameter of the third operation is correct or the second action parameter of the fourth operation is correct.
[0503] If the second action parameter of the third operation or the second action parameter of the fourth operation meets the second requirement, the wearable device 200 can send a fifth message to the terminal device 100. In response to the fifth message, the terminal device 100 can output a fourth prompt, which indicates that the second action parameter of the third operation or the second action parameter of the fourth operation is correct.
[0504] For a description of S1322, please refer to the description of S1222; this application will not repeat it here.
[0505] The embodiment in Figure 13 is similar to the embodiment in Figure 12, except that in the embodiment in Figure 12, after the terminal device 100 confirms the preset requirements for one action parameter of the user's input operation to the wearable device 200 based on sensor data, it then confirms whether the other action parameter of the user's next input operation to the wearable device 200 meets the preset requirements. In the embodiment in Figure 13, after the wearable device 200 confirms the preset requirements for one action parameter of the user's input operation to the wearable device 200 based on sensor data, it then confirms whether the other action parameter of the user's next input operation to the wearable device 200 meets the preset requirements.
[0506] It should be noted that the steps in the embodiment of Figure 13 are only used to explain this application, and this application does not limit the execution order of the steps in the embodiment of Figure 13.
[0507] Figure 14 shows a flowchart of an interactive method.
[0508] S1401, The terminal device sends the first message to the wearable device.
[0509] S1402. After receiving the first message, the wearable device receives a first operation input by the user. The first operation includes one or more action parameters, and the one or more action parameters of the first operation include the first action parameters.
[0510] S1403. If the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt. The first prompt is used to instruct the user to adjust the first action parameter of the second operation when inputting the second operation. The type of the second operation is the same as the type of the first operation.
[0511] Optionally, the wearable device may confirm that the first action parameter of the first operation does not meet the first requirement, or the terminal device may confirm that the first action parameter of the first operation does not meet the first requirement.
[0512] The first operation includes multiple action parameters, which may refer to the first operation including at least two action parameters.
[0513] When the first operation involves multiple action parameters, if the terminal device does not indicate which action parameter in the first operation is erroneous, the user will also be unable to determine which action parameter is incorrect. The user would then need to adjust the action parameters in their input operations to the wearable device sequentially. This method allows the terminal device to indicate which action parameter in the first operation is erroneous, enabling the user to identify the erroneous parameter and adjust it when performing a second operation on the wearable device. This allows the user to quickly and accurately adjust the action parameters in the second operation.
[0514] This method allows wearable devices or terminal devices to monitor which action parameters of the user's input operation on the wearable device do not meet the preset requirements, and to correct the action parameters that do not meet the preset requirements. This can more accurately guide the user to adjust the input operation on the wearable device, improve the accuracy of the user's control of the wearable device through actions, and also improve the interaction efficiency between the user and the wearable device.
[0515] In one possible implementation, the method further includes: if the first action parameter of the first operation does not meet the first requirement, the terminal device also outputs a first reason why the first action parameter of the first operation does not meet the first requirement.
[0516] In this way, the terminal device can also prompt the user about the reason for the error in the first action parameter during the first operation, so that the user can know why the operation is not up to standard.
[0517] In one possible implementation, after the wearable device receives the first message, the method further includes: the wearable device collecting first sensor data, the first sensor data being used to indicate one or more action parameters of the first operation; if the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: if it is confirmed based on the first sensor data that the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt.
[0518] In one possible implementation, the first sensor data is data collected by the wearable device during the process of receiving a first user operation.
[0519] Optionally, the first sensor data may include, but is not limited to, any one or more of the following: acceleration data, angular velocity data, etc.
[0520] In this way, the terminal device or wearable device can confirm, based on sensor data, whether one or more action parameters in the user's input operation on the wearable device meet the preset requirements.
[0521] In one possible implementation, after the terminal device outputs the first prompt, the method further includes: the wearable device receiving a second operation input by the user and acquiring second sensor data, the second sensor data being used to indicate one or more action parameters of the second operation, the one or more action parameters of the second operation including the first action parameter; if it is confirmed based on the second sensor data that the first action parameter of the second operation meets the first requirement, the terminal device outputs a second prompt, the second prompt being used to indicate that the first action parameter of the second operation is correct.
[0522] In this way, when the first operation includes multiple action parameters, the terminal device or wearable device can sequentially confirm whether each of the multiple action parameters of the user's input operation to the wearable device meets the preset requirements. For example, after confirming that the first action parameter of the user's input operation to the wearable device meets the first requirement, the terminal device or wearable device can then confirm whether the second action parameter of the user's input operation to the wearable device meets the second requirement. And if the terminal device or wearable device confirms that the first action parameter meets the first requirement, the terminal device outputs a second prompt.
[0523] In one possible implementation, after the terminal device outputs the second prompt, the method further includes: the wearable device receiving a third operation input by the user and acquiring third sensor data, the third sensor data being used to indicate one or more action parameters of the third operation, the one or more action parameters of the third operation including the second action parameter, the type of the third operation being the same as the type of the first operation; if it is confirmed based on the third sensor data that the second action parameter of the third operation does not meet the second requirement, the terminal device outputs a third prompt, the third prompt being used to instruct the user to adjust the second action parameter of the fourth operation when inputting the fourth operation, the type of the fourth operation being the same as the type of the first operation.
[0524] Thus, when the first operation includes multiple action parameters, the terminal device or wearable device can, after confirming that the first action parameter of the user's input operation to the wearable device meets the first requirement, then confirm whether the second action parameter of the user's input operation to the wearable device meets the second requirement. If it is confirmed that the second action parameter in the third operation does not meet the second requirement, a third prompt is output, which prompts the user to adjust the second action parameter in the input operation to the wearable device.
[0525] In one possible implementation, after the terminal device outputs the second prompt, the method further includes: the wearable device receiving a fourth operation input by the user and acquiring fourth sensor data, the fourth sensor data being used to indicate one or more action parameters of the fourth operation, the one or more action parameters of the fourth operation including the second action parameter; if it is confirmed based on the fourth sensor data that the second action parameter of the fourth operation meets the second requirement, the terminal device outputs a fourth prompt, the fourth prompt being used to indicate that the second action parameter of the fourth operation is correct.
[0526] Thus, when the first operation includes multiple action parameters, the terminal device or wearable device can, after confirming that the first action parameter of the user's input operation to the wearable device meets the first requirement, then confirm whether the second action parameter of the user's input operation to the wearable device meets the second requirement. And if it is confirmed that the second action parameter meets the second requirement, a fourth prompt is output.
[0527] In one possible implementation, one or more action parameters of the first operation further include a second action parameter; the method further includes: if it is confirmed that the first action parameter of the first operation meets the first requirement and the second action parameter of the first operation meets the second requirement, the terminal device outputs a fifth prompt, the fifth prompt being used to indicate that the first operation is correct.
[0528] In this way, when the first operation involves multiple action parameters, the terminal device or wearable device can monitor whether multiple action parameters meet preset requirements in a single operation. And when the terminal device or wearable device confirms that all multiple action parameters meet the preset requirements, the terminal device outputs a fifth prompt.
[0529] In one possible implementation, one or more action parameters of the first operation further include a second action parameter; the method further includes: if it is confirmed that the first action parameter of the first operation meets the first requirement and the second action parameter of the first operation does not meet the second requirement, the terminal device outputs a sixth prompt, the sixth prompt being used to instruct the user to adjust the second action parameter of the sixth operation when inputting the sixth operation, the type of the sixth operation being the same as the type of the first operation.
[0530] In this way, when the first operation includes multiple action parameters, the terminal device or wearable device can monitor whether the multiple action parameters meet the preset requirements in one operation, and when the terminal device or wearable device confirms that the second action parameter among the multiple action parameters does not meet the second requirement, the terminal device outputs a sixth prompt.
[0531] In one possible implementation, the wearable device receives a first message sent by the terminal device, specifically including: the terminal device receiving a fifth operation input by the user, and in response to the fifth operation, the wearable device receiving the first message sent by the terminal device.
[0532] In this way, the terminal device can send the first message to the wearable device after receiving the fifth operation input by the user.
[0533] In one possible implementation, after the terminal device receives the fifth operation input by the user, the method further includes: the terminal device entering a first action teaching mode, wherein the first requirement is obtained by the terminal device based on the first action teaching mode; after the wearable device obtains the first sensor data, the method further includes: the wearable device sending the first sensor data to the terminal device; if the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: if the terminal device confirms based on the first sensor data that the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt.
[0534] In this way, the terminal device can confirm that the first action parameter in the first operation does not meet the first requirement based on the first sensor data collected by the wearable device.
[0535] In one possible implementation, after the wearable device receives the first message, the method further includes: the wearable device entering a first action teaching mode, wherein the first requirement is obtained by the wearable device based on the first action teaching mode; if the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: if the wearable device confirms based on the first sensor data that the first action parameter of the first operation does not meet the first requirement, the wearable device sends a second message to the terminal device; in response to the second message, the terminal device outputs the first prompt.
[0536] In this way, the wearable device can confirm, based on the first sensor data collected by the wearable device, that the first action parameter in the first operation does not meet the first requirement. Upon confirming that the first action parameter in the first operation does not meet the first requirement, it sends a second message to the terminal device. The second message indicates that the first action parameter in the first operation does not meet the first requirement.
[0537] In one possible implementation, the type of the first operation includes any of the following: nodding operation, shaking operation, and waving operation.
[0538] In one possible implementation, the first action parameter of the first operation includes the movement angle of the first operation, and the second action parameter of the first operation includes the movement speed.
[0539] In one possible implementation, the type of the first operation includes a nodding operation, the first action parameter of the first operation includes a nodding angle, the second action parameter of the first operation includes a nodding speed, the first requirement includes a nodding angle greater than a preset angle, and the second requirement includes a nodding speed greater than a preset speed; or, the type of the first operation includes a head shaking operation, the first action parameter of the first operation includes a head shaking angle, the second action parameter of the first operation includes a head shaking speed, the first requirement includes a head shaking angle greater than a preset angle, and the second requirement includes a head shaking speed greater than a preset speed.
[0540] The various embodiments of this application can be combined arbitrarily to achieve different technical effects.
[0541] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).
[0542] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0543] In summary, the above description is merely an embodiment of the technical solution of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made based on the disclosure of this application should be included within the scope of protection of this application.
Claims
1. An interaction method, said method being applied to an interactive system, characterized in that, The interactive system includes a wearable device and a terminal device, and the wearable device and the terminal device establish a communication connection; the method includes: The terminal device sends a first message to the wearable device; After receiving the first message, the wearable device receives a first operation input by the user. The first operation includes one or more action parameters, and the one or more action parameters of the first operation include the first action parameter. If the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt. The first prompt is used to instruct the user to adjust the first action parameter of the second operation when inputting the second operation. The type of the second operation is the same as the type of the first operation.
2. The method according to claim 1, characterized in that, The method further includes: If the first action parameter of the first operation does not meet the first requirement, the terminal device also outputs a first reason why the first action parameter of the first operation does not meet the first requirement.
3. The method according to claim 1 or 2, characterized in that, After the wearable device receives the first message, the method further includes: The wearable device collects data from a first sensor, which is used to indicate one or more action parameters of the first operation. If the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: If, based on the data from the first sensor, it is confirmed that the first action parameter of the first operation does not meet the first requirement, the terminal device outputs the first prompt.
4. The method according to claim 3, wherein the first sensor data is data collected by the wearable device during the process of receiving the first user operation.
5. The method according to any one of claims 1-4, characterized in that, After the terminal device outputs the first prompt, the method further includes: The wearable device receives the second operation input by the user and acquires second sensor data. The second sensor data is used to indicate one or more action parameters of the second operation, and the one or more action parameters of the second operation include the first action parameter. If the first action parameter of the second operation is confirmed to meet the first requirement based on the second sensor data, the terminal device outputs a second prompt, which indicates that the first action parameter of the second operation is correct.
6. The method according to claim 5, characterized in that, After the terminal device outputs the second prompt, the method further includes: The wearable device receives a third operation input by the user and acquires third sensor data. The third sensor data is used to indicate one or more action parameters of the third operation. The one or more action parameters of the third operation include second action parameters. The type of the third operation is the same as the type of the first operation. If the second action parameter of the third operation is confirmed to not meet the second requirement based on the third sensor data, the terminal device outputs a third prompt. The third prompt is used to instruct the user to adjust the second action parameter of the fourth operation when inputting the fourth operation. The type of the fourth operation is the same as the type of the first operation.
7. The method according to claim 5 or 6, characterized in that, After the terminal device outputs the second prompt, the method further includes: The wearable device receives a fourth operation input by the user and acquires fourth sensor data, the fourth sensor data being used to indicate one or more action parameters of the fourth operation, the one or more action parameters of the fourth operation including a second action parameter; If the second action parameter of the fourth operation is confirmed to meet the second requirement based on the data from the fourth sensor, the terminal device outputs a fourth prompt, which indicates that the second action parameter of the fourth operation is correct.
8. The method according to any one of claims 1-4, characterized in that, One or more action parameters of the first operation further include a second action parameter; the method further includes: If it is confirmed that the first action parameter of the first operation meets the first requirement and the second action parameter of the first operation meets the second requirement, the terminal device outputs a fifth prompt, which is used to indicate that the first operation is correct.
9. The method according to any one of claims 1-4, characterized in that, One or more action parameters of the first operation further include a second action parameter; the method further includes: If it is confirmed that the first action parameter of the first operation meets the first requirement, and the second action parameter of the first operation does not meet the second requirement, the terminal device outputs a sixth prompt. The sixth prompt is used to instruct the user to adjust the second action parameter of the sixth operation when inputting the sixth operation. The type of the sixth operation is the same as the type of the first operation.
10. The method according to claim 3 or 4, characterized in that, The wearable device receives a first message sent by the terminal device, specifically including: The terminal device receives a fifth operation input by the user, and in response to the fifth operation, the wearable device receives the first message sent by the terminal device.
11. The method according to claim 10, characterized in that, After the terminal device receives the fifth operation input by the user, the method further includes: The terminal device enters the first action teaching mode, and the first requirement is obtained by the terminal device based on the first action teaching mode; After the wearable device acquires the first sensor data, the method further includes: The wearable device sends the first sensor data to the terminal device; If the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: If the terminal device confirms, based on the first sensor data, that the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt.
12. The method according to any one of claim 3, claim 4, or claim 10, characterized in that, After the wearable device receives the first message, the method further includes: The wearable device enters a first action teaching mode, and the first requirement is obtained by the wearable device based on the first action teaching mode; If the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: If the wearable device confirms, based on the first sensor data, that the first action parameter of the first operation does not meet the first requirement, the wearable device sends a second message to the terminal device; In response to the second message, the terminal device outputs the first prompt.
13. The method according to any one of claims 1-12, characterized in that, The first operation can be any of the following types: nodding, shaking, or waving.
14. The method according to claim 8 or 9, characterized in that, The first action parameter of the first operation includes the movement angle of the first operation, and the second action parameter of the first operation includes the movement speed.
15. The method according to any one of claim 8, claim 9, or claim 14, characterized in that, The first operation type includes a nodding operation, the first action parameter of the first operation includes a nodding angle, the second action parameter of the first operation includes a nodding speed, the first requirement includes a nodding angle greater than a preset angle, and the second requirement includes a nodding speed greater than a preset speed. or, The first operation includes a head-shaking operation, the first action parameter of the first operation includes a head-shaking angle, the second action parameter of the first operation includes a head-shaking speed, the first requirement includes a head-shaking angle greater than a preset angle, and the second requirement includes a head-shaking speed greater than a preset speed.
16. An interaction method, characterized in that, The method includes: The terminal device sends a first message to the wearable device, the first message being used to instruct the wearable device to receive a first operation input by the user, the first operation including one or more action parameters, the one or more action parameters of the first operation including the first action parameter; If the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt. The first prompt is used to instruct the user to adjust the first action parameter of the second operation when inputting the second operation. The type of the second operation is the same as the type of the first operation.
17. The method according to claim 16, characterized in that, The method further includes: If the first action parameter of the first operation does not meet the first requirement, the terminal device also outputs a first reason why the first action parameter of the first operation does not meet the first requirement.
18. The method according to claim 16 or 17, characterized in that, If the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: If, based on the first sensor data, it is confirmed that the first action parameter of the first operation does not meet the first requirement, the terminal device outputs the first prompt, wherein the first sensor data is used to indicate one or more action parameters of the first operation, and the first sensor data is collected by the wearable device after receiving the first message.
19. The method according to claim 18, characterized in that, The first sensor data is the data collected by the wearable device during the process of receiving the first user's operation.
20. The method according to any one of claims 16-19, characterized in that, After the terminal device outputs the first prompt, the method further includes: If the first action parameter of the second operation is confirmed to meet the first requirement based on the second sensor data, the terminal device outputs a second prompt. The second prompt is used to indicate that the first action parameter of the second operation is correct. The second operation is an operation in which the wearable device receives user input after the terminal device outputs the first prompt. The second sensor data is used to indicate one or more action parameters of the second operation, and the one or more action parameters of the second operation include the first action parameter.
21. The method according to claim 20, characterized in that, After the terminal device outputs the second prompt, the method further includes: If the second action parameter of the third operation is confirmed to not meet the second requirement based on the third sensor data, the terminal device outputs a third prompt. The third prompt is used to instruct the user to adjust the second action parameter of the fourth operation when inputting the fourth operation. The type of the fourth operation is the same as the type of the first operation. The third operation is the operation input by the wearable device after the terminal device outputs the second prompt. The third sensor data is used to indicate one or more action parameters of the third operation, and the one or more action parameters of the third operation include the second action parameter.
22. The method according to claim 20 or 21, characterized in that, After the terminal device outputs the second prompt, the method further includes: If the second action parameter of the fourth operation is confirmed to meet the second requirement based on the fourth sensor data, the terminal device outputs a fourth prompt, which indicates that the second action parameter of the fourth operation is correct. The fourth operation is an operation in which the wearable device receives user input after the terminal device outputs the second prompt. The fourth sensor data is used to indicate one or more action parameters of the fourth operation, and the one or more action parameters of the fourth operation include the second action parameter.
23. The method according to any one of claims 16-19, characterized in that, One or more action parameters of the first operation further include a second action parameter; the method further includes: If it is confirmed that the first action parameter of the first operation meets the first requirement and the second action parameter of the first operation meets the second requirement, the terminal device outputs a fifth prompt, which is used to indicate that the first operation is correct.
24. The method according to any one of claims 16-19, characterized in that, One or more action parameters of the first operation further include a second action parameter; the method further includes: If it is confirmed that the first action parameter of the first operation meets the first requirement, and the second action parameter of the first operation does not meet the second requirement, the terminal device outputs a sixth prompt. The sixth prompt is used to instruct the user to adjust the second action parameter of the sixth operation when inputting the sixth operation. The type of the sixth operation is the same as the type of the first operation.
25. The method according to claim 18 or 19, characterized in that, The wearable device receives a first message sent by the terminal device, specifically including: The terminal device receives a fifth operation input by the user, and in response to the fifth operation, the wearable device receives the first message sent by the terminal device.
26. The method according to claim 25, characterized in that, After the terminal device receives the fifth operation input by the user, the method further includes: The terminal device enters the first action teaching mode, and the first requirement is obtained by the terminal device based on the first action teaching mode; The terminal device receives the first sensor data sent by the wearable device; If the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: If the terminal device confirms, based on the first sensor data, that the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt.
27. The method according to any one of claim 18, claim 19, or claim 25, characterized in that, If the first action parameter of the first operation does not meet the first requirement, the terminal device outputs a first prompt, specifically including: The terminal device receives a second message sent by the wearable device, the second message being sent after the wearable device confirms, based on the first sensor data, that the first action parameter of the first operation does not meet the first requirement; In response to the second message, the terminal device outputs the first prompt.
28. The method according to any one of claims 16-27, characterized in that, The first operation can be any of the following types: nodding, shaking, or waving.
29. The method according to claim 23 or 24, characterized in that, The first action parameter of the first operation includes the movement angle of the first operation, and the second action parameter of the first operation includes the movement speed.
30. The method according to any one of claim 23, 24, or 29, characterized in that, The first operation type includes a nodding operation, the first action parameter of the first operation includes a nodding angle, the second action parameter of the first operation includes a nodding speed, the first requirement includes a nodding angle greater than a preset angle, and the second requirement includes a nodding speed greater than a preset speed. or, The first operation includes a head-shaking operation, the first action parameter of the first operation includes a head-shaking angle, the second action parameter of the first operation includes a head-shaking speed, the first requirement includes a head-shaking angle greater than a preset angle, and the second requirement includes a head-shaking speed greater than a preset speed.
31. A terminal device, characterized in that, The terminal device includes a processor and a memory coupled to the processor. The memory is used to store computer program code, the computer program code including computer instructions. When the processor reads the computer instructions from the memory, the terminal device performs the method as described in any one of claims 1 to 30.
32. A computer-readable storage medium, characterized in that, Includes computer instructions that, when executed on a terminal device, cause the terminal device to perform the method as described in any one of claims 1 to 30.
33. A computer program product, characterized in that, Includes computer instructions that, when executed on a terminal device, cause the terminal device to perform the method as described in any one of claims 1 to 30.