Gesture interaction method and apparatus, electronic device, medium, and product

Abstract

Embodiments of the present application provide a gesture interaction method and device, electronic equipment, medium and product. The method comprises: collecting wrist motion data, and identifying a first gesture type according to the wrist motion data; determining a current first situational state according to at least one of current time, schedule data, motion state and social distance; determining a first function action triggered by the first gesture type in the first situational state based on a pre-set mapping relationship between gesture type, situational state and function action; and executing the first function action to realize interaction. The method of the present application uses a two-dimensional function mapping relationship of gesture-situation to improve the richness and intelligence of gesture interaction.

Description

Technical Field

[0001] This application relates to the field of interaction, and more particularly to a gesture interaction method, device, electronic device, medium, and product. Background Technology

[0002] The core application scenario for smart wearable devices is when users are exercising or have their hands busy, making it difficult to operate them by touching the screen or pressing buttons. Therefore, gesture operation has become one of the common interaction methods between users and smart wearable devices.

[0003] Currently, the mapping between gestures and functions is often singular, meaning that a single gesture can only trigger one fixed function. To meet users' diverse functional needs, the only solution is to expand the number of gestures. However, this requires users to learn and memorize many gestures, significantly increasing the rate of accidental touches and severely impacting the user experience. Summary of the Invention

[0004] This application provides a gesture interaction method, device, electronic device, medium, and product for using a two-dimensional function mapping relationship between gestures and contexts to enhance the richness and intelligence of gesture interaction.

[0005] Firstly, this application provides a gesture interaction method, including:

[0006] Collect wrist movement data, and identify the first gesture type based on the wrist movement data;

[0007] Determine the current first situational state based on at least one of the following: current time, schedule data, activity status, and social distancing.

[0008] Based on the pre-defined mapping relationship between gesture type, context state and functional action, determine the first functional action triggered by the first gesture type in the first context state;

[0009] Perform the first functional action to achieve interaction.

[0010] Optionally, determining the current first situational state based on at least one of the following: current time, schedule data, movement status, and social distance, includes:

[0011] Based on the current time, determine the current time period, wherein the time period is divided into at least one of the following: morning time period, commuting time period, work / study time period, leisure time period, and nighttime time period;

[0012] And / or, read the user-set schedule data, and determine whether the current event is a specific schedule event based on the schedule data;

[0013] And / or, determine the current motion state based on the wrist motion data;

[0014] And / or, detect whether there are other smart devices currently within a preset social distance;

[0015] The first situational state is determined based on at least one of the following: the current time period, whether the current person is in a specific scheduled event, the current state of motion, and whether the current distance between other smart devices is less than the preset social distance.

[0016] Optionally, the contextual state includes at least one of the following: morning / seated state, work meeting state, exercise state, and near-field social state.

[0017] Optionally, the pre-defined mapping relationship between gesture types, contextual states, and functional actions includes:

[0018] When the gesture type is horizontal shaking and the context state is morning / sitting state, the corresponding function is to turn off the alarm clock and announce the weather and / or schedule.

[0019] When the gesture type is vertical shaking and the context state is morning / quiet state, the corresponding function is to turn Do Not Disturb mode on / off.

[0020] When the gesture type is rotation and shaking, and the context state is morning / meditation state, the corresponding function is to randomly switch the screen display scheme.

[0021] When the gesture type is a single wrist shake and the context state is morning / sitting state, the corresponding function is screen-on display time.

[0022] Optionally, the pre-defined mapping relationship between gesture types, contextual states, and functional actions includes:

[0023] When the gesture type is horizontal shaking and the context state is a work meeting state, the corresponding function is to mute incoming calls and send a preset reply SMS.

[0024] When the gesture type is vertical shaking and the context state is a work meeting state, the corresponding function is to reject incoming calls;

[0025] When the gesture type is rotation and shaking, and the context state is a work meeting state, the corresponding function action is to start recording;

[0026] When the gesture type is a single wrist shake and the context is a work meeting, the corresponding function is to view the latest notifications.

[0027] Optionally, the pre-defined mapping relationship between gesture types, contextual states, and functional actions includes:

[0028] When the gesture type is horizontal shaking and the context state is a motion state, the corresponding function is to switch to the next song;

[0029] When the gesture type is vertical shaking and the context state is a motion state, the corresponding function is to switch to the previous song;

[0030] When the gesture type is rotation and shaking and the context state is a motion state, the corresponding function is to pause / resume motion timing;

[0031] When the gesture type is a single wrist shake and the context state is a motion state, the corresponding function is to mark the current location waypoint.

[0032] Optionally, the pre-defined mapping relationship between gesture types, contextual states, and functional actions includes:

[0033] When the gesture type is horizontal shaking and the context state is near-field social state, the corresponding function is to initiate a business card exchange request.

[0034] When the gesture type is vertical shaking and the context state is near-field social state, the corresponding function is to initiate motion data PK;

[0035] When the gesture type is rotation and shaking and the context state is near-field social state, the corresponding function is to initiate a quick mini-game invitation;

[0036] When the gesture type is a single wrist shake and the context state is a near-field social state, the corresponding function is to send a quick greeting to the other party.

[0037] Optionally, determining the current first situational state based on at least one of the following: current time, schedule data, movement status, and social distance, includes:

[0038] If at least one of the current time, the schedule data, the movement status, and the social distance meets multiple preset situational states, then the one with the highest priority among the multiple preset situational states shall be taken as the first situational state.

[0039] Optionally, the method further includes:

[0040] A two-dimensional mapping matrix is ​​established, wherein different rows of the two-dimensional mapping matrix correspond to different gesture types, different columns of the two-dimensional mapping matrix correspond to different context states, and different elements of the two-dimensional mapping matrix correspond to different functional actions;

[0041] The method of determining the corresponding first functional action based on the first gesture type and the first context state, according to the pre-defined mapping relationship between gesture type, context state, and functional action, includes:

[0042] Based on the two-dimensional mapping matrix, the corresponding first functional action is determined according to the row where the first gesture type is located and the column where the first context state is located.

[0043] Optionally, determining the first functional action triggered by the first gesture type in the first context state includes:

[0044] If the first gesture type is the target gesture type, then the first function action is determined to be an emergency help request, and the system enters the emergency safety mode, executing preset safety actions until the user performs an emergency safety mode exit operation.

[0045] Optionally, the preset safety actions include:

[0046] Send real-time location information to preset emergency contacts;

[0047] And / or, call the first contact in the emergency contact list; if no answer is received, call the next contact in the list.

[0048] And / or, activate the microphone to record ambient sounds, encrypt and store the recording file locally, and upload the recording file to cloud storage when the network is available;

[0049] And / or, display a help icon and current coordinates on the screen.

[0050] Secondly, this application provides a gesture interaction device, comprising:

[0051] The receiving module is used to collect wrist movement data and identify the first gesture type based on the wrist movement data;

[0052] The first determination module is used to determine the current first situational state based on at least one of the current time, schedule data, movement status and social distance;

[0053] The second determining module is used to determine the first functional action triggered by the first gesture type in the first context state based on the pre-set mapping relationship between gesture type, context state and functional action.

[0054] The execution module is used to perform the first functional action to achieve interaction.

[0055] Thirdly, this application provides an electronic device, including: a processor, and a memory communicatively connected to the processor;

[0056] The memory stores computer-executed instructions;

[0057] The processor executes computer execution instructions stored in the memory to implement the method described above.

[0058] Fourthly, this application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the method described above.

[0059] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the method described above.

[0060] The gesture interaction method, device, electronic device, medium, and product provided in this application perform functional mapping from two dimensions: gesture type and context state. As a result, the same gesture can trigger different functions in different contexts, effectively improving the information carrying capacity of gestures, reducing the number of gestures that users need to learn, and maintaining a high degree of differentiation between different gestures, reducing accidental touches, thereby improving user experience and enhancing the intelligence of gesture interaction. Attached Figure Description

[0061] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0062] Figure 1 This is a flowchart illustrating the gesture interaction method provided in an embodiment of this application.

[0063] Figure 2 This is a schematic diagram of a gesture control linkage device provided in an embodiment of this application.

[0064] Figure 3 This is a schematic diagram of the two-dimensional function mapping process provided in the embodiments of this application.

[0065] Figure 4 This is a schematic diagram of the gesture-triggered social interaction process provided in an embodiment of this application.

[0066] Figure 5 This is a schematic diagram of the structure of the gesture interaction device provided in the embodiments of this application.

[0067] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0068] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0069] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0070] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, storage, use, processing, transmission, provision, disclosure, and application of the relevant data all comply with the relevant laws, regulations, and standards of the relevant countries and regions, have taken necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation access points for users to choose to authorize or refuse.

[0071] Furthermore, the technical solution involved in this application, which involves big data analysis of user information (including but not limited to personal biometrics, identity data, consumption data, asset data, electronic terminal operation data, etc.) and uses distributed technology for automated decision-making, and makes decisions that have a significant impact on personal rights based on the results of automated decision-making, provides users with corresponding operation entry points for users to choose to agree to or reject the results of automated decision-making; if the user chooses to reject, the process will proceed to the expert decision-making process.

[0072] It should be noted that the gesture interaction methods, devices, electronic devices, media and products provided in this application can be used in the field of interaction, or in any field other than interaction, such as the field of wearable devices. The application fields of the gesture interaction methods, devices, electronic devices, media and products in this application are not limited.

[0073] The core application scenario for smart wearable devices is when users are exercising or have their hands busy, making it difficult to operate them by touching the screen or pressing buttons. Therefore, gesture operation has become one of the common interaction methods between users and smart wearable devices.

[0074] Currently, the mapping between gestures and functions is often singular, meaning that a single gesture can only trigger one fixed function. To meet users' diverse functional needs, the only solution is to expand the number of gestures. However, this requires users to learn and memorize many gestures, significantly increasing the rate of accidental touches and severely impacting the user experience.

[0075] The gesture interaction methods, devices, electronic devices, media, and products provided in this application aim to solve the aforementioned technical problems of the prior art. Analysis shows that users often have different functional needs in different contexts. Therefore, an additional contextual state dimension can be introduced, mapping functions from both gesture type and contextual state dimensions. This allows the same gesture to trigger different functions in different contexts, effectively improving the information carrying capacity of gestures, reducing the number of gestures users need to learn, maintaining greater differentiation between different gestures, reducing accidental touches, thereby improving user experience and enhancing the intelligence of gesture interaction.

[0076] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0077] Figure 1 This is a flowchart illustrating the gesture interaction method provided in an embodiment of this application. The executing entity of this method can be a smart wearable device, specifically a system of that smart wearable device. Smart wearable devices can be, for example, smartwatches, smart bracelets, or other smart devices worn on a user's hand, wrist, or arm; this is not limited to these specific devices. Figure 1 As shown, the method includes:

[0078] Figure 1 This is a flowchart illustrating a gesture interaction method provided in an embodiment of this application. Figure 1 As shown, the method includes:

[0079] S101. Collect wrist movement data and identify the first gesture type based on the wrist movement data.

[0080] For example, wrist movement data may include accelerometer data and gyroscope data. Smart wearable devices can collect wrist movement data in real time through built-in three-axis accelerometers and three-axis gyroscopes, and accurately recognize various basic shaking gestures by using sliding window framing and multi-dimensional feature extraction algorithms.

[0081] For example, gesture types may include horizontal shaking, vertical shaking, rotational shaking, single wrist flick, continuous rapid shaking, etc.

[0082] Among them, when the user's wrist is shaken horizontally, the main feature is that the accelerometer X-axis shows periodic alternating positive and negative peaks, and the single shaking period is within the first preset threshold range, such as 0.3-0.5 seconds.

[0083] When the user's wrist is moved up and down in the vertical direction during vertical shaking, the main characteristic is that the accelerometer Z-axis exhibits periodic alternating positive and negative peak characteristics;

[0084] When the user's wrist rotates and shakes, it makes a rapid reciprocating motion along the forearm axis. The main characteristic is that the gyroscope's yaw axis angular velocity (yaw rate) shows alternating peaks.

[0085] A single wrist flick is characterized by a rapid swing of the wrist, with the acceleration curve exhibiting a single-peak pulse characteristic and the duration of the action being less than a second preset threshold, such as 0.3 seconds.

[0086] The main characteristic of continuous rapid shaking is that multiple acceleration peaks are detected within a preset time window (e.g., more than 5 times within 3 seconds) and the peak distribution is relatively uniform.

[0087] S102. Determine the current first situational state based on at least one of the following: current time, schedule data, movement status, and social distance.

[0088] For example, social distance refers to the distance between other smart devices with their wireless communication functions enabled, as detected when the near-field wireless communication function (such as Bluetooth) of a smart wearable device is turned on.

[0089] For example, when the motion monitoring function of a smart wearable device is enabled, the motion state can be determined by obtaining the motion monitoring results of the motion monitoring function, which can effectively reduce power consumption, reduce hardware resource conflicts, and improve data consistency.

[0090] Understandably, user behavior can be inferred directly or indirectly based on current time, schedule data, activity status, and / or social distance, thereby determining the first context state.

[0091] The first contextual state can be determined based on a single condition. For example, if the current time is 7:00, the first contextual state is the "morning state." Alternatively, if the social distance is close, the first contextual state can be inferred to be the "near-field social state," where pairing and data transmission between the two devices are possible.

[0092] Optionally, multiple conditions can be combined to determine the first situational state. For example, if a user sets their schedule as: meeting from 10:00 to 11:00 today, and workout from 12:00 to 13:00, and the current time is 10:20, then the first situational state can be inferred to be the meeting state.

[0093] In one possible implementation, the current first contextual state is determined based on at least one of the following: current time, schedule data, motion status, and social distancing, including:

[0094] Based on the current time, determine the current time period, which is divided into at least one of the following: morning period, commuting period, work / study period, leisure period, and nighttime period;

[0095] And / or, read the user-set schedule data, and determine whether the current event is a specific schedule event based on the schedule data;

[0096] And / or, determine the current motion state based on wrist movement data;

[0097] And / or, detect whether there are other smart devices currently within a preset social distance;

[0098] The first situational state is determined based on at least one of the following: the current time period, whether the current person is in a specific scheduled event, the current state of motion, and whether there are other smart devices within a preset social distance.

[0099] For example, time periods can be divided into morning hours (07:30-09:00), work hours (09:30-18:30), commuting hours (09:00-09:30 and 18:30-19:00), leisure hours (19:00-22:00), and nighttime hours (22:00-07:30 the next day). The specific time period divisions can be customized by the user or learned from historical user behavior data.

[0100] For example, schedule data can be read from calendar apps or other apps with scheduling functions. Specific schedule events refer to pre-set schedule events by the user, such as meetings, appointments, and exercise. Determining whether the user is currently in a specific schedule event can be done by combining the schedule data with the current time.

[0101] S103. Based on the pre-defined mapping relationship between gesture type, context state and functional action, determine the first functional action triggered by the first gesture type in the first context state.

[0102] For example, the mapping relationship between gesture type, context state, and functional action can be obtained based on training with large-scale user behavior data. Alternatively, it can be obtained by statistically analyzing the predetermined number of functional actions performed most frequently by users in different context states and establishing a mapping relationship between these functional actions and context states and gestures. Users can also adjust the mapping based on the system's recommended default configuration; no restrictions are placed on this.

[0103] S104. Execute the first functional action to achieve interaction.

[0104] For example, depending on the configuration, a user's gestures can trigger interactions with the smart wearable device, or with other smart terminals linked to it. In this case, the smart wearable device only serves the function of gesture recognition. For instance, a user can interact with a smartwatch using gestures; they can also control their phone with gestures. The smartwatch recognizes the user's gestures and sends the recognition results to the phone.

[0105] The following is combined with Figure 2 The present application provides an exemplary description of the scenarios for the gesture control linkage device provided in the embodiments.

[0106] Figure 2 This is a schematic diagram of a scene for a gesture control linkage device provided in an embodiment of this application. Figure 2 As shown, the system is mainly divided into smartwatch terminal, smartphone terminal, and cloud / end-side learning terminal.

[0107] The smartwatch is responsible for data collection and initial recognition, as well as gesture monitoring.

[0108] 1) The underlying hardware layer of the smartwatch has a built-in inertial sensor that senses the physical movement of the wrist through an accelerometer and a gyroscope.

[0109] 2) Continuously acquire the original motion waveform data output by the sensor in real time at a set sampling rate (e.g., 100Hz).

[0110] 3) Clean and reduce noise (e.g., low-pass filtering) the raw data to remove high-frequency environmental interference and achieve data acquisition and preprocessing.

[0111] 4) Cut the continuous data stream into data frames of fixed time length (such as a 1-second window) to achieve sliding window frame division, which facilitates segmented analysis.

[0112] 5) Convert the segmented data frames into machine-readable "time-frequency feature vectors" (such as peak amplitude, zero-crossing rate, spectral energy, etc.) and extract features.

[0113] 6) Input the feature vector into the lightweight gesture recognition model pre-deployed on the input side of the watch for inference.

[0114] 7) The model outputs gesture events (such as "horizontal shake") and confidence scores. This output will be used as a trigger signal to transmit the mapping steps to the smartphone.

[0115] On smartphones, it is responsible for context matching and interaction decisions. That is, it determines which function to perform based on the complex environment in which the user is currently located, and monitors the user's true intentions.

[0116] 1) Collect current environmental information comprehensively to achieve multi-dimensional context awareness. Current environmental information includes Ct (time context), Cm (motion status), Cs (social distance), and Ce (safety level).

[0117] 2) Generate a context state vector (C = (Ct, Cm, Cs, Ce)): Integrate the above multi-dimensional environmental information into a unified vector expression.

[0118] 3) Receive gesture commands from the watch, combine them with the environment vector, and search for the corresponding operation logic in a preset two-dimensional matrix to achieve context-gesture mapping matrix matching.

[0119] 4) Determine the final task to be performed (e.g., morning + horizontal shaking = turn off the alarm) to match the interactive function goal.

[0120] 5) Enter the intent verification window and determine whether the user cancels the interaction by taking a reverse action or clicking the screen within a predetermined time (e.g., 3 seconds).

[0121] If not revoked: Mark as valid sample: The system considers this identification to be accurate and in line with the user's expectations, packages the waveform data of this sensor as a positive sample, and executes the interactive function.

[0122] If the error is revoked: it is marked as a false trigger sample: the system realizes that a misjudgment has occurred (e.g., the user just flicked a drop of water), packages the erroneous waveform data that caused the misjudgment as a negative sample, and immediately terminates the task and intercepts the interaction to prevent disturbing the user.

[0123] The positive and negative samples mentioned above will be merged into the "positive sample stream" and "negative sample stream" respectively, and uploaded to the cloud / end-side learning terminal.

[0124] Cloud / device-side learning terminal: Used to receive feedback data, perform personalized evolution and closed-loop updates, so that the watch's recognition is more in line with the user's specific habits.

[0125] 1) The adaptive modeling cycle, also known as the cold start phase, involves accumulating initial data.

[0126] 2) Based on the data from the cold start phase, establish the first customized baseline for the user and generate an initial personalized model.

[0127] 3) The cloud / back-end incremental learning engine receives the initial personalized model and continuously receives positive and negative sample streams from the mobile device for retraining.

[0128] 4) Revise the previous judgment boundary to generate a personalized baseline that is more tolerant of errors and more accurate in identifying the user.

[0129] 5) Output the final new model parameters and send them back to the gesture recognition model on the watch to replace the old model, thereby updating the personalized model parameters and completing the personalized adaptive system closed loop.

[0130] In this embodiment, function mapping is performed from two dimensions: gesture type and context state. As a result, the same gesture can trigger different functions in different contexts, which effectively improves the information carrying capacity of gestures, reduces the number of gestures that users need to learn, and maintains a high degree of differentiation between different gestures, reducing accidental touches, thereby improving user experience and enhancing the intelligence of gesture interaction.

[0131] In some embodiments, determining the current first contextual state based on at least one of current time, schedule data, motion status, and social distancing includes:

[0132] If at least one of the current time, schedule data, movement status, and social distance meets multiple preset situational states, then the one with the highest priority among the multiple preset situational states will be used as the first situational state.

[0133] For example, the priority of the context state corresponding to the schedule data can be set higher than the current time, because the schedule data is user-defined and more effectively reflects the user's actual behavior; the time period in which the current time is located may be learned from the user's historical behavior data, which has a certain lag. For example, suppose the current time is nighttime, but the user's schedule data is set to exercise, then there is a high probability that the user has chosen to go to bed late today, and the user is actually exercising. Therefore, the first context state is determined to be the exercise state based on the schedule data.

[0134] For example, the contextual state corresponding to the activity status can be prioritized over schedule data and the current time. This is because a user may neither execute their scheduled activities nor follow their usual behavior, while the activity status is determined by real-time monitoring of the user's activity data, making it highly reliable. For instance, suppose the current time is during working hours, the user's schedule data is set to a meeting, but their activity status is set to walking. In this case, the user may finish work early and go home. Therefore, based on the activity status, the first contextual state is determined to be commuting / activity.

[0135] In this embodiment of the application, by setting the priority of the context state, it is possible to correspond to multiple context states among at least one of the current time, schedule data, movement status and social distance. When there is a conflict, the current first context state is accurately determined, which is more in line with the user's actual behavior.

[0136] In some embodiments, the method further includes:

[0137] Establish a two-dimensional mapping matrix. Different rows of the two-dimensional mapping matrix correspond to different gesture types, different columns of the two-dimensional mapping matrix correspond to different context states, and different elements of the two-dimensional mapping matrix correspond to different functional actions.

[0138] Based on a pre-defined mapping relationship between gesture types, contextual states, and functional actions, the corresponding first functional action is determined according to the first gesture type and the first contextual state, including:

[0139] Based on the two-dimensional mapping matrix, the corresponding first functional action is determined according to the row where the first gesture type is located and the column where the first context state is located.

[0140] For example, for a two-dimensional mapping relationship between gestures and contexts, a two-dimensional mapping matrix can be stored in memory using a two-dimensional array.

[0141] Taking C language as an example, a two-dimensional array can be in the form of int a[m][n]. That is, a is an array containing m elements, and each element is an array containing n ints. Here, m corresponds to the number of gesture types, and n corresponds to the number of context states. The logic for accessing the two-dimensional array a[i][j] is as follows: first find the i-th element in the outer array, and then find the j-th element in that array.

[0142] For example, the two-dimensional mapping relationship between gestures and contexts can also be stored using key-value pairs.

[0143] In this context, gestures and contextual states are the keys in key-value pairs, and the corresponding functional actions are the values ​​in key-value pairs.

[0144] The following example illustrates the gesture-context two-dimensional function mapping relationship provided in this application embodiment, using context states including morning / sitting state, work meeting state, exercise state, and near-field social state as examples.

[0145] Table 1

[0146]

[0147] Table 1 exemplarily illustrates a gesture-context two-dimensional function mapping relationship provided in an embodiment of this application. As shown in Table 1, when the gesture type is horizontal shaking and the context state is morning / seated state, the corresponding function action is to turn off the alarm clock and announce the weather and / or schedule;

[0148] When the gesture type is vertical shaking and the context is morning / quiet state, the corresponding function is to turn Do Not Disturb mode on / off.

[0149] When the gesture type is rotation and shaking, and the context is morning / sitting state, the corresponding function is to randomly switch the screen display scheme.

[0150] When the gesture type is a single wrist shake and the context is morning / sitting state, the corresponding function is to turn on the screen to display the time.

[0151] Understandably, during morning / meditation sessions, users' needs include: turning off the alarm and listening to the weather report upon waking; maintaining sleep or meditation by turning on Do Not Disturb mode to prevent message interruptions, or ending sleep or meditation by turning off Do Not Disturb mode to receive messages; randomly switching screen display schemes after waking or during meditation to enhance the sense of novelty; and checking the time upon waking to determine if they need to get up. Furthermore, it is inconvenient for users to fumble around on the screen or buttons upon waking. Therefore, gestures can trigger these functions when the context is morning / meditation, reducing the number of steps and reliance on fine motor skills, thus improving the user experience.

[0152] For example, a user sets an alarm for 7:00 AM every morning. When the alarm rings, the user doesn't need to open their eyes to find the watch screen; they simply need to shake their wrist horizontally twice. The system recognizes the horizontal shaking gesture and queries the current context: Time context Ct = morning hours, Activity status Cm = sitting / lying down, Social distance Cs = 0, Safety level Ce = 0. Based on the mapping relationship, the system determines the function to "turn off the alarm + announce the day's weather and the top three schedules via voice." The alarm is silenced, and the watch announces through its speaker: "Today is sunny, temperature 12-22 degrees Celsius. Department weekly meeting at 9:00 AM, client visit at 2:00 PM, product review at 4:00 PM." The user doesn't need to touch the screen during the entire interaction.

[0153] As shown in Table 1, when the gesture type is horizontal shaking and the context is a work meeting, the corresponding function is to mute incoming calls and send a preset reply SMS.

[0154] When the gesture type is vertical shaking and the context is a work meeting, the corresponding function is to reject the incoming call.

[0155] When the gesture type is rotation and shaking and the context is a work meeting, the corresponding function is to start recording.

[0156] When the gesture type is a single wrist shake and the context is a work meeting, the corresponding function is to view the latest notifications.

[0157] Understandably, during work and / or meetings, users primarily need to: mute useful calls and automatically reply with an SMS (e.g., "I'm in a meeting, please call back later"), and hang up on irrelevant calls to avoid interrupting work / meetings; record key points from work / meetings; and view the latest notifications to quickly receive important information and avoid missing anything. Furthermore, these actions need to be performed with minimal movement to avoid being impolite. Therefore, gestures can be used to trigger these functions when the context is a work / meeting, enhancing the user experience.

[0158] For example, a user is attending a department meeting, and the calendar event is marked as "in meeting." When a call comes in and the system vibrates, the user shakes their wrist horizontally once. The system recognizes the horizontal shaking gesture and queries the current context: time context Ct = work period and calendar event is "in meeting," and motion state Cm = sitting. Based on the mapping relationship, the system determines the function to be "mute incoming calls + send a preset text message 'in meeting, will reply later' to the caller." The incoming call is muted, and the text message is automatically sent, so the user doesn't need to raise their wrist to check the screen, thus not interrupting the meeting.

[0159] As shown in Table 1, when the gesture type is horizontal shaking and the context state is motion state, the corresponding function is to switch to the next song;

[0160] When the gesture type is vertical shaking and the context state is motion state, the corresponding function is to switch to the previous song;

[0161] When the gesture type is rotation and shaking and the context state is motion state, the corresponding function is to pause / resume motion timing;

[0162] When the gesture type is a single wrist shake and the context state is a motion state, the corresponding function is to mark the current location waypoint.

[0163] Understandably, in sports scenarios (such as running), users' main needs are to listen to music, keep track of their workout time, and mark waypoints. Since users' hands are not convenient for tapping the screen or pressing buttons while exercising, these functions can be triggered by gestures to improve the user experience.

[0164] For example, a user is running, and the watch is in sports mode. During the run, the user swings their wrist horizontally. The system recognizes the gesture and queries the context: sports status Cm = running. At this point, the system automatically increases the peak acceleration threshold for wrist movement recognition from the static 1.5g to 2.5g to filter out interference from arm swinging during running. The function is confirmed as "Switch to the next song". The music immediately changes, and the watch plays the next song through the connected Bluetooth headphones. The user does not need to stop running or raise their wrist to operate.

[0165] As shown in Table 1, when the gesture type is horizontal shaking and the context state is near-field social state, the corresponding function is to initiate a business card exchange request.

[0166] When the gesture type is vertical shaking and the context state is near-field social state, the corresponding function action is to initiate motion data PK;

[0167] When the gesture type is rotation and shaking and the context state is near-field social state, the corresponding function is to initiate a quick mini-game invitation;

[0168] When the gesture type is a single wrist flick and the context is a near-field social state, the corresponding function is to send a quick greeting to the other party.

[0169] Understandably, in the near-field social ready state, the user's main need is to socialize with matched users. Therefore, different gestures are used to trigger different social functions in this context, effectively improving the convenience of user social interaction.

[0170] For example, the following is combined with Figure 4 This paper explains the complete process of social interaction triggered by simultaneous gestures between two smart devices.

[0171] Figure 4 This is a schematic diagram illustrating the process of triggering social interaction through gestures, as provided in an embodiment of this application. Figure 4 As shown, the process includes the following steps:

[0172] Step E1: Device A and Device B continuously broadcast their custom service UUIDs via BLE broadcast packets. When the other party enters the BLE reachable range, the two parties establish a BLE connection and enter the "near-field social ready" state.

[0173] Step E2: If a UWB module is supported, further perform UWB ranging to refine the judgment threshold to within 2 meters and reduce false matching by irrelevant devices;

[0174] Step E3: When device A detects a valid shake gesture, it sends a "shake event" message to the ready device B via the BLE connection. The message includes a timestamp T_A and the gesture type.

[0175] Step E4: After receiving the message, device B checks whether it has also detected the same type of shake gesture within the time window of |T_A - T_B| < 2 seconds. If yes, it is determined that "both parties shake simultaneously", and the handshake is successful; otherwise, the event is ignored.

[0176] Step E5: After a successful handshake, an interactive options interface pops up on both watches, where users can choose to exchange electronic business cards, compare daily exercise data, launch quick mini-games, and other social functions.

[0177] Step E6: Both parties must confirm their agreement on the watch screen before the exchange. All data exchanges are transmitted through a BLE encrypted channel to ensure user privacy and data security.

[0178] For example, User A encounters User B, both wearing smartwatches equipped with this system. When they approach within 2 meters, both watches detect each other's devices via BLE broadcast and enter "Near Field Social Ready" mode. Both simultaneously make a horizontal shaking gesture. User A's watch detects the gesture and sends an event message to User B's watch. User B's watch verifies that the timestamp difference is within 2 seconds and the gesture type matches, indicating a successful handshake. Both watches simultaneously display interactive options: "Exchange Business Cards," "Compare Today's Steps," and "Start a Rock-Paper-Scissors Game." The two choose to exchange business cards; after confirmation, their respective electronic business card information is transmitted to each other's watches via a BLE encrypted channel and saved to their contacts.

[0179] This application embodiment performs personalized configuration of gesture-function mapping for morning / sitting state, work meeting state, exercise state, and near-field social state, so that the same gesture can trigger different functions in different contexts, intelligently adapting to the user's needs in different states, effectively improving the richness, adaptability, and intelligence of gesture interaction, and greatly enhancing the user experience.

[0180] In some embodiments, determining the first functional action triggered corresponding to the first gesture type in the first context state includes:

[0181] If the first gesture type is the target gesture type, then the first function action is determined to be emergency help, and the system enters emergency safety mode, executing preset safety actions until the user performs an emergency safety mode exit operation.

[0182] For example, the target gesture type is the type of gesture that represents the user's emergency call for help. As shown in Table 1, it can be "continuous rapid shaking", etc. It can be set automatically by the system or customized by the user.

[0183] For example, the first functional action corresponding to the target gesture type is emergency help. This mapping relationship has the highest priority among the pre-set mapping relationships between gesture types, context states, and functional actions. In other words, as long as the user currently performs the target gesture type, emergency help will be executed first, regardless of the specific context state. This emergency help triggering mechanism can respond to the user's request for help in a timely and reliable manner, improving user safety.

[0184] Furthermore, in different situations, emergency assistance is triggered by a single target gesture type, avoiding the need for different gestures to trigger emergency assistance in different situations. This effectively improves the convenience of emergency assistance operations, makes it easier for users to remember, and enhances the feasibility and success rate of emergency assistance via gestures.

[0185] For example, the safety action runs in the highest priority real-time thread. After the thread starts, it will block low-priority interrupts (such as normal notification push, UI refresh, Do Not Disturb mode, airplane mode, low battery status, etc.) and only interrupt after the user performs the emergency safety mode exit operation, or due to hardware limitations (such as battery depletion, etc.), to prevent accidental exit or forced exit by others, effectively improving the reliability of emergency safety mode.

[0186] For example, the user's emergency safe mode exit operation can be performed by the user entering a preset security password, or by the user performing a specific combination of cancellation gestures (such as clenching a fist three times in a row). This can be a system default setting or a user-defined setting. The specific operation needs to have a certain degree of complexity. For example, the password cannot be a series of consecutive numbers such as "123456", and the gesture cannot be a gesture that is easy to trigger, such as shaking back and forth, to ensure that the user's intention to exit the emergency safe mode is clear when performing the emergency safe mode exit operation.

[0187] Below, in conjunction with Figure 3 The process of two-dimensional function mapping provided in the embodiments of this application will be described. Figure 3 This is a schematic diagram illustrating the two-dimensional function mapping process provided in an embodiment of this application. Figure 3 As shown, the process includes the following steps:

[0188] (1) Obtain the current situation state vector C.

[0189] (2) Receive the gesture type G obtained from the recognition.

[0190] (3) Query the mapping matrix M[G][C] to obtain the corresponding functional actions.

[0191] (4) Determine if the security level Ce is 1. If so, execute the SOS emergency procedure first.

[0192] (5) Execute the mapped functional actions and provide tactile / visual feedback to the user.

[0193] (6) Wait 3 seconds for the user to perform the undo operation. If so, roll back and record it as a mistaken touch sample.

[0194] In one possible implementation, the preset security actions include:

[0195] Send real-time location information to preset emergency contacts;

[0196] And / or, call the first contact in the emergency contact list; if no answer is received, call the next contact in the list.

[0197] And / or, activate the microphone to record ambient sound, encrypt and store the recording file locally, and upload the recording file to cloud storage when the network is available;

[0198] And / or, display a help icon and current coordinates on the screen.

[0199] It is understandable that people in a state of panic or injury may have difficulty stating their exact address. Therefore, sending real-time location information directly to emergency contacts allows rescuers or relatives to obtain the user's location information in a timely and clear manner and provide timely assistance.

[0200] For example, real-time location information can be precisely determined using GPS positioning, or it can be determined using the faster AGPS. Alternatively, a real-time location information transmission method can be adopted, in which an approximate area is first roughly located and sent using AGPS, and then the precise range is located using GPS and sent a second time. This allows rescuers or relatives to immediately go to the approximate area sent initially, and then get a precise location en route, thus enabling them to reach the user's location in a timely and accurate manner to provide assistance.

[0201] For example, real-time location information can be sent in the form of SMS. Taking SMS as an example, if the cellular network signal is poor and the SMS center does not return a success receipt, the system will not repeatedly resend the message to avoid occupying the channel and causing the device to consume a lot of power, overheat, or even lose connection completely. Instead, the system will forward the distress call and location information to other paired devices (such as mobile phones) through a Bluetooth tunnel, and the other devices will assist in sending the message, increasing the probability that the distress message will arrive.

[0202] Understandably, emergency contacts can also be contacted via automated phone calls. This disruptive approach can effectively reduce the probability of emergency contacts missing their call for help.

[0203] For example, calling an emergency contact will forcefully occupy the call channel, even during Bluetooth calls or third-party voice calls, and will hang up the current call to perform the emergency dialing, ensuring that the call is successfully made in a timely manner.

[0204] Understandably, even if a user falls or becomes trapped, passersby may hesitate to help due to uncertainty about whether the user truly needs assistance, or they may not be able to pinpoint their location when requesting help. Therefore, displaying a distress signal and the user's current location coordinates (such as the SOS international distress signal) on the device's screen can quickly and clearly convey a distress signal to those around them, and help passersby report their precise location when seeking help.

[0205] For example, the help icon and current coordinates are forcibly displayed across any application interface or locked screen state, such as in Android systems, where they can be drawn using the highest Z-order of SurfaceFlinger. During display, the screen brightness can be fixed at the maximum brightness.

[0206] Understandably, in addition to sending out requests for help, recordings can also be used to document the environment, providing evidence for subsequent accountability or review. Local encrypted storage ensures that even if the device is taken by someone else, the recording cannot be easily deleted or listened to; automatic cloud uploading enables real-time off-site backup of evidence, so even if the device is physically damaged, the evidence in the cloud still exists.

[0207] For example, during recording, a hardware lock is acquired on the microphone to prevent other applications from occupying the microphone and causing recording failure.

[0208] For example, audio files (e.g., in AAC or AMR format) can be encrypted using AES-256-GCM real-time streaming encryption, with the key derived from a device hardware-level key (such as a TEE secure area) to prevent plaintext from being written to Flash.

[0209] For example, the cloud upload operation is performed by an asynchronous background thread. If the network is unavailable, the audio file is marked as pending upload and stored in a protected, encrypted partition; when the network is restored, the interrupted upload is automatically resumed.

[0210] For example, a user feels unsafe being followed while walking alone at night. The user rapidly shakes their wrist six times within three seconds. The system detects the "rapid wrist shaking" gesture, and the security level Ce immediately switches to 1, triggering an emergency safety sequence: the watch immediately sends an SOS text message to three pre-set emergency contacts, containing real-time GPS coordinates and a map link; after three seconds, it automatically dials the first emergency contact's number; and ambient sound recording is simultaneously activated. The watch screen displays a prominent red SOS icon and the current location coordinates. Emergency mode continues to run until the user enters a security password or cancels by clenching their fist three times consecutively.

[0211] In this embodiment, an emergency call is triggered after the user performs the target gesture type, and an emergency safety mode is entered. The highest priority, uninterrupted safety action is performed, which enables the user to make timely and reliable calls for help in the face of an emergency, effectively providing the user with safety protection.

[0212] The above are the gesture interaction methods provided in the embodiments of this application. Figure 5 This is a schematic diagram of the structure of the gesture interaction device provided in an embodiment of this application. Figure 5 As shown in the figure, this application embodiment also provides a gesture interaction device, including:

[0213] The receiving module 51 is used to collect wrist movement data and identify the first gesture type based on the wrist movement data.

[0214] The first determining module 52 is used to determine the current first situational state based on at least one of the current time, schedule data, movement status and social distance;

[0215] The second determining module 53 is used to determine the first functional action triggered by the first gesture type in the first context state based on the pre-set mapping relationship between gesture type, context state and functional action.

[0216] Execution module 54 is used to perform the first functional action to realize interaction.

[0217] It should be noted that the gesture interaction device is used to execute the aforementioned gesture interaction method. For the specific implementation method, please refer to the method embodiment provided in the embodiments of this application, which will not be repeated here.

[0218] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device can be one of the aforementioned smart wearable devices. Figure 6 As shown, the electronic device includes:

[0219] The electronic device includes a processor 291 and a memory 292; it may also include a communication interface 293 and a bus 294. The processor 291, memory 292, and communication interface 293 can communicate with each other via the bus 294. The communication interface 293 can be used for information transmission. The processor 291 can invoke logical instructions stored in the memory 292 to execute the methods of the above embodiments.

[0220] Furthermore, the logic instructions in the aforementioned memory 292 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium.

[0221] The memory 292, as a computer-readable storage medium, can be used to store software programs and computer-executable programs, such as program instructions / modules corresponding to the methods in the embodiments of this application. The processor 291 executes functional applications and data processing by running the software programs, instructions, and modules stored in the memory 292, thereby implementing the methods in the above-described method embodiments.

[0222] The memory 292 may include a program storage area and a data storage area. The program storage area may store the operating system and application programs required for at least one function; the data storage area may store data created based on the use of the terminal device. Furthermore, the memory 292 may include high-speed random access memory and may also include non-volatile memory.

[0223] This application provides a non-transitory computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the methods described in the foregoing embodiments.

[0224] This application provides a computer program product, including a computer program that, when executed by a processor, implements the methods provided in any of the embodiments described above.

[0225] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to this application.

[0226] It should be further noted that although the steps in the flowchart are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowchart may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0227] It should be understood that the above-described device embodiments are merely illustrative, and the device of this application can also be implemented in other ways. For example, the division of units / modules in the above embodiments is only a logical functional division, and there may be other division methods in actual implementation. For example, multiple units, modules, or components may be combined, or integrated into another system, or some features may be ignored or not executed.

[0228] Furthermore, unless otherwise specified, the functional units / modules in the various embodiments of this application can be integrated into one unit / module, or each unit / module can exist physically separately, or two or more units / modules can be integrated together. The integrated units / modules described above can be implemented in hardware or as software program modules.

[0229] When integrated units / modules are implemented in hardware, the hardware can be digital circuits, analog circuits, etc. The physical implementation of the hardware structure includes, but is not limited to, transistors, memristors, etc. Unless otherwise specified, the processor can be any suitable hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the storage unit can be any suitable magnetic or magneto-optical storage medium, such as Resistive Random Access Memory (RRAM), Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), Enhanced Dynamic Random Access Memory (EDRAM), High-Bandwidth Memory (HBM), Hybrid Memory Cube (HMC), etc.

[0230] If the integrated unit / module is implemented as a software program module and sold or used as an independent product, it can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned memory includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.

[0231] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combination of these technical features does not contradict each other, it should be considered within the scope of this specification.

[0232] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0233] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A gesture interaction method, characterized in that, include: Collect wrist movement data, and identify the first gesture type based on the wrist movement data; Determine the current first situational state based on at least one of the following: current time, schedule data, activity status, and social distancing. Based on the pre-defined mapping relationship between gesture type, context state and functional action, determine the first functional action triggered by the first gesture type in the first context state; Perform the first functional action to achieve interaction.

2. The method according to claim 1, characterized in that, Determining the current first situational state based on at least one of current time, schedule data, movement status, and social distancing includes: Based on the current time, determine the current time period, wherein the time period is divided into at least one of the following: morning time period, commuting time period, work / study time period, leisure time period, and nighttime time period; And / or, read the user-set schedule data, and determine whether the current event is a specific schedule event based on the schedule data; And / or, determine the current motion state based on the wrist motion data; And / or, detect whether there are other smart devices currently within a preset social distance; The first situational state is determined based on at least one of the following: the current time period, whether the current person is in a specific scheduled event, the current state of motion, and whether the current distance between other smart devices is less than the preset social distance.

3. The method according to claim 2, characterized in that, The contextual state includes at least one of the following: morning / sitting state, work meeting state, exercise state, and near-field social state.

4. The method according to claim 3, characterized in that, The pre-defined mapping relationship between gesture types, contextual states, and functional actions includes: When the gesture type is horizontal shaking and the context state is morning / sitting state, the corresponding function is to turn off the alarm clock and announce the weather and / or schedule. When the gesture type is vertical shaking and the context state is morning / quiet state, the corresponding function is to turn Do Not Disturb mode on / off. When the gesture type is rotation and shaking, and the context state is morning / meditation state, the corresponding function is to randomly switch the screen display scheme. When the gesture type is a single wrist shake and the context state is morning / sitting state, the corresponding function is screen-on display time.

5. The method according to claim 3, characterized in that, The pre-defined mapping relationship between gesture types, contextual states, and functional actions includes: When the gesture type is horizontal shaking and the context state is a work meeting state, the corresponding function is to mute incoming calls and send a preset reply SMS. When the gesture type is vertical shaking and the context state is a work meeting state, the corresponding function is to reject incoming calls; When the gesture type is rotation and shaking, and the context state is a work meeting state, the corresponding function action is to start recording; When the gesture type is a single wrist shake and the context is a work meeting, the corresponding function is to view the latest notifications.

6. The method according to claim 3, characterized in that, The pre-defined mapping relationship between gesture types, contextual states, and functional actions includes: When the gesture type is horizontal shaking and the context state is a motion state, the corresponding function is to switch to the next song; When the gesture type is vertical shaking and the context state is a motion state, the corresponding function is to switch to the previous song; When the gesture type is rotation and shaking and the context state is a motion state, the corresponding function is to pause / resume motion timing; When the gesture type is a single wrist shake and the context state is a motion state, the corresponding function is to mark the current location waypoint.

7. The method according to claim 3, characterized in that, The pre-defined mapping relationship between gesture types, contextual states, and functional actions includes: When the gesture type is horizontal shaking and the context state is near-field social state, the corresponding function is to initiate a business card exchange request. When the gesture type is vertical shaking and the context state is near-field social state, the corresponding function is to initiate motion data PK; When the gesture type is rotation and shaking and the context state is near-field social state, the corresponding function is to initiate a quick mini-game invitation; When the gesture type is a single wrist shake and the context state is a near-field social state, the corresponding function is to send a quick greeting to the other party.

8. The method according to claim 1, characterized in that, Determining the current first situational state based on at least one of current time, schedule data, movement status, and social distancing includes: If at least one of the current time, the schedule data, the movement status, and the social distance meets multiple preset situational states, then the one with the highest priority among the multiple preset situational states shall be taken as the first situational state.

9. The method according to claim 1, characterized in that, The method further includes: A two-dimensional mapping matrix is ​​established, wherein different rows of the two-dimensional mapping matrix correspond to different gesture types, different columns of the two-dimensional mapping matrix correspond to different context states, and different elements of the two-dimensional mapping matrix correspond to different functional actions; The method of determining the corresponding first functional action based on the first gesture type and the first context state, according to the pre-defined mapping relationship between gesture type, context state, and functional action, includes: Based on the two-dimensional mapping matrix, the corresponding first functional action is determined according to the row where the first gesture type is located and the column where the first context state is located.

10. The method according to any one of claims 1-9, characterized in that, The step of determining the first functional action triggered by the first gesture type in the first context state includes: If the first gesture type is the target gesture type, then the first function action is determined to be an emergency help request, and the system enters the emergency safety mode, executing preset safety actions until the user performs an emergency safety mode exit operation.

11. The method according to claim 10, characterized in that, The preset safety actions include: Send real-time location information to preset emergency contacts; And / or, call the first contact in the emergency contact list; if no answer is received, call the next contact in the list. And / or, activate the microphone to record ambient sounds, encrypt and store the recording file locally, and upload the recording file to cloud storage when the network is available; And / or, display a help icon and current coordinates on the screen.

12. A gesture interaction device, characterized in that, include: The receiving module is used to collect wrist movement data and identify the first gesture type based on the wrist movement data; The first determination module is used to determine the current first situational state based on at least one of the current time, schedule data, movement status and social distance; The second determining module is used to determine the first functional action triggered by the first gesture type in the first context state based on the pre-set mapping relationship between gesture type, context state and functional action. The execution module is used to perform the first functional action to achieve interaction.

13. An electronic device, characterized in that, include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory to implement the method as described in any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1 to 11.

15. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method of any one of claims 1 to 11.

Images