Information interaction processing system, method and device, electronic equipment and storage medium

Abstract

The invention provides an information interaction processing system, method and device, electronic equipment and a computer storage medium, in the system, operation actions at least comprise at least one of a first operation action and a second operation action, so that a wearable user can perform the corresponding first operation action on wearable equipment, and the information interaction processing efficiency is improved. According to the method, the terminal application can be opened or closed, or a subprogram in the terminal application is opened, or some task processes in the terminal application are opened, and certainly, after the terminal application is opened, or the subprogram in the terminal application is opened, or some task processes in the terminal application are opened; the wearable user can execute a second operation action on the wearable device so as to execute the target function operation in the opened terminal application or subprogram or task process; in a word, multiple modes or multiple functions can be operated on the terminal application only by operating the wearable device, and interaction with a mobile phone through the wearable device is facilitated.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an information interaction processing system, an information interaction processing method, an information interaction processing device, an electronic device, and a computer storage medium. Background Art

[0002] As more and more people order goods online, the number of online orders generated is also increasing, and the delivery of online orders by delivery riders is becoming more and more important. On the one hand, while ensuring timely delivery of online orders, delivery riders also hope to deliver more and more orders.

[0003] When a delivery rider is delivering online orders, whether he is riding or walking (for example, when picking up an order or delivering an order, there may be a section of the road that cannot be ridden and needs to be walked), the delivery rider either focuses on observing the road conditions or may hold multiple orders, which makes it inconvenient for the delivery rider to operate the mobile phone. In the order delivery process, there are actually many nodes where the delivery rider needs to operate the mobile phone. For example, when the delivery rider receives a reminder call from the ordering user, he needs to operate the mobile phone to answer the call. When the delivery rider finishes picking up the meal at the merchant where the ordering user placed the order, he needs to click sign in in the delivery application to complete the meal pickup operation. Therefore, in the process of delivery riders delivering online orders, how to provide a way to easily operate the mobile phone has become a technical problem that urgently needs to be solved. Summary of the invention

[0004] The present application provides an information interaction processing system to provide a delivery rider with a convenient way to operate a mobile phone to interact with the mobile phone during the delivery order process. The present application also provides an information interaction processing method, an information interaction processing device, an electronic device and a computer storage medium.

[0005] The present application provides an information interaction processing system, including: a wearable device and a terminal application; the wearable device is used to determine an operation action to be detected in response to detecting an operation action of a wearing user; determine an operation instruction to be executed according to the operation action to be detected and the operation correspondence relationship; provide the operation instruction to be executed to the terminal application; the operation correspondence relationship is an operation correspondence relationship between an operation action performed by the wearing user when wearing the wearable device and an operation instruction to be executed for the terminal application, which is configured in a configuration application or in a terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for executing a target function operation in the candidate mode; the wearable device and the terminal application are connected in a short-distance communication manner; entering or exiting the candidate mode of the terminal application includes entering or exiting the terminal application or entering or exiting a sub-application in the terminal application or entering or exiting a task process of the terminal application; the terminal application is used to obtain the operation instruction to be executed and respond based on the operation instruction to be executed.

[0006] Optionally, a processor is provided in the wearable device, and if the operation action to be detected is a second operation action for performing a target function operation when entering a candidate mode, the processor is used to obtain the operation action amount to be detected corresponding to the operation action to be detected; determine whether the operation action amount to be detected meets the preset operation action amount requirement; if the operation action amount to be detected meets the preset operation action amount requirement, then take the operation action to be detected as a valid action; and determine the operation instruction to be executed according to the correspondence between the operation action to be detected and the operation, including: taking the operation action confirmed as a valid action in the operation actions to be detected as the target operation action to be detected, and determining the operation instruction to be executed according to the correspondence between the target operation action to be detected and the operation.

[0007] Optionally, an operation action sensor is provided in the wearable device; obtaining the operation action amount to be detected corresponding to the operation action to be detected includes: obtaining a first state value corresponding to the operation action sensor before the wearing user performs the operation action to be detected; obtaining a second state value corresponding to the operation action sensor after the wearing user performs the operation action to be detected; and obtaining the operation action amount to be detected based on the first state value and the second state value.

[0008] Optionally, the operation instruction to be executed includes an execution adjustment amount for executing the target functional operation; the processor is specifically used to obtain the execution adjustment amount for executing the target functional operation based on the correspondence between the operation action amount to be detected, the operation action amount and the functional adjustment amount; and provide the execution adjustment amount to the terminal application; the terminal application is specifically used to respond based on the execution adjustment amount.

[0009] Optionally, if the operation action to be detected is a first operation action for entering a candidate mode of the terminal application, the wearable device is further configured to play a voice prompt message for entering the candidate mode in response to detecting the first operation action.

[0010] Optionally, a processor is provided in the wearable device; if the operation action to be detected is a first operation action for entering a candidate mode of the terminal application, the processor is further used to determine whether the wearing user performs the second operation action within a preset time period after performing the first operation action; if the wearing user does not perform the second operation action within the preset time period, an exit instruction to exit the candidate mode is sent to the terminal application; the terminal application is used to obtain the exit instruction and exit the candidate mode in response to the exit instruction.

[0011] Optionally, the wearable device is connected to an application program interface of the terminal application; the wearable device is specifically used to call the application program interface of the terminal application and provide the to-be-executed operation instruction to the terminal application through the called application program interface.

[0012] Optionally, if the operation action to be detected is the first operation action for entering a candidate mode of the terminal application, the operation correspondence includes a mode correspondence between the operation action and each candidate mode; determining the operation instruction to be executed based on the operation action to be detected and the operation correspondence includes: determining, in each candidate mode, the target candidate mode to which the operation action to be detected points, based on the operation action to be detected and the mode correspondence; and determining the instruction to enter the target candidate mode as the operation instruction to be executed.

[0013] Optionally, a positioning module is provided in the wearable device; the positioning module is used to perform real-time positioning of the wearer and obtain real-time positioning information of the wearer; the real-time positioning information is provided to the terminal application; the terminal application is used to perform path planning for the order to be delivered according to the real-time positioning information and obtain the delivery path of the order to be delivered; or, based on the real-time positioning information, update the order delivery status of the order to be delivered.

[0014] Optionally, a wearing status detection sensor is provided in the wearable device; the wearing status detection sensor is used to detect whether the wearing user is in a state of wearing the wearable device; if the wearing user is in a state of wearing the wearable device, a step of determining the operation action to be detected in response to detecting the operation action of the wearing user is executed.

[0015] The present application provides an information interaction processing method, which is applied to a wearable device, and the method includes: in response to detecting an operation action of a wearing user, determining an operation action to be detected; the operation action at least includes at least one of a first operation action for entering or exiting a candidate mode of a terminal application and a second operation action for executing a target function operation when entering the candidate mode; entering or exiting the candidate mode of the terminal application includes entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application; determining an operation instruction to be executed according to a correspondence between the operation action to be detected and an operation; the operation correspondence is an operation correspondence between an operation action performed by the wearing user when wearing the wearable device and an operation instruction indicated to be executed for the terminal application, which is configured in a configuration application or in a terminal application; the wearable device and the terminal application are connected in a short-distance communication manner; and the operation instruction to be executed is provided to the terminal application so that the terminal responds based on the operation instruction to be executed.

[0016] Optionally, if the operation action to be detected is a second operation action for performing a target function operation when entering a candidate mode, then before executing the step of determining the operation instruction to be executed based on the correspondence between the operation action to be detected and the operation, it also includes: obtaining the operation action amount to be detected corresponding to the operation action to be detected; judging whether the operation action amount to be detected meets the preset operation action amount requirement; if the operation action amount to be detected meets the preset operation action amount requirement, then executing the step of determining the operation instruction to be executed based on the correspondence between the operation action to be detected and the operation.

[0017] Optionally, an operation action sensor is provided in the wearable device; obtaining the operation action amount to be detected corresponding to the operation action to be detected includes: obtaining a first state value corresponding to the operation action sensor before the wearing user performs the operation action to be detected; obtaining a second state value corresponding to the operation action sensor after the wearing user performs the operation action to be detected; and obtaining the operation action amount to be detected based on the first state value and the second state value.

[0018] Optionally, the operation instruction to be executed includes an execution adjustment amount for executing the target functional operation; the method also includes: obtaining the execution adjustment amount for executing the target functional operation based on the correspondence between the operation action amount to be detected, the operation action amount and the functional adjustment amount; providing the execution adjustment amount to the terminal application so that the terminal application responds based on the execution adjustment amount.

[0019] Optionally, if the operation action to be detected is a first operation action for entering a candidate mode of the terminal application, the method further includes: in response to detecting the first operation action, playing a voice prompt message for entering the candidate mode.

[0020] Optionally, if the operation action to be detected is a first operation action for entering a candidate mode of the terminal application, the method further includes: determining whether the wearing user performs the second operation action within a preset time period after performing the first operation action; if the wearing user does not perform the second operation action within the preset time period, sending an exit instruction to exit the candidate mode to the terminal application, so that the terminal application exits the candidate mode in response to the exit instruction.

[0021] Optionally, the wearable device is connected to the application program interface of the terminal application; providing the operation instruction to be executed to the terminal application includes: calling the application program interface of the terminal application, and providing the operation instruction to be executed to the terminal application through the called application program interface.

[0022] Optionally, if the operation action to be detected is the first operation action for entering a candidate mode of the terminal application, the operation correspondence includes a mode correspondence between the operation action and each candidate mode; determining the operation instruction to be executed based on the operation action to be detected and the operation correspondence includes: determining, in each candidate mode, the target candidate mode to which the operation action to be detected points, based on the operation action to be detected and the mode correspondence; and determining the instruction to enter the target candidate mode as the operation instruction to be executed.

[0023] Optionally, a positioning module is provided in the wearable device; the method further includes: using the positioning module to perform real-time positioning of the wearing user to obtain real-time positioning information of the wearing user; providing the real-time positioning information to the terminal application, so that the terminal application performs path planning for the order to be delivered according to the real-time positioning information to obtain the delivery path of the order to be delivered; or, based on the real-time positioning information, updating the order delivery status of the order to be delivered.

[0024] Optionally, a wearing status detection sensor is provided in the wearable device; the method further includes: using the wearing status detection sensor to detect whether the wearing user is in a state of wearing the wearable device; if the wearing user is in a state of wearing the wearable device, executing a step of determining the operation action to be detected in response to detecting the operation action of the wearing user.

[0025] The present application provides an information interaction processing method, which is applied to a terminal application, and the method includes: obtaining an operation instruction to be executed sent by a wearable device; responding based on the operation instruction to be executed; the operation instruction to be executed is determined by the wearable device based on the operation action to be detected performed by the wearer user on the wearable device and the operation correspondence relationship; the operation correspondence relationship is an operation correspondence relationship between the operation action performed by the wearer user when wearing the wearable device and the operation instruction indicated to be executed on the terminal application, which is configured in a configuration application or in a terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation in the candidate mode; the wearable device and the terminal application are connected in a short-distance communication manner; entering or exiting the candidate mode of the terminal application includes entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

[0026] Optionally, the operation instruction to be executed includes an execution adjustment amount for executing the target function operation; the method also includes: obtaining the execution adjustment amount for executing the target function operation sent by the wearable device; the execution adjustment amount is obtained by the wearable device based on the correspondence between the operation action amount to be detected corresponding to the operation action to be detected, the operation action amount and the function adjustment amount; and responding based on the execution adjustment amount.

[0027] Optionally, the wearable device is connected to an application program interface of the terminal application; and obtaining the operation instruction to be executed sent by the wearable device includes: obtaining the operation instruction to be executed sent by the wearable device through the application program interface.

[0028] Optionally, the terminal application includes at least a delivery application. If the terminal application is a delivery application, the method further includes: obtaining real-time positioning information sent by the wearable device for real-time positioning of the wearing user; performing path planning for the delivery order based on the real-time positioning information to obtain the delivery path of the delivery order; or, updating the order delivery status of the delivery order based on the real-time positioning information.

[0029] The present application provides an information interaction processing device, which is applied to a wearable device, and the device includes: a unit for determining an operation action to be detected, which is used to determine the operation action to be detected in response to detecting the operation action of the wearer; the operation action at least includes at least one of a first operation action for entering or exiting a candidate mode of a terminal application and a second operation action for performing a target function operation in the candidate mode; entering or exiting the candidate mode of the terminal application includes entering or exiting the terminal application or entering or exiting a sub-application in the terminal application or entering or exiting a task process of the terminal application; a unit for determining an operation instruction to be executed, which is used to determine the operation instruction to be executed according to the correspondence between the operation action to be detected and the operation; the operation correspondence is an operation correspondence between the operation action performed by the wearer when wearing the wearable device and the operation instruction indicated to be executed for the terminal application, which is configured in a configuration application or in a terminal application; the wearable device and the terminal application are connected in a short-distance communication manner; a unit for providing the operation instruction to be executed, which is used to provide the operation instruction to be executed to the terminal application, so that the terminal responds based on the operation instruction to be executed.

[0030] The present application provides an information interaction processing device, which is applied to a terminal application, and the device includes: a to-be-executed operation instruction obtaining unit, which is used to obtain the to-be-executed operation instruction sent by a wearable device; a responding unit, which is used to respond based on the to-be-executed operation instruction; the to-be-executed operation instruction is determined by the wearable device based on the to-be-detected operation action performed by the wearer user on the wearable device and the operation correspondence relationship; the operation correspondence relationship is an operation correspondence relationship between the operation action performed by the wearer user when wearing the wearable device and the operation instruction indicated to be executed on the terminal application, which is configured in a configuration application or in a terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation in the candidate mode; the wearable device and the terminal application are connected in a short-distance communication manner; entering or exiting the candidate mode of the terminal application includes entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

[0031] The present application provides an electronic device, comprising: a processor; a memory for storing a computer program, wherein the computer program is run by the processor to execute the above-mentioned information interaction processing method.

[0032] The present application provides a computer storage medium, wherein the computer storage medium stores a computer program, and the computer program is run by a processor to execute the above-mentioned information interaction processing method.

[0033] Compared with the prior art, the embodiments of the present application have the following advantages:

[0034] The present application provides an information interaction processing system, including: a wearable device and a terminal application; in the system, an operation correspondence relationship between an operation action performed by a wearable user when wearing the wearable device and an operation instruction indicated to be executed for the terminal application is pre-configured in a configuration application or in a terminal application, so that if the wearable user performs an operation action when wearing the wearable device, the wearable device can determine the operation action to be detected in response to detecting the operation action of the wearable user; then, according to the operation action to be detected and the operation correspondence relationship, determine the operation instruction to be executed; provide the operation instruction to be executed to the terminal application; so that the terminal application responds after obtaining the operation instruction to be executed. In the information interaction system, since the operation action at least includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for executing a target function operation in the candidate mode, entering or exiting the terminal The candidate modes of the terminal application include entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application, so that the wearing user can open or close the terminal application itself, or open a sub-program in the terminal application, or open some task processes in the terminal application by performing a corresponding first operation on the wearable device. Of course, after opening the terminal application itself, opening a sub-program in the terminal application, or opening some task processes in the terminal application, the wearing user can also perform a second operation on the wearable device to perform a target function operation in the opened terminal application, or perform a target function operation in the opened sub-program, or perform a target function operation in the opened task process; in short, the wearing user can realize multiple modes or multiple functions in the terminal application by simply operating the wearable device, which greatly facilitates the wearable user to interact with the mobile phone through the wearable device. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0036] Figure 1 This is a scenario diagram of the information interaction processing system for this application.

[0037] Figure 2 This is a schematic diagram of the structure of the information interaction processing system provided in this application.

[0038] Figure 3 This is an example flow chart of the interaction between the wearable device and the terminal application in this application.

[0039] Figure 4 This is a flowchart of the information interaction processing method provided in the second embodiment of the present application.

[0040] Figure 5 This is a flowchart of the information interaction processing method provided in the third embodiment of the present application.

[0041] Figure 6 A schematic diagram of an information interaction processing device provided in the fourth embodiment of the present application.

[0042] Figure 7 A schematic diagram of an information interaction processing device provided in the fifth embodiment of the present application.

[0043] Figure 8 A schematic diagram of an electronic device provided in accordance with the sixth embodiment of the present application. DETAILED DESCRIPTION

[0044] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application. Therefore, the present application is not limited to the specific implementation disclosed below.

[0045] The present application provides an information interaction processing system, an information interaction processing method, an information interaction processing device, an electronic device, and a computer storage medium. The following describes the information interaction processing system, the information interaction processing method, the information interaction processing device, the electronic device, and the computer storage medium through specific embodiments. In order to more clearly demonstrate the information interaction processing system provided by the embodiment of the present application, the application scenario of the information interaction processing system provided by the embodiment of the present application is first introduced.

[0046] The information interaction processing system of the present application can be used in the scenario where the delivery rider uses a wearable device to control and interact with the terminal application on the mobile phone during the delivery order process. The terminal application can be a system application on the mobile phone, such as a call application, a text message application, a volume adjustment application, etc.; the terminal application can also be an application downloaded on the mobile phone, such as a delivery application (an application used for delivery riders to deliver orders), a social application, etc. The terminal application in this application is mainly introduced using the delivery application as an example. Of course, it is understandable that the delivery rider is only an example of a wearable user who wears a wearable device. The wearable user can also be a user other than the delivery rider, and the user only needs to wear or wear the wearable device.

[0047] For example, when delivery rider 1 picks up an order such as order A at a merchant (i.e., the pickup for order A has been completed) and is on the way to deliver order A to the address specified by the ordering user, delivery rider 1 is in a riding state. The ordering user urges for order A and calls delivery rider 1. At this time, delivery rider 1 answers the call by tapping the smart helmet body (taking the smart helmet as an example of a wearable device) or clicking a button on the smart helmet. Of course, delivery rider 1 can also answer the call through voice trigger, such as when delivery rider 1 says keywords such as answering the call to the wearable device, he can also answer the call.

[0048] For another example, when delivery rider 1 rides to the address specified by the ordering user and delivers order A to the ordering user, in the delivery application, delivery rider 1 needs to click on "deliver" for order A. However, because delivery rider 1 is in a hurry to deliver the next order (order B), he forgets to click on "deliver" for order A. At this time, delivery rider 1 is in a riding state to pick up the goods from the merchant corresponding to the next order. When the delivery application detects that the location information of delivery rider 1 for order A has approached the address specified by the ordering user and then starts to move away from the address, it will send a reminder message or inquiry message to the wearable device requesting to click on "deliver", and the reminder message or inquiry message will be played by voice on the wearable device. The played inquiry message may be: It is detected that you have arrived at the delivery address of order A, please confirm whether to deliver it. The delivery rider can nod to confirm delivery or shake his head to deny delivery, and the wearable device will recognize the nodding and shaking movements.

[0049] For another example, when the delivery rider is in a riding state, if the system assigns an order to the delivery rider, the delivery rider needs to operate the mobile phone to accept the assigned order (accept the order) or refuse the assigned order (reject the order) in the delivery application. However, since the delivery rider is in a riding state or a walking state (he may hold multiple order items in his hand when walking), it is not convenient to operate on the mobile phone to accept or reject the order; and by operating the smart helmet, it is convenient for the delivery rider to finally accept or reject the order in the delivery application on the mobile phone in a riding state or a walking state. The smart helmet can broadcast the voice inquiry information of whether to accept or reject the order to the delivery rider. The voice inquiry information can also include the order's required pickup time information, delivery time information, pickup address information, delivery address information, etc. to facilitate the delivery rider to confirm whether to accept the order; after the delivery rider hears the voice inquiry information through the smart helmet, he can nod to indicate acceptance of the order, or shake his head to indicate rejection of the order. Of course, other operations can also be used to accept or reject the order. As for which action is used to indicate acceptance or rejection of the order, it can be configured in advance in the delivery application or configuration application.

[0050] After the delivery rider accepts or rejects an order through the smart helmet, the smart helmet can recognize the action performed by the delivery rider and send an order acceptance or rejection instruction to the delivery app on the mobile phone based on the recognized action so that the delivery app can respond. The whole process avoids the delivery rider being distracted by operating the phone while riding or walking, ensuring riding safety.

[0051] In this application, the wearable device not only has ordinary functions such as broadcasting voice and receiving voice input from the delivery rider, but also can interact with the terminal (i.e., the mobile phone) or the terminal application to perform various functions, so that the delivery rider can perform corresponding actions on the wearable device worn by the delivery rider, that is, enter or exit multiple modes of the mobile phone on the mobile phone or perform multiple functional operations in a certain mode, thereby upgrading the function of the wearable device to the intelligent dimension. It should be noted that in the application, the operating actions performed by the operating user (such as the delivery rider) on the wearable device only when the operating user (such as the delivery rider) is wearing the wearable device will be recognized, so as to enter or exit multiple modes of the mobile phone on the mobile phone or perform multiple functional operations in a certain mode, so as to avoid the operating user from misoperating the mobile phone due to misoperation when not wearing the wearable device.

[0052] The reason why wearable devices can interact with mobile phone terminal applications by tapping the smart helmet, clicking buttons on the smart helmet, or responding by voice is mainly related to the hardware and software components of the wearable devices. Figure 1 , which is a scenario diagram of the information interaction processing system of the present application, which corresponds to the system framework diagram of the wearable device.

[0053] like Figure 1 As shown, the wearable device includes: Bluetooth module and processor (processor, such as MCU, Microcontroller Unit, micro control unit), low-power Bluetooth module and low-power processor (low-power processor such as Sub-MCU), positioning module (such as GPS, i.e. Global Positioning System, global positioning system), mobile network communication module (such as 4G communication), voice input module (such as MIC and sound effect DSP, MIC, i.e. Microphone Interface Connector, microphone interface connector; DSP, i.e. Digital Signal Processing, digital signal processing), speaker module, button module, barometer, wireless network communication module, infrared sensor, battery module, lighting module, operation action sensor (such as acceleration sensor and gyroscope). Among them, the positioning module and mobile network communication module may not be set in the wearable device.

[0054] pass Figure 1 It can be seen that: the positioning module, mobile network communication module, speaker module, and voice input module are connected to the Bluetooth module, and the positioning module, mobile network communication module, speaker module, and voice input module are not always in working condition; while the button module, barometer, wireless network communication module, infrared sensor, light module, and operation motion sensor are all connected to the low-power Bluetooth module, and these button modules, barometer, wireless network communication module, infrared sensor, light module, and operation motion sensor are all in working condition at all times. The components that are always in working condition work by connecting to the low-power Bluetooth module to save power of the wearable device. The modules that are not always in working condition can be connected to the ordinary Bluetooth module to work because they are not always in working condition.

[0055] The battery module can be connected to the Bluetooth module and the low-power Bluetooth module respectively. The battery module can achieve efficient battery management, support long-term battery life, and has a fast charging function. At the same time, it has a low-battery reminder function to ensure that the wearable device will not lose power at critical moments.

[0056] The light module includes light components installed on the front and back of the wearable device. On the one hand, it provides a better visibility riding environment for delivery riders when riding at night or in low-light environments; at the same time, the safety warning light can be turned on at night, which can automatically light up and flash at night or in dim environments to warn surrounding vehicles and pedestrians. The wearable device is equipped with a light sensor to automatically adjust the brightness of the light, and of course, it is also used to automatically turn on and off the light components.

[0057] Both the Bluetooth module and the low-power Bluetooth module can be connected to the mobile phone to realize the communication function between the wearable device and the mobile phone (such as calling and playing music); of course, the wireless network communication module can also be connected to the mobile phone, and the wireless network communication module can also communicate directly with the server.

[0058] Wearable devices can also achieve voice communication (such as voice playback, voice calls, etc.) with mobile phones through microphones and speakers. Wearable devices achieve clear voice communication through microphones and speakers. Specifically, multiple microphone arrays are used (when the delivery rider wears the wearable device, the multiple microphone arrays on the wearable device are located in front of the head and at the left and right ears) to detect noise in the environment, and use signal processing algorithms to analyze and filter noise to reduce environmental noise, thereby enabling delivery riders to make high-quality calls while riding.

[0059] The positioning module can locate the delivery rider in real time to obtain the real-time positioning information of the delivery rider. Of course, in order to save the power of wearable devices, the delivery rider can also be located by mobile phone. The reason for using the positioning module of wearable devices for positioning is mainly to make up for the shortcomings of mobile phone positioning.

[0060] In addition, some software is also installed in the wearable device, such as the embedded advanced safety monitoring software (ASM for short), which can determine the delivery speed, driving trajectory and posture of the delivery rider based on various sensors (such as infrared sensors, operating motion sensors, positioning modules, barometers).

[0061] In addition, voice assistant software is also provided in the wearable device to realize voice interaction. For example, the delivery rider 1 mentioned above can also answer the call through voice trigger. At this time, the voice information input by the delivery rider 1 through voice is actually analyzed by the voice assistant software.

[0062] In order to facilitate understanding of the information interaction processing system of the present application, Figure 2 As shown, it is a structural diagram of the information interaction processing system provided by the present application. The information interaction processing system of the present application includes: a wearable device 201 and a terminal application 202.

[0063] Wearable device 201 is used to determine the operation action to be detected in response to detecting the operation action of the wearer; determine the operation instruction to be executed based on the correspondence between the operation action to be detected and the operation; and provide the operation instruction to be executed to the terminal application; the terminal application 202 is used to obtain the operation instruction to be executed and respond based on the operation instruction to be executed; wherein the terminal application at least includes a delivery application.

[0064] The delivery application can be an application installed in the terminal (such as a mobile phone) used by the delivery rider for the delivery rider to deliver orders. The delivery rider can use the delivery application to receive orders, deliver orders, navigate the delivery orders, etc. The delivery application can also be configured for wearable devices; both the delivery application and the wearable device are used by the delivery rider in the process of delivering orders, and can always stay connected through short-range communication methods. Short-range communication methods include Bluetooth, near-field communication, radio frequency identification, infrared communication, wireless local area network, etc.

[0065] Wearable device 201 is a smart helmet, a smart headset, etc. Of course, wearable device 201 can also be a smart device that is convenient for delivery riders to wear in addition to smart helmets and smart headsets. Figure 1Some necessary modules including the Bluetooth module, processor, voice input module, speaker module, barometer, wireless network communication module, infrared sensor, battery module, lighting module, operation motion sensor, and button module can be used; in this embodiment, the difference between the smart helmet and the smart headset is that the delivery rider can single-click (or double-click or triple-click) the smart helmet body, or click (or double-click or triple-click or long press) the button on the smart helmet; while the smart headset can only single-click (or double-click or triple-click or long press) the button on the smart headset.

[0066] In the present application, the operation correspondence is an operation correspondence between an operation action performed by a wearable user when wearing a wearable device and an operation instruction indicated to be executed for the terminal application, which is configured in a configuration application or in a terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation when entering the candidate mode; the wearable device and the terminal application are connected in a short-range communication manner; entering or exiting a candidate mode of the terminal application includes entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

[0067] When the terminal application is a delivery application, the configuration application can be a separate application in the terminal device or embedded in the delivery application. When the configuration application is set up separately in the terminal device, the above operation correspondence is directly configured in the configuration application. If the configuration application is embedded in the delivery application, the above operation correspondence can be configured in the delivery application.

[0068] In the present application, the first operation action and the second operation action can actually be the same type of operation action or different types of operation actions; for example, the first operation action can include hand movements, voice-triggered actions, and head movements, and the second operation action can also include hand movements, voice-triggered actions, and head movements; generally speaking, when executing the first operation action, hand movements and voice-triggered actions can usually be used; when executing the second operation action, head movements can usually be used.

[0069] Hand movements such as the delivery rider's single, double, or triple clicks on the smart helmet body; they can also be single, double, triple clicks, and long presses on the buttons of the smart helmet; voice-triggered actions such as the delivery rider saying the wake-up keyword through the voice input module (such as a microphone) of the smart helmet; head movements such as the delivery rider's head movements when wearing a smart helmet, such as nodding, shaking his head, raising his head, lowering his head, turning his head to the left, turning his head to the right, etc.

[0070] Since in the present application, entering or exiting the candidate mode includes entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting the task process of the terminal application, in fact, the candidate mode can be the terminal application itself, or it can refer to a sub-application in the terminal application, and of course it can also refer to the task process in the terminal application; that is, by triggering the first operation action, you can enter or exit a certain application, you can also enter or exit a subroutine of a certain application, and of course you can also enter or exit a task process of a certain stage of a certain application.

[0071] The candidate mode may be the terminal application itself, and the terminal application may be a system application, such as adjusting the volume of a mobile phone or a voice call. If someone calls the delivery rider during riding, the delivery rider can enter the telephone communication mode by clicking the helmet body to answer the call. While the delivery rider is on the phone, he can increase the volume by moving his head upward.

[0072] Alternatively, for telephone communications in the system application, when the delivery rider is about to reach the address of the ordering user while riding, the order in the delivery application is about to be delivered. At this time, the delivery application sends an inquiry message through the smart helmet to ask whether to call the ordering user for the order. The smart helmet will play the inquiry message by voice. After the delivery rider hears the inquiry message through the smart helmet he is wearing, he can click the button on the smart helmet to call the ordering user.

[0073] It should be noted that in the present application, the first operation or the second operation is only effective when the delivery rider is wearing a wearable device.

[0074] Candidate modes can also be message interaction applications, such as delivery riders sending messages and making phone calls to ordering users. For example, the ordering user can be called by single-clicking the smart helmet body, and the ordering user can be messaged by double-clicking the smart helmet body (for example, when the ordering user is urging the order, the delivery rider sends a message to the delivery rider in the delivery application to urge the order. After receiving the urging message sent by the ordering user through the smart helmet, the delivery rider double-clicks the smart helmet body to send a reply message to the ordering user).

[0075] For example, when a delivery rider is riding an electric bike and the electric bike breaks down or the rider falls, he or she can quickly tap the smart helmet three times or long press the button on the smart helmet to enter SOS mode, and the phone can then trigger a text message or call to an emergency contact for help.

[0076] The candidate mode can also be a task process. When entering a task process, the delivery rider performs the second operation to perform the target function operation; for example, in the case where the delivery rider needs to deposit the order in the smart cabinet, the delivery rider needs to confirm whether to deposit the order in the cabinet during the order deposit stage. The delivery rider can confirm the cabinet deposit or deny the cabinet deposit message interaction through the smart helmet he wears, such as nodding to confirm (nodding is an example of performing the second operation action, and the confirmation cabinet deposit operation performed in the order deposit stage in the delivery application based on the second operation action is an example of performing the target function operation), shaking his head to deny; tapping the helmet once to confirm, and double-clicking quickly to deny; the head up indicates the previous order, and the head down indicates the next order; turning the head to the left indicates the previous order, and turning to the right indicates the next order.

[0077] For another example, after the smart cabinet slot information is assigned to the order, at the stage of playing the assigned slot information through the smart helmet voice: turning the head to the left means the volume is reduced, turning the head to the right means the volume is increased; turning the head upward means the volume is reduced, turning the head downward means the volume is increased; single-clicking the helmet button or single-clicking the helmet plays the current order assigned cabinet slot information; double-clicking the helmet or button or turning the head to the left or turning the head upward can play the cabinet slot information assigned to the previous order. After depositing the order in the cabinet, single-click the helmet button or single-click the helmet to call the ordering user to inform the cabinet storage details of the order; double-click the helmet button or double-click the helmet to send a message to the ordering user to inform the cabinet storage details of the order. The above can actually be an example of a delivery rider performing a second operation to finally perform a target function operation on the delivery application after entering a certain task process.

[0078] The reason why the delivery rider responds to the terminal application through the second operation action for the above-mentioned different stages (i.e., different task processes) is that the corresponding configuration has been made in advance in the delivery application or configuration application; for example, in the stage of confirming whether to deposit in the cabinet, the configuration is: when the head nods, it indicates confirmation of deposit in the cabinet, and when the head shakes, it indicates denial of deposit in the cabinet. Of course, it can also be configured to confirm or deny deposit in the cabinet through voice triggering and other methods. When playing the slot information assigned to the order, it is configured as follows: by clicking the wearable device or the button on the wearable device, the slot information corresponding to the current order is played; by double-clicking the wearable device or the button on the wearable device, or turning the head to the left or turning the head upward to play the slot information corresponding to the previous order; it can also be configured through voice triggering, such as please play the slot information assigned to the current order. In the stage after the order is deposited in the cabinet, it can also be configured as follows: by clicking the wearable device or the button on the wearable device, a call is made to the ordering user to inform the details of the cabinet deposit; by double-clicking the wearable device or the button on the wearable device, a message is sent to the ordering user to inform the details of the cabinet deposit; it can also be configured to call or send a message through voice triggering.

[0079] A communication protocol is set between the wearable device and the terminal. When the delivery rider performs the first operation action or the second operation action, the processor in the wearable device first determines which action the delivery rider has performed, and determines the operation instruction to be executed corresponding to the operation action to be detected based on the correspondence between the identified operation action to be detected and the operation pre-configured in the configuration application or the terminal application. Then, the wearable device provides the operation instruction to be executed to the terminal (such as a mobile phone), and the terminal identifies the operation instruction to be executed based on the communication protocol between the wearable device and the terminal, so that the terminal application can respond.

[0080] For example, if single-clicking the smart helmet body represents making a phone call, when the delivery rider single-clicks the smart helmet body, the smart helmet will recognize the action of single-clicking the smart helmet body, and based on the operation correspondence, confirm that the instruction corresponding to the action of single-clicking the smart helmet body is an instruction to make a phone call. Of course, in the wearable device, the corresponding code is used to represent the instruction to make a phone call. For example, the XXXX1 instruction is used to represent the instruction to make a phone call. Through the communication protocol between the wearable device and the terminal, the terminal (such as a mobile phone) can determine that the XXXX1 instruction sent by the wearable device is an instruction to make a phone call, and then open the phone call page in the terminal and make a call to the ordering user.

[0081] The candidate modes mentioned in the preceding text may be various terminal applications, various subroutines, and various task processes. The action for entering the candidate mode may be configured (configured in the configuration application or the terminal application) as: single-clicking the button, double-clicking the button, triple-clicking the button, and long pressing the button for N seconds (N is configurable); it may also be configured as: single-tap (single-tap) the helmet body, quick double-tap (double-tap) the helmet body, quick triple-tap (triple-tap) the helmet body; whether it is a single-tap, double-tap, or triple-tap can be identified by the acceleration sensor on the helmet; in addition, the delivery rider can also trigger actions through voice, such as the delivery rider speaking to the smart helmet through the microphone to enter application M, and the DSP chip inside the smart helmet can recognize the keywords spoken by the delivery rider to enter application M.

[0082] If the delivery rider performs the second operation action, such as turning the head to the left, turning the head to the right, nodding, shaking the head, raising the head (head up), and lowering the head (head down), it can be identified by the operation action sensor (acceleration sensor and gyroscope) in the wearable device.

[0083] In this embodiment, for different candidate modes, different operation actions can be configured to enter (or exit), such as single-clicking the smart helmet body to enter application M, and double-clicking the smart helmet body to enter application N.

[0084] In order to understand how delivery riders operate wearable devices to interact with mobile phones during riding, Figure 3 To explain, Figure 3 This is an example flow chart of the interaction between the wearable device and the terminal application in this application.

[0085] First, the wearable device 201 executes step S301: uses an infrared sensor to detect whether the delivery rider is in a state of wearing the wearable device; if so, continues to execute step S302: detects whether the delivery rider performs the first operation action to enter the candidate mode; if so, executes step S303: determines the target candidate mode corresponding to the first operation action, and provides the instruction to enter the target candidate mode to the terminal application; the terminal application 202 executes step S304: in response to the instruction to enter the target candidate mode, turns on the target candidate mode. At the same time, a prompt tone for entering the target candidate mode is played through the wearable device. As for playing the prompt tone for entering the target candidate mode, it can be configured in advance in the configuration application or the terminal application: once it is detected that the delivery rider performs the first operation action to enter a candidate mode, the entry prompt tone is played directly, and the prompt tone can be some kind of music.

[0086] Afterwards, the wearable device 201 executes step S305: obtaining the first state value corresponding to the operation action sensor in the wearable device; for example, when the operation action sensor is an acceleration sensor and a gyroscope, the first state value corresponding to the acceleration sensor and the first state value corresponding to the gyroscope can be obtained; the acceleration sensor has a state value corresponding to each of the three dimensions (which can be the X-axis, Y-axis, and Z-axis), including a pitch value, a deflection value, and a left and right yaw value; similarly, the gyroscope also has a state value corresponding to each of the three dimensions, including a pitch value, a deflection value, and a left and right yaw value; the pitch value, deflection value, and left and right yaw value of the acceleration sensor and the pitch value, deflection value, and left and right yaw value of the gyroscope are used as the first state value. At this time, the delivery rider has not yet performed the second operation action. Afterwards, the wearable device executes step S306: detects whether the delivery rider performs the second operation action for performing the target function operation in the target candidate mode; if yes, executes step S307: obtains the second state value corresponding to the operation action sensor in the wearable device after performing the second operation action; the second state value is the pitch value, deflection value, left and right yaw value of the acceleration sensor and the pitch value, deflection value, left and right yaw value of the gyroscope after the delivery rider performs the second operation action. After obtaining the second state value, execute step S308: based on the first state value and the second state value, obtain the operation action amount corresponding to the second operation action. The operation action amount is actually measured based on the change of the parameters of the operation action sensor itself. Afterwards, execute step S309: determine whether the operation action amount exceeds the preset action amount threshold; if yes, execute step S310: determine the execution adjustment amount of the target function operation according to the operation action amount. For example, when the volume needs to be adjusted, when the second operation action is to turn the head to the left, the adjustment size of the volume is actually determined based on the amount of rotation of the head to the left. The adjustment size of the volume is an example of the execution adjustment amount. Of course, if in this process, the second operation action is a plurality of operation actions, each time a second operation action is executed, it is necessary to obtain the corresponding operation action amount, and then obtain the execution adjustment amount each time. Of course, each adjacent second operation action can be the same or different, and the time interval between each adjacent second operation action does not exceed the first preset time interval.

[0087] In the above step S309, it is assumed that the second operation performed by the delivery rider is turning the head to the left or turning the head to the right, and the corresponding preset action threshold is such as a rotation angle of 35 degrees. The reason why a rotation angle of 35 degrees is used as the preset action threshold is that the range of rotation when a person turns his head to the left or right is limited (such as the maximum rotation angle to the left or right generally does not exceed 70 degrees).

[0088] In the above step S310, the execution adjustment amount of executing the target function operation is determined based on the operation action amount, the corresponding relationship between the operation action amount and the function adjustment amount. The corresponding relationship between the operation action amount and the function adjustment amount can be a linear mapping relationship or a logarithmic relationship. Specifically, taking into account the limited amplitude range of head movements and the gradual slowing down of head movements at the ends of the up, down, left and right directions, it is more practical to use a logarithmic relationship. Assuming that x is used to represent the operation action amount and y is used as the function adjustment amount, as x increases, y also increases monotonically; x actually represents the amplitude of the head movement or the rotation angle, and y represents the adjustment amount corresponding to the specific function; in the area close to the x-axis (that is, when x is small), y changes faster; as x increases, y changes gradually slowly.

[0089] In step S308, the execution adjustment amount of executing the target function operation can also be determined based on the rotation angle, rotation angular velocity, acceleration, and rotation acceleration change corresponding to the second operation action, and according to these parameters. The rotation angle and rotation angular velocity are the change parameters corresponding to the gyroscope, and the acceleration and rotation acceleration change are the change parameters corresponding to the acceleration sensor. The rotation angle, rotation angular velocity, acceleration, and rotation acceleration change are dynamically changing parameters, and the prompt sound of the corresponding function can be synchronously played according to these dynamically changing parameters. The larger the rotation angle, the larger the prompt volume. Of course, the prompt volume can also be determined based on the rotation acceleration. The rotation angle, rotation angular velocity, acceleration, and rotation acceleration change can be obtained based on the above-mentioned first state value, the second state value and the duration information of executing the second operation action.

[0090] When obtaining the execution adjustment amount, it is taken into account that the head will return to the original initial position after turning. For example, when the delivery rider turns to the left to reduce the volume of the mobile phone, the head will return to the initial forward position after turning to the left to the maximum extent. Therefore, it is necessary to eliminate the jitter when the head returns to the initial position (that is, the maximum amplitude corresponding to the initial position to the action is taken as the operation action amount), and the execution adjustment amount is obtained based on the maximum amplitude value of the second operation action.

[0091] When the delivery rider performs certain second operation actions, it may not be possible to complete them in one go and the action may need to be repeated multiple times. For example, turning the head to the left once may not be enough to turn down the volume and the rider needs to turn the head to the left again or multiple times. In this embodiment, if the action needs to be repeated, two adjacent actions need to be completed within a first preset time interval.

[0092] In this embodiment, different operation actions can be set in the configuration application or terminal application (such as the delivery application) to implement more complex target function operations, such as turning the head left to indicate adjustment to the previous order, and nodding to dial the ordering user of this order. Then, through continuous actions of turning the head left and nodding, the ordering user of the previous order can be called on the mobile phone.

[0093] In fact, the execution adjustment amount is used to generate an operation instruction to be executed for executing the target function operation, so as to provide the operation instruction to be executed containing the execution adjustment amount to the terminal application for response. For example, after the slot information is assigned to the order and the voice is played, if the delivery rider turns his head to the left, the operation instruction to be executed contains a volume value for turning down the volume, so that the system application that adjusts the volume of the mobile phone can turn down the volume.

[0094] Afterwards, the terminal application 202 executes step S311: responding based on the to-be-executed operation instruction including the execution adjustment amount provided by the wearable device, and executing the target function operation.

[0095] Afterwards, the wearable device 201 executes step S312: detecting whether the delivery rider performs the first operation action of exiting the target candidate mode; if yes, the process ends. The first operation action of entering the target candidate mode and the first operation action of exiting the target candidate mode can be the same or different. For example, the smart helmet body can be single-clicked to enter the target candidate mode, and the smart helmet body can be double-clicked to exit the target candidate mode.

[0096] Of course, if it is determined in step S309 that the operation action amount does not exceed the preset action amount threshold or it is detected in step S306 that the delivery rider does not perform the second operation action within the preset second time interval, the target candidate mode is also exited and the process ends. The above second time interval is greater than the first time interval, such as the second time interval is 3 seconds and the first time interval is 1 second.

[0097] The above-mentioned Figures 1 to 3 That is, it is a diagram of an application scenario of the information interaction processing system of the present application. The application scenario of the information interaction processing system is not specifically limited in the embodiments of the present application. The application scenario of the above-mentioned information interaction processing system is only an embodiment of the application scenario of the information interaction processing system provided by the present application. The purpose of providing the application scenario embodiment is to facilitate the understanding of the information interaction processing system provided by the present application, and is not used to limit the information interaction processing system provided by the present application. Other application scenarios of the information interaction processing system in the embodiments of the present application are not described one by one.

[0098] First embodiment

[0099] This embodiment provides an information interaction processing system. For details, please refer to Figure 2 , which is a schematic diagram of an information interaction processing system provided in an embodiment of the present application. For some specific examples or details of this embodiment, please refer to the above scenario embodiment.

[0100] The information interaction processing system of this embodiment includes: a wearable device 201, a terminal application 202;

[0101] The wearable device 201 is used to determine the operation action to be detected in response to detecting the operation action of the wearer; determine the operation instruction to be executed according to the correspondence between the operation action to be detected and the operation; and provide the operation instruction to be executed to the terminal application.

[0102] The terminal application 202 is used to obtain the operation instruction to be executed and respond based on the operation instruction to be executed. In this embodiment, the terminal application at least includes a distribution application.

[0103] In this embodiment, the operation correspondence is an operation correspondence between an operation action performed by the wearer when wearing the wearable device, which is configured in a configuration application or in a terminal application, and an operation instruction indicating execution of the terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation when entering the candidate mode; the wearable device and the terminal application are connected in a short-range communication manner; entering or exiting a candidate mode of the terminal application includes entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

[0104] In this embodiment, a processor is provided in the wearable device. If the operation action to be detected is a second operation action for performing a target function operation when entering a candidate mode, the processor is used to obtain the amount of the operation action to be detected corresponding to the operation action to be detected; determine whether the amount of the operation action to be detected meets the preset operation action amount requirement; if the amount of the operation action to be detected meets the preset operation action amount requirement, then the operation action to be detected is taken as a valid action; as a method of determining the operation instruction to be executed according to the correspondence between the operation action to be detected and the operation: the operation action confirmed as a valid action in the operation action to be detected is taken as the target operation action to be detected, and the operation instruction to be executed is determined according to the correspondence between the target operation action to be detected and the operation.

[0105] In this embodiment, an operation action sensor is provided in the wearable device; the operation action sensor may refer to an IMU sensor, such as an acceleration sensor, a gyroscope, etc.; IMU, namely: Inertial Measurement Unit. As a way to obtain the amount of the operation action to be detected corresponding to the operation action to be detected: obtain a first state value corresponding to the operation action sensor before the wearer performs the operation action to be detected; obtain a second state value corresponding to the operation action sensor after the wearer performs the operation action to be detected; obtain the amount of the operation action to be detected according to the first state value and the second state value.

[0106] In this embodiment, if the operation action to be detected is a second operation action for executing the target function operation when entering the candidate mode, and the operation instruction to be executed includes an execution adjustment amount for executing the target function operation; the processor is specifically used to obtain the execution adjustment amount for executing the target function operation based on the correspondence between the operation action amount to be detected, the operation action amount and the function adjustment amount; and provide the execution adjustment amount to the terminal application; the terminal application is specifically used to respond based on the execution adjustment amount.

[0107] In this embodiment, if the operation to be detected is the first operation for entering the candidate mode of the terminal application, the wearable device is further configured to play a voice prompt for entering the candidate mode in response to detecting the first operation. For example, when entering a terminal application, a prompt tone corresponding to entering the terminal application is played.

[0108] In this embodiment, since a processor is provided in the wearable device, if the operation to be detected is the first operation for entering the candidate mode of the terminal application, the processor is further used to determine whether the wearer performs a second operation within a preset time period after performing the first operation; if the wearer does not perform the second operation within the preset time period, an exit instruction for exiting the candidate mode is sent to the terminal application; the terminal application is used to obtain the exit instruction and exit the candidate mode in response to the exit instruction. Figure 3 Some relevant explanations.

[0109] In this embodiment, the wearable device is connected to the application program interface of the terminal application; the wearable device is specifically used to call the application program interface of the terminal application, and provide the operation instructions to be executed to the terminal application through the called application program interface. For example, the smart helmet is interface-adapted with various terminal applications (including system applications); at the same time, when the terminal application is a delivery application, the smart helmet is also interface-adapted with various scenarios of the delivery application; so that the information that currently needs to be confirmed or interacted by the delivery rider can be voice-broadcasted on the smart helmet side, and then the delivery rider performs the first operation action or the second operation action, and then can enter the terminal application or enter the various task processes of the terminal application on the mobile phone through the smart helmet, and can also perform the target function operation.

[0110] In this embodiment, if the operation to be detected is the first operation for entering a candidate mode of a terminal application, the operation correspondence includes a mode correspondence between the operation and each candidate mode; specifically, determining the operation instruction to be executed based on the operation to be detected and the operation correspondence may mean: determining the target candidate mode pointed to by the operation to be detected in each candidate mode based on the mode correspondence between the operation to be detected and the mode; determining the instruction to enter the target candidate mode as the operation instruction to be executed. In this application, different first operation actions are used to enter different candidate modes, so the target candidate mode to be entered can be determined based on the first operation performed by the delivery rider.

[0111] The above describes the situation that the delivery rider can actively enter a candidate mode or actively perform a certain functional operation in a candidate mode through a wearable device. In fact, the inquiry request message can be played on the wearable device to make the delivery rider passively enter a candidate mode or passively perform a certain functional operation in a candidate mode. Specifically, in this embodiment, if the operation to be detected is the first operation action for entering the candidate mode of the terminal application, the terminal application is also used to respond to the need to enter the candidate mode (such as when the ordering user needs to call the ordering user) and send an inquiry request message to the wearable device to request a reply to enter the candidate mode; the wearable device is also used to obtain the inquiry request message and play the voice (such as playing whether to call the ordering user of the current order on the smart helmet), so that the delivery rider can listen to the voice played inquiry request message and perform the first operation action. Of course, before performing the second operation action, the terminal application can also send an inquiry request message to the wearable device to request a reply to whether to perform the target functional operation; the wearable device can also be used to obtain the inquiry request message and play the voice, so that the delivery rider can listen to the voice played inquiry request message and perform the second operation action.

[0112] In this embodiment, a positioning module is provided in the wearable device; the positioning module is used to perform real-time positioning of the wearer and obtain the real-time positioning information of the wearer; the real-time positioning information is provided to the terminal application; the terminal application is used to plan the path of the order to be delivered according to the real-time positioning information and obtain the delivery path of the order to be delivered; or, based on the real-time positioning information, update the order delivery status of the order to be delivered. The order delivery status of the order to be delivered is divided into arrival, pickup, delivery, and arrival; arrival corresponds to the merchant who arrives to pick up the goods; pickup corresponds to the pickup node; delivery corresponds to the state between the pickup and the delivery address of the ordering user; arrival corresponds to the completion of order delivery. The above nodes can be determined by the real-time positioning point of the delivery rider, so by positioning the delivery rider through the positioning module on the wearable device, the order delivery status can be updated in the delivery application.

[0113] In this embodiment, a wearing state detection sensor is provided in the wearable device; since the first operation action or the second operation action performed when the delivery rider is wearing or wearing the wearable device is effective, it is necessary to first use the wearing state detection sensor to detect whether the wearing user is in the state of wearing the wearable device; if the wearing user is in the state of wearing the wearable device, the subsequent step of determining the operation action to be detected in response to the detection of the operation action of the wearing user is performed to ensure that the operation action to be detected is effective. The wearing state detection sensor is such as an infrared sensor.

[0114] The present application provides an information interaction processing system, including: a wearable device and a terminal application; in the system, an operation correspondence relationship between an operation action performed by a wearable user when wearing the wearable device and an operation instruction indicated to be executed for the terminal application is pre-configured in a configuration application or in a terminal application, so that if the wearable user performs an operation action when wearing the wearable device, the wearable device can determine the operation action to be detected in response to detecting the operation action of the wearable user; then, according to the operation action to be detected and the operation correspondence relationship, determine the operation instruction to be executed; provide the operation instruction to be executed to the terminal application; so that the terminal application responds after obtaining the operation instruction to be executed. In the information interaction system, since the operation action at least includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for executing a target function operation in the candidate mode, entering or exiting the terminal The candidate modes of the terminal application include entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application, so that the wearing user can open or close the terminal application itself, or open a sub-program in the terminal application, or open some task processes in the terminal application by performing a corresponding first operation on the wearable device. Of course, after opening the terminal application itself, opening a sub-program in the terminal application, or opening some task processes in the terminal application, the wearing user can also perform a second operation on the wearable device to perform a target function operation in the opened terminal application, or perform a target function operation in the opened sub-program, or perform a target function operation in the opened task process; in short, the wearing user can realize multiple modes or multiple functions in the terminal application by simply operating the wearable device, which greatly facilitates the wearable user to interact with the mobile phone through the wearable device.

[0115] Furthermore, since wearable devices can be used to enter or exit the terminal's candidate mode or perform multiple functional operations in the candidate mode, the candidate modes are diverse, allowing delivery riders to directly use wearable devices to access multiple terminal applications or task processes of multiple terminal applications. Combined with multiple head movements or a combination of multiple head movements, multiple functional operations can be performed within the terminal application or task process, avoiding the need for delivery riders to distract themselves by operating their mobile phones while riding or walking with multiple orders, greatly improving the delivery rider experience.

[0116] Second embodiment

[0117] Corresponding to the first embodiment, the second embodiment of the present application provides an information interaction processing method. The execution subject of this embodiment is a wearable device, and the same parts of the second embodiment as the first embodiment are not introduced again. For details, please refer to the relevant parts of the first embodiment and the scenario embodiment.

[0118] Please refer to Figure 4 , which is a flowchart of the information interaction processing method provided in the second embodiment of the present application.

[0119] The information interaction processing method of the embodiment of the present application includes the following steps.

[0120] Step S401: In response to detecting an operation action of the wearer, determining an operation action to be detected.

[0121] The operation action includes at least one of a first operation action for entering or exiting a candidate mode of a terminal application and a second operation action for performing a target function operation when entering the candidate mode; entering or exiting the candidate mode of a terminal application includes entering or exiting a terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

[0122] Step S402: Determine the operation instruction to be executed according to the corresponding relationship between the operation action to be detected and the operation.

[0123] The operation correspondence is an operation correspondence between an operation action performed by a wearer when wearing the wearable device and an operation instruction executed on the terminal application, which is configured in a configuration application or in a terminal application; the wearable device and the terminal application are connected in a short-distance communication manner.

[0124] Step S403: providing the operation instruction to be executed to the terminal application, so that the terminal responds based on the operation instruction to be executed.

[0125] In this embodiment, if the operation action to be detected is a second operation action for performing a target function operation when entering a candidate mode, then before executing the step of determining the operation instruction to be executed based on the correspondence between the operation action to be detected and the operation, it also includes: obtaining the operation action amount to be detected corresponding to the operation action to be detected; judging whether the operation action amount to be detected meets the preset operation action amount requirement; if the operation action amount to be detected meets the preset operation action amount requirement, then executing the step of determining the operation instruction to be executed based on the correspondence between the operation action to be detected and the operation.

[0126] In this embodiment, an operation action sensor is provided in the wearable device; the operation action amount to be detected corresponding to the operation action to be detected is obtained, including: obtaining a first state value corresponding to the operation action sensor before the wearing user performs the operation action to be detected; obtaining a second state value corresponding to the operation action sensor after the wearing user performs the operation action to be detected; and obtaining the operation action amount to be detected based on the first state value and the second state value.

[0127] In this embodiment, the operation instruction to be executed includes an execution adjustment amount for executing the target functional operation; the method also includes: obtaining the execution adjustment amount for executing the target functional operation based on the correspondence between the operation action amount to be detected, the operation action amount and the functional adjustment amount; providing the execution adjustment amount to the terminal application so that the terminal application responds based on the execution adjustment amount.

[0128] In this embodiment, if the operation action to be detected is a first operation action for entering a candidate mode of the terminal application, the method further includes: in response to detecting the first operation action, playing a voice prompt message for entering the candidate mode.

[0129] In this embodiment, if the operation action to be detected is a first operation action for entering a candidate mode of a terminal application, the method also includes: determining whether the wearing user performs a second operation action within a preset time period after performing the first operation action; if the wearing user does not perform the second operation action within the preset time period, sending an exit instruction to exit the candidate mode to the terminal application, so that the terminal application exits the candidate mode in response to the exit instruction.

[0130] In this embodiment, the wearable device is connected to the application program interface of the terminal application; providing the operation instruction to be executed to the terminal application includes: calling the application program interface of the terminal application, and providing the operation instruction to be executed to the terminal application through the called application program interface.

[0131] In this embodiment, if the operation action to be detected is the first operation action for entering a candidate mode of a terminal application, the operation correspondence includes a mode correspondence between the operation action and each candidate mode; as a method of determining the operation instruction to be executed based on the operation action to be detected and the operation correspondence: first, based on the operation action to be detected and the mode correspondence, determine the target candidate mode pointed to by the operation action to be detected in each candidate mode; then, determine the instruction to enter the target candidate mode as the operation instruction to be executed.

[0132] In this embodiment, if the operation action to be detected is the first operation action for entering the candidate mode of the terminal application, before executing the first operation, the method also includes: obtaining an inquiry request message sent by the terminal application for requesting a reply on whether to enter the candidate mode; and voice playing the inquiry request message.

[0133] In this embodiment, a positioning module is provided in the wearable device; the method also includes: using the positioning module to perform real-time positioning of the wearing user to obtain real-time positioning information of the wearing user; providing the real-time positioning information to the terminal application, so that the terminal application performs path planning for the order to be delivered according to the real-time positioning information, and obtains the delivery path of the order to be delivered; or, based on the real-time positioning information, updating the order delivery status of the order to be delivered.

[0134] In this embodiment, a wearing state detection sensor is provided in the wearable device; the method further includes: using the wearing state detection sensor to detect whether the wearing user is in a state of wearing the wearable device; if the wearing user is in a state of wearing the wearable device, executing a step of determining the operation action to be detected in response to detecting the operation action of the wearing user.

[0135] Third embodiment

[0136] Corresponding to the first embodiment, the third embodiment of the present application provides a second information interaction processing method. The execution subject of this embodiment is a terminal application, and the same parts of the third embodiment as the first embodiment are not introduced again. For details, please refer to the relevant parts of the first embodiment and the scenario embodiment.

[0137] Please refer to Figure 5 , which is a flowchart of the information interaction processing method provided in the third embodiment of the present application.

[0138] The information interaction processing method of the embodiment of the present application includes the following steps.

[0139] Step S501: Obtain an operation instruction to be executed sent by the wearable device.

[0140] Step S502: respond based on the operation instruction to be executed.

[0141] In this embodiment, the operation instruction to be executed is determined by the wearable device based on the operation action to be detected performed by the wearing user on the wearable device and the operation correspondence; the operation correspondence is the operation correspondence between the operation action performed by the wearing user when wearing the wearable device configured in the configuration application or in the terminal application and the operation instruction indicating the execution of the terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation when entering the candidate mode; the wearable device and the terminal application are connected in a short-distance communication manner; entering or exiting the candidate mode of the terminal application includes entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

[0142] In this embodiment, the operation instruction to be executed includes an execution adjustment amount for executing the target function operation; the method also includes: obtaining the execution adjustment amount for executing the target function operation sent by the wearable device; the execution adjustment amount is obtained by the wearable device based on the correspondence between the operation action amount to be detected corresponding to the operation action to be detected, the operation action amount and the function adjustment amount; responding based on the execution adjustment amount.

[0143] In this embodiment, the wearable device is connected to the application program interface of the terminal application; as a way to obtain the to-be-executed operation instruction sent by the wearable device: obtaining the to-be-executed operation instruction sent by the wearable device through the application program interface.

[0144] In this embodiment, it also includes: in response to detecting the need to enter the candidate mode, sending an inquiry request message for requesting a reply on whether to enter the candidate mode to the wearable device, so that the wearable device obtains the inquiry request message and performs voice playback.

[0145] In this embodiment, the terminal application includes at least a delivery application; if the terminal application is a delivery application, the method further includes: obtaining real-time positioning information sent by the wearable device for real-time positioning of the wearing user; based on the real-time positioning information, performing path planning for the order to be delivered, and obtaining the delivery path of the order to be delivered; or, based on the real-time positioning information, updating the order delivery status of the order to be delivered.

[0146] Fourth embodiment

[0147] Corresponding to the information interaction processing method provided in the second embodiment of the present application, the fourth embodiment of the present application also provides an information interaction processing device. Since the device embodiment is basically similar to the second embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the second embodiment. The device embodiment described below is only illustrative.

[0148] Please refer to Figure 6 , which is a schematic diagram of an information interaction processing device provided in the fourth embodiment of the present application.

[0149] The information interaction processing device 600 is applied to a wearable device, and the device includes: a to-be-detected operation action determination unit 601, which is used to determine the to-be-detected operation action in response to detecting the operation action of the wearer; the operation action at least includes at least one of a first operation action for entering or exiting a candidate mode of a terminal application and a second operation action for performing a target function operation in the candidate mode; entering or exiting the candidate mode of the terminal application includes entering or exiting the terminal application or entering or exiting a sub-application in the terminal application or entering or exiting a task process of the terminal application; a to-be-executed operation instruction determination unit 602, which is used to determine the to-be-executed operation instruction according to the to-be-detected operation action and the operation correspondence relationship; the operation correspondence relationship is an operation correspondence relationship between the operation action performed by the wearer when wearing the wearable device and the operation instruction indicated to be executed for the terminal application, which is configured in a configuration application or in a terminal application; the wearable device and the terminal application are connected in a short-distance communication manner; and a to-be-executed operation instruction providing unit 603, which is used to provide the to-be-executed operation instruction to the terminal application so that the terminal responds based on the to-be-executed operation instruction.

[0150] Fifth embodiment

[0151] Corresponding to the information interaction processing method provided in the third embodiment of the present application, the fifth embodiment of the present application also provides an information interaction processing device. Since the device embodiment is basically similar to the third embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the third embodiment. The device embodiment described below is only illustrative.

[0152] Please refer to Figure 7 , which is a schematic diagram of an information interaction processing device provided in the fifth embodiment of the present application.

[0153] The information interaction processing device 700 is applied to a terminal application, and the device includes: a to-be-executed operation instruction obtaining unit 701, which is used to obtain the to-be-executed operation instruction sent by the wearable device; a responding unit 702, which is used to respond based on the to-be-executed operation instruction; the to-be-executed operation instruction is determined by the wearable device based on the to-be-detected operation action performed by the wearer user on the wearable device and the operation correspondence relationship; the operation correspondence relationship is an operation correspondence relationship between the operation action performed by the wearer user when wearing the wearable device and the operation instruction indicated to be executed on the terminal application, which is configured in a configuration application or in a terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation in the candidate mode; the wearable device and the terminal application are connected in a short-distance communication manner; entering or exiting the candidate mode of the terminal application includes entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

[0154] Sixth embodiment

[0155] Corresponding to the methods of the second to third embodiments of the present application, the sixth embodiment of the present application further provides an electronic device.

[0156] like Figure 8 As shown, Figure 8 A schematic diagram of an electronic device provided in accordance with the sixth embodiment of the present application.

[0157] In this embodiment, an optional hardware structure of the electronic device 800 can be as follows: Figure 8 As shown, it includes: at least one processor 801, at least one memory 802 and at least one communication bus 805; the memory 802 contains a program 803 and data 804.

[0158] The bus 805 may be a communication device for transmitting data between components inside the electronic device 800, such as an internal bus (e.g., a CPU-memory bus, where the processor is a central processing unit, CPU for short), an external bus (e.g., a universal serial bus port, a peripheral component interconnect express port), etc.

[0159] In addition, the electronic device also includes: at least one network interface 806, at least one peripheral interface 807. The network interface 806 provides wired or wireless communication related to an external network 808 (for example, the Internet, an intranet, a local area network, a mobile communication network, etc.); in some embodiments, the network interface 806 may include any number of network interface controllers (NICs), radio frequency (RF) modules, repeaters, transceivers, modems, routers, gateways, any combination of wired network adapters, wireless network adapters, Bluetooth adapters, infrared adapters, near field communication (NFC) adapters, cellular network chips, etc.

[0160] The peripheral interface 807 is used to connect to the peripheral device, and the peripheral device can be the peripheral device 1 ( Figure 8 809 in), peripheral 2 ( Figure 8 810) and peripheral 3 ( Figure 8 811 in the figure). Peripherals are peripheral devices, which may include but are not limited to cursor control devices (such as mice, touch pads or touch screens), keyboards, displays (such as cathode ray tube displays, liquid crystal displays). Displays or light emitting diode displays, video input devices (such as cameras or communication interfaces coupled to video files), etc.

[0161] The processor 801 may be a CPU, or an application specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present application.

[0162] The memory 802 may include a high-speed RAM (full name: Random Access Memory) memory, and may also include a non-volatile memory, such as at least one disk memory.

[0163] The processor 801 calls the program and data stored in the memory 802 to execute the methods of the second embodiment to the third embodiment of the present application.

[0164] Seventh embodiment

[0165] Corresponding to the methods of the second to third embodiments of the present application, the seventh embodiment of the present application also provides a computer storage medium, which stores a computer program, and the computer program is run by a processor to execute the methods of the second to third embodiments of the present application.

[0166] Although the present application is disclosed as above in the form of a preferred embodiment, it is not intended to limit the present application. Any technical personnel in this field may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.

[0167] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory. The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0168] 1. Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. According to the definition in this article, computer-readable media does not include non-transitory computer-readable storage media, such as modulated data signals and carrier waves.

[0169] 2. Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems or computer program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0170] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

Claims

1. An information interaction processing system, characterized in that: include: Wearable devices and terminal applications; The wearable device is used to determine the operation action to be detected in response to detecting the operation action of the wearer; Determine the operation instruction to be executed according to the corresponding relationship between the operation action to be detected and the operation; Providing the to-be-executed operation instruction to the terminal application; the operation correspondence is an operation correspondence between an operation action performed by a wearing user when wearing the wearable device and an operation instruction executed for the terminal application, which is configured in a configuration application or in a terminal application; The operation action at least includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation when entering the candidate mode; the wearable device and the terminal application are connected in a short-distance communication manner; The candidate modes of entering or exiting the terminal application include entering or exiting the terminal application, entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application; The terminal application is used to obtain the operation instruction to be executed and respond based on the operation instruction to be executed.

2. The system according to claim 1, characterized in that The wearable device is provided with a processor, and if the operation action to be detected is a second operation action for performing a target function operation when entering a candidate mode, the processor is used to obtain an operation action amount to be detected corresponding to the operation action to be detected; and determine whether the operation action amount to be detected meets a preset operation action amount requirement condition; If the amount of the operation to be detected meets the preset operation amount requirement, the operation to be detected is regarded as a valid action; Determining the operation instruction to be executed based on the correspondence between the operation action to be detected and the operation includes: taking the operation action confirmed as a valid action among the operation actions to be detected as the target operation action to be detected, and determining the operation instruction to be executed based on the correspondence between the target operation action to be detected and the operation.

3. The system according to claim 2, characterized in that The wearable device is provided with an operation motion sensor; The obtaining the amount of the operation action to be detected corresponding to the operation action to be detected includes: Obtaining a first state value corresponding to the operation action sensor before the wearing user performs the operation action to be detected; Obtaining a second state value corresponding to the operation action sensor after the wearing user performs the operation action to be detected; The amount of the operation to be detected is obtained according to the first state value and the second state value.

4. The system according to claim 3, characterized in that The to-be-executed operation instruction includes an execution adjustment amount for executing the target functional operation; The processor is specifically configured to obtain an execution adjustment amount for executing the target function operation according to the corresponding relationship between the operation action amount to be detected, the operation action amount and the function adjustment amount; and provide the execution adjustment amount to the terminal application; The terminal application is specifically configured to respond based on the execution adjustment amount.

5. An information interaction processing method, characterized in that: Applied to a wearable device, the method comprises: In response to detecting an operation action of the wearing user, determining an operation action to be detected; the operation action at least includes at least one of a first operation action for entering or exiting a candidate mode of a terminal application and a second operation action for performing a target function operation in the candidate mode; entering or exiting a candidate mode of a terminal application includes entering or exiting a terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application; Determine the operation instruction to be executed according to the correspondence between the operation action to be detected and the operation; the operation correspondence is an operation correspondence between the operation action performed by the wearer when wearing the wearable device and the operation instruction executed for the terminal application, which is configured in the configuration application or in the terminal application; the wearable device and the terminal application are connected in a short-distance communication manner; The operation instruction to be executed is provided to a terminal application, so that the terminal responds based on the operation instruction to be executed.

6. An information interaction processing method, characterized in that: Applied to terminal applications, the method includes: Obtaining the operation instructions to be executed sent by the wearable device; Respond based on the operation instruction to be executed; the operation instruction to be executed is determined by the wearable device based on the operation action to be detected performed by the wearable user on the wearable device and the operation correspondence; the operation correspondence is an operation correspondence between the operation action performed by the wearable user when wearing the wearable device and the operation instruction indicated to be executed on the terminal application, which is configured in the configuration application or in the terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation when entering the candidate mode; the wearable device and the terminal application are connected in a short-distance communication manner; entering or exiting the candidate mode of the terminal application includes entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

7. An information interaction processing device, characterized in that: Applied to a wearable device, the device comprises: A unit for determining an operation action to be detected, configured to determine an operation action to be detected in response to detecting an operation action of a user wearing the device; the operation action at least includes at least one of a first operation action for entering or exiting a candidate mode of a terminal application and a second operation action for performing a target function operation in the candidate mode; entering or exiting a candidate mode of a terminal application includes entering or exiting a terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application; a unit for determining an operation instruction to be executed, configured to determine an operation instruction to be executed according to a correspondence relationship between the operation action to be detected and the operation; the operation correspondence relationship is an operation correspondence relationship between an operation action to be executed by a wearer when wearing the wearable device and an operation instruction to be executed for the terminal application, which is configured in a configuration application or in a terminal application; the wearable device and the terminal application are connected in a short-distance communication manner; The unit for providing the operation instruction to be executed is used to provide the operation instruction to be executed to the terminal application, so that the terminal responds based on the operation instruction to be executed.

8. An information interaction processing device, characterized in that: Applied to terminal applications, the device comprises: A unit for obtaining an operation instruction to be executed, used for obtaining an operation instruction to be executed sent by a wearable device; A response unit, used to respond based on the to-be-executed operation instruction; the to-be-executed operation instruction is determined by the wearable device based on the to-be-detected operation action performed by the wearer user on the wearable device and the operation correspondence; the operation correspondence is an operation correspondence configured in a configuration application or in a terminal application between an operation action performed by the wearer user when wearing the wearable device and an operation instruction indicating execution on the terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation in entering the candidate mode; the wearable device and the terminal application are connected in a short-distance communication manner; entering or exiting the candidate mode of the terminal application includes entering or exiting the terminal application, or entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

9. An electronic device, characterized in that: include: processor; A memory for storing a computer program, wherein the computer program is executed by a processor to perform the method according to any one of claims 5 to 6.

10. A computer storage medium, characterized in that: The computer storage medium stores a computer program, which is executed by a processor to perform the method according to any one of claims 5 to 6.

Images