Information interaction processing system, method and apparatus, and electronic device and storage medium

Abstract

Provided in the present application are an information interaction processing system, method and apparatus, and an electronic device and a computer storage medium. In the system, since operation actions include at least one operation action among a first operation action and a second operation action, by executing a corresponding first operation action for a wearable device, a wearable device user can open or close a terminal application itself, or open a subroutine in the terminal application or open some task processes in the terminal application; and of course, after opening the terminal application itself, or opening a subroutine in the terminal application or opening some task processes in the terminal application, the wearable device user can also execute the second operation action for the wearable device, so as to execute a target function operation in the opened terminal application, subroutine, or task processes. In summary, a plurality of modes or a plurality of functions can be operated in a terminal application merely by operating a wearable device, thereby facilitating the interaction with a mobile phone by means of the wearable device.

Description

Information interaction processing systems, methods, apparatuses, electronic devices and storage media

[0001] This application claims priority to Chinese Patent Application No. 202411419363.9, filed on October 11, 2024, entitled "Information Interaction Processing System, Method, Apparatus, Electronic Device and Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of computer technology, specifically to information interaction processing systems, information interaction processing methods, information interaction processing devices, electronic devices, and computer storage media. Background Technology

[0003] As more and more people order goods online, the number of online orders is also increasing, making the delivery of these orders increasingly important for delivery riders. On the one hand, while ensuring timely delivery of online orders, delivery riders also hope to deliver an increasing number of orders.

[0004] During online order deliveries, whether riders are on a bike or walking (e.g., picking up or delivering orders to the final destination where walking is necessary), their attention is often focused on observing road conditions or carrying multiple orders, making it inconvenient for them to operate their phones. However, there are numerous points in the delivery process where riders need to use their phones. For example, when receiving a call from a customer reminding them of their order, they need to answer the call; when picking up the food from the merchant, they need to check in through the delivery app. Therefore, providing a convenient way for riders to operate their phones during online order deliveries is a pressing technical problem that needs to be solved. Summary of the Invention

[0005] This application provides an information interaction processing system to provide delivery riders with an easy way to operate their mobile phones and interact with them during the delivery order process. This application also provides an information interaction processing method, an information interaction processing device, an electronic device, and a computer storage medium.

[0006] This application provides an information interaction processing system, including: a wearable device and a terminal application; the wearable device is configured to, in response to detecting an operation action of a wearer, determine a detection operation action; determine an operation instruction to be executed based on the detection operation action and an operation correspondence; and provide the operation instruction to be executed to the terminal application; the operation correspondence is an operation correspondence configured in the configuration application or in the terminal application, indicating the operation action performed by the wearer when wearing the wearable device and the operation instruction to be executed for the terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation in the candidate mode; the wearable device and the terminal application are connected via short-range communication; the candidate modes for entering or exiting the terminal application include entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting a task process of the terminal application; the terminal application is configured to obtain the operation instruction to be executed and respond based on the operation instruction to be executed.

[0007] Optionally, the wearable device includes a processor. If the operation to be detected is a second operation for performing a target function operation in a candidate mode, the processor is configured to obtain the quantity of the operation to be detected corresponding to the operation to be detected; determine whether the quantity of the operation to be detected meets a preset operation quantity requirement; if the quantity of the operation to be detected meets the preset operation quantity requirement, then the operation to be detected is considered a valid operation; the step of determining the operation instruction to be executed based on the correspondence between the operation to be detected and the operation includes: taking the operation confirmed as a valid operation among the operation to be detected as the target operation to be detected, and determining the operation instruction to be executed based on the correspondence between the target operation to be detected and the operation.

[0008] Optionally, the wearable device is equipped with an operation motion sensor; obtaining the quantity of the operation motion to be detected includes: obtaining a first state value of the operation motion sensor before the wearer performs the operation motion to be detected; obtaining a second state value of the operation motion sensor after the wearer performs the operation motion to be detected; and obtaining the quantity of the operation motion to be detected based on the first state value and the second state value.

[0009] Optionally, the operation instruction to be executed includes an execution adjustment amount for performing the target function operation; the processor is specifically configured to obtain the execution adjustment amount for performing the target function operation based on the detection operation action amount and the correspondence between the operation action amount and the function adjustment amount; provide the execution adjustment amount to the terminal application; the terminal application is specifically configured to respond based on the execution adjustment amount.

[0010] Optionally, if the operation to be detected is a first operation for entering a candidate mode of the terminal application, the wearable device is further configured to play a voice prompt message for entering the candidate mode in response to detecting the first operation.

[0011] Optionally, the wearable device includes a processor; if the operation to be detected is a first operation for entering a candidate mode of the terminal application, the processor is further configured to determine whether the wearable user performs a second operation within a preset time period after performing the first operation; if the wearable user does not perform the second operation within the preset time period, an exit instruction to exit the candidate mode is sent to the terminal application; the terminal application is configured to receive the exit instruction and exit the candidate mode in response to the exit instruction.

[0012] Optionally, the wearable device interfaces with the application programming interface (API) of the terminal application; specifically, the wearable device is used to call the API of the terminal application to provide the operation instructions to be executed to the terminal application through the called API.

[0013] Optionally, if the operation to be detected is a first operation for entering a candidate mode of the terminal application, the operation correspondence includes the mode correspondence between the operation and each candidate mode; determining the operation instruction to be executed based on the operation to be detected and the operation correspondence includes: determining the target candidate mode pointed to by the operation to be detected in each candidate mode based on the operation to be detected and the mode correspondence; and determining the instruction to enter the target candidate mode as the operation instruction to be executed.

[0014] Optionally, the wearable device includes a positioning module; the positioning module is used to locate the wearer in real time and obtain the wearer's real-time positioning information; the real-time positioning information is provided to the terminal application; the terminal application is used to perform route planning for the order to be delivered based on the real-time positioning information to obtain the delivery route of the order to be delivered; or, based on the real-time positioning information, update the order delivery status of the order to be delivered.

[0015] Optionally, the wearable device is provided with a wearing status detection sensor; the wearing status detection sensor is used to detect whether the wearer is wearing the wearable device; if the wearer is wearing the wearable device, then the step of determining the operation to be detected is executed in response to detecting the wearer's operation.

[0016] This application provides an information interaction processing method applied to a wearable device. The method includes: in response to detecting an operation action of a wearer, determining an operation action to be detected; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of a terminal application and a second operation action for performing a target function operation in the candidate mode; the candidate mode for entering or exiting the terminal application includes entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting a task process of the terminal application; determining an operation instruction to be executed based on the operation action to be detected and an operation correspondence relationship; the operation correspondence relationship is an operation correspondence relationship configured in a configuration application or in a terminal application, indicating the operation action performed by the wearer when wearing the wearable device and the operation instruction to be executed for the terminal application; the wearable device and the terminal application are connected via short-range communication; and providing the operation instruction to be executed to the terminal application so that the terminal responds based on the operation instruction to be executed.

[0017] Optionally, if the operation to be detected is a second operation for performing a target function operation in the candidate mode, then before performing the step of determining the operation instruction to be executed based on the operation to be detected and the operation correspondence, the method further includes: obtaining the quantity of the operation to be detected corresponding to the operation to be detected; determining whether the quantity of the operation to be detected meets the preset operation quantity requirement; if the quantity of the operation to be detected meets the preset operation quantity requirement, then performing the step of determining the operation instruction to be executed based on the operation to be detected and the operation correspondence.

[0018] Optionally, the wearable device is equipped with an operation motion sensor; obtaining the quantity of the operation motion to be detected includes: obtaining a first state value of the operation motion sensor before the wearer performs the operation motion to be detected; obtaining a second state value of the operation motion sensor after the wearer performs the operation motion to be detected; and obtaining the quantity of the operation motion to be detected based on the first state value and the second state value.

[0019] Optionally, the operation instruction to be executed includes an execution adjustment amount for performing the target function operation; the method further includes: obtaining the execution adjustment amount for performing the target function operation based on the operation action quantity to be detected, the correspondence between the operation action quantity and the function adjustment amount; and providing the execution adjustment amount to the terminal application so that the terminal application responds based on the execution adjustment amount.

[0020] Optionally, if the operation to be detected is a first operation for entering a candidate mode of the terminal application, the method further includes: in response to detecting the first operation, playing a voice prompt message for entering the candidate mode.

[0021] Optionally, if the operation to be detected is a first operation for entering a candidate mode of the terminal application, the method further includes: determining whether the wearable user performs the second operation within a preset time period after performing the first operation; if the wearable user does not perform the second operation within the preset time period, sending an exit command to the terminal application to exit the candidate mode, so that the terminal application exits the candidate mode in response to the exit command.

[0022] Optionally, the wearable device interfaces with the application programming interface (API) of the terminal application; providing the operation instruction to be executed to the terminal application includes: calling the application programming interface of the terminal application and providing the operation instruction to be executed to the terminal application through the called application programming interface.

[0023] Optionally, if the operation to be detected is a first operation for entering a candidate mode of the terminal application, the operation correspondence includes the mode correspondence between the operation and each candidate mode; determining the operation instruction to be executed based on the operation to be detected and the operation correspondence includes: determining the target candidate mode pointed to by the operation to be detected in each candidate mode based on the operation to be detected and the mode correspondence; and determining the instruction to enter the target candidate mode as the operation instruction to be executed.

[0024] Optionally, the wearable device is equipped with a positioning module; the method further includes: using the positioning module to perform real-time positioning of the wearer to obtain the wearer's real-time positioning information; providing the real-time positioning information to the terminal application so that the terminal application can perform route planning for the order to be delivered based on the real-time positioning information to obtain the delivery route of the order to be delivered; or, updating the order delivery status of the order to be delivered based on the real-time positioning information.

[0025] Optionally, the wearable device is provided with a wearing status detection sensor; the method further includes: using the wearing status detection sensor to detect whether the wearer is wearing the wearable device; if the wearer is wearing the wearable device, then performing the step of determining the operation to be detected in response to detecting the wearer's operation.

[0026] This application provides an information interaction processing method applied to a terminal application. The method includes: obtaining an operation instruction to be executed sent by a wearable device; responding based on the operation instruction to be executed; the operation instruction to be executed is determined by the wearable device based on a detection operation action performed by a wearer on the wearable device and an operation correspondence; the operation correspondence is an operation correspondence configured in a configuration application or in a terminal application, representing the operation action performed by a wearer when wearing the wearable device and an operation instruction to be executed on the terminal application; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation in the candidate mode; the wearable device and the terminal application are connected via short-range communication; the candidate modes for entering or exiting the terminal application include entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting a task process of the terminal application.

[0027] Optionally, the operation instruction to be executed includes an execution adjustment amount for performing the target function operation; the method further includes: obtaining the execution adjustment amount sent by the wearable device for performing the target function operation; the execution adjustment amount is obtained by the wearable device based on the corresponding quantity of the operation to be detected and the correspondence between the operation quantity and the function adjustment amount; and responding based on the execution adjustment amount.

[0028] Optionally, the wearable device interfaces with the application programming interface (API) of the terminal application; obtaining the operation instruction to be executed sent by the wearable device includes: obtaining the operation instruction to be executed sent by the wearable device through the API.

[0029] Optionally, the terminal application includes at least a delivery application. If the terminal application is a delivery application, the method further includes: obtaining real-time location information sent by the wearable device for real-time location of the wearer; performing route planning for the order to be delivered based on the real-time location information to obtain the delivery route of the order to be delivered; or updating the order delivery status of the order to be delivered based on the real-time location information.

[0030] This application provides an information interaction processing device applied to a wearable device. The device includes: a detection operation action determination unit, configured to determine a detection operation action in response to detecting an operation action of a wearer; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of a terminal application and a second operation action for performing a target function operation in the candidate mode; the candidate mode for entering or exiting the terminal application includes entering or exiting the terminal application, entering or exiting a sub-application of the terminal application, or entering or exiting a task process of the terminal application; a pending operation instruction determination unit, configured to determine a pending operation instruction based on the detection operation action and operation correspondence; the operation correspondence is an operation correspondence configured in a configuration application or in a terminal application, indicating the operation action performed by the wearer when wearing the wearable device and the operation instruction indicating execution for the terminal application; the wearable device and the terminal application are connected via short-range communication; and a pending operation instruction providing unit, configured to provide the pending operation instruction to the terminal application so that the terminal responds based on the pending operation instruction.

[0031] This application provides an information interaction processing device applied to a terminal application. The device includes: a pending operation instruction acquisition unit for acquiring a pending operation instruction sent by a wearable device; and a response unit for responding based on the pending operation instruction. The pending operation instruction is determined by the wearable device based on a detection operation action performed by a wearer on the wearable device and an operation correspondence. The operation correspondence is an operation correspondence configured in a configuration application or a terminal application, representing the operation action performed by a wearer when wearing the wearable device and an operation instruction executed on the terminal application. The operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation in the candidate mode. The wearable device and the terminal application are connected via short-range communication. The candidate modes for entering or exiting the terminal application include entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting a task process of the terminal application.

[0032] This application provides an electronic device, including: a processor; and a memory for storing a computer program, which is executed by the processor to perform the above-described information interaction processing method.

[0033] This application provides a computer storage medium storing a computer program, which is executed by a processor to perform the above-described information interaction processing method.

[0034] Compared with the prior art, the embodiments of this application have the following advantages:

[0035] This application provides an information interaction processing system, including a wearable device and a terminal application. In this system, a mapping relationship between an operation performed by a wearable user while wearing the wearable device and an operation instruction to be executed on the terminal application is pre-configured in a configuration application or in the terminal application. This allows the wearable device to detect and determine the operation to be detected when the wearable user performs an operation. Then, based on the operation to be detected and the mapping relationship, an operation instruction to be executed is determined. This operation instruction is then provided to the terminal application. The terminal application responds upon receiving the operation instruction. In this information interaction system, since the operation includes at least one of a first operation for entering or exiting a candidate mode of the terminal application and a second operation for performing a target function operation while entering the candidate mode, entering or exiting the terminal application... The candidate modes for the terminal application include entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting a task process within the terminal application. This allows wearable users to open or close the terminal application itself, open a sub-application within the terminal application, or open some task processes within the terminal application by performing a corresponding first operation on the wearable device. Of course, after opening the terminal application itself, a sub-application within the terminal application, or some task processes within the terminal application, wearable users can also perform a second operation on the wearable device to perform a target function operation within the opened terminal application, or within the opened sub-application, or within the opened task process. In short, wearable users can achieve multiple modes or functions in the terminal application simply by operating the wearable device, greatly facilitating the interaction between wearable users and their mobile phones through the wearable device. Attached Figure Description

[0036] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this application. For those skilled in the art, other drawings can be obtained based on these drawings.

[0037] Figure 1 is a schematic diagram of the information interaction processing system of this application.

[0038] Figure 2 is a schematic diagram of the information interaction processing system provided in this application.

[0039] Figure 3 is a flowchart illustrating an example of the interaction between the wearable device and the terminal application in this application.

[0040] Figure 4 is a flowchart of the information interaction processing method provided in the second embodiment of this application.

[0041] Figure 5 is a flowchart of the information interaction processing method provided in the third embodiment of this application.

[0042] Figure 6 is a schematic diagram of the information interaction processing device provided in the fourth embodiment of this application.

[0043] Figure 7 is a schematic diagram of the information interaction processing device provided in the fifth embodiment of this application.

[0044] Figure 8 is a schematic diagram of the electronic device provided in the sixth embodiment of this application. Detailed Implementation

[0045] Many specific details are set forth in the following description to provide a full understanding of this application. However, this application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of this application. Therefore, this application is not limited to the specific implementations disclosed below.

[0046] This application provides an information interaction processing system, an information interaction processing method, an information interaction processing device, an electronic device, and a computer storage medium. The following specific embodiments describe the information interaction processing system, the information interaction processing method, the information interaction processing device, the electronic device, and the computer storage medium. To more clearly illustrate the information interaction processing system provided in this application's embodiments, the application scenarios of the information interaction processing system provided in this application's embodiments are first introduced.

[0047] The information interaction processing system of this application can be used in scenarios where delivery riders use wearable devices to control and interact with mobile terminal applications during order delivery. The terminal application can be a system application on the mobile phone, such as a call application, SMS application, or volume control application; it can also be an application downloaded to the mobile phone, such as a delivery application (used by the delivery rider to deliver orders) or a social application. This application primarily uses a delivery application as an example of a terminal application. Of course, it is understood that the delivery rider is merely one example of a user wearing the wearable device; other users besides delivery riders can also be users, as long as they wear or carry the wearable device.

[0048] For example, when delivery rider 1 has picked up an order, such as order A (i.e., the pickup for order A has been completed), and is on his way to deliver order A to the address specified by the ordering user, while riding, the ordering user urges the delivery rider to complete the order and calls the delivery rider 1. At this time, delivery rider 1 can answer the call by tapping the smart helmet (using the smart helmet as an example of a wearable device) or clicking a button on the smart helmet. Of course, delivery rider 1 can also answer the call by voice, such as by saying keywords like "answer the phone" to the wearable device.

[0049] For example, when delivery rider 1 rides to the address specified by the ordering user and delivers order A to the user, the delivery application requires rider 1 to click "delivered" for order A. However, because rider 1 is in a hurry to deliver the next order (order B), they forget to click "delivered" for order A. At this time, rider 1 is still riding to pick up the goods for the next order. When the delivery application detects that rider 1's location information has approached the address specified by the ordering user and then started to move away from the address, it will send a reminder message or inquiry message to the wearable device requesting the rider to click "delivered". The wearable device will then play the reminder message or inquiry message aloud. The inquiry message might be something like: "We have detected that you have arrived at the delivery address of order A. Please confirm whether you have delivered it." The rider can nod to confirm delivery or shake their head to deny delivery, and the wearable device will recognize the nodding or shaking head actions.

[0050] For example, when a delivery rider is riding, if the system assigns an order, the rider needs to use their mobile phone to accept or reject the order in the delivery app. However, because the rider is riding or walking (and may be carrying multiple orders), it's inconvenient to operate on their phone. Using a smart helmet allows riders to accept or reject orders directly from their mobile phone while riding or walking. The smart helmet can broadcast a voice prompt to the rider asking whether they want to accept or reject the order. This prompt can include information such as the required pickup and delivery time, pickup address, and delivery address, allowing the rider to confirm their decision. After hearing the prompt, the rider can nod to accept or shake their head to reject. Other actions can also be used, and the specific actions used can be pre-configured in the delivery or configuration app.

[0051] After a delivery rider accepts or rejects an order using their smart helmet, the helmet recognizes the rider's action and sends the corresponding instruction to the delivery app on their mobile phone. This process prevents riders from being distracted by operating their phones while riding or walking, ensuring rider safety.

[0052] In this application, the wearable device not only has basic functions such as broadcasting voice messages and receiving voice input from delivery riders, but also enables various functional interactions with the terminal (i.e., the mobile phone) or the terminal application. This allows delivery riders to perform corresponding actions on the worn wearable device, enabling them to enter or exit multiple modes on the mobile phone or perform multiple functional operations within a certain mode, thus elevating the wearable device's functionality to a smart dimension. It should be noted that in this application, only actions performed by the user (such as the delivery rider) while wearing the wearable device are recognized for subsequent entry or exit from multiple modes on the mobile phone or performance of multiple functional operations within a certain mode. This avoids accidental operations on the mobile phone due to user error when not wearing the wearable device.

[0053] The reason why wearable devices can interact with mobile phone applications by having delivery riders tap the smart helmet, click buttons on the helmet, or respond via voice is mainly related to the hardware and software components of the wearable device. Specifically, please refer to Figure 1, which is a schematic diagram of the information interaction processing system of this application, and corresponds to the system framework diagram of the wearable device.

[0054] As shown in Figure 1, a wearable device includes: a Bluetooth module and processor (processor, such as MCU, Microcontroller Unit), a low-power Bluetooth module and low-power processor (low-power processor such as Sub-MCU), a positioning module (such as GPS, Global Positioning System), a mobile network communication module (such as 4G communication), a voice input module (such as MIC and audio DSP, MIC is Microphone Interface Connector; DSP is Digital Signal Processing), a speaker module, a button module, a barometer, a wireless network communication module, an infrared sensor, a battery module, a light module, and motion sensors (such as accelerometer and gyroscope). The positioning module and mobile network communication module may not be included in the wearable device.

[0055] As shown in Figure 1, the positioning module, mobile network communication module, speaker module, and voice input module are connected to the Bluetooth module. However, these modules are not always operational. In contrast, the button module, barometer, wireless network communication module, infrared sensor, light module, and motion sensor are all connected to the Bluetooth Low Energy module. These modules are always operational. The use of Bluetooth Low Energy modules for these constantly operational components saves power for the wearable device. Modules that are not always operational can be connected to regular Bluetooth modules.

[0056] The battery module can connect to both the Bluetooth module and the Bluetooth Low Energy module. The battery module enables efficient battery management, supports long battery life, and has fast charging capabilities. At the same time, it has a low battery warning function to ensure that the wearable device will not lose power at critical moments.

[0057] The lighting module includes lighting components mounted on the front and rear of the wearable device. On one hand, it provides delivery riders with better visibility during nighttime or low-light riding; on the other hand, it can activate safety warning lights at night, automatically illuminating and flashing to alert surrounding vehicles and pedestrians in dark environments. The wearable device incorporates a light sensor to automatically adjust the brightness of the lights, and also to automatically turn the lighting components on and off.

[0058] Both Bluetooth and Bluetooth Low Energy modules can connect to mobile phones to enable communication functions between wearable devices and mobile phones (such as making calls and playing music); of course, wireless network communication modules can also connect to mobile phones, and wireless network communication modules can also communicate directly with the server.

[0059] Wearable devices can also enable voice communication with mobile phones (such as voice playback and voice calls) via microphones and speakers. Specifically, wearable devices achieve clear voice communication through microphones and speakers. Multiple microphone arrays (located in front of the head and at the left and right ears when the delivery rider wears the device) are used to detect environmental noise. Signal processing algorithms are then used to analyze and filter the noise for environmental noise reduction, thereby enabling delivery riders to make high-quality calls while riding.

[0060] The positioning module can locate delivery riders in real time to obtain their location information. Of course, to save power of the wearable device, a mobile phone can also be used to locate the delivery rider. The reason for using the positioning module of the wearable device is mainly to compensate for the shortcomings of mobile phone positioning.

[0061] In addition, wearable devices also include software such as Advanced Safety Monitoring (ASM), which can determine the delivery rider's delivery speed, driving trajectory and posture based on various sensors (such as infrared sensors, motion sensors, positioning modules and barometers).

[0062] In addition, wearable devices are equipped with voice assistant software to enable voice interaction. For example, as mentioned above, delivery rider 1 can also answer the call by voice. In this case, the voice assistant software analyzes the voice information input by delivery rider 1.

[0063] To facilitate understanding of the information interaction processing system of this application, Figure 2 is shown as a structural schematic diagram of the information interaction processing system provided by this application. The information interaction processing system of this application includes: a wearable device 201 and a terminal application 202.

[0064] Wearable device 201 is used to respond to the detection of an operation action by the wearer, determine the operation action to be detected, determine the operation instruction to be executed based on the operation correspondence between the operation action to be detected and the operation instruction, and provide the operation instruction to be executed to the terminal application; terminal application 202 is used to obtain the operation instruction to be executed and respond based on the operation instruction to be executed; wherein, the terminal application includes at least a delivery application.

[0065] A delivery app is an application installed on the delivery rider's device (such as a mobile phone) for delivering orders. Riders use the app to accept orders, deliver them, and navigate to destinations. Delivery apps can also be configured for wearable devices. Both the app and the wearable device are used by the rider during the delivery process and maintain a constant connection via short-range communication (NRCM). NRCM methods include Bluetooth, Near Field Communication (NFC), Radio Frequency Identification (RFID), Infrared Communication (IR), and Wi-Fi.

[0066] Wearable devices 201 include, for example, smart helmets and smart headphones. Of course, wearable devices 201 can also be other smart devices that are convenient for delivery riders to wear, besides smart helmets and smart headphones, as long as they have some of the necessary modules listed in Figure 1, such as a Bluetooth module, processor, voice input module, speaker module, barometer, wireless network communication module, infrared sensor, battery module, light module, motion sensor, and button module. In this embodiment, the difference between a smart helmet and smart headphones is that the delivery rider can click (or double-click or triple-click) the smart helmet itself, or click (or double-click or triple-click or long-press) the buttons on the smart helmet; while the smart headphones can only be clicked (or double-clicked or triple-clicked or long-pressed) the buttons on the smart headphones.

[0067] In this application, the operation correspondence is the operation correspondence between the operation actions performed by the wearer when wearing the wearable device, configured in the configuration application or the terminal application, and the operation instructions executed for the terminal application; the operation actions include at least one of the following: a first operation action for entering or exiting a candidate mode of the terminal application, and a second operation action for performing a target function operation in the candidate mode; the wearable device and the terminal application are connected via short-range communication; the candidate modes for entering or exiting the terminal application include entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting a task process within the terminal application.

[0068] When the terminal application is a delivery application, the configuration application can be a standalone application on the terminal device or embedded within the delivery application. If the configuration application is set up separately on the terminal device, the above-mentioned operation mapping relationships are configured directly in the configuration application. If the configuration application is embedded in the delivery application, the above-mentioned operation mapping relationships are configured within the delivery application.

[0069] In this application, the first operation action and the second operation action can actually be the same type of operation action or different types of operation actions; for example, the first operation action can include hand action, voice trigger action, and head action, and the second operation action can also include hand action, voice trigger action, and head action; generally speaking, when performing the first operation action, hand action and voice trigger action can usually be used; when performing the second operation action, head action can usually be used.

[0070] Hand gestures include single-click, double-click, triple-click, etc., performed by the delivery rider on the smart helmet itself; single-click, double-click, triple-click, long-press, etc., performed on the smart helmet buttons; voice-triggered gestures include the delivery rider speaking the wake-up keyword through the smart helmet's voice input module (such as the microphone); head gestures include the delivery rider's head movements while wearing the smart helmet, such as nodding, shaking, raising, lowering, turning the head to the left, turning the head to the right, etc.

[0071] In this application, the candidate modes for entering or exiting include entering or exiting a terminal application, entering or exiting a sub-application within a terminal application, or entering or exiting a task process within a terminal application. In fact, the candidate mode can be the terminal application itself, a sub-application within a terminal application, or a task process within a terminal application. That is, by triggering the first operation action, one can enter or exit an application, enter or exit a sub-program of an application, or enter or exit a task process at a certain stage of an application.

[0072] The candidate mode can be the terminal application itself, or the terminal application can be a system application, such as adjusting the phone volume or making a voice call; if someone calls the delivery rider while riding, the delivery rider can answer the call by clicking on the helmet to enter the phone communication mode; while the delivery rider is answering the call, he can increase the volume by tilting his head up.

[0073] Alternatively, regarding telephone communication within the system application, when a delivery rider is approaching the address of the user who placed the order, and the order in the delivery application is in a "delivery imminent" state, the delivery application will send an inquiry message to the user who placed the order via the smart helmet. The smart helmet will play the inquiry message aloud, and after hearing the inquiry message through the smart helmet, the delivery rider can click a button on the smart helmet to call the user who placed the order.

[0074] It should be noted that in this application, the first or second operation is only valid if the delivery rider is wearing the wearable device.

[0075] Candidate modes can also be message interaction applications, such as delivery riders sending messages or making phone calls to users who have placed orders. For example, a user can make a phone call to a user by clicking on the smart helmet, and a user can send a message to a user by double-clicking on the smart helmet. (For example, when a user urges an order, the delivery rider can send a message to the delivery rider in the delivery application to urge the order. After receiving the urge message from the user, the delivery rider can send a reply message to the user by double-clicking on the smart helmet.)

[0076] For example, if a delivery rider's electric bike malfunctions or the rider falls, they can quickly triple-tap the smart helmet or press and hold the button on the helmet to enter SOS mode. This will allow their phone to send a text message or make a phone call to emergency contacts for help.

[0077] The candidate mode can also be a task process. Upon entering a task process, the delivery rider performs a second action to execute the target function. For example, in a scenario where the delivery rider needs to store an order in a smart locker, during the order storage phase, the rider needs to confirm whether to store the order. The delivery rider can confirm or deny storage via message interaction using their smart helmet, such as nodding for confirmation (nodding is an example of performing the second action; the confirmation of storage during the order storage phase in the delivery application is an example of executing the target function), shaking their head for denial; a single tap on the helmet for confirmation, a quick double tap for denial; head up for the previous order, head down for the next order; turning the head left for the previous order, turning it right for the next order.

[0078] For example, after assigning a smart locker compartment information to an order, during the stage of playing the assigned compartment information via voice playback on the smart helmet: turning the head to the left decreases the volume, turning the head to the right increases the volume; turning the head up decreases the volume, turning the head down increases the volume; clicking the helmet button or clicking the helmet plays the locker compartment information assigned to the current order; double-clicking the helmet or the button, or turning the head to the left or up, plays the locker compartment information assigned to the previous order. After storing the order in the locker, clicking the helmet button or clicking the helmet calls the user who placed the order to inform them of the locker storage details; double-clicking the helmet button or double-clicking the helmet sends a message to the user who placed the order to inform them of the locker storage details. The above can actually be an example of how, after entering a certain task process, the delivery rider performs a second operation to ultimately execute the target function operation on the delivery application.

[0079] The reason delivery riders respond via a second action in the terminal application at different stages (i.e., different task processes) is due to pre-configuration in the delivery application or configuration application. For example, during the locker confirmation stage, the configuration might be: a nodding head indicates confirmation of locker storage, while a head shaking indicates denial. Alternatively, voice triggering can be used for confirmation or denial. When playing the assigned locker information, the configuration might be: clicking the wearable device or a button on it to play the locker information for the current order; double-clicking the wearable device or a button, or turning the head left or up to play the locker information for the previous order; or voice triggering, such as "Please play the locker information assigned to the current order." After the order is locked, the configuration might be: clicking the wearable device or a button to call the ordering user to inform them of locker details; double-clicking the wearable device or a button to send a message to the ordering user to inform them of locker details; or voice triggering for a call or message.

[0080] A communication protocol is established between the wearable device and the terminal. When the delivery rider performs the first or second operation, the processor in the wearable device first determines which operation the delivery rider performed. Based on the identified operation to be detected and the operation correspondence pre-configured in the configuration application or terminal application, the processor determines the operation instruction to be executed corresponding to the operation to be detected. Then, the wearable device provides the operation instruction to be executed to the terminal (such as a mobile phone). The terminal identifies the operation instruction to be executed based on the communication protocol between the wearable device and the terminal, so that the terminal application can respond.

[0081] For example, if clicking the smart helmet body indicates making a phone call, when a delivery rider clicks the smart helmet body, the smart helmet will recognize the click action and, based on the operation correspondence, confirm that the click action corresponds to the instruction to make a phone call. Of course, in wearable devices, a corresponding code is used to represent the instruction to make a phone call, for example, the instruction XXXX1 is used to represent the instruction to make a phone call. Through the communication protocol between the wearable device and the terminal, the terminal (such as a mobile phone) can determine that the XXXX1 instruction sent by the wearable device is the instruction to make a phone call, and then open the phone call page on the terminal and dial the number of the ordering user.

[0082] The candidate modes mentioned above can be various terminal applications, subroutines, and task processes. The action to enter the candidate mode can be configured (in the configuration application or terminal application) as: single click, double click, triple click, or long press for N seconds (N is configurable); it can also be configured as: single tap (single click) on the helmet body, quick double tap (double click) on the helmet body, or quick triple tap (triple click) on the helmet body. Whether it is a single tap, double tap, or triple tap on the helmet body can be identified by the accelerometer on the helmet. In addition, delivery riders can also trigger actions by voice. For example, a delivery rider can say "enter application M" into the smart helmet through the microphone, and the DSP chip inside the smart helmet can recognize the keyword "enter application M" spoken by the delivery rider.

[0083] If the delivery rider performs a second action, such as turning the head to the left, turning the head to the right, nodding, shaking the head, raising the head (head up), or lowering the head (head down), it can be identified by the action sensors (accelerometer and gyroscope) in the wearable device.

[0084] In this embodiment, different operation actions can be configured for entering (or exiting) different candidate modes, such as clicking the smart helmet body to enter application M, and double-clicking the smart helmet body to enter application N.

[0085] To facilitate understanding of how delivery riders operate wearable devices to interact with mobile phones during their rides, Figure 3 is used for illustration. Figure 3 is a flowchart illustrating an example of the interaction between the wearable device and the terminal application in this application.

[0086] First, wearable device 201 executes step S301: using an infrared sensor to detect whether the delivery rider is wearing the wearable device; if so, it continues to step S302: detecting whether the delivery rider has performed a first operation to enter a candidate mode; if so, it executes step S303: determining the target candidate mode corresponding to the first operation and providing the instruction to enter the target candidate mode to the terminal application; terminal application 202 executes step S304: responding to the instruction to enter the target candidate mode, it opens the target candidate mode. Simultaneously, a prompt sound indicating entry into the target candidate mode is played through the wearable device. The playback of the prompt sound can be pre-configured in the configuration application or the terminal application: once the delivery rider is detected to have performed the first operation to enter a certain candidate mode, the entry prompt sound is played directly; the prompt sound can be a type of music.

[0087] Next, the wearable device 201 executes step S305: obtaining the first state value corresponding to the operation motion sensor in the wearable device; for example, when the operation motion sensor is an accelerometer and a gyroscope, the first state value corresponding to the accelerometer and the first state value corresponding to the gyroscope can be obtained; the accelerometer has a corresponding state value in three dimensions (which can be the X-axis, Y-axis, and Z-axis), including pitch value, yaw value, and left and right yaw value; similarly, the gyroscope also has a corresponding state value in three dimensions, also including pitch value, yaw value, and left and right yaw value; the pitch value, yaw value, and left and right yaw value of the accelerometer and the pitch value, yaw value, and left and right yaw value of the gyroscope are used as the first state value. At this time, the delivery rider has not yet performed the second operation motion. Next, the wearable device executes step S306: detecting whether the delivery rider performs a second operation action for performing the target function operation in the target candidate mode; if so, it executes step S307: obtaining the second state value corresponding to the operation action sensor in the wearable device after performing the second operation action; the second state value is the pitch, yaw, and lateral yaw values ​​of the accelerometer and the pitch, yaw, and lateral yaw values ​​of the gyroscope after the delivery rider performs the second operation action. After obtaining the second state value, it executes step S308: obtaining the operation action amount corresponding to the second operation action based on the first and second state values. The operation action amount is actually measured based on the change in the parameters of the operation action sensor itself. Next, it executes step S309: determining whether the operation action amount exceeds a preset action amount threshold; if so, it executes step S310: determining the execution adjustment amount for performing the target function operation based on the operation action amount. For example, when adjusting the volume, if the second operation action is turning the head to the left, the volume adjustment is actually determined based on the amount of head rotation to the left. Adjusting the volume is an example of the adjustment amount to be performed. Of course, if there are multiple second operations during this process, each second operation needs to be performed individually, requiring the corresponding operation amount to determine the adjustment amount for each operation. Adjacent second operations can be the same or different, and the time interval between adjacent second operations cannot exceed a first preset time interval.

[0088] In step S309 above, assuming the second action performed by the delivery rider is to turn the head to the left or to the right, the corresponding preset action amount threshold is a rotation angle of 35 degrees. The reason for using a rotation angle of 35 degrees as the preset action amount threshold is that the range of rotation when a person turns their head to the left or right is limited (e.g., the maximum rotation angle to the left or right generally does not exceed 70 degrees).

[0089] In step S310 above, the execution adjustment amount for performing the target function operation is determined based on the correspondence between the operation motion amount and the function adjustment amount. The correspondence between the operation motion amount and the function adjustment amount can be a linear mapping relationship or a logarithmic relationship. Specifically, considering the limited range of head movements and the gradual slowing down of head movements in the up, down, left, and right directions, using a logarithmic relationship is more realistic. Assuming that x represents the operation motion amount and y is used as the function adjustment amount, y increases monotonically as x increases; x actually represents the amplitude or rotation angle of the head movement, and y represents the adjustment amount corresponding to the specific function; in the region near the x-axis (i.e., when x is small), y changes faster; as x increases, y changes gradually more slowly.

[0090] In step S308, the execution adjustment amount for the target function operation can be determined based on the rotation angle, rotation angular velocity, acceleration, and change in rotational acceleration corresponding to the second operation action. The rotation angle and rotation angular velocity are the changing parameters corresponding to the gyroscope, while the acceleration and change in rotational acceleration are the changing parameters corresponding to the acceleration sensor. These are dynamically changing parameters, and the corresponding function's prompt sound can be played synchronously based on them. A larger rotation angle results in a louder prompt volume; alternatively, the prompt volume can be determined based on the rotational acceleration. The rotation angle, rotation angular velocity, acceleration, and change in rotational acceleration can be obtained based on the aforementioned first state value, second state value, and the duration of the second operation action.

[0091] When obtaining the execution adjustment amount, it is considered that the head will return to the original initial position after turning. For example, when the delivery rider turns to the left to reduce the phone volume, the head will return to the initial forward position after turning to the left to the maximum extent. Therefore, it is necessary to remove this shaking when the head returns to the initial position (that is, take the maximum amplitude corresponding to the action from the initial position as the operation action amount), and obtain the execution adjustment amount based on the maximum amplitude value of the second operation action.

[0092] When a delivery rider performs certain second actions, it may not be possible to complete them in one go and the action may need to be repeated multiple times. For example, turning the head to the left once may not be enough to reduce the volume, so the head may need to be turned to the left again or multiple times. In this embodiment, if the action needs to be repeated, two adjacent actions need to be completed within a first preset time interval.

[0093] In this embodiment, different operation actions can be set in the configuration application or terminal application (such as a delivery application) to achieve more complex target function operations. For example, turning the head to the left indicates adjusting to the previous order, and nodding indicates making a phone call to the user who placed the order. Furthermore, by performing a series of actions, turning the head to the left and nodding, a phone call to the user who placed the previous order can be made on the mobile phone.

[0094] In fact, the execution adjustment amount is used to generate the pending operation instruction for performing the target function operation, so as to provide the pending operation instruction containing the execution adjustment amount to the terminal application for response. For example, after assigning grid information to the order and playing voice, if the delivery rider turns his head to the left, the pending operation instruction contains the volume value to turn down the volume, so that the system application that adjusts the phone volume can turn down the volume.

[0095] Next, the terminal application 202 executes step S311: responding to the pending operation instruction containing the execution adjustment amount provided by the wearable device, and executing the target function operation. Then, the wearable device 201 executes step S312: detecting whether the delivery rider has performed the first operation action to exit the target candidate mode; if so, the process ends. The first operation action to enter the target candidate mode and the first operation action to exit the target candidate mode can be the same or different. For example, clicking the smart helmet body can enter the target candidate mode, and double-clicking the smart helmet body can exit the target candidate mode.

[0096] Of course, if in step S309 it is determined that the amount of the operation action does not exceed the preset action amount threshold, or in step S306 it is detected that the delivery rider has not performed the second operation action within the preset second time interval, then the target candidate mode is also exited and the process ends. The aforementioned second time interval is greater than the first time interval, such as the second time interval being 3 seconds and the first time interval being 1 second.

[0097] Figures 1 to 3 described above illustrate one application scenario of the information interaction processing system of this application. The embodiments of this application do not specifically limit the application scenario of the information interaction processing system. The above-described application scenario is merely one embodiment of the application scenario of the information interaction processing system provided in this application. The purpose of providing this application scenario embodiment is to facilitate understanding of the information interaction processing system provided in this application, and not to limit the information interaction processing system provided in this application. Other application scenarios of the information interaction processing system in the embodiments of this application will not be described in detail.

[0098] First Embodiment

[0099] This embodiment provides an information interaction processing system. Please refer to Figure 2 for details, which is a schematic diagram of the information interaction processing system provided in this application embodiment. For some specific examples or details of this embodiment, please refer to the above scenario embodiment.

[0100] The information interaction processing system of this embodiment includes: a wearable device 201 and a terminal application 202;

[0101] Wearable device 201 is used to respond to the detection of an operation action by the wearer, determine the operation action to be detected, determine the operation instruction to be executed based on the operation correspondence between the operation action to be detected and the operation, and provide the operation instruction to be executed to the terminal application.

[0102] Terminal application 202 is used to obtain an operation instruction to be executed and to respond based on the operation instruction. In this embodiment, the terminal application includes at least a delivery application.

[0103] In this embodiment, the operation correspondence is the operation correspondence between the operation actions performed by the wearer when wearing the wearable device, configured in the configuration application or the terminal application, and the operation instructions executed for the terminal application; the operation actions include at least one of the following: a first operation action for entering or exiting a candidate mode of the terminal application, and a second operation action for performing a target function operation in the candidate mode; the wearable device and the terminal application are connected via short-range communication; the candidate modes for entering or exiting the terminal application include entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting a task process within the terminal application.

[0104] In this embodiment, the wearable device is equipped with a processor. If the operation to be detected is a second operation for performing a target function operation in the candidate mode, the processor is used to obtain the quantity of the operation to be detected corresponding to the operation to be detected; determine whether the quantity of the operation to be detected meets the preset operation quantity requirement; if the quantity of the operation to be detected meets the preset operation quantity requirement, then the operation to be detected is regarded as a valid operation; as a way to determine the operation instruction to be executed based on the correspondence between the operation to be detected and the operation: take the operation action confirmed as a valid operation among the operation actions to be detected as the target operation action to be detected, and determine the operation instruction to be executed based on the correspondence between the target operation action to be detected and the operation.

[0105] In this embodiment, the wearable device is equipped with an operation motion sensor; the operation motion sensor can refer to an IMU sensor, such as an accelerometer or gyroscope; IMU stands for Inertial Measurement Unit. One method for obtaining the quantity of the operation motion to be detected is as follows: obtain a first state value corresponding to the operation motion sensor before the wearer performs the operation motion; obtain a second state value corresponding to the operation motion sensor after the wearer performs the operation motion; and obtain the quantity of the operation motion to be detected based on the first and second state values.

[0106] In this embodiment, if the operation to be detected is a second operation for performing a target function operation in the candidate mode, and the operation instruction to be executed contains an execution adjustment amount for performing the target function operation; the processor is specifically used to obtain the execution adjustment amount for performing the target function operation based on the operation to be detected amount, the correspondence between the operation amount and the function adjustment amount; and to provide the execution adjustment amount to the terminal application; the terminal application is specifically used to respond based on the execution adjustment amount.

[0107] In this embodiment, if the operation to be detected is a first operation for entering a candidate mode of a terminal application, the wearable device is further configured to play a voice prompt message indicating entry into the candidate mode in response to detecting the first operation. For example, when entering a terminal application, a prompt sound corresponding to entering that terminal application is played.

[0108] In this embodiment, since the wearable device is equipped with a processor, if the operation to be detected is a first operation for entering a candidate mode of the terminal application, the processor is further configured to determine whether the wearer performs a second operation within a preset time period after performing the first operation; if the wearer does not perform the second operation within the preset time period, an exit command to exit the candidate mode is sent to the terminal application; the terminal application is configured to receive the exit command and exit the candidate mode in response to the exit command. See the relevant description in Figure 3 for details.

[0109] In this embodiment, the wearable device interfaces with the application programming interface (API) of the terminal application. Specifically, the wearable device calls the API of the terminal application to provide the operation instructions to be executed to the terminal application through the called API. For example, the smart helmet adapts its interface to various terminal applications (including system applications). At the same time, when the terminal application is a delivery application, the smart helmet also adapts its interface to various scenarios of the delivery application. This allows the smart helmet to broadcast information that needs to be confirmed or interacted with by the delivery rider via voice, and then the delivery rider performs the first or second operation. This enables the rider to access the terminal application or various task processes of the terminal application through the smart helmet on the mobile phone, and also to perform the target function operation.

[0110] In this embodiment, if the operation to be detected is a first operation for entering a candidate mode of the terminal application, the operation correspondence includes the mode correspondence between the operation and each candidate mode. Specifically, determining the operation instruction to be executed based on the operation to be detected and the operation correspondence can mean: determining the target candidate mode pointed to by the operation to be detected among each candidate mode based on the mode correspondence between the operation to be detected and the candidate mode; and determining the instruction to enter the target candidate mode as the operation instruction to be executed. In this application, different first operations correspond to entering different candidate modes; therefore, the target candidate mode to be entered can be determined based on the first operation specifically performed by the delivery rider.

[0111] The above describes the scenario where delivery riders can actively enter a candidate mode or actively perform a function operation within a candidate mode using wearable devices. In practice, however, a query request message can be played on the wearable device to passively induce the delivery rider to enter a candidate mode or passively perform a function operation within a candidate mode. Specifically, in this embodiment, if the operation to be detected is a first operation for entering a candidate mode of the terminal application, the terminal application is further configured to, in response to detecting a need to enter a candidate mode (e.g., needing to call the ordering user), send a query request message to the wearable device requesting a response regarding whether to enter the candidate mode. The wearable device is further configured to receive the query request message and play it aloud (e.g., playing a message on the smart helmet asking whether to call the ordering user of the current order), so that the delivery rider can listen to the voice-played query request message and then perform the first operation. Alternatively, before performing the second operation, the terminal application can send a query request message to the wearable device requesting a response regarding whether to perform the target function operation; the wearable device can also receive the query request message and play it aloud, so that the delivery rider can listen to the voice-played query request message and then perform the second operation.

[0112] In this embodiment, the wearable device is equipped with a positioning module. The positioning module is used to locate the wearer in real time, obtaining the wearer's real-time location information. This real-time location information is then provided to the terminal application. The terminal application uses the real-time location information to plan the delivery route for the order to be delivered, or to update the order delivery status based on the real-time location information. The order delivery status is categorized as "arrived," "pickup," "delivery," and "delivered." "Arrived" corresponds to arriving at the merchant for pickup; "pickup" corresponds to the pickup node; "delivery" corresponds to the status between pickup and the order user's delivery address; and "delivered" corresponds to the order being delivered. These nodes can be determined using the delivery rider's real-time location. Therefore, by locating the delivery rider using the positioning module on the wearable device, the order delivery status can be updated within the delivery application.

[0113] In this embodiment, the wearable device is equipped with a wearing status detection sensor. Since the first or second operation action performed by the delivery rider while wearing the wearable device is valid, the wearing status detection sensor needs to first detect whether the user is wearing the wearable device. If the user is wearing the wearable device, then the subsequent steps of responding to the detection of the user's operation action and determining the operation action to be detected are executed to ensure that the operation action to be detected is valid. The wearing status detection sensor is, for example, an infrared sensor.

[0114] This application provides an information interaction processing system, including a wearable device and a terminal application. In this system, a mapping relationship between an operation performed by a wearable user while wearing the wearable device and an operation instruction to be executed on the terminal application is pre-configured in a configuration application or in the terminal application. This allows the wearable device to detect and determine the operation to be detected when the wearable user performs an operation. Then, based on the operation to be detected and the mapping relationship, an operation instruction to be executed is determined. This operation instruction is then provided to the terminal application. The terminal application responds upon receiving the operation instruction. In this information interaction system, since the operation includes at least one of a first operation for entering or exiting a candidate mode of the terminal application and a second operation for performing a target function operation while entering the candidate mode, entering or exiting the terminal application... The candidate modes for the terminal application include entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting a task process within the terminal application. This allows wearable users to open or close the terminal application itself, open a sub-application within the terminal application, or open some task processes within the terminal application by performing a corresponding first operation on the wearable device. Of course, after opening the terminal application itself, a sub-application within the terminal application, or some task processes within the terminal application, wearable users can also perform a second operation on the wearable device to perform a target function operation within the opened terminal application, or within the opened sub-application, or within the opened task process. In short, wearable users can achieve multiple modes or functions in the terminal application simply by operating the wearable device, greatly facilitating the interaction between wearable users and their mobile phones through the wearable device.

[0115] Furthermore, since wearable devices can enter or exit candidate modes of the terminal or perform multiple functional operations in candidate modes, the candidate modes are diverse. This allows delivery riders to directly access multiple terminal applications or task processes of multiple terminal applications using wearable devices. Combining multiple head movements or combinations of multiple head movements can enable the execution of multiple functional operations within the terminal application or task process, avoiding the need for delivery riders to operate their phones while riding or walking while carrying multiple orders, thus greatly improving the delivery rider experience.

[0116] Second Embodiment

[0117] Corresponding to the first embodiment, the second embodiment of this application provides an information interaction processing method. The executing entity of this embodiment is a wearable device. The parts in the second embodiment that are the same as those in the first embodiment will not be described again; please refer to the relevant parts of the first embodiment and the scenario embodiment for details.

[0118] Please refer to Figure 4, which is a flowchart of the information interaction processing method provided in the second embodiment of this application.

[0119] The information interaction processing method of this application includes the following steps.

[0120] Step S401: In response to detecting the user's action, determine the action to be detected.

[0121] The operation action includes at least one of the following: a first operation action for entering or exiting a candidate mode of the terminal application, and a second operation action for performing a target function operation in the candidate mode; the candidate mode for entering or exiting the terminal application includes entering or exiting the terminal application, entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

[0122] Step S402: Determine the operation instruction to be executed based on the correspondence between the operation to be detected and the operation.

[0123] The operation mapping relationship is the mapping relationship between the operation actions performed by the wearer when wearing the wearable device and the operation instructions executed for the terminal application, which is configured in the configuration application or the terminal application; the wearable device and the terminal application are connected by short-range communication.

[0124] Step S403: Provide the operation instruction to be executed to the terminal application so that the terminal can respond based on the operation instruction to be executed.

[0125] In this embodiment, if the operation to be detected is a second operation for performing a target function operation in the candidate mode, before performing the step of determining the operation instruction to be executed based on the operation to be detected and the operation correspondence, the method further includes: obtaining the quantity of the operation to be detected corresponding to the operation to be detected; determining whether the quantity of the operation to be detected meets the preset operation quantity requirement; if the quantity of the operation to be detected meets the preset operation quantity requirement, then performing the step of determining the operation instruction to be executed based on the operation to be detected and the operation correspondence.

[0126] In this embodiment, the wearable device is equipped with an operation motion sensor; obtaining the quantity of the operation motion to be detected includes: obtaining a first state value corresponding to the operation motion sensor before the wearer performs the operation motion to be detected; obtaining a second state value corresponding to the operation motion sensor after the wearer performs the operation motion to be detected; and obtaining the quantity of the operation motion to be detected based on the first state value and the second state value.

[0127] In this embodiment, the operation instruction to be executed includes an execution adjustment amount for performing the target function operation; the method further includes: obtaining the execution adjustment amount for performing the target function operation based on the operation action amount to be detected, the correspondence between the operation action amount and the function adjustment amount; and providing the execution adjustment amount to the terminal application so that the terminal application can respond based on the execution adjustment amount.

[0128] In this embodiment, if the operation to be detected is a first operation for entering a candidate mode of a terminal application, the method further includes: in response to detecting the first operation, playing a voice prompt message for entering the candidate mode.

[0129] In this embodiment, if the operation to be detected is a first operation for entering a candidate mode of a terminal application, the method further includes: determining whether the wearable user performs a second operation within a preset time period after performing the first operation; if the wearable user does not perform the second operation within the preset time period, sending an exit command to the terminal application to exit the candidate mode, so that the terminal application exits the candidate mode in response to the exit command.

[0130] In this embodiment, the wearable device interfaces with the application programming interface (API) of the terminal application; providing the operation instructions to be executed to the terminal application includes: calling the application programming interface of the terminal application and providing the operation instructions to be executed to the terminal application through the called application programming interface.

[0131] In this embodiment, if the operation to be detected is the first operation for entering a candidate mode of the terminal application, the operation correspondence includes the mode correspondence between the operation and each candidate mode; as a way to determine the operation instruction to be executed based on the operation to be detected and the operation correspondence: first, based on the operation to be detected and the mode correspondence, determine the target candidate mode pointed to by the operation to be detected in each candidate mode; then, determine the instruction to enter the target candidate mode as the operation instruction to be executed.

[0132] In this embodiment, if the operation to be detected is a first operation for entering a candidate mode of a terminal application, before performing the first operation, the method further includes: obtaining an inquiry request message sent by the terminal application for requesting a reply on whether to enter the candidate mode; and playing the inquiry request message aloud.

[0133] In this embodiment, the wearable device is equipped with a positioning module; the method further includes: using the positioning module to perform real-time positioning of the wearer to obtain the wearer's real-time positioning information; providing the real-time positioning information to the terminal application so that the terminal application can perform route planning for the order to be delivered based on the real-time positioning information to obtain the delivery route of the order to be delivered; or, updating the order delivery status of the order to be delivered based on the real-time positioning information.

[0134] In this embodiment, the wearable device is equipped with a wearing status detection sensor; the method further includes: using the wearing status detection sensor to detect whether the wearer is in the state of wearing the wearable device; if the wearer is in the state of wearing the wearable device, then performing the step of determining the operation to be detected in response to detecting the wearer's operation.

[0135] Third Embodiment

[0136] Corresponding to the first embodiment, the third embodiment of this application provides a second information interaction processing method. The execution subject of this embodiment is a terminal application. The parts in the third embodiment that are the same as those in the first embodiment will not be described again; please refer to the relevant parts of the first embodiment and the scenario embodiment for details.

[0137] Please refer to Figure 5, which is a flowchart of the information interaction processing method provided in the third embodiment of this application.

[0138] The information interaction processing method of this application includes the following steps.

[0139] Step S501: Obtain the operation instruction to be executed sent by the wearable device.

[0140] Step S502: Respond based on the operation instruction to be executed.

[0141] In this embodiment, the operation instruction to be executed is determined by the wearable device based on the detection operation action performed by the wearer on the wearable device and the operation correspondence; the operation correspondence is the operation correspondence between the operation action performed by the wearer when wearing the wearable device and the operation instruction to be executed on the terminal application, which is configured in the configuration application or the terminal application; the operation action includes at least one of the following: a first operation action for entering or exiting a candidate mode of the terminal application, and a second operation action for performing a target function operation in the candidate mode; the wearable device and the terminal application are connected by a short-range communication method; the candidate mode for entering or exiting the terminal application includes entering or exiting the terminal application, entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application.

[0142] In this embodiment, the operation instruction to be executed includes an execution adjustment amount for performing the target function operation; the method further includes: obtaining the execution adjustment amount sent by the wearable device for performing the target function operation; the execution adjustment amount is obtained by the wearable device based on the detection operation action amount corresponding to the detection operation action, the correspondence between the operation action amount and the function adjustment amount; and responding based on the execution adjustment amount.

[0143] In this embodiment, the wearable device interfaces with the application programming interface (API) of the terminal application; as a way to obtain the operation instructions to be executed sent by the wearable device: obtain the operation instructions to be executed sent by the wearable device through the API.

[0144] In this embodiment, it further includes: in response to detecting a need to enter the candidate mode, sending an inquiry request message to the wearable device to request a response on whether to enter the candidate mode, so that the wearable device receives the inquiry request message and performs voice playback.

[0145] In this embodiment, the terminal application includes at least a delivery application; if the terminal application is a delivery application, the method further includes: obtaining real-time location information sent by the wearable device for real-time location of the wearer; performing route planning on the order to be delivered based on the real-time location information to obtain the delivery route of the order to be delivered; or, updating the order delivery status of the order to be delivered based on the real-time location information.

[0146] Fourth embodiment

[0147] Corresponding to the information interaction processing method provided in the second embodiment of this application, the fourth embodiment of this application also provides an information interaction processing device. Since the device embodiment is basically similar to the second embodiment, the description is relatively simple; relevant details can be found in the description of the second embodiment. The device embodiments described below are merely illustrative.

[0148] Please refer to Figure 6, which is a schematic diagram of the information interaction processing device provided in the fourth embodiment of this application.

[0149] The information interaction processing device 600 is applied to a wearable device. The device includes: a detection operation action determination unit 601, configured to determine a detection operation action in response to detecting an operation action of a wearer; the operation action includes at least one of a first operation action for entering or exiting a candidate mode of a terminal application and a second operation action for performing a target function operation in the candidate mode; the candidate mode for entering or exiting the terminal application includes entering or exiting the terminal application, entering or exiting a sub-application of the terminal application, or entering or exiting a task process of the terminal application; a pending operation instruction determination unit 602, configured to determine a pending operation instruction based on the detection operation action and operation correspondence; the operation correspondence is an operation correspondence configured in a configuration application or in a terminal application, indicating the operation action performed by the wearer when wearing the wearable device and the operation instruction indicating execution for the terminal application; the wearable device and the terminal application are connected via short-range communication; and a pending operation instruction providing unit 603, configured to provide the pending operation instruction to the terminal application so that the terminal responds based on the pending operation instruction.

[0150] Fifth embodiment

[0151] Corresponding to the information interaction processing method provided in the third embodiment of this application, the fifth embodiment of this application also provides an information interaction processing device. Since the device embodiment is basically similar to the third embodiment, the description is relatively simple; relevant details can be found in the description of the third embodiment. The device embodiments described below are merely illustrative.

[0152] Please refer to Figure 7, which is a schematic diagram of the information interaction processing device provided in the fifth embodiment of this application.

[0153] The information interaction processing device 700, applied to a terminal application, includes: a pending operation instruction acquisition unit 701, for acquiring a pending operation instruction sent by a wearable device; and a response unit 702, for responding based on the pending operation instruction. The pending operation instruction is determined by the wearable device based on a detected operation action performed by a wearer on the wearable device and an operation correspondence. The operation correspondence is an operation correspondence configured in a configuration application or a terminal application, representing the operation action performed by a wearer when wearing the wearable device and an operation instruction executed on the terminal application. The operation action includes at least one of a first operation action for entering or exiting a candidate mode of the terminal application and a second operation action for performing a target function operation in the candidate mode. The wearable device and the terminal application are connected via short-range communication. The candidate modes for entering or exiting the terminal application include entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting a task process of the terminal application.

[0154] Sixth Embodiment

[0155] Corresponding to the methods of the second to third embodiments of this application, the sixth embodiment of this application also provides an electronic device.

[0156] As shown in Figure 8, Figure 8 is a schematic diagram of the electronic device provided in the sixth embodiment of this application.

[0157] In this embodiment, an optional hardware structure of the electronic device 800 may be as shown in FIG8, including: at least one processor 801, at least one memory 802 and at least one communication bus 805; the memory 802 contains a program 803 and data 804.

[0158] Bus 805 can be a communication device for transmitting data between components within electronic device 800, such as an internal bus (e.g., CPU-memory bus, where the processor is the central processing unit, or CPU for short) or an external bus (e.g., a universal serial bus port or a peripheral component interconnection fast port).

[0159] Additionally, the electronic device also includes at least one network interface 806 and at least one peripheral interface 807. The network interface 806 provides wired or wireless communication with an external network 808 (e.g., the Internet, intranet, local area network, mobile communication network, etc.). In some embodiments, the network interface 806 may include any number of network interface controllers (NICs), radio frequency (RF) modules, repeaters, transceivers, modems, routers, gateways, any combination of wired network adapters, wireless network adapters, Bluetooth adapters, infrared adapters, near field communication (NFC) adapters, cellular network chips, etc.

[0160] Peripheral interface 807 is used to connect to peripherals, which can be peripheral 1 (809 in Figure 8), peripheral 2 (810 in Figure 8), and peripheral 3 (811 in Figure 8) as shown in the figure. Peripherals are peripheral devices, which can include, but are not limited to, cursor control devices (e.g., mouse, touchpad, or touchscreen), keyboards, displays (e.g., cathode ray tube displays, liquid crystal displays), displays or light-emitting diode displays, video input devices (e.g., cameras or input interfaces coupled to video files), etc.

[0161] The processor 801 may be a CPU, an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.

[0162] The memory 802 may include high-speed RAM (Random Access Memory) memory, and may also include non-volatile memory, such as at least one disk storage device.

[0163] In this embodiment, the processor 801 calls the program and data stored in the memory 802 to execute the methods of the second to third embodiments of this application.

[0164] Seventh Embodiment

[0165] Corresponding to the methods of the second to third embodiments of this application, the seventh embodiment of this application also provides a computer storage medium storing a computer program that is executed by a processor to perform the methods of the second to third embodiments of this application.

[0166] Although this application discloses preferred embodiments as described above, it is not intended to limit this application. Any person skilled in the art can make possible changes and modifications without departing from the spirit and scope of this application. Therefore, the scope of protection of this application should be determined by the scope defined in the claims of this application.

[0167] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. Memory may include non-persistent storage in computer-readable media, random access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0168] 1. Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can store information using any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transfer medium that can be used to store information accessible by a computing device. As defined in this article, computer-readable media do not include non-transitory computer-readable storage media, such as modulated data signals and carrier waves.

[0169] 2. Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0170] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

Claims

1. An information interaction processing system, characterized in that, include: Wearable devices and terminal applications; The wearable device is used to determine the operation to be detected in response to detecting the operation of the wearer; Based on the correspondence between the operation to be detected and the operation, the operation instruction to be executed is determined; The operation instruction to be executed is provided to the terminal application; the operation correspondence is the operation correspondence between the operation actions performed by the wearer when wearing the wearable device and the operation instructions executed for the terminal application, which is configured in the configuration application or the terminal application. The operation action includes at least one of the following: a first operation action for entering or exiting a candidate mode of the terminal application, and a second operation action for performing a target function operation while entering a candidate mode; the wearable device and the terminal application are connected via near-field communication. Candidate modes for entering or exiting the terminal application include entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting the task process of the terminal application. The terminal application is used to obtain the operation instruction to be executed and to respond based on the operation instruction to be executed.

2. The system according to claim 1, characterized in that, The wearable device is equipped with a processor. If the operation to be detected is a second operation for performing a target function operation in the candidate mode, the processor is used to obtain the amount of the operation to be detected corresponding to the operation to be detected; and to determine whether the amount of the operation to be detected meets the preset operation amount requirement conditions. If the amount of the operation to be detected meets the preset operation amount requirement, then the operation to be detected is considered a valid operation. The step of determining the operation instruction to be executed based on the operation to be detected and the operation correspondence includes: taking the operation action confirmed as a valid action among the operation actions to be detected as the target operation action to be detected, and determining the operation instruction to be executed based on the target operation action to be detected and the operation correspondence.

3. The system according to claim 2, characterized in that, The wearable device is equipped with an operation motion sensor; Obtaining the quantity of the operation to be detected corresponding to the operation to be detected includes: Obtain the first state value of the sensor corresponding to the operation action before the wearer performs the operation to be detected; Obtain the second state value of the sensor corresponding to the operation action after the wearer performs the operation to be detected; The amount of the operation to be detected is obtained based on the first state value and the second state value.

4. The system according to claim 3, characterized in that, The operation instruction to be executed includes an execution adjustment amount for performing the target function operation; The processor is specifically configured to obtain an execution adjustment amount for performing the target function operation based on the detection operation amount and the correspondence between the operation amount and the function adjustment amount; and to provide the execution adjustment amount to the terminal application. The terminal application is specifically used to respond based on the execution adjustment amount.

5. The system according to claim 1, characterized in that, If the operation to be detected is a first operation for entering a candidate mode of the terminal application, the wearable device is further configured to play a voice prompt message indicating entry into the candidate mode in response to detecting the first operation.

6. The system according to claim 1, characterized in that, The wearable device is equipped with a processor; if the operation to be detected is a first operation for entering the candidate mode of the terminal application, the processor is also used to determine whether the wearer performs the second operation within a preset time period after performing the first operation. If the wearer does not perform the second operation within the preset time period, an exit command to exit the candidate mode is sent to the terminal application. The terminal application is configured to receive the exit instruction and exit the candidate mode in response to the exit instruction.

7. The system according to claim 1, characterized in that, The wearable device interfaces with the application programming interface of the terminal application. The wearable device is specifically used to call the application programming interface (API) of the terminal application and provide the operation instructions to be executed to the terminal application through the called API.

8. The system according to claim 1, characterized in that, If the operation to be detected is the first operation for entering the candidate mode of the terminal application, the operation correspondence includes the mode correspondence between the operation and each candidate mode; The step of determining the operation instruction to be executed based on the correspondence between the detected operation action and the operation includes: Based on the correspondence between the operation to be detected and the mode, the target candidate mode to which the operation to be detected points is determined from each candidate mode; The instruction that enters the target candidate mode is determined as the operation instruction to be executed.

9. The system according to claim 1, characterized in that, The wearable device is equipped with a positioning module; the positioning module is used to perform real-time positioning of the wearer, obtain the wearer's real-time positioning information, and provide the real-time positioning information to the terminal application; The terminal application is used to perform route planning for the orders to be delivered based on the real-time location information, and to obtain the delivery route for the orders to be delivered. Alternatively, the order delivery status of the order to be delivered can be updated based on the real-time location information.

10. The system according to claim 1, characterized in that, The wearable device is equipped with a wearing status detection sensor; The wearing status detection sensor is used to detect whether the wearer is wearing the wearable device; If the wearer is wearing the wearable device, then the step of determining the action to be detected is performed in response to detecting the wearer's action.

11. An information interaction processing method, characterized in that, Applied to wearable devices, the method includes: In response to detecting the user's operation, a detection operation is determined; the operation includes at least one of the following: a first operation for entering or exiting a candidate mode of the terminal application, and a second operation for performing a target function operation in the candidate mode; the candidate mode for entering or exiting the terminal application includes entering or exiting the terminal application, entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application. Based on the operation action to be detected and the operation correspondence, the operation instruction to be executed is determined; the operation correspondence is the operation correspondence between the operation action performed by the wearer when wearing the wearable device and the operation instruction to be executed for the terminal application, which is configured in the configuration application or in the terminal application; the wearable device and the terminal application are connected by a short-range communication method. The operation instruction to be executed is provided to the terminal application so that the terminal can respond based on the operation instruction to be executed.

12. The method according to claim 11, characterized in that, If the operation to be detected is a second operation for performing a target function operation in the candidate mode, then before performing the step of determining the operation instruction to be executed based on the correspondence between the operation to be detected and the operation, the method further includes: Obtain the quantity of the operation action to be detected corresponding to the operation action to be detected; Determine whether the amount of the operation to be detected meets the preset operation amount requirements; If the amount of the operation to be detected meets the preset operation amount requirement, then the step of determining the operation instruction to be executed based on the operation correspondence between the operation to be detected and the operation is performed.

13. The method according to claim 12, characterized in that, The wearable device is equipped with an operation motion sensor; Obtaining the quantity of the operation to be detected corresponding to the operation to be detected includes: Obtain the first state value of the sensor corresponding to the operation action before the wearer performs the operation to be detected; Obtain the second state value of the sensor corresponding to the operation action after the wearer performs the operation to be detected; The amount of the operation to be detected is obtained based on the first state value and the second state value.

14. The method according to claim 13, characterized in that, The operation instruction to be executed includes an execution adjustment amount for performing the target function operation; The method further includes: Based on the correspondence between the detected operation action quantity, the operation action quantity and the function adjustment quantity, the execution adjustment quantity used to perform the target function operation is obtained; The execution adjustment amount is provided to the terminal application so that the terminal application responds based on the execution adjustment amount.

15. The method according to claim 11, characterized in that, If the operation to be detected is a first operation for entering a candidate mode of the terminal application, the method further includes: in response to detecting the first operation, playing a voice prompt message for entering the candidate mode.

16. The method according to claim 11, characterized in that, If the operation to be detected is a first operation for entering a candidate mode of the terminal application, the method further includes: Determine whether the wearable user performs the second operation within a preset time period after performing the first operation; If the wearable user does not perform the second operation within the preset time period, an exit command to exit the candidate mode is sent to the terminal application, so that the terminal application exits the candidate mode in response to the exit command.

17. The method according to claim 11, characterized in that, The wearable device interfaces with the application programming interface of the terminal application. Providing the operation instruction to be executed to the terminal application includes: calling the application programming interface (API) of the terminal application and providing the operation instruction to be executed to the terminal application through the called API.

18. The method according to claim 11, characterized in that, If the operation to be detected is the first operation for entering the candidate mode of the terminal application, the operation correspondence includes the mode correspondence between the operation and each candidate mode; The step of determining the operation instruction to be executed based on the correspondence between the detected operation action and the operation includes: Based on the correspondence between the operation to be detected and the mode, the target candidate mode to which the operation to be detected points is determined from each candidate mode; The instruction that enters the target candidate mode is determined as the operation instruction to be executed.

19. The method according to claim 11, characterized in that, The wearable device is equipped with a positioning module; The method further includes: using the positioning module to perform real-time positioning of the wearable user to obtain the real-time positioning information of the wearable user; The real-time location information is provided to the terminal application so that the terminal application can perform route planning for the orders to be delivered based on the real-time location information and obtain the delivery route for the orders to be delivered; or, based on the real-time location information, update the order delivery status of the orders to be delivered.

20. The method according to claim 11, characterized in that, The wearable device is equipped with a wearing status detection sensor; The method further includes: using the wearing status detection sensor to detect whether the wearer is wearing the wearable device; if the wearer is wearing the wearable device, then performing the step of determining the operation to be detected in response to detecting the wearer's operation.

21. An information interaction processing method, characterized in that, Applied to terminal applications, the method includes: Receive the operation instructions to be executed from the wearable device; The response is based on the operation instruction to be executed; the operation instruction to be executed is determined by the wearable device based on the detection operation action performed by the wearer on the wearable device and the operation correspondence; the operation correspondence is an operation correspondence configured in the configuration application or the terminal application, indicating the operation action performed by the wearer when wearing the wearable device and the operation instruction to be executed on the terminal application; the operation action includes at least one of the following: a first operation action for entering or exiting the candidate mode of the terminal application, and a second operation action for performing a target function operation in the candidate mode; the wearable device and the terminal application are connected via short-range communication; the candidate mode for entering or exiting the terminal application includes entering or exiting the terminal application, entering or exiting a sub-application in the terminal application, or entering or exiting the task process of the terminal application.

22. The method according to claim 21, characterized in that, The operation instruction to be executed includes an execution adjustment amount for performing the target function operation; The method further includes: obtaining an execution adjustment amount sent by the wearable device for performing the target function operation; the execution adjustment amount is obtained by the wearable device based on the detection operation action amount corresponding to the detection operation action, the correspondence between the operation action amount and the function adjustment amount; The response is based on the aforementioned adjustment amount.

23. The method according to claim 21, characterized in that, The wearable device interfaces with the application programming interface of the terminal application. The step of obtaining the operation instruction to be executed sent by the wearable device includes: obtaining the operation instruction to be executed sent by the wearable device through the application interface.

24. The method according to claim 21, characterized in that, The terminal application includes at least a delivery application; if the terminal application is a delivery application, the method further includes: Obtain real-time location information sent by the wearable device for real-time positioning of the wearer; Based on the real-time location information, route planning is performed on the orders to be delivered to obtain the delivery route for the orders to be delivered; or, based on the real-time location information, the order delivery status of the orders to be delivered is updated.

25. An information interaction processing device, characterized in that, For use in wearable devices, the device includes: The detection action determination unit is used to determine the detection action in response to detecting the action of the wearer user; the action includes at least one of the following: a first action for entering or exiting a candidate mode of the terminal application and a second action for performing a target function operation in the candidate mode; the candidate mode for entering or exiting the terminal application includes entering or exiting the terminal application, entering or exiting a sub-application in the terminal application, or entering or exiting a task process of the terminal application. An operation instruction determination unit is used to determine an operation instruction to be executed based on the operation action to be detected and the operation correspondence relationship; the operation correspondence relationship is an operation correspondence relationship configured in the configuration application or the terminal application that indicates the operation action performed by the wearer when wearing the wearable device and the operation instruction to be executed for the terminal application; the wearable device and the terminal application are connected by a short-range communication method; An operation instruction providing unit is used to provide the operation instruction to be executed to a terminal application so that the terminal can respond based on the operation instruction to be executed.

26. An information interaction processing device, characterized in that, For use in terminal applications, the device includes: The unit for obtaining operation instructions to be executed is used to obtain operation instructions to be executed sent by the wearable device; A response unit is configured to respond based on the operation instruction to be executed; the operation instruction to be executed is determined by the wearable device based on the detection operation action performed by the wearer on the wearable device and the operation correspondence; the operation correspondence is an operation correspondence configured in the configuration application or the terminal application, representing the operation action performed by the wearer when wearing the wearable device and the operation instruction to be executed on the terminal application; the operation action includes at least one of the following: a first operation action for entering or exiting a candidate mode of the terminal application, and a second operation action for performing a target function operation in the candidate mode; the wearable device and the terminal application are connected via short-range communication; the candidate modes for entering or exiting the terminal application include entering or exiting the terminal application, entering or exiting a sub-application within the terminal application, or entering or exiting a task process of the terminal application.

27. An electronic device, characterized in that, include: processor; A memory for storing a computer program that is executed by a processor to perform the method described in any one of claims 11-24.

28. A computer storage medium, characterized in that, The computer storage medium stores a computer program that is executed by a processor to perform the method described in any one of claims 11-24.

Images