Message flow conversion method and device

Abstract

This application provides a message transfer method and apparatus. The method includes: a first application of a terminal receiving a first message; the first message being sent to a second application of the terminal for processing to obtain a first data packet; the terminal sending the first data packet to a third application of a wearable device, causing the wearable device to drive at least one interactive device to display the first message based on the first data packet. The message transfer method and apparatus provided in this application, by having the terminal send the first data packet corresponding to the first message to the wearable device, so that the wearable device can determine the content of the first message based on the obtained first data packet and display the content of the first message, realizes the message transfer between the wearable device and the terminal device. This allows the second application of the terminal to receive all messages about the wearable device from the terminal and forward them to the wearable device, improving the convenience of interaction between the terminal device and the wearable device.

Description

Technical Field

[0001] This application relates to the field of communication technology, specifically to a message transfer method and apparatus. Background Technology

[0002] When existing wearable devices are in use, the acquisition of terminal device messages is generally based on Bluetooth transmission or uniformly pushed to the wearable device by a cloud server.

[0003] In existing methods, the terminal can only push and preview message summaries, and the wearable device can only display messages that are limited in both content and the number of sources. The terminal can only push notification messages from the terminal to the wearable device, but it cannot push messages from various applications on the terminal to the wearable device for display. Summary of the Invention

[0004] This application provides a message transfer method and apparatus to solve the technical problem that it can only push notification messages from the terminal to wearable devices, but cannot push messages from various application software in the terminal to wearable devices for display.

[0005] In a first aspect, this application provides a message flow method, the method comprising:

[0006] The terminal's first application receives the first message;

[0007] The first message is sent to the second application of the terminal for processing to obtain the first data packet;

[0008] The terminal sends the first data packet to a third application of the wearable device, causing the wearable device to drive at least one interactive device to display the first message based on the first data packet.

[0009] In one embodiment, it also includes:

[0010] The second application of the terminal receives a second data packet returned by the third application of the wearable device, wherein the second data packet is obtained by the third application of the wearable device processing a second message, and the second message is a reply message from the wearable device;

[0011] The second application of the terminal processes the second data packet to obtain the second message;

[0012] The second message is sent to the first application of the terminal.

[0013] In one embodiment, the first message is sent to a second application on the terminal for processing to obtain a first data packet, including:

[0014] The second application of the terminal encodes the first message to obtain the encoded first message, and compresses the encoded first message to obtain the first data packet.

[0015] In one embodiment, the second application of the terminal processes the second data packet to obtain the second message, including:

[0016] The second application of the terminal decompresses the second data packet to obtain a decompressed second message, and decodes the decompressed second message to obtain the second message.

[0017] In one embodiment, the first message includes one or more of text messages, audio messages, image messages, and video messages.

[0018] In one embodiment, the second message includes one or more of text messages, audio messages, image messages, and video messages.

[0019] In one embodiment, the first message further includes an application identifier of the first application, the application identifier being used to indicate the source application of the first message.

[0020] Secondly, embodiments of this application also provide a message flow method, the method comprising:

[0021] The third application of the wearable device receives a first data packet sent by the terminal. The first data packet is obtained by the terminal's first application receiving a first message and the first message being sent to the terminal's second application for processing.

[0022] The wearable device drives at least one interactive device to display the first message based on the first data packet.

[0023] In one embodiment, it also includes:

[0024] The third application of the wearable device receives a second message, which is a response message from the wearable device.

[0025] The third application of the wearable device processes the second message to obtain the second data packet;

[0026] The third application of the wearable device sends the second data packet to the second application of the terminal.

[0027] In one embodiment, the third application of the wearable device processes the second message to obtain a second data packet, including:

[0028] The third application of the wearable device encodes the second message to obtain the encoded second message, and compresses the encoded second message to obtain the second data packet.

[0029] In one embodiment, the wearable device drives at least one interactive device to display the first message based on the first data packet, including:

[0030] The third application of the wearable device decompresses the first data packet to obtain the decompressed first message, and decodes the decompressed first message to obtain the first message.

[0031] The wearable device drives at least one interactive device to display the first message based on the first message.

[0032] In one embodiment, the second message includes an application identifier of the first application, which is used to indicate the application that responded to the second message.

[0033] In one embodiment, the first message includes one or more of text messages, audio messages, image messages, and video messages.

[0034] In one embodiment, the second message includes one or more of text messages, audio messages, image messages, and video messages.

[0035] Thirdly, embodiments of this application also provide a terminal, the terminal including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement any of the above-described message transfer methods.

[0036] Fourthly, embodiments of this application also provide a wearable device, the wearable device including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement any of the above-described message flow methods.

[0037] Fifthly, embodiments of this application also provide a non-transitory computer-readable storage medium storing a computer program thereon, wherein the computer program, when executed by a processor, implements any of the above-described message flow methods. Attached Figure Description

[0038] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0039] Figure 1 This is one of the flowcharts illustrating the message flow method provided in the embodiments of this application;

[0040] Figure 2 This is an overall framework structure diagram provided for embodiments of this application;

[0041] Figure 3 A schematic diagram illustrating the process of transferring interactive messages from a terminal to a wearable device, provided in an embodiment of this application.

[0042] Figure 4 This is a schematic diagram of the data protocol format for data transfer from a terminal to a wearable device, provided in an embodiment of this application.

[0043] Figure 5 This is a schematic diagram illustrating the process of transferring interactive messages from a wearable device to a terminal, as provided in an embodiment of this application.

[0044] Figure 6 This is a schematic diagram of the data protocol format for data transfer from a wearable device to a terminal, provided in an embodiment of this application.

[0045] Figure 7 This is a data protocol format diagram for user-initiated reply messages provided in an embodiment of this application;

[0046] Figure 8 The second flowchart illustrating the message transfer method provided in this application embodiment;

[0047] Figure 9 This is a schematic diagram of the data link establishment process provided in the embodiments of this application;

[0048] Figure 10 A flowchart illustrating the message flow method provided in the embodiments of this application. Detailed Implementation

[0049] The technical solutions of this application will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0050] Figure 1This is one of the flowcharts illustrating the message flow method provided in the embodiments of this application, referred to as... Figure 1 The message transfer method provided in this application includes the following steps:

[0051] Step 110: The terminal's first application receives the first message;

[0052] Step 120: The first message is sent to the second application of the terminal for processing to obtain the first data packet;

[0053] Step 130: The terminal sends the first data packet to a third application of the wearable device, so that the wearable device drives at least one interactive device to display the first message based on the first data packet.

[0054] The terminals in this application include various handheld devices, in-vehicle devices, wearable devices, computing devices, or other processing devices connected to a wireless modem with wireless communication capabilities, such as mobile phones, tablets, desktop laptops, and smart devices capable of running applications, including the central control console of a smart car. Specifically, they can refer to user equipment (UE), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent, or user device. Terminal devices can also be satellite phones, cellular phones, smartphones, wireless data cards, wireless modems, machine-type communication devices, including cordless phones, session initiation protocol (SIP) phones, wireless local loop (WLL) stations, personal digital assistants (PDAs), handheld devices with wireless communication capabilities, computing devices or other processing devices connected to a wireless modem, in-vehicle devices or wearable devices, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical care, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, and terminal devices in 5G networks or future communication networks. Mobile terminals can be battery-powered or attached to and powered by the power system of a vehicle or vessel. The power system of a vehicle or ship can also charge the battery of a mobile terminal to extend the communication time of the mobile terminal.

[0055] Wearable devices in this application include smart bracelets, smartwatches, VR (Virtual Reality) glasses, and AR (Augmented Reality) glasses, etc. This application does not limit the specific type of wearable device.

[0056] The following describes the technical solution of this application in detail, taking the message transfer method provided in the embodiments of this application as an example.

[0057] Specifically, in step 110, the first application in the terminal receives the first message.

[0058] The first application on the terminal is the one that can interact with the wearable device among all the applications on the terminal. Users can exchange messages with the wearable device based on the first application.

[0059] The first message can include one or more of the following: text messages, audio messages, image messages, and video messages. For example, when the first application is a chat application, it can send interactive messages such as text messages, voice messages, image and video messages, and video messages to the wearable device.

[0060] In step 120, after receiving the first message, the first message is sent to the second application of the terminal for processing to obtain the first data packet.

[0061] In this context, the second application acts as a primary message relay station when the first application in the terminal interacts with the wearable device. After receiving the first message from the first application in the terminal, it sends the received message to the wearable device.

[0062] Optionally, the first application on the terminal can use its message flow SDK (Software Development Kit) to send the received first message to a second application on the terminal. When the first application receives a new message, it forwards the new message to the second application via the message flow SDK.

[0063] Optionally, the second application in the terminal encodes and compresses the obtained first message to obtain a first data packet, and sends the obtained first data packet to the wearable device.

[0064] In step 130, the second application in the terminal processes the first message and, after obtaining the first data packet, sends the obtained first data packet to the third application in the wearable device. This enables the wearable device to drive at least one interactive device based on the first data packet to display the first message, thus realizing the interaction process of the first message between the terminal and the wearable device.

[0065] After receiving the first data packet, the third application of the wearable device can decode the received first data packet to obtain the first message.

[0066] The third application is a device within the wearable device used to receive the first data packets from the terminal. This third application establishes a connection with the second application on the terminal and enables the mutual transmission of the first data packets. Specifically, the third application can receive interactive messages from the second application on the terminal, and can also transmit other messages from the wearable device itself to the second application on the terminal, and then forward them to the first application on the terminal based on the messages from the second application.

[0067] The first data message is used in the interaction process between the wearable device and its user. For example, the first data message can be encoded text, images, video, or audio messages displayed or played on the wearable device. After the wearable device acquires and decodes the first data message, it can rearrange and display the text within the first data message using an interactive device within the wearable device. The interactive device is a device within the wearable device used to display message content. It can drive the speaker module to play audio messages from the first data message, drive the display module to display augmented reality scenes from text messages from the first data message, and simultaneously drive both the display module and the speaker module to play video messages from the first data message. After viewing the content decoded from the first data message, the user of the wearable device can perform interactive operations such as replying or deleting.

[0068] Optionally, such as Figure 2 As shown in the overall framework diagram provided in this application embodiment, the second application can be divided into three modules:

[0069] Terminal Interoperability Module 210: Enables seamless discovery and data link establishment between terminals and wearable devices via BLE (Bluetooth Low Energy) and WiFi (Wireless Fidelity).

[0070] Message Flow SDK 220: Provides message flow SDK integration for the first application that needs to flow messages. The first application sends the messages that need to be flowed to the terminal message flow master control module 230 of the second application through the message flow SDK. At the same time, the terminal message flow master control module 230 also sends the message content replied by the wearable device back to the first application through the message flow SDK.

[0071] Terminal message flow control module 230: realizes data sending / receiving between the second application and the third application, compresses and encrypts the message content to be sent, and then sends it to the third application; similarly, it receives message data sent from the third application, decrypts and decompresses the data, and then sends the reply message content to the first application to realize message reply;

[0072] The third application can also be divided into three modules:

[0073] Wearable device interconnection module 240: Enables seamless discovery and data link establishment between terminals and wearable devices via Bluetooth BLE and WiFi;

[0074] Input / output module 250: The output module sends the audio data in the interactive message to the headphone player of the wearable device according to the data type of the interactive message. After arranging the content to be displayed according to the size of the wearable device's output display screen, it outputs it to the display of the wearable device. When the user replies to the message through the touchpad, microphone, virtual keyboard, etc. of the wearable device, the complete content of the reply message is obtained by the input / output module 250 on the wearable device side and finally sent to the wearable device message flow control module 260.

[0075] Wearable device message flow control module 260: realizes data sending / receiving between the second application and the third application, compresses and encrypts the reply message content sent by the input / output module 250 and sends it to the second application; similarly, it receives message data sent from the second application, decrypts and decompresses the data and sends the obtained message content to the input / output module 250, and the input / output module 250 finally presents the flowed message to the user.

[0076] When there are interactive messages on the terminal that need to be transferred to the wearable device, such as Figure 3 The flowchart illustrating the process of transferring interactive messages from a terminal to a wearable device provided in this application embodiment shows that the first application pushes the interactive messages to be transferred to the second application through the message transfer SDK, and then:

[0077] 1. Report the content of the circulating interactive messages to the terminal message flow control module;

[0078] 2. The terminal message flow main control module 230 first uses a private protocol to handshake and negotiate with the third application on the wearable device side to establish a message flow data channel;

[0079] 3. After the applications on both ends of the terminal and the wearable device complete the handshake negotiation of the private protocol, the terminal will compress the interactive messages to be transmitted to reduce the amount of data transmission, and finally encrypt the compressed data.

[0080] 4. After the terminal completes the compression and encryption of the interactive message, it will start the data transmission process, sending the compressed and encrypted interactive message from the terminal to the wearable device.

[0081] 5. When the third-party application on the wearable device side receives the interactive message sent from the terminal, it first decompresses and decrypts the data;

[0082] 6. After the data decompression and decryption are complete, send the interactive message to the input / output module;

[0083] 7. The input / output module determines whether the incoming interactive message is audio data played by the headphones of the wearable device or text message displayed on the display of the wearable device, and then sends the data of different types to the corresponding output unit.

[0084] 8. The audio output unit plays the message audio from the headphones;

[0085] 9. The display output unit rearranges the message content in a format that adapts to the display area of ​​the glasses, and then sends it to the wearable device for display.

[0086] The data protocol format for interactive messages flowing from the terminal to the wearable device can be as follows: Figure 4 As shown in the schematic diagram of the data protocol format for data transfer from a terminal to a wearable device provided in this application embodiment, the first application of the terminal sends the interactive message TransMessage to be transferred to the second application of the terminal. The interactive message TransMessage includes the application name field AppName, the message source field MessageSrc, the message type field MessageType, and the message content field MessageContent. After receiving the interactive message, the second application of the terminal compresses and encrypts the interactive message, and sends the compressed and encrypted message to the third application of the wearable device. After receiving the message, the third application of the wearable device decompresses and decrypts it, reformatts and displays the text message in the obtained message, and sends the audio message in the obtained message to the headphones of the wearable device for playback.

[0087] When a wearable device needs to forward a response message to an interactive message to the terminal, such as Figure 5 The schematic diagram of the interactive message flow from the wearable device to the terminal provided in this application embodiment shows that, firstly, the virtual buttons, touchpad, microphone, and other input modules of the wearable device are called to reply to the message. The third application obtains the complete reply message content through the input module, and then:

[0088] 1. Report the reply message content to the third-party application;

[0089] 2. The third application first uses a private protocol to handshake and negotiate with the second application on the terminal side to establish a message flow data channel;

[0090] 3. After the third application of the wearable device and the second application of the terminal complete the handshake negotiation of the private protocol, the wearable device will compress the message data to be replied to reduce the amount of data transmission, and finally encrypt the compressed data.

[0091] 4. After the wearable device completes the compression and encryption of the reply message data, it will add the corresponding application name, the recipient and other necessary information before sending the message, depending on the type of reply message, and finally form a complete reply message.

[0092] 5. Subsequently, the wearable device will send the above reply message from the wearable device to the terminal;

[0093] 6. When the second application on the terminal side receives the reply message sent from the wearable device, it first decompresses and decrypts the data;

[0094] 7. After the data decompression and decryption are completed, the reply message is sent to the first application to be replied to via the message flow SDK according to the application name AppName specified in the reply message;

[0095] 8. After receiving the reply message from the message flow SDK, the first application sends the message to the specified recipient / receiving group according to the sending object specified in the reply message;

[0096] The data protocol format for the response message flow from the wearable device to the terminal can be as follows: Figure 6 As shown in the schematic diagram of the wearable device to terminal data protocol format provided in this application embodiment, the wearable device's input module obtains a reply message (ReplyMessage) and sends it to the wearable device's third application. The reply message (ReplyMessage) includes the application name field (AppName), the recipient field (SendAddress), the message type field (MessageType), and the message content field (MessageContent). After receiving the reply message, the wearable device's third application compresses and encrypts the reply message and sends the compressed and encrypted reply message to the terminal's second application. After receiving the compressed and encrypted reply message, the terminal's second application decompresses and decrypts it, and pushes the reply message to the corresponding first application based on the AppName field. After receiving the reply message, the first application pushes the reply message to the corresponding contact based on the SendAddress field.

[0097] Wearable devices can proactively send messages, not limited to replying to messages; they can also initiate message sending themselves, such as... Figure 7 As shown in the data protocol format diagram of the user-initiated reply message provided in this application embodiment, the user only needs to specify the message type and recipient / receiving group to transfer the message flow to the corresponding first application of the connected terminal for message sending. Specifically, the input module of the wearable device obtains the user-initiated reply message ReplyMessage and sends it to the third application of the wearable device. The ReplyMessage includes the application name field AppName, the recipient field SendAddress, the message type field MessageType, and the message content field MessageContent. After receiving the ReplyMessage, the third application of the wearable device compresses and encrypts the ReplyMessage and sends the compressed and encrypted ReplyMessage to the second application of the terminal. After receiving the compressed and encrypted ReplyMessage, the second application of the terminal decompresses and decrypts it, and pushes the ReplyMessage to the corresponding first application based on the AppName field. After receiving the ReplyMessage, the first application pushes the ReplyMessage to the corresponding contact based on the SendAddress field.

[0098] The message transfer method provided in this application embodiment sends a first data packet corresponding to a first message to a wearable device via a terminal, so that the wearable device can determine the content of the first message based on the obtained first data packet and display the content of the first message. This realizes the transfer of messages between the wearable device and the terminal device, enabling the second application of the terminal to receive all messages about the wearable device from the terminal and forward them to the wearable device, thereby improving the convenience of interaction between the terminal device and the wearable device.

[0099] Based on the above embodiments, it also includes:

[0100] The second application of the terminal receives a second data packet returned by the third application of the wearable device, wherein the second data packet is obtained by the third application of the wearable device processing a second message, and the second message is a reply message from the wearable device; the second application of the terminal processes the second data packet to obtain the second message; the second message is sent to the first application of the terminal.

[0101] The second application on the terminal receives a second data packet returned by the third application on the wearable device. The second data packet can be a second message obtained by the wearable device based on its own input module, and processed accordingly. The second message can be a reply to the first message after the user has viewed its content, or it can be an interactive message initiated by the user to the first application on the terminal device.

[0102] After receiving the second data packet, the terminal receives the second data packet sent by the third application. The second application in the terminal processes the second data packet to obtain a second message, and returns the second message to the first application in the terminal.

[0103] After receiving the second message content, the terminal device injects the second message content into the first application and displays the second message to the corresponding user.

[0104] The message flow method provided in this application embodiment receives a second data packet returned by a third application of a wearable device through a second application of a terminal. The second application of the terminal processes the received second data packet to obtain a second message and sends the second message to the first application of the terminal, thereby realizing the message flow process of the wearable device's reply message to the first application of the terminal.

[0105] Based on the above embodiments, step 120 includes:

[0106] The second application of the terminal encodes the first message to obtain the encoded first message, and compresses the encoded first message to obtain the first data packet.

[0107] After receiving the first message from the first application, the second application on the terminal encodes the first message to obtain the encoded first message. It then compresses the encoded first message to obtain the first data packet.

[0108] Optionally, after receiving the first data packet, before transmitting the first data packet to the wearable device, the first data packet can be encrypted using an encryption algorithm. The encryption method can be based on TLS (Transport Layer Security).

[0109] It is understandable that after the third application of the wearable device receives the first data packet, it decompresses and decodes the first data packet to obtain the first message.

[0110] The message transmission method provided in this application improves the transmission efficiency of the first message by encoding and compressing the first message to obtain a first data packet, and then transmitting the obtained first data packet.

[0111] Based on the above embodiments, step 130 includes:

[0112] The second application of the terminal decompresses the second data packet to obtain a decompressed second message, and decodes the decompressed second message to obtain the second message.

[0113] After the second application on the terminal receives the second data packet, it processes the received second data packet.

[0114] Because the wearable device encodes and compresses the second message before sending it to the terminal, the terminal's second application needs to decompress the received second data packet and decode the decompressed second message to obtain the original second message.

[0115] The message transmission method provided in this application involves decompressing a second data packet using a second application on the terminal to obtain a decompressed second message, and then decoding the decompressed second message to obtain the second message itself. This encoding and compression process during the transmission of the second message ensures efficient transmission.

[0116] Based on the above embodiments, the first message includes one or more of text messages, audio messages, image messages, and video messages.

[0117] The first message type can be one or more of the following: text message, audio message, image message, and video message.

[0118] Optionally, after obtaining the first message and determining its data type, the third application of the wearable device sends the audio message in the first message to the headphone player of the wearable device for output; after formatting the text message in the first message that needs to be displayed according to the screen size of the wearable device, it outputs it to the display of the wearable device; and outputs the video message in the first message to the display of the wearable device for playback.

[0119] The message flow method provided in this application embodiment, by determining that the type of the first message is one or more of text messages, audio messages, image messages, and video messages, realizes the interaction process of multiple types of messages and improves the flexibility of interaction between the terminal and the smart wearable device.

[0120] Based on the above embodiments, the second message includes one or more of text messages, audio messages, image messages, and video messages.

[0121] The second message type can be one or more of the following: text message, audio message, image message, and video message.

[0122] The third application of wearable devices can obtain second messages based on the virtual buttons, touchpads, microphones and other input devices of the wearable devices, so that the third application can obtain the second messages.

[0123] The message flow method provided in this application embodiment, by determining that the type of the second message is one or more of text messages, audio messages, image messages, and video messages, realizes the interaction process of multiple types of messages and improves the flexibility of interaction between the terminal and the smart wearable device.

[0124] Based on the above embodiments, the first message also includes an application identifier of the first application, which is used to indicate the source application of the first message.

[0125] For the first message obtained from the first application, the application identifier of the first application can be added to the first message. The application identifier is the application identifier of the first application, which is used to indicate that the first message comes from the first application. That is, the first message can be determined to come from the first application based on the application identifier.

[0126] The application identifier can be the application name or application ID, etc.

[0127] Understandably, after the third application on the wearable device receives the first message, it can determine that the first message originated from the first application based on the application identifier in the first message. Therefore, after determining the reply message to the first message, it can be determined that the reply message was returned to the first application.

[0128] The message flow method provided in this application embodiment determines the message interaction object by determining that the first message also includes the application identifier of the first application, which facilitates the message interaction process between the terminal and the wearable device.

[0129] Figure 8 The second flowchart illustrating the message flow method provided in this application embodiment is shown below. Figure 8 The message transfer method provided in this application includes the following steps:

[0130] Step 810: The third application of the wearable device receives the first data packet sent by the terminal. The first data packet is obtained by the terminal's second application after the first application receives the first message and the first message is sent to the terminal for processing.

[0131] Step 820: The wearable device drives at least one interactive device to display the first message based on the first data packet.

[0132] The terminals in this application include various handheld devices, in-vehicle devices, wearable devices, computing devices, or other processing devices connected to a wireless modem with wireless communication capabilities, such as mobile phones, tablets, desktop laptops, and smart devices capable of running applications, including the central control console of a smart car. Specifically, they can refer to user equipment (UE), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent, or user device. Terminal devices can also be satellite phones, cellular phones, smartphones, wireless data cards, wireless modems, machine-type communication devices, including cordless phones, session initiation protocol (SIP) phones, wireless local loop (WLL) stations, personal digital assistants (PDAs), handheld devices with wireless communication capabilities, computing devices or other processing devices connected to a wireless modem, in-vehicle devices or wearable devices, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical care, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, and terminal devices in 5G networks or future communication networks. Mobile terminals can be battery-powered or attached to and powered by the power system of a vehicle or vessel. The power system of a vehicle or ship can also charge the battery of a mobile terminal to extend the communication time of the mobile terminal.

[0133] Wearable devices in this application include smart bracelets, smartwatches, VR (Virtual Reality) glasses, and AR (Augmented Reality) glasses, etc. This application does not limit the specific type of wearable device.

[0134] The following describes the technical solution of this application in detail, taking the message transfer method provided in the embodiments of this application as an example of a wearable device.

[0135] Specifically, in step 810, the third application of the wearable device receives the first data packet sent by the terminal. The first data packet is obtained by the terminal's second application after the first application receives the first message and the first message is sent to the terminal for processing.

[0136] The third application is a device within the wearable device used to receive the first data packets from the terminal. The third application in the wearable device establishes a connection with the second application in the terminal and enables the mutual transmission of the first data packets. Specifically, the third application in the wearable device can receive interactive messages from the second application in the terminal, and can also transmit other messages from the wearable device itself to the second application in the terminal, and forward them to the first application in the terminal based on the messages from the second application.

[0137] The second application acts as the first message relay station when the first application in the terminal interacts with the wearable device.

[0138] Optionally, the first application on the terminal can use its message flow SDK (Software Development Kit) to send the received first message to a second application on the terminal. When the first application receives a new message, it forwards the new message to the second application via the message flow SDK.

[0139] In step 820, the wearable device drives at least one interactive device to display the first message based on the first data packet.

[0140] After receiving the first data packet, the third application of the wearable device can decode the received first data packet to obtain the first message.

[0141] The first data message is used in the interaction process between the wearable device and its user. For example, the first data message can be encoded text, images, video, or audio messages displayed or played on the wearable device. After the wearable device acquires and decodes the first data message, it can rearrange and display the text within the first data message using an interactive device within the wearable device. The interactive device is a device within the wearable device used to display message content. It can drive the speaker module to play audio messages from the first data message, drive the display module to display augmented reality scenes from text messages from the first data message, and simultaneously drive both the display module and the speaker module to play video messages from the first data message. After viewing the content decoded from the first data message, the user of the wearable device can perform interactive operations such as replying or deleting.

[0142] The message transfer method provided in this application embodiment receives a first data packet sent by a terminal through a third application of a wearable device, processes the received first data packet to obtain a first message, and drives an interactive device to display the first message. This realizes message transfer between the wearable device and the terminal device, enabling the second application of the terminal to receive all messages about the wearable device from the terminal and forward them to the wearable device, thus improving the convenience of interaction between the terminal device and the wearable device.

[0143] Based on the above embodiments, it also includes:

[0144] The third application of the wearable device receives a second message, which is a response message from the wearable device.

[0145] The third application of the wearable device processes the second message to obtain the second data packet;

[0146] The third application of the wearable device sends the second data packet to the second application of the terminal.

[0147] The second message is a response message returned by the wearable device to the terminal device. The second message may include one or more of the following: text message, audio message, image message, and video message.

[0148] It is understandable that the second message could be a message confirmed by the wearable device's owner after receiving the first message and completing the corresponding interactive operation. Alternatively, it could be a message actively initiated by the user and sent to the terminal device.

[0149] The second message can be obtained based on the virtual buttons, touchpad, microphone and other input devices of the wearable device, so that the third application can receive the second message.

[0150] After receiving the second message, the third application of the wearable device processes the second message to obtain the second data packet corresponding to the second message.

[0151] Optionally, a third application in the wearable device encodes and compresses the obtained second message to obtain a second data packet.

[0152] After receiving the second data packet, the wearable device sends the received second data packet to the terminal's second application based on the wearable device's third application.

[0153] The second message is used to facilitate the interaction between the wearable device and the terminal device. For example, the second message can be text, image, video, or audio from the wearable device. Upon receiving the second message, the second application on the terminal can return it to the first application, thus enabling the interaction between the wearable device and the terminal.

[0154] Understandably, before the third application in the wearable device sends the received second data packet to the second application on the terminal, a communication link needs to be established between the wearable device and the terminal. After receiving the second data packet, the second application decodes and decompresses it to obtain the second message corresponding to the second data packet.

[0155] Optional, the specific process for establishing the link is as follows: Figure 9 The data link establishment process provided in this application embodiment is illustrated in the diagram. The specific establishment process is as follows:

[0156] 1. Both the terminal and the wearable device are controlled by a Bluetooth control module that controls the Bluetooth chip and periodically broadcasts BLE information. The BLE information carries a specific application identifier and the device identifier of the wearable device (such as the Bluetooth MAC address).

[0157] 2. After the peer device receives and correctly parses the broadcast BLE information, extract the device feature code and establish a further BLE unicast channel with the device (such as the GATT protocol).

[0158] 3. On the BLE unicast channel, both parties perform necessary authentication and authorization. After successful authentication, the WiFi link module is invoked to establish a WiFi point-to-point data link.

[0159] 4. The established WiFi point-to-point data link serves as the data transmission channel between the two ends.

[0160] The message transfer method provided in this application embodiment receives a second message through a third application of a wearable device, processes the second message to obtain a second data packet, and sends the second data packet to a second application of the terminal, thereby realizing the message transfer process of the wearable device's reply message to the second application of the terminal.

[0161] Based on the above embodiments, step 810 includes:

[0162] The third application of the wearable device encodes the second message to obtain the encoded second message, and compresses the encoded second message to obtain the second data packet.

[0163] After receiving the second message, the third application of the wearable device encodes the second message to obtain the encoded second message. It then compresses the encoded second message to obtain the second data packet.

[0164] Optionally, after obtaining the second data packet, but before transmitting the second data packet to the terminal, the second data packet can be encrypted using an encryption algorithm. The encryption method can be based on TLS (Transport Layer Security).

[0165] It is understandable that after the second application in the terminal receives the second data packet, it decompresses and decodes the received second data packet to obtain the second message.

[0166] The message transmission method provided in this application improves the transmission efficiency of the second message by encoding and compressing the second message to obtain a second data packet, and then transmitting the obtained second data packet.

[0167] Based on the above embodiments, step 810 includes:

[0168] The third application of the wearable device decompresses the first data packet to obtain the decompressed first message, and decodes the decompressed first message to obtain the first message.

[0169] The wearable device drives at least one interactive device to display the first message based on the first message.

[0170] After receiving the first data packet, the third application of the wearable device decompresses the received first data packet to obtain the decompressed first message, and then decodes the decompressed first message to obtain the first message.

[0171] The first data message is used for interaction between the wearable device and its user. For example, the first data message can be encoded text, images, video, or audio messages displayed or played on the wearable device. After the wearable device acquires and decodes the first data message, it can rearrange the text within the message and display it based on an interactive device within the device. The interactive device is a device within the wearable device used to display message content, and the wearable device can include various interactive devices. These interactive devices can drive the speaker module to play audio messages from the first data message, drive the display module to display augmented reality scenes from text messages in the first data message, and simultaneously drive both the display module and the speaker module to play video messages from the first data message. After viewing the content decoded from the first data message, the user of the wearable device can perform interactive operations such as replying or deleting.

[0172] The message transmission method provided in this application involves decompressing a first data packet using a third application on a wearable device to obtain a decompressed first message, and then decoding the decompressed first message to obtain the first message itself. The encoding and compression methods used during the transmission of the first message ensure efficient transmission.

[0173] Based on the above embodiments, step 810 includes:

[0174] The second message includes the application identifier of the first application, which is used to indicate the application that responded to the second message.

[0175] For a second message obtained from a third application, the application identifier of the first application can be added to the second message. The application identifier is the application identifier of the second application, used to indicate that the second message should be sent to the first application. That is, based on the application identifier, it can be determined that the second message will be routed to the first application.

[0176] The message flow method provided in this application embodiment determines the message interaction object by identifying that the second message includes the application identifier of the first application, which facilitates the message interaction process between the terminal and the wearable device.

[0177] Based on the above embodiments, step 810 includes:

[0178] The first message includes one or more of the following: text message, audio message, image message, and video message.

[0179] The first message type can be one or more of the following: text message, audio message, image message, and video message.

[0180] Optionally, after obtaining the first message and determining its data type, the third application of the wearable device sends the audio message in the first message to the headphone player of the wearable device for output; after formatting the text message in the first message that needs to be displayed according to the screen size of the wearable device, it outputs it to the display of the wearable device; and outputs the video message in the first message to the display of the wearable device for playback.

[0181] The message flow method provided in this application embodiment, by determining that the type of the first message is one or more of text messages, audio messages, image messages, and video messages, realizes the interaction process of multiple types of messages and improves the flexibility of interaction between the terminal and the smart wearable device.

[0182] Based on the above embodiments, step 810 includes:

[0183] The second message includes one or more of the following: text message, audio message, image message, and video message.

[0184] The second message type can be one or more of the following: text message, audio message, image message, and video message.

[0185] The third application of wearable devices can obtain second messages based on the virtual buttons, touchpads, microphones and other input devices of the wearable devices, so that the third application can obtain the second messages.

[0186] The message flow method provided in this application embodiment, by determining that the type of the second message is one or more of text messages, audio messages, image messages, and video messages, realizes the interaction process of multiple types of messages and improves the flexibility of interaction between the terminal and the smart wearable device.

[0187] The following is a flowchart illustrating a message flow method provided in an embodiment of this application. Figure 10 For example, the technical solution provided in the embodiments of this application is illustrated below:

[0188] Step 1010: When an interactive message arrives at the first application, the first application forwards the interactive message to the second application through the message flow SDK;

[0189] Step 1020: When the second application receives the interaction message forwarded by the first application, it encodes and compresses the interaction message accordingly, and then sends the data packet to the third application on the wearable device.

[0190] Step 1030: When the third application on the wearable device receives a new data packet, it decompresses the data packet, reformatts the text message according to the message content, and sends it to the display of the wearable device for display; for voice messages, it sends the audio to the headphones of the wearable device for playback.

[0191] Step 1040: When a user needs to reply to a message, they input the content of the reply message through interactive methods such as the touchpad / microphone / virtual buttons of the wearable device, and then send the reply message on the wearable device. The reply message will be compressed and encoded by the third application on the wearable device, and after adding the application name of the reply and the corresponding recipient information, it will be sent back to the second application on the terminal.

[0192] Step 1050: The second application on the terminal receives the reply message, first decodes and restores the content of the reply message, and then injects the reply message content into the first application according to the application name corresponding to the reply message.

[0193] Step 1060: The first application obtains the injected reply message content, recipient and other information through the message flow SDK, and replies to the corresponding replyer / group to complete the entire message receiving, browsing and reply process;

[0194] Step 1070: Users can also send messages proactively through wearable devices. They only need to specify the message type and recipient information to send the message to the corresponding first application on the terminal, which will then send the message to the corresponding recipient.

[0195] This application embodiment also provides a terminal, the terminal including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the message transfer methods provided in the above-described method embodiments, for example including:

[0196] The terminal's first application receives the first message;

[0197] The first message is sent to the second application of the terminal for processing to obtain the first data packet;

[0198] The terminal sends the first data packet to a third application of the wearable device, causing the wearable device to drive at least one interactive device to display the first message based on the first data packet.

[0199] On the other hand, this application also provides a wearable device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the message flow method provided in the above-described method embodiments, for example including:

[0200] The third application of the wearable device receives a first data packet sent by the terminal. The first data packet is obtained by the terminal's first application receiving a first message and the first message being sent to the terminal's second application for processing.

[0201] The wearable device drives at least one interactive device to display the first message based on the first data packet.

[0202] In another aspect, embodiments of this application also provide a non-transitory computer-readable storage medium storing a computer program thereon. When executed by a processor, the computer program implements the message flow methods provided in the above-described method embodiments, including, for example:

[0203] The terminal's first application receives the first message;

[0204] The first message is sent to the second application of the terminal for processing to obtain the first data packet;

[0205] The terminal sends the first data packet to a third application of the wearable device, causing the wearable device to drive at least one interactive device to display the first message based on the first data packet.

[0206] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0207] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0208] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A message flow method, characterized in that, The method includes: The terminal's first application receives the first message; The first message is sent to the second application of the terminal for processing to obtain the first data packet; The terminal, based on the terminal message flow control module of the second application, sends the first data packet to the third application of the wearable device through the message flow data channel, so that the wearable device drives at least one interactive device to display the first message based on the first data packet; the message flow data channel is constructed by the terminal message flow control module through handshake negotiation with the third application of the wearable device based on a private protocol. Also includes: The second application of the terminal receives a second data packet returned by the third application of the wearable device, wherein the second data packet is obtained by the third application of the wearable device processing a second message, and the second message is a reply message from the wearable device; The second application of the terminal processes the second data packet to obtain the second message; The second message is sent to the first application of the terminal; The first message is sent to a second application on the terminal for processing to obtain a first data packet, including: The second application of the terminal encodes the first message to obtain the encoded first message, and compresses the encoded first message to obtain the first data packet.

2. The message flow method according to claim 1, characterized in that, The second application of the terminal processes the second data packet to obtain the second message, including: The second application of the terminal decompresses the second data packet to obtain a decompressed second message, and decodes the decompressed second message to obtain the second message.

3. The message flow method according to claim 1 or 2, characterized in that, The first message includes one or more of the following: text message, audio message, image message, and video message.

4. The message flow method according to claim 2, characterized in that, The second message includes one or more of the following: text message, audio message, image message, and video message.

5. The message flow method according to claim 1 or 2, characterized in that, The first message also includes an application identifier of the first application, which is used to indicate the source application of the first message.

6. A message flow method, characterized in that, The method includes: The wearable device message flow control module in the third application of the wearable device receives a first data packet sent by the terminal based on the message flow data channel. The first data packet is obtained by the terminal's first application receiving the first message and then sending the first message to the terminal's second application for processing. The message flow data channel is constructed by the terminal message flow control module of the second application through a handshake negotiation with the third application of the wearable device based on a private protocol. The wearable device drives at least one interactive device to display the first message based on the first data packet; Also includes: The third application of the wearable device receives a second message, which is a response message from the wearable device. The third application of the wearable device processes the second message to obtain the second data packet; The third application of the wearable device sends the second data packet to the second application of the terminal; The third application of the wearable device processes the second message to obtain a second data packet, including: The third application of the wearable device encodes the second message to obtain the encoded second message, and compresses the encoded second message to obtain the second data packet.

7. The message flow method according to claim 6, characterized in that, The wearable device drives at least one interactive device to display the first message based on the first data packet, including: The third application of the wearable device decompresses the first data packet to obtain the decompressed first message, and decodes the decompressed first message to obtain the first message. The wearable device drives at least one interactive device to display the first message based on the first message.

8. The message flow method according to claim 6, characterized in that, The second message includes the application identifier of the first application, which is used to indicate the application that responded to the second message.

9. The message flow method according to claim 6 or 7, characterized in that, The first message includes one or more of the following: text message, audio message, image message, and video message.

10. The message flow method according to claim 6, characterized in that, The second message includes one or more of the following: text message, audio message, image message, and video message.

11. A terminal, the terminal comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the message flow method as described in any one of claims 1 to 5.

12. A wearable device, the wearable device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the message flow method as described in any one of claims 6 to 10.

13. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the message flow method as described in any one of claims 1 to 5 or claims 6 to 10.

Images