Data interaction methods, systems and electronic devices

Abstract

This invention provides a data interaction method, system, and electronic device, relating to the field of smart terminal interaction. The method first acquires source data contained in a mobile phone; then, based on the type of source data, it converts the source data into thumbnails according to a preset format, and controls the mobile phone to transmit the thumbnails and corresponding source data to a watch for storage; finally, it controls the watch to transmit the received source data to a storage server for storage; when an operation command for the thumbnail is received from the mobile phone, the operation command is sent to the watch; the watch interacts with the source data corresponding to the thumbnail in the storage server according to the received operation command, and sends the interaction result of the source data to the mobile phone; this method combines a mobile phone and a watch, transferring the storage pressure of the mobile phone to the storage server through the watch, solving the problem of high storage pressure in existing mobile terminals such as mobile phones, and improving the user experience.

Description

Technical Field

[0001] This invention relates to the field of smart terminal interaction, and in particular to a data interaction method, system and electronic device. Background Technology

[0002] With the development of the internet, mobile devices such as smartphones and smartwatches have become increasingly popular. As these devices offer more and more functions and a better user experience, users have become accustomed to using them to fulfill various daily needs. Consequently, users typically install various applications, take numerous photos and videos, download many files, and send and receive a large number of emails, resulting in a significant amount of files and data being stored on their mobile devices. While the usage scenarios for this data may not be frequent, it still occupies a considerable amount of storage space, reducing storage utilization and impacting the device's operating speed.

[0003] Existing technologies alleviate storage pressure on mobile devices such as smartphones mainly through data compression and cloud backup. However, data compression can only be implemented locally on the mobile device and has low compression efficiency; while cloud backup relies too heavily on network resources, resulting in a poor user experience. Summary of the Invention

[0004] In view of this, the purpose of this invention is to provide a data interaction method, system, and electronic device. By combining a mobile phone with network connectivity and a watch, the storage pressure of the mobile phone is transferred to the storage server through the watch, which solves the problem of high storage pressure in mobile terminals such as mobile phones in the prior art and improves the user experience.

[0005] In a first aspect, embodiments of the present invention provide a data interaction method, which is applied to multimedia data interaction of a mobile terminal device; wherein the mobile terminal device includes: a mobile phone with network connectivity and a watch; the mobile phone and the watch interact with each other via a wireless local area network transmission protocol and / or a Bluetooth transmission protocol; the watch interacts with a preset storage server via a wireless local area network transmission protocol and / or a general packet radio service transmission protocol.

[0006] The method includes:

[0007] Obtain source data contained in the mobile phone; wherein, the source data includes at least: multimedia data, application data, and file data; multimedia data includes at least: image data and video data; application data includes at least: email data, contact data, and recording data; file data includes at least: folder data and sub-file data;

[0008] Based on the type of source data, the source data is converted into thumbnails in a preset format and sent to the mobile phone. The thumbnails and the corresponding source data are then transferred to the watch for storage.

[0009] The watch controls the received source data to be transmitted to the storage server for storage, and determines whether to delete the source data of the phone and watch based on the relationship between the weight value corresponding to the index data of the thumbnail of the source data and the preset weight threshold.

[0010] Once the system detects a user's interaction with a thumbnail on their phone, it sends the interaction command to the watch.

[0011] The watch controls the interaction between the received operation commands and the source data corresponding to the thumbnails in the storage server, and sends the interaction results of the source data to the mobile phone.

[0012] In some implementations, the source data is converted into thumbnails and sent to the mobile phone according to a preset format, depending on the type of source data, including:

[0013] If the source data is image data, the image data is segmented according to the preset image segmentation strategy, and the segmented image data is compressed to obtain thumbnails, which are then saved to the mobile phone.

[0014] If the source data is video data, the video data is segmented according to the preset video segmentation strategy, the feature map in the segmented video data is extracted, and the feature map is compressed to obtain a thumbnail, which is then saved to the mobile phone.

[0015] If the source data is email data, then the email subject, sending and receiving time, sender and recipient, and email body contained in the email data will be used to generate the corresponding email summary image according to the preset layout format. The email summary image will be compressed to obtain a thumbnail, and the thumbnail will be saved to the mobile phone.

[0016] If the source data is contact data, then the corresponding contact summary image is generated according to the preset layout format for the contact name, mobile phone number and remarks information contained in the contact data. The contact summary image is then compressed to obtain a thumbnail, and the thumbnail is saved to the mobile phone.

[0017] If the source data is audio recording data, then the corresponding audio recording summary image is generated according to the preset layout format for the audio recording name, recording duration and recording time contained in the audio recording data. The audio recording summary image is then compressed to obtain a thumbnail, and the thumbnail is saved to the mobile phone.

[0018] If the source data is file data, the corresponding file summary image is generated according to the preset layout format for the folder data and sub-file data in the file data, including the title, creation time and file content. The file summary image is then compressed to obtain a thumbnail, which is then saved to the mobile phone.

[0019] In some implementations, determining whether to delete source data for phones and watches is based on the relationship between the weight value corresponding to the index data of the source data's thumbnail and a preset weight threshold, including:

[0020] Obtain the index data corresponding to the thumbnails in the watch, and use the index data to determine the first weight value of the source data;

[0021] If the first weight value of the source data is greater than the preset first weight threshold, the source data will be saved to the watch; if the first weight value of the source data is not greater than the preset first weight threshold, the source data will be deleted from the watch.

[0022] In some implementations, determining whether to delete the source data for the phone and watch based on the relationship between the weight value corresponding to the index data of the thumbnail of the source data and a preset weight threshold also includes:

[0023] Obtain the index data corresponding to the thumbnails in the mobile phone, and use the index data to determine the second weight value of the source data;

[0024] If the second weight value of the source data is greater than the preset second weight threshold, the source data will be saved to the phone; if the second weight value of the source data is not greater than the preset second weight threshold, the source data will be deleted from the phone.

[0025] In some implementations, after monitoring user input on thumbnails on the phone, the input is sent to the watch, further including:

[0026] Obtain voice control commands from the phone for thumbnails; where the voice control commands are operation instructions obtained through the phone's built-in voice assistant.

[0027] The voice control commands are converted into thumbnail operation commands, which are then sent to the watch.

[0028] In some implementations, the watch controls the interaction between the received operation commands and the source data corresponding to the thumbnails in the storage server, and sends the interaction results of the source data to the mobile phone, including:

[0029] After the watch receives the operation command, it determines the source data of the thumbnail corresponding to the operation command;

[0030] Determine if the watch contains source data;

[0031] If yes, the source data will be sent directly to the phone; otherwise, the watch will retrieve the source data from the storage server and send it to the phone.

[0032] In some implementations, when the operation command is a data display command, the watch interacts with the source data corresponding to the thumbnail in the storage server according to the received operation command, and sends the interaction result of the source data to the mobile phone, including:

[0033] When the watch receives a data display command, it requests data from the storage server based on the thumbnail corresponding to the data display command.

[0034] The watch retrieves the source data corresponding to the thumbnail based on the response data from the storage server, and sends the source data to the mobile phone for display.

[0035] In some implementations, when the operation command is a data deletion command, the watch interacts with the source data corresponding to the thumbnail in the storage server according to the received operation command, and sends the interaction result of the source data to the mobile phone, including:

[0036] When the watch receives a data deletion command, it sends a deletion request to the storage server based on the thumbnail corresponding to the data deletion command.

[0037] The watch is controlled to delete the corresponding thumbnail from the storage server based on the first deletion response received; the first deletion response is the response from the storage server after successfully deleting the source data corresponding to the thumbnail.

[0038] Obtain the second deletion response from the watch and send it to the mobile phone; wherein, the second deletion response is the response after deleting the source data of the corresponding thumbnail in the watch.

[0039] Secondly, embodiments of the present invention provide a data interaction system applied to multimedia data interaction of mobile terminal devices; wherein, the mobile terminal devices include: a mobile phone with network connectivity and a watch; the mobile phone and the watch interact with each other via a wireless local area network transmission protocol and / or a Bluetooth transmission protocol; the watch interacts with a preset storage server via a wireless local area network transmission protocol and / or a general packet radio service transmission protocol.

[0040] The system includes:

[0041] The source data preprocessing module is used to obtain the source data contained in the mobile phone; wherein, the source data includes at least: multimedia data, application data and file data; multimedia data includes at least: image data and video data; application data includes at least: email data, contact data and recording data; file data includes at least: folder data and sub-file data;

[0042] The thumbnail generation module is used to convert source data into thumbnails according to the type of source data and a preset format, and then transfer the thumbnails and the corresponding source data to the watch for storage.

[0043] The first interaction module is used to control the watch to transmit the received source data to the storage server for storage, and to determine whether to delete the source data of the phone and watch by the relationship between the weight value corresponding to the index data of the thumbnail of the source data and the preset weight threshold.

[0044] The second interaction module is used to send the operation command to the watch after monitoring the user's operation command on the thumbnail in the mobile phone;

[0045] The third interaction module is used to control the watch to interact with the source data corresponding to the thumbnails in the storage server according to the received operation instructions, and to send the interaction results of the source data to the mobile phone.

[0046] Thirdly, embodiments of the present invention also provide an electronic device, which includes: a processor and a memory; the memory stores a computer program, which, when run by the processor, implements the steps of the data interaction method mentioned in the first aspect above.

[0047] Fourthly, embodiments of the present invention also provide a computer-readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the steps of the data interaction method mentioned in the first aspect above.

[0048] The embodiments of the present invention bring the following beneficial effects:

[0049] This invention provides a data interaction method, system, and electronic device applied to multimedia data interaction in mobile terminal devices; wherein, the mobile terminal device includes: a mobile phone with network connectivity and a watch; the mobile phone and the watch interact with each other via a wireless local area network (WLAN) protocol and / or a Bluetooth protocol; the watch interacts with a preset storage server via a WLAN protocol and / or a General Packet Radio Service (GPRS) protocol. During the data interaction process of the aforementioned mobile terminal devices, the system first acquires the source data contained in the phone. This source data includes at least: multimedia data, application data, and file data. Multimedia data includes at least: image data and video data; application data includes at least: email data, contact data, and recording data; and file data includes at least: folder data and sub-file data. Then, based on the type of source data, it converts the source data into thumbnails according to a preset format and sends them to the phone. The thumbnails and their corresponding source data are then transferred to the watch for storage. Subsequently, the watch transmits the received source data to a storage server for storage, and determines whether to delete the source data on the phone and watch based on the relationship between the weight value corresponding to the index data of the source data thumbnails and a preset weight threshold. When the system detects a user's operation command on the thumbnails on the phone, it sends the command to the watch. Finally, the watch interacts with the source data corresponding to the thumbnails in the storage server based on the received operation command and sends the interaction result back to the phone. This data interaction method combines a mobile phone with internet connectivity and a smartwatch, transferring the storage burden from the phone to a storage server via the smartwatch. This solves the problem of high storage pressure on mobile terminals such as mobile phones in existing technologies and improves the user experience.

[0050] Other features and advantages of the invention will be set forth in the following description, or some features and advantages may be inferred from the description or determined without doubt, or may be learned by practicing the techniques described above.

[0051] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0052] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0053] Figure 1 A flowchart of a data interaction method provided in an embodiment of the present invention;

[0054] Figure 2 In a data interaction method provided by an embodiment of the present invention, a flowchart is provided for converting source data into thumbnails on a mobile phone according to a preset format based on the type of source data.

[0055] Figure 3 This is a flowchart illustrating a data interaction method provided in an embodiment of the present invention, which uses the relationship between the weight value corresponding to the index data of the thumbnail of the source data and a preset weight threshold to determine whether to delete the source data of the mobile phone and watch.

[0056] Figure 4 This is a flowchart illustrating how to determine whether to delete source data from a mobile phone and a watch based on the relationship between the weight value corresponding to the index data of the thumbnail of the source data and a preset weight threshold in another data interaction method provided in this embodiment of the invention.

[0057] Figure 5 A flowchart of a data interaction method provided in an embodiment of the present invention, which sends the operation command to the watch after monitoring the user's operation command on the thumbnail in the mobile phone;

[0058] Figure 6 In a data interaction method provided by an embodiment of the present invention, the control watch interacts with the source data corresponding to the thumbnail in the storage server according to the received operation instructions, and sends the interaction result of the source data to the mobile phone. (Flowchart of step S105)

[0059] Figure 7 A flowchart of step S105 in a data interaction method provided in an embodiment of the present invention, when the operation instruction is a data display instruction;

[0060] Figure 8 A flowchart of step S105 in a data interaction method provided in an embodiment of the present invention, when the operation instruction is a data deletion instruction;

[0061] Figure 9 This is a schematic diagram of the structure of a data interaction system provided in an embodiment of the present invention;

[0062] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention.

[0063] icon:

[0064] 910 - Source data preprocessing module; 920 - Thumbnail generation module; 930 - First interaction module; 940 - Second interaction module; 950 - Third interaction module;

[0065] 101 - Processor; 102 - Memory; 103 - Bus; 104 - Communication interface. Detailed Implementation

[0066] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0067] With the development of the internet, mobile devices such as smartphones and smartwatches have become increasingly popular. As these devices offer more and more functions and a better user experience, users have become accustomed to using them to fulfill various daily needs. Consequently, users typically install various applications, take numerous photos and videos, download many files, and send and receive a large number of emails, resulting in a significant amount of files and data being stored on their mobile devices. While the usage scenarios for this data may not be frequent, it still occupies a considerable amount of storage space, reducing storage utilization and impacting the device's operating speed.

[0068] Existing technologies alleviate storage pressure on mobile terminals such as smartphones primarily through data compression and cloud backup. However, data compression can only be implemented locally on the mobile terminal and has low efficiency; while cloud backup relies heavily on network resources, resulting in a poor user experience. Therefore, this invention provides a data interaction method, system, and electronic device. By combining a network-enabled smartphone and a smartwatch, it transfers the storage pressure from the smartphone to a storage server via the smartwatch, solving the problem of high storage pressure on mobile terminals such as smartphones in existing technologies and improving the user experience.

[0069] To facilitate understanding of this embodiment, a data interaction method disclosed in this invention will first be described in detail. This method is applied to multimedia data interaction in mobile terminal devices. The mobile terminal devices include: a mobile phone with network connectivity and a watch; the mobile phone and watch interact via a wireless local area network (WLAN) transmission protocol and / or a Bluetooth transmission protocol; the watch interacts with a preset storage server via a WLAN transmission protocol and / or a General Packet Radio Service (GPRS) transmission protocol. Specifically, the data interaction method is as follows: Figure 1 As shown, it includes:

[0070] Step S101: Obtain the source data contained in the mobile phone.

[0071] The source data on a mobile phone consists of its raw data, primarily including multimedia data, application data, and file data. Multimedia data includes at least image and video data; application data includes at least email, contact, and audio recordings; and file data includes at least folder data and subfolders. The large amount of source data stored on the phone reduces its storage space and impacts its operating speed.

[0072] Source data can be obtained by scanning files on the phone using relevant tools, or by calling data statistics interfaces related to the source data.

[0073] Step S102: Based on the type of source data, convert the source data into thumbnails in a preset format and transfer them to the mobile phone. Then, transfer the thumbnails and the corresponding source data to the watch for storage.

[0074] Because the source data is large in volume and diverse in categories, it is converted into thumbnails based on the type of source data and in conjunction with appropriate image processing algorithms. Generally, for image data, thumbnails can be obtained using relevant image scaling algorithms; for video data, thumbnails are obtained by scaling a frame of the video data using relevant image scaling algorithms. Specifically, if the source data is image data, the image data is segmented according to a preset image segmentation strategy, and the segmented image data is compressed to obtain the thumbnail; if the source data is video data, the video data is segmented according to a preset video segmentation strategy, feature maps are extracted from the segmented video data, and the feature maps are compressed to obtain the thumbnail.

[0075] For source data that is not multimedia data, you can obtain its corresponding source data name, time, content, etc., fill it into a table or text that corresponds to its type, and then perform relevant image conversion on the filled table or text to generate its corresponding thumbnail.

[0076] Step S103: Control the watch to transmit the received source data to the storage server for saving, and determine whether to delete the source data of the phone and watch by the relationship between the weight value corresponding to the index data of the thumbnail of the source data and the preset weight threshold.

[0077] Once the source data thumbnails are determined, the source data and their thumbnails are transmitted to the watch. Upon receiving the source data, the watch first transmits it to a storage server to complete a network backup of the source data on the phone. After the backup is complete, the watch determines whether the source data needs to be deleted based on the relationship between the weight value corresponding to the index data of the source data thumbnail and a preset weight threshold, thereby freeing up storage space. It's worth noting that the phone still stores the converted thumbnails of the source data at this point, which will be required for subsequent data interactions.

[0078] Step S104: After monitoring the user's operation command on the thumbnail on the mobile phone, the operation command is sent to the watch.

[0079] During user interaction with the phone, the user interacts with thumbnails, and the source data has already been backed up to the storage server. Therefore, upon receiving the relevant operation command for the thumbnail from the phone, the phone sends the operation command to the watch, and the watch provides feedback on the operation command through the interaction between the watch and the storage server.

[0080] Step S105: Control the watch to interact with the source data corresponding to the thumbnail in the storage server according to the received operation command, and send the interaction result of the source data to the mobile phone.

[0081] After receiving the operation command, the watch uses it to interact with the storage server, obtains the interaction result of the relevant source data, and then feeds this result back to the mobile phone. This achieves interaction between the mobile phone and the storage server, using thumbnails from the phone. Since the source data on the mobile phone is replaced by thumbnails, the storage pressure on the mobile phone is greatly reduced.

[0082] In some implementations, the source data is converted into thumbnails and sent to the mobile phone according to a preset format, depending on the type of source data. Figure 2 As shown, it includes:

[0083] Step S201: If the source data is image data, the image data is segmented according to a preset image segmentation strategy, and the segmented image data is compressed to obtain a thumbnail, which is then saved to the mobile phone.

[0084] Specifically, the image data mainly consists of photos taken with a mobile phone. Due to the increased pixel count of mobile phones, these photos occupy a significant amount of storage space. Therefore, the image data is compressed using relevant image compression algorithms, and the resulting thumbnails are saved on the phone. The file size of the image data is significantly reduced before and after compression.

[0085] Step S202: If the source data is video data, the video data is segmented according to a preset video segmentation strategy, the feature map in the segmented video data is extracted, and the feature map is compressed to obtain a thumbnail, which is then saved to the mobile phone.

[0086] With the widespread adoption of high-definition and ultra-high-definition video recording, videos recorded on mobile phones also consume a significant amount of storage space. Therefore, video data can be segmented according to a preset video segmentation strategy. Feature maps are then extracted from the segmented video data, and these feature maps are compressed to obtain thumbnails. These compressed thumbnails are then saved on the mobile phone. Using these compressed thumbnails to represent the video data significantly reduces the storage space required for the video data.

[0087] Step S203: If the source data is email data, generate a corresponding email summary image for the email subject, sending and receiving time, sender and recipient, and email body contained in the email data according to the preset layout format, compress the email summary image to obtain a thumbnail, and save the thumbnail to the mobile phone.

[0088] Step S204: If the source data is contact data, generate a corresponding contact summary image for the contact name, mobile phone number and remarks contained in the contact data according to the preset layout format, compress the contact summary image to obtain a thumbnail, and save the thumbnail to the mobile phone.

[0089] Step S205: If the source data is audio recording data, then the corresponding audio recording summary image is generated according to the preset layout format for the audio recording name, audio recording duration and audio recording time contained in the audio recording data, and the audio recording summary image is compressed to obtain a thumbnail, and the thumbnail is saved to the mobile phone.

[0090] Email data, contact list data, and audio recording data can be collectively referred to as application data. For this application data, we can obtain its corresponding source data name, time, content, etc., fill it into tables or text corresponding to its type, and then perform relevant image conversion on the filled tables or text to generate its corresponding thumbnail. Specifically, if the application data is email data, the email subject, send / receive time, sender / recipient, and email body can be formatted and filled according to a preset format to obtain the corresponding document file, which can then be converted into a corresponding image. Because these images are text images, their size is small, thus optimizing the space occupied by email data.

[0091] For contact list data, recording data, and other application data, the above method is used to extract the application data using the relevant formats and generate corresponding thumbnails, which will not be elaborated here.

[0092] Step S206: If the source data is file data, generate a corresponding file summary image for the folder data and sub-file data in the file data according to the preset layout format, and compress the file summary image to obtain a thumbnail, and save the thumbnail to the mobile phone.

[0093] When the source data is file data, the title and creation time contained in the corresponding file data can be filled with text according to a preset format to obtain the corresponding document file. Then, the document file can be converted into a corresponding image to represent the file data. Taking a folder as an example, a folder may contain multiple levels of subfolders, and each folder contains corresponding files. When the amount of file data is large, it can lead to a large storage space being occupied by the file data. However, by using it to generate thumbnails to manage the file data, the storage space occupied can be greatly reduced.

[0094] During data interaction, frequently used source data generated recently is temporarily saved as key data. Since this key data involves high user interaction frequency, it can be stored on the phone or watch to reduce data transfer during the interaction process. In some implementations, the relationship between the weight value corresponding to the index data of the source data thumbnail and a preset weight threshold determines whether to delete the source data on the phone or watch. Figure 3 As shown, the method also includes:

[0095] Step S301: Obtain the index data corresponding to the thumbnail in the watch, and use the index data to determine the first weight value of the source data.

[0096] It's worth noting that the first weight value primarily measures whether the source data in the watch is frequently used by the user. Specifically, for image data, the first weight value indicates whether the photo was taken recently by the user or is a photo the user frequently views.

[0097] Step S302: If the first weight value of the source data is greater than the preset first weight threshold, the source data is saved to the watch; if the first weight value of the source data is not greater than the preset first weight threshold, the source data is deleted from the watch.

[0098] If the first weight value of the source data is greater than the preset first weight threshold, it indicates that the source data is frequently used by the user, and therefore it is stored in the watch for easy interaction with the phone. If the first weight value of the source data is not greater than the preset first weight threshold, it indicates that the source data is not frequently used by the user, and therefore it can be deleted from the watch.

[0099] The above process primarily optimizes the interaction process of source data in the watch. In real-world scenarios, source data in the phone will also be optimized using the same approach. In some implementations, the relationship between the weight value corresponding to the index data of the source data thumbnail and a preset weight threshold is used to determine whether to delete source data from both the phone and the watch. Figure 4 As shown, it also includes:

[0100] Step S401: Obtain the index data corresponding to the thumbnail in the mobile phone, and use the index data to determine the second weight value of the source data.

[0101] The second weighting value primarily measures whether the source data on the phone is frequently used by the user. In some scenarios, the second weighting value is the same as the first weighting value. Specifically, for image data, the second weighting value is also used to indicate whether the photo was taken recently by the user or is a photo the user frequently views.

[0102] Step S402: If the second weight value of the source data is greater than the preset second weight threshold, the source data is saved to the mobile phone; if the second weight value of the source data is not greater than the preset second weight threshold, the source data is deleted from the mobile phone.

[0103] If the second weight value of the source data is greater than the preset second weight threshold, it indicates that the source data is frequently used by the user, and therefore it should be saved on the phone for easy interaction with the watch or the user. Conversely, if the second weight value of the source data is not significantly different from the preset second weight threshold, it indicates that the source data is not frequently used by the user, and therefore it can be deleted from the phone.

[0104] Operation commands can be obtained not only through user touch but also through user voice. In some implementations, after monitoring user commands to operate on thumbnails on the phone, the commands are sent to the watch, such as... Figure 5 The above also includes:

[0105] Step S501: Obtain the voice control command of the mobile phone for the thumbnail; wherein, the voice control command is the operation command obtained through the built-in voice assistant of the mobile phone.

[0106] Step S502: Convert the voice control command into a thumbnail operation command and send the operation command to the watch.

[0107] Voice control commands are determined by the phone's built-in voice assistant. The voice assistant receives the user's commands and generates corresponding operation instructions based on those commands.

[0108] In the process of controlling the watch to interact with the mobile phone using operation commands, it is necessary to perform necessary statistical analysis on the source data contained in the watch to improve the efficiency of the interaction. Specifically, in some implementations, the watch interacts with the source data corresponding to the thumbnail in the storage server according to the received operation commands, and sends the interaction result of the source data to the mobile phone in step S105, such as... Figure 6 As shown, it includes:

[0109] Step S601: After the watch receives the operation command, the source data of the thumbnail corresponding to the operation command is determined.

[0110] Step S602: Determine whether the watch contains source data;

[0111] In step S603, if yes, the source data is sent directly to the mobile phone; if no, the watch is controlled to retrieve the source data from the storage server and send the source data to the mobile phone.

[0112] Once the watch receives an operation command, it can determine the corresponding source data based on the command and then check if the source data is stored in the watch. If it is, the source data can be sent directly to the mobile phone, thus avoiding data interaction with the storage server and improving the efficiency of data interaction.

[0113] In some implementations, when the operation command is a data display command, the watch controls the interaction between the received operation command and the source data corresponding to the thumbnail in the storage server, and sends the interaction result of the source data to the mobile phone in step S105, such as... Figure 7 As shown, it includes:

[0114] Step S701: When the watch receives a data display instruction, it requests data from the storage server based on the thumbnail corresponding to the data display instruction.

[0115] Data display commands primarily concern the process of displaying source data. For example, when a user taps a thumbnail of a captured image on their phone, a data display command for that thumbnail is generated. The ultimate effect of this command is to retrieve and display the source data corresponding to the thumbnail from the watch on the user's phone. Therefore, the phone sends this display command to the watch. Upon receiving the command, the watch requests data from the storage server based on the thumbnail in the command, interacting with the storage server to obtain the source data corresponding to the thumbnail.

[0116] Step S702: Control the watch to obtain the source data corresponding to the thumbnail based on the response data of the storage server, and send the source data to the mobile phone for display.

[0117] After the watch retrieves the source data corresponding to the thumbnail—the original captured image—from the storage server, it sends it to the mobile phone for display. On the mobile phone, the user can view the original image by touching the thumbnail. This process utilizes the interaction between the watch and the storage server, as well as the interaction between the phone and the watch. While this interaction is largely imperceptible to the user, it reduces the image storage burden on the mobile phone.

[0118] The above process involves interactions related to displaying source data. In real-world scenarios, this also includes interactions related to deleting source data. In some implementations, when the operation command is a data deletion command, the watch controls the interaction between the received operation command and the source data corresponding to the thumbnail in the storage server, and sends the interaction result of the source data to the mobile phone in step S105, such as... Figure 8 As shown, it includes:

[0119] Step S801: When the watch receives a data deletion command, it sends a deletion request to the storage server based on the thumbnail corresponding to the data deletion command.

[0120] The data deletion command primarily targets the deletion of source data. Although the phone currently only contains thumbnails and a few pieces of source data, the data deletion process requires deleting the corresponding source data from both the watch and the storage server. Therefore, after receiving the data deletion command from the phone, the watch needs to forward this command to the storage server to delete the corresponding source data.

[0121] Step S802: Control the watch to delete the corresponding thumbnail in the watch according to the first deletion response received from the storage server; wherein, the first deletion response is the response from the storage server after successfully deleting the source data corresponding to the thumbnail.

[0122] After the storage server deletes the source data, it generates a first deletion response, indicating that the storage server has completed the deletion. Therefore, after the watch receives the first deletion response, it also needs to delete the corresponding zoomed-in image in the watch, thus realizing the data deletion process on both the watch and the storage server.

[0123] Step S803: Obtain the second deletion response from the watch and send the second deletion response to the mobile phone; wherein, the second deletion response is the response after deleting the source data of the corresponding thumbnail in the watch.

[0124] After completing the deletion, the watch can send a second deletion response to the phone to inform the phone that the deletion process is complete. As can be seen from the data interaction method in the above embodiments, this method combines a network-enabled phone and a watch to transfer the storage pressure on the phone to a storage server via the watch, solving the problem of high storage pressure on mobile terminals such as phones in existing technologies and improving the user experience.

[0125] Corresponding to the above-described data interaction method embodiments, this invention provides a data interaction system applied to multimedia data interaction of mobile terminal devices; wherein, the mobile terminal devices include: a mobile phone with network connectivity and a watch; the mobile phone and the watch interact with each other via a wireless local area network transmission protocol and / or a Bluetooth transmission protocol; the watch interacts with a preset storage server via a wireless local area network transmission protocol and / or a general packet radio service transmission protocol.

[0126] like Figure 9 As shown, the data interaction system includes:

[0127] The source data preprocessing module 910 is used to obtain the source data contained in the mobile phone; wherein, the source data includes at least: multimedia data, application data and file data; the multimedia data includes at least: image data and video data; the application data includes at least: email data, contact data and recording data; the file data includes at least: folder data and sub-file data;

[0128] The thumbnail generation module 920 is used to convert source data into thumbnails according to the type of source data and a preset format, and then transfer the thumbnails and the corresponding source data to the watch for storage.

[0129] The first interaction module 930 is used to control the watch to transmit the received source data to the storage server for storage, and to determine whether to delete the source data of the phone and watch by the relationship between the weight value corresponding to the index data of the thumbnail of the source data and the preset weight threshold.

[0130] The second interaction module 940 is used to send the operation command to the watch after monitoring the user's operation command on the thumbnail in the mobile phone;

[0131] The third interaction module 950 is used to control the watch to interact with the source data corresponding to the thumbnail in the storage server according to the received operation instructions, and to send the interaction results of the source data to the mobile phone.

[0132] In some implementations, when the thumbnail generation module 920 converts the source data into thumbnails in a preset format according to the type of source data and sends them to the mobile phone, it is also used for:

[0133] If the source data is image data, the image data is segmented according to the preset image segmentation strategy, and the segmented image data is compressed to obtain thumbnails, which are then saved to the mobile phone.

[0134] If the source data is video data, the video data is segmented according to the preset video segmentation strategy, the feature map in the segmented video data is extracted, and the feature map is compressed to obtain a thumbnail, which is then saved to the mobile phone.

[0135] If the source data is email data, then the email subject, sending and receiving time, sender and recipient, and email body contained in the email data will be used to generate the corresponding email summary image according to the preset layout format. The email summary image will be compressed to obtain a thumbnail, and the thumbnail will be saved to the mobile phone.

[0136] If the source data is contact data, then the corresponding contact summary image is generated according to the preset layout format for the contact name, mobile phone number and remarks information contained in the contact data. The contact summary image is then compressed to obtain a thumbnail, and the thumbnail is saved to the mobile phone.

[0137] If the source data is audio recording data, then the corresponding audio recording summary image is generated according to the preset layout format for the audio recording name, recording duration and recording time contained in the audio recording data. The audio recording summary image is then compressed to obtain a thumbnail, and the thumbnail is saved to the mobile phone.

[0138] If the source data is file data, the corresponding file summary image is generated according to the preset layout format for the folder data and sub-file data in the file data, including the title, creation time and file content. The file summary image is then compressed to obtain a thumbnail, which is then saved to the mobile phone.

[0139] In some implementations, when the first interaction module 930 determines whether to delete the source data of the phone and watch by comparing the weight value corresponding to the index data of the thumbnail of the source data with a preset weight threshold, it is also used to: obtain the index data corresponding to the thumbnail in the watch, and use the index data to determine the first weight value of the source data; if the first weight value of the source data is greater than the preset first weight threshold, then save the source data to the watch; if the first weight value of the source data is not greater than the preset first weight threshold, then delete the source data from the watch.

[0140] In some implementations, when the first interaction module 930 determines whether to delete the source data of the phone and watch by comparing the weight value corresponding to the index data of the thumbnail of the source data with a preset weight threshold, it is also used to: obtain the index data corresponding to the thumbnail in the phone and use the index data to determine the second weight value of the source data; if the second weight value of the source data is greater than the preset second weight threshold, then save the source data to the phone; if the second weight value of the source data is not greater than the preset second weight threshold, then delete the source data from the phone.

[0141] In some implementations, the second interaction module 940 is further configured to: obtain voice control commands from the mobile phone for the thumbnail; wherein the voice control commands are operation commands obtained through the voice assistant built into the mobile phone; convert the voice control commands into operation commands for the thumbnail, and send the operation commands to the watch.

[0142] In some implementations, the third interaction module 950 is further configured to: after the watch receives an operation command, determine the source data of the thumbnail corresponding to the operation command; determine whether the watch stores the source data; if so, send the source data directly to the mobile phone; if not, control the watch to obtain the source data from the storage server and send the source data to the mobile phone.

[0143] In some implementations, when the operation instruction is a data display instruction, the third interaction module 950 is further configured to: when the watch receives the data display instruction, request data from the storage server according to the thumbnail corresponding to the data display instruction; control the watch to obtain the source data corresponding to the thumbnail according to the response data of the storage server, and send the source data to the mobile phone for data display.

[0144] In some implementations, when the operation instruction is a data deletion instruction, the third interaction module 950 is further configured to: when the watch receives the data deletion instruction, send a deletion request to the storage server according to the thumbnail corresponding to the data deletion instruction; control the watch to delete the corresponding thumbnail in the watch according to the first deletion response received from the storage server; wherein, the first deletion response is the response of the storage server after successfully deleting the source data corresponding to the thumbnail; obtain the second deletion response of the watch and send the second deletion response to the mobile phone; wherein, the second deletion response is the response after deleting the source data of the corresponding thumbnail in the watch.

[0145] As can be seen from the data interaction system in the above embodiments, the system combines a mobile phone with network-enabled smartwatches to transfer the storage pressure of the mobile phone to the storage server through the smartwatch, thus solving the problem of high storage pressure in mobile terminals such as mobile phones in the prior art and improving the user experience.

[0146] The data interaction system provided in this embodiment of the invention has the same technical features as the data interaction method provided in the above embodiments, and therefore can solve the same technical problems and achieve the same technical effects. For the sake of brevity, any parts not mentioned in the embodiments can be referred to the corresponding content in the foregoing embodiments.

[0147] This embodiment also provides an electronic device, as shown in the structural schematic diagram below. Figure 10 As shown, the device includes a processor 101 and a memory 102; wherein the memory 102 is used to store one or more computer instructions, which are executed by the processor to implement the steps of the above-described data interaction method.

[0148] Figure 10 The electronic device shown also includes a bus 103 and a communication interface 104, with the processor 101, communication interface 104 and memory 102 connected via the bus 103.

[0149] The memory 102 may include high-speed random access memory (RAM), and may also include non-volatile memory, such as at least one disk storage device. The bus 103 may be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 10 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0150] The communication interface 104 is used to connect to at least one user terminal and other network units through a network interface, and to send encapsulated IPv4 packets or IPv4 packets to the user terminal through the network interface.

[0151] Processor 101 may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of processor 101 or by instructions in software form. The processor 101 can be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this disclosure. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this disclosure can be directly manifested as execution by a hardware decoding processor, or execution by a combination of hardware and software modules in the decoding processor. The software module can reside in a mature storage medium in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory 102. The processor 101 reads the information in memory 102 and, in conjunction with its hardware, completes the steps of the method described in the foregoing embodiments.

[0152] This invention also provides a computer-readable storage medium storing a computer program that, when executed by a processor, performs the steps of the methods described in the foregoing embodiments.

[0153] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Additionally, the coupling or direct coupling or communication connection shown or discussed may be through some communication interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0154] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0155] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0156] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0157] Finally, it should be noted that the above-described embodiments are merely specific implementations of the present invention, used to illustrate the technical solutions of the present invention, and not to limit it. The scope of protection of the present invention is not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments within the technical scope disclosed in the present invention, or make equivalent substitutions for some of the technical features; and these modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A data interaction method, characterized in that, The method is applied to multimedia data interaction of a mobile terminal device; wherein, the mobile terminal device comprises a mobile phone and a watch with networking function; the mobile phone and the watch perform data interaction through a wireless local area network transmission protocol and / or a Bluetooth transmission protocol; the watch and a preset storage server perform data interaction through a wireless local area network transmission protocol and / or a general packet radio service transmission protocol; The method comprises: acquiring source data contained in the mobile phone; wherein, the source data at least comprises multimedia data, application data and file data; the multimedia data at least comprises picture data and video data; the application data at least comprises email data, address book data and recording data; the file data at least comprises folder data and sub-file data; according to the type of the source data, converting the source data into a thumbnail in the mobile phone in a preset format, and transmitting the thumbnail and the corresponding source data to the watch for saving; controlling the watch to transmit the received source data to the storage server for saving, and judging whether to delete the source data in the mobile phone and the watch according to the relationship between the weight value corresponding to the index data of the thumbnail of the source data and the preset weight threshold; after monitoring the operation instruction of the user to the thumbnail in the mobile phone, sending the operation instruction to the watch; controlling the watch to interact with the source data corresponding to the thumbnail in the storage server according to the received operation instruction, and sending the interaction result of the source data to the mobile phone.

2. The data interaction method of claim 1, wherein, According to the type of the source data, converting the source data into a thumbnail in the mobile phone in a preset format, comprising: if the source data is the picture data, segmenting the picture data according to a preset image segmentation strategy, and obtaining the thumbnail by image compression of the segmented picture data, and saving the thumbnail to the mobile phone; if the source data is the video data, segmenting the video data according to a preset video segmentation strategy, extracting a feature map in the segmented video data, and obtaining the thumbnail by image compression of the feature map, and saving the thumbnail to the mobile phone; if the source data is the email data, generating a corresponding email summary image according to a preset layout format for the email subject, sending and receiving time, sender and receiver, and email body contained in the email data, and obtaining the thumbnail by image compression of the email summary image, and saving the thumbnail to the mobile phone; if the source data is the address book data, generating a corresponding address book summary image according to a preset layout format for the address book name, mobile phone number and note information contained in the address book data, and obtaining the thumbnail by image compression of the address book summary image, and saving the thumbnail to the mobile phone; If the source data is audio data, a recording name, a recording duration and a recording time contained in the audio data are generated into a corresponding audio summary image according to a preset layout format, the audio summary image is compressed to obtain the thumbnail image, and the thumbnail image is saved in the mobile phone. If the source data is file data, a title, a creation time and file content contained in the folder data and the sub-file data in the file data are generated into a corresponding file summary image according to a preset layout format, the file summary image is compressed to obtain the thumbnail image, and the thumbnail image is saved in the mobile phone.

3. The data interaction method of claim 1, wherein, Whether to delete the source data in the mobile phone and the watch is determined according to a relationship between a weight value corresponding to index data of the thumbnail image of the source data and a preset weight threshold, and the method comprises the following steps: The index data corresponding to the thumbnail image in the watch is obtained, and the first weight value of the source data is determined by using the index data; If the first weight value of the source data is greater than a preset first weight threshold, the source data is saved in the watch; if the first weight value of the source data is not greater than the preset first weight threshold, the source data is deleted from the watch.

4. The data interaction method of claim 3, wherein, Whether to delete the source data in the mobile phone and the watch is determined according to a relationship between a weight value corresponding to index data of the thumbnail image of the source data and a preset weight threshold, and the method further comprises the following steps: The index data corresponding to the thumbnail image in the mobile phone is obtained, and the second weight value of the source data is determined by using the index data; If the second weight value of the source data is greater than a preset second weight threshold, the source data is saved in the mobile phone; if the second weight value of the source data is not greater than the preset second weight threshold, the source data is deleted from the mobile phone.

5. The data interaction method of claim 1, wherein, When the operation instruction of the user to the thumbnail image in the mobile phone is monitored, the operation instruction is sent to the watch, and the method further comprises the following steps: The voice control instruction of the mobile phone to the thumbnail image is obtained; wherein the voice control instruction is obtained by using the voice assistant built in the mobile phone to obtain the operation instruction; The voice control instruction is converted into the operation instruction of the thumbnail image, and the operation instruction is sent to the watch.

6. The data interaction method of claim 1, wherein, The watch is controlled to interact with the source data corresponding to the thumbnail image in the storage server according to the received operation instruction, and the interaction result of the source data is sent to the mobile phone, and the method comprises the following steps: After the watch receives the operation instruction, the source data of the thumbnail image corresponding to the operation instruction is determined; It is judged whether the source data is saved in the watch; If yes, the source data is directly sent to the mobile phone; if not, the watch is controlled to obtain the source data from the storage server, and the source data is sent to the mobile phone.

7. The data interaction method of claim 6, wherein, When the operation instruction is a data display instruction, the watch is controlled to interact with the source data corresponding to the thumbnail image in the storage server according to the received operation instruction, and the interaction result of the source data is sent to the mobile phone, and the method comprises the following steps: When the watch receives the data display instruction, the watch sends a data request to the storage server according to the thumbnail corresponding to the data display instruction; The watch controls the watch to acquire source data corresponding to the thumbnail according to a response data of the storage server, and sends the source data to the mobile phone for data display.

8. The data interaction method of claim 6, wherein, When the operation instruction is a data deletion instruction, the watch controls the watch to interact with source data corresponding to the thumbnail in the storage server according to the received operation instruction, and sends an interaction result of the source data to the mobile phone, including: When the watch receives the data deletion instruction, the watch sends a deletion request to the storage server according to the thumbnail corresponding to the data deletion instruction; The watch controls the watch to delete the corresponding thumbnail in the watch according to a first deletion response of the storage server; wherein the first deletion response is a response of the storage server after successfully deleting the source data corresponding to the thumbnail; The watch acquires a second deletion response, and sends the second deletion response to the mobile phone; wherein the second deletion response is a response after deleting the source data of the corresponding thumbnail in the watch.

9. A data interaction system, characterized by The system is applied to multimedia data interaction of a mobile terminal device; wherein the mobile terminal device includes a mobile phone and a watch with networking function; the mobile phone and the watch perform data interaction through a wireless local area network transmission protocol and / or a Bluetooth transmission protocol; the watch and a preset storage server perform data interaction through a wireless local area network transmission protocol and / or a general packet radio service transmission protocol; The system includes: A source data preprocessing module is configured to acquire source data contained in the mobile phone; wherein the source data at least includes multimedia data, application data and file data; the multimedia data at least includes picture data and video data; the application data at least includes email data, address book data and recording data; and the file data at least includes folder data and sub-file data; A thumbnail generation module is configured to convert the source data into thumbnails in the mobile phone according to a type of the source data and a preset format, and transmit the thumbnails and corresponding source data to the watch for storage; A first interaction module is configured to control the watch to transmit the received source data to the storage server for storage, and determine whether to delete the source data of the mobile phone and the watch through a relationship between a weight value corresponding to index data of the thumbnail of the source data and a preset weight threshold; A second interaction module is configured to send an operation instruction of a user to the watch after monitoring the operation instruction of the user to the thumbnail in the mobile phone; A third interaction module is configured to control the watch to interact with source data corresponding to the thumbnail in the storage server according to the received operation instruction, and send an interaction result of the source data to the mobile phone.

10. An electronic device, comprising: The electronic device comprises a processor and a storage device; the storage device stores a computer program, and the computer program realizes the steps of the data interaction method in any one of claims 1 to 8 when executed by the processor.

Images