Multimedia information processing method and device
By establishing encrypted local area network communication channels between electronic devices with different operating systems, multimedia information can be directly transmitted and processed, solving the problems of cumbersome operation and low security, realizing seamless access and editing of cross-platform files, and improving the user experience.
Patent Information
- Application Number
- CN202511585115.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-31
- Publication Date
- 2026-02-03
AI Technical Summary
Transferring multimedia files between mobile devices with different operating systems is cumbersome and insecure. Existing technologies cannot provide a secure, efficient, and user-friendly cross-platform file access and editing solution.
By establishing data channels between electronic devices with different operating systems, multimedia information can be directly transmitted and processed, avoiding the use of third-party servers for relaying. Low-power Bluetooth is used for device discovery and authentication, and an encrypted local area network communication channel is established to achieve direct cross-platform information transmission and editing.
It improves the security of information communication between devices with different operating systems, enables seamless cross-platform file access and editing, and enhances the user experience.
Smart Images

Figure CN121462989A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of communication technology, and specifically relates to a multimedia information processing method and apparatus. Background Technology
[0002] With the widespread adoption of mobile devices, many users own and use mobile devices with different operating systems (hereinafter referred to as "dual-device users"). However, due to the closed nature of different operating system ecosystems, users face many inconveniences when operating devices across different operating systems. For example, the core pain points of dual-device users are "the inconvenience of transferring files between the two mobile devices" and "the desire to use high-quality applications from the ecosystem of one mobile device on another."
[0003] However, currently, the common method for processing multimedia information between mobile devices with different operating systems is to upload the multimedia information from one mobile device to a third-party server, and then download it from the third-party server for processing on the other mobile device. This method is cumbersome and has low information security. Summary of the Invention
[0004] The purpose of this application is to provide a multimedia information processing method and apparatus that can improve the security of multimedia information processing between mobile devices with different operating systems.
[0005] In a first aspect, embodiments of this application provide a multimedia information processing method, applied to a first electronic device deployed with a first operating system, the method comprising:
[0006] Through the established data channel between the first electronic device and the second electronic device, the metadata of at least one multimedia information of the second electronic device sent by the second electronic device is received, and the second electronic device is deployed with a second operating system different from the first operating system;
[0007] Generate a thumbnail of the at least one multimedia information based on the metadata of the at least one multimedia information;
[0008] Upon receiving a first input to a first thumbnail in a thumbnail of at least one multimedia information, a first request is sent to the second electronic device, the first request being used to request the first multimedia information corresponding to the first thumbnail;
[0009] Receive and process the first multimedia information sent by the second electronic device.
[0010] Secondly, embodiments of this application provide a multimedia information processing method, applied to a second electronic device deployed with a second operating system, the method comprising:
[0011] Through the established data channel between the first electronic device and the second electronic device, metadata of at least one multimedia information of the second electronic device is sent to the first electronic device, wherein the first electronic device is equipped with a first operating system that is different from the second operating system;
[0012] Receive a first request sent by the first electronic device, the first request being used to request the first multimedia information corresponding to the first thumbnail in the thumbnail of the at least one multimedia information;
[0013] In response to the first request, the first multimedia information is sent to the first electronic device.
[0014] Thirdly, embodiments of this application provide a multimedia information processing apparatus, applied to a first electronic device on which a first operating system is deployed, the apparatus comprising:
[0015] The first processing module is configured to receive metadata of at least one multimedia information sent by the second electronic device through the established data channel between the first electronic device and the second electronic device, and store the metadata of the at least one multimedia information, wherein the second electronic device is deployed with a second operating system different from the first operating system;
[0016] The first generation module is used to generate a thumbnail of the at least one multimedia information based on the metadata of the at least one multimedia information.
[0017] The first sending module is configured to send a first request to the second electronic device when receiving a first input to a first thumbnail in a thumbnail of at least one multimedia information, wherein the first request is used to request the first multimedia information corresponding to the first thumbnail;
[0018] The second processing module is used to receive and process the first multimedia information sent by the second electronic device.
[0019] Fourthly, embodiments of this application provide a multimedia information processing apparatus applied to a second electronic device having a second operating system deployed thereon, the apparatus comprising:
[0020] The second sending module is used to send metadata of at least one multimedia information of the second electronic device to the first electronic device through the established data channel between the first electronic device and the second electronic device, wherein the first electronic device has a first operating system that is different from the second operating system deployed therein;
[0021] A first receiving module is configured to receive a first request sent by the first electronic device, wherein the first request is configured to request the first multimedia information corresponding to the first thumbnail in the thumbnail of the at least one multimedia information;
[0022] The third sending module is used to send the first multimedia information to the first electronic device in response to the first request.
[0023] Fifthly, embodiments of this application provide an electronic device including a processor and a memory, the memory storing programs or instructions executable on the processor, the programs or instructions, when executed by the processor, implementing the steps of the method described in the first or second aspect.
[0024] In a sixth aspect, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first or second aspect.
[0025] In a seventh aspect, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the communication interface being used to transmit image data, and the processor being used to run programs or instructions to implement the method as described in the first or second aspect.
[0026] Eighthly, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method as described in the first or second aspect.
[0027] In this embodiment, a data channel can be established between a first electronic device and a second electronic device, both deployed with different operating systems. Through this data channel, the first electronic device can receive metadata of multimedia information transmitted by the second electronic device and generate thumbnails of the multimedia information based on this metadata. A user can select a first thumbnail of the first multimedia information from the generated thumbnails through a first input. Thus, a first request can be sent to the second electronic device via the data channel to request the first multimedia information. The first electronic device can receive the first multimedia information sent by the second electronic device in response to the first request through the established data channel and process the first multimedia information from the second electronic device. In this embodiment, no third-party server is needed to relay the multimedia information from the second electronic device to the first electronic device. The establishment of a data channel between the first and second electronic devices, both with different operating systems, provides a foundation for direct communication between them. The first electronic device can directly send first requests to the second electronic device and directly receive the first multimedia information sent by the second electronic device through the data channel, thereby processing the first multimedia information from the second electronic device and improving the security of information communication between them. Attached Figure Description
[0028] Figure 1 This is one of the flowcharts of the multimedia information processing method provided in the embodiments of this application;
[0029] Figure 2 This is the second flowchart of the multimedia information processing method provided in the embodiments of this application;
[0030] Figure 3 This is the third flowchart of the multimedia information processing method provided in the embodiments of this application;
[0031] Figure 4 This is the fourth flowchart of the multimedia information processing method provided in the embodiments of this application;
[0032] Figure 5 This is the fifth flowchart of the multimedia information processing method provided in the embodiments of this application;
[0033] Figure 6 This is one of the schematic diagrams of a multimedia information processing device provided in the embodiments of this application;
[0034] Figure 7 This is a second schematic diagram of the multimedia information processing device provided in the embodiments of this application;
[0035] Figure 8 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;
[0036] Figure 9 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation
[0037] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0038] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0039] The multimedia information processing method provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.
[0040] like Figure 1 As shown, this application provides a multimedia information processing method according to an embodiment. This method can be applied to a first electronic device with a first operating system deployed thereon. The method includes:
[0041] Step 101: Through the established data channel between the first electronic device and the second electronic device, receive metadata of at least one multimedia information sent by the second electronic device, store the metadata of at least one multimedia information, and the second electronic device is deployed with a second operating system different from the first operating system.
[0042] The first electronic device has a first operating system deployed thereon, and the second electronic device has a second operating system deployed thereon. The first electronic device may include, but is not limited to, a first mobile device, and the second electronic device may include, but is not limited to, a second mobile device. For example, the first operating system may be, but is not limited to, Android, iOS, or other operating systems, and the second operating system may be, but is not limited to, Android, iOS, or other operating systems. However, the first and second operating systems are different operating systems. For example, if the first operating system is Android, then the second operating system can be any operating system other than Android; if the first operating system is iOS, then the second operating system can be any operating system other than iOS. Multimedia information may include, but is not limited to, images, videos, audio, text, and visualized data. Metadata is information used to describe data; the metadata of multimedia information is information used to describe multimedia information, and its data volume is relatively small compared to the multimedia information itself. The first electronic device can establish a data channel with the second electronic device to facilitate data communication between them. For example, the second electronic device can send the metadata of its multimedia information to the first electronic device through the data channel.
[0043] Step 102: Generate a thumbnail of at least one multimedia information based on the metadata of at least one multimedia information.
[0044] Step 103: Upon receiving a first input for a first thumbnail in a thumbnail of at least one multimedia information, a first request is sent to a second electronic device, the first request being used to request the first multimedia information corresponding to the first thumbnail.
[0045] After receiving metadata of at least one multimedia message from the second electronic device, a thumbnail of at least one multimedia message can be generated based on the metadata. This provides visual cues for the multimedia message. The user can browse the thumbnails of the at least one multimedia message from the second electronic device within the first electronic device. The user can make selections within the thumbnails of the at least one multimedia message. For example, a first input can be made to the first thumbnail to generate a first request, which is then sent to the second electronic device to request the first multimedia message corresponding to the first thumbnail. The at least one multimedia message includes the first multimedia message. That is, the user can request corresponding media information from the second electronic device by selecting a thumbnail. For example, if at least one multimedia message includes N images, and the user selects the thumbnail of the first image from the thumbnails of the N images generated in the first electronic device, a first request can be sent to the second electronic device to request the first image. Upon receiving the first request, the second electronic device can transmit the first image to the first electronic device via a data channel.
[0046] Step 104: Receive and process the first multimedia information sent by the second electronic device.
[0047] After receiving the first request, the second electronic device can send the first multimedia information to the first electronic device in response to the first request. After receiving the first multimedia information sent by the second electronic device, the first electronic device can process the first multimedia information, which may include, but is not limited to, editing, displaying, recognizing, and extracting text.
[0048] In this embodiment, a data channel can be established between a first electronic device and a second electronic device, both deployed with different operating systems. Through this data channel, the first electronic device can receive metadata of multimedia information transmitted by the second electronic device and generate thumbnails of the multimedia information based on this metadata. A user can select a first thumbnail of the first multimedia information from the generated thumbnails through a first input. Thus, a first request can be sent to the second electronic device via the data channel to request the first multimedia information. The first electronic device can receive the first multimedia information sent by the second electronic device in response to the first request through the established data channel and process the first multimedia information from the second electronic device. In this embodiment, no third-party server is needed to relay the multimedia information from the second electronic device to the first electronic device. The establishment of a data channel between the first and second electronic devices, both with different operating systems, provides a foundation for direct communication between them. The first electronic device can directly send first requests to the second electronic device and directly receive the first multimedia information sent by the second electronic device through the data channel, thereby processing the first multimedia information from the second electronic device and improving the security of information communication between them.
[0049] In some embodiments, after receiving and processing the first multimedia information sent by the second electronic device, the method further includes:
[0050] The first multimedia information after storage and processing, and the metadata of the first multimedia information after storage and processing;
[0051] Generate a thumbnail of the processed first multimedia information based on the metadata of the processed first multimedia information.
[0052] The processed first multimedia information is sent to the second electronic device.
[0053] It is understood that the processed first multimedia information in this embodiment can be multimedia information that has been modified from the original first multimedia information. This modification can be, but is not limited to, editing; that is, the processing in this embodiment can be editing, etc. Since the processed first multimedia information is obtained by processing the original first multimedia information, the metadata describing the multimedia information also changes accordingly. The first electronic device can store the processed first multimedia information and its metadata. Furthermore, it can generate a thumbnail of the processed first multimedia information based on its metadata, so that users can view and select the thumbnail. In addition, the first electronic device can also send its processed first multimedia information to the second electronic device, realizing the collaboration of multimedia information between the first and second electronic devices. As an example, to ensure the integrity of the original first multimedia information, this application follows the principle of not overwriting the original file (i.e., the "Save As" logic). The second electronic device can save the processed first multimedia information separately without overwriting the original first multimedia information.
[0054] In some embodiments, before receiving metadata of at least one multimedia information sent by the second electronic device through the established data channel between the first electronic device and the second electronic device, the method further includes:
[0055] When the first electronic device is on the same local area network as the second electronic device, a data channel is established with the second electronic device, and the first account identifier logged in on the first electronic device is the same as the second account identifier logged in on the second electronic device.
[0056] Before transmitting metadata, a data channel needs to be established between the first and second electronic devices. To ensure the necessary channel for data transmission, the first and second electronic devices must be on the same network. For example, if the first and second electronic devices are on the same local area network, a data channel can be established with the second electronic device. Furthermore, the first account identifier logged in on the first electronic device must be the same as the second account identifier logged in on the second electronic device. This ensures that only devices belonging to the same account can discover each other and complete authentication, thereby establishing the data channel between them and ensuring the security of data transmission.
[0057] In some embodiments, establishing a data channel with the second electronic device includes:
[0058] Receive a first message broadcast by the second electronic device, the first message carrying the identifier of the second account logged in on the second electronic device;
[0059] If the second account identifier is the same as the first account identifier logged in on the first electronic device, a first channel is established with the second electronic device;
[0060] The system receives first information sent by the second electronic device through the first channel. The first information includes first network information of the network where the second electronic device is located.
[0061] Based on the first network information and the second network information of the network where the first electronic device is located, and after determining that the second electronic device and the first electronic device are on the same local area network, a data channel is established with the second electronic device.
[0062] Before establishing a data channel, the second electronic device can broadcast a first message carrying the identifier of the second account logged in on the second electronic device. After receiving the first message broadcast by the second electronic device, the first electronic device can perform identity authentication, that is, compare whether the identifier of the second account logged in on the second electronic device is the same as the identifier of the first account logged in on the first electronic device. If they are the same, it means that the first electronic device and the second electronic device are devices under the same account. In this case, a first channel can be established with the second electronic device first. Afterwards, the first electronic device and the second electronic device can exchange their respective network information through the first channel. For example, the first electronic device can receive the first information sent by the second electronic device through the first channel, and the first electronic device can send the second network information of the network where the first electronic device is located to the second electronic device through the first channel. By using the second network information of the first electronic device and the first network information of the second electronic device, it can be determined whether the first electronic device and the second electronic device are on the same network. If it is determined that the second electronic device and the first electronic device are on the same local area network, a data channel can be established with the second electronic device so that the second electronic device and the first electronic device can communicate data.
[0063] As an example, the first network information may include, but is not limited to, at least one of the Internet Protocol (IP) address of the second electronic device and the Service Set Identifier (SSID) of the network to which the second electronic device is connected. The second network information may include, but is not limited to, at least one of the Internet Protocol (IP) address of the first electronic device and the Service Set Identifier (SSID) of the network to which the first electronic device is connected. As an example, the first channel may be, but is not limited to, a Bluetooth channel, and the first message broadcast by the second electronic device may be a first message broadcast by the second electronic device via Bluetooth.
[0064] In some embodiments, the method further includes:
[0065] If, based on the first network information and the second network information of the network where the first electronic device is located, it is determined that the second electronic device and the first electronic device are not on the same local area network, a first prompt message is output. The first prompt message is used to prompt the first electronic device and the second electronic device to be connected to the same local area network.
[0066] A data channel is established with the second electronic device when the first electronic device switches to the network where the second electronic device is located, or when the second electronic device switches to the network where the first electronic device is located.
[0067] If the first electronic device and the second electronic device are not connected to the same network, a first prompt message can be output to prompt the user to connect the first electronic device and the second electronic device to the same local area network. In this way, the user can switch the network of the first electronic device and / or switch the network of the second electronic device according to the prompt, so that the second electronic device and the first electronic device are connected to the same network. When the first electronic device changes to the network where the second electronic device is located, or the second electronic device changes to the network where the first electronic device is located, a data channel can be established with the second electronic device to facilitate data communication between the first electronic device and the second electronic device.
[0068] In some embodiments, establishing a data channel with a second electronic device includes:
[0069] Establish a control channel with the second electronic device;
[0070] A data channel is established with the second electronic device when the first electronic device sends second information to the second electronic device via the control channel and receives third information sent by the second electronic device; wherein the second information includes a first confirmation notification and the third information includes a second confirmation notification, the first confirmation notification indicating that the first electronic device can perform data communication and the second confirmation notification indicating that the second electronic device can perform data communication.
[0071] In the process of establishing a data channel between two electronic devices when they are on the same network, a control channel can be established first. Through this control channel, control signaling and other information can be transmitted between the two devices. For example, the first electronic device can send second information (which can also be understood as first control signaling) to the second electronic device via the control channel. The second electronic device can then send third information (which can also be understood as second control signaling) to the first electronic device via the control channel. The second information can carry a first confirmation notification indicating that the first electronic device is ready for data communication, and the third information can carry a second confirmation notification indicating that the second electronic device is ready for data communication. These confirmation notifications can be exchanged through the control channel, thus establishing a data channel for subsequent data communication between the two devices. Alternatively, as an example, the second information can also carry device information of the first electronic device, such as its device identifier, and the third information can also carry device information of the second electronic device, such as its device identifier. This allows the first and second electronic devices to exchange their respective device information through the control channel, ensuring the accuracy of the data channel establishment between them.
[0072] In some embodiments, the method further includes: sending a first key of a first electronic device to a second electronic device via a first channel and receiving a second key of a second electronic device sent by the second electronic device;
[0073] The first key is used to encrypt information sent from the second electronic device to the first electronic device in the control channel and the data channel, and the second key is used to encrypt information sent from the first electronic device to the second electronic device in the control channel and the data channel.
[0074] After establishing the first channel, the first and second electronic devices can exchange their respective keys. This allows the first electronic device to encrypt information transmitted from the control channel to the second electronic device using the second electronic device's second key, and vice versa, enhancing transmission security. Similarly, the first electronic device can encrypt information transmitted from the data channel to the second electronic device using the second electronic device's second key, and vice versa.
[0075] In some embodiments, after receiving and storing metadata of at least one multimedia message sent by the second electronic device to the first electronic device via a data channel, the method further includes:
[0076] The device receives a fourth message sent by a second electronic device, the fourth message including at least one of the following: metadata of a first multimedia message, the first multimedia message being newly added multimedia message in the second electronic device relative to at least one multimedia message; an identifier of metadata of a second multimedia message, the second multimedia message being multimedia message that has been deleted from at least one multimedia message in the second electronic device; and metadata of a third multimedia message, the third multimedia message being multimedia message that has been edited from at least one multimedia message in the second electronic device.
[0077] Based on the fourth information, update the metadata of the multimedia information of the second electronic device stored in the first electronic device.
[0078] In this embodiment, the second electronic device can monitor changes in multimedia information (e.g., including but not limited to adding, deleting, and editing at least one of these). When a change is detected, it can send fourth information to the first electronic device through a data channel. In this way, the first electronic device can update the metadata of the multimedia information of the second electronic device stored in the first electronic device according to the fourth information, ensuring the consistency of the metadata of the multimedia data of the first electronic device and the second electronic device. Subsequently, the thumbnail of the multimedia information can be updated accordingly to ensure the consistency between the thumbnail of the multimedia information in the first electronic device and the multimedia information in the second electronic device.
[0079] In some embodiments, the method further includes at least one of the following:
[0080] If a data channel is detected to be disconnected or the data channel connection times out or fails, a second prompt message is output to indicate that the connection has been disconnected.
[0081] If the first channel between the first electronic device and the second electronic device is detected to be disconnected, a third prompt message is output, which is used to indicate that the first channel has been interrupted.
[0082] When the mutual transfer application is detected to switch to background operation, a fourth prompt message is output. The fourth prompt message is used to prompt the mutual transfer application to switch to foreground operation. The mutual transfer application is used to establish a control channel and / or data channel between the first electronic device and the second electronic device.
[0083] Upon receiving a notification of a multimedia information write error, a fifth prompt message is output, indicating insufficient storage space.
[0084] This embodiment provides an exception handling mechanism to address various fault states that may occur in real-world usage scenarios. For example:
[0085] Handling network disconnection anomalies: The system can detect network (e.g., including but not limited to Wi-Fi / hotspot) disconnection by Socket connection timeout or failure. Once detected, the system can pause all data transmission and display a second prompt message at the user interface (UI) level, such as a "Device disconnected" dialog box, and list possible reasons (e.g., weak signal, second electronic device not lit up, etc.), and guide the user to check network settings or try automatic / manual reconnection, etc.
[0086] Handling first channel (e.g., Bluetooth (BLE) connection disconnection exception): The system detects whether the basic Bluetooth connection is disconnected through BLE state change callback. Once disconnected, all socket channels (control channel and data channel) will be forcibly closed, the cross-device access function entry will be grayed out or disappear, and a third prompt message will be output to inform the user that the connection has been interrupted and guide the user to re-initiate the complete device discovery and connection process, etc.
[0087] Handling abnormal background switching of the file transfer application: The system detects whether the file transfer application has been switched to the background by listening to the lifecycle events of the file transfer application. Once the background switch is detected, the system will issue a local notification, such as outputting the fourth prompt message to remind the user that "You are using 'Cross-Device Access', please keep this device unlocked and the screen on", etc., to guide the user to switch the file transfer application back to the foreground to restore network activity that may have been terminated by the system.
[0088] Handling album permission revocation exceptions: The system detects whether album permissions have been revoked by using the permission error code (Multimedia Information Access Permission Error Notification) returned by the file access interface (API). Once detected, the main function switch will be automatically turned off, all file requests will be rejected, and a sixth prompt message will pop up, such as a prompt dialog box, to guide the user to jump to the "Settings" application to re-authorize.
[0089] Insufficient device storage space error: The system detects insufficient storage space by detecting errors returned during file write operations (multimedia information write error notification). Once detected, the current file transfer operation will be paused or canceled, and a fifth prompt message will pop up, such as displaying a "Insufficient phone storage space" dialog box, and providing a "Go to clean up" button to guide the user to free up space, etc.
[0090] In this embodiment, a robust system reliability assurance framework is constructed through intelligent detection of various common abnormal scenarios, clear user guidance, and automatic recovery attempts. This enables the solution of this application embodiment to operate stably under complex wireless network environments and user operations, ensuring the consistency and smoothness of the user experience, and demonstrating the completeness and high practicality of the invention.
[0091] The multimedia information processing method provided in this application can be executed by a multimedia information processing device. This application uses the execution of the multimedia information processing method by a multimedia information processing device as an example to illustrate the multimedia information processing device provided in this application.
[0092] like Figure 2 As shown, this application provides a multimedia information processing method according to an embodiment. This method can be applied to a second electronic device with a second operating system deployed thereon. The method includes:
[0093] Step 201: Through the established data channel between the first electronic device and the second electronic device, send metadata of at least one multimedia information of the second electronic device to the first electronic device. The first electronic device has a first operating system that is different from the second operating system.
[0094] Step 202: Receive a first request sent by the first electronic device, the first request being used to request the first multimedia information corresponding to the first thumbnail in at least one multimedia information thumbnail;
[0095] Step 203: In response to the first request, send the first multimedia information to the first electronic device.
[0096] In some embodiments, after sending the first multimedia information to the first electronic device, the method further includes:
[0097] Receive the processed first multimedia information sent by the first electronic device after processing the first multimedia information;
[0098] The processed first multimedia information is then stored in a second electronic device.
[0099] In some embodiments, before sending metadata of at least one multimedia information of the second electronic device to the first electronic device via the established data channel, the method further includes:
[0100] When the two devices are on the same local area network, a data channel is established between them. The first account identifier logged in on the first electronic device is the same as the second account identifier logged in on the second electronic device.
[0101] In some embodiments, establishing a data channel with the first electronic device includes:
[0102] Broadcast a first message, which carries the identifier of the second account logged in on the second electronic device;
[0103] First information is sent to the first electronic device through the first channel. The first information includes the first network information of the network where the second electronic device is located. The first channel is a channel established when the second account identifier is the same as the first account identifier logged in in the first electronic device.
[0104] A data channel is established with the first electronic device. The data channel is established when it is determined that the second electronic device and the first electronic device are on the same local area network based on the first network information and the second network information of the network where the first electronic device is located, or when the first electronic device switches to the network where the second electronic device is located or the second electronic device switches to the network where the first electronic device is located.
[0105] In some embodiments, establishing a data channel with the first electronic device includes:
[0106] Establish a control channel with the first electronic device;
[0107] Upon receiving second information sent by the first electronic device and third information sent to the first electronic device via the control channel, a data channel is established with the first electronic device; wherein, the second information includes a first confirmation notification, the third information includes a second confirmation notification, the first confirmation notification indicates that the first electronic device can perform data communication, and the second confirmation notification indicates that the second electronic device can perform data communication.
[0108] In some embodiments, the method further includes: receiving a first key of a first electronic device sent by a first electronic device and sending a second key of a second electronic device to the first electronic device via a first channel;
[0109] The first key is used to encrypt information sent from the second electronic device to the first electronic device in the control channel and the data channel, and the second key is used to encrypt information sent from the first electronic device to the second electronic device in the control channel and the data channel.
[0110] In some embodiments, after transmitting metadata of at least one multimedia information of the second electronic device to the first electronic device via a data channel, the method further includes:
[0111] Send a fourth message to the first electronic device, the fourth message including at least one of the following: metadata of the first multimedia message, the first multimedia message being multimedia message newly added in the second electronic device relative to at least one multimedia message; an identifier of the metadata of the second multimedia message, the second multimedia message being multimedia message that has been deleted from at least one multimedia message in the second electronic device; and metadata of the third multimedia message, the third multimedia message being multimedia message that has been adjusted in at least one multimedia message in the second electronic device.
[0112] The fourth piece of information is used to update the metadata of the multimedia information of the second electronic device stored in the first electronic device.
[0113] In some embodiments, the method further includes at least one of the following:
[0114] If a data channel is detected to be disconnected or the data channel connection times out or fails, a second prompt message is output to indicate that the connection has been disconnected.
[0115] If the first channel between the first electronic device and the second electronic device is detected to be disconnected, a third prompt message is output, which is used to indicate that the first channel has been interrupted.
[0116] When the mutual transfer application is detected to switch to background operation, a fourth prompt message is output. The fourth prompt message is used to prompt the mutual transfer application to switch to foreground operation. The mutual transfer application is used to establish a control channel and / or data channel between the first electronic device and the second electronic device.
[0117] Upon receiving a notification of an error in access permissions for multimedia information, a sixth prompt message is output, which is used to request authorization for multimedia information access.
[0118] The multimedia information processing method of the second electronic device described above is a different device-side method corresponding to the multimedia information processing method of the first electronic device described above. The technical features are the same and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0119] The multimedia information processing method provided in this application can be executed by a multimedia information processing device. This application uses the execution of the multimedia information processing method by a multimedia information processing device as an example to illustrate the multimedia information processing device provided in this application.
[0120] The process of the above method will be specifically described below with some specific embodiments. Taking a first electronic device (also called a master device) as the first terminal, and the first terminal as an Android terminal (i.e., a terminal with an Android operating system deployed), the first terminal can be a first mobile terminal. The second electronic device (also called a slave device) is the second terminal, and the second terminal is an iOS terminal (i.e., a terminal with an iOS operating system deployed), the second terminal can be a second mobile terminal. The first operating system is the Android operating system, and the second operating system is the iOS operating system. The multimedia information is an image, as an example. A mobile phone can be used as an example of a terminal.
[0121] Introduction to related technologies:
[0122] With the widespread adoption of mobile devices, many users own and use both Android smartphones and Apple iPhones (hereinafter referred to as "dual-device users"). However, due to the closed nature of the two operating system ecosystems, users face numerous inconveniences when collaborating across devices. The core pain points for dual-device users are "the inconvenience of transferring files between the two phones" and "the desire to use high-quality applications from the other phone's ecosystem on one phone." To solve the cross-platform file transfer problem, relevant technologies mainly provide the following solutions, but all have significant limitations:
[0123] 1. Cloud-based synchronization solutions: For example, synchronization via cloud photo album services (i.e., third-party services). These solutions require users to upload all multimedia information to a third-party server, consuming significant network bandwidth and time, and potentially raising concerns about data privacy. Furthermore, cloud synchronization does not directly access the device's local file system in real time; it often involves file compression or format conversion and cannot meet the needs of instant editing and write-back.
[0124] 2. Manual File Transfer Applications: File transfer tools in related technologies typically require users to manually select files on the source device and receive them on the target device. The entire process is cumbersome and provides a fragmented user experience. This "one-time transfer" mode only achieves data copying and cannot support a smooth workflow of "real-time" browsing and direct editing of the slave device's photo album on the master device.
[0125] 3. Lack of Functional Integration: The core of the solutions in related technologies is data migration or copying, without providing a mechanism that allows applications on the main device (e.g., photo album apps with advanced AI editing capabilities) to directly open, edit, and save a file physically stored on the secondary device. This prevents users from applying the powerful AI image editing capabilities of Android devices to photos on their iPhones, failing to meet users' core demand to "leverage Android's AI image editing capabilities."
[0126] Therefore, the existing technologies cannot provide a secure, efficient, and user-friendly cross-platform file access and editing solution, especially in high-frequency scenarios such as image processing. The embodiments of this application aim to fundamentally solve the aforementioned technical problems through an innovative system architecture and method.
[0127] The overall concept of the embodiment of this application is as follows:
[0128] The solution provided in this application enables an Android device (master device) to seamlessly access, display, edit, and manage image files stored on an iOS device (slave device). Embodiments of this application provide a cross-platform image access and editing system, which includes:
[0129] Main device: For example, an Android smartphone with client applications (such as file management and photo album) and connection management services (such as the connection service of the file transfer application and the connection dock service).
[0130] From the device: for example, an iPhone with a client application (such as a file transfer app) installed on it.
[0131] The solution in this application includes the following key stages:
[0132] 1. Authentication and Connection Establishment Phase: First, the master and slave devices authenticate each other based on the same user account. Then, a hybrid communication link is established between the devices: Bluetooth Low Energy (BLE) is used for device discovery, pairing, and low-bandwidth control signaling transmission. Based on this, a high-speed data channel is established over a local area network (Wi-Fi or a personal hotspot created by the device).
[0133] 2. Remote Data Virtualization Phase: After a successful connection (establishing a data channel), the system synchronizes the photo library metadata from the slave device to the master device. The master device builds and maintains a cache database of this metadata locally, thereby generating a virtualized view (i.e., thumbnails) of the slave device's photo library that can be browsed in real time within its native applications (such as file management and photo albums). The system monitors changes to the slave device's photo album in real time and synchronizes incremental updates to the master device to maintain view consistency;
[0134] 3. Cross-platform editing and write-back stage: Users can select any image for editing in the virtualized view of the main device. The system will temporarily download and cache the original image file to the main device via a high-speed data channel, and then call the local image editing application on the main device for processing. After the user completes the editing and performs the save operation, the system will send the modified image data back to the slave device, and save it as a new file in the slave device's photo library through a proxy application, thus completing the closed-loop operation of "editing and saving back to iPhone".
[0135] The solution in this application embodiment can establish a direct and secure local connection between heterogeneous operating system devices without relying on a third-party cloud server, realizing real-time access to remote photo albums and seamless access to local editing capabilities, ensuring communication security while improving the user experience for dual-device users.
[0136] The specific flow of the multimedia information processing method in this application embodiment is as follows:
[0137] First, establish a data channel between the first electronic device and the second electronic device:
[0138] This application provides a channel establishment scheme that integrates three major elements: identity authentication, physical proximity, and network coexistence, to establish a secure and reliable communication channel. Figure 3 As shown, the process of establishing a data channel between the first electronic device and the second electronic device includes the following steps 301-305:
[0139] Step 301: BLE-based device discovery and authentication:
[0140] The connection process begins with device discovery. One device (e.g., a second electronic device) broadcasts a message via Bluetooth Low Energy (BLE) containing a hashed, unique identifier for the user's account (OpenID), i.e., the account identifier. Another device (e.g., the first electronic device) scans and filters the broadcast messages, responding only to devices whose OpenID hashes match its own logged-in account identifier. This mechanism ensures that only devices belonging to the same user can discover each other, thus completing the first layer of authentication.
[0141] Step 302: Establish the first channel between the first electronic device and the second electronic device:
[0142] After a matching device is detected, the system guides the user through the standard BLE pairing and binding process, thereby establishing a low-bandwidth BLE secure channel, i.e., establishing the first channel.
[0143] Step 303: Local Area Network Connection Booting and Verification:
[0144] Both devices use the established BLE secure channel to exchange their respective local area network (LAN) IP addresses and the Service Set Identifier (SSID) of the network they are connected to (e.g., a Wi-Fi network). Based on this, the system determines whether the two devices are on the same LAN. If they are not, the system will guide the user through a UI prompt (the first prompt) to connect both devices to the same Wi-Fi network, or have the Android device create a personal hotspot for the iPhone to connect to, ensuring the physical link required for subsequent high-speed data transmission.
[0145] Step 304: Establish an encrypted control channel (e.g., a Transmission Control Protocol (TCP) / Internet Protocol (IP) control channel):
[0146] After confirming that the two devices are on the same local area network, the master device can initiate a TCP socket connection to the slave device through the connection service in the inter-transfer application (e.g., target port 8903) to establish a control channel. To ensure connection security, the two devices negotiate and exchange their respective session keys using a BLE secure channel. These keys are used to encrypt all subsequent control signaling transmitted in the socket channel. For example, the master device sends its key to the slave device, and the slave device sends its key to the master device.
[0147] Step 305: Establish an encrypted data channel (e.g., a TCP / IP data channel):
[0148] After the control channel is securely established, the file system service can be coordinated to open a separate data channel (e.g., target port 5678). This channel is also encrypted using the negotiated key and is dedicated to transmitting large file data such as images.
[0149] This implementation employs a hybrid mode of "BLE bootstrapping, LAN transmission," utilizing BLE as a secure out-of-band channel to bootstrap and encrypt LAN TCP / IP connections, effectively preventing man-in-the-middle attacks. The separation of control and data channels ensures system performance and stability during large data transfers, providing a secure and reliable foundation for subsequent data access and editing operations. This embodiment achieves physical separation of control and data flows. The BLE channel handles device discovery, state synchronization, and lightweight command transmission, while the high-speed Wi-Fi channel (LAN or hotspot) is dedicated to reading and writing large files. This layered collaborative mode significantly improves connection stability and overall data transmission efficiency.
[0150] Secondly, after the data channel is established, metadata synchronization is performed, such as... Figure 4 As shown, the specific process for metadata synchronization includes the following steps 401-405:
[0151] Step 401: Initiate the first full metadata synchronization:
[0152] After the data channel is established (after the Android client application and the iOS file transfer client establish a connection through the underlying connection service SDK), the master device (Android) initiates a full album metadata synchronization request to the slave device (iPhone), that is, the master device requests album metadata from the slave device;
[0153] Step 402: Extract and transfer metadata: After obtaining user authorization, the file transfer app on the iPhone queries the iOS Photos framework to extract metadata for all multimedia information in the photo album. This metadata may include, but must include, file identifiers, creation dates, geographic location, image dimensions, etc. For special formats (such as Live Photos), the corresponding identifier field (is_live_photo) will also be extracted. This metadata is then transferred to the Android device in batches (e.g., 300 records per batch) via a data channel.
[0154] Step 403: Build a local cache database on the main device:
[0155] After receiving the metadata, the Android device stores it in a local database. This database acts as a "metadata mirror" of the iPhone's Photos app, enabling the Android Photos app to load and display the list quickly, resulting in a smooth browsing experience.
[0156] Step 404: Change observer in device registration:
[0157] To keep data synchronized, the Share app on iPhone devices registers an observer (which can be understood as an object) with the iOS Photos framework to listen for any changes to the album content (such as adding, deleting, or editing photos).
[0158] Step 405: Push incremental updates in real time:
[0159] When the content of the iPhone's Photos app changes, the system notifies the observer. The observer then generates an "incremental data packet" (i.e., the fourth piece of information) containing only the changed content and pushes it to the Android device in real time via the data channel. Upon receiving the fourth piece of information, the Android device modifies its local database cache accordingly, thereby ensuring the real-time consistency of the view.
[0160] This implementation achieves a smooth browsing experience without having to load the list from the remote device every time by establishing a metadata mirror of the remote album on the host device. Simultaneously, the observer-based incremental update mechanism ensures real-time and efficient data synchronization, significantly reducing network and system resource consumption.
[0161] Furthermore, after receiving the metadata of the multimedia information synchronized from the slave device, the master device can generate thumbnails of the multimedia information, such as... Figure 5 As shown, the process by which the master device processes multimedia information from the slave device is as follows:
[0162] Step 501: The user selects the first thumbnail and requests the first multimedia information:
[0163] In essence, the user selects a thumbnail and requests the original image. The user browses a virtualized list of iPhone photos (i.e., a list of thumbnails) in the Photos app on the Android device. When the user clicks on a thumbnail to view or edit it, the application sends a request for the original image data of the selected thumbnail to the iPhone device via the file system data channel (i.e., the first request).
[0164] Step 502: Transmit and cache the first multimedia information
[0165] This involves transmitting and caching the high-resolution original image. Upon receiving the first request, the iPhone's file transfer application reads the corresponding high-resolution image data (e.g., the first multimedia message) and streams it to the Android device via a data channel. The Android device stores the received multimedia message in a temporary local cache file. Additionally, it can display the download progress of the multimedia message to the user, allowing them to track the download progress.
[0166] Step 503: Call the local editor for processing:
[0167] After the original image data (e.g., the first multimedia message) is fully cached locally, the Android Photos app uses its built-in image editor to open this cached multimedia message. Users can utilize all native editing features available on Android devices, including its unique AI algorithms. For special formats such as Live Photos, the Android app is adapted to render them correctly and provide a native-like editing experience.
[0168] Step 504: Return the modified first multimedia information:
[0169] After the user finishes editing and clicks the "Save" button, the Android device will send the edited and modified image data (i.e., the processed first multimedia information) back to the iPhone device through the data channel.
[0170] Step 505: Save the modified first multimedia message sent by the Android device to the iOS device (i.e., iPhone device):
[0171] The iPhone device's file transfer application receives the modified first multimedia information and calls the iOS Photos framework API to save it as a new file to the system album. To ensure the integrity of the original data (the first multimedia information), this application strictly follows the principle of not overwriting the original file (i.e., the "Save As" logic). The new file (i.e., the modified first multimedia information) is usually saved in a dedicated album called "File Transfer".
[0172] Step 506: Update metadata:
[0173] On the main device side, after saving the modified first multimedia information, the metadata of the modified first multimedia information can be updated to the local database of the main device in real time, so that the modified first multimedia information can immediately appear in the virtual view list (thumbnail list). At the same time, a seventh prompt message can be output to inform the user that the saving was successful.
[0174] This implementation seamlessly integrates the local software capabilities of the master device with the remote data source of the slave device, realizing a unified closed-loop operation of "browsing-editing-writing back". Through temporary caching and the "save as" strategy, it ensures both a smooth editing experience and the security of the original data, meeting the core need of users who want to use the powerful editing capabilities of Android devices to process iPhone photos.
[0175] In addition, this application also provides an anomaly handling scheme to ensure system reliability.
[0176] This implementation provides a comprehensive and sophisticated anomaly handling mechanism to address various fault states that may occur in real-world usage scenarios. Specifically, it includes the following:
[0177] Handling network disconnection anomalies: The system detects Wi-Fi / hotspot disconnection by timing out or failing the Socket connection. Once detected, the system will pause all data transmission and pop up a "Device disconnected" dialog box at the UI level, listing possible reasons (such as weak signal, iPhone screen not lit, etc.) and guiding the user to check network settings or try automatic / manual reconnection.
[0178] Handling BLE connection disconnection exceptions: The system detects basic Bluetooth connection disconnection through BLE state change callbacks. Once disconnected, all socket channels will be forcibly closed, the cross-device access function entry will be grayed out or disappear, clearly informing the user that the connection has been interrupted, and guiding the user to re-initiate the complete device discovery and connection process.
[0179] Handling iOS app switching to the background exception: The system detects whether the file transfer app has been switched to the background by listening to iOS app lifecycle events. Once detected, the iOS system will send a local notification to remind the user that "You are using 'Cross-Device Access'. Please keep this iPhone unlocked and on," etc., to guide the user to switch the file transfer app back to the foreground to restore network activity that may have been terminated by the system.
[0180] Handling iOS Photos Permission Revocation Anomalies: The system detects whether Photos permissions have been revoked by checking the permission error codes returned by the File Access API. Once detected, the main function switch will be automatically turned off, all file requests will be denied, and a dialog box will pop up guiding the user to the iOS "Settings" app to re-authorize.
[0181] Handling insufficient storage space on Android devices: The system detects insufficient storage space by checking for errors returned during file write operations. Once detected, the current file transfer operation will be paused or canceled, and a "Insufficient storage space" dialog box will pop up, providing a "Go to clean up" button to guide the user to free up space.
[0182] Through the aforementioned anomaly handling, intelligent detection of various common anomaly scenarios, clear user guidance, and automatic recovery attempts are achieved, constructing a robust system reliability assurance framework. This enables the solutions in this application to operate stably in complex wireless network environments and under various user operations, ensuring the consistency and smoothness of the user experience, and demonstrating the completeness and high practicality of the invention.
[0183] like Figure 6 As shown, a multimedia information processing device 600 is provided according to an embodiment, applied to a first electronic device on which a first operating system is deployed. The device 600 includes:
[0184] The first processing module 601 is used to receive metadata of at least one multimedia information sent by the second electronic device through the established data channel between the first electronic device and the second electronic device, and to store the metadata of at least one multimedia information. The second electronic device is deployed with a second operating system that is different from the first operating system.
[0185] The first generation module 602 is used to generate a thumbnail of at least one multimedia information based on the metadata of at least one multimedia information.
[0186] The first sending module 603 is configured to send a first request to a second electronic device when receiving a first input to a first thumbnail in a thumbnail of at least one multimedia information. The first request is used to request the first multimedia information corresponding to the first thumbnail.
[0187] The second processing module 604 is used to receive and process the first multimedia information sent by the second electronic device.
[0188] In some embodiments, the device 600 further includes:
[0189] The first storage module is used to store the processed first multimedia information and the metadata of the processed first multimedia information.
[0190] The second generation module is used to generate a thumbnail of the processed first multimedia information based on the metadata of the processed first multimedia information.
[0191] The fourth sending module is used to send the processed first multimedia information to the second electronic device.
[0192] In some embodiments, the device 600 further includes:
[0193] The first establishment module is used to establish a data channel with the second electronic device when the two devices are on the same local area network. The first account identifier logged in on the first electronic device is the same as the second account identifier logged in on the second electronic device.
[0194] In some embodiments, establishing a data channel with the second electronic device includes:
[0195] Receive a first message broadcast by the second electronic device, the first message carrying the identifier of the second account logged in on the second electronic device;
[0196] If the second account identifier is the same as the first account identifier logged in on the first electronic device, a first channel is established with the second electronic device;
[0197] The system receives first information sent by the second electronic device through the first channel. The first information includes first network information of the network where the second electronic device is located.
[0198] Based on the first network information and the second network information of the network where the first electronic device is located, and after determining that the second electronic device and the first electronic device are on the same local area network, a data channel is established with the second electronic device.
[0199] In some embodiments, the device 600 further includes:
[0200] The first output module is used to output a first prompt message when it is determined, based on the first network information and the second network information of the network where the first electronic device is located, that the second electronic device and the first electronic device are not on the same local area network. The first prompt message is used to prompt the first electronic device and the second electronic device to be connected to the same local area network.
[0201] The second establishment module is used to establish a data channel with the second electronic device when the first electronic device switches to the network where the second electronic device is located or when the second electronic device switches to the network where the first electronic device is located.
[0202] In some embodiments, establishing a data channel with a second electronic device includes:
[0203] Establish a control channel with the second electronic device;
[0204] A data channel is established with the second electronic device when the first electronic device sends second information to the second electronic device via the control channel and receives third information sent by the second electronic device; wherein the second information includes a first confirmation notification and the third information includes a second confirmation notification, the first confirmation notification indicating that the first electronic device can perform data communication and the second confirmation notification indicating that the second electronic device can perform data communication.
[0205] In some embodiments, the device 600 further includes:
[0206] The fifth transmitting module is used to transmit the first key of the first electronic device to the second electronic device through the first channel;
[0207] The second receiving module is used to receive the second key of the second electronic device sent by the second electronic device.
[0208] The first key is used to encrypt information sent from the second electronic device to the first electronic device in the control channel and the data channel, and the second key is used to encrypt information sent from the first electronic device to the second electronic device in the control channel and the data channel.
[0209] In some embodiments, the device 600 further includes:
[0210] The third receiving module is used to receive fourth information sent by the second electronic device. The fourth information includes at least one of the following: metadata of the first multimedia information, which is multimedia information newly added to the second electronic device relative to at least one multimedia information; the identifier of the metadata of the second multimedia information, which is multimedia information that has been deleted from at least one multimedia information in the second electronic device; and metadata of the third multimedia information, which is multimedia information that has been adjusted in at least one multimedia information in the second electronic device.
[0211] The first update module is used to update the metadata of the multimedia information of the second electronic device stored in the first electronic device based on the fourth information.
[0212] In some embodiments, the device 600 further includes at least one of the following:
[0213] The second output module is used to output a second prompt message when a data channel is detected to be disconnected or the data channel connection times out or fails. The second prompt message is used to indicate that the connection has been disconnected.
[0214] The third output module is used to output a third prompt message when the first channel between the first electronic device and the second electronic device is detected to be disconnected. The third prompt message is used to indicate that the first channel has been interrupted.
[0215] The fourth output module is used to output a fourth prompt message when the mutual transfer application is detected to switch to background operation. The fourth prompt message is used to prompt the mutual transfer application to switch to foreground operation. The mutual transfer application is used to establish a control channel and / or data channel between the first electronic device and the second electronic device.
[0216] The fifth output module is used to output a fifth prompt message when a multimedia information writing error notification is received. The fifth prompt message is used to indicate that there is insufficient storage space.
[0217] The multimedia information processing device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. It can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television set (TV), ATM, or self-service machine, etc. This application embodiment does not impose specific limitations.
[0218] The multimedia information processing device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.
[0219] The multimedia information processing apparatus provided in this application embodiment can implement the various processes implemented in the above-described multimedia information processing method embodiment. For example, it can implement the various processes implemented in the above-described multimedia information processing method embodiment applied to the first electronic device. To avoid repetition, it will not be described again here.
[0220] like Figure 7 As shown, a multimedia information processing apparatus 700 is provided according to an embodiment, applied to a second electronic device on which a second operating system is deployed. The apparatus 700 includes:
[0221] The second sending module 701 is used to send metadata of at least one multimedia information of the second electronic device to the first electronic device through the established data channel between the first electronic device and the second electronic device. The first electronic device has a first operating system that is different from the second operating system deployed in it.
[0222] The first receiving module 702 is used to receive a first request sent by the first electronic device. The first request is used to request the first multimedia information corresponding to the first thumbnail in at least one multimedia information thumbnail.
[0223] The third sending module 703 is used to send first multimedia information to the first electronic device in response to the first request.
[0224] In some embodiments, the device 700 further includes:
[0225] The fourth receiving module is used to receive the processed first multimedia information sent by the first electronic device after processing the first multimedia information.
[0226] The second storage module is used to store the processed first multimedia information in the second electronic device.
[0227] In some embodiments, the device 700 further includes:
[0228] The third module is used to establish a data channel with the first electronic device when the two devices are on the same local area network. The first account identifier logged in on the first electronic device is the same as the second account identifier logged in on the second electronic device.
[0229] In some embodiments, establishing a data channel with the first electronic device includes:
[0230] Broadcast a first message, which carries the identifier of the second account logged in on the second electronic device;
[0231] First information is sent to the first electronic device through the first channel. The first information includes the first network information of the network where the second electronic device is located. The first channel is a channel established when the second account identifier is the same as the first account identifier logged in in the first electronic device.
[0232] A data channel is established with the first electronic device. The data channel is established when it is determined that the second electronic device and the first electronic device are on the same local area network based on the first network information and the second network information of the network where the first electronic device is located, or when the first electronic device switches to the network where the second electronic device is located or the second electronic device switches to the network where the first electronic device is located.
[0233] In some embodiments, establishing a data channel with the first electronic device includes:
[0234] Establish a control channel with the first electronic device;
[0235] Upon receiving second information sent by the first electronic device and third information sent to the first electronic device via the control channel, a data channel is established with the first electronic device; wherein, the second information includes a first confirmation notification, the third information includes a second confirmation notification, the first confirmation notification indicates that the first electronic device can perform data communication, and the second confirmation notification indicates that the second electronic device can perform data communication.
[0236] In some embodiments, the device 700 further includes:
[0237] The fifth receiving module is used to receive the first key of the first electronic device sent by the first electronic device through the first channel;
[0238] The sixth sending module is used to send the second key of the second electronic device to the first electronic device;
[0239] The first key is used to encrypt information sent from the second electronic device to the first electronic device in the control channel and the data channel, and the second key is used to encrypt information sent from the first electronic device to the second electronic device in the control channel and the data channel.
[0240] In some embodiments, the device 700 further includes:
[0241] The seventh sending module is used to send fourth information to the first electronic device. The fourth information includes at least one of the following: metadata of the first multimedia information, which is multimedia information newly added in the second electronic device relative to at least one multimedia information; an identifier of the metadata of the second multimedia information, which is multimedia information that has been deleted from at least one multimedia information in the second electronic device; and metadata of the third multimedia information, which is multimedia information that has been adjusted in at least one multimedia information in the second electronic device.
[0242] The fourth piece of information is used to update the metadata of the multimedia information of the second electronic device stored in the first electronic device.
[0243] In some embodiments, the device 700 further includes at least one of the following:
[0244] The sixth output module is used to output a second prompt message when a data channel disconnection or data channel connection timeout or failure is detected. The second prompt message is used to indicate that the connection has been disconnected.
[0245] The seventh output module is used to output a third prompt message when the first channel between the first electronic device and the second electronic device is detected to be disconnected. The third prompt message is used to indicate that the first channel has been interrupted.
[0246] The eighth output module is used to output a fourth prompt message when the mutual transfer application is detected to switch to background operation. The fourth prompt message is used to prompt the mutual transfer application to switch to foreground operation. The mutual transfer application is used to establish a control channel and / or data channel between the first electronic device and the second electronic device.
[0247] The ninth output module is used to output a sixth prompt message when a notification of an error in access permission for multimedia information is received. The sixth prompt message is used to prompt for authorization of multimedia information access.
[0248] The multimedia information processing device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. It can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television set (TV), ATM, or self-service machine, etc. This application embodiment does not impose specific limitations.
[0249] The multimedia information processing device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.
[0250] The multimedia information processing apparatus provided in this application embodiment can implement the various processes implemented in the above-described multimedia information processing method embodiment. For example, it can implement the various processes implemented in the above-described multimedia information processing method embodiment applied to a second electronic device. To avoid repetition, it will not be described again here.
[0251] Optionally, such as Figure 8 As shown, this application embodiment also provides an electronic device 800, including a processor 801 and a memory 802. The memory 802 stores programs or instructions that can run on the processor 801. When the program or instructions are executed by the processor 801, they implement the various steps of the above-described multimedia information processing method for a first electronic device or a multimedia information processing method for a second electronic device, and can achieve the same technical effect. To avoid repetition, they will not be described again here.
[0252] It should be noted that the electronic devices in the embodiments of this application include the aforementioned mobile electronic devices and non-mobile electronic devices.
[0253] Figure 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.
[0254] The electronic device 900 includes, but is not limited to, components such as: radio frequency unit 901, network module 902, audio output unit 903, input unit 904, sensor 905, display unit 906, user input unit 907, interface unit 908, memory 909, and processor 910.
[0255] Those skilled in the art will understand that the electronic device 900 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 910 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 9 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.
[0256] The electronic device can be a first electronic device or a second electronic device.
[0257] Taking an electronic device as the first electronic device as an example:
[0258] In some embodiments, the processor 910 is configured to:
[0259] Through the established data channel between the first electronic device and the second electronic device, the system receives metadata of at least one multimedia information sent by the second electronic device and stores the metadata of at least one multimedia information. The second electronic device is deployed with a second operating system that is different from the first operating system.
[0260] Generate a thumbnail of at least one multimedia information based on the metadata of at least one multimedia information.
[0261] Upon receiving a first input to a first thumbnail in a thumbnail of at least one multimedia information, a first request is sent to a second electronic device, the first request being used to request the first multimedia information corresponding to the first thumbnail;
[0262] Receive and process the first multimedia information sent by the second electronic device in response to the first request.
[0263] In some embodiments, the processor 910 is further configured to:
[0264] The first multimedia information after storage and processing, and the metadata of the first multimedia information after storage and processing;
[0265] Generate a thumbnail of the processed first multimedia information based on the metadata of the processed first multimedia information.
[0266] The processed first multimedia information is sent to the second electronic device.
[0267] In some embodiments, the processor 910 is further configured to:
[0268] When the first electronic device is on the same local area network as the second electronic device, a data channel is established with the second electronic device, and the first account identifier logged in on the first electronic device is the same as the second account identifier logged in on the second electronic device.
[0269] In some embodiments, the processor 910 is specifically used for:
[0270] Receive a first message broadcast by the second electronic device, the first message carrying the identifier of the second account logged in on the second electronic device;
[0271] If the second account identifier is the same as the first account identifier logged in on the first electronic device, a first channel is established with the second electronic device;
[0272] The system receives first information sent by the second electronic device through the first channel. The first information includes first network information of the network where the second electronic device is located.
[0273] Based on the first network information and the second network information of the network where the first electronic device is located, and after determining that the second electronic device and the first electronic device are on the same local area network, a data channel is established with the second electronic device.
[0274] In some embodiments, the processor 910 is further configured to:
[0275] If, based on the first network information and the second network information of the network where the first electronic device is located, it is determined that the second electronic device and the first electronic device are not on the same local area network, a first prompt message is output. The first prompt message is used to prompt the first electronic device and the second electronic device to be connected to the same local area network.
[0276] A data channel is established with the second electronic device when the first electronic device switches to the network where the second electronic device is located, or when the second electronic device switches to the network where the first electronic device is located.
[0277] In some embodiments, the processor 910 is specifically used for:
[0278] Establish a control channel with the second electronic device;
[0279] A data channel is established with the second electronic device when the first electronic device sends second information to the second electronic device via the control channel and receives third information sent by the second electronic device; wherein the second information includes a first confirmation notification and the third information includes a second confirmation notification, the first confirmation notification indicating that the first electronic device can perform data communication and the second confirmation notification indicating that the second electronic device can perform data communication.
[0280] In some embodiments, the processor 910 is further configured to:
[0281] The first electronic device sends its first key to the second electronic device and receives the second key sent by the second electronic device via the first channel.
[0282] The first key is used to encrypt information sent from the second electronic device to the first electronic device in the control channel and the data channel, and the second key is used to encrypt information sent from the first electronic device to the second electronic device in the control channel and the data channel.
[0283] In some embodiments, the processor 910 is further configured to:
[0284] The device receives fourth information sent by the second electronic device, the fourth information including at least one of the following: metadata of the first multimedia information, the first multimedia information being newly added multimedia information in the second electronic device relative to at least one multimedia information; an identifier of the metadata of the second multimedia information, the second multimedia information being multimedia information that has been deleted from at least one multimedia information in the second electronic device; and metadata of the third multimedia information, the third multimedia information being multimedia information that has been adjusted in at least one multimedia information in the second electronic device.
[0285] Based on the fourth information, update the metadata of the multimedia information of the second electronic device stored in the first electronic device.
[0286] In some embodiments, the processor 910 is further configured to perform at least one of the following:
[0287] If a data channel is detected to be disconnected or the data channel connection times out or fails, a second prompt message is output to indicate that the connection has been disconnected.
[0288] If the first channel between the first electronic device and the second electronic device is detected to be disconnected, a third prompt message is output, which is used to indicate that the first channel has been interrupted.
[0289] When the mutual transfer application is detected to switch to background operation, a fourth prompt message is output. The fourth prompt message is used to prompt the mutual transfer application to switch to foreground operation. The mutual transfer application is used to establish a control channel and / or data channel between the first electronic device and the second electronic device.
[0290] Upon receiving a notification of a multimedia information write error, a fifth prompt message is output, indicating insufficient storage space.
[0291] Taking an electronic device as a second electronic device as an example:
[0292] In some embodiments, the processor 910 is configured to:
[0293] Through the established data channel between the first electronic device and the second electronic device, metadata of at least one multimedia information of the second electronic device is sent to the first electronic device. The first electronic device has a first operating system that is different from the second operating system.
[0294] Receive a first request sent by a first electronic device, the first request being used to request first multimedia information corresponding to a first thumbnail in a thumbnail of at least one multimedia information;
[0295] In response to the first request, first multimedia information is sent to the first electronic device.
[0296] In some embodiments, the processor 910 is further configured to:
[0297] Receive the processed first multimedia information sent by the first electronic device after processing the first multimedia information;
[0298] The processed first multimedia information is then stored in a second electronic device.
[0299] In some embodiments, the processor 910 is further configured to:
[0300] When the two devices are on the same local area network, a data channel is established between them. The first account identifier logged in on the first electronic device is the same as the second account identifier logged in on the second electronic device.
[0301] In some embodiments, the processor 910 is specifically used for:
[0302] Broadcast a first message, which carries the identifier of the second account logged in on the second electronic device;
[0303] First information is sent to the first electronic device through the first channel. The first information includes the first network information of the network where the second electronic device is located. The first channel is a channel established when the second account identifier is the same as the first account identifier logged in in the first electronic device.
[0304] A data channel is established with the first electronic device. The data channel is established when it is determined that the second electronic device and the first electronic device are on the same local area network based on the first network information and the second network information of the network where the first electronic device is located, or when the first electronic device switches to the network where the second electronic device is located or the second electronic device switches to the network where the first electronic device is located.
[0305] In some embodiments, the processor 910 is specifically used for:
[0306] Establish a control channel with the first electronic device;
[0307] Upon receiving second information sent by the first electronic device and third information sent to the first electronic device via the control channel, a data channel is established with the first electronic device; wherein, the second information includes a first confirmation notification, the third information includes a second confirmation notification, the first confirmation notification indicates that the first electronic device can perform data communication, and the second confirmation notification indicates that the second electronic device can perform data communication.
[0308] In some embodiments, the processor 910 is configured to:
[0309] Through the first channel, the system receives a first key from a first electronic device and sends a second key from a second electronic device to the first electronic device.
[0310] The first key is used to encrypt information sent from the second electronic device to the first electronic device in the control channel and the data channel, and the second key is used to encrypt information sent from the first electronic device to the second electronic device in the control channel and the data channel.
[0311] In some embodiments, the processor 910 is configured to:
[0312] Send a fourth message to the first electronic device, the fourth message including at least one of the following: metadata of the first multimedia message, the first multimedia message being multimedia message newly added in the second electronic device relative to at least one multimedia message; an identifier of the metadata of the second multimedia message, the second multimedia message being multimedia message that has been deleted from at least one multimedia message in the second electronic device; and metadata of the third multimedia message, the third multimedia message being multimedia message that has been adjusted in at least one multimedia message in the second electronic device.
[0313] The fourth piece of information is used to update the metadata of the multimedia information of the second electronic device stored in the first electronic device.
[0314] In some embodiments, the processor 910 is used for at least one of the following:
[0315] If a data channel is detected to be disconnected or the data channel connection times out or fails, a second prompt message is output to indicate that the connection has been disconnected.
[0316] If the first channel between the first electronic device and the second electronic device is detected to be disconnected, a third prompt message is output, which is used to indicate that the first channel has been interrupted.
[0317] When the mutual transfer application is detected to switch to background operation, a fourth prompt message is output. The fourth prompt message is used to prompt the mutual transfer application to switch to foreground operation. The mutual transfer application is used to establish a control channel and / or data channel between the first electronic device and the second electronic device.
[0318] Upon receiving a notification of an error in access permissions for multimedia information, a sixth prompt message is output, which is used to request authorization for multimedia information access.
[0319] It should be understood that, in this embodiment, the input unit 904 may include a graphics processing unit (GPU) 9041 and a microphone 9042. The GPU 9041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 906 may include a display panel 9061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 907 includes at least one of a touch panel 9091 and other input devices 9092. The touch panel 9091 is also called a touch screen. The touch panel 9091 may include a touch detection device and a touch controller. Other input devices 9092 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.
[0320] The memory 909 can be used to store software programs and various data. The memory 909 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 109 may include volatile memory or non-volatile memory, or the memory 909 may include both volatile and non-volatile memory. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 109 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.
[0321] Processor 110 may include one or more processing units; optionally, including but not limited to applications and an operating system. Processor 910 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the aforementioned modem processor may also not be integrated into processor 910.
[0322] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described multimedia information processing method embodiments and achieve the same technical effects. To avoid repetition, they will not be described again here.
[0323] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.
[0324] This application also provides a chip, including a processor and a communication interface. The communication interface and the processor are coupled. The communication interface is used to transmit image data, and the processor is used to run programs or instructions to implement the various processes of the above-described multimedia information processing method embodiments and achieve the same technical effect. To avoid repetition, it will not be described again here.
[0325] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.
[0326] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the multimedia information processing method embodiments described above, and can achieve the same technical effects. To avoid repetition, it will not be described again here.
[0327] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0328] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0329] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
Claims
1. A multimedia information processing method, characterized by, The method is applied to a first electronic device deployed with a first operating system, and comprises the following steps: receiving metadata of at least one multimedia information of a second electronic device through a data channel established between the first electronic device and the second electronic device, the second electronic device being deployed with a second operating system different from the first operating system; generating a thumbnail of the at least one multimedia information according to the metadata of the at least one multimedia information; in a case where a first input is received on a first thumbnail of the thumbnail of the at least one multimedia information, sending a first request to the second electronic device, the first request being used to request a first multimedia information corresponding to the first thumbnail; receiving and processing the first multimedia information sent by the second electronic device.
2. The method of claim 1, wherein, After the receiving and processing the first multimedia information sent by the second electronic device, the method further comprises the following steps: storing the processed first multimedia information and metadata of the processed first multimedia information; generating a thumbnail of the processed first multimedia information according to the metadata of the processed first multimedia information; and sending the processed first multimedia information to the second electronic device.
3. The method of claim 1, wherein, Before the receiving metadata of at least one multimedia information of a second electronic device through a data channel established between the first electronic device and the second electronic device, the method further comprises the following steps: in a case where the first electronic device and the second electronic device are in the same local area network, establishing the data channel between the first electronic device and the second electronic device, a first account identifier logged in the first electronic device being the same as a second account identifier logged in the second electronic device.
4. The method of claim 3, wherein, The establishing the data channel between the first electronic device and the second electronic device comprises the following steps: receiving a first message broadcast by the second electronic device, the first message carrying the second account identifier logged in the second electronic device; in a case where the second account identifier is the same as a first account identifier logged in the first electronic device, establishing a first channel between the first electronic device and the second electronic device; receiving first information sent by the second electronic device through the first channel, the first information comprising first network information of a network in which the second electronic device is located; in a case where it is determined, based on the first network information and second network information of a network in which the first electronic device is located, that the second electronic device and the first electronic device are in the same local area network, establishing the data channel between the first electronic device and the second electronic device.
5. The method of claim 4, wherein, The method further comprises the following steps: in a case where it is determined, based on the first network information and second network information of a network in which the first electronic device is located, that the second electronic device and the first electronic device are not in the same local area network, outputting first prompt information, the first prompt information being used to prompt the first electronic device and the second electronic device to be connected to the same local area network. In a case that the first electronic device switches to a network where the second electronic device is located or the second electronic device switches to a network where the first electronic device is located, the data channel with the second electronic device is established.
6. The method of claim 1, wherein, The method further includes at least one of: In a case that the data channel is detected to be disconnected or the data channel connection is detected to be timed out or failed, second prompt information is outputted, the second prompt information being used to prompt that the connection is disconnected; In a case that the first channel between the first electronic device and the second electronic device is detected to be disconnected, third prompt information is outputted, the third prompt information being used to prompt that the first channel is interrupted; In a case that the cross-transmission application is detected to be switched to run in the background, fourth prompt information is outputted, the fourth prompt information being used to prompt to switch the cross-transmission application to run in the foreground, the cross-transmission application being used to establish a control channel and / or a data channel between the first electronic device and the second electronic device; In a case that a multimedia information writing error notification is received, fifth prompt information is outputted, the fifth prompt information being used to prompt that the storage space is insufficient.
7. A multimedia information processing method, characterized by, The method is applied to a second electronic device where a second operating system is deployed, and the method includes: sending, to the first electronic device, metadata of at least one multimedia information of the second electronic device through the established data channel between the first electronic device and the second electronic device, the first electronic device being deployed with a first operating system different from the second operating system; receiving a first request sent by the first electronic device, the first request being used to request a first multimedia information corresponding to a first thumbnail in a thumbnail of the at least one multimedia information; sending, to the first electronic device, the first multimedia information in response to the first request.
8. The method of claim 7, wherein, After the sending, to the first electronic device, of the first multimedia information, the method further includes: receiving processed first multimedia information obtained by processing the first multimedia information sent by the first electronic device; storing the processed first multimedia information in the second electronic device.
9. The method of claim 7, wherein, Before the sending, to the first electronic device, of the metadata of the at least one multimedia information of the second electronic device through the established data channel, the method further includes: in a case that the first electronic device is located in a same local area network as the second electronic device, establishing the data channel with the first electronic device, a first account identifier logged in the first electronic device being same as a second account identifier logged in the second electronic device.
10. The method of claim 9, wherein, The establishing of the data channel with the first electronic device includes: broadcasting a first message, the first message carrying the second account identifier logged in the second electronic device; sending, to the first electronic device through a first channel, first information, the first information including first network information of a network where the second electronic device is located, the first channel being a channel established in a case that the second account identifier is same as a first account identifier logged in the first electronic device; establish the data channel with the first electronic device, the data channel being established in a case where it is determined, based on the first network information and second network information of a network in which the first electronic device is located, that the second electronic device and the first electronic device are in the same local area network, or being established in a case where the first electronic device switches to a network in which the second electronic device is located or the second electronic device switches to a network in which the first electronic device is located.
11. The method of claim 7, wherein, The method further includes at least one of: outputting second prompt information in a case where it is detected that the data channel is disconnected or the data channel connection times out or fails, the second prompt information being used to prompt that the connection has been disconnected; outputting third prompt information in a case where it is detected that a first channel between the first electronic device and the second electronic device is disconnected, the third prompt information being used to prompt that the first channel has been interrupted; outputting fourth prompt information in a case where it is detected that the cross-transmission application switches to background running, the fourth prompt information being used to prompt that the cross-transmission application is switched to foreground running, the cross-transmission application being used to establish a control channel and / or a data channel between the first electronic device and the second electronic device; outputting sixth prompt information in a case where a multimedia information access permission error notification is received, the sixth prompt information being used to prompt multimedia information access authorization.
12. A multimedia information processing apparatus, characterized by comprising: The apparatus is applied to a first electronic device in which a first operating system is deployed, and the apparatus includes: a first processing module configured to receive metadata of at least one multimedia information of a second electronic device sent by the second electronic device through an established data channel between the first electronic device and the second electronic device, the second electronic device being deployed with a second operating system different from the first operating system, and store the metadata of the at least one multimedia information; a first generating module configured to generate a thumbnail of the at least one multimedia information according to the metadata of the at least one multimedia information; a first sending module configured to send a first request to the second electronic device in a case where a first input to a first thumbnail in the thumbnail of the at least one multimedia information is received, the first request being used to request a first multimedia information corresponding to the first thumbnail; a second processing module configured to receive and process the first multimedia information sent by the second electronic device.
13. A multimedia information processing apparatus, characterized by comprising: The apparatus is applied to a second electronic device in which a second operating system is deployed, and the apparatus includes: a second sending module configured to send metadata of at least one multimedia information of the second electronic device to a first electronic device through an established data channel between the first electronic device and the second electronic device, the first electronic device being deployed with a first operating system different from the second operating system; a first receiving module configured to receive a first request sent by the first electronic device, the first request being used to request a first multimedia information corresponding to a first thumbnail in a thumbnail of the at least one multimedia information; a third sending module configured to send the first multimedia information to the first electronic device in response to the first request.