Multimedia resource access method and electronic equipment
By providing multimedia resource access methods in electronic devices, allowing users to access the gallery of other electronic devices in the local machine, the problem of only accessing the gallery of the local machine in the existing technology is solved, and flexible access and convenience of multiple device galleries are achieved.
Patent Information
- Application Number
- CN202311085365.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-25
- Publication Date
- 2025-03-04
AI Technical Summary
In the prior art, electronic devices can only access multimedia resources in the local gallery, and cannot flexibly access multimedia resources in the gallery of other electronic devices.
It provides a method of accessing multimedia resources, through the display interface, allowing users to access multimedia resources in the gallery of other electronic devices in the local machine, and realize switching access to multiple device galleries.
It realizes accessing albums in at least two devices except the unit in this machine, improving access convenience and making it easier for users to obtain more album resources.
Smart Images

Figure CN119561952A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of terminal technology, and in particular to a method for accessing multimedia resources and an electronic device. Background Art
[0002] When using electronic devices such as mobile phones and tablets, multimedia resources such as pictures and videos in a gallery can usually be accessed. However, in the prior art, electronic devices can usually only access multimedia resources in the gallery of the local device. Summary of the invention
[0003] The present application provides a method for accessing multimedia resources and an electronic device, whereby the electronic device can flexibly access the multimedia resources in the gallery of other electronic devices in the local device.
[0004] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:
[0005] In a first aspect, the present application provides a method for accessing multimedia resources, including: a first device displays a first interface (such as an album page), the first interface includes a first area and a second area, a first option, a second option and a third option are displayed in the first area, the first option corresponds to the first device, the second option corresponds to the second device, the third option corresponds to the third device, and the preview information of the album in the first device is displayed in the second area. In response to the selection operation of the second option, the first device displays the preview information of the album in the second device in the second area. In response to the selection operation of the third option, the first device displays the preview information of the album in the third device in the second area.
[0006] In summary, by using the present application, the first device can switch to access the second device and the photo album in the second device in the first interface. First, the first device can access the photo albums in at least two devices other than the first device, which is convenient for the user to obtain more photo albums in the first device. Second, during the switching access process, the user does not need to perform operations such as returning, which improves the convenience of access.
[0007] In a possible design of the first aspect, after the first device displays the preview information of the album in the second device in the second area, in response to the access operation to the first album of the second device in the first interface, the first device displays the second interface (such as a grid page), and the second interface includes thumbnails of multimedia resources in the first album. In response to the viewing operation of the first thumbnail in the second interface, the first device displays a third interface (such as a large picture page), and the third interface is used to display the first multimedia resource corresponding to the first thumbnail. In other words, the multimedia resources in the album can also be further viewed on the first device. Subsequently, after the first device is disconnected from the second device, in response to the return operation to the third interface, the first device displays a fourth interface, the fourth interface includes the first option and the third option, and the fourth interface does not include the preview information of the album in the second device.
[0008] That is, after the first device and the second device are disconnected, in response to the operation of returning to the grid page, the first device will not return to the grid page normally, but will directly return to the album page, and will not provide preview information of the album in the second device in the album page. In this way, it can be ensured that after the first device and the second device are disconnected, too much information of multimedia resources in the second device will not be presented to the user.
[0009] In a possible design manner of the first aspect, the fourth interface also includes a second option.
[0010] In a possible design of the first aspect, in response to a return operation to the third interface, the first device displays a fourth interface including a second option, including: in response to a return operation to the third interface, the first device can search for the second device, and the first device displays the fourth interface including the second option.
[0011] That is to say, after the first device and the second device are disconnected, if the first device can still search for the second device, such as the second device moves away from the first device and then approaches the first device, the second device can continue to be provided with options so as to access the photo album in the second device again.
[0012] In a possible design manner of the first aspect, the fourth interface does not include the second option.
[0013] In a possible design of the first aspect, in response to a return operation to the third interface, the first device displays a fourth interface that does not include the second option, including: in response to a return operation to the third interface, the first device does not search for the second device, and the first device displays the fourth interface that does not include the second option.
[0014] That is, after the first device and the second device are disconnected, if the first device cannot search for the second device, such as the second device moves away from the first device and is no longer close to the first device, the option of the second device is no longer provided to avoid providing unavailable options.
[0015] In a possible design of the first aspect, after the first device displays the third interface, in response to a return operation to the third interface, the first device is not disconnected from the second device, and the first device displays the second interface. In response to the return operation to the second interface, the first device displays the first interface in the second area including preview information of the album in the second device.
[0016] That is to say, if the first device is not disconnected from the second device, the first device can normally return from the third interface to the second interface and then return to the first interface, and can continue to display the preview information of the album in the second device in the first interface, so as to facilitate returning to select multimedia resources.
[0017] In a possible design of the first aspect, in response to a return operation to the third interface, the first device displays a fourth interface, including: in response to a return operation to the third interface, the first device detects a disconnection with the second device, and the first device displays the fourth interface.
[0018] In practice, the moment when the first device and the second device are disconnected may not be the same as the moment when the first device and the second device are detected to be disconnected. Usually, the moment when the disconnection is detected is after the moment of the disconnection. At the same time, only after the disconnection is detected can the first device respond to the disconnection scenario. Therefore, in response to the operation of returning to the grid page and detecting the disconnection, the first device will display the fourth interface that does not include the preview information of the album in the second device.
[0019] In a possible design of the first aspect, in response to a return operation to the third interface, the first device detects a disconnection with the second device, and the first device displays a fourth interface, including: in response to a return operation to the third interface at a first moment, the first device displays the fourth interface, the first moment being after the first device detects a disconnection with the second device. That is, in response to the operation of returning to the grid page at the first moment after the disconnection is detected, the first device will display the fourth interface that does not include preview information of the album in the second device.
[0020] And, the method further includes: in response to a return operation to the third interface at a second time, the first device displays the second interface; wherein the second time is a time after the first device is disconnected from the second device, but before the first device detects the disconnection with the second device. That is, in response to the operation of returning to the grid page at the second time after the disconnection but before the disconnection is detected, the first device can still return to the grid page normally to provide thumbnails of multimedia resources for selection and viewing.
[0021] In a possible design of the first aspect, the first device includes a data middle platform and a first application, and the first application includes a gallery application, or the first application includes an application with permission to access the gallery application, such as a chat application, an image editing application, etc. After the first device is disconnected from the second device, the data middle platform detects that the first device and the second device are disconnected. The data middle platform sends a disconnection notification to the first application, and the disconnection notification is used to indicate that the first application is not allowed to access the data middle platform. Accordingly, in response to the return operation to the third interface, the first device displays the fourth interface, including: in response to the return operation to the third interface, the first application has received the disconnection notification, and the first application displays the fourth interface.
[0022] That is, the first application can accurately determine that it is currently in a disconnection scenario through the disconnection notification, and in response to the operation of returning to the grid page, display the fourth interface that does not include preview information of the album in the second device.
[0023] By adopting this design method, especially for external applications such as chat applications and video editing applications, the data security in the second device can be further guaranteed.
[0024] In a possible design of the first aspect, the third interface further includes a preset operation control, and the preset operation control includes a save control and / or a copy control. After the first device displays the third interface, the method further includes: in response to a selection operation of the preset operation control, the first device saves the first multimedia resource to the second album of the first device.
[0025] That is to say, the first device can also copy or save the multimedia resources in the second device to the first device.
[0026] In a possible design of the first aspect, the first multimedia resource is a static image, or the first multimedia resource is a video, but the first device has not played the video in the third interface. In response to the selection operation of the preset operation control, the first device saves the first multimedia resource to the second album of the first device, including: in response to the selection operation of the preset operation control, the first device displays a first prompt in the third interface, and the first prompt is used to prompt that the file is being transferred. After the file transfer is completed, the first device saves the first multimedia resource to the second album.
[0027] Among them, for static images or videos that have not been played on the large image page, the first device has not yet obtained the original image information. Therefore, in response to the user's selection operation of the preset control, the first device needs to obtain the original image information from the second device, which is a time-consuming process. Based on this, by displaying the first prompt, it can be clearly indicated that the user needs to wait.
[0028] In a possible design of the first aspect, the first multimedia resource is a dynamic picture, or the first multimedia resource is a video and the first device has played the video in the third interface. In response to the selection operation of the preset operation control, the first device does not display the first prompt.
[0029] Among them, for dynamic pictures or videos that have been played on the large picture page, the first device has already obtained the original image information. Therefore, in response to the user's selection operation of the preset control, the first device only needs to obtain the original image information from the local, which takes a very short time, and the first prompt may not be displayed, but the result of the preset operation, such as the result of successful saving or successful copying, may be directly presented.
[0030] In a possible design manner of the first aspect, the preset operation control is a save control, and the second photo album is a photo album named after the second device.
[0031] This makes it easier to distinguish multimedia resources from different devices.
[0032] In a possible design of the first aspect, after the first device saves the first multimedia resource to the second album of the first device, the method also includes: the first device displays a fifth interface, the fifth interface includes preview information of the album in the first device, and the preview information of the second album is located after the preview information of the last system album in the album of the first device.
[0033] In this way, it is convenient to quickly locate the album storing multimedia resources from other devices after the system album.
[0034] In a possible design of the first aspect, the preset operation control is a copy control. In response to a selection operation on the preset operation control, the first device saves the first multimedia resource to a second album of the first device, including: in response to a selection operation on the preset operation control, the first device displays preview information of the album in the first device. In response to a selection operation on the second album in the first device, the first device saves the first multimedia resource to the second album of the first device.
[0035] That is to say, the first device can accurately copy the multimedia resources from the second device to the album specified by the user.
[0036] In a possible design of the first aspect, the method further includes: the first device displays a sixth interface, the sixth interface includes photos in the first device, and in the process of displaying the sixth interface, the first device searches for the second device and the third device. Accordingly, the first device displays the first interface, including: in response to an operation of switching to an album page, the first device displays the first interface, the second option and the third option are located after the first option, and the second option and the third option are sorted according to the priority of the second device and the third device.
[0037] That is to say, before entering the first interface, the options of other devices discovered by the first device can be displayed in the first device according to the priority of the devices. In this way, the options of the devices with high priority can be displayed in front for easy viewing.
[0038] In a possible design of the first aspect, in response to the selection operation of the second option, the first device displays preview information of the photo album in the second device in the second area, including: if the number of devices connected to the first device has not reached the first number, in response to the selection operation of the second option, the first device displays preview information of the photo album in the second device in the second area.
[0039] That is to say, only when the number of devices connected to the first device is within the first number, can the first device continue to establish a connection with the second device and obtain and display the album information in the second device.
[0040] In a possible design of the first aspect, in response to the selection operation of the second option, the first device displays preview information of the album in the second device in the second area, including: if the first device has been connected to the first number of devices, in response to the selection operation of the second option, the first device displays a first window, the first window includes device options corresponding to the first number of connected devices, the first number of device options includes a first device option, and the first device option corresponds to a fourth device. In response to the disconnection operation of the first device option, the first device is disconnected from the fourth device. The first device displays preview information of the album in the second device in the second area.
[0041] That is, when the number of devices connected to the first device exceeds the first number, the first device needs to disconnect from one of the connected devices before it can continue to establish a connection with the second device and obtain and display the album information in the second device.
[0042] In a possible design of the first aspect, the method further includes: if the number of devices connected to the first device has reached the first number, in response to a selection operation of the second option, the first device displays the first window. In response to an operation of instructing to close the first window, the first device displays a prompt message in the second area that the number of devices connected has exceeded the upper limit.
[0043] That is, when the number of devices connected to the first device exceeds the first number, the first device may continue to maintain connection with the connected devices based on the user's selection, instead of connecting to new devices.
[0044] In a second aspect, the present application further provides an electronic device, comprising: a display screen, a memory and one or more processors, wherein the memory is coupled to the processor; wherein the memory stores computer program code, the computer program code includes computer instructions, and when the computer instructions are executed by the processor, the electronic device executes the method in the above-mentioned first aspect and any possible design thereof.
[0045] In the third aspect, the present application also provides a chip system, which is applied to an electronic device including a display screen, a processor and a memory. The chip system includes one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected through lines. The interface circuit is used to receive signals from the memory and send signals to the processor. The signals include computer instructions stored in the memory. When the processor executes the computer instructions, the electronic device executes the method in the above-mentioned first aspect and any possible design method thereof.
[0046] In a fourth aspect, the present application further provides a computer-readable storage medium, comprising computer instructions, which, when executed on an electronic device, enables the electronic device to execute the method in the first aspect and any possible design thereof.
[0047] In a fifth aspect, the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the method of the first aspect and any possible design thereof.
[0048] It can be understood that the beneficial effects that can be achieved by the electronic device, chip system, computer storage medium, and computer program product provided above can refer to the beneficial effects in the first aspect and any possible design method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] Figure 1 A schematic diagram of a networking form provided in an embodiment of the present application;
[0050] Figure 2A schematic diagram of another networking form provided in an embodiment of the present application;
[0051] Figure 3A A schematic diagram of the principle of synchronizing multimedia resources across devices provided in an embodiment of the present application;
[0052] Figure 3B A hardware structure diagram of a mobile phone provided in an embodiment of the present application;
[0053] Figure 4 One of the schematic diagrams of the mobile phone interface provided in the embodiment of the present application;
[0054] Figure 5 The second schematic diagram of the mobile phone interface provided in the embodiment of the present application;
[0055] Figure 6 The third schematic diagram of the mobile phone interface provided in the embodiment of the present application;
[0056] Fig. 7A A fourth schematic diagram of a mobile phone interface provided in an embodiment of the present application;
[0057] Figure 7B A fifth schematic diagram of a mobile phone interface provided in an embodiment of the present application;
[0058] Figure 7C The sixth schematic diagram of the mobile phone interface provided in the embodiment of the present application;
[0059] Figure 8 Schematic diagram of the mobile phone interface provided in the embodiment of the present application.
[0060] Fig. 9 The eighth schematic diagram of the mobile phone interface provided in the embodiment of the present application;
[0061] Fig.10 A schematic diagram of multimedia resource access in a disconnected scenario provided in an embodiment of the present application;
[0062] Fig.11 A ninth schematic diagram of a mobile phone interface provided in an embodiment of the present application;
[0063] Fig.12 The tenth schematic diagram of the mobile phone interface provided in the embodiment of the present application;
[0064] Fig.13 Schematic diagram eleven of a mobile phone interface provided in an embodiment of the present application;
[0065] Fig.14 The twelfth schematic diagram of the mobile phone interface provided in the embodiment of the present application;
[0066] Fig.15 13th schematic diagram of a mobile phone interface provided in an embodiment of the present application;
[0067] Fig.16 Schematic diagram 14 of a mobile phone interface provided in an embodiment of the present application;
[0068] Fig.17A The fifteenth schematic diagram of the mobile phone interface provided in the embodiment of the present application;
[0069] Fig. 17B Schematic diagram 16 of the mobile phone interface provided in the embodiment of the present application;
[0070] Fig.18 Schematic diagram seventeen of a mobile phone interface provided in an embodiment of the present application;
[0071] Fig.19 The eighteenth schematic diagram of the mobile phone interface provided in the embodiment of the present application;
[0072] Fig. 20 The nineteenth schematic diagram of the mobile phone interface provided in the embodiment of the present application;
[0073] Fig.21 Schematic diagram 20 of a mobile phone interface provided in an embodiment of the present application;
[0074] Fig. 22 Schematic diagram 21 of the mobile phone interface provided in the embodiment of the present application;
[0075] Fig.23 Schematic diagram 22 of the mobile phone interface provided in the embodiment of the present application;
[0076] Fig.24 Schematic diagram 23 of the mobile phone interface provided in the embodiment of the present application;
[0077] Fig.25 Schematic diagram 24 of the mobile phone interface provided in the embodiment of the present application;
[0078] Fig.26 This is schematic diagram twenty-fifth of the mobile phone interface provided in the embodiment of the present application. DETAILED DESCRIPTION
[0079] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear indication to the contrary in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in a "or" relationship.
[0080] The method for accessing multimedia resources provided in the embodiment of the present application can be applied to the communication system provided in the embodiment of the present application, and the communication system includes multiple electronic devices. Any electronic device can be a mobile phone, a tablet, a smart screen, etc. Not limited to this, the electronic device can also be a personal computer (personal computer, PC), a personal digital assistant (personal digital assistant, PDA), an augmented reality (augmented reality, AR) device, a virtual reality (virtual reality, VR) device, etc. The above-mentioned electronic device can also be other portable electronic devices, such as a laptop computer (Laptop), etc.
[0081] The same user account (such as a Honor account) is logged in to the above-mentioned multiple electronic devices, or user accounts with a trust relationship such as mutual family accounts, mutual workgroup accounts, etc. are logged in to multiple electronic devices.
[0082] It is understandable that multiple electronic devices logged in with the same user account or logged in with a trusted user account can be added to the same trust ring through identity authentication after being close to each other (such as within the Bluetooth communication range). Any electronic device in the trust ring can discover (or search for) other electronic devices in the trust ring.
[0083] After the wireless local area network (WLAN) is turned on, the above-mentioned multiple electronic devices can access the network provided by the same access device. After accessing the same network, the multiple electronic devices can achieve communication connection and data transmission based on the network.
[0084] In a specific implementation, the access device is a router. Figure 1 The mobile phone 110, tablet 120, smart screen 130 and laptop computer 140 shown in the figure are connected to the device Figure 1 The router 150 shown. After the mobile phone 110, the tablet 120, the smart screen 130 and the laptop 140 turn on WLAN, the mobile phone 110, the tablet 120, the smart screen 130 and the laptop 140 can access the WLAN network of the router 150. Subsequently, the mobile phone 110, the tablet 120, the smart screen 130 and the laptop 140 can realize communication connection and data transmission through the router.
[0085] In another specific implementation, the access device is one of the multiple electronic devices. Figure 2 The tablet 210, smart screen 220 and mobile phone 230 shown in the figure are accessed by the mobile phone 230. Among them, the mobile phone 230 has turned on the WLAN hotspot. After the tablet 210 and the smart screen 220 turn on WLAN, they can access the WLAN hotspot of the mobile phone 230. Subsequently, the tablet 210 and the smart screen 220 can be transferred through the mobile phone 230 to achieve communication connection and data transmission; and the mobile phone 230 can achieve communication connection and data transmission with the tablet 210 and the smart screen 220.
[0086] In the above communication system, multiple electronic devices can discover each other. Moreover, for any electronic device, a communication connection can be established with the discovered electronic device and multimedia resources such as pictures and videos can be transmitted to realize the sharing of multimedia resources among multiple electronic devices. This is equivalent to that any electronic device in the above communication system can access the multimedia resources in each electronic device in the communication system across devices.
[0087] Furthermore, the sharing of multimedia resources among multiple electronic devices can be achieved through a data middle platform.
[0088] Multiple electronic devices including Figure 3ATaking the mobile phone 230 and the tablet 210 in the example, and the mobile phone 230 accesses the multimedia resources in the tablet 210, the mobile phone 230 includes a data middle platform 1, and also includes a gallery application, other applications (such as chat applications, image editing applications) and other applications that have the need (or permission) to access multimedia resources across devices. And, the tablet 210 includes a data middle platform 2, and also includes a gallery application that can provide multimedia resources. It should be noted that the data of the mobile phone 230 can also be accessed from the tablet 210. The user may need to create some content on the tablet 210, such as editing manuscripts that require illustrations, editing videos, etc., and can enter the interface for accessing data across devices through the interface of applications such as note applications or social applications, and obtain data from other devices such as the mobile phone 230.
[0089] After the mobile phone 230 and the tablet 210 establish a communication connection, the data center 2 can synchronize the album information in the gallery application of the tablet 210, such as the album cover, album name, the number of multimedia resources included in the album, and the thumbnails of the multimedia resources included in the album, to the data center 1. After the data center 1 receives the album information in the tablet 210, the gallery application or other applications in the mobile phone 230 can obtain and display the album information in the tablet 210 by accessing the data center 1. For example, the album in the tablet 210 is displayed in the album page of the gallery application, and the thumbnails of the multimedia resources in the album of the tablet 210 are displayed in the grid page.
[0090] Of course, other applications in the mobile phone 230 can also access the gallery application of the mobile phone 230 to view the local multimedia resources of the mobile phone 230.
[0091] Also, when the gallery application or other applications in the mobile phone 230 need to obtain more image information in the gallery application of the tablet 210, such as the original image information of various multimedia resources, the gallery application or other applications in the mobile phone 230 can request more image information from the data center 1 by accessing the data center 1. The data center 1 can request more image information from the gallery application of the tablet 210 through the data center 2. Finally, the data center 2 can synchronize the obtained more image information to the data center 1. After the data center 1 receives more image information from the tablet 210, it can feed back to the gallery application or other applications in the mobile phone 230. In this way, the gallery application or other applications in the mobile phone 230 can respond based on more image information. For example, display large pictures, play dynamic pictures, play videos, save / copy multimedia resources, etc.
[0092] It should be noted that the process of the tablet 210 accessing the multimedia resources in the mobile phone 230 is similar. For example, the tablet 210 may also include other applications, and the gallery application or other applications in the tablet 210 may also obtain the information of the multimedia resources in the mobile phone 230 (such as album information, more image information) synchronized from the data platform 1 to the data platform 2 by accessing the data platform 2, and then respond based on the obtained information of the multimedia resources, such as displaying and playing.
[0093] The method for accessing multimedia resources provided in the embodiment of the present application can be applied to various electronic devices in the above-mentioned communication system. Among them, any electronic device among the multiple electronic devices can access the multimedia resources of other electronic devices among the multiple electronic devices, and can flexibly switch from accessing the multimedia resources of one electronic device among the other electronic devices to accessing the multimedia resources of another electronic device among the other electronic devices. For details, please refer to the following Figure 5 Instructions on accessing multimedia resources on other electronic devices.
[0094] Furthermore, any electronic device among the multiple electronic devices can also flexibly access multimedia resources in other electronic devices according to the connection status between it and other electronic devices among the multiple electronic devices. Figure 10-Figure 14 For more information about disconnection scenarios, see .
[0095] The following uses the mobile phone 230 as an example to illustrate the hardware structure of any electronic device among the multiple electronic devices. Figure 3B As shown, the mobile phone 230 may include: a processor 201, an external memory interface 202, an internal memory 221, a universal serial bus (USB) interface 203, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280 (such as including a pressure sensor 280E), a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc.
[0096] It is to be understood that the structure shown in this embodiment does not constitute a specific limitation on the mobile phone 230. In other embodiments, the mobile phone 230 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0097] The processor 201 may include one or more processing units, for example, the processor 201 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0098] The charging management module 240 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While the charging management module 240 charges the battery 242, it can also power the electronic device through the power management module 241.
[0099] The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 201. The power management module 241 receives input from the battery 242 and / or the charging management module 240, and supplies power to the processor 201, the internal memory 221, the external memory, the display screen 294, the camera 293, and the wireless communication module 260. In some embodiments, the power management module 241 and the charging management module 240 can also be set in the same device.
[0100] The wireless communication function of the mobile phone 230 can be realized through the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor and the baseband processor.
[0101] The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the mobile phone 230. The wireless communication module 260 can provide solutions for wireless communications including WLAN (such as (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR), etc., applied to the mobile phone 230.
[0102] In some embodiments, the mobile phone 230 can establish a trust loop and transmit data with other electronic devices (such as the tablet 210 ) through the wireless communication module 260 .
[0103] The mobile phone 230 implements the display function through a GPU, a display screen 294, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 201 may include one or more GPUs, which execute program instructions to generate or change display information.
[0104] The mobile phone 230 can realize the shooting function through the ISP, the camera 293, the video codec, the GPU, the display screen 294 and the application processor. The ISP is used to process the data fed back by the camera 293. The camera 293 is used to capture a static image or a video. In some embodiments, the mobile phone 230 may include 1 or N cameras 293, where N is a positive integer greater than 1.
[0105] The external memory interface 202 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 230. The external memory card communicates with the processor 201 through the external memory interface 202 to implement a data storage function. For example, files such as music and videos are stored in the external memory card.
[0106] The internal memory 221 may be used to store computer executable program codes, which include instructions. The processor 201 executes various functional applications and data processing of the mobile phone 230 by running the instructions stored in the internal memory 221. For example, in an embodiment of the present application, the processor 201 may execute the instructions stored in the internal memory 221, and the internal memory 221 may include a program storage area and a data storage area.
[0107] In some embodiments, the data storage function of the data center in the mobile phone 230 is implemented by the internal memory 221.
[0108] The mobile phone 230 can implement audio functions such as music playing and recording through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the earphone interface 270D, and the application processor.
[0109] The button 290 includes a power button, a volume button, etc. The button 290 can be a mechanical button. It can also be a touch button. The motor 291 can generate a vibration prompt. The motor 291 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. The indicator 292 can be an indicator light, which can be used to indicate the charging status, power changes, messages, missed calls, notifications, etc. The SIM card interface 295 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 295, or pulled out from the SIM card interface 295 to achieve contact and separation with the mobile phone 230. The mobile phone 230 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 295 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.
[0110] Furthermore, the software architecture of the electronic device may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture or a cloud architecture. The embodiments of the present application do not specifically limit this.
[0111] It is understandable that only after the electronic device enables the file sharing permission, the electronic device can share the multimedia resources in its gallery with other electronic devices.
[0112] For example, the mobile phone 230 may display Figure 4 Interface 401 is shown. Interface 401 is a setting interface for smart interconnection. Interface 401 includes setting items for various smart interconnection services, such as application continuation, call sharing, notification sharing, keyboard and mouse sharing, and also includes setting item 4011 for file sharing. The text "Closed" is displayed at setting item 4011 for file sharing, indicating that the permission for file sharing is not currently enabled. In response to the user clicking on setting item 4011 for file sharing, mobile phone 230 may display Figure 4 Interface 402 is shown. Interface 402 is a file sharing setting interface. Interface 402 includes a file sharing switch 4021. In response to the user clicking the switch 4021, the mobile phone 230 can enable the file sharing permission. For example, after enabling the file sharing permission, the mobile phone 230 can display Figure 4 Interface 403 is shown. Interface 403 is also a file sharing setting interface. Unlike interface 402, the switch 4031 for file sharing in interface 403 is in the on state. Subsequently, in response to the user's return operation on interface 403, mobile phone 230 may display interface 404. Interface 404 is also a smart interconnection setting interface. Unlike interface 401, the text "Enabled" is displayed at the setting item 4041 for file sharing in interface 404, indicating that the permission for file sharing is currently enabled.
[0113] Other electronic devices (such as tablet 210, smart screen 220) can also be similarly Figure 4 The process of enabling file sharing permissions is described in detail here.
[0114] Currently, the permission of file sharing can also be enabled by default in each electronic device. In this case, the process of enabling the permission of file sharing can be omitted.
[0115] In the following, the present application scheme is specifically described by taking accessing multimedia resources in the tablet 210 and the smart screen 220 in the mobile phone 230 as an example.
[0116] When the tablet 210 and the smart screen 220 have the file sharing permission turned on, the mobile phone 230 can access the multimedia resources in the tablet 210 and the smart screen 220 in the local computer. Specifically, the mobile phone 230 can access the multimedia resources in the tablet 210 and the smart screen 220 through the album page (also called the first interface) in the gallery application, or the mobile phone 230 can access the multimedia resources in the tablet 210 and the smart screen 220 through the image selector (also called the picture selector, photo selector) in other applications (such as chat applications, image editing applications, etc.) other than the gallery application. The following are respectively described:
[0117] For example, the mobile phone 230 may display Figure 5 Interface 501 shown is the album page of the gallery application. Interface 501 includes not only the albums in the mobile phone 230, but also the options corresponding to the tablet 210 and the smart screen 220 discovered by the mobile phone 230. For example, the option corresponding to the tablet 210 is "S's Pad" 5011 in interface 501, and the option corresponding to the smart screen 220 is "S's Smart Screen" 5012 in interface 501. In the album page, the options of each electronic device can be used to trigger access to the multimedia resources of the electronic device. That is, the options of each electronic device are the entrance to access multimedia resources across devices.
[0118] Continue to see Figure 5 In response to the user's selection operation (such as a click operation) of "S's Pad" 5011 in the interface 501, the mobile phone 230 can establish a communication connection with the tablet 210, and transmit the album information in the tablet 210 based on the established communication connection, such as the album cover, album name, the number of multimedia resources included in the album, and the thumbnails of the multimedia resources included in the album. For example, in the process of establishing the communication connection and transmitting the album information, the mobile phone 230 can display Figure 5 The interface 502 shown includes the text "Loading..." to prompt the user to wait. After the transfer of the album information is completed, the mobile phone 230 may display Figure 5The interface 503 shown includes preview information of the albums in the tablet 210, such as preview information of albums such as "All Photos", "Camera", and "My Favorites". The preview information includes the album name, album cover, and the number of multimedia resources in the album. For example, the number below the album name indicates the number of multimedia resources included in the corresponding album in the tablet 210. Subsequently, the mobile phone 230 can access multimedia resources such as pictures and videos in each album in the tablet 210.
[0119] In practice, if it takes a short time to establish a connection and transmit the album information, then the interface prompting the user to wait may not be displayed, such as interface 502.
[0120] In the album page, the mobile phone 230 can always display the options (also called the first option) of the local device (also called the first device) and the options (also called the second option, the third option...) of other devices (also called the second device, the third device...), and display the preview information of the album in the device corresponding to the currently selected option. In this way, it is convenient to flexibly switch to access the multimedia resources in the local device and other devices in the album page.
[0121] Continue to see Figure 5 After the mobile phone 230 displays the interface 503, in response to the user's selection operation of "S's smart screen" 5012 in the interface 503, the mobile phone 230 can establish a connection with the smart screen 220 and transmit the album information in the smart screen 220 based on the established communication connection. After the transmission of the album information is completed, the mobile phone 230 can display Figure 5 The interface 504 shown includes preview information of the albums in the smart screen 220, such as preview information of albums such as "All Photos", "Videos", and "My Favorites". Similarly, the preview information includes the album name, album cover, and the number of multimedia resources in the album. For example, the number below the album name indicates the number of multimedia resources included in the corresponding album in the smart screen 220. Subsequently, the mobile phone 230 can access multimedia resources such as pictures and videos in each album in the smart screen 220.
[0122] Obviously, in interfaces 501-504, there are always options for the local device (such as "local" 5010), options for the tablet 210 ("S's Pad" 5011) and options for the smart screen 220 ("S's smart screen" 5012). And, when the currently selected option is the local option, the preview information of the album in the local device is displayed in the album page (as shown in interface 501); when the currently selected option is the option for the tablet 210, the preview information of the album in the tablet 210 is switched to display in the album page (as shown in interface 503); when the currently selected option is the option for the smart screen 220, the preview information of the album in the smart screen 220 is switched to display in the album page (as shown in interface 504).
[0123] For the sake of convenience, the area in the album page that displays options for the local device and options for other devices may be referred to as the first area, and the area that displays preview information of the album may be referred to as the second area.
[0124] As another example, the mobile phone 230 may display Figure 6 The interface 601 shown in FIG. 6 is a conversation interface with Tom in a chat application. The interface 601 includes a "photo" 6011. In response to the user's selection operation on the "photo" 6011, the mobile phone 230 may display Figure 6 Interface 602 is shown. Interface 602 is an interface of an image selector in a chat application. Interface 602 includes thumbnails of images in the mobile phone 230. In response to an operation of expanding more devices, such as clicking on the inverted triangle 6021 to the right of "this device" in interface 602, the mobile phone 230 may display Figure 6 The interface 603 (also referred to as the first interface) shown is also an interface of the image selector. However, unlike the interface 602, the interface 603 also includes options corresponding to the tablet 210 and the smart screen 220 discovered by the mobile phone 230. For example, the option corresponding to the tablet 210 is "S's Pad" 6031 in the interface 603, and the option corresponding to the smart screen 220 is "S's Smart Screen" 6032 in the interface 603.
[0125] Continue to see Figure 6 In response to the user's selection operation (such as a click operation) of "S's Pad" 6031 in the interface 603, the mobile phone 230 can establish a communication connection with the tablet 210, and transmit the album information in the tablet 210 based on the established communication connection. Similarly, during the process of establishing the communication connection and transmitting the album information, the mobile phone 210 can also prompt "Loading..." ( Figure 6 After obtaining the album information of the tablet 210, the mobile phone 230 can display Figure 6The interface 604 shown includes the albums in the tablet 210 , such as “All Photos”, “Camera”, “My Favorites”, etc. Subsequently, the user can access multimedia resources such as pictures and videos in each album in the tablet 210 on the mobile phone 230 .
[0126] In the following, unless otherwise specified, the multimedia resources in the tablet 210 and the smart screen 220 are accessed through the album page of the gallery application as an example. However, the embodiment using the gallery application as an example in the following can be combined with the contents of other embodiments, such as Figure 6 The embodiments shown are combined.
[0127] When the mobile phone 230 establishes a communication connection with the tablet 210 or the smart screen 220, the connection may fail. In some embodiments, after the mobile phone 230 fails to establish a communication connection with the tablet 210 or the smart screen 220, the mobile phone 230 may display the reason for the connection failure. Among them, the reasons for the failure include that the communication channel is being occupied by other services (such as the "keyboard and mouse sharing" service), the tablet 210 or the smart screen 220 and the mobile phone 230 are no longer in the same network, etc.
[0128] For example, the mobile phone 230 may display Fig. 7A Interface 701 shown. Interface 701 includes options "S's Pad" 7011 and "S's Smart Screen" 7012 of tablet 210. When mobile phone 230 is using the "keyboard and mouse sharing" service, in response to the user's selection operation on "S's Pad" 7011 in interface 701, mobile phone 230 can display Fig. 7A Interface 702 is shown. Interface 702 is a prompt interface for connection failure. Interface 702 includes a prompt text "This machine is using keyboard and mouse sharing, please disconnect and try again." In addition, interface 702 also includes a reconnection control, such as "Reload" 7021, which is used to trigger the mobile phone 230 to reconnect with the tablet 210.
[0129] It is understandable that the mobile phone 230 can maintain connection with one or more devices at the same time. Of course, the number of devices that the mobile phone 230 can connect to at the same time is limited, for example, a maximum of a first number of devices can be connected at the same time. After the number of devices connected to the mobile phone 230 reaches the first number, in response to the user's selection operation of the option (also referred to as the second option) of another device (also referred to as the second device), the mobile phone 230 needs to disconnect from one of the connected devices first, and then establish a connection with another device.
[0130] In an exemplary scenario, the mobile phone 230 maintains connection with one or more devices at the same time, that is, a data transmission link has been established between the mobile phone 230 and the one or more devices, and the link has not been disconnected.
[0131] Among them, the mobile phone 230 can prompt the user to disconnect with a connected device (also called the fourth device) through a connection configuration window (also called the first window), and provide a selection control for the user to select the device to be disconnected through the connection configuration window.
[0132] Taking the first number as 3 as an example, the mobile phone 230 can connect to three devices at the same time. After the mobile phone 230 establishes a connection with the three devices (such as the tablet 210, the smart screen 220 and the mobile phone 710), the mobile phone 230 can display Figure 7B Interface 711 is an album page. Interface 711 includes an option “L’s phone” 7111 for another phone (such as phone 720) that phone 230 has not yet established a connection with. In response to the user’s selection operation (such as a click operation) of “L’s phone” 7111 in interface 711, phone 230 may display Figure 7B The interface 712 shown in the figure includes a prompt "Loading" 7121. During the display of the interface 712, the mobile phone 230 is trying to establish a connection with the mobile phone 720. During the connection attempt, the mobile phone 230 can detect that the number of devices currently connected to the mobile phone 230 has reached 3. In this scenario, the mobile phone 230 can display Figure 7B The interface 713 shown includes a connection configuration window 7131 .
[0133] Exemplarily, the connection configuration window 7131 can be used to select the device to be disconnected. The connection configuration window 7131 includes a prompt message 7132, which is used to prompt the user that the number of devices connected to the mobile phone 230 has reached the upper limit, and a connected device must be disconnected before accessing another device, such as the mobile phone 720.
[0134] In addition, the connection configuration window 7131 also includes options for connected devices and corresponding selection controls. There is a one-to-one correspondence between the options and selection controls for the above-mentioned connected devices. For example, the connection configuration window 7131 includes the option "S's Pad" 7133 for the tablet 210, the option "S's Smart Screen" 7134 for the smart screen 220, and the option "S's Phone" 7135 for the mobile phone 710 and their corresponding selection controls, such as the selection control for the tablet 210 is control 7136.
[0135] Continue to see Figure 7BIn response to the user's click operation on the control 7136, the mobile phone 230 can determine that the user indicates to disconnect from the tablet 210 (i.e., receives the disconnection operation), and the mobile phone 230 can disconnect from the tablet 210. After disconnecting from the tablet 210, the mobile phone 230 establishes a connection with the mobile phone 720, for example, establishes a data transmission link with the mobile phone 720. Then, the mobile phone 230 obtains information about multimedia resources in the mobile phone 720, such as album information, from the mobile phone 720 through the data transmission link. Afterwards, the mobile phone 230 can display Figure 7B The interface 714 shown shows preview information of the photo albums in the mobile phone 720. Subsequently, the mobile phone 230 can access multimedia resources such as pictures and videos in each photo album in the mobile phone 720.
[0136] When the mobile phone 230 is connected to a connected device (such as Figure 7B After the tablet 210 in the example shown is disconnected, in response to the user selecting the option of the disconnected device again, the mobile phone 230 can reconnect with the disconnected device. Similarly, before establishing a connection, if the number of connected devices exceeds the upper limit, the mobile phone 230 also needs to disconnect from a connected device first. For details, see Figure 7B The description is not repeated here.
[0137] The connection configuration window also includes a cancel control. In response to the user clicking the cancel control, the mobile phone 230 can continue to maintain the connection with the connected device without establishing a connection with another device.
[0138] For example, after the mobile phone 230 detects that the number of devices currently connected to the mobile phone 230 has reached the upper limit, the mobile phone can display Figure 7C The interface 721 shown in FIG. 721 includes a connection configuration window 7211, and the connection configuration window 721 includes a cancel control 7212. In response to the user clicking the cancel control 7212, the mobile phone 230 may display Figure 7C The interface 722 shown includes a prompt 7221, and the prompt 7221 includes the text "The number of device connections exceeds the upper limit, please disconnect and try again" to prompt that the number of connections exceeds the upper limit.
[0139] In addition, the interface 722 may further include a reload control 7222 . In response to a user clicking operation on the reload control 7222 , the mobile phone 230 may pop up a connection configuration window again, such as the display interface 721 .
[0140] In practice, the number of multiple electronic devices in the same trust ring can be more or less. For example, the number of multiple electronic devices is a small number such as 2 or 3; or, the number of multiple electronic devices is a large number such as more than 3. However, the options of electronic devices that can be displayed simultaneously in the album page are limited. Therefore, in the album page, the mobile phone 230 can display the options of electronic devices (such as tablet 210, smart screen 220) in order from the front to the back of the discovery time, so that the options of the electronic devices are arranged regularly according to the discovery time, so as to facilitate the user to find the corresponding options.
[0141] Here, it should be noted that: before displaying the album page, the electronic devices discovered by the mobile phone 230 are considered to be discovered at the same time. For example, the electronic devices discovered in the process of the mobile phone 230 displaying the desktop and the photo page of the gallery application (the photo page includes local photos, which can also be called the sixth interface) are considered to be discovered at the same time. In the process of displaying the album page, the electronic devices discovered by the mobile phone 230 are divided into the order of discovery. Of course, in the process of displaying the album page, the mobile phone 230 can also discover at least two electronic devices at the same time.
[0142] Furthermore, when the mobile phone 230 displays the album page, it can be sorted by preset device type and display the options of the electronic devices discovered at the same time, so that the options of the electronic devices discovered at the same time can also be arranged in sequence according to the device type, further facilitating the user to find the corresponding options from multiple electronic devices discovered at the same time. Among them, the device types include multiple items of mobile phones, tablets, smart screens, and PCs. The preset device type sorting can be any combination of the order of the above-mentioned multiple device types. For example, the preset device type sorting is as follows: mobile phone, tablet, PC, smart screen.
[0143] Taking the preset device type sequence of mobile phone, tablet, PC, and smart screen as an example, before displaying the album page (such as in the process of displaying the photo page of the gallery application), at time t1, the mobile phone 230 discovers the smart screen 220, and at time t2, the mobile phone 230 discovers the tablet 210. That is, the tablet 210 and the smart screen 220 can be regarded as being discovered at the same time. At time t3, in response to the operation of entering the album page, the mobile phone 230 can display Figure 8 Interface 801 is shown. Interface 801 is an album page. In interface 801, option "S's Pad" 8011 of tablet 210 is displayed in front, and option "S's Smart Screen" 8012 of smart screen 220 is displayed in the back. That is, the options of tablet 210 and smart screen 220 discovered at the same time are displayed in the order of preset device types. After displaying interface 801, at time t4, mobile phone 230 discovers mobile phone 810. That is, mobile phone 230 first discovers tablet 210 and smart screen 220, and then discovers mobile phone 810. At time t5 after discovering mobile phone 810, mobile phone 230 can display Figure 8Interface 802 shown. The difference from interface 801 is that interface 802 includes a prompt "Newly discovered 1 device, swipe left to view". Then, in response to the user's swiping operation from right to left in interface 802, mobile phone 230 can display interface 803. In interface 803, after "S's Pad" 8011 and "S's Smart Screen" 8012, the option "S's Phone 0" 8031 of mobile phone 810 is also displayed. That is, the options of tablet 210 and smart screen 220 discovered first are displayed in front, and the options of mobile phone 810 discovered later are displayed in the back.
[0144] Furthermore, the electronic devices discovered at the same time may include electronic devices of the same type. If the electronic devices discovered at the same time include electronic devices of the same type (referred to as same type devices), the mobile phone 230 may display the options of the same type devices according to the option names of the same type devices. For example, the options are sorted by the first letters of the English letters of the option names.
[0145] Still taking the preset device type order of mobile phone, tablet, PC, and smart screen as an example, the electronic devices discovered at the same time include tablet 210, smart screen 220, and tablet 820. Then, when mobile phone 230 displays the options of tablet 210, smart screen 220, and tablet 820, it can display the options of smart screen 220 after the options of tablet 210 and tablet 820. In addition, the option name of tablet 210 is "S's Pad" and the option name of tablet 820 is "C's Tablet". Among them, the first letter of "S's Pad" is S, and the first letter of "C's Tablet" is C, and C is before S. Then, mobile phone 230 can display the options of tablet 810 before the options of tablet 210.
[0146] After displaying the album in the tablet 210 (also referred to as the second device) on the album page, in response to the user's access operation to any album (also referred to as the first album), the mobile phone 230 can display the album's grid page (also referred to as the second interface). Each grid in the grid page displays a thumbnail of a picture or video in the album.
[0147] For example, the mobile phone 230 may display Fig. 9 Interface 901 is shown. Interface 901 is an album page. Interface 901 includes albums in tablet 210, such as "All Photos", "Camera", "My Favorites", etc. In response to the user's access operation (such as a click operation) to "Camera", mobile phone 230 can display Fig. 9 Interface 902 is shown. Interface 902 is a grid page of an album. Interface 902 includes thumbnails of multimedia resources such as pictures and videos included in the "camera" of tablet 210.
[0148] After the grid page is displayed, in response to a user viewing operation (hereinafter described as a click operation) on any thumbnail (also referred to as a first thumbnail) in the grid page, the mobile phone 230 may display a large picture page (also referred to as a third interface) of the multimedia resource (also referred to as the first multimedia resource) corresponding to the thumbnail. Fig. 9 By clicking the thumbnail 9021 in the interface 902, the mobile phone 230 can display Fig. 9 The interface 903 shown includes multimedia resources corresponding to the thumbnail 9021.
[0149] It is understandable that after the mobile phone 230 displays the multimedia resource corresponding to the thumbnail, in response to the user's return operation, the mobile phone 230 can return to the grid page. Fig. 9 Taking the click operation of the return button 9031 in the interface 903 as an example, in response to the user's Fig. 9 By clicking the return button 9031 in the interface 903, the mobile phone 230 can display Fig. 9 Interface 902 is shown.
[0150] Then, in response to the user's return operation on the grid page, the mobile phone 230 can return to the album page. Fig. 9 Taking the click operation of the return button 9022 in the interface 902 as an example, in response to the user's Fig. 9 By clicking the return button 9022 in the interface 902, the mobile phone 230 can display Fig. 9 Interface 901 is shown.
[0151] Above Fig. 9 The example of illustrates the response of the mobile phone 230 to the user's operation when there is a communication connection between the mobile phone 230 and the tablet 210.
[0152] In some scenarios, the tablet 210 may be disconnected from the mobile phone 230. For example, when the tablet 210 is away from the mobile phone 230, the connection with the mobile phone 230 may be disconnected. After the mobile phone 230 and the tablet 210 are connected, the data center 1 can detect whether the mobile phone 230 and the tablet 210 are disconnected. Fig.10 If the connection between the mobile phone 230 and the tablet 210 is detected to be disconnected, the data middle station 1 sends a disconnection notification to the gallery application or other applications. The disconnection notification is used to indicate that the gallery application or other applications are not allowed to access the data middle station 1. In this way, after the tablet 210 is disconnected from the mobile phone 230, the gallery application or other applications no longer have the authority to access the data middle station 1, and thus cannot continue to obtain information about multimedia resources in the tablet 210 from the data middle station 1, which can ensure the data security in the tablet 210.
[0153] In particular, when the other applications are applications provided by external manufacturers other than the developer of the mobile phone 230 (referred to as external applications or third-party applications, such as chat applications provided by external manufacturers), the use of Fig.10 The processing method shown can ensure that after the mobile phone 230 is disconnected from the tablet 210, the external application can no longer obtain the information of the multimedia resources in the tablet 210. It is understandable that compared with system applications such as gallery applications and note applications, the security of external applications is lower. Fig.10 The processing method shown, especially for external applications, can more effectively protect the data security in the tablet 210.
[0154] In the following, the picture gallery application is still used as an example to illustrate the response process after disconnection. The implementation process of other applications is similar. You only need to replace the picture gallery application in the following with other applications. This article will not go into details.
[0155] Furthermore, when the mobile phone 230 and the tablet 210 are disconnected (such as after the gallery application receives the disconnection notification), the gallery application can also respond accordingly based on the currently displayed interface and the different situations of whether the mobile phone 230 can discover the tablet 210, so as to ensure that after the tablet 210 and the mobile phone 230 are disconnected, the information of too much multimedia resources in the tablet 210 is not presented to the user.
[0156] In case 1, the currently displayed interface is an album page in the gallery application, and the album page includes the albums in the tablet 210 .
[0157] After the mobile phone 230 establishes a communication connection with the tablet 210, the mobile phone 230 (the gallery application in it) can display Fig.11 The interface 1101 shown is the album page of the gallery application. The currently selected option in the interface 1101 is "S's Pad" 11011 of the tablet 210, and the interface 1101 includes the albums in the tablet 210. That is, the album page includes the albums in the tablet 210. During the process of the mobile phone 230 (the gallery application in it) displaying the interface 1101, the mobile phone 230 and the tablet 210 are disconnected. At this time, the album information of the albums in the tablet 210 should still be stored in the cache of the gallery, and the albums in the tablet 210 can continue to be displayed.
[0158] After the mobile phone 230 and the tablet 210 are disconnected, if the mobile phone 230 can no longer find the tablet 210, in response to receiving the disconnection notification, the mobile phone 230 (the gallery application in it) will display Fig.11 Interface 1102 is shown. Interface 1102 is also an album page, but interface 1102 no longer includes the option of tablet 210, nor the album in tablet 210.
[0159] After the mobile phone 230 and the tablet 210 are disconnected, if the mobile phone 230 can still find the tablet 210, in response to receiving the disconnection notification, the mobile phone 230 (the gallery application in it) will display Fig.11 Interface 1103 is shown. Interface 1103 is also an album page, and includes the option "S's Pad" of tablet 210, but does not include the album in tablet 210, but prompts "Device connection has been disconnected, please reload".
[0160] That is, after detecting that the mobile phone 230 is disconnected from the tablet 210 , the mobile phone 230 does not continue to display the album in the tablet 210 in the album page, so as to prevent the user from obtaining the information of the album in the tablet 210 .
[0161] In case 2, the currently displayed interface is a grid page, and the grid page includes thumbnails of multimedia resources included in an album of the tablet 210 .
[0162] After the mobile phone 230 establishes a communication connection with the tablet 210, the mobile phone 230 (the gallery application in it) can display Fig.12 The interface 1201 shown is a grid page. The interface 1201 includes thumbnails of multimedia resources in the "Camera" album of the tablet 210, such as thumbnail 12011. That is, the grid page includes thumbnails of multimedia resources included in an album of the tablet 210. During the process of the mobile phone 230 (the gallery application therein) displaying the interface 1201, the mobile phone 230 and the tablet 210 are disconnected. In response to discovering the disconnection, the mobile phone 230 (the gallery application therein) can continue to use the information in the cache of the gallery application to display the grid page, such as continuing to display the interface 1201.
[0163] After the mobile phone 230 and the tablet 210 are disconnected, in response to the user's click operation on the thumbnail 12011 in the interface 1201, the mobile phone 230 (the gallery application in it) cannot obtain more image information corresponding to the thumbnail 12011, and cannot display the large image page, but will display Fig.12 Interface 1202 is shown. Interface 1202 is also a grid page, and interface 1202 includes a prompt "Device connection has been disconnected" to prompt that the mobile phone 230 is disconnected from the tablet 210 and cannot obtain more image information for display.
[0164] After the mobile phone 230 and the tablet 210 are disconnected, if the mobile phone 230 can no longer find the tablet 210, in response to the user clicking the return button 12012 in the interface 1201, the mobile phone 230 (the gallery application in it) will display Fig.12 Interface 1203 is shown. Interface 1203 is a photo album page, but interface 1203 does not include the option of tablet 210, nor does it include the photo album in tablet 210.
[0165] After the mobile phone 230 and the tablet 210 are disconnected, if the mobile phone 230 can still find the tablet 210, in response to the user clicking the return button 12012 in the interface 1201, the mobile phone 230 (the gallery application in the mobile phone 230) will display Fig.12 Interface 1204 is shown. Interface 1204 is an album page, which includes the option "S's Pad" of tablet 210, but does not include the album in tablet 210. Instead, it prompts "Device connection has been disconnected, please reload".
[0166] That is, after detecting that the mobile phone 230 is disconnected from the tablet 210 , the mobile phone 230 no longer continues to provide the user with a service for viewing the multimedia resources corresponding to the thumbnails, thereby preventing the user from obtaining the multimedia resources in the tablet 210 .
[0167] In case 3, the currently displayed interface is a large picture page, which may include a multimedia resource in the tablet 210 .
[0168] After the mobile phone 230 establishes a communication connection with the tablet 210, the mobile phone 230 (the gallery application in it) can display Fig.13 The interface 1301 shown is a large image page. The interface 1301 includes a picture 13011 in the "camera" of the tablet 210. That is, the large image page includes a multimedia resource in the tablet 210. During the process of the mobile phone 230 (the gallery application therein) displaying the interface 1301, the mobile phone 230 and the tablet 210 are disconnected. In response to discovering the disconnection, the mobile phone 230 (the gallery application therein) may continue to use the information in the cache of the gallery application to display the large image page, but at this time, the large image page may indicate that the device has been disconnected. For example, the mobile phone 230 (the gallery application therein) may display Fig.13 Interface 1302 is shown. Different from interface 1301, interface 1302 includes a prompt "Device disconnected".
[0169] After the mobile phone 230 and the tablet 210 are disconnected, if the mobile phone 230 can no longer find the tablet 210, then in response to the user clicking the return button 13021 in the interface 1302 (i.e., the return operation to the large image page), the mobile phone 230 (the gallery application in it) will not continue to use the information in the cache of the gallery application to display the grid page, that is, it will not return to the grid page, but will directly return to the album page (also called the fourth interface), such as displaying Fig.13 The interface 1303 shown is an album page, but the interface 1303 does not include the option “S’s Pad” for the tablet 210 .
[0170] After the mobile phone 230 and the tablet 210 are disconnected, if the mobile phone 230 can still find the tablet 210, in response to the user clicking the return button 13021 in the interface 1302, the mobile phone 230 (the gallery application in the mobile phone 230) will display Fig.13 Interface 1304 is shown. Interface 1304 is an album page, which includes the option "S's Pad" of tablet 210, but does not include the album in tablet 210. Instead, it prompts "Device connection is disconnected, please reload".
[0171] That is to say, after detecting that the mobile phone 230 is disconnected from the tablet 210, in response to the operation of returning to the grid page (such as clicking the return button 13021 in the interface 1302), the mobile phone 230 will not return to the grid page, but will directly return to the album page, and will not provide the albums in the tablet 210 in the album page.
[0172] At this point, it should be noted that there is a certain delay when the data center 1 detects whether the mobile phone 230 and the tablet 210 are disconnected. For example, the data center 1 detects whether the connection is disconnected once every 2 minutes, but the mobile phone 230 and the tablet 210 are disconnected at the moment between the two detections, that is, the delay is 1 minute. During this delay (also referred to as the second moment), the data center 1 will not send a disconnection notification to the gallery application, and the gallery application can continue to access the data center 1 to obtain information about multimedia resources in the tablet 210. Therefore, during this delay, the mobile phone 230 can also respond in the same way as before the mobile phone 230 is disconnected from the tablet 210, such as continuing to display the album page of the album including the tablet 210, continuing to enter the grid page to view thumbnails, and returning to the grid page normally from the large picture page.
[0173] For example, the mobile phone 230 (the gallery application in it) may display Fig.14 The interface 1401 shown in the figure includes a picture in the tablet 210. During the process of displaying the interface 1401, the mobile phone 230 is disconnected from the tablet 210, but the mobile phone 230 has not yet detected the disconnection with the tablet 210. In this case, in response to the user clicking the return button 14011 in the interface 1401, the mobile phone 230 (the gallery application in the mobile phone 230) can continue to obtain the information required to display the grid page from the data platform 1 or from the cache of the gallery application, so as to display the grid page. Fig.14 Interface 1402 is a grid page, and interface 1402 includes thumbnails of multimedia resources in the "camera" of tablet 210. Then, in response to the user clicking the return button 14021 in interface 1402, mobile phone 230 (the gallery application in it) can continue to obtain the information required to display the album page from data center 1 or from the cache of the gallery application, thereby displaying Fig.14Interface 1403 is shown. Interface 1403 is an album page, and interface 1403 includes the option "S's Pad" of tablet 210 and the album in tablet 210. That is, when mobile phone 230 is disconnected from tablet 210, but mobile phone 230 has not detected the disconnection with tablet 210, mobile phone 230 can normally return from the large picture page to the grid page, and further return from the grid page to the album page, and the album page includes the options and albums of tablet 210.
[0174] That is, only when the mobile phone 230 is disconnected from the tablet 210 and the disconnection is detected (such as recorded as the first moment), the mobile phone 230 will respond according to the above-mentioned situation 1 to situation 3.
[0175] After displaying the grid page, in response to the user clicking on any thumbnail in the grid page, mobile phone 230 can obtain information about the multimedia resource and display a large picture page (such as interface 1502, interface 1602, interface 1702 and interface 1703 below) by matching the resource type of the multimedia resource corresponding to the thumbnail.
[0176] The resource types of multimedia resources include static images, dynamic images (also called live images) and videos. Dynamic images include a static image and a video within a preset time (such as 1.5 seconds) before and after the static image is taken. The following are respectively explained:
[0177] First, static images.
[0178] In response to the user clicking on the thumbnail of the static picture in the grid page, the mobile phone 230 may display a large picture of the static picture.
[0179] In some embodiments, the mobile phone 230 (such as through the data middle platform 1) obtains the large image information of the static image from the tablet 210, and after obtaining the large image information, displays the large image of the static image based on the large image information.
[0180] It should be noted that the large image of the static image is not the original image of the static image, but a thumbnail larger than the thumbnail size displayed in the grid page. For example, the grid page displays a thumbnail of a first size, and the large image page displays a thumbnail of a second size, and the first size is smaller than the second size.
[0181] Take the grid page as Fig.15 Taking the interface 1501 shown in FIG. 15 as an example, the interface 1501 includes a thumbnail 15011. The thumbnail 15011 is a thumbnail of a static image. In response to the user clicking the thumbnail 15011 in the interface 1501, the mobile phone 230 can obtain the large image information corresponding to the thumbnail 15011 in the tablet 210, and after obtaining the large image information, the mobile phone 230 can display the large image information. Fig.15Interface 1502 is shown. Interface 1502 includes a large image 15021 corresponding to the thumbnail 15011.
[0182] That is to say, for a static picture, in response to a viewing operation of the user, the mobile phone 230 mainly obtains the large picture information of the static picture from the tablet 210 .
[0183] Second, dynamic pictures.
[0184] In response to the user clicking on the thumbnail of the dynamic picture in the grid page, the mobile phone 230 can display the original image of the dynamic picture. Specifically, the mobile phone 230 can first display the original image of the static picture in the dynamic picture, and in response to the user playing the static picture, the mobile phone 230 plays the video in the dynamic picture.
[0185] In some embodiments, the mobile phone 230 (e.g., through the data center 1) obtains the original image information of the static image and the original image information of the video in the dynamic image from the tablet 210. Subsequently, the mobile phone 210 displays the original image of the static image based on the original image information of the static image, and plays the video based on the original image information of the video.
[0186] Take the grid page as Fig.16 Taking the interface 1601 as an example, the interface 1601 includes a thumbnail 16011. The lower left corner of the thumbnail 16011 includes a dynamic picture icon 16012, which is used to indicate that the multimedia resource corresponding to the thumbnail 16011 is a dynamic picture. In response to the user clicking the thumbnail 16011 in the interface 1601, the mobile phone 230 can obtain the original image information of the static picture and video included in the dynamic picture corresponding to the thumbnail 16011.
[0187] After acquiring the original image information of the static image and video included in the dynamic image, the mobile phone 230 can display Fig.16 Interface 1602 is shown. Interface 1602 includes a static image 16021 of the dynamic image corresponding to thumbnail 16011. After interface 1602 is displayed, in response to a user's play operation (such as a long press operation) on static image 16021 in interface 1602, mobile phone 230 can play the video of the dynamic image corresponding to thumbnail 16011 in interface 1602.
[0188] That is to say, for dynamic pictures, in response to the user's viewing operation, the mobile phone 230 obtains the original image information of the static pictures and videos included in the dynamic pictures. It is understandable that the data volume of the video of the dynamic picture (usually only 2-3s) is usually small. Therefore, after receiving the user's viewing operation, the mobile phone 230 obtains the original image information and does not occupy too many resources. In addition, the static pictures and videos in the dynamic picture are a whole, and the user usually needs to view the overall effect. Therefore, after receiving the user's viewing operation, the mobile phone 230 obtains the original image information, which can facilitate the user to view the complete dynamic picture.
[0189] Third, video.
[0190] In response to the user clicking on the thumbnail of the video in the grid page, the mobile phone 230 can display the cover of the video. In some embodiments, the mobile phone 230 (such as the data center 1) obtains the cover information of the video from the tablet 210, and after obtaining the cover information, displays the cover of the video based on the cover information.
[0191] It should be noted that the cover of the video is not the original image, but a thumbnail that is larger than the thumbnail displayed in the grid page.
[0192] Take the grid page as Fig.17A Taking the interface 1701 shown in FIG. 17 as an example, the interface 1701 includes a thumbnail 17011. The lower left corner of the thumbnail 17011 includes the duration of the video "00:10". That is, the multimedia resource corresponding to the thumbnail 17011 is a video. In response to the user clicking the thumbnail 17011 in the interface 1701, the mobile phone 230 can obtain the cover information of the video corresponding to the thumbnail 17011, and after obtaining the cover information, the mobile phone 230 can display the video. Fig.17A Interface 1702 is shown. Interface 1702 includes a cover 17021 of the video corresponding to the thumbnail 17011.
[0193] After displaying the video cover, in response to the user's operation to play the video, the mobile phone 230 can play the video. In some embodiments, the mobile phone 230 (such as the data center 1) obtains the original image information of the video from the tablet 210, and plays the video after obtaining the original image information.
[0194] Continue to use Fig.17A For example, the mobile phone 230 displays Fig.17A After the interface 1702 is displayed, in response to the user clicking the play button 17022 in the interface 1702, the mobile phone 230 can obtain the original image information of the video corresponding to the thumbnail 17011 in the tablet 210, and after obtaining the original image information, the mobile phone 230 can play the video corresponding to the thumbnail 17011, such as Fig.17AAs shown in interface 1703, video 17031 starts playing.
[0195] That is, for a video, in response to a user's viewing operation, the mobile phone 230 first obtains the video cover information from the tablet 210, and then in response to the user's video play operation, the mobile phone 230 further obtains the original image information of the video from the tablet 210. It can be understood that the video data volume is large. Therefore, after receiving the user's viewing operation, the mobile phone 230 first obtains the cover information, which can avoid occupying too many resources in a short time.
[0196] In addition, after displaying the large image page, in response to the user's left and right sliding operation, the mobile phone 230 can also switch to display different multimedia resources. Taking the right sliding operation as an example, the mobile phone 230 can display Fig. 17B The interface 1711 shown in FIG. 17 includes a video 17111 (eg, a video cover). In response to a right swipe operation by the user in the interface 1711, the mobile phone 230 may display Fig. 17B The interface 1712 shown in the figure shows a dynamic image 17121 (such as a static image of a dynamic image). In response to the user's right swipe operation in the interface 1712, the mobile phone 230 can display Fig. 17B The interface 1713 shown in the figure shows a static image 17131 (such as a large image of a static image). Further, if a new image is generated in the "Camera" album of the tablet 210, in response to the user's right swipe operation in the interface 1713, the mobile phone 230 can also display Fig. 17B The interface 1714 shown in the figure shows a new image. In response to the user's right sliding operation in the interface 1713, the mobile phone 230 can obtain the information of the new image from the tablet 210, so as to display the new image.
[0197] After displaying the grid page, or in response to the user viewing operation on any thumbnail in the grid page, the mobile phone 230 obtains and displays the information of the multimedia resource, and then the mobile phone 230 can share, save, copy, edit, etc. the multimedia resource.
[0198] In a specific implementation, in response to a user viewing operation on any thumbnail in the grid page, the mobile phone 230 may display an operation control for the multimedia resource. The operation control includes at least one of the following: an operation control for a share operation, an operation control for a save operation (also referred to as a save control), an operation control for a copy operation (also referred to as a copy control), and an operation control for an edit operation.
[0199] For example, Fig.15 The bottom of the interface 1502 is shown. Fig.16The bottom of the interface 1602 is shown as well as Fig.17A The bottom of the interface 1702 and the interface 1703 shown include an operation control “Share” for a sharing operation, an operation control “Save” for a saving operation, an operation control “Copy” for a copy operation, an operation control “Edit” for an editing operation, and the like.
[0200] Subsequently, in response to the user's selection operation on the operation control, the mobile phone 230 may perform a corresponding operation on the multimedia resource corresponding to the thumbnail, such as sharing, editing, saving, copying, etc.
[0201] In another specific implementation, after displaying the grid page, the mobile phone 230 may receive a selection operation of the grid page by the user. The selection operation may be a long press operation of the user on any thumbnail in the grid page, or the selection operation may be a click operation of the user on a preset control in the grid page (used to trigger the mobile phone 230 to display the selection control and operation options). The following mainly takes the selection operation of the user long press operation on any thumbnail in the grid page as an example for explanation.
[0202] In response to the user's selection operation on the grid page, the mobile phone 230 may display a selection control in each thumbnail of the grid page, and display an operation option in the grid page. The selection control is used to trigger the mobile phone 230 to select the corresponding thumbnail. In this implementation, the operation options also include an operation control for the select all operation and an operation control for the create operation. Among them, the operation control for the select all operation is used to select thumbnails in batches; the operation control for the create operation is used to create a video using the selected images.
[0203] The grid page is Fig.18 Taking the interface 1801 shown in FIG. 18 as an example, in response to the user's long press operation on the thumbnail 18011 in the interface 1801, the mobile phone 230 may display Fig.18 Interface 1802 is shown. Interface 1802 is still a grid page, but different from interface 1801 in that each thumbnail in interface 1802 includes a selection control, such as thumbnail 18011 includes a selection control 18021. In addition, the bottom of interface 1802 also includes an operation control "Share" 18022 for sharing operations, an operation control "Save" 18023 for saving operations, an operation control "Copy" 18024 for copying operations, an operation control "Create" 18025 for creating operations, and an operation control "Select All" 18026 for selecting all operations.
[0204] In a specific implementation, in response to a user's long press operation on any thumbnail in the grid page, the mobile phone 230 can not only display the selection control and operation options, but also select the thumbnail. Fig.18In the example, in response to the user's long press operation on the thumbnail 18011 in the interface 1801, the selection control 18021 of the thumbnail 18011 in the interface 1802 displayed by the mobile phone 230 is in a selected state, indicating that the thumbnail 18011 is selected.
[0205] After displaying the selection control or the operation control of the select all operation in the grid page, in response to the user's selection operation on the thumbnail in the grid page, the mobile phone 230 can select the corresponding thumbnail. Subsequently, in response to the user's selection operation on the operation control, the mobile phone 230 can perform corresponding operations on the multimedia resources corresponding to the thumbnail, such as sharing, editing, saving, copying, etc.
[0206] Continue to use Fig.18 For example, the mobile phone 230 displays Fig.18 After the interface 1802 is shown, in response to the user selecting the thumbnail 18027 in the interface 1802, the mobile phone 230 can display Fig.18 Interface 1803 is shown. Thumbnail 18011 and thumbnail 18027 are selected in interface 1803. Subsequently, in response to the user's selection operation of "Share", "Save", or "Copy" at the bottom of interface 1803, mobile phone 230 may be triggered to share, save, or copy the multimedia resources corresponding to thumbnail 18011 and thumbnail 18027, respectively.
[0207] The following mainly takes the example of the mobile phone 230 saving and copying multimedia resources in response to the user's selection operation on the operation control in the large picture page as an example to illustrate the operation of the mobile phone 230 on the multimedia resources.
[0208] It is understandable that, whether saving a multimedia resource or copying a multimedia resource, the original image information of the multimedia resource is operated. Therefore, in response to the user's selection operation of the operation control for the save operation or the operation control for the copy operation, the mobile phone 230 can first obtain the original image information of the multimedia resource, and then operate the original image information.
[0209] In practice, before the mobile phone 230 receives the user's selection operation of the operation control for the save operation or the operation control for the copy operation, the mobile phone 230 may have already obtained the original image information of the multimedia resource (as described above). Fig.16 , Fig.17A For example, in the previous Fig.16 In the example of , the mobile phone 230 has already acquired the original image information of the dynamic picture. Fig.17A In the example of , the mobile phone 230 has obtained the original image information of the video. After obtaining the original image information, the mobile phone 230 can save the original image information locally (such as in the data center 1 or the gallery application).
[0210] It is understandable that obtaining the original image information of the multimedia resource locally is faster than obtaining the original image information from the tablet 210 .
[0211] Based on this, in some embodiments, after receiving the user's selection operation on the operation control of the save operation or the operation control of the copy operation, the mobile phone 230 can first detect whether the local cache includes the original image information of the multimedia resource to be saved or copied. If the local cache includes the original image information of the multimedia resource to be saved or copied, the locally stored original image information can be directly obtained for processing. If the local cache does not include the original image information of the multimedia resource to be saved or copied, the original image information of the multimedia resource to be saved or copied in the tablet 210 can be obtained, and the processing is performed after the original image information is obtained. In this way, in the case where there is a local cache, the duration of saving or copying can be shortened.
[0212] Among them, if the local area does not include the original image information of the multimedia resources to be saved or copied, it will take a long time to obtain the original image information, and the mobile phone 230 can prompt that the file is being transferred; if the local area includes the original image information of the multimedia resources to be saved or copied, the original image information can be quickly obtained and processed, and the mobile phone 230 does not need to prompt that the file is being transferred.
[0213] The following takes the saving process of static pictures, dynamic pictures and videos as examples to illustrate:
[0214] Example 1: Saving a static image.
[0215] Mobile phone 230 can display Fig.19 Interface 1901 is shown. Interface 1901 includes a large image of a static image in tablet 210 and "Save" 19011. "Save" 19011 is used to trigger mobile phone 230 to perform a save operation. In response to the user's selection operation of "Save" 19011 in interface 1901, mobile phone 230 can detect whether the local includes the original image information of the static image. Generally, at this time, mobile phone 230 has not yet obtained the original image information of the static image (as described above). Fig.10 That is, the mobile phone 230 can detect that the local does not include the original image information of the static image, and the mobile phone 230 needs to obtain the original image information of the static image in the tablet 210. For example, the mobile phone 230 can display Fig.19 Interface 1902 is shown. Interface 1902 includes a prompt text "Transferring..." to prompt that the file is being transferred. After obtaining the original image information of the static image, the mobile phone 230 can display Fig.19Interface 1903 is shown, and interface 1903 includes a prompt text "saved to the local "from S's Pad" album" to prompt that the saving is successful.
[0216] Example 2: Saving dynamic images.
[0217] Mobile phone 230 can display Fig. 20 The interface 2001 shown in FIG. 2001 includes an original image of a dynamic image in the tablet 210 and a "save" 20011. The "save" 20011 is used to trigger the mobile phone 230 to perform a save operation. In response to the user's selection operation of the "save" 20011 in the interface 2001, the mobile phone 230 can detect whether the local includes the original image information of the dynamic image. In general, at this time, the mobile phone 230 has already obtained the original image information of the dynamic image (as described above). Fig.11 That is, the mobile phone 230 can detect the original image information of the dynamic picture in the local area. Then, the mobile phone 230 can quickly obtain the original image information of the dynamic picture from the local area and save it. For example, the mobile phone 230 can display Fig. 20 Interface 2002 is shown. Interface 2002 includes a prompt text "saved to the local "from S's Pad" album" to prompt that the saving is successful.
[0218] Example 3: Saving a video.
[0219] Mobile phone 230 can display Fig.21 Interface 2101 is shown. Interface 2101 includes a cover of a video in tablet 210 and "Save" 21011. "Save" 21011 is used to trigger mobile phone 230 to perform a save operation. In response to the user's selection operation of "Save" 21011 in interface 2101, mobile phone 230 can detect whether the local includes the original image information of the video. Usually, when mobile phone 230 displays interface 2101, the video has not yet been played, and mobile phone 230 has not yet obtained the original image information of the video (as described above). Fig.12 That is, the mobile phone 230 can detect that the original image information of the video is not included in the local storage, and the mobile phone 230 needs to obtain the original image information of the video in the tablet 210. For example, the mobile phone 230 can display Fig.21 Interface 2102 is shown. Interface 2102 includes a prompt text "Transferring..." to prompt that the file is being transferred. After obtaining the original image information of the video, the mobile phone 230 can display Fig.21 Interface 2103 is shown, and interface 2103 includes a prompt text "saved to the local "from S's Pad" album" to prompt that the saving is successful.
[0220] However, the mobile phone 230 displays Fig.21 After the interface 2101 is displayed, in response to the user clicking the play button 21012 in the interface 2101, the mobile phone 230 can obtain the original image information of the video in the tablet 210 and play the video based on the original image information of the video. For example, after obtaining the original image information of the video, the mobile phone 230 can display Fig.21 In the interface 2104 shown, a video is playing in the interface 2104. The interface 2104 includes a "Save" 21041. In response to the user's selection operation of the "Save" 21041 in the interface 2104, the mobile phone 230 can detect whether the original image information of the video is included locally. Usually, when the mobile phone 230 displays the interface 2104, the video is already playing, and the mobile phone 230 has already obtained the original image information of the video. That is, the mobile phone 230 can detect that the original image information of the video is included locally. Then, the mobile phone 230 can quickly obtain the original image information of the video from the local and save it. For example, the mobile phone 230 can display Fig.21 Interface 2103 is shown.
[0221] In response to the user's save operation, the mobile phone 230 can save multimedia resources to the local device. Specifically, when the mobile phone 230 saves multimedia resources from the tablet 210 for the first time, the mobile phone 230 can create a target album 1 (also called the second album) in the local gallery, and then all multimedia resources from the tablet 210 can be saved to the target album 1. The target album 1 can be named in the format of "from" + "device name". For example, if the device name of the tablet 210 is S's Pad, the multimedia resources from the tablet 210 can be saved to the "from S's Pad" album.
[0222] For example, before the multimedia resources in the tablet 210 are saved in the mobile phone 230, the mobile phone 230 may display Fig. 22 The interface 2201 shown in FIG. 2201 does not include the "Pad from S" album. After the multimedia resources in the tablet 210 are saved to the mobile phone 230, the mobile phone 230 can display Fig. 22 The interface 2202 (also referred to as the fifth interface) shown in FIG. 2202 includes an album “from S's Pad” 22021 . The album “from S's Pad” 22021 includes multimedia resources from the tablet 210 stored by the mobile phone 230 .
[0223] Furthermore, as the multimedia resources from the tablet 210 are continuously saved, the multimedia resources in the target album 1 can be continuously increased.
[0224] The gallery of mobile phone 230 usually includes two types of albums: system albums and self-built albums. Among them, the system album refers to the album automatically created by the mobile phone 230, such as "All Photos", "Albums", "My Favorites", "Screenshots and Recordings", "Record Multiple Access", and "Video Editing" in interface 2202 are all system albums. In contrast to the system album, the self-built album is the album created by the mobile phone 230 based on the user's operation of creating an album, such as "Self-built Album 1" and "Self-built Album 2" in interface 2202 are both self-built albums. Normally, the system album is located before the self-built album. It is understandable that the user can also adjust the arrangement order of multiple albums in the gallery so that some or all of the self-built albums are located before at least one system album.
[0225] In some embodiments, the mobile phone 230 can save the target album 1 to the gallery of the mobile phone 230, after the last system album. In this way, it is convenient for the user to find the target album 1 after the system album.
[0226] In addition, if the mobile phone 230 stores multimedia resources from both the tablet 210 and the smart screen 220, the mobile phone 230 can save the target album 1 created later in the order in which the target album 1 was created, and save the target album 1 created earlier in the order in which the target album 1 was created.
[0227] Furthermore, after the device name of the tablet 210 is changed, when the mobile phone 230 saves multimedia resources from the tablet 210 again, it is necessary to recreate the target album 1.
[0228] The foregoing Figure 19-22 In the example, only the saving process is described. During the saving process, in response to the user's saving operation, the mobile phone 230 needs to obtain the original image information of the multimedia resource to be saved. During the copying process, in response to the user's copying operation, the mobile phone 230 can first provide candidate albums for the user to select. In response to the user's operation of selecting the target album 2 (also referred to as the second album) from the candidate albums, the mobile phone 230 will obtain the original image information of the multimedia resource to be copied and copy the original image information to the target album 2.
[0229] For example, the mobile phone 230 may display Fig.23 Interface 2301 shown. Interface 2301 includes a large image of a static image in tablet 210 and "Copy" 23011. "Copy" 23011 is used to trigger mobile phone 230 to perform a copy operation. In response to the user's selection operation of "Copy" 23011 in interface 2301, mobile phone 230 can display Fig.23Interface 2302 is shown. Interface 2302 includes candidate albums, such as "All Photos", "Camera", "Self-built Album 1", "Self-built Album 2", etc. In response to the user's selection operation of "Self-built Album 2" in interface 2302 (i.e., target album 2 is "Self-built Album 2"), mobile phone 230 can obtain the original image information of the static picture. For example, mobile phone 230 can display Fig.23 The interface 2303 shown in FIG. 23 includes a prompt text "Transferring..." to prompt that the file is being transferred. After obtaining the original image information of the static image, the mobile phone 230 can display Fig.23 Interface 2304 is shown. Interface 2304 includes a prompt text "saved to this machine's "self-built photo album 2"" to prompt that the copy is successful.
[0230] Above Fig.23 The process of copying a static image is shown. It is understandable that if the multimedia resource to be copied is a dynamic resource, the mobile phone 230 can quickly obtain the original image information of the dynamic image from the local after receiving the user's selection operation on the target album 2, so the mobile phone 230 can directly display the interface of successful copying. The specific principle can be found in the previous text. Fig. 20 If the multimedia resource to be copied is a video, and before playing the video, the mobile phone 230 receives the user's copy operation, after receiving the user's selection operation on the target album 2, the mobile phone 230 needs to obtain the original image information of the video in the tablet 210, so the mobile phone 230 can first display an interface prompting that the text is being transferred, and after the acquisition is completed, display an interface indicating that the copy is successful. If the multimedia resource to be copied is a video, and after playing the video, the mobile phone 230 receives the user's copy operation, after receiving the user's selection operation on the target album 2, the mobile phone 230 can quickly obtain the original image information of the dynamic picture from the local, so the mobile phone 230 can directly display the interface indicating that the copy is successful. For the specific principle, please refer to the previous text Fig.21 Related instructions.
[0231] After the copying is successful, in response to the user's access operation to the target album 2, the mobile phone 230 can display the grid page of the target album 2. The grid page of the target album 2 includes the multimedia resources that have been copied successfully.
[0232] Taking the target album 2 as the "self-built album 2" in the mobile phone 230 as an example, before copying the multimedia resources in the tablet 210 to the "self-built album 2" in the mobile phone 230, the mobile phone 230 can display Fig.24The interface 2401 shown in FIG. 2401 includes “Self-built Album 2” 24011, and the number of multimedia resources included in “Self-built Album 2” 24011 is 22. After the multimedia resources in the tablet 210 are copied to the “Self-built Album 2” in the mobile phone 230, the mobile phone 230 can display Fig.24 Interface 2402 is shown. Interface 2402 includes "Self-built Album 2" 24021. Different from "Self-built Album 2" 24011 in interface 2401, the cover of "Self-built Album 2" 24021 in interface 2402 has changed, and the number of multimedia resources included in "Self-built Album 2" 24021 is updated to 23. That is, "Self-built Album 2" 24021 has added a multimedia resource whose thumbnail is shown in the cover of "Self-built Album 2" 24021.
[0233] In practice, when the mobile phone 230 obtains the original image information of the multimedia resource in the tablet 210, such as when the original image information is obtained in response to the user's viewing operation of the thumbnail in the grid page, or when the original image information is obtained in response to the user's selection operation of the operation control, the acquisition may fail. For example, if a data packet is lost during the transmission process, the acquisition will fail. In this case, the mobile phone 230 can prompt the transmission failure.
[0234] For example, when the mobile phone 230 obtains the original image information from the tablet 210, the mobile phone 230 may display Fig.25 Interface 2501 shown. Interface 2501 includes a prompt text "Transferring..." to indicate that the file is being transferred. After the transfer fails, the mobile phone 230 may display Fig.25 Interface 2502 is shown. Interface 2502 includes a prompt text "Device connection abnormality, transmission failed" to prompt transmission failure.
[0235] After the acquisition of the original image information fails, in response to the operation of returning to the grid page, the mobile phone 230 can display the grid page normally. In response to the operation of continuing to return, the mobile phone 230 can also display the album page normally, and the album page includes the albums in the tablet 210.
[0236] Continue to use Fig.25 In the example of FIG. 25, in response to the user clicking the return control 25021 in the interface 2502, the mobile phone 230 may display Fig.25 Interface 2503 is a grid page. In response to the user clicking on the return control 25031 in interface 2503, mobile phone 230 may display Fig.25 Interface 2504 is shown. Interface 2504 is an album page, and interface 2504 generally includes the albums in tablet 210.
[0237] Some multimedia resources in the tablet 230 also include text. Usually, the text in the multimedia resources cannot be operated. Fig.26 Taking the image 26011 in the interface 2601 as an example, the image 26011 includes the text “text text text” 26012 . When the user long presses the “text text text” 26012 , the mobile phone 230 cannot be triggered to select part or all of the “text text text” 26012 .
[0238] In some embodiments, if the multimedia resource in the tablet 230 includes text, the mobile phone 230 may provide a text extraction control in the large image page when displaying the large image page of the multimedia resource. In response to the user's triggering operation (such as a click operation, a long press operation, etc.) on the text extraction control in the large image page, the mobile phone 230 may extract the text in the multimedia resource. Fig.26 As shown in the button 26012 in the interface 2601 , in response to the user clicking the button 26012 in the interface 2601 , the mobile phone 230 can extract the text “text text text” 26012 in the multimedia resource 26011 .
[0239] Further, after the extraction is completed, in response to the user's triggering operation (such as a long press operation) on the text in the multimedia resource, the mobile phone 230 can select part or all of the text and provide text operation options for the user to operate on the selected text. Fig.26 By long pressing the text "text text text" 26021 in the interface 2602, the mobile phone 230 can display Fig.26 In the interface 2603 shown, in the interface 2603, the second "text" in the "text text text" 26021 is selected, and the interface 2603 includes multiple operation options, such as the copy, select all, translate, search, share and other options in the pop-up box 26031.
[0240] With this embodiment, the mobile phone 230 can extract texts from multimedia resources in the tablet 210 locally, thereby facilitating subsequent operations such as copying and translating the texts in the multimedia resources.
[0241] The embodiment of the present application also provides a chip system, which includes at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected by lines. For example, the interface circuit can be used to receive signals from other devices (such as the memory of the terminal). For another example, the interface circuit can be used to send signals to other devices (such as processors). Exemplarily, the interface circuit can read instructions stored in the memory and send the instructions to the processor. When the instructions are executed by the processor, the terminal can execute the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiment of the present application.
[0242] This embodiment further provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on a terminal, the terminal executes each function or step in the above method embodiment.
[0243] This embodiment also provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute each function or step in the above method embodiment.
[0244] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory so that the chip performs the various functions or steps in the above-mentioned method embodiments.
[0245] Among them, the chip system, computer-readable storage medium, computer program product or device provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0246] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0247] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0248] The unit described as a separate component may or may not be physically separated, and the component shown as a unit may be one physical unit or multiple physical units, that is, it may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
[0249] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0250] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program code.
[0251] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present application and are not intended to limit it. Although the present application has been described in detail with reference to the preferred embodiments, a person of ordinary skill in the art should understand that the technical solution of the present application may be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present application.
Claims
1. A method for accessing multimedia resources, characterized in that: include: The first device displays a first interface, the first interface includes a first area and a second area, the first area displays a first option, a second option and a third option, the first option corresponds to the first device, the second option corresponds to the second device, the third option corresponds to the third device, and the second area displays preview information of an album in the first device; In response to a selection operation on the second option, the first device displays preview information of the album in the second device in the second area; In response to a selection operation on the third option, the first device displays preview information of the album in the third device in the second area.
2. The method according to claim 1, characterized in that After the first device displays the preview information of the album in the second device in the second area, the method further includes: In response to an access operation to the first album of the second device in the first interface, the first device displays a second interface, where the second interface includes thumbnails of multimedia resources in the first album; In response to a viewing operation on the first thumbnail in the second interface, the first device displays a third interface, where the third interface is used to display a first multimedia resource corresponding to the first thumbnail; The first device is disconnected from the second device; In response to a return operation to the third interface, the first device displays a fourth interface, wherein the fourth interface includes the first option and the third option, and the fourth interface does not include preview information of the album in the second device.
3. The method according to claim 2, characterized in that The fourth interface also includes the second option.
4. The method according to claim 3, characterized in that In response to the return operation on the third interface, the first device displays the fourth interface including the second option, including: In response to the return operation to the third interface, the first device may search for the second device, and the first device displays the fourth interface including the second option.
5. The method according to claim 2, characterized in that: The fourth interface does not include the second option.
6. The method according to claim 5, characterized in that In response to the return operation on the third interface, the first device displays the fourth interface that does not include the second option, including: In response to the return operation to the third interface, the first device fails to search for the second device, and the first device displays the fourth interface that does not include the second option.
7. The method according to any one of claims 2 to 6, characterized in that: After the first device displays the third interface, the method further includes: In response to a return operation to the third interface, the first device is not disconnected from the second device, and the first device displays the second interface; In response to a return operation to the second interface, the first device displays the first interface including preview information of the album in the second device in the second area.
8. The method according to any one of claims 2 to 6, characterized in that: In response to the return operation on the third interface, the first device displays a fourth interface, including: In response to a return operation to the third interface, the first device detects a disconnection with the second device, and the first device displays a fourth interface.
9. The method according to claim 8, characterized in that In response to the return operation to the third interface, the first device detects a disconnection with the second device, and the first device displays a fourth interface, including: In response to a return operation to the third interface at a first moment, the first device displays the fourth interface, the first moment being after the first device detects a disconnection with the second device; The method further comprises: In response to a return operation to the third interface at a second moment, the first device displays the second interface; The second moment is a moment after the first device is disconnected from the second device, but the second moment is before the first device detects the disconnection with the second device.
10. The method according to any one of claims 2 to 9, characterized in that: The first device includes a data middle platform and a first application, the first application includes a gallery application, or the first application includes an application having permission to access the gallery application; After the first device is disconnected from the second device, the method further includes: The data center detects that the first device and the second device are disconnected; The data center sends a disconnection notification to the first application; In response to the return operation on the third interface, the first device displays a fourth interface, including: In response to a return operation to the third interface, the first application has received the disconnection notification, and the first application displays the fourth interface.
11. The method according to any one of claims 2 to 10, characterized in that: The third interface also includes preset operation controls, and the preset operation controls include a save control and / or a copy control; After the first device displays the third interface, the method further includes: In response to a selection operation on the preset operation control, the first device saves the first multimedia resource to a second album of the first device.
12. The method according to claim 11, characterized in that The first multimedia resource is a static image, or the first multimedia resource is a video, but the first device has not played the video in the third interface; In response to the selection operation of the preset operation control, the first device saving the first multimedia resource to a second album of the first device includes: In response to a selection operation on the preset operation control, the first device displays a first prompt in the third interface, where the first prompt is used to prompt that a file is being transferred; After the file transfer is completed, the first device saves the first multimedia resource to the second album.
13. The method according to claim 12, characterized in that The first multimedia resource is a dynamic picture, or the first multimedia resource is a video, and the first device has played the video in the third interface. In response to the selection operation of the preset operation control, the first device does not display the first prompt.
14. The method according to any one of claims 11 to 13, characterized in that The preset operation control is the save control, and the second photo album is a photo album named after the second device.
15. The method according to claim 14, characterized in that After the first device saves the first multimedia resource to a second album of the first device, the method further includes: The first device displays a fifth interface, which includes preview information of the photo albums in the first device, and the preview information of the second photo album is located after the preview information of the last system photo album in the photo albums of the first device.
16. The method according to any one of claims 11 to 13, characterized in that: The preset operation control is the copy control; In response to the selection operation of the preset operation control, the first device saving the first multimedia resource to a second album of the first device includes: In response to a selection operation on the preset operation control, the first device displays preview information of the photo album in the first device; In response to a selection operation on the second photo album in the first device, the first device saves the first multimedia resource to the second photo album of the first device.
17. The method according to any one of claims 1 to 16, characterized in that The method further comprises: The first device displays a sixth interface, the sixth interface includes photos in the first device, and in the process of displaying the sixth interface, the first device searches for the second device and the third device; The first device displays a first interface, including: In response to the operation of switching to the album page, the first device displays the first interface, and the second option and the third option are located after the first option, and the second option and the third option are sorted according to the priority of the second device and the third device.
18. The method according to any one of claims 1 to 17, characterized in that In response to the selection operation of the second option, the first device displays preview information of the album in the second device in the second area, including: If the number of devices connected to the first device does not reach the first number, in response to a selection operation on the second option, the first device displays preview information of the album in the second device in the second area.
19. The method according to any one of claims 1 to 17, characterized in that In response to the selection operation of the second option, the first device displays preview information of the album in the second device in the second area, including: If the first device has been connected to the first number of devices, in response to a selection operation on the second option, the first device displays a first window, wherein the first window includes device options corresponding to the first number of connected devices, wherein the first number of device options includes a first device option, and the first device option corresponds to a fourth device; In response to a disconnection operation on the first device option, the first device is disconnected from the fourth device; The first device displays preview information of the photo album in the second device in the second area.
20. The method according to claim 19, characterized in that The method further comprises: If the number of devices connected to the first device reaches the first number, in response to a selection operation of the second option, the first device displays the first window; In response to the operation of instructing to close the first window, the first device displays a prompt message in the second area indicating that the device connection limit has exceeded.
21. An electronic device, characterized in that: The electronic device includes a display screen, a memory and a processor, and the display screen, the memory and the processor are coupled; wherein the memory stores a computer program code, and the computer program code includes computer instructions; when the computer instructions are executed by the processor, the electronic device executes the method as described in any one of claims 1-20.
22. A computer-readable storage medium, characterized in that: The method comprises computer instructions; when the computer instructions are executed on an electronic device, the electronic device executes the method as claimed in any one of claims 1 to 20.
Citation Information
Cited By
Multimedia resource access method and electronic device
EP4694087A1
Multimedia resource access method and electronic device
WO2025044174A1