Multimedia resource display method and electronic equipment

Abstract

The embodiment of the invention discloses a multimedia resource display method and electronic equipment, relates to the field of electronic equipment, and aims to view multimedia resources generated through processing logic of a photo album application program by using other application programs, except the photo album application program, of the electronic equipment. According to the specific scheme, first electronic equipment receives opening operation of a user on a first application program; in response to the opening operation, the first electronic equipment displays a first interface, and the first interface is an interface corresponding to the first application program; the first electronic equipment obtains multimedia resources corresponding to the second application program, the multimedia resources corresponding to the second application program comprise the first multimedia resources and the second multimedia resources, and the second multimedia resources are multimedia resources obtained after the second application program processes the first multimedia resources; and the first electronic equipment displays a second interface, wherein the second interface comprises multimedia resources corresponding to the second application program.

Description

Technical Field

[0001] The present application relates to the field of electronic devices, and in particular to a method for displaying multimedia resources and an electronic device. Background Art

[0002] Currently, when a user views multimedia resources (such as pictures or videos) of an electronic device, the user can use the album application of the electronic device to view the multimedia resources of the electronic device, and the user can also use other applications other than the album application (such as communication applications, social applications, or editing applications) to view the multimedia resources of the electronic device.

[0003] When a user uses an electronic device's album application to view multimedia resources, the user can view pictures and videos taken by the electronic device and stored in the album application, or view pictures and videos generated by the processing logic of the album application (such as classified albums, user's favorite pictures and videos, etc.).

[0004] However, when the user uses other applications of the electronic device to view multimedia resources, the user can only view the pictures and videos taken by the electronic device stored in the album application. That is, the user cannot use other applications of the electronic device to view the pictures and videos generated by the processing logic of the album application, and the user experience is poor. Summary of the invention

[0005] The embodiments of the present application provide a method for displaying multimedia resources and an electronic device, which can use other applications of the electronic device other than the album application to view the multimedia resources generated by the processing logic of the album application.

[0006] In order to achieve the above purpose, the embodiment of the present application adopts the following technical solution:

[0007] In a first aspect, an embodiment of the present application provides a method for displaying multimedia resources, which is applied to a first electronic device, and the first electronic device may include a first application and a second application. The method for displaying multimedia resources may include: the first electronic device receives an opening operation of the first application by a user; in response to the opening operation, the first electronic device displays a first interface, and the first interface is an interface corresponding to the first application; the first electronic device obtains multimedia resources corresponding to the second application, wherein the multimedia resources corresponding to the second application include the first multimedia resources and the second multimedia resources, and the second multimedia resources are multimedia resources obtained after the second application processes the first multimedia resources; the first electronic device displays a second interface, and the second interface includes the multimedia resources corresponding to the second application.

[0008] Based on the method described in the first aspect, the multimedia resources of the second application of the first electronic device include the first multimedia resources and the second multimedia resources obtained after processing the first multimedia resources. When the user uses the first application of the first electronic device to view the multimedia resources corresponding to the second application, not only can the first multimedia resources corresponding to the second application be viewed, but also the second multimedia resources corresponding to the second application can be viewed, and then the user selects the multimedia resources to be shared from the second multimedia resources corresponding to the second application through the first application. Furthermore, when the user uses the first application to view the multimedia resources corresponding to the second application, the first application can classify and display the multimedia resources corresponding to the second application according to the classification method of the second application. This classification display method conforms to the user's usage habits, so that the user can quickly find the required multimedia resources, thereby improving the user's usage habits.

[0009] In combination with the first aspect, in another possible implementation manner, the second multimedia resource is a multimedia resource obtained after the second application classifies, identifies or marks the first multimedia resource.

[0010] Based on this possible implementation method, the second application can identify, classify, mark and other processes on the first multimedia resources, obtain and store the second multimedia resources, and when the user uses the first application of the first electronic device to view the multimedia resources corresponding to the second application, not only can the user view the first multimedia resources corresponding to the second application, but also can view the second multimedia resources corresponding to the second application. In this way, the user can quickly find the desired multimedia resources in the second multimedia resources corresponding to the second application, making it more convenient to use.

[0011] In combination with the first aspect, in another possible implementation, after the first electronic device receives the user's opening operation on the first application, the method for displaying the multimedia resources may also include: the first electronic device obtains a remote device list; the first electronic device displays a third interface, the third interface includes a remote device list, and the remote device list includes device information of the second electronic device; the first electronic device receives the user's selection operation on the device information of the second electronic device; in response to the selection operation, the first electronic device obtains the multimedia resources of the second electronic device; the first electronic device displays a fourth interface, and the fourth interface includes the multimedia resources of the second electronic device.

[0012] Based on this possible implementation, after the user opens the first application of the first electronic device, the first electronic device can obtain a list of remote devices and display a third interface including the list of remote devices, so that the user can select a second electronic device in the list of remote devices, and then the user can view the multimedia resources of the second electronic device using the first application of the first electronic device. In this way, the first application of the electronic device can directly obtain and view the multimedia resources of the second electronic device from the database of the first electronic device, which can simplify the operation process and thus improve the user experience. Furthermore, the first application of the electronic device can be adapted according to its display interface, which can meet the personalized needs of different applications and provide a better user experience.

[0013] In combination with the first aspect, in another possible implementation, the above-mentioned first electronic device obtains the remote device list, which may include: the first application sends a first request to the second application, the first request is used to request to call the second application; when the second application receives the first request, the second application obtains the remote device list; the second application sends the remote device list to the first application.

[0014] Based on this possible implementation, when a user needs to use the first application of the first electronic device to view multimedia resources of other electronic devices, the user can obtain a remote device list through the second application to select the device for which the multimedia resources are to be viewed in the remote device list. In this way, the first application of the electronic device can obtain the multimedia resources included in the media data center of other electronic devices through the second application, without modifying other applications of the electronic device, which can reduce the access cost of the first application of the electronic device.

[0015] In combination with the first aspect, in another possible implementation, before the first electronic device obtains the multimedia resources of the second electronic device, the method for displaying the multimedia resources may also include: in response to a selection operation, the first electronic device obtains the first device identifier of the second electronic device; the first electronic device establishes a communication connection between the first electronic device and the second electronic device based on the first device identifier; based on the communication connection between the first electronic device and the second electronic device, the first electronic device obtains and stores the multimedia resources of the second electronic device.

[0016] Based on this possible implementation method, in response to a selection operation, the first electronic device obtains the first device identification of the second electronic device, and establishes a communication connection between the first electronic device and the second electronic device based on the first device identification to obtain and store the multimedia resources of the second electronic device. In this way, when the user views the multimedia resources of the second electronic device through the first application, the multimedia resources of the second electronic device pre-stored by the first electronic device can be obtained.

[0017] In combination with the first aspect, in another possible implementation method, the above-mentioned first electronic device also includes a first media data middle station. Before establishing a communication connection between the first electronic device and the second electronic device according to the first device identifier, the above-mentioned multimedia resource display method may also include: the first device identifier sent by the first application to the second application; the second application receives the first device identifier and sends the first device identifier to the first media data middle station; wherein, the first electronic device establishes a communication connection between the first electronic device and the second electronic device according to the first device identifier, which may include: the first media data middle station establishes a communication connection between the first electronic device and the second electronic device according to the first device identifier; wherein, based on the communication connection between the first electronic device and the second electronic device, the first electronic device obtains and stores the multimedia resources of the second electronic device, which may include: based on the communication connection between the first electronic device and the second electronic device, the first media data middle station obtains and stores the multimedia resources of the second electronic device.

[0018] Based on this possible implementation method, in response to a selection operation, the first application obtains and sends the first device identifier of the second electronic device to the second application, so that the first device identifier is sent to the first media data middle station of the first electronic device through the second application, so that the first media data middle station can connect to the second electronic device to obtain and store the multimedia resources of the second electronic device. In this way, when the user needs to use the first application of the first electronic device to view the multimedia resources of other electronic devices, the remote device list can be obtained through the second application to select the device for which the multimedia resources are to be viewed in the remote device list.

[0019] In combination with the first aspect, in another possible implementation method, the above-mentioned first electronic device also includes a first media data middle station, the multimedia resources corresponding to the above-mentioned second application include third multimedia resources and fourth multimedia resources, and the above-mentioned first electronic device obtains the multimedia resources corresponding to the second application including: the first electronic device obtains the third multimedia resource by calling the first interface of the first media data middle station; the first electronic device obtains the fourth multimedia resource by calling the second interface of the first media data middle station.

[0020] Based on this possible implementation, when the first application of the first electronic device obtains the multimedia resource corresponding to the second application, the third multimedia resource can be obtained through the first interface of the first media data center of the first electronic device. The interface of the standard content provider, therefore, when the application of the electronic device uses the provider interface to obtain the multimedia resources included in the media data platform, the developer does not need to adapt the application, that is, the application can be used to access the first interface, which is more convenient to use. Also, when the first application of the first electronic device obtains the multimedia resources corresponding to the second application, the fourth multimedia resource can be obtained through the second interface of the first media data platform of the first electronic device. In this way, since the second interface can provide cross-device data transmission related capabilities in addition to Android native capabilities, the application of the electronic device can achieve cross-device management and connection through the second interface.

[0021] In combination with the first aspect, in another possible implementation manner, the fourth multimedia resource is a thumbnail corresponding to the multimedia resource.

[0022] Based on this possible implementation, since the second interface can provide cross-device data transmission related capabilities in addition to Android native capabilities, the application of the electronic device can obtain the thumbnail corresponding to the multimedia resource through the second interface.

[0023] In combination with the first aspect, in another possible implementation manner, the second application is a gallery application, and the first application is an application other than the gallery application in the first electronic device.

[0024] Based on this possible implementation method, when a user uses an electronic device's application other than the album application to view the electronic device's multimedia resources, he can not only view the pictures and videos taken by the electronic device and stored in the album application, but also view the multimedia resources generated by the processing logic of the album application. Furthermore, the user can use other applications to share the multimedia resources generated by the processing logic of the album application.

[0025] In combination with the first aspect, in another possible implementation, the second application includes at least one of a clipping application, a communication application, a social application, and a file management application.

[0026] Based on this possible implementation, the clipping application, communication application, social application, and file management application of the electronic device can access the multimedia resources of the gallery application of the electronic device, and can also access the multimedia resources of other electronic devices.

[0027] In a second aspect, an embodiment of the present application provides a display device for multimedia resources, which can be applied to an electronic device to implement the method in the first aspect. The function of the display device for multimedia resources can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions, for example, a receiving module, a display module, and an acquisition module.

[0028] The receiving module may be used to receive a user's opening operation on the first application.

[0029] The display module can be used to display a first interface in response to an opening operation, where the first interface is an interface corresponding to the first application.

[0030] The acquisition module can be used to acquire multimedia resources corresponding to the second application, wherein the multimedia resources corresponding to the second application include first multimedia resources and second multimedia resources, and the second multimedia resources are multimedia resources obtained after the second application processes the first multimedia resources.

[0031] The display module can also be used to display a second interface, where the second interface includes multimedia resources corresponding to the second application.

[0032] In a third aspect, an electronic device is provided, which has the function of implementing the method described in the first aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0033] In a fourth aspect, an electronic device is provided, comprising: a processor and a memory; the memory is used to store computer execution instructions, and when the electronic device is running, the processor executes the computer execution instructions stored in the memory to enable the electronic device to perform a method for displaying multimedia resources as described in any one of the first aspects above.

[0034] In a fifth aspect, an electronic device is provided, comprising: a processor; the processor is used to couple with a memory, and after reading instructions in the memory, execute the method for displaying multimedia resources as described in any one of the above-mentioned first aspects according to the instructions.

[0035] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by an electronic device, the electronic device implements a method for displaying multimedia resources as described in any one of the first aspect or possible implementations of the first aspect.

[0036] In a seventh aspect, an embodiment of the present application provides a computer program product, comprising a computer-readable code. When the computer-readable code is executed in an electronic device, the electronic device implements a method for displaying multimedia resources as described in any one of the first aspect or possible implementations of the first aspect.

[0037] In an eighth aspect, a device (for example, the device may be a chip system) is provided, the device including a processor for supporting an electronic device to implement the functions involved in the first aspect above. In one possible design, the device also includes a memory for storing program instructions and data necessary for the electronic device. When the device is a chip system, it may be composed of a chip, or may include a chip and other discrete devices.

[0038] It should be understood that the beneficial effects of the second to eighth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 A schematic diagram of a scene of displaying multimedia resources by an electronic device in the prior art Figure 1 ;

[0040] Figure 2 A schematic diagram of a scene of displaying multimedia resources by an electronic device in the prior art Figure 2 ;

[0041] Figure 3 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0042] Figure 4 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application Figure 1 ;

[0043] Figure 5 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application Figure 2 ;

[0044] Figure 6 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application Figure 3 ;

[0045] Figure 7 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application Figure 4 ;

[0046] Figure 8 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application Figure 5 ;

[0047] Fig. 9A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application Figure 6 ;

[0048] Fig.10 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application Figure 7 ;

[0049] Fig.11 A scenario diagram of a method for displaying multimedia resources provided in an embodiment of the present application Figure 1 ;

[0050] Fig.12 A scenario diagram of a method for displaying multimedia resources provided in an embodiment of the present application Figure 2 ;

[0051] Fig.13 A scenario diagram of a method for displaying multimedia resources provided in an embodiment of the present application Figure 3 ;

[0052] Fig.14 A scenario diagram of a method for displaying multimedia resources provided in an embodiment of the present application Figure 4 ;

[0053] Fig.15 A flowchart of a method for displaying multimedia resources provided in an embodiment of the present application Figure 1 ;

[0054] Fig.16 A flowchart of a method for displaying multimedia resources provided in an embodiment of the present application Figure 2 ;

[0055] Fig.17 A flowchart of a method for displaying multimedia resources provided in an embodiment of the present application Figure 3 ;

[0056] Fig.18 A flowchart of a method for displaying multimedia resources provided in an embodiment of the present application Figure 4 ;

[0057] Fig.19 A schematic diagram of the structure of a multimedia resource display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0058] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0059] The terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise specified, "plurality" means two or more.

[0060] In order to clearly describe the technical solutions of the embodiments of the present application, some terms and technologies involved in the embodiments of the present application are briefly introduced below.

[0061] Currently, when a user views multimedia resources (such as pictures or videos) of an electronic device, the user can use the album application of the electronic device to view the multimedia resources of the electronic device, and the user can also use other applications other than the album application (such as communication applications, social applications, or editing applications) to view the multimedia resources of the electronic device.

[0062] When a user uses an electronic device's album application to view multimedia resources, the user can view pictures and videos taken by the electronic device and stored in the album application, or view pictures and videos generated by the processing logic of the album application (such as classified albums, user's favorite pictures and videos, etc.).

[0063] For example, combined with Figure 1 (a) and Figure 1 As shown in (b), taking the electronic device as a mobile phone as an example, after the user opens the album application 101 of the mobile phone, the mobile phone displays the interface 102 corresponding to the album application. The interface 102 corresponding to the album application may include multiple albums, such as the "All Photos" album, the "Camera" album, the "My Favorites" album, the "Portraits" album, the "Places" album, and the "Food" album. The user can view all the pictures and videos taken by the mobile phone in the "Camera" album. The user can also view the pictures and videos collected by the user in the "My Favorites" album. In addition, the user can search for corresponding pictures or videos in the classified albums according to the type of multimedia resources (such as pictures or videos, etc.) to be viewed.

[0064] However, when the user uses other applications of the electronic device to view multimedia resources, the user can only view the pictures and videos taken by the electronic device stored in the album application. That is, the user cannot use other applications of the electronic device to view the pictures and videos generated by the processing logic of the album application, and the user experience is poor.

[0065] In some scenarios, when a user uses other applications of an electronic device to send pictures or videos, the user can view the pictures and videos taken by the electronic device stored in the album application through the other applications of the electronic device, and select the pictures or videos to be sent from the pictures and videos taken by the electronic device.

[0066] For example, taking the electronic device as a mobile phone and the other application as a communication application, Figure 2 As shown in (a) of FIG. 1 , the mobile phone may include a communication application 201. After the user opens the communication application 201 of the mobile phone, the mobile phone may display a chat interface corresponding to the communication application 201. Figure 2 As shown in (b) of FIG. 1 , the chat interface 201 may include a picture selection control 202. After the mobile phone receives a trigger operation of the user on the picture selection control 202, the mobile phone may display the pictures and videos taken by the mobile phone in response, that is, the mobile phone may display a picture selection interface. Figure 2 As shown in (c) of FIG. 1 , the picture selection interface 203 may include an “Pictures and Videos” album, an “All Videos” album, a “Camera” album, a “Screenshots” album, and a “Browser” album. Figure 1 In (b), the picture selection interface 203 does not include the "My Collection" album, the "Portrait" album, the "Place" album, and the "Food" album. That is, the user can only view the pictures and videos taken by the mobile phone stored in the album application through the communication application of the mobile phone, but cannot view the pictures and videos generated by the processing logic of the album application, and thus the user cannot select the pictures or videos to be sent from the pictures and videos generated by the processing logic of the album application.

[0067] In addition, when a user uses other applications of an electronic device to view pictures and videos taken by the electronic device and stored in the album application, the other applications of the electronic device can classify the pictures and videos taken by the electronic device according to their own classification methods and display the pictures and videos taken by the electronic device according to the categories. However, the classification methods of other applications of the electronic device are different from those of the album application, that is, the albums presented on the interfaces corresponding to other applications of the electronic device are different from the albums presented on the interfaces corresponding to the album application.

[0068] For example, continuing with the example of the electronic device being a mobile phone and the other application being a communication application, Figure 1 As shown in (b) of FIG. 1 , the interface 102 corresponding to the album application of the mobile phone may include an “all photos” album, a “camera” album, a “my favorites” album, a “portraits” album, a “places” album, and a “food” album. Figure 2As shown in (c) in the figure, the picture selection interface 203 of the communication application of the mobile phone may include the "Pictures and Videos" album, the "All Videos" album, the "Camera" album, the "Screenshots" album, and the "Browser" album. That is, the albums presented on the interface corresponding to the communication application of the mobile phone are different from the albums presented on the interface corresponding to the album application.

[0069] However, when users use electronic devices, they often use the album application of the electronic device to view the multimedia resources (such as pictures or videos) of the electronic device, that is, the classification method of the album application of the electronic device is more in line with the user's usage habits. In other words, because the classification method of other applications of the electronic device does not conform to the user's usage habits, the user cannot quickly find the pictures or videos to be sent, and the user experience is poor.

[0070] In other scenarios, when a user has multiple electronic devices (such as a mobile phone, a tablet computer, or a laptop computer, etc.), the user cannot directly view multimedia resources of other electronic devices through one electronic device. Figure 1 As shown in (b) of FIG. 1 , the interface 102 corresponding to the album application of the mobile phone only includes pictures and videos of the mobile phone. Figure 2 As shown in (c) of FIG. 1 , the picture selection interface 203 of the communication application of the mobile phone also only includes pictures and videos of the mobile phone. That is, the user can only directly view the multimedia resources of the mobile phone on the mobile phone, but cannot directly view the multimedia resources of other electronic devices.

[0071] In the related art, when a user uses an electronic device to view multimedia resources on other electronic devices, the user needs to send the multimedia resources of other electronic devices to the electronic device, and then the user can view the multimedia resources on other electronic devices through the electronic device, which makes the operation process cumbersome and fails to provide users with a convenient and fast use experience. For example, the user can use the Bluetooth sharing function of other electronic devices to send the multimedia resources of other electronic devices to the electronic device. For another example, the user can also use the application of other electronic devices (such as a communication application) to send the multimedia resources of other electronic devices to the electronic device.

[0072] Taking a specific scenario as an example, users are accustomed to using mobile phones to take pictures or videos because mobile phones have many advantages, such as excellent camera performance, support for multiple shooting functions, easy to carry, and simple operation. However, compared with mobile phones, computers (such as tablets, laptops, or desktop computers, etc.) have many advantages such as powerful image processing capabilities, larger screen sizes, higher screen resolutions, and higher screen accuracy. Users can use computers to edit and process pictures or videos. Based on this, when users need to use computers to edit pictures or videos taken by mobile phones, users need to send the pictures or videos in the mobile phone to the computer first, and then users can use the computer to edit and process the pictures or videos taken by the mobile phone, which makes the operation process cumbersome and fails to provide users with a convenient and fast user experience.

[0073] In summary, in the prior art, when a user uses an electronic device's other applications other than the album application to view multimedia resources, the user can only view the pictures and videos taken by the electronic device stored in the album application, but cannot view the pictures and videos generated by the processing logic of the album application, resulting in a poor user experience. Also, when a user views the pictures and videos taken by the electronic device stored in the album application through other applications of the electronic device, the pictures and videos taken by the electronic device cannot be classified and displayed according to the classification method of the album application, which does not conform to the user's usage habits, resulting in the user being unable to quickly find the pictures or videos to be sent, resulting in a poor user experience.

[0074] In addition, when a user views pictures and videos taken by an electronic device and stored in an album application through other applications of the electronic device, the user cannot search for corresponding pictures and videos as needed, which is inconvenient to use.

[0075] In addition, in a scenario where a user has multiple electronic devices, it is necessary to use the sharing function of the electronic devices to send the multimedia resources of one electronic device to other electronic devices before the multimedia resources on the electronic device can be viewed on the other electronic devices. The operation process is cumbersome and cannot provide users with a convenient and fast usage experience.

[0076] In view of the above problems, an embodiment of the present application provides a method for displaying multimedia resources, which can be applied to electronic devices. When a user uses other applications of an electronic device other than an album application to view multimedia resources of the electronic device, not only can the user view pictures and videos taken by the electronic device stored in the album application, but also can view multimedia resources generated by the processing logic of the album application, and then the user can use other applications to share the multimedia resources generated by the processing logic of the album application.

[0077] Furthermore, when the user uses other applications of the electronic device to view the multimedia resources of the album application, the other applications of the electronic device can classify and display the multimedia resources of the album application according to the classification method of the album application. This classification display method is in line with the user's habit of viewing albums, allowing the user to quickly find the required multimedia resources, thereby improving the user's usage habits.

[0078] Furthermore, when a user views pictures and videos taken by the electronic device and stored in the photo album application through other applications of the electronic device, the user can search for corresponding pictures and videos as needed, which is more convenient to use.

[0079] In addition, in the scenario where a user has multiple electronic devices, the user does not need to send the multimedia resources of the electronic device to other electronic devices through the sharing function of the electronic device. In this way, the user can directly view the multimedia resources of other electronic devices through one electronic device, which is convenient to operate and can improve the user's experience. Moreover, when a user views the multimedia resources of other electronic devices through one electronic device, he can not only view the pictures and videos taken by other electronic devices, but also view the multimedia resources generated by the processing logic of the album application of other electronic devices, which can meet the different needs of users.

[0080] The following describes a method for displaying multimedia resources provided in an embodiment of the present application.

[0081] The multimedia resource display method provided in the embodiment of the present application can be applied to an electronic device. The electronic device can be the first electronic device mentioned above, or the second electronic device mentioned above.

[0082] In some embodiments, the electronic device may be a mobile phone, a tablet computer, a handheld computer, a personal computer (PC), a cellular phone, a personal digital assistant (PDA), a wearable device, etc. The embodiments of the present application do not limit the specific form of the electronic device.

[0083] That is, the first electronic device or the second electronic device can be a mobile phone, a tablet computer, a handheld computer, a personal computer (PC), a cellular phone, a personal digital assistant (PDA), a wearable device, etc. And the specific form of the first electronic device can be the same as or different from the specific form of the second electronic device.

[0084] For example, when the first electronic device is a mobile phone, the second electronic device may be a mobile phone, or may be a tablet computer, a handheld computer, or the like.

[0085] For example, taking the electronic device (ie, the first electronic device or the second electronic device) as a mobile phone, Figure 3 A schematic structural diagram of an electronic device provided in an embodiment of the present application is shown.

[0086] like Figure 3 As shown, the electronic device may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, a sensor module 380, a button 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a subscriber identification module (SIM) card interface 395, etc. Among them, the sensor module 380 may include a pressure sensor 380A, a gyroscope sensor 380B, an air pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, etc.

[0087] It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0088] The processor 310 may include one or more processing units, for example, the processor 310 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0089] The controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0090] The processor 310 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. The memory may store instructions or data that the processor 310 has just used or cyclically used. If the processor 310 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 310, and thus improves the efficiency of the system.

[0091] In some embodiments, the processor 310 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0092] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, modem processor and baseband processor.

[0093] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0094] The mobile communication module 350 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied in electronic devices. The mobile communication module 350 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the processor 310. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the same device as at least some of the modules of the processor 310.

[0095] The wireless communication module 360 ​​can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to electronic devices. The wireless communication module 360 ​​can be one or more devices integrating at least one communication processing module. The wireless communication module 360 ​​receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 310. The wireless communication module 360 ​​can also receive the signal to be sent from the processor 310, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0096] In some embodiments, the antenna 1 of the electronic device is coupled to the mobile communication module 350, and the antenna 2 is coupled to the wireless communication module 360, so that the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology.

[0097] The electronic device implements the display function through a GPU, a display screen 394, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 310 may include one or more GPUs that execute program instructions to generate or change display information.

[0098] The display screen 394 is used to display pictures, videos, etc. The display screen 394 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device may include 1 or N display screens 394, where N is a positive integer greater than 1.

[0099] The electronic device can realize the shooting function through the ISP, the camera 393, the video codec, the GPU, the display screen 394 and the application processor, etc. In some embodiments, the electronic device can include 1 or N cameras 393, where N is a positive integer greater than 1.

[0100] The internal memory 321 can be used to store computer executable program codes, which include instructions. The processor 310 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 321. The internal memory 321 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, a picture playback function, etc.), etc. The data storage area may store data established during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0101] The acceleration sensor 380E can periodically collect acceleration data of the electronic device at a certain frequency. For example, the acceleration magnitude of the electronic device in various directions (generally XYZ three-axis directions) can be collected.

[0102] Of course, it is understandable that the above Figure 3 The figure is only an exemplary description when the electronic device is in the form of a mobile phone. If the electronic device is in the form of a tablet computer, a handheld computer, a PC, a PDA, a wearable device (such as a smart watch, a smart bracelet), etc., the structure of the electronic device may include Figure 3 The structure shown in the figure is less than Figure 3 More structures are shown in the figure, which are not limited here.

[0103] It is understandable that, generally speaking, the realization of electronic device functions requires not only hardware support but also software cooperation.

[0104] The software system of the electronic device may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device.

[0105] Figure 4 It is a software structure block diagram of the electronic device provided in the embodiment of the present application.

[0106] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and the system library (also called the Native layer), and the kernel layer.

[0107] The application layer can include a series of application packages. Figure 4 As shown, the application package may include applications such as camera, gallery (also called album), calendar, phone, map, navigation, WLAN, Bluetooth, music, video, short message, etc. The application framework layer provides application programming interface (application programming interface, API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0108] like Figure 4 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0109] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0110] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, pictures, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0111] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0112] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including answering, hanging up, etc.).

[0113] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0114] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0115] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0116] The core library consists of two parts: one is the function that the Java language needs to call, and the other is The core library.

[0117] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0118] The system library may include multiple functional modules, such as a surface manager, a media library, a 3D graphics processing library (such as OpenGL ES), a 2D graphics engine (such as SGL), etc.

[0119] The surface manager is used to manage the display subsystem and provide the fusion of two-dimensional and three-dimensional layers for multiple applications.

[0120] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats.

[0121] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing.

[0122] A 2D graphics engine is a drawing engine for 2D drawings.

[0123] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0124] The methods in the following embodiments can all be implemented in an electronic device having the above hardware structure or software structure.

[0125] In some examples, in order to implement the method for displaying multimedia resources provided in the embodiments of the present application, Figure 4 Based on the software structure diagram of the electronic device shown, the application layer can also include a media data middle platform. It should be noted that the media data middle platform can also be located in the application framework layer. In the embodiment of the present application, the media data middle platform is located in the application layer as an example for schematic illustration.

[0126] The media data platform can be a media data platform application (APP). The media data platform refers to the digital transformation of various products and services of traditional media, aggregating and integrating the massive data originally scattered in various links and business departments, and realizing the efficient use and value mining of these data by building a shared data platform.

[0127] The media data middle station can be used to obtain and store the multimedia resources of the electronic device (also called the local device) and send the multimedia resources of the electronic device to other electronic devices (also called remote devices). The multimedia resources of the electronic device may include pictures, videos, thumbnails, audio, and documents.

[0128] The media data platform can also be used to receive multimedia resources sent by other electronic devices, where the multimedia resources of other electronic devices may also include pictures, videos, thumbnails, audio, and documents.

[0129] That is to say, the media data middle station can serve as a transfer station for multimedia resources. On the one hand, the media data middle station of the electronic device can obtain the multimedia resources of the electronic device, and store the multimedia resources of the electronic device in the database of the media data middle station, so that the application of the electronic device (such as an application other than the album application) can view the multimedia resources of the electronic device. In addition, other electronic devices can also obtain the multimedia resources of the electronic device from the database of the media data middle station of the electronic device, and then the user can view the multimedia resources of the electronic device through other electronic devices. On the other hand, the media data middle station of the electronic device can obtain and store the multimedia resources included in other electronic devices from the media data middle stations of other electronic devices, so that the user can view the multimedia resources of other electronic devices through the electronic device. That is, through the media data middle station of the electronic device, the sharing and synchronization of multimedia resources across devices can be achieved.

[0130] Combine the following Figure 5 A schematic diagram of a media data center for an electronic device is provided.

[0131] like Figure 5As shown, the media data middle platform may include a provider interface and a software development kit (SDK) interface. The provider interface and the SDK interface can be used to support business access, that is, the upper layer application of the electronic device (such as the album application, communication application, social application or editing application) can access the multimedia resources of the electronic device through the provider interface or the SDK interface.

[0132] A provider interface can be a The interface of the standard content provider (Content Provider). The provider interface can be used to query the standard media data (i.e., the metadata corresponding to the multimedia resources stored in the MediaProvider database) and the classified media data (i.e., the metadata corresponding to the multimedia resources generated by the processing logic of the gallery) stored in the media data center. In other words, the application of an electronic device can query the standard media data and classified media data of the electronic device through the provider interface, and can also query the standard media data and classified media data of other electronic devices through the provider interface.

[0133] The SDK interface can be an extended interface of the media data middle platform. The SDK interface has capabilities related to cross-device data transmission, such as distributed device query capability, device connection capability, device disconnection capability, and thumbnail query capability. In other words, the application of the electronic device can also request a list of remote devices (i.e., including one or more other electronic devices) and connect to the remote device through the SDK interface. The application of the electronic device can query the thumbnails of the electronic device through the SDK interface, and can also query the thumbnails of other electronic devices.

[0134] like Figure 5 As shown, the media data middle platform may also include an internal implementation module.

[0135] like Figure 5 As shown, the media data middle platform can also include a device management module, a distributed database, a distributed file system, and a trust link module. Among them, through the device management module, the fusion interconnection platform can be called, and then the remote devices corresponding to the multimedia resources stored in the media data middle platform can be managed. The distributed database can be used to synchronize multimedia resources between cross-end databases. The distributed file system can be used for cross-end file system mounting and removal, and can also be used for cross-end file access, deletion, movement, copying, etc. The trust link module has the ability to connect across devices.

[0136] like Figure 5As shown, the media data center may also include multiple databases for storing multimedia resources (ie, multimedia resources of the electronic device and multimedia resources of other electronic devices).

[0137] Specifically, the media data middle station may include a metadata database, a thumbnail database, a metadata remote slave library, and a thumbnail remote slave library. The metadata database may be used to store metadata corresponding to multimedia resources of an electronic device (also referred to as the local device). The thumbnail database may be used to store identifiers corresponding to thumbnails of multimedia resources of an electronic device (also referred to as the local device) (such as key values ​​corresponding to thumbnails), that is, the thumbnail corresponding to the multimedia resource may be determined by the identifier corresponding to the thumbnail. Exemplarily, the thumbnail database may be a key-value pair database (key-value datebase, KVDB). The metadata remote slave library may be used to store metadata corresponding to multimedia resources of other electronic devices (also referred to as remote devices). The thumbnail remote slave library may be used to store identifiers corresponding to thumbnails of multimedia resources of other electronic devices (also referred to as remote devices) (such as key values ​​corresponding to thumbnails), that is, the thumbnail corresponding to the multimedia resource may be determined by the identifier corresponding to the thumbnail. Exemplarily, the thumbnail remote slave library may be a key-value pair database.

[0138] In some examples, the media data center of an electronic device may include one metadata remote library, or may include multiple metadata remote libraries. A metadata remote library is used to store metadata corresponding to multimedia resources of another electronic device. For example, the media data center of an electronic device may include metadata remote library 1, metadata remote library 2, ..., metadata remote library N, wherein metadata remote library 1 can be used to store metadata corresponding to multimedia resources of remote device 1. Metadata remote library 2 can be used to store metadata corresponding to multimedia resources of remote device 2. Metadata remote library N can be used to store metadata corresponding to multimedia resources of remote device N.

[0139] In some examples, the media data center of the electronic device may include a thumbnail remote library, or may include multiple thumbnail remote libraries. A thumbnail remote library is used to store identifiers corresponding to thumbnails of multimedia resources of another electronic device. For example, the media data center of the electronic device may include thumbnail remote library 1, thumbnail remote library 2, ..., thumbnail remote library N, wherein thumbnail remote library 1 can be used to store identifiers corresponding to thumbnails of multimedia resources of remote device 1. Thumbnail remote library 2 can be used to store identifiers corresponding to thumbnails of multimedia resources of remote device 2. Thumbnail remote library N can be used to store identifiers corresponding to thumbnails of multimedia resources of remote device N.

[0140] exist Figure 5 Based on the software structure diagram of the media data center shown in the figure, combined with Figure 6 As shown, the media data platform may also include an external interface layer. The provider interface and the software development kit interface may be located in the external interface layer of the media data platform, that is, the external interface layer of the media data platform may include the provider interface and the software development kit interface.

[0141] The external interface layer of the media data platform can also include a data platform storage interface. The data platform storage interface can be used to call the data platform storage (i.e., Data Center Store). The provider interface and fields of the media data platform are defined in the data platform storage.

[0142] like Figure 6 As shown, the media data middle platform may further include a permission verification module. The permission verification module may include an Android permission verification module and a distributed permission verification module.

[0143] The Android permission verification module can be used to verify the Android standard permissions for accessing applications. That is, when an application of an electronic device requests access to the media data center of the electronic device, the media data center of the electronic device can verify the Android standard permissions of the application of the electronic device. In the case that the application of the electronic device has Android standard permissions, the application of the electronic device can access the multimedia resources of the electronic device stored in the media data center of the electronic device. Specifically, when the Android permission verification module verifies the Android standard permissions for accessing the application, the storage permission for accessing the application can be verified in the manner of the Android standard media provider (i.e., Media Provider), without the need for additional permission application and adaptation for the application of the electronic device, which facilitates the access and development of the application of the electronic device.

[0144] The distributed permission verification module can be used to verify the distributed permissions for accessing the application. The distributed permission verification can be a verification on top of the Android permission verification, that is, when the application of an electronic device requests to access the multimedia resources of other electronic devices stored in the media data center of the electronic device, it is necessary to first verify the Android standard permissions of the application of the electronic device. In the case where the application of the electronic device has Android standard permissions, the distributed permissions of the application of the electronic device are verified. In the case where the application of the electronic device has distributed permissions, the application of the electronic device can access the multimedia resources of other electronic devices stored in the media data center of the electronic device. Exemplarily, an implementation mechanism of the distributed permission verification may be package name whitelist control.

[0145] like Figure 6As shown, the media data middle platform may also include a local data processing module. The local data processing module may include a media data synchronization module, a gallery data synchronization module, and a thumbnail generation module.

[0146] The media data synchronization module can be used to synchronize the metadata corresponding to the multimedia resources stored in the media provider database of the electronic device to the database of the media data center. Through the media data synchronization module, the electronic device can synchronize the multimedia resources of the media provider database between the electronic device and other electronic devices.

[0147] The gallery data synchronization module can be used to synchronize the metadata corresponding to the multimedia resources stored in the gallery database of the electronic device to the database of the media data center. The electronic device can synchronize the multimedia resources of the gallery database between the electronic device (also called the local device) and other electronic devices through the gallery data synchronization module.

[0148] The thumbnail generation module can be used to generate thumbnails corresponding to multimedia resources based on the metadata corresponding to the multimedia resources stored in the media data center.

[0149] like Figure 6 As shown, the media data middle platform can also include cross-device services. Cross-device services can include application connection management services, device connection management services, user authorization management services, distributed file mounting services, distributed database management services, thumbnail synchronization services, and function switch control services.

[0150] Among them, through the application connection management service, the device management module of the converged interconnection platform can be called, and the remote devices corresponding to the multimedia resources stored in the media data middle platform can be managed through the converged interconnection platform. Through the device connection management service, the converged interconnection platform can be called, and the remote devices can be connected through the converged interconnection platform. Through the user authorization management service, the converged interconnection platform can be called, and the access rights of the remote devices can be managed through the converged interconnection platform. Through the distributed file mounting service, the remote device can be mounted. Through the distributed database management service, the distributed database of the converged interconnection platform can be connected. Through the thumbnail synchronization service, the converged interconnection platform can be called, and the thumbnails corresponding to the multimedia resources of the remote device can be synchronized through the converged interconnection platform. Through the function switch control service, the relevant functions across devices can be controlled.

[0151] In some examples, the permission verification module, the local data processing module and the cross-device service may be located in the internal implementation layer of the media data platform, that is, the internal implementation layer of the media data platform may include the permission verification module, the local data processing module and the cross-device service.

[0152] like Figure 6 As shown, the media data middle platform may also include a converged interconnection platform software development kit (SDK). The media data middle platform can call the converged interconnection platform through the converged interconnection platform software development kit, and then realize the sharing and synchronization of multimedia resources across devices through the converged interconnection platform.

[0153] In some examples, the device management module, the distributed database, the distributed file system, and the trust link module may be located in a converged interconnection platform software development kit, that is, the converged interconnection platform software development kit may include a device management module, a distributed database, a distributed file system, and a trust link module.

[0154] Below Figure 5 Based on the software structure diagram of the media data center shown in the figure, combined with Figure 7 As shown, a schematic description of the provider interface of the media data center is given.

[0155] like Figure 7 As shown, the provider interface of the media data middle platform may include a matching module (ie, matcher), a local standard media data interface, a local classification data interface, a cross-device standard media data interface, and a cross-device classification data interface.

[0156] The multimedia resources stored in the media data center of the electronic device may include the multimedia resources of the electronic device (i.e., local multimedia resources) and the multimedia resources of other electronic devices (i.e., cross-device multimedia resources). The multimedia resources of the electronic device may include standard media data of the electronic device (i.e., local standard media data) and classified media data of the electronic device (i.e., local classified media data). The multimedia resources of other electronic devices may include standard media data of other electronic devices (i.e., cross-device standard media data) and classified media data of other electronic devices (i.e., cross-device classified media data).

[0157] When an application of an electronic device requests to access multimedia resources in the media data center of the electronic device, the application of the electronic device can access the specified data (i.e., local standard media data, local classified media data, cross-device standard media data, or cross-device classified media data) by specifying a URI. Among them, URI (Uniform Resource Identifier) ​​is a string symbol sequence that identifies and locates resources. URI can be used to uniquely identify a data set in ContentProvider.

[0158] In some examples, the URI in the embodiments of the present application adds <device>Fields and <category>field.

[0159] For example, the URI of the provider used by the user is:

[0160] Content: / / com.xxx.mediadatacenter / <device> / <category> / <id>

[0161] Among them, through <device>The field can be used to match devices, i.e. by URI <device>The URI field can distinguish the device corresponding to the multimedia resource that the application of the electronic device requests to access. For example, when the multimedia resource that the application of the electronic device requests to access is a multimedia resource local to the electronic device, the URI field can distinguish the device corresponding to the multimedia resource that the application of the electronic device requests to access. <device>For example, when the multimedia resource requested by the application of an electronic device is a multimedia resource of another electronic device (i.e., a remote device), the URI <device>The field is the device identification of other electronic devices (ie, the device ID of the remote device).

[0162] pass <category>The field can be used to match the type of multimedia resources, that is, by the URI <category>The field can distinguish the type of multimedia resource that the application of the electronic device requests to access. For example, <category>The fields can be standard media types such as Android Image, Video, Audio, etc. <category>Fields can also be system classification information, such as Favorite, Portrait, Geo, etc.

[0163] The matching module can be used to monitor the URI of the access party application (i.e., the application of the electronic device accessing the media data center), and <device>field, determines the device corresponding to the multimedia resource requested by the access party application, and the URI of the access party application <category>field, determines the type of multimedia resources requested by the access party application, and then calls the corresponding interface (i.e., local standard media data interface, local classification data interface, cross-device standard media data interface or cross-device classification data interface) according to the type of device and multimedia resources corresponding to the multimedia resources requested by the access party application to obtain the multimedia resources requested by the access party application from the database of the media data middle station.

[0164] The local standard media data interface can be used to obtain standard media data of an electronic device (i.e., this device). The local classified data interface can be used to obtain classified media data of an electronic device (i.e., this device). The cross-device standard media data interface can be used to obtain standard media data of other devices (i.e., remote devices). The cross-device classified data interface can be used to obtain classified media data of other devices (i.e., remote devices).

[0165] For example, the URI of the access application is:

[0166] Content: / / com.xxx.mediadatacenter / local / files

[0167] That is, the matching module can determine all multimedia files of the electronic device (i.e., the local device) that the access party application requests to access based on the URI of the access party application. At this time, the matching module calls the local standard media data interface to obtain the standard media data of the electronic device (i.e., the local standard media data) from the database of the media data center.

[0168] For example, the URI of the access application is:

[0169] Content: / / com.xxx.mediadatacenter / local / image / <id>

[0170] That is, the matching module can determine the image of the electronic device (i.e., the local device) that the access application requests to access based on the URI of the access application. At this time, the matching module calls the local standard media data interface to obtain the image based on the URI of the access application. <id>field, and obtain the corresponding image from the database of the media data center.

[0171] For example, the URI of the access application is:

[0172] Content: / / com.xxx.mediadatacenter / local / Favorite / <id>

[0173] That is, the matching module can determine the multimedia resources collected by the user of the electronic device (i.e., the local device) that the access party application requests to access based on the URI of the access party application. At this time, the matching module calls the local classification data interface to <id>field, obtains the user's favorite multimedia resources from the database of the media data center.

[0174] For example, the URI of the access application is:

[0175] Content: / / com.xxx.mediadatacenter / device-1 / Video / <id>

[0176] That is, the matching module can determine the video file of the remote device 1 (i.e., other electronic device) requested by the access party application according to the URI of the access party application, and then the matching module calls the cross-device standard media data interface to obtain the video file of the remote device 1 (i.e., other electronic device) according to the URI of the access party application. <id>field, obtains the video file of remote device 1 from the database of the media data center.

[0177] For example, the URI of the access application is:

[0178] Content: / / com.xxx.mediadatacenter / device-2 / Portrait / <id>

[0179] That is, the matching module can determine the portrait album of the remote device 2 (i.e., other electronic devices) requested by the access party application according to the URI of the access party application, and then the matching module calls the cross-device classification data interface to <id>Field, obtains the portrait picture in the portrait album of the remote device 2 from the database of the media data center.

[0180] In the embodiment of the present application, since the provider interface is a The interface of the standard content provider. Therefore, when the application of the electronic device uses the provider interface to obtain the multimedia resources included in the media data center, the developer does not need to adapt the application. That is, the application can be used to access the provider interface, which is more convenient to use.

[0181] Combine the following Figure 8 The following is a schematic diagram of the SDK interface of the media data center.

[0182] like Figure 8 As shown, the SDK interface of the media data middle station may include an application connection management interface, a device connection management interface, and a thumbnail management interface. The application connection management interface can be accessed by the application program of the electronic device (such as a system application or a third-party application), that is, through the application connection management interface, the SDK interface of the media data middle station can communicate with the media data middle station toolkit of the application program of the electronic device, and return a list of remote devices to the application program of the electronic device. The device connection management interface can be used to connect the corresponding remote device through the identifier of the remote device carried by the software development kit included in the media data middle station toolkit. The thumbnail of the media data middle station can be obtained through the thumbnail management interface.

[0183] In this way, since the SDK interface of the media data middle platform can provide cross-device data transmission related capabilities in addition to Android native capabilities, the application of the electronic device can obtain the thumbnails stored in the media data middle platform through the SDK interface of the media data middle platform, and can also realize cross-device management and connection through the SDK interface of the media data middle platform.

[0184] exist Figure 5 Based on the software structure diagram of the media data center shown in the figure, combined with Fig. 9 As shown, the application layer may also include a media data platform toolkit, that is, a software development kit provided by the media data platform to the application of the electronic device. The media data platform toolkit can be inherited in the application of the electronic device, that is, the application of the electronic device can call the SDK interface of the media data platform through the media data platform toolkit and obtain the multimedia resources included in the media data platform.

[0185] Exemplarily, the media data middle platform toolkit can be inherited in the album application (also called gallery application) of the electronic device. Other applications of the media data middle platform toolkit electronic device other than the album application (such as editing applications, communication applications, social applications or file management applications, etc.) can first call the album application of the electronic device, and access the software development kit interface of the media data middle platform through the media data middle platform toolkit integrated in the album application of the electronic device. In this way, other applications of the electronic device other than the album application can obtain the multimedia resources included in the media data middle platform of the electronic device through the album application, without the need to integrate the media data middle platform toolkit in other applications of the electronic device, nor to modify other applications of the electronic device, which can reduce the access cost of other applications of the electronic device.

[0186] Exemplarily, the media data middle platform toolkit can be inherited in other applications of the electronic device other than the album application (such as editing applications, communication applications, social applications or file management applications, etc.). Other applications of the electronic device can directly access the software development kit interface of the media data middle platform through its integrated media data middle platform toolkit. In this way, other applications of the electronic device other than the album application can directly call the software development kit interface of the media data middle platform and obtain the multimedia resources included in the media data middle platform, which can simplify the operation process and thus improve the user experience. Furthermore, other applications of the electronic device other than the album application can be adapted according to its display interface, which can meet the personalized needs of different applications and provide a better user experience.

[0187] In some examples, such as Fig. 9 As shown, the media data middle platform toolkit may include a connection management toolkit, a thumbnail request management toolkit, and a data middle platform storage toolkit. Through the connection management toolkit, the application of the electronic device can communicate with the application connection management interface of the SDK interface of the media data middle platform, and obtain the remote device list returned by the media data middle platform. Through the thumbnail request management toolkit, the application of the electronic device can call the thumbnail management interface of the SDK interface of the media data middle platform to obtain the thumbnail of the media data middle platform through the SDK interface of the media data middle platform. Through the data middle platform storage toolkit, the application of the electronic device can call the data middle platform storage. In this way, the application of the electronic device can call the SDK interface of the media data middle platform through the media data middle platform toolkit and obtain the multimedia resources included in the media data middle platform.

[0188] Below Figure 5 Based on the software structure diagram of the media data center shown in the figure, combined with Fig.10 The process of an application of an electronic device accessing a media data center of the electronic device is schematically illustrated.

[0189] like Fig.10 As shown, the application business layer (upper-layer application) may include multiple applications, that is, the application business layer may include a gallery application (i.e., an album application), and may also include other applications besides the gallery application (such as a clipping application, a communication application, a social application, or a file management application, etc.).

[0190] The gallery application of the electronic device can directly access the media data center of the electronic device. That is to say, the gallery application of the electronic device can call the provider interface or SDK interface of the media data center of the electronic device, and then obtain the multimedia resources stored in the media data center. When the gallery application of the electronic device calls the provider interface of the media data center of the electronic device, the gallery application of the electronic device can directly access the provider interface of the media data center of the electronic device. When the gallery application of the electronic device calls the SDK interface of the media data center of the electronic device, the gallery application of the electronic device can call the provider interface of the media data center of the electronic device through its integrated media data center toolkit.

[0191] For example, taking a mobile phone as an example, Fig.11 As shown in (a) of FIG. 1 , after the user opens the gallery application 1101 of the mobile phone 01, the mobile phone 01 displays the interface corresponding to the gallery application 1101. Fig.11 As shown in (b) of FIG. 1 , the interface corresponding to the gallery application 1101 may include a first viewing control 1102 and a second viewing control 1103. The first viewing control 1102 may be used to request to view multimedia resources (such as pictures or videos) of the mobile phone 01 (i.e., the local device), i.e., the first viewing control 1102 may be the local device identification. The second viewing control 1103 may be used to request to view multimedia resources (such as pictures or videos) of the mobile phone 02 (i.e., other electronic devices), i.e., the second viewing control 1103 may be the identification of the mobile phone 02.

[0192] After mobile phone 01 receives the user's trigger operation on the first viewing control 1102, the media data middle station of mobile phone 01 can send metadata corresponding to the multimedia resources of mobile phone 01 to the gallery application of mobile phone 01 (such as the metadata corresponding to the "Camera" album, "All Photos" album, "Video" album, "Screenshot" album, "My Favorites" album, "Share" album, "Portrait (Personal)" album, and "Portrait (Group Photo)" album included in mobile phone 01). After the gallery application of mobile phone 01 receives the metadata corresponding to the multimedia resources of mobile phone 01, combined with Fig.11 As shown in (b), mobile phone 01 can display metadata corresponding to the multimedia resources of mobile phone 01, that is, the "Camera" album, "All Photos" album, "Video" album, "Screenshot" album, "My Favorites" album, "Share" album, "Portrait (Personal)" album, and "Portrait (Group Photo)" album are displayed in the corresponding interface of the gallery application 1101 of mobile phone 01. It should be noted that after the user opens the gallery application 1101 of mobile phone 01, mobile phone 01 can access the media data middle platform of the electronic device and obtain the metadata corresponding to the multimedia resources of mobile phone 01. That is, after the user opens the gallery application 1101 of mobile phone 01, mobile phone 01 displays the interface corresponding to the gallery application 1101. The interface corresponding to the gallery application 1101 may include the "Camera" album, "All Photos" album, "Video" album, "Screenshot" album, "My Favorites" album, "Share" album, "Portrait (Personal)" album, and "Portrait (Group Photo)" album.

[0193] After mobile phone 01 receives the user's trigger operation on the second viewing control 1103, the media data middle platform of mobile phone 01 can send metadata corresponding to the multimedia resources of mobile phone 02 to the gallery application of mobile phone 01 (such as the metadata corresponding to the "Camera" album, "All Photos" album, "Video" album, "Screenshot" album, "My Favorites" album, "Portrait" album, and "Place" album included in mobile phone 02). After the gallery application of mobile phone 01 receives the metadata corresponding to the multimedia resources of mobile phone 02, combined with Fig.11 As shown in (c), mobile phone 01 can display the metadata corresponding to the multimedia resources of mobile phone 02, that is, the "Camera" album, "All Photos" album, "Video" album, "Screenshot" album, "My Favorites" album, "Portrait" album, and "Place" album included in mobile phone 02 are displayed in the corresponding interface of the gallery application 1101 of mobile phone 01.

[0194] Combination Fig.11 As shown in (c) in FIG. 1 , after the mobile phone 01 receives the user's selection operation for the portrait picture 1104 in the "Portrait" album, the gallery application of the mobile phone 01 can call the provider interface of the media data center of the mobile phone 01 to obtain the metadata corresponding to the portrait picture 1104 from the media data center of the mobile phone 01. After the mobile phone 01 receives the metadata corresponding to the portrait picture 1104 sent by the media data center of the mobile phone 01, combined with Fig.11 As shown in (d) in FIG. 1 , the gallery application of mobile phone 01 displays a portrait picture 1104 in the “Portrait” album included in mobile phone 02 .

[0195] In this way, the user can use the gallery application of the electronic device to view the multimedia resources of the electronic device, and can also view the multimedia resources of other electronic devices. Moreover, when the user uses the gallery application of the electronic device to view the multimedia resources of other electronic devices, not only can the standard media data of other electronic devices be viewed, but also the classified media data of other electronic devices and the thumbnails corresponding to the multimedia resources can be viewed, thereby realizing the sharing of multimedia resources across devices, which can improve the access efficiency of users.

[0196] There are two ways for other applications of electronic devices other than the gallery application to access the media data center of the electronic device. One way is that other applications of the electronic device can call the gallery application of the electronic device and obtain the multimedia resources stored in the media data center of the electronic device (i.e., the multimedia resources of the electronic device and the multimedia resources of other electronic devices) through the gallery application of the electronic device.

[0197] In some examples, when other applications of an electronic device obtain multimedia resources stored in the media data center of the electronic device through the gallery application of the electronic device, the other applications of the electronic device can call the gallery selection page or distributed album page of the gallery application of the electronic device, and call the provider (i.e., Provider) interface of the media data center of the electronic device through the gallery selection page or distributed album page of the gallery application of the electronic device to obtain the multimedia resources stored in the media data center of the electronic device (i.e., standard media data and classified media data of the electronic device, standard media data and classified media data of other electronic devices).

[0198] In some examples, when other applications of an electronic device obtain multimedia resources stored in the media data middle platform of the electronic device through the gallery application of the electronic device, the other applications of the electronic device can call the media data middle platform toolkit of the gallery application of the electronic device (that is, the software development kit provided by the media data middle platform to the application of the electronic device), and call the SDK interface of the media data middle platform of the electronic device through the media data middle platform toolkit of the gallery application of the electronic device to obtain the multimedia resources stored in the media data middle platform of the electronic device (that is, thumbnails corresponding to the multimedia resources of the electronic device and thumbnails corresponding to the multimedia resources of other electronic devices).

[0199] For example, taking the electronic device as a mobile phone and the other application of the electronic device as a clip application, Fig.12 As shown in (a) of FIG. 1 , the user opens the clipping application 1201 of the mobile phone 01, and the mobile phone 01 displays the interface corresponding to the clipping application 1201. Fig.12 As shown in (b) of FIG. 1 , the interface corresponding to the clipping application 1201 may include a picture selection control 1202, and the picture selection control 1202 may be used to call the picture gallery selection page of the picture gallery application of the mobile phone 01. After the clipping application 1201 of the mobile phone 01 receives the user's triggering operation on the picture selection control 1202, combined with Fig.12 As shown in (c), the editing application of mobile phone 01 can call the gallery selection page of the gallery application, and call the provider interface of the media data middle platform of mobile phone 01 through the gallery selection page of the gallery application to obtain the multimedia resources stored in the media data middle platform of mobile phone 01 (such as the metadata corresponding to the multimedia resources of mobile phone 01), and display the gallery selection page. The gallery selection page can include the multimedia resources of mobile phone 01, such as the "Camera" album, "All Photos" album, "Video" album, "Screenshot" album, "My Favorites" album, "Share" album, "Portrait (Personal)" album, and "Portrait (Group Photo)" album included in mobile phone 01.

[0200] And, combined with Fig.12 As shown in (c), the editing application of mobile phone 01 can also call the media data middle platform toolkit of the gallery application through the gallery selection page of the gallery application, and then the editing application of mobile phone 01 can call the SDK interface of the media data middle platform of mobile phone 01 through the media data middle platform toolkit of the gallery application to obtain and display the remote device list, that is, display the viewing control 1203 for requesting to view the multimedia resources of mobile phone 02 (that is, the remote device list includes mobile phone 02). Viewing control 1203 can be the identification of mobile phone 02.

[0201] After the editing application of mobile phone 01 receives the user's trigger operation on the viewing control 1203, the editing application of mobile phone 01 can call the provider interface of the media data middle platform of mobile phone 01 through the gallery selection page of the gallery application to obtain the multimedia resources stored in the media data middle platform of mobile phone 02 (such as the metadata corresponding to the multimedia resources of mobile phone 02), and display the multimedia resources included in mobile phone 02, such as the "Camera" album, "All Photos" album, "Video" album, "Screenshot" album, "My Favorites" album, "Portrait" album, and "Place" album included in mobile phone 02.

[0202] For example, taking the electronic device as a mobile phone and the other application of the electronic device as a communication application, Fig.13 As shown in (a) of FIG. 1 , the user opens the communication application 1301 of the mobile phone 01, and the mobile phone 01 displays the interface corresponding to the communication application 1301. Fig.13 As shown in (b) of FIG. 1 , the interface corresponding to the communication application 1301 may include a picture selection control 1302, and the picture selection control 1302 may be used to call the picture gallery selection page of the picture gallery application of the mobile phone 01. For example, the picture selection control 1302 may be a picture gallery logo. After the communication application 1301 of the mobile phone 01 receives the user's triggering operation on the picture selection control 1302, in combination with Fig.13 As shown in (c), the communication application of mobile phone 01 can call the gallery selection page of the gallery application, and call the provider interface of the media data middle platform of mobile phone 01 through the gallery selection page of the gallery application to obtain the multimedia resources stored in the media data middle platform of mobile phone 01 (such as the metadata corresponding to the multimedia resources of mobile phone 01), and display the gallery selection page. The gallery selection page can include the multimedia resources of mobile phone 01, such as the "Camera" album, "All Photos" album, "Video" album, "Screenshot" album, "My Favorites" album, "Share" album, "Portrait (Personal)" album, and "Portrait (Group Photo)" album included in mobile phone 01.

[0203] And, combined with Fig.13 As shown in (c), the communication application of mobile phone 01 can also call the media data middle platform toolkit of the gallery application through the gallery selection page of the gallery application, and then the communication application of mobile phone 01 can call the SDK interface of the media data middle platform of mobile phone 01 through the media data middle platform toolkit of the gallery application to obtain and display the remote device list, that is, display the viewing control 1303 for requesting to view the multimedia resources of mobile phone 02 (that is, the remote device list includes mobile phone 02). Viewing control 1303 can be the identification of mobile phone 02.

[0204] After the communication application of mobile phone 01 receives the user's trigger operation on the viewing control 1303, the communication application of mobile phone 01 can call the provider interface of the media data middle platform of mobile phone 01 through the gallery selection page of the gallery application to obtain the multimedia resources stored in the media data middle platform of mobile phone 02 (such as the metadata corresponding to the multimedia resources of mobile phone 02), and display the multimedia resources included in mobile phone 02, such as the "Camera" album, "All Photos" album, "Video" album, "Screenshot" album, "My Favorites" album, "Portrait" album, and "Place" album included in mobile phone 02.

[0205] In this way, other applications of the electronic device except the gallery application can obtain the multimedia resources stored in the media data middle platform of the electronic device through the gallery application. There is no need to integrate the media data middle platform toolkit in other applications of the electronic device, nor is there any need to modify other applications of the electronic device, which can reduce the access cost of other applications of the electronic device.

[0206] Another way is that other applications of the electronic device can directly obtain the multimedia resources stored in the media data center of the electronic device (ie, the multimedia resources of the electronic device and the multimedia resources of other electronic devices).

[0207] In some examples, when other applications of an electronic device obtain multimedia resources stored in the media data center of the electronic device, the other applications of the electronic device can call the provider interface of the media data center of the electronic device to obtain the multimedia resources stored in the media data center of the electronic device (i.e., standard media data and classified media data of the electronic device, standard media data and classified media data of other electronic devices).

[0208] In some examples, other applications of the electronic device may integrate the media data platform toolkit of the electronic device. When other applications of the electronic device obtain multimedia resources stored in the media data platform of the electronic device, other applications of the electronic device may access the media data platform of the electronic device through the integrated media data platform toolkit of the electronic device to obtain the multimedia resources stored in the media data platform of the electronic device (i.e., thumbnails corresponding to the multimedia resources of the electronic device and thumbnails corresponding to the multimedia resources of other electronic devices).

[0209] For example, taking the electronic device as a mobile phone and the other application of the electronic device as a file management application, Fig.14 As shown in (a) of FIG. 1 , the user opens the file management application 1401 of the mobile phone 01, and the mobile phone 01 displays the interface corresponding to the file management application 1401. Fig.14 As shown in (b), the file management application of mobile phone 01 can call the provider interface of the media data middle platform of mobile phone 01 to obtain the multimedia resources stored in the media data middle platform of mobile phone 01, that is, the interface corresponding to the file management application 1401 may include the "All Photos" album, "Video" folder, "Audio" folder, and "Document" folder included in mobile phone 01, so that the user can select photos, videos, audio, or documents included in mobile phone 01.

[0210] And, combined with Fig.14 As shown in (b), the file management application of mobile phone 01 can also call the SDK interface of the media data middle platform of mobile phone 01 through its integrated media data middle platform toolkit to obtain and display the remote device list, that is, display the viewing control 1402 for requesting multimedia resources of the tablet computer (that is, the remote device list includes the tablet computer). Viewing control 1402 can be a "my tablet computer" logo.

[0211] Combination Fig.14 As shown in (c), after the file management application of mobile phone 01 receives the user's trigger operation on the viewing control 1402, the file management application of mobile phone 01 can call the provider interface of the media data middle platform of mobile phone 01 to obtain the multimedia resources stored in the media data middle platform of mobile phone 01, that is, the interface corresponding to the file management application 1401 may include the "All Photos" album, "Video" folder, and "Document" folder included in the tablet computer, so that the user can select photos, videos, or documents included in the tablet computer.

[0212] In this way, other applications of the electronic device except the album application can directly call the media data middle platform of the electronic device to obtain the multimedia resources stored in the media data middle platform of the electronic device, which can simplify the operation process and thus improve the user experience. Furthermore, other applications of the electronic device except the album application can be adapted according to its display interface, which can meet the personalized needs of different applications and provide a better user experience.

[0213] In the embodiment of the present application, the two ways in which the application of the electronic device accesses the media data middle platform of the electronic device can be implemented through the provider interface and SDK of the media data middle platform of the electronic device. In other words, the media data middle platform of the electronic device provided in the embodiment of the present application can provide an efficient and convenient data access method, so that users can easily access the multimedia resources of the local electronic device and other electronic devices.

[0214] In some examples, the media data platform may also include a search service. An application of an electronic device (such as a gallery application, a communication application, a clipping application, or a social application) may include a search software development kit. When an application of an electronic device views multimedia resources stored in the media data platform of the electronic device, the application of the electronic device can call the search service of the media data platform through the search software development kit, and then search for the required multimedia resources in the multimedia resources stored in the media data platform. In this way, when a user views pictures and videos taken by the electronic device stored in the album application through other applications of the electronic device, the user can search for the corresponding pictures and videos as needed, which is more convenient to use.

[0215] Before the application of the electronic device obtains the multimedia resources stored in the media data center of the electronic device, the media data center of the electronic device needs to first obtain and store the multimedia resources of the electronic device and the multimedia resources of other electronic devices. Figure 5 Based on the software structure diagram of the media data center shown in the figure, combined with Fig.10 , a schematic illustration is given of a process in which a media data center of an electronic device acquires and stores multimedia resources of the electronic device, and a process in which a media data center of an electronic device acquires and stores multimedia resources of other electronic devices.

[0216] First, the media data center of the first electronic device is started, and the media data center can obtain and store metadata corresponding to the multimedia resources included in the first electronic device (metadata corresponding to the multimedia resources of the local device) from the media database corresponding to the media provider of the first electronic device and the gallery database corresponding to the gallery. That is, the media data center of the first electronic device can synchronize the metadata corresponding to the multimedia resources stored in the media database of the first electronic device and the metadata corresponding to the multimedia resources stored in the gallery database to the database of the media data center of the first electronic device (i.e., the metadata database).

[0217] That is to say, the multimedia resources of the electronic device (the local multimedia resources) stored in the media data center of the electronic device can have two sources, namely, one source is the gallery database (that is, the database corresponding to the gallery application of the electronic device), and the other source is the media database (that is, the database corresponding to all multimedia resources included in the electronic device).

[0218] Among them, the media database can be a database corresponding to the media provider. The media database can be used to store metadata corresponding to multimedia resources (such as audio, video, pictures or documents) generated by the media provider. For example, the metadata stored in the media database may include the identification of the picture (ie id), the storage path of the picture (ie data), the size of the picture (ie size), the timestamp corresponding to the picture (ie date_modified), the name of the picture (ie display_name), the rotation angle of the picture (ie orientation), etc. For example, when a user uses an electronic device to take a picture or share a picture with other electronic devices, the media provider obtains the metadata corresponding to the picture and stores the metadata corresponding to the picture in the media database. It should be noted that the media database may include metadata corresponding to multimedia resources generated by the system application of the electronic device, and may also include metadata corresponding to multimedia resources generated by third-party applications.

[0219] The gallery database can be used to store metadata corresponding to videos or pictures of the electronic device. Exemplarily, the metadata stored in the gallery database can be divided into basic data and extended data, wherein the basic data can be metadata corresponding to pictures and videos obtained from the media database, that is, Native pictures and videos, such as picture identification, picture storage path, picture size, picture corresponding timestamp, picture name, picture rotation angle. In other words, the gallery database synchronizes the metadata (i.e., basic data) corresponding to some multimedia resources in the media database to the gallery database.

[0220] The extended data may be private data generated by the processing logic of the gallery. For example, the private data may include pictures and videos collected by the user, or data in classified albums (such as portrait albums, location albums, or food albums, etc.). For example, the gallery may process a portrait image, generate portrait-related data corresponding to the portrait image (such as facial coordinates, facial features, etc.), and store the portrait-related data corresponding to the portrait image in the gallery database.

[0221] In some examples, when an application of an electronic device (such as a photo album application or a third-party application) calls the media data middle platform, the media data middle platform of the electronic device is started. In this way, when the user uses the application of the electronic device, there is no need to perform cumbersome operations, and the media data middle platform of the electronic device can be called without perception, and the local multimedia resources of the electronic device and the multimedia resources of other electronic devices can be obtained through the media data middle platform of the electronic device.

[0222] Then, after the user opens the application of the first electronic device, the application of the first electronic device can call the SDK interface of the media data center of the first electronic device to obtain a remote device list (i.e., the remote device list may include other electronic devices). The user can select the device corresponding to the multimedia resource to be obtained (i.e., other electronic devices) through the remote device list.

[0223] After the application of the first electronic device receives the user's selection operation for the remote device list, the application of the first electronic device determines the device identification of the second electronic device. The application of the first electronic device can send a device connection request to the media data middle station of the first electronic device through the SDK interface of the media data middle station of the first electronic device, and the device connection request may include the device identification of the second electronic device. After the media data middle station of the first electronic device receives the device connection request, the media data middle station of the first electronic device can call the fusion interconnection platform of the first electronic device through the fusion interconnection platform software development kit. The fusion interconnection platform of the first electronic device establishes a communication connection with the fusion interconnection platform of the second electronic device according to the device identification of the second electronic device. After the fusion interconnection platform of the first electronic device establishes a communication connection with the fusion interconnection platform of the second electronic device, the fusion interconnection platform of the first electronic device can send a data synchronization request to the fusion interconnection platform of the second electronic device to obtain the multimedia resources of the second electronic device (such as standard media data, classified media data or thumbnails corresponding to multimedia resources).

[0224] After the fusion interconnection platform of the second electronic device receives the data synchronization request, the fusion interconnection platform of the second electronic device can obtain the multimedia resources of the second electronic device from the media data center of the second electronic device. After obtaining the multimedia resources of the second electronic device, the fusion interconnection platform of the second electronic device sends the multimedia resources of the second electronic device to the fusion interconnection platform of the first electronic device. After the fusion interconnection platform of the first electronic device receives the multimedia resources of the second electronic device, the fusion interconnection platform of the first electronic device stores the multimedia resources of the second electronic device in the corresponding database of the media data center of the first electronic device (that is, the standard media data and classified media data of the second electronic device are stored in the metadata remote slave library, and the thumbnail identifiers corresponding to the multimedia resources of the second electronic device are stored in the thumbnail remote slave library).

[0225] Afterwards, after the application of the first electronic device receives the user's query operation for the remote device list, the application of the first electronic device sends a query request for the multimedia resources of the second electronic device to the media data center of the first electronic device through the provider interface of the media data center of the first electronic device. After receiving the query request, the media data center of the first electronic device obtains the multimedia resources of the second electronic device from the database of the media data center of the first electronic device, and returns the multimedia resources of the second electronic device to the application of the first electronic device.

[0226] Finally, the application of the first electronic device receives the multimedia resource of the second electronic device, and the application of the first electronic device displays the multimedia resource of the second electronic device.

[0227] In this way, the media data center of the electronic device can obtain the multimedia resources of the electronic device and store the multimedia resources of the electronic device in the database of the media data center, so that the application of the electronic device can view the multimedia resources of the electronic device, and then the user can efficiently and conveniently access the multimedia resources of the electronic device. Furthermore, the media data center of the electronic device can obtain the multimedia resources of other electronic devices by utilizing the capabilities of the converged interconnection platform, so that the user can view the multimedia resources of other electronic devices through one electronic device, and then the sharing and synchronization of multimedia resources between devices can be realized.

[0228] Furthermore, the solution of the present application can support the sharing and synchronization of different types of multimedia resources, meet the usage requirements of different users, and improve the user experience.

[0229] Below Fig.10 Based on the software structure diagram of the media data center of the electronic device, combined with Fig.15 The method for displaying multimedia resources provided in the embodiment of the present application is schematically described. Fig.15 As shown, the method for displaying multimedia resources may include S1501-S1539.

[0230] S1501: A user opens a client module of a first application program of a first electronic device.

[0231] The first application may be a system application of the first electronic device, such as a gallery application (also referred to as an album application), a communication application, or a clipping application included in the first electronic device. The first application may also be an application of a third party in the electronic device, such as a third-party clipping application, a third-party communication application, a third-party social application, etc. The specific type of the first application is not limited in the embodiments of the present application.

[0232] The user opens the client module (i.e., client) of the first application in the first electronic device, that is, the user opens the first application in the first electronic device. If the user clicks the icon corresponding to the first application included in the first electronic device, the client module of the first application of the first electronic device can access the first media data middle platform of the first electronic device through the media data middle platform toolkit of the first application.

[0233] S1502. The client module of the first application sends a binding service request to the media data middle platform toolkit of the first application.

[0234] The media data middle platform toolkit of the first application may include a software development kit (i.e., client SDK) provided by the first media data middle platform of the first electronic device to the first application. The client module of the first application may call the SDK interface of the first media data middle platform through the media data middle platform toolkit of the first application, and obtain the multimedia resources included in the first media data middle platform. Exemplarily, the media data middle platform toolkit may include a connection management toolkit, a thumbnail request management toolkit, and a data middle platform storage toolkit.

[0235] The binding service request can be used to request the binding service of the first media data station of the first electronic device, that is, to request to establish a communication connection with the first media data station of the first electronic device. When the first application of the first electronic device needs to access the first media data station of the first electronic device, the first application of the first electronic device can send a binding service request to the first media data station of the first electronic device (that is, the application connection management service of the first media data station) to request to bind the service with the first media data station of the first electronic device (that is, the application connection management service of the first media data station), that is, to notify the first media data station of the first electronic device (that is, the application connection management service of the first media data station) that the first application of the first electronic device needs to access the first media data station of the first electronic device and establish a communication connection with the first media data station of the first electronic device. When the first application requests to bind the service with the first media data station of the first electronic device, the first application can use the bind Service() method to bind the service.

[0236] In some examples, the first application of the first electronic device can send a binding service request through its integrated media data middle platform toolkit. That is, the client module of the first application of the first electronic device can send a binding service request to the media data middle platform toolkit of the first application to send a binding service request to the application connection management service of the first media data middle platform through the media data middle platform toolkit of the first application.

[0237] In some examples, before the client module of the first application sends a binding service request to the media data middleware toolkit of the first application, the client module of the first application sends an initialization notification to the media data middleware toolkit of the first application to initialize the media data middleware toolkit of the first application, i.e., trigger the startup of the media data middleware toolkit of the first application.

[0238] Exemplarily, the media data middle platform toolkit of the first application is initialized, that is, the media data middle platform software development toolkit integrated by the first application performs a singleton initialization operation.

[0239] S1503. The media data middle platform toolkit of the first application receives the binding service request and sends the binding service request to the application connection management service of the first media data middle platform.

[0240] After the media data middle platform toolkit of the first application receives the binding service request sent by the client module of the first application, the media data middle platform toolkit of the first application can send a binding service request to the application connection management service (i.e., link service) of the first media data middle platform to request to establish a communication connection with the application connection management service of the first media data middle platform.

[0241] Exemplarily, when the media data middle platform toolkit of the first application sends a binding service request to the application connection management service of the first media data middle platform, the media data middle platform toolkit of the first application can call the SDK interface of the first media data middle platform to send a binding service request to the application connection management service of the first media data middle platform.

[0242] S1504. The application connection management service of the first media data center receives the binding service request and sends a first initialization notification to the device connection management service of the first media data center. The first initialization notification is used to trigger the device connection management service of the first media data center to perform an initialization operation.

[0243] After the application connection management service of the first media data center receives the binding service request sent by the media data center toolkit of the first application, the application connection management service of the first media data center can send a first initialization notification to the device connection management (Center Device Manager) service of the first media data center to perform initialization operations on the device connection management service of the first media data center.

[0244] Exemplarily, after the application connection management service of the first media data middle station receives the binding service request sent by the media data middle station toolkit of the first application, the application connection management service of the first media data middle station creates an onCreate() method and uses the on Create() method to perform initialization operations.

[0245] S1505. The device connection management service of the first media data center receives a first initialization notification sent by the application connection management service of the first media data center, and performs an initialization operation.

[0246] After the device connection management service of the first media data center receives the first initialization notification sent by the application connection management service of the first media data center, the device connection management service of the first media data center performs an initialization operation. Exemplarily, the device connection management service of the first media data center performs a singleton initialization operation.

[0247] S1506. The device connection management service of the first media data middle station sends a second initialization notification to the device management and device connection module of the first media data middle station, where the second initialization notification is used to trigger the device connection management service of the first media data middle station to perform an initialization operation.

[0248] The device management and device connection module of the first media data middle platform may include a device management module and a trust link module. Through the device management module, the fusion interconnection platform can be called to manage the remote devices corresponding to the multimedia resources stored in the media data middle platform. The distributed database can be used to synchronize multimedia resources between cross-end databases. The distributed file system can be used for cross-end file system mounting and removal, and can also be used for cross-end file access, deletion, movement, copying, etc.

[0249] After the device connection management service of the first media data center completes initialization, the device connection management service of the first media data center sends a second initialization notification to the device management and device connection module of the first media data center to notify the device management and device connection module of the first media data center to perform initialization operations.

[0250] S1507: The device connection management service of the first media data middle station sends a first remote device list request to the device management and device connection module of the first media data middle station.

[0251] After the device management and device connection module of the first media data center performs an initialization operation, the device connection management service of the first media data center can send a first remote device list request to the device management and device connection module of the first media data center. The first remote device list request can be used to request a remote device list (i.e., an online device list). The remote device list may include other electronic devices that the converged interconnection platform of the first electronic device can connect to.

[0252] Exemplarily, the device connection management service of the first media data center can use the get Online Devices() method to obtain the remote device list from the device management and device connection module of the first media data center.

[0253] In some examples, after the device connection management service of the first media data center sends a first remote device list request to the device management and device connection module of the first media data center, the device connection management service of the first media data center can register a device observer (i.e., DeviceObserver) with the device management and device connection module of the first media data center. By registering a device observer with the device management and device connection module of the first media data center, the device connection management service of the first media data center can receive a notification or callback when the device status of a remote device in the remote device list changes. Exemplarily, the device connection management service of the first media data center can use the register Device Observer (Device Observer) method to register a device observer with the device management and device connection module of the first media data center.

[0254] S1508. The device connection management service of the first media data center generates a remote device list.

[0255] After the device connection management service of the first media data center registers the device observer with the device management and device connection module of the first media data center, the device connection management service of the first media data center can obtain remote device information and generate a remote device list based on the remote device information.

[0256] S1509. The device connection management service of the first media data center sends a first notification to the application connection management service of the first media data center.

[0257] After the application connection management service of the first media data center, the device connection management service of the first media data center, and the device management and device connection module of the first media data center are initialized, the device connection management service of the first media data center sends a first notification to the application connection management service of the first media data center, and the first notification is used to indicate that the first media data center has completed initialization.

[0258] S1510. The application connection management service of the first media data middle station receives the first notification and creates a binding service.

[0259] After the application connection management service of the first media data center receives the first notification, the application connection management service of the first media data center creates a binding service, that is, the application connection management service of the first media data center establishes a communication connection with the first application program.

[0260] S1511. The application connection management service of the first media data middle platform sends a second notification to the media data middle platform toolkit of the first application program, where the second notification is used to indicate that the binding is successful.

[0261] After the application connection management service of the first media data middle station is bound to the first application, the application connection management service of the first media data middle station sends a second notification to the media data middle station toolkit of the first application to notify the media data middle station toolkit of the first application that the application connection management service of the first media data middle station is successfully bound to the first application.

[0262] S1512. The media data middle platform toolkit of the first application receives the second notification and sends the second notification to the client module of the first application.

[0263] After the media data middle platform toolkit of the first application receives the second notification sent by the application connection management service of the first media data middle platform, it sends a second notification to the client module of the first application to notify the client module of the first application that the application connection management service of the first media data middle platform is successfully bound to the first application.

[0264] S1513. The client module of the first application receives the second notification and sends a second remote device list request to the media data middle platform toolkit of the first application.

[0265] After the client module of the first application receives the second notification, the client module of the first application may send a second remote device list request to the media data middleware toolkit of the first application. The second remote device list request may be used to request to obtain a remote device list.

[0266] Exemplarily, the client module of the first application may use the queryDeviceList() function to query the remote device list, ie, send a second remote device list request to the media data middleware toolkit of the first application.

[0267] S1514. The media data middle platform toolkit of the first application receives the second remote device list request, and sends the second remote device list request to the application connection management service of the first media data middle platform.

[0268] After the media data middle platform toolkit of the first application receives the second remote device list request sent by the client module of the first application, it can send the second remote device list request to the application connection management service of the first media data middle platform. Exemplarily, the media data middle platform toolkit of the first application can use the queryDeviceList() function to query the remote device list, that is, send the second remote device list request to the application connection management service of the first media data middle platform.

[0269] S1515. The application connection management service of the first media data center receives the second remote device list request, and sends the second remote device list request to the device connection management service of the first media data center.

[0270] After the application connection management service of the first media data middle station receives the second remote device list request sent by the media data middle station toolkit of the first application, it can send the second remote device list request to the device connection management service of the first media data middle station. Exemplarily, the application connection management service of the first media data middle station can use the queryDeviceList() function to query the remote device list, that is, send the second remote device list request to the device connection management service of the first media data middle station.

[0271] S1516. The device connection management service of the first media data center receives the second remote device list request and sends the remote device list to the application connection management service of the first media data center.

[0272] After the device connection management service of the first media data center receives the second remote device list request sent by the application connection management service of the first media data center, it returns the remote device list to the application connection management service of the first media data center, so as to return the remote device list to the first application through the application connection management service of the first media data center.

[0273] S1517. The application connection management service of the first media data middle platform receives the remote device list and sends the remote device list to the media data middle platform toolkit of the first application program.

[0274] After the application connection management service of the first media data middle station receives the remote device list sent by the device connection management service of the first media data middle station, it returns the remote device list to the media data middle station toolkit of the first application, so as to return the remote device list to the client of the first application through the media data middle station toolkit of the first application.

[0275] S1518. The media data middle platform toolkit of the first application receives the remote device list and sends the remote device list to the client module of the first application.

[0276] After the media data middle platform toolkit of the first application receives the remote device list sent by the application connection management service of the first media data middle platform, the remote device list can be sent by the client module of the first application, that is, the remote device list is displayed on the interface corresponding to the client module of the first application. In this way, the user can select the device to obtain multimedia resources from the remote device list.

[0277] S1519: Perform a selection operation on a second electronic device in the remote device list. When the user needs to obtain multimedia resources of a second electronic device, the user can select the second electronic device in the remote device list.

[0278] S1520. In response to the selection operation, the client module of the first application sends a device connection request to the media data middleware toolkit of the first application.

[0279] When the user selects the second electronic device in the remote device list, in response to the selection operation, the client module of the first application sends a device connection request to the second electronic device to the media data middle platform toolkit of the first application. The device connection request can be used to request a connection to the second electronic device, that is, the first media data middle platform of the first electronic device obtains and stores the multimedia resources of the second electronic device. The device connection request may include a device identifier of the second electronic device.

[0280] Exemplarily, the client module of the first application may use the connect Device(String) function to connect to the second electronic device, ie, send a device connection request for the second electronic device to the media data middle platform toolkit of the first application.

[0281] S1521. The media data middle platform toolkit of the first application receives a device connection request and sends the device connection request to the application connection management service of the first media data middle platform.

[0282] After the media data middle platform toolkit of the first application receives the device connection request for the second electronic device sent by the client module of the first application, it can send a device connection request for the second electronic device to the application connection management service of the first media data middle platform, so that the first media data middle platform obtains and stores the multimedia resources of the second electronic device.

[0283] Exemplarily, the media data platform toolkit of the first application can use the connect Device(String) function to connect to the second electronic device, that is, send a device connection request for the second electronic device to the application connection management service of the first media data platform.

[0284] S1522: The application connection management service of the first media data center receives the device connection request, and sends the device connection request to the device connection management service of the first media data center.

[0285] Exemplarily, the application connection management service of the first media data center can use the connect Device (String) function to connect to the second electronic device, that is, send a device connection request for the second electronic device to the device connection management service of the first media data center.

[0286] S1523: The device connection management service of the first media data middle station receives the device connection request and sends a session service request to the device management and device connection module of the first media data middle station.

[0287] After the device connection management service of the first media data center receives the device connection request, the device connection management service of the first media data center sends a session service request to the device management and device connection module of the first media data center. The session service request can be used to request to establish a session service with the device management and device connection module of the first media data center. Exemplarily, the device connection management service of the first media data center uses the createSessionServer method to establish a session service with the device management and device connection module of the first media data center.

[0288] S1524. The device management and device connection module of the first media data center receives the session service request, creates a session service, and sends a third notification to the device connection management service of the first media data center.

[0289] The third notification is used to indicate that the session service between the device connection management service of a media data middle station and the device management and device connection module of the first media data middle station is successfully established.

[0290] S1525. The device connection management service of the first media data middle station receives the third notification and establishes a physical link with the device management and device connection module of the first media data middle station.

[0291] After the device connection management service of the first media data center receives the third notification, the device connection management service of the first media data center can establish a physical link with the device management and device connection module of the first media data center. Exemplarily, the device connection management service of the first media data center can use the open Session (String) function to open a session in the registered media data center to establish a communication connection with the device management and device connection module of the first media data center.

[0292] S1526: Send a link establishment request to the second media data middle station of the second electronic device.

[0293] Exemplarily, the trust link module of the first media data middle station starts the remote service and sends a link establishment request to the second media data middle station of the second electronic device according to the device identification of the second electronic device, where the link establishment request is used to request to establish a link with the second electronic device.

[0294] S1527. The second electronic device establishes a link with the device management and device connection module of the first media data middle station, and sends a fourth notification to the device management and device connection module of the first media data middle station, where the fourth notification is used to indicate that the link is successfully established.

[0295] The second media data middle station of the second electronic device establishes a link with the device management and device connection module of the first media data middle station through the trust link module. After the second media data middle station of the second electronic device establishes a link with the first media data middle station of the first electronic device, a fourth notification is sent to the device management and device connection module of the first media data middle station to notify the device management and device connection module of the first media data middle station that the link is successfully established.

[0296] S1528. The device management and device connection module of the first media data middle station receives the fourth notification and sends the fourth notification to the device connection management service of the first media data middle station.

[0297] S1529. The device connection management service of the first media data middle station mounts the second electronic device.

[0298] After the device management and device connection module of the first media data middle station establishes a link with the second media data middle station of the second electronic device, the device connection management service of the first media data middle station can create a mount point for the second electronic device in the distributed file system.

[0299] S1530: Send a fifth notification to the device connection management service of the first media data middle station, where the fifth notification is used to indicate that the mounting is successful.

[0300] After the distributed file system of the first media data center creates the mount point of the second electronic device, a fifth notification is sent to the device connection management service of the first media data center to notify the device connection management service of the first media data center that the second electronic device is mounted successfully.

[0301] S1531. The device connection management service of the first media data middle station sends a distributed database initialization notification to the distributed database of the first media data middle station.

[0302] After the device connection management service of the first media data center creates a mount point for the second electronic device in the distributed file system, the device connection management service of the first media data center can send a distributed database initialization notification to the distributed database of the first media data center to initialize the distributed database of the first media data center.

[0303] S1532. The distributed database of the first media data middle station receives the distributed database initialization notification, and sends a sixth notification to the device connection management service of the first media data middle station, where the sixth notification is used to indicate that the distributed database initialization is successful.

[0304] After receiving the distributed database initialization notification sent by the device connection management service of the first media data center, the distributed database of the first media data center performs an initialization operation, that is, the device connection management service of the first media data center connects to the distributed database of the first media data center.

[0305] S1533. The distributed database of the first media data middle station sends a synchronization request to the second media data middle station of the second electronic device.

[0306] After the device connection management service of the first media data center is connected to the distributed database of the first media data center, the distributed database of the first media data center can send a synchronization request to the second media data center of the second electronic device to request synchronization of the multimedia resources of the second electronic device.

[0307] S1534: The second media data middle station of the second electronic device receives the synchronization request and sends the multimedia resources of the second electronic device to the distributed database of the first media data middle station.

[0308] After the second media data center of the second electronic device receives the synchronization request, it sends the multimedia resources of the second electronic device (i.e., the standard media data, classified media data, and thumbnails stored in the database of the second media data center) to the distributed database of the first media data center. The distributed database of the first media data center receives the multimedia resources of the second electronic device and stores the multimedia resources of the second electronic device in the database of the first media data center. In this way, the first application of the first electronic device can obtain the multimedia resources of the second electronic device through the first media data center.

[0309] S1535. The distributed database of the first media data middle station sends a data synchronization notification to the device connection management service of the first media data middle station.

[0310] After the distributed database of the first media data center obtains the multimedia resources of the second electronic device, the distributed database of the first media data center can send a data synchronization notification to the device connection management service of the first media data center. The data synchronization notification can be used to instruct the first media data center of the first electronic device to synchronize the multimedia resources of the second electronic device.

[0311] S1536: The device connection management service of the first media data center receives the data synchronization notification and updates the device status of the second electronic device.

[0312] After the device connection management service of the first media data center receives the data synchronization notification, the device connection management service of the first media data center can update the device status of the second electronic device so that the first application of the first electronic device can obtain the multimedia resources of the second electronic device.

[0313] S1537. The device connection management service of the first media data middle station obtains a callback function of the first application.

[0314] S1538. The application connection management service of the first media data middle platform calls the callback function of the first application and sends a seventh notification to the media data middle platform toolkit of the first application.

[0315] S1539. The media data middle platform toolkit of the first application receives the seventh notification and sends the seventh notification to the client module of the first application.

[0316] The application connection management service of the first media data middle platform calls the callback function of the first application, sends a seventh notification to the media data middle platform toolkit of the first application, and sends the seventh notification to the client module of the first application through the media data middle platform toolkit of the first application. The seventh notification is used to indicate that the device status of the second electronic device has been updated.

[0317] Since after the client module of the first application receives the seventh notification, that is, after the first media data center of the first electronic device has synchronized the multimedia resources of the second electronic device, the first application of the first electronic device can obtain the multimedia resources of the second electronic device through the first media data center. The following is a schematic illustration of the process by which the first application of the first electronic device can obtain the multimedia resources of the second electronic device through the first media data center.

[0318] Since the application of the first electronic device can obtain the multimedia resources of the second electronic device through the first media data platform of the first electronic device, the application of the first electronic device can directly access the first media data platform of the first electronic device, or can access the first media data platform of the first electronic device through the gallery application. In addition, the application of the first electronic device can obtain the multimedia resources (such as standard media data, classified media data) of the second electronic device through the provider interface of the first media data platform, or can obtain the multimedia resources (such as thumbnails) of the second electronic device through the SDK interface of the first media data platform.

[0319] Combine the following Fig.16 Taking the example that the application of the first electronic device directly accesses the first media data platform of the first electronic device, and the application of the first electronic device can obtain the multimedia resources of the second electronic device through the provider interface of the first media data platform, the display method of the multimedia resources provided by the embodiment of the present application is schematically described. Fig.16 As shown, the method for displaying multimedia resources may include S1601-S1611.

[0320] S1601: A user opens a first application on a first electronic device.

[0321] The user opens the first application in the first electronic device, such as the user clicks on the icon corresponding to the first application included in the first electronic device, so that the first electronic device can display the interface corresponding to the first application (which may also be referred to as the first interface in the embodiment of the present application).

[0322] The first application may be a system application of the first electronic device, such as a gallery application (also referred to as an album application), a communication application, or a clipping application included in the first electronic device. The first application may also be an application of a third party in the electronic device, such as a third-party clipping application, a third-party communication application, a third-party social application, etc. The specific type of the first application is not limited in the embodiments of the present application.

[0323] In some examples, the first application may integrate a media data platform toolkit of a first media data platform of a first electronic device. When the first application obtains multimedia resources of a second electronic device stored in the media data platform of the electronic device, the first application may obtain a remote device list through the media data platform toolkit of the first media data platform integrated therein, and select the second electronic device in the remote device list to obtain the multimedia resources of the second electronic device from the first media data platform of the first electronic device.

[0324] S1602: The first application sends a remote device list request to the SDK interface of the first media data center of the first electronic device.

[0325] After the first electronic device receives the operation of the user opening the first application in the first electronic device, in response, the first application sends a remote device list request to the SDK interface of the first media data middle station of the first electronic device. The remote device list request can be used to request to obtain a remote device list (i.e., an online device list). The remote device list may include other electronic devices that can be connected to the converged interconnection platform of the first electronic device.

[0326] S1603. The SDK interface of the first media data center receives a remote device list request and obtains the remote device list.

[0327] After the SDK interface of the first media data center receives the remote device list request, the remote device list can be obtained through the internal implementation layer of the first media data center.

[0328] Specifically, the SDK interface of the first media data middle station in the embodiment of the present application receives the remote device list request and obtains the specific implementation method of the remote device list. Please refer to the specific implementation methods in S1513-S1518 above, which will not be repeated in the embodiment of the present application.

[0329] S1604. The SDK interface of the first media data middle platform sends the remote device list to the first application.

[0330] After the SDK interface of the first media data platform obtains the remote device list through the internal implementation layer of the first media data platform, the remote device list can be sent to the first application so that the first application displays the remote device list.

[0331] S1605: The first application displays a first interface, the first interface includes a remote device list, the remote device list includes a viewing control, and the viewing control is used to request to view multimedia resources in the second electronic device.

[0332] After the first application receives the remote device list returned by the SDK interface of the first media data center, the first electronic device (i.e., the first application) can display the first interface, i.e., the interface corresponding to the first application. The first interface may include the remote device list. In this way, the user can select the device corresponding to the multimedia resource to be viewed in the remote list.

[0333] In some examples, the remote device list may include a viewing control that can be used to request viewing of multimedia resources in the second electronic device.

[0334] In some examples, multimedia resources may include resources such as pictures, videos, audio, documents, etc. The specific types of multimedia resources are not limited in the embodiments of the present application. In the embodiments of the present application, multimedia resources are pictures as an example for illustration.

[0335] For example, taking the first electronic device as mobile phone 01 and the first application as a file management application of mobile phone 01 as an example, Fig.14 As shown in (b), the file management application of mobile phone 01 can also call the SDK interface of the media data middle platform of mobile phone 01 through its integrated media data middle platform toolkit to obtain and display the remote device list, that is, display the viewing control 1402 for requesting multimedia resources of the tablet computer (that is, the remote device list includes the tablet computer). Viewing control 1402 can be a "my tablet computer" logo.

[0336] S1606: The first application receives a trigger operation of the user on the viewing control.

[0337] After the first electronic device displays the first interface, when the user needs to view multimedia resources on the second electronic device through the first electronic device, the user can trigger the viewing control included in the first interface. That is, the first application of the first electronic device can receive the user's triggering operation on the viewing control.

[0338] S1607. In response to the user triggering operation on the viewing control, the first application sends a query request for multimedia resources of the second electronic device to the provider interface of the first media data center of the first electronic device, where the query request includes the first field information.

[0339] After the first application receives a trigger operation of the user on the viewing control, such as a click operation, in response, the first application may send a query request for the multimedia resources of the second electronic device to the first media data center of the first electronic device. That is, the query request may be used to request the multimedia resources (such as standard media data, classified media data, or thumbnails corresponding to multimedia resources) included in the second electronic device.

[0340] The standard media data of the second electronic device, i.e., the metadata corresponding to the multimedia resources stored in the MediaProvider database of the second electronic device. The classified media data of the second electronic device, i.e., the metadata corresponding to the multimedia resources generated by the processing logic of the gallery of the second electronic device. For example, classified albums ("portraits" album, "places" album, "time" album), multimedia data collected by users, etc.

[0341] It should be noted that after the user opens the first application in the first electronic device, the first application can directly send a query request for the multimedia resources of the second electronic device to the first media data center of the first electronic device. The first application can also send a query request for the multimedia resources of the second electronic device to the first media data center of the first electronic device after receiving the user's trigger operation on the viewing control in the interface corresponding to the first application. In the embodiment of the present application, the triggering condition for the first application to send a query request for the multimedia resources of the second electronic device to the first media data center of the first electronic device is not limited. In the embodiment of the present application, the first application sends a query request for the multimedia resources of the second electronic device to the first media data center of the first electronic device after receiving the user's trigger operation on the viewing control in the interface corresponding to the first application. It should be noted that after the user opens the first application in the first electronic device, in response to the user's trigger operation on the viewing control, the first application can send a query request for the standard media data and classified media data of the second electronic device to the first media data center of the first electronic device. In response to the user's trigger operation on the viewing control, the first application can also send a query request for the thumbnail corresponding to the multimedia resources of the second electronic device to the first media data center of the first electronic device. In the embodiment of the present application, an example is used to illustrate that in response to a user triggering an operation on a viewing control, a first application can send a query request for standard media data and classified media data of a second electronic device to a first media data middle station of a first electronic device.

[0342] S1608. The provider interface of the first media data center receives the query request.

[0343] S1609: The provider interface of the first media data center obtains multimedia resources of the second electronic device according to the query request.

[0344] After the first media data middle station of the first electronic device receives the query request, the first media data middle station may obtain the multimedia resources of the second electronic device from a database corresponding to the second electronic device.

[0345] In some examples, the query request includes first field information. The first field information may be used to indicate the type of multimedia resource that the first application requests to access. For example, the first field information may be a standard media type such as Image, Video, Audio, etc. of the Android standard. The first field information may also be system classification information, such as Favorite, Portrait, Geo, etc.

[0346] Exemplarily, the query request may be a URI of the first application. The first field information may be <category>Field information of the field segment.

[0347] In some examples, the first media data center obtains multimedia resources of the second electronic device based on a query request, which may include: the first media data center determines the type of multimedia resources requested to be accessed by the first application based on the first field information, and calls a corresponding interface based on the type of multimedia resources requested to be accessed by the first application to obtain the multimedia resources of the second electronic device.

[0348] For example, the URI of the first application is:

[0349] Content: / / com.xxx.mediadatacenter / device-2 / Video / <id>

[0350] That is, the provider interface of the first media data center can determine that the first application requests to access the video file of the second electronic device according to the URI of the first application. At this time, the provider interface of the first media data center calls the cross-device standard media data interface to <id>field, obtain the video file of the second electronic device from the database of the media data center.

[0351] For example, the URI of the first application is:

[0352] Content: / / com.xxx.mediadatacenter / device-2 / Portrait / <id>

[0353] That is, the provider interface of the first media data center can determine that the first application requests to access the portrait album of the second electronic device according to the URI of the first application. At this time, the provider interface of the first media data center calls the cross-device classification data interface to <id>field, obtaining the portrait picture in the portrait album of the second electronic device from the database of the media data center.

[0354] S1610. The first media data middle platform sends multimedia resources of the second electronic device to the first application.

[0355] After the first media data center obtains the multimedia resources of the second electronic device, the first media data center may send the multimedia resources of the second electronic device to the first application.

[0356] S1611. The first application receives multimedia resources of the second electronic device and displays the multimedia resources of the second electronic device.

[0357] After the first application receives the multimedia resource of the second electronic device, the first application may display the multimedia resource of the second electronic device so that the user may select the corresponding multimedia resource.

[0358] For example, continue to combine Fig.14 As shown in (c), after the file management application of mobile phone 01 receives the user's trigger operation on the viewing control 1402, the file management application of mobile phone 01 can call the provider interface of the media data middle platform of mobile phone 01 to obtain the multimedia resources stored in the media data middle platform of mobile phone 01, that is, the interface corresponding to the file management application 1401 can include the "All Photos" album, "Video" folder, and "Document" folder included in the tablet computer, so that the user can select photos, videos, or documents included in the tablet computer.

[0359] In this way, the application of the electronic device can directly call the media data middle platform of the electronic device to obtain the multimedia resources stored in the media data middle platform of the electronic device, which can simplify the operation process and thus improve the user experience. Furthermore, the application of the electronic device can be adapted according to its display interface, which can meet the personalized needs of different applications and provide a better user experience.

[0360] Combine the following Fig.17 Taking the example that the clipping application of the first electronic device accesses the first media data platform of the first electronic device through the gallery application, and the application of the first electronic device can obtain the multimedia resources of the second electronic device through the provider interface of the first media data platform, the display method of the multimedia resources provided by the embodiment of the present application is schematically described. Fig.17 As shown, the method for displaying multimedia resources may include S1701-S1713.

[0361] S1701, a user opens a clipping application of a first electronic device.

[0362] S1702: The clipping application of the first electronic device calls a gallery selection page of the gallery application of the first electronic device.

[0363] After the first electronic device receives the gallery selection page that calls the gallery application of the first electronic device, in response, the gallery application of the first electronic device sends a remote device list request to the SDK interface of the first media data center of the first electronic device.

[0364] S1703: The gallery application sends a remote device list request to the SDK interface of the first media data center of the first electronic device.

[0365] The gallery application sends a remote device list request to the SDK interface of the first media data middle platform of the first electronic device. The remote device list request can be used to request to obtain a remote device list (i.e., an online device list). The remote device list may include other electronic devices that can be connected to the converged interconnection platform of the first electronic device.

[0366] S1704. The SDK interface of the first media data middle station receives the remote device list request and obtains the remote device list.

[0367] After the SDK interface of the first media data center receives the remote device list request, the remote device list can be obtained through the internal implementation layer of the first media data center.

[0368] Specifically, the SDK interface of the first media data middle station in the embodiment of the present application receives the remote device list request and obtains the specific implementation method of the remote device list. Please refer to the specific implementation methods in S1513-S1518 above, which will not be repeated in the embodiment of the present application.

[0369] S1705. The SDK interface of the first media data middle platform sends the remote device list to the gallery application.

[0370] After the SDK interface of the first media data middle platform obtains the remote device list through the internal implementation layer of the first media data middle platform, the remote device list can be sent to the gallery application.

[0371] S1706: The gallery application receives the remote device list, and sends the remote device list to the clip application.

[0372] After the gallery application receives the remote device list, it may send the remote device list to the editing application, so that the editing application displays the remote device list.

[0373] S1707: The editing application displays an interface of the editing application, where the interface of the editing application includes a remote device list, where the remote device list includes a viewing control, and the viewing control is used to request viewing of multimedia resources in the second electronic device.

[0374] After the editing application receives the remote device list returned by the gallery application, the first electronic device (i.e., the editing application) can display the editing application interface, i.e., the interface corresponding to the editing application. The editing application interface may include the remote device list. In this way, the user can select the device corresponding to the multimedia resource to be viewed in the remote list.

[0375] In some examples, the remote device list may include a viewing control that can be used to request viewing of multimedia resources in the second electronic device.

[0376] In some examples, multimedia resources may include resources such as pictures, videos, audio, documents, etc. The specific types of multimedia resources are not limited in the embodiments of the present application. In the embodiments of the present application, multimedia resources are pictures as an example for illustration.

[0377] For example, taking the first electronic device as a mobile phone as an example, Fig.12 As shown in (a) of FIG. 1 , the user opens the clipping application 1201 of the mobile phone 01, and the mobile phone 01 displays the interface corresponding to the clipping application 1201. Fig.12 As shown in (b) of FIG. 1 , the interface corresponding to the clipping application 1201 may include a picture selection control 1202, and the picture selection control 1202 may be used to call the picture gallery selection page of the picture gallery application of the mobile phone 01. After the clipping application 1201 of the mobile phone 01 receives the user's triggering operation on the picture selection control 1202, combined with Fig.12 As shown in (c), the editing application of mobile phone 01 can call the gallery selection page of the gallery application, and then call the media data middle platform toolkit of the gallery application through the gallery selection page of the gallery application, and then the editing application of mobile phone 01 can call the SDK interface of the media data middle platform of mobile phone 01 through the media data middle platform toolkit of the gallery application to obtain and display the remote device list, that is, display the viewing control 1203 for requesting to view the multimedia resources of mobile phone 02 (that is, the remote device list includes mobile phone 02). Viewing control 1203 can be the identification of mobile phone 02.

[0378] S1708. The clipping application receives a trigger operation on a viewing control from the user.

[0379] After the first electronic device displays the editing application interface, when the user needs to view the multimedia resources on the second electronic device through the first electronic device, the user can trigger the viewing control included in the editing application interface. That is, the editing application of the first electronic device can receive the user's triggering operation on the viewing control.

[0380] S1709. In response to the user triggering operation on the viewing control, the editing application sends a query request for the multimedia resources of the second electronic device to the provider interface of the first media data center of the first electronic device, where the query request includes the first field information.

[0381] After the editing application receives a trigger operation of the user on the viewing control, such as a click operation, in response, the editing application may send a query request for the multimedia resources of the second electronic device to the first media data center of the first electronic device. That is, the query request may be used to request the multimedia resources (such as standard media data, classified media data, or thumbnails corresponding to the multimedia resources) included in the second electronic device.

[0382] The standard media data of the second electronic device, i.e., the metadata corresponding to the multimedia resources stored in the MediaProvider database of the second electronic device. The classified media data of the second electronic device, i.e., the metadata corresponding to the multimedia resources generated by the processing logic of the gallery of the second electronic device. For example, classified albums ("portraits" album, "places" album, "time" album), multimedia data collected by users, etc.

[0383] S1710. The provider interface of the first media data center receives a query request.

[0384] S1711. The provider interface of the first media data center obtains multimedia resources of the second electronic device according to the query request.

[0385] After the first media data middle station of the first electronic device receives the query request, the first media data middle station may obtain the multimedia resources of the second electronic device from a database corresponding to the second electronic device.

[0386] In some examples, the query request includes first field information. The first field information may be used to indicate the type of multimedia resource that the clipping application requests to access. For example, the first field information may be an Android standard media type such as Image, Video, Audio, etc. The first field information may also be system classification information, such as Favorite, Portrait, Geo, etc.

[0387] Exemplarily, the query request may be a URI of a clipping application. The first field information may be <category>Field information of the field segment.

[0388] In some examples, the first media data center obtains multimedia resources of the second electronic device based on a query request, which may include: the first media data center determines the type of multimedia resources that the clipping application requests to access based on the first field information, and calls a corresponding interface based on the type of multimedia resources that the clipping application requests to access to obtain the multimedia resources of the second electronic device.

[0389] For example, the URI for the Clip application is:

[0390] Content: / / com.xxx.mediadatacenter / device-2 / Video / <id>

[0391] That is, the provider interface of the first media data center can determine that the editing application requests to access the video file of the second electronic device according to the URI of the editing application. At this time, the provider interface of the first media data center calls the cross-device standard media data interface to <id>field, obtain the video file of the second electronic device from the database of the media data center.

[0392] For example, the URI for the Clip application is:

[0393] Content: / / com.xxx.mediadatacenter / device-2 / Portrait / <id>

[0394] That is, the provider interface of the first media data center can determine that the editing application requests to access the portrait album of the second electronic device according to the URI of the editing application. At this time, the provider interface of the first media data center calls the cross-device classification data interface to <id>field, obtaining the portrait picture in the portrait album of the second electronic device from the database of the media data center.

[0395] S1712: The first media data center sends the multimedia resources of the second electronic device to the editing application.

[0396] After the first media data center obtains the multimedia resources of the second electronic device, the first media data center may send the multimedia resources of the second electronic device to the clipping application.

[0397] S1713: The clipping application receives multimedia resources of the second electronic device and displays the multimedia resources of the second electronic device.

[0398] After the clipping application receives the multimedia resource of the second electronic device, the clipping application may display the multimedia resource of the second electronic device so that the user may select the corresponding multimedia resource.

[0399] For example, taking the first electronic device as a mobile phone as an example, continue to combine Fig.12 As shown in (c), after the editing application of mobile phone 01 receives the user's trigger operation on the viewing control 1203, the editing application of mobile phone 01 can call the provider interface of the media data middle platform of mobile phone 01 through the gallery selection page of the gallery application to obtain the multimedia resources stored in the media data middle platform of mobile phone 02 (such as the metadata corresponding to the multimedia resources of mobile phone 02), and display the multimedia resources included in mobile phone 02, such as the "Camera" album, "All Photos" album, "Video" album, "Screenshot" album, "My Favorites" album, "Portrait" album, and "Place" album included in mobile phone 02.

[0400] In this way, other applications of the electronic device except the gallery application can obtain the multimedia resources stored in the media data middle platform of the electronic device through the gallery application. There is no need to integrate the media data middle platform toolkit in other applications of the electronic device, nor is there any need to modify other applications of the electronic device, which can reduce the access cost of other applications of the electronic device.

[0401] For ease of understanding, the following Fig.18 The method for displaying multimedia resources provided in the embodiment of the present application is described. Fig.18 As shown, the method for displaying multimedia resources may include the following S1801-S1804.

[0402] S1801. A first electronic device receives an opening operation of a first application by a user.

[0403] The first electronic device may include a first application and a second application. The second application may be a gallery application (ie, a photo album application).

[0404] The first application may be an application other than the second application in the first electronic device, that is, the first application may be an application other than the gallery application in the first electronic device. The first application may be a clipping application, a communication application, a communication application, a social application, etc. included in the first electronic device. The specific type of the first application is not limited in the embodiments of the present application. It is understandable that the first application may be a system application of the first electronic device or a third-party application.

[0405] When the user needs to use the first application, the user can open the first application on the first electronic device, that is, the first electronic device can receive the user's opening operation on the first application.

[0406] Specifically, the specific implementation of the first electronic device receiving the user's opening operation of the first application in the embodiment of the present application can refer to the above S1601, or the specific implementation in the above S1701, which will not be repeated in the embodiment of the present application.

[0407] S1802: In response to the opening operation, the first electronic device displays a first interface, where the first interface is an interface corresponding to the first application.

[0408] When the first electronic device receives an opening operation of the first application by the user, the electronic device may display a first interface in response, where the first interface is an interface corresponding to the first application.

[0409] In some examples, when the first electronic device displays the first interface, the remote device list includes a viewing control, and the viewing control is used to request to view the multimedia resources in the second electronic device.

[0410] Specifically, the specific implementation of the first electronic device receiving the user's opening operation of the first application in the embodiment of the present application can refer to the above S1605, or the specific implementation in the above S1707, which will not be repeated in the embodiment of the present application.

[0411] S1803. The first electronic device obtains multimedia resources corresponding to the second application, wherein the multimedia resources corresponding to the second application include first multimedia resources and second multimedia resources, and the second multimedia resources are multimedia resources obtained after the second application processes the first multimedia resources.

[0412] The multimedia resources of the second application may be multimedia resources stored in the database corresponding to the second application (the gallery database of the first electronic device). The first multimedia resources may be multimedia resources obtained by the gallery database from the media database of the first electronic device. That is, the first multimedia resources may be Android native pictures and videos. For example, the metadata corresponding to the first multimedia resource is the identification of the picture, the storage path of the picture, the size of the picture, the timestamp corresponding to the picture, the name of the picture, and the rotation angle of the picture.

[0413] The second multimedia resource is a multimedia resource obtained after the second application processes the first multimedia resource. In some examples, the second multimedia resource is a multimedia resource obtained after the second application classifies, identifies or marks the first multimedia resource. That is, metadata corresponding to the multimedia resource generated by the processing logic of the second application (i.e., the gallery application). For example, metadata corresponding to a classified album (such as a portrait album, a location album, or a food album, etc.).

[0414] The first electronic device obtains the multimedia resources corresponding to the second application, that is, after the user opens the first application, the first application obtains the multimedia resources corresponding to the second application, so that the user can view the multimedia resources corresponding to the second application through the first application.

[0415] In some examples, the multimedia resources corresponding to the second application further include a third multimedia resource and a fourth multimedia resource. The third multimedia resource is different from the fourth multimedia resource. The fourth multimedia resource may be a thumbnail.

[0416] In some examples, the first media data middleware of the first electronic device may include a first interface and a second interface. Exemplarily, the first interface may be a provider (i.e., provider) interface. Exemplarily, the second interface may be a software development kit (SDK) interface.

[0417] In some examples, when the first electronic device obtains the multimedia resource corresponding to the second application, the first electronic device can obtain the third multimedia resource corresponding to the second application through the first interface of the first media data center of the first electronic device. The interface of the standard content provider, therefore, when the application of the electronic device uses the provider interface to obtain the multimedia resources included in the media data center, the developer does not need to adapt the application, that is, the application can be used to access the first interface, which is more convenient to use.

[0418] In some examples, when the first electronic device obtains the multimedia resource corresponding to the second application, the first electronic device can obtain the fourth multimedia resource corresponding to the second application through the second interface of the first media data platform of the first electronic device. In this way, since the second interface can provide cross-device data transmission related capabilities in addition to Android native capabilities, the application of the electronic device can achieve cross-device management and connection through the second interface.

[0419] S1804: The first electronic device displays a second interface, where the second interface includes multimedia resources of a second application.

[0420] After the first electronic device acquires the multimedia resources corresponding to the second application, the first electronic device displays the second interface, which includes the multimedia resources of the second application. That is, after the first application interface of the first electronic device displays the multimedia resources corresponding to the second application.

[0421] In this way, the multimedia resources of the second application of the first electronic device include the first multimedia resources and the second multimedia resources obtained after processing the first multimedia resources. When the user uses the first application of the first electronic device to view the multimedia resources corresponding to the second application, not only can the first multimedia resources corresponding to the second application be viewed, but also the second multimedia resources corresponding to the second application, and then the user selects the multimedia resources to be shared from the second multimedia resources corresponding to the second application through the first application. Furthermore, when the user uses the first application to view the multimedia resources corresponding to the second application, the first application can classify and display the multimedia resources corresponding to the second application according to the classification method of the second application. This classification display method conforms to the user's usage habits, so that the user can quickly find the required multimedia resources, thereby improving the user's usage habits.

[0422] Since the user can also view the multimedia resources of the second electronic device through the first application of the first electronic device. In some examples, after the first electronic device receives the user's opening operation on the first application, the method for displaying the multimedia resources may also include: the first electronic device obtains a remote device list; the first electronic device displays a third interface, the third interface includes a remote device list, and the remote device list includes device information of the second electronic device; the first electronic device receives the user's selection operation on the device information of the second electronic device; in response to the selection operation, the first electronic device obtains the multimedia resources of the second electronic device; the first electronic device displays a fourth interface, and the fourth interface includes the multimedia resources of the second electronic device.

[0423] The remote device list may include other electronic devices to which the converged interconnection platform of the first electronic device can be connected.

[0424] The device information of the second electronic device may be a device name of the second electronic device.

[0425] After the user opens the first application of the first electronic device, the first electronic device can obtain a list of remote devices and display a third interface including the list of remote devices, so that the user can select a second electronic device in the list of remote devices, and then the user can view the multimedia resources of the second electronic device using the first application of the first electronic device. In this way, the first application of the electronic device can directly obtain and view the multimedia resources of the second electronic device from the database of the first electronic device, which can simplify the operation process and thus improve the user experience. Furthermore, the first application of the electronic device can be adapted according to its display interface, which can meet the personalized needs of different applications and provide a better user experience.

[0426] In some examples, the first application may integrate a media data platform toolkit of a first media data platform of a first electronic device. When the first application obtains multimedia resources of a second electronic device stored in the media data platform of the electronic device, the first application may obtain a remote device list through the media data platform toolkit of the first media data platform integrated therein, and select the second electronic device in the remote device list to obtain the multimedia resources of the second electronic device from the first media data platform of the first electronic device.

[0427] Specifically, in the embodiment of the present application, the first electronic device obtains a remote device list; the first electronic device displays a third interface, the third interface includes a remote device list, and the remote device list includes device information of the second electronic device; the first electronic device receives a user's selection operation on the device information of the second electronic device; in response to the selection operation, the first electronic device obtains multimedia resources of the second electronic device; the first electronic device displays a fourth interface, and the fourth interface includes the multimedia resources of the second electronic device. For the specific implementation method, please refer to S1602-S1605 above, which will not be repeated in the embodiment of the present application.

[0428] In some examples, the first electronic device obtains a list of remote devices, which may include: the first application sends a first request to the second application, the first request is used to request to call the second application; when the second application receives the first request, the second application obtains the list of remote devices; the second application sends the list of remote devices to the first application.

[0429] That is to say, when a user needs to use the first application of the first electronic device to view multimedia resources of other electronic devices, the user can obtain the remote device list through the second application to select the device for which the multimedia resources are to be viewed in the remote device list. In this way, the first application of the electronic device can obtain the multimedia resources included in the media data center of other electronic devices through the second application, without modifying other applications of the electronic device, which can reduce the access cost of the first application of the electronic device.

[0430] Specifically, in the embodiment of the present application, the first application sends a first request to the second application, and the first request is used to request to call the second application; when the second application receives the first request, the second application obtains a list of remote devices; the specific implementation method of the second application sending the list of remote devices to the first application can refer to the above S1703-S1707, which will not be repeated in the embodiment of the present application.

[0431] Before the first electronic device acquires the multimedia resources of the second electronic device, the method for displaying the multimedia resources may further include: in response to a selection operation, the first electronic device acquires the first device identification of the second electronic device; the first electronic device establishes a communication connection between the first electronic device and the second electronic device based on the first device identification; based on the communication connection between the first electronic device and the second electronic device, the first electronic device acquires and stores the multimedia resources of the second electronic device.

[0432] In some examples, the first electronic device also includes a first media data middle station. Before establishing a communication connection between the first electronic device and the second electronic device based on the first device identifier, the method for displaying the multimedia resources may also include: the first application sends the first device identifier to the second application; the second application receives the first device identifier and sends the first device identifier to the first media data middle station; wherein, the first electronic device establishes a communication connection between the first electronic device and the second electronic device based on the first device identifier, which may include: the first media data middle station establishes a communication connection between the first electronic device and the second electronic device based on the first device identifier; wherein, based on the communication connection between the first electronic device and the second electronic device, the first electronic device obtains and stores the multimedia resources of the second electronic device, which may include: based on the communication connection between the first electronic device and the second electronic device, the first media data middle station obtains and stores the multimedia resources of the second electronic device.

[0433] Specifically, in the embodiment of the present application, in response to a selection operation, the first electronic device obtains the first device identification of the second electronic device; the first electronic device establishes a communication connection between the first electronic device and the second electronic device based on the first device identification; based on the communication connection between the first electronic device and the second electronic device, the first electronic device obtains and stores the multimedia resources of the second electronic device. For the specific implementation method, please refer to S1519-S1539 above, which will not be repeated in the embodiment of the present application.

[0434] According to the solution of the present application, when a user uses an application other than the album application of an electronic device to view multimedia resources of the electronic device, the user can not only view pictures and videos taken by the electronic device and stored in the album application, but also view multimedia resources generated by the processing logic of the album application. Furthermore, the user can use other applications to share the multimedia resources generated by the processing logic of the album application.

[0435] Furthermore, when the user uses other applications of the electronic device to view the multimedia resources of the album application, the other applications of the electronic device can classify and display the multimedia resources of the album application according to the classification method of the album application. This classification display method is in line with the user's habit of viewing albums, allowing the user to quickly find the required multimedia resources, thereby improving the user's usage habits.

[0436] Furthermore, when a user views pictures and videos taken by the electronic device and stored in the photo album application through other applications of the electronic device, the user can search for corresponding pictures and videos as needed, which is more convenient to use.

[0437] In addition, in the scenario where a user has multiple electronic devices, the user does not need to send the multimedia resources of the electronic device to other electronic devices through the sharing function of the electronic device. In this way, the user can directly view the multimedia resources of other electronic devices through one electronic device, which is convenient to operate and can improve the user's experience. Moreover, when a user views the multimedia resources of other electronic devices through one electronic device, he can not only view the pictures and videos taken by other electronic devices, but also view the multimedia resources generated by the processing logic of the album application of other electronic devices, which can meet the different needs of users.

[0438] Corresponding to the method in the above-mentioned embodiment, the embodiment of the present application further provides a display device for multimedia resources. The display device for multimedia resources can be applied to a first electronic device to implement the method in the above-mentioned embodiment. The function of the display device for multimedia resources can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-mentioned functions.

[0439] For example, Fig.19 A schematic diagram of the structure of a multimedia resource display device 1900 is shown. Fig.19 As shown, the multimedia resource display device 1900 may include: a receiving module 1901 , a display module 1902 and an acquisition module 1903 .

[0440] The receiving module 1901 may be used to receive a user's opening operation on the first application.

[0441] The display module 1902 may be configured to display a first interface in response to an opening operation, where the first interface is an interface corresponding to the first application.

[0442] The acquisition module 1903 can be used to acquire multimedia resources corresponding to the second application, wherein the multimedia resources corresponding to the second application include first multimedia resources and second multimedia resources, and the second multimedia resources are multimedia resources obtained after the second application processes the first multimedia resources.

[0443] The display module 1902 may also be used to display a second interface, where the second interface includes multimedia resources corresponding to the second application.

[0444] In another possible implementation, the second multimedia resource is a multimedia resource obtained after the second application classifies, identifies or marks the first multimedia resource.

[0445] In another possible implementation, the acquisition module 1903 may also be used to acquire a remote device list.

[0446] The display module 1902 may also be used to display a third interface, where the third interface includes a remote device list, and the remote device list includes device information of the second electronic device.

[0447] The receiving module 1901 may also be used to receive a user's selection operation on device information of a second electronic device.

[0448] The acquisition module 1903 may also be configured to acquire multimedia resources of the second electronic device in response to a selection operation.

[0449] The display module 1902 may also be used to display a fourth interface, where the fourth interface includes multimedia resources of the second electronic device.

[0450] In another possible implementation, the above-mentioned media resource display device 1900 may further include: a sending module 1904.

[0451] The sending module 1904 may be configured to send a first request to the second application, where the first request is used to request to call the second application.

[0452] The acquisition module 1903 may be specifically configured to acquire a remote device list when the second application receives the first request.

[0453] The sending module 1904 may also be configured to send the remote device list to the first application.

[0454] In another possible implementation, the above-mentioned media resource display device 1900 may further include: an establishment module 1905 and a storage module 1906 .

[0455] The acquisition module 1903 may also be configured to acquire the first device identification of the second electronic device in response to a selection operation.

[0456] The establishing module 1905 may be configured to establish a communication connection between the first electronic device and the second electronic device according to the first device identifier.

[0457] The acquisition module 1903 may also be configured to acquire multimedia resources of the second electronic device based on the communication connection between the first electronic device and the second electronic device.

[0458] The storage module 1906 may be configured to store multimedia resources of the second electronic device.

[0459] In another possible implementation, the first electronic device further includes a first media data middle station.

[0460] The sending module 1904 may also be configured to send the first device identifier to the second application.

[0461] The receiving module 1901 may also be configured to receive a first device identifier.

[0462] The sending module 1904 may also be configured to send the first device identifier to the first media data middle station.

[0463] In another possible implementation, the first electronic device further includes a first media data middle station, and the multimedia resources corresponding to the second application include a third multimedia resource and a fourth multimedia resource. The acquisition module 1903 may be specifically configured to acquire the third multimedia resource by calling the first interface of the first media data middle station.

[0464] The acquisition module 1903 may be specifically configured to acquire the fourth multimedia resource by calling the second interface of the first media data center.

[0465] In another possible implementation, the fourth multimedia resource is a thumbnail corresponding to the multimedia resource.

[0466] In another possible implementation, the second application is a gallery application, and the first application is an application other than the gallery application in the first electronic device.

[0467] In another possible implementation, the second application includes at least one of a clipping application, a communication application, a social application, and a file management application.

[0468] It should be understood that the division of units or modules (hereinafter referred to as units) in the above device is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or physically separated. And the units in the device can all be implemented in the form of software calling through processing elements; or all in the form of hardware; or some units can be implemented in the form of software calling through processing elements, and some units can be implemented in the form of hardware.

[0469] For example, each unit can be a separately established processing element, or it can be integrated in a certain chip of the device. In addition, it can also be stored in a memory in the form of a program, and called and executed by a certain processing element of the device. In addition, all or part of these units can be integrated together, or they can be implemented independently. The processing element described here can also be called a processor, which can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each unit above can be implemented by an integrated logic circuit of hardware in the processor element or in the form of software called by a processing element.

[0470] In one example, the unit in the above apparatus may be one or more integrated circuits configured to implement the above method, such as one or more ASICs, or one or more DSPs, or one or more FPGAs, or a combination of at least two of these integrated circuit forms.

[0471] For another example, when the units in the device can be implemented in the form of a processing element scheduling program, the processing element can be a general-purpose processor, such as a CPU or other processor that can call a program. For another example, these units can be integrated together and implemented in the form of a system on a chip SOC.

[0472] In one implementation, the units of the above apparatus implementing the corresponding steps in the above method can be implemented in the form of a processing element scheduling program. For example, the apparatus may include a processing element and a storage element, and the processing element calls the program stored in the storage element to execute the method described in the above method embodiment. The storage element may be a storage element on the same chip as the processing element, that is, an on-chip storage element.

[0473] In another implementation, the program for executing the above method may be in a storage element on a different chip from the processing element, i.e., an off-chip storage element. In this case, the processing element calls or loads the program from the off-chip storage element to the on-chip storage element to call and execute the method described in the above method embodiment.

[0474] For example, an embodiment of the present application may also provide a device, such as an electronic device, which may include a processor and a memory for storing instructions executable by the processor. When the processor is configured to execute the above instructions, the electronic device implements the shortcut input method described in the above embodiment. The memory may be located inside the electronic device or outside the electronic device. And the processor includes one or more.

[0475] In another implementation, the unit of the device implementing each step in the above method may be configured as one or more processing elements, which may be arranged on the corresponding electronic device, and the processing element here may be an integrated circuit, for example: one or more ASICs, or one or more DSPs, or one or more FPGAs, or a combination of these integrated circuits. These integrated circuits may be integrated together to form a chip.

[0476] For example, the present application also provides a chip, which can be applied to the above electronic device. The chip includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through a line; the processor receives and executes computer instructions from the memory of the electronic device through the interface circuit to implement the method described in the above method embodiment.

[0477] An embodiment of the present application also provides a computer program product, including computer instructions executed by the above-mentioned electronic device.

[0478] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0479] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0480] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0481] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0482] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, such as a program. The software product is stored in a program product, such as a computer-readable storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard drives, ROM, RAM, magnetic disks, or optical disks.

[0483] For example, the present application embodiment may also provide a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by an electronic device, the electronic device implements the shortcut input method described in the above method embodiment.

[0484] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.< / id> < / id> < / id> < / id> < / category> < / id> < / id> < / id> < / id> < / category> < / id> < / id> < / id> < / id> < / id> < / id> < / id> < / id> < / category> < / device> < / category> < / category> < / category> < / category> < / device> < / device> < / device> < / device> < / id> < / category> < / device> < / category> < / device>

Claims

1. A method for displaying multimedia resources, characterized in that: Applied to a first electronic device, the first electronic device includes a first application and a second application, and the method includes: The first electronic device receives a user's opening operation on the first application; In response to the opening operation, the first electronic device displays a first interface, where the first interface is an interface corresponding to the first application; The first electronic device acquires a multimedia resource corresponding to the second application, wherein the multimedia resource corresponding to the second application includes a first multimedia resource and a second multimedia resource, and the second multimedia resource is a multimedia resource obtained after the second application processes the first multimedia resource; The first electronic device displays a second interface, and the second interface includes multimedia resources corresponding to the second application.

2. The method according to claim 1, characterized in that The second multimedia resource is a multimedia resource obtained after the second application classifies, identifies or marks the first multimedia resource.

3. The method according to claim 1, characterized in that After the first electronic device receives an opening operation of the first application from the user, the method further includes: The first electronic device obtains a remote device list; The first electronic device displays a third interface, the third interface includes a remote device list, and the remote device list includes device information of the second electronic device; The first electronic device receives a user's selection operation on device information of the second electronic device; In response to the selection operation, the first electronic device acquires multimedia resources of the second electronic device; The first electronic device displays a fourth interface, and the fourth interface includes multimedia resources of the second electronic device.

4. The method according to claim 3, characterized in that The first electronic device obtains a remote device list, including: The first application sends a first request to the second application, where the first request is used to request to call the second application; When the second application receives the first request, the second application obtains the remote device list; The second application sends the remote device list to the first application.

5. The method according to claim 3, characterized in that: Before the first electronic device acquires the multimedia resource of the second electronic device, the method further includes: In response to the selection operation, the first electronic device obtains a first device identification of the second electronic device; The first electronic device establishes a communication connection between the first electronic device and the second electronic device according to the first device identifier; Based on the communication connection between the first electronic device and the second electronic device, the first electronic device acquires and stores the multimedia resources of the second electronic device.

6. The method according to claim 5, characterized in that The first electronic device further includes a first media data middle station. Before establishing a communication connection between the first electronic device and the second electronic device according to the first device identifier, the method further includes: The first device identifier sent by the first application to the second application; The second application receives the first device identifier and sends the first device identifier to the first media data middle station; The first electronic device establishing a communication connection between the first electronic device and the second electronic device according to the first device identifier includes: the first media data middle station establishing a communication connection between the first electronic device and the second electronic device according to the first device identifier; Among them, based on the communication connection between the first electronic device and the second electronic device, the first electronic device obtains and stores the multimedia resources of the second electronic device, including: based on the communication connection between the first electronic device and the second electronic device, the first media data center obtains and stores the multimedia resources of the second electronic device.

7. The method according to claim 1, characterized in that The first electronic device further includes a first media data middle platform, and the multimedia resources corresponding to the second application include a third multimedia resource and a fourth multimedia resource; and the first electronic device obtains the multimedia resources corresponding to the second application, including: The first electronic device obtains the third multimedia resource by calling the first interface of the first media data middle station; The first electronic device obtains the fourth multimedia resource by calling the second interface of the first media data center.

8. The method according to claim 7, characterized in that The fourth multimedia resource is a thumbnail corresponding to the multimedia resource.

9. The method according to any one of claims 1 to 8, characterized in that The second application is a gallery application, and the first application is an application other than the gallery application in the first electronic device.

10. The method according to any one of claims 1 to 8, characterized in that The second application includes at least one of a clipping application, a communication application, a social application, and a file management application.

11. An electronic device, characterized in that: The electronic device comprises a processor and a memory for storing instructions executable by the processor; when the processor is configured to execute the instructions, the electronic device implements the method according to any one of claims 1 to 10.

12. A computer-readable storage medium having computer program instructions stored thereon; characterized in that: When the computer program instructions are executed by an electronic device, the electronic device implements the method according to any one of claims 1 to 10.

Images