A method of playing multimedia data and an electronic device

Abstract

This application provides a method and electronic device for playing multimedia data, relating to the field of terminals, which can conveniently and quickly switch multimedia data in a first electronic device to a second electronic device for playback. The method includes: displaying a first display interface; displaying a first prompt interface, the first prompt interface including N candidate devices; receiving a first selection operation from the N candidate devices to select another electronic device; switching only the multimedia data associated with the first display interface to the other electronic device for playback; the first display interface is the interface of a first application, and the multimedia data associated with the first display interface includes: data from the display interface of the first application; data from video or audio tasks in the first display interface; other information displayed simultaneously with the first display interface; multimedia data from video applications; multimedia data from audio applications; display data from the main screen; and multimedia data from applications currently running when the first display interface is displayed.

Description

TECHNICAL FIELD

[0001] The present application relates to the terminal field, and in particular to a method for playing multimedia data and an electronic device. BACKGROUND

[0002] With the development of smart home technology, a user or a family often has multiple electronic devices capable of communicating with each other. Various electronic devices generally have their own device characteristics, for example, a mobile phone is better in portability, a television screen is better in display effect, and a sound box is better in sound quality effect. In order to fully exert the device characteristics of different electronic devices, the electronic devices can realize the interaction of multimedia data among multiple devices through functions such as screen projection, airplay (wireless play), or Bluetooth.

[0003] Taking the screen projection function as an example, a user can install a screen projection software in a mobile phone to send multimedia data such as photos and videos in the mobile phone to other controlled devices (for example, a smart television) supporting the screen projection function for display. In one implementation manner, after the user selects the smart television as a controlled device, the mobile phone sends the display data in the mobile phone screen to the smart television in real time for display, that is, the display contents in the mobile phone and the smart television are completely the same, which easily leads to the leakage of private information in the mobile phone. In another implementation manner, after the user selects the smart television as a controlled device, the mobile phone can first prompt the user to select an application to be projected through a list or the like, and after the user selects a specific application, the mobile phone can project the application selected by the user on the smart television for display, which requires the user to manually set the specific projection content before projection each time, leading to a relatively cumbersome operation in the projection process. SUMMARY

[0004] The present application provides a method for playing multimedia data and an electronic device, which can conveniently and quickly switch multimedia data in a first electronic device to a second electronic device for playing, reduces the operation in the projection process, improves the efficiency of human-computer interaction, and enhances the intelligence of the electronic device and the friendliness in human interaction.

[0005] To achieve the above object, the present application adopts the following technical solutions:

[0006] In a first aspect, the present application provides a method for playing multimedia data, comprising: a first electronic device displays a first display interface; subsequently, the first electronic device displays a first prompt interface, and the first prompt interface includes N (N is an integer greater than 0) candidate devices; if a first selection operation of selecting a second electronic device from the N candidate devices is detected, the first electronic device only switches multimedia data associated with the first display interface to the second electronic device for playing.

[0007] When the first display interface is an interface of the first application, the multimedia data associated with the first display interface includes one or any combination of the following: data of the display interface of the first application, data of a video task or an audio task in the first display interface; other information displayed simultaneously with the first display interface (for example, information in a status bar); multimedia data of a video application in the first electronic device, multimedia data of an audio application in the first electronic device, display data of a home screen of the first electronic device, and multimedia data of an application that is running when the first electronic device displays the first display interface.

[0008] That is, when running an application, the first electronic device can determine the application as an application that needs to be switched to another electronic device to play multimedia data, and prompt the user to select a candidate device for the application. If the user selects a candidate device (i.e., a second electronic device), the first electronic device can switch the multimedia data (such as audio or display data) of the application to the second electronic device for playing with granularity of the application, instead of synchronizing the multimedia data played by the first electronic device in the second electronic device with granularity of the operating system. In this way, the user can select a candidate device for an APP during use of the APP, thereby triggering the first electronic device to switch only the multimedia data of the APP to the second electronic device, avoiding the tedious process of manually setting the switching content before each switching of the device, making the human-computer interaction process more natural and friendly, and improving the user experience.

[0009] In a possible design method, when the first display interface is an interface of the first application, the first prompt interface includes an identifier of the first application, and the first prompt interface is superimposed on the first display interface. That is, the first prompt interface corresponding to the first application is superimposed and displayed when the first display interface of the first application is displayed.

[0010] In a possible design method, after the first electronic device displays the first display interface, the method further includes: in response to a first operation of the user, the first electronic device displays a device switching button; at this time, the first electronic device displays the first prompt interface, including: if a second selection operation of the user on the device switching button is detected, the first electronic device displays the first prompt interface.

[0011] That is, the user can call the interface including the switching button in the first electronic device by performing the first operation. The user can trigger the phone to determine the first application running as an application that can play multimedia data across devices by clicking the device switching button, thereby prompting the user to select a candidate device for the first application to play multimedia data across devices, making the human-computer interaction process more natural and friendly, and improving the user experience.

[0012] In a possible design, the method further includes: if the second selection operation of the user on the device switching button is detected, the first electronic device can further display a second prompt interface, and the second prompt interface includes M (M is an integer greater than 0) candidate devices; if the first electronic device receives a third selection operation of the user selecting a third electronic device from the M candidate devices, the first electronic device can switch the multimedia data of the second application to the third electronic device for playing; wherein the second application is a video application or an audio application in the first electronic device, or an application that is running when the first display interface is displayed.

[0013] That is, the mobile phone can prompt the user to select a candidate device for cross-device playing of multimedia data of a second application in addition to prompting the user to select a candidate device for cross-device playing of multimedia data of a first application. In this way, the user can select which APP multimedia data is switched to which candidate device for running. The user can determine the APP for cross-device playing of multimedia data and the specific device for cross-device playing of multimedia data of the APP through only one selection operation in the prompt interface (for example, a prompt box), thereby simplifying the human-computer interaction process when the multimedia data is switched.

[0014] In a possible design, when the first display interface is an interface of the first application, the first prompt interface can include an identifier of the first application, and the second prompt interface includes an identifier of the second application; the first prompt interface is superimposed on the first display interface, the second prompt interface is superimposed on the first display interface, and the first prompt interface and the second prompt interface are displayed simultaneously.

[0015] In a possible design, the first operation can be an operation of opening a pull-down menu, and the pull-down menu includes the device switching button; or, the first operation can be an operation of opening a pull-up menu, and the pull-up menu includes the device switching button; or, the first operation can be an operation of opening a side pull menu, and the side pull menu includes the device switching button; or, the first operation is an operation of opening a floating menu, and the floating menu includes the device switching button.

[0016] In a possible design method, when the first display interface is an interface of the first application, the first prompt interface can include a name of a video task or an audio task in the first display interface, for example, a video **; at this time, the first electronic device only switches multimedia data associated with the first display interface to the second electronic device for playing, including: the first electronic device switches multimedia data of the video task or multimedia data of the audio task to the second electronic device for playing. In this way, the first electronic device can further switch a video task or an audio task in the first application to another electronic device in a task granularity. At this time, data in the first display interface that is irrelevant to the video task or the audio task does not need to be switched to the second electronic device for playing.

[0017] In a possible design method, the first electronic device displays the first prompt interface, including: if it is detected that a candidate device capable of switching multimedia data for playing is found, the first electronic device automatically displays the first prompt interface. That is, the first electronic device can dynamically generate a prompt interface corresponding to an application when running the application and push the prompt interface to the user, thereby prompting the user that the application currently running can perform an operation of switching multimedia data for playing across devices.

[0018] Alternatively, before the first electronic device displays the first prompt interface, the method further includes: if it is detected that a candidate device capable of switching multimedia data for playing is found, the first electronic device automatically generates the first prompt interface; then, when detecting that the user opens a message notification bar, the first electronic device can display the first prompt interface in the message notification bar.

[0019] In a possible design method, the message notification bar can further include a second prompt interface, and the second prompt interface includes M (M is an integer greater than 0) candidate devices; the method further includes: the first electronic device receives a third selection operation of the user selecting a third electronic device from the M candidate devices; and in response to the third selection operation, the first electronic device switches multimedia data of the second application to the third electronic device for playing. That is, the first electronic device can dynamically generate prompt interfaces corresponding to a plurality of applications respectively and push the prompt interfaces to the user; after the user selects a candidate device in a certain prompt interface, the APP for which multimedia data is switched for playing across devices and the specific device for which multimedia data of the APP is switched for playing across devices can be determined, thereby simplifying a human-computer interaction process when multimedia data is switched.

[0020] In a possible design method, after the first electronic device only switches multimedia data associated with the first display interface to the second electronic device for playing, the method further includes: the first electronic device displays a notification, and the notification is used to prompt that the multimedia data in the first electronic device is playing in the second electronic device.

[0021] For example, the notification can include a candidate device capable of switching to play the multimedia data in addition to the second electronic device.

[0022] In a possible design, after the first electronic device only switches the multimedia data associated with the first display interface to the second electronic device to play, the method further includes: displaying, by the first electronic device, a second display interface of a second application; and then switching, by the first electronic device, the multimedia data associated with the second display interface to a third electronic device to play. That is, the first electronic device can switch the multimedia data of multiple applications to different electronic devices to play respectively.

[0023] In a possible design, when the first display interface is a home screen of the first electronic device, the first electronic device can synchronize display data of the home screen (which can also be referred to as a desktop) and multimedia data of all other running applications to the second electronic device to realize mirror display, thereby realizing cross-device playing of multimedia data at an operating system granularity.

[0024] In a possible design, the first electronic device can also be a candidate device selected by the user, and in this case, the method further includes: receiving, by the first electronic device, a switching-to-play instruction sent by the second electronic device; if the first electronic device is in an unlocked state, playing, by the first electronic device, multimedia data from the second electronic device in response to the switching-to-play instruction; and if the first electronic device is in a locked state, displaying, by the first electronic device, a cross-device playing notification from the second electronic device in a lock screen interface.

[0025] In a possible design, the method further includes: after the first electronic device displays the first prompt interface, if no operation of the first prompt interface by the user is received within a preset time, the first electronic device can hide the first prompt interface; or the first electronic device can convert display data of the first display interface into audio data, and switch the converted audio data to the second electronic device to play; or after the first electronic device switches the multimedia data associated with the first display interface to the second electronic device to play, the first electronic device can continue to display the first display interface or display an interface other than the first display interface.

[0026] In a second aspect, the present application provides an electronic device, including: a touch screen, a communication interface, one or more processors, a memory, and one or more computer programs; wherein the processor is coupled with the touch screen, the communication interface, a positioning apparatus, and the memory, the one or more computer programs are stored in the memory, and when the electronic device is running, the processor executes the one or more computer programs stored in the memory, so that the electronic device executes the method for playing multimedia data described in any of the above aspects.

[0027] In a third aspect, the present application provides a computer storage medium, including computer instructions, when the computer instructions are run on an electronic device, causing the electronic device to perform the method for playing multimedia data according to any one of the first aspect.

[0028] In a fourth aspect, the present application provides a computer program product, when the computer program product is run on an electronic device, causing the electronic device to perform the method for playing multimedia data according to any one of the first aspect.

[0029] It can be understood that the terminal according to the second aspect, the computer storage medium according to the third aspect, and the computer program product according to the fourth aspect provided above are all used to execute the corresponding method provided above, and thus the beneficial effects achieved thereby can refer to the beneficial effects of the corresponding method provided above, which will not be described herein again. BRIEF DESCRIPTION OF DRAWINGS

[0030] Figure 1 An architecture diagram of a device group provided by an embodiment of the present application;

[0031] Figure 2 An application scenario diagram of a method for playing multimedia data provided by an embodiment of the present application Figure 1 ;

[0032] Figure 3 An application scenario diagram of a method for playing multimedia data provided by an embodiment of the present application Figure 2 ;

[0033] Figure 4 An application scenario diagram of a method for playing multimedia data provided by an embodiment of the present application Figure 3 ;

[0034] Figure 5 A structure diagram of an electronic device provided by an embodiment of the present application Figure 1 ;

[0035] Figure 6 An application scenario diagram of a method for playing multimedia data provided by an embodiment of the present application Figure 4 ;

[0036] Figure 7 An application scenario diagram of a method for playing multimedia data provided by an embodiment of the present application Figure 5 ;

[0037] Figure 8 An application scenario diagram of a method for playing multimedia data provided by an embodiment of the present application Figure 6 ;

[0038] Figure 9An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 7 ;

[0039] Figure 10 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 8 ;

[0040] Figure 11 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 9 ;

[0041] Figure 12 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 10 ;

[0042] Figure 13 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 10 One

[0043] Figure 14 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 10 Two

[0044] Figure 15 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 10 Three

[0045] Figure 16 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 10 Four

[0046] Figure 17 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 10 Five

[0047] Figure 18 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 10 Six

[0048] Figure 19 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 10 Seven

[0049] Figure 20 An application scenario of a method for playing multimedia data provided by an embodiment of the present application is shown in FIG. 1 Figure 10 Eight

[0050] Figure 21A structure of an electronic device provided in an embodiment of the present application Figure 2 . DETAILED DESCRIPTION

[0051] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0052] A method for playing multimedia data provided in an embodiment of the present application can be applied to Figure 2 Each electronic device 100 in the device group 200 can communicate with each other.

[0053] For example, the user's mobile phone, tablet computer, smart speaker, smart watch and notebook computer can be taken as the device group 200, and when the user logs in the mobile phone, tablet computer, smart speaker, smart watch and notebook computer with the same account, the mobile phone, tablet computer, smart speaker and notebook computer are in a local area network (LAN), and each device in the local area network can communicate with each other.

[0054] For another example, the electronic devices 100 can also form a local area network through a wireless communication mode (for example, Bluetooth, Wi-Fi or ZigBee network, etc.). For example, the user can add the mobile phone, tablet computer, smart speaker and notebook computer to a Wi-Fi network named “1234”. Each electronic device 100 in the Wi-Fi network forms a local area network, and all the devices in the local area network form the device group 200.

[0055] Of course, in addition to the local area network, the electronic devices 100 in the device group 200 can also be interconnected through a cellular network, or the electronic devices 100 can also be interconnected through a relay device (for example, a USB data line or a Dock device), so as to realize the communication function between the electronic devices 100 in the device group 200, and the embodiments of the present application do not make any limitation in this regard.

[0056] In the embodiments of the present application, a device switching button can be pre-set in the electronic device 100, which can be used to switch one or more multimedia data in the electronic device 100 to other electronic devices in the device group 200 for playing. The multimedia data can include one or any combination of the following: text data, image data, animation data, audio data or video data. The multimedia data can be data generated by the electronic device when running an APP, such as display data, audio data, etc.

[0057] Taking the mobile phone as the above-mentioned electronic device 100 for example, the device switching button can be set on the mobile phone, and the device switching button can be used to switch the multimedia data in the mobile phone to other electronic devices in the device group 200 for playing. Figure 2As shown in (a) of FIG. 2, the device switching button 201 can be arranged in a pull-down menu 202. If the mobile phone detects that a user performs a pull-down operation from the top of the touch screen, the mobile phone can respond to the pull-down operation to expand the pull-down menu 202 from the top of the touch screen, and the pull-down menu 202 can contain the device switching button 201.

[0058] Alternatively, as shown in (b) of FIG. 2, the mobile phone can arrange the device switching button 201 in a pull-up menu 203. If it is detected that a user performs a pull-up operation from the bottom of the touch screen, the mobile phone can respond to the pull-up operation to expand the pull-up menu 203 from the bottom of the touch screen, and the pull-up menu 203 can contain the device switching button 201. Figure 2

[0059] Alternatively, as shown in (c) of FIG. 2, the mobile phone can arrange the device switching button 201 in a side pull menu 204. If it is detected that a user performs a sliding operation from a side of the touch screen, the mobile phone can respond to the sliding operation to expand the side pull menu 204 from the side of the touch screen, and the side pull menu 204 can contain the device switching button 201. Figure 3

[0060] Alternatively, as shown in (d) of FIG. 2, the mobile phone can arrange the device switching button 201 in a floating menu 205. When it is detected that a user clicks a floating button 206 displayed in the touch screen, the mobile phone can display the floating menu 205 containing the device switching button 201. Figure 2

[0061] It should be noted that the concepts of the bottom, the top and the side of the touch screen described in the embodiments of the present application are relative. Generally, as shown in (a) of FIG. 3, a rectangular touch screen usually includes a top, a bottom and two sides, i.e., four areas close to the boundary lines. The bottom usually refers to a position close to the bottom of the touch screen, and the top usually refers to a position close to the top of the touch screen. The bottom and the top of the touch screen generally refer to the lower part and the upper part when the mobile phone is placed as shown in (a) of FIG. 3 or (b) of FIG. 3. Figure 3 Figure 4 Figure 4

[0062] In addition, the device switching button 201 described above can be a virtual key or a physical key, and the embodiments of the present application do not make any limitation in this regard.

[0063] ​​​​​​Exemplarily, the user can generate various multimedia data when using various APPs in the mobile phone. For example, the mobile phone can display video data to the user when running a video APP, play audio data to the user when running a music APP, and display text and picture data to the user when running a browser APP. When using a certain APP, if the user wants to switch the multimedia data output by the current APP to be played on other electronic devices, the user can click the device switching button 201 from the above-described drop-down menu 202 (or the up-pull menu 203, the side-pull menu 204, or the floating menu 205).

[0064] Generally, the mobile phone can record the currently running APP or task in real time. For example, the mobile phone can establish a corresponding application stack when running an application. Generally, the content at the top of the application stack is the content that the mobile phone is currently running and displaying. For example, when the application A is running, the application A can generate a plurality of tasks in the application stack of the application A. The mobile phone executes each task from the top of the stack and outputs the execution result of each task on the touch screen of the mobile phone for display. When the mobile phone displays the drop-down menu 202, the display task of the drop-down menu 202 can also be placed at the top of the application stack. Then, the APP (or task) adjacent to the display task of the drop-down menu 202 in the application stack is the application (or task) that the user is using before the mobile phone displays the drop-down menu 202. Therefore, the mobile phone can determine the APP or task adjacent to the display task of the drop-down menu 202 in the application stack as the APP or task that the user wants to switch to other devices for execution, and then the mobile phone can prompt the user to switch the multimedia data output by the APP (or task) to other electronic devices for playing.

[0065] For the convenience of description, the APP (or task) that the mobile phone prompts the user to switch to other electronic devices for playing multimedia data in subsequent embodiments can be referred to as a target APP (or target task).

[0066] Exemplarily, after the mobile phone detects that the user opens the WeChat APP, the mobile phone can push the WeChat APP to the top of the application stack to start running. At this time, as shown in (a) of FIG. 4, the interface displayed by the mobile phone is the interface 401 of the WeChat APP. If it is detected that the user performs a drop-down operation in the interface 401 of the WeChat APP, the mobile phone can push the display task of the drop-down menu to the top of the application stack to start running. At this time, as shown in (b) of FIG. 4, the mobile phone can superimpose and display the drop-down menu 402 on the interface 401 of the WeChat APP. The drop-down menu 402 includes the device switching button 201. Figure 4 Figure 5

[0067] ​​If it is detected that the user clicks the device switching button 201, since the user clicks the device switching button 201 before using the WeChat APP, the user at this time is likely to want to switch the multimedia data output by the WeChat APP (i.e., the target APP) to other devices for playing. Therefore, as shown in (c) of FIG. 4, the mobile phone can display a prompt box 403 for the WeChat APP to play across devices, and the prompt box 403 contains one or more candidate devices supporting running the WeChat APP, and the candidate devices and the mobile phone belong to the same device group 200. Figure 2

[0068] Then, if it is detected that the user selects a certain candidate device (e.g., the smart TV 404) in the prompt box 403, the mobile phone can switch the multimedia data (e.g., the chat interface of the contact) output by the WeChat APP to the smart TV 404 for continuing playing. For example, the mobile phone can send the display data generated by the running WeChat APP to the smart TV 404 for continuing display. Wherein, the specific method of the mobile phone switching the multimedia data output by a certain APP to other electronic devices will be described in detail in subsequent embodiments, and thus is not described here.

[0069] It can be seen that in the embodiments of the present application, if the first electronic device (e.g., the mobile phone) detects that the user clicks the device switching button, it indicates that the user has the demand to switch the multimedia data on the first electronic device to other electronic devices for playing. Then, the first electronic device can prompt the user to switch the multimedia data output by one or more target APPs recently used to a certain candidate device for playing. If the user selects a second electronic device from the candidate devices, the mobile phone can switch the multimedia data output by the target APP from the first electronic device to the second electronic device for playing across devices.

[0070] That is, when it is detected that the user has the demand to switch the playing device of the multimedia data, the mobile phone can automatically determine the target APP which can be switched to other electronic devices for playing across devices for the user, and prompt the user to switch the multimedia data output by the target APP, avoiding the tedious process of manually setting the target APP each time the user switches the device. In this way, the user can trigger the mobile phone to determine the APP as the target APP which can play the multimedia data across devices by clicking the above-mentioned device switching button during using the APP, and then prompt the user to select the candidate device for the target APP to play the multimedia data across devices, so that the whole human-computer interaction process is more natural and friendly, and the user experience is improved.

[0071] ​Exemplarily, the electronic device 100 in the device group 200 can be a mobile phone, a tablet computer, a smart speaker, a smart television, a notebook computer, an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a personal digital assistant (PDA), a wearable electronic device, a virtual reality device, or the like.

[0072] Taking the mobile phone as an example of the electronic device 100, Figure 4 A structural schematic diagram of the mobile phone is shown.

[0073] The mobile phone can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, and the like.

[0074] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the mobile phone. In other embodiments of the present application, the mobile phone can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0075] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), and the like. Different processing units can be independent devices, or can be integrated in one or more processors.

[0076] The controller can be the nerve center and command center of the mobile phone. The controller can generate operation control signals according to the instruction operation code and the timing signal, complete the control of fetching and executing instructions.

[0077] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instructions or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0078] In some embodiments, the processor 110 can include one or more interfaces. The interface can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0079] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can contain multiple sets of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces respectively. For example: the processor 110 can be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface, realizing the touch function of the mobile phone.

[0080] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple sets of I2S buses. The processor 110 can be coupled with the audio module 170 through the I2S buses to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the I2S interface to enable the function of answering a phone call through a Bluetooth earphone.

[0081] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 170 can be coupled with the wireless communication module 160 through a PCM bus interface. In some embodiments, the audio module 170 can also deliver audio signals to the wireless communication module 160 through the PCM interface to enable the function of playing music through a Bluetooth earphone. Both the I2S interface and the PCM interface can be used for audio communication.

[0082] The UART interface is a universal serial bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to enable Bluetooth functionality. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the UART interface to enable the function of playing music through a Bluetooth earphone.

[0083] The MIPI interface can be used to connect the processor 110 and peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes the camera serial interface (CSI), the display serial interface (DSI), and the like. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to enable the camera function of the mobile phone. The processor 110 and the display screen 194 communicate through the DSI interface to enable the display function of the mobile phone.

[0084] The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 and the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

[0085] The USB interface 130 is an interface conforming to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the mobile phone, and can also be used to transmit data between the mobile phone and a peripheral device. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0086] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the mobile phone. In some other embodiments of the present application, the mobile phone can also use different interface connection modes or a combination of multiple interface connection modes in the above embodiments.

[0087] The wireless communication function of the mobile phone can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0088] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the mobile phone can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0089] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the mobile phone. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves radiated through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be arranged in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be arranged in the same device.

[0090] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0091] The wireless communication module 160 can provide solutions for wireless communication applications in mobile phones, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0092] In some embodiments, antenna 1 of the mobile phone is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the mobile phone to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), BeiDou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).

[0093] The mobile phone implements its display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0094] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the mobile phone may include one or N displays 194, where N is a positive integer greater than 1.

[0095] Mobile phones can achieve shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0096] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0097] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the mobile phone may include one or N cameras 193, where N is a positive integer greater than 1.

[0098] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when a mobile phone is selecting a frequency, the DSP performs Fourier transforms on the frequency energy.

[0099] Video codecs are used to compress or decompress digital video. A mobile phone can support one or more video codecs. This allows the phone to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0100] NPU stands for Neural Network (NN) Computing Processor. By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in mobile phones, such as image recognition, facial recognition, speech recognition, and text understanding.

[0101] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the phone's storage capacity. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0102] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various mobile phone functions and data processing by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during mobile phone use (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0103] Mobile phones can perform audio functions, such as music playback and recording, through components like the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0104] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0105] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. Mobile phones can use the speaker 170A to listen to music or make hands-free calls.

[0106] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When answering a phone call or voice message, the receiver 170B can be brought close to the user's ear to hear the voice.

[0107] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. A mobile phone can have at least one microphone 170C. In some embodiments, a mobile phone can have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, a mobile phone can have three, four, or more microphones 170C, enabling sound signal collection, noise reduction, sound source identification, and directional recording, among other functions.

[0108] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0109] The sensor module 180 may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, etc.

[0110] Of course, the mobile phone may also include a charging management module 140, a power management module 141, a battery 142, a button 190, an indicator 192, and one or more SIM card interfaces, etc. This application embodiment does not impose any restrictions on this.

[0111] The following will describe in detail, with reference to the accompanying drawings, a method for playing multimedia data provided by an embodiment of this application.

[0112] In some embodiments of this application, when a user is using a first electronic device (e.g., a mobile phone), if the user wishes to switch the multimedia data playing on the mobile phone to another device (e.g., a smart TV), the user can find the aforementioned device switching button 201 through some fixed entry points. For example, these fixed entry points could be... Figure 4 The drop-down menu 202, drop-up menu 203, side drop-up menu 204, or floating menu 205 shown in (a)-(d) are not limited in this embodiment.

[0113] Generally, users can access the aforementioned fixed entry point when any app is running on their mobile phone. For example... Figure 6 As shown in (a)-(b), when the WeChat app is running in the foreground, the user can trigger the display of the drop-down menu by inputting a pull-down action. Subsequently, if the phone detects that the user clicks the device switching button 201 in the drop-down menu, the phone can query the applications that were running on the phone before the drop-down menu was displayed. For example, the phone can query the application stack to find that the app adjacent to the task displayed in the drop-down menu is the WeChat app, meaning that the WeChat app was the application the user was using before the drop-down menu was displayed.

[0114] In other words, the user brought up the drop-down menu while using the WeChat app and clicked the device switching button 201 within it. Therefore, the user's intention in clicking the device switching button 201 was likely to switch the multimedia data output by the WeChat app to another device for playback. Furthermore, as... Figure 7 As shown in (c), the mobile phone can automatically identify the WeChat APP as the target APP and display a prompt box 403 indicating that the WeChat APP can play across devices. The prompt box 403 contains one or more candidate devices.

[0115] For example, after a mobile phone identifies the WeChat app as the target app, it can query which members are included in the device group 200 to which the phone is currently located. For instance, if a user connects their mobile phone, tablet, smart TV, and smart speaker to a Wi-Fi network named "1234," these devices form a device group 200. Therefore, after the phone identifies the WeChat app as the target app, it can query which other members in the "1234" Wi-Fi network also include the tablet, smart TV, and smart speaker. The phone can then display these members as candidate devices in a prompt box 403, allowing the user to choose which candidate device to switch to for WeChat. Alternatively, the phone can also obtain the distance between itself and these group members, and then identify devices whose distance to the phone is less than a distance threshold as candidate devices.

[0116] Alternatively, after the mobile phone queries its device group 200 to identify one or more group members, it can further determine which devices within these group members are capable of running the WeChat app (i.e., the target app). For example, the mobile phone can obtain the device parameters of each member in its device group 200, such as whether it has display functionality or audio output functionality. Then, based on the type of WeChat app, the mobile phone can display members with display functionality (such as tablets and smart TVs) as candidate devices in the prompt box 403. For another example, if a mobile phone, tablet, smart TV, and smart speaker are logged into the same Huawei account as a device group 200, the corresponding server maintains the device parameters of each member in device group 200. The mobile phone can then send a WeChat app switching request to the server, requesting the server to determine one or more candidate devices from device group 200 that can run the WeChat app.

[0117] Alternatively, after the phone retrieves one or more members from the current device group 200, it can sort these members using a specific algorithm to determine the order of devices suitable for running the WeChat app within device group 200. For example, the phone can sort members in device group 200 (excluding the phone itself) based on factors such as device parameters, WeChat app software requirements, and user habits, with devices ranked higher being more suitable for running the WeChat app. The phone can then display the candidate devices in prompt box 403 according to the sorting results, allowing the user to easily switch to a more suitable device to continue running the WeChat app.

[0118] Subsequently, after the phone displays a prompt box 403 indicating that the WeChat app can play content across devices, the user can select a candidate device (such as a smart TV) from the list of candidate devices provided in prompt box 403 as the second electronic device to run the WeChat app. In response to the user's selection of a smart TV, the phone can switch the multimedia data output by the WeChat app from the phone to the smart TV for cross-device playback.

[0119] For example, such as Figure 7 As shown, a mobile phone can use its screen mirroring function to send the display data output by the WeChat app to a smart TV, which then continues to display the WeChat app's interface. It should be noted that since the WeChat app is currently displayed in the foreground on the phone, the phone can mirror all display data to the smart TV for display. In this case, the display data sent by the phone includes not only the WeChat app's application interface but also the display data in the status bar. That is, when the phone switches the multimedia data output by the WeChat app to the smart TV, it can also switch the status bar, dock, and other information displayed simultaneously while the WeChat app is running to the smart TV for display as well. Of course, the phone can also send only the running application interface of the WeChat app to the smart TV for display; this embodiment does not impose any restrictions on this.

[0120] Alternatively, if the smart TV has the WeChat app installed, the phone can send a command to the smart TV to open the WeChat app, causing the smart TV to respond and open its own WeChat app, thus switching the WeChat app from the phone to the smart TV for continued operation. Alternatively, when sending the command to the smart TV to open the WeChat app, the phone can also include the current running data of the WeChat app, for example, indicating that the WeChat app is currently in the chat interface of contact Sam. In this way, after the smart TV opens its own WeChat app, it can automatically jump to the chat interface of contact Sam based on the running data, enabling seamless continuation of multimedia data when switching between multiple devices.

[0121] For example, after a mobile phone switches the multimedia data output by the WeChat app to a smart TV for playback, the mobile phone can continue to run the WeChat app and output the corresponding multimedia data. Alternatively, the mobile phone can also stop running the WeChat app; for example, the user can exit the WeChat app and return to the phone's home screen or open another app. Of course, after the mobile phone switches the WeChat app across devices to the smart TV, the user can also perform various operations on the WeChat app on the smart TV, such as chatting with contacts within the WeChat app. This application embodiment does not impose any limitations on this.

[0122] In the above embodiments, when the first electronic device (e.g., the mobile phone mentioned above) is running the target APP, it can receive the user's trigger on the device switching button 201. Then, the first electronic device can be used to switch the target APP across devices to the second electronic device (e.g., the smart TV mentioned above) selected by the user, thereby switching the multimedia data output by the target APP in the first electronic device to the second electronic device for playback.

[0123] In other embodiments, after the first electronic device identifies a target app that can play multimedia data across devices, it can further determine whether the target app contains a target task that needs to be switched. Then, the first electronic device can switch the target task across devices to the second electronic device selected by the user, at the task-by-task level.

[0124] For example, a user can use a mobile phone (i.e., the first electronic device) to open a video app and select to play a TV series. At this time, such as... Figure 8 As shown in (a), the mobile phone can display the playback interface 701 of a TV series in a video app. If a pull-down operation is detected in the playback interface 701, then... Figure 8 As shown in (b), the mobile phone can display a drop-down menu 702 containing a device switching button 201. If the user clicks the device switching button 201 in the drop-down menu 702, the mobile phone can identify the video app that was running before the user clicked the device switching button 201 as the target app.

[0125] Furthermore, the phone can determine whether the task currently being performed by the target app is a preset target task. This target task could be a video playback task, a music playback task, a video call task, or an audio call task, etc. When the phone is running these target tasks, the user's attention is generally focused on the audio or video data being played. Therefore, if the target app is currently performing one of these target tasks—for example, if the target app is currently performing the task of playing the aforementioned TV series, which is a video playback task—then... Figure 8 As shown in (a), the phone can display a prompt box 801 to switch the target task across devices. Similarly, prompt box 801 also contains one or more candidate devices. The difference is that when a candidate device in prompt box 801 is selected, the TV series playback interface in the video app is displayed instead of the entire application interface of the video app.

[0126] Still Figure 9 As shown in (a), if it is detected that the user has selected a smart TV (i.e., the second electronic device) from the candidate devices in the prompt box 801, it means that the user wants to switch the playback task of the aforementioned TV series to run on the smart TV. Therefore, as... Figure 9As shown in (b), the mobile phone can switch the playback task of the aforementioned TV series to the smart TV for continued display via screen mirroring or other methods, thereby transferring the video data played in the video app from the mobile phone to the smart TV. At this time, only the playback task of the aforementioned TV series is executed on the smart TV, while other content from the video app displayed on the mobile phone (such as comments, advertisements, etc.) is not displayed on the smart TV, allowing users to obtain an immersive audio-visual experience in the context of switching audio and video devices.

[0127] In other embodiments, users can also access the drop-down menu from the desktop (also known as the home screen). For example... Figure 10 As shown in (a), when the phone displays desktop 901, if a pull-down operation is detected, the phone can display a pull-down menu 902 containing a device switching button 201. If the user clicks the device switching button 201 in the pull-down menu 902, the phone can identify the desktop as the target app for which cross-device switching is required. Furthermore, as... Figure 10 As shown in (b), the phone can display a prompt 903 for switching desktops across devices, and the prompt 903 also contains one or more candidate devices.

[0128] So, if the system detects that the user has selected a candidate device (such as a smart TV) in prompt 903, the phone can switch its desktop across devices to the smart TV. For example, the phone can project its entire desktop onto the smart TV via screen mirroring. Since the phone desktop is an operating system-level application, after projecting the desktop to the smart TV, all user actions on the phone desktop can be projected onto the smart TV, thus achieving system-level screen mirroring.

[0129] In this way, the method provided in this application embodiment can switch the entire operating system from one electronic device to another, or switch an application from one electronic device to another at the application level, or switch a task in an application from one electronic device to another at the task level, ultimately realizing cross-device playback of multimedia data across multiple devices.

[0130] In other embodiments, the mobile phone may identify multiple target apps that can play multimedia data across devices. For example, such as... Figure 11As shown in (a), when the phone is running the WeChat APP, the user brings up the drop-down menu on the phone through a pull-down operation. If the phone detects that the user clicked the device switching button 201 in the drop-down menu, the phone can identify the WeChat APP that the user was using before clicking the device switching button 201 as the target APP. At the same time, the phone can also identify the desktop system application as the target APP.

[0131] At this time, as Figure 11 As shown in (b), the mobile phone can display a prompt box 1001 for switching the WeChat app across devices and a prompt box 1002 for switching the desktop across devices. If the user selects a candidate device in prompt box 1001, the mobile phone can switch the multimedia data output by the WeChat app to the selected candidate device for playback at the application level. If the user selects a candidate device in prompt box 1002, the mobile phone can switch the multimedia data output by the mobile phone desktop to the selected candidate device for playback at the operating system level. In this way, when playing multimedia data across devices, the user can manually select the specific target app that needs to be played across devices.

[0132] In other embodiments, the target app identified by the mobile phone may include not only the app the user was using before clicking the device switching button 201, but also apps running in the background before the user clicked the device switching button 201. For example, Figure 11 As shown in (a), when the phone is running the WeChat app in the foreground, it is also running the music app and the shopping app in the background. If the phone detects that the user has performed a pull-down operation on the WeChat app interface, it can display a pull-down menu 1101. If the phone detects that the user has clicked the device switching button 201 in the pull-down menu 1101, it can identify the WeChat app, music app, and shopping app that were running on the phone before the user clicked the device switching button 201 as the target app.

[0133] At this time, as Figure 8 As shown in (b), the mobile phone can display prompts for switching between the three target apps across devices: prompt 1102 for switching to the WeChat app, prompt 1103 for switching to the music app, and prompt 1104 for switching to the shopping app. If the user selects a candidate device in prompt 1102, the mobile phone can switch the multimedia data output by the WeChat app to the selected candidate device for playback. If the user selects a candidate device in prompt 1103, the mobile phone can switch the multimedia data output by the music app to the selected candidate device for playback. If the user selects a candidate device in prompt 1104, the mobile phone can switch the multimedia data output by the shopping app to the selected candidate device for playback.

[0134] In other words, after detecting that the user clicks the device switching button 201, all the apps currently running on the phone could be the apps the user wants to use for cross-device multimedia data playback. Therefore, the phone can display all the candidate devices for switching these apps to the user, allowing the user to choose which app to switch to and run on which candidate device. In this way, the user can determine the app for cross-device multimedia data playback and the specific device for playing the multimedia data from that app with just one selection in these prompts provided by the phone, thus simplifying the human-computer interaction process when switching multimedia data.

[0135] For example, most multimedia data that users want to switch to is audio or video data. Therefore, when determining the target app that the user needs to switch to, the phone can identify audio apps and video apps as target apps. Let's continue with... Figure 10 The scenario illustrated in (a) illustrates a case where the phone is running the WeChat app in the foreground while simultaneously running a music app and a shopping app in the background. If the phone detects that the user has performed a pull-down operation on the WeChat app interface, it can display a pull-down menu 1101. If the phone detects that the user has clicked the device switching button 201 in the pull-down menu 1101, it can identify the music app (which is an audio app) as the target app from among the WeChat app, music app, and shopping app. Subsequently, the phone can display a notification for the music app, without needing to display notifications for the WeChat app and the music app.

[0136] Alternatively, since the user brought up the drop-down menu 1101 while the WeChat app was running on their phone, it's highly likely the user switched the WeChat app to another device. Therefore, upon detecting the user clicking the device switching button 201 in the drop-down menu 1101, the phone can identify the WeChat app as one target app. For the music app and shopping app running in the background before the user clicked the device switching button 201, the phone can identify the music app (which is an audio app) as another target app. At this point, the phone can display notifications for both the WeChat app and the music app.

[0137] It should be noted that the prompt box described in the above embodiments (e.g.) Figure 12 The prompt box 801 shown in (a) is... Figure 12 The prompt boxes 1001 and 1002 shown in (b) can be regarded as a specific display form of a prompt interface, and the embodiments of this application do not impose any restrictions on it.

[0138] For example, when a first electronic device (e.g., a mobile phone) switches an app (e.g., WeChat) across devices to play multimedia data on a second electronic device (e.g., a smart TV), such as... Figure 4 As shown in (a), the mobile phone can display a notification message 1202 in the message notification bar 1201 indicating that the WeChat app is running across devices. The notification message 1202 can notify the user that the WeChat app is now playing across devices on the smart TV. For example, the mobile phone can also include a stop button 1203 in the notification message 1202. When the user wants to cancel the cross-device playback function of the WeChat app on the smart TV, they can click the stop button 1203 in the notification message 1202. In response to the user clicking the stop button 1203, the mobile phone can instruct the smart TV to stop displaying the WeChat app's application interface. For example, the mobile phone can stop sending display data generated while the WeChat app is running to the smart TV. Furthermore, after the smart TV stops running the WeChat app, the mobile phone can switch the WeChat app back to the mobile phone to continue displaying it, thus achieving seamless transition between the mobile phone and the smart TV.

[0139] In the embodiments of this application, such as Figure 12 As shown in (b), if the phone detects that the user has clicked the stop button 1203 in the notification message 1202, the phone can also hide the stop button 1203 and display the restore button 1204. If the phone detects that the user has clicked the restore button 1204, the phone can switch the WeChat app back to the smart TV to continue cross-device playback.

[0140] In this embodiment, when the mobile phone detects that the user clicks the stop button 1203 in the notification message 1202, the mobile phone can also start a timer for a preset duration (e.g., 1 minute). If the mobile phone detects that the user has opened an application (or task) of the same type as the WeChat APP within the preset duration, it means that the user is likely to want to switch the newly opened application (or task) to the smart TV for cross-device playback. In this case, the mobile phone can automatically switch the newly opened application (or task) to the smart TV to play its multimedia data. That is to say, the application (or task) that needs to be played across devices and the device after the application (or task) is played across devices can be automatically determined by the mobile phone, thereby simplifying the human-computer interaction process when playing multimedia data across devices.

[0141] In some embodiments, the mobile phone may also prompt the user in the aforementioned notification message 1202 whether there are other electronic devices that can play the WeChat app across devices. For example, if the user is... Figure 13 If a smart TV is selected in the prompt box 403 shown in (c) on the mobile phone, then after switching the WeChat APP to the smart TV, it will still work as before. Figure 13As shown in (a), the mobile phone can display candidate devices (such as tablets and laptops) other than smart TVs in the prompt box 403 in the notification message 1202. Of course, the candidate devices prompted to the user in the notification message 1202 can change dynamically. For example, when a new electronic device is added to the device group where the mobile phone is located, the mobile phone can display the newly added electronic device as a new candidate device in the notification message 1202.

[0142] If a user clicks on a candidate device (e.g., a tablet) in notification message 1202, the mobile phone can switch the WeChat app to the tablet for cross-device playback. In this case, the multimedia data output by the WeChat app on the mobile phone can be played on both the smart TV and the tablet simultaneously. Alternatively, when a user clicks on a candidate device (e.g., a tablet) in notification message 1202, the mobile phone can instruct the smart TV to stop playing the cross-device WeChat app and switch the multimedia data output by the WeChat app to the tablet for continued playback. This embodiment does not impose any limitations on this approach.

[0143] Similarly, if a first electronic device (e.g., a mobile phone) switches a specific task (e.g., the playback task of a TV series) from an app to a second electronic device (e.g., a smart TV), then... Figure 14 As shown in (a), the mobile phone can also display a notification message 1301 for cross-device TV series playback in the message notification bar 1201. If the first electronic device (e.g., a mobile phone) switches the entire mobile phone desktop to run on the second electronic device (e.g., a smart TV), then as... Figure 14 As shown in (b), the mobile phone can also display a notification message 1302 for cross-device playback of the mobile phone desktop in the message notification bar 1201.

[0144] In the above embodiments, the user can trigger the device switching button 201 from a fixed entry point (e.g., a drop-down menu), so that the first electronic device can determine the target APP (or target task) that can play multimedia data across devices, and then prompt the user with candidate devices for playing the target APP (or target task) across devices, so as to realize cross-device playback of multimedia data between multiple devices.

[0145] In other embodiments of this application, the first electronic device (e.g., a mobile phone) can also dynamically generate a cross-device playback reminder message, which is used to prompt the user to perform an operation to play multimedia data across devices. For example, as shown... Figure 15As shown, when a mobile phone is running a video app, it can automatically detect whether there are other electronic devices in the same device group that can play the video app across devices. For example, device group A includes mobile phones, laptops, tablets, and smart speakers. In addition to the mobile phone, the laptops and tablets in device group A both have video playback capabilities. Therefore, the mobile phone can identify the laptops and tablets as candidate devices for playing multimedia data from the video app across devices.

[0146] Furthermore, as Figure 15 As shown, when the video app is running, the phone can display a cross-device reminder message 1401. In this message, the phone prompts the user to switch the video app to a laptop or tablet to play its multimedia data. Furthermore, the phone can also display icons for candidate devices in the message: a laptop icon 1402 and a tablet icon 1403. If the phone detects that the user clicks on icon 1402 or icon 1403, it can switch the multimedia data output by the video app to the corresponding candidate device for continued playback.

[0147] For example, a mobile phone can push cross-device notification messages to a user using the methods described above when a specific application is running. For instance, the specific application could be a video application or an audio application. The phone can automatically set the installed video and audio applications as the specific applications. Alternatively, the user can manually set one or more applications on their phone as the specific applications.

[0148] Alternatively, the mobile phone can push cross-device reminder messages to the user using the methods described above when running specific tasks. For example, the specific tasks mentioned above could be video playback tasks, video download tasks, audio playback tasks, or audio download tasks, etc. Similarly, the specific tasks mentioned above can be manually set by the user or automatically set by the mobile phone, and this application embodiment does not impose any restrictions on this.

[0149] In other embodiments, such as Figure 16 As shown in (a), when a mobile phone is running a video app, if it detects other candidate devices in its device group that can also run video apps, the phone can also generate a cross-device playback card in the notification bar. At this time, if it detects that the user has performed an operation to open the notification bar (e.g., a pull-down gesture), then... Figure 16As shown in (b), the mobile phone can display a cross-device playback card 1502 for the video app in the message notification bar 1501. Similar to the cross-device reminder message 1401 mentioned above, the mobile phone can remind the user to switch the video app to a candidate device such as a smart TV or tablet in the cross-device playback card 1502. Furthermore, the mobile phone can also display icons of the candidate devices in the cross-device playback card 1502. If the mobile phone detects that the user clicks on the icon of a candidate device in the cross-device playback card 1502, the mobile phone can switch the multimedia data output by the video app to the corresponding candidate device to continue playback.

[0150] In other embodiments, the phone may also display cross-device playback cards of other applications running in the background in the message notification bar 1501. For example... Figure 14 As shown in (a), the phone is running a video app in the foreground while a browser app is running in the background. Therefore, in addition to detecting candidate devices in the device group for cross-device playback of the video app, the phone can also detect candidate devices for cross-device playback of the browser app. Furthermore, if it detects that the user has performed an action to open the notification bar (e.g., a pull-down gesture), then... Figure 15 As shown in (b), the mobile phone can display a cross-device playback card 1502 for the video app and a cross-device playback card 1601 for the browser app in the message notification bar 1501. In this way, users can identify the app performing cross-device playback and the specific device playing the app at once through one or more cross-device playback cards pushed by the mobile phone, thereby simplifying the human-computer interaction process when playing multimedia data across devices.

[0151] Of course, the phone can also display cross-device playback cards on the phone's home screen in the aforementioned message notification bar 1501. If it is detected that the user clicks on a candidate device in the cross-device playback cards on the phone's home screen, the phone can switch the home screen to the candidate device selected by the user at the operating system level. This application embodiment does not impose any restrictions on this.

[0152] It should be noted that the cross-device notification messages described in the above embodiments (e.g.) Figure 17 Cross-device notification message 1401) or cross-device playback card (e.g. Figure 17 The cross-device playback card 1502 shown in (b) can also be regarded as a specific display form of a prompt interface, and this application embodiment does not impose any restrictions on it.

[0153] In other embodiments of this application, after a mobile phone switches an app (or task) to another device for cross-device playback, the user can still open other apps (or tasks) on the mobile phone. For example, such as Figure 18As shown, after switching a video app on a smart TV for cross-device playback, the user can still open other applications on their phone. Taking WeChat as an example, after opening WeChat, the phone can automatically detect if there are any candidate devices in its device group for cross-device playback of WeChat. If a candidate device for cross-device playback of WeChat is detected, the phone can prompt the user to select a candidate device to play the WeChat app's multimedia data across devices via the aforementioned cross-device playback card or cross-device reminder message. As... Figure 19 As shown, the phone can display a cross-device notification message 1701 within the WeChat app interface. This message includes two candidate devices for the WeChat app: a tablet and a smart TV. If the phone detects that the user has tapped the tablet icon 1702, it can switch the multimedia data output from the currently running WeChat app to the tablet for continued playback. At this time, the multimedia data output from the video app on the phone is switched to the smart TV for playback, and the multimedia data output from the WeChat app on the phone is switched to the tablet for playback. Users can enjoy multimedia data played on different electronic devices simultaneously, thus improving the user experience.

[0154] For example, the candidate devices detected by the mobile phone for the aforementioned WeChat app might also include a smart TV running a video app. If the user chooses to switch the WeChat app across devices to the smart TV, the mobile phone can instruct the smart TV to stop playing the video app's multimedia data and start playing the WeChat app's multimedia data. Alternatively, the mobile phone can pre-set the priority order between different apps, and thus instruct the smart TV to play the multimedia data of the app with higher priority between the video app and WeChat. Or, if the multimedia data output by the two apps selected by the user on the same candidate device does not conflict—for example, if only audio output is needed when running a music app, and only image output is needed when running WeChat—then the mobile phone can switch both the music app and WeChat app across devices to the same candidate device (e.g., the aforementioned smart TV) to play their respective multimedia data.

[0155] In some other embodiments of this application, the candidate device selected by the user for the target APP may not have a display function or an audio output function. For example, such as Figure 19As shown, if a user selects to switch a music app across devices to a smart speaker 1801 that does not have a display function, the phone can send the audio data of the music app to the smart speaker 1801 for playback, without needing to send the display data of the music app. Similarly, if a user selects to switch a running document to the smart speaker, the phone can convert the text data in the document into audio data and then send the converted audio data to the smart speaker for playback. In other words, if the candidate device selected by the user can only run some functions of the target app (such as display or audio output functions), the phone can play the multimedia data of the target app using the methods supported by the candidate device, based on the device's capabilities.

[0156] In other embodiments of this application, the user can also select the target app to be played across devices and the electronic device after the target app is played across devices in the multitasking window of the mobile phone. For example, Figure 20 As shown, a multitasking window typically contains application snapshots of one or more recently used applications. The phone can determine candidate devices for cross-device playback for each application in the multitasking window, and thus, the phone can display a quick device switching bar in each application's snapshot. Taking the WeChat app as an example, as... Figure 20 As shown, the mobile phone can display a quick device switching bar 1901 in the WeChat app's application snapshot. This bar contains candidate devices identified by the mobile phone for the WeChat app. Therefore, if the phone detects that the user has selected a candidate device in the quick device switching bar 1901, it can switch the multimedia data output by the WeChat app to the corresponding electronic device for playback.

[0157] As can be seen, the embodiments of this application provide multiple shortcuts to trigger a first electronic device (e.g., a mobile phone) to switch multimedia data across devices to a second electronic device for playback. For example, a device switching button can be set in a fixed entry point on the mobile phone (e.g., a drop-down menu). By clicking the device switching button, the user can trigger the mobile phone to determine the target APP for cross-device playback and the candidate devices after the target APP is played across devices. Another example is that the mobile phone can dynamically generate a cross-device playback reminder message or cross-device playback card for the target APP, thereby prompting the user to select the candidate devices for cross-device playback of the target APP in the reminder message or card. Yet another example is that the mobile phone can also set up a quick device switching bar for each application in the multitasking window, thereby prompting the user to select the candidate devices for cross-device playback of the target APP in the quick device switching bar.

[0158] In this way, users can select the target app and the electronic device on which the target app will play across devices using any of the shortcuts mentioned above while using the app. This allows for cross-device playback of multimedia data from the target app, making the entire human-computer interaction process more natural and user-friendly, and improving the user experience.

[0159] It should be noted that the above embodiments all use a mobile phone as the first electronic device, and the shortcuts are set on the mobile phone as examples. It is understood that the first electronic device can also be any device in the device group such as a tablet computer or a laptop computer, and this application embodiment does not impose any restrictions on it.

[0160] Taking a laptop computer as an example of the aforementioned first electronic device, such as Figure 20 As shown in (a), the aforementioned device switching button 201 can also be set in the status bar 2001 of the laptop. When a user browses a webpage on the laptop, the browser interface 2002 is displayed on the laptop. If the user selects the device switching button 201 in the status bar 2001, the laptop can select the currently running browser as the target application and display a prompt box 2003 indicating that the browser is playing across devices. This prompt box 2003 contains one or more candidate devices for the browser.

[0161] Subsequently, if it is detected that the user has selected a candidate device in the prompt box 2003, such as mobile phone 2004, it means that the user wants to switch the multimedia data output from the browser running on the laptop to the mobile phone 2004 for playback. Then the laptop can send the URL of the webpage currently displayed in the browser to the mobile phone.

[0162] After the mobile phone receives the URL, if Figure 20 As shown in (b), if the phone is unlocked, it can use a browser application to open the website, thus switching the browser running on the laptop to the phone for display. If the phone is locked, then... Figure 21 As shown in (c), the phone can display a notification message 2005 on the lock screen to indicate that the browser running on the laptop has been switched to the phone. Subsequently, after receiving the user's unlock operation, the phone will... ​As shown in (d), the mobile phone can automatically open the website address sent by the laptop using a browser application, thereby switching the browser running on the laptop to the mobile phone across devices. Of course, after the phone is unlocked, it can also display the interface that was on the lock screen before, as is currently the case. The user can still find the notification message 2005 in the message notification bar to continue browsing the webpage. After the user clicks on the notification message 2005 or opens the browser application, the mobile phone can open the website address sent by the laptop, thus switching the browser running on the laptop to the mobile phone across devices.

[0163] like ​ As shown in the illustration, this application discloses an electronic device, including: a touchscreen 2101, the touchscreen 2101 including a touch-sensitive surface 2106 and a display screen 2107; one or more processors 2102; a memory 2103; a communication module 2108; one or more application programs (not shown); and one or more computer programs 2104. The above-mentioned devices can be connected via one or more communication buses 2105. The one or more computer programs 2104 are stored in the memory 2103 and configured to be executed by the one or more processors 2102. The one or more computer programs 2104 include instructions that can be used to perform the various steps in the above embodiments.

[0164] Through the above description of the embodiments, those skilled in the art will clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0165] In the embodiments of this application, the functional units can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0166] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as flash memory, portable hard disk, read-only memory, random access memory, magnetic disk, or optical disk.

[0167] The above description is merely a specific implementation of the embodiments of this application, but the protection scope of the embodiments of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the embodiments of this application should be covered within the protection scope of the embodiments of this application. Therefore, the protection scope of the embodiments of this application should be determined by the protection scope of the claims.

Claims

1. A multimedia data processing method, characterized by, Comprising: The first electronic device displays an interface of a first application; The first electronic device displays a first prompt interface, the first prompt interface comprising N candidate devices, N being an integer greater than 0; The first electronic device receives a first selection operation of a user selecting a second electronic device from the N candidate devices; In response to the first selection operation, the first electronic device sends multimedia data of the first application to the second electronic device; The first electronic device displays an interface of a second application; The first electronic device displays a second prompt interface, the second prompt interface comprising M candidate devices, M being an integer greater than 0; The first electronic device receives a second selection operation of a user selecting a third electronic device from the M candidate devices; In response to the second selection operation, the first electronic device sends multimedia data of the second application to the third electronic device; After the first electronic device sends multimedia data of the first application to the second electronic device, after the first electronic device sends multimedia data of the second application to the third electronic device, the method further comprises: The first electronic device displays a first notification indicating that the first application of the first electronic device is cross-device playing on the second electronic device, and a second notification indicating that the second application of the first electronic device is cross-device playing on the third electronic device.

2. The method of claim 1, wherein, The first electronic device displays a first prompt interface, comprising: In response to detecting a preset user operation, the first electronic device displays the first prompt interface.

3. The method of claim 1, wherein, The first electronic device displays a first prompt interface, comprising: In response to detecting a candidate device, the first electronic device automatically displays the first prompt interface.

4. The method according to any one of claims 1 to 3, characterized in that, After the first electronic device sends multimedia data of the first application to the second electronic device, the method further comprises: The first electronic device receives a third selection operation of a user selecting a fourth electronic device from the L displayed candidate devices of the first application, L being an integer greater than 0; In response to the third selection operation, the first electronic device sends multimedia data of the first application to the fourth electronic device.

5. The method of claim 4, wherein, The first electronic device receives a third selection operation of a user selecting a fourth electronic device from the L displayed candidate devices of the first application, specifically comprising: When the first electronic device displays the first notification, the first electronic device receives the third selection operation.

6. The method according to any one of claims 1 to 3, characterized in that, The first electronic device displays an interface of a second application comprises: the first electronic device displays a home screen; the first electronic device sends multimedia data of the second application to the third electronic device comprises: the first electronic device sends multimedia data of the home screen to the third electronic device.

7. The method of any one of claims 1-3, wherein: The first electronic device sends multimedia data of the first application to the second electronic device comprises: the first electronic device sends multimedia data of the first application to the second electronic device through Bluetooth or Wi-Fi; The first electronic device sending the multimedia data of the second application to the third electronic device includes the first electronic device sending the multimedia data of the second application to the third electronic device through Bluetooth or Wi-Fi.

8. An electronic device, comprising: Comprise: a touch screen, wherein the touch screen comprises a touch-sensitive surface and a display screen; one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, the one or more computer programs comprising instructions that, when executed by the electronic device, cause the electronic device to perform the multimedia data processing method of any one of claims 1-7.

9. A computer-readable storage medium having stored therein instructions, the computer-readable storage medium comprising: When the instructions are run on an electronic device, the electronic device is caused to perform the multimedia data processing method of any one of claims 1-7.

Images