Interface display method and electronic equipment

Abstract

The invention provides an interface display method and electronic equipment, in response to operation of a user on first electronic equipment, an application of second electronic equipment or an interface of the application and the like can be transferred to the first electronic equipment, and the first electronic equipment can display the interface containing the transfer content. The first electronic equipment can realize the circulation operation according to the information of the historical operation of the user acting on the second electronic equipment. The information of the historical operation corresponding to the first electronic device and the information of the historical operation corresponding to the second electronic device can be shared among multiple electronic devices. By using the interface display method provided by the invention, the efficiency of content circulation among a plurality of electronic devices is higher, the electronic devices can provide a more efficient circulation triggering mode for a user, and the user experience is good.

Description

Technical Field

[0001] This application relates to the field of terminal device software, and more specifically, to a method for displaying an interface and an electronic device. Background Technology

[0002] In home, cockpit, or office settings, the shared use of multiple electronic devices is often involved. Different electronic devices vary in performance, attributes, and usage status. Collaborative use of multiple devices (such as streaming videos and documents from a mobile phone to a smart screen) can compensate for the limitations of a single device, improve the efficiency of using multiple devices, and enhance the user experience.

[0003] The triggering of collaborative work between multiple devices is the key factor affecting the efficiency of device collaboration, and how to improve the way multiple devices collaborate is a question worth considering. Summary of the Invention

[0004] This application provides a method for displaying an interface and an electronic device. Users can trigger the transfer of content from a second electronic device to the first electronic device by operating a first electronic device. This results in higher efficiency for content transfer between different electronic devices, higher efficiency for collaborative work, and higher efficiency for the first electronic device in displaying the transferred content.

[0005] In a first aspect, a method for displaying an interface is provided, applied to a first electronic device. The method includes: receiving input from a user, the input being used to indicate first content; sending first information to a second electronic device, the first information being used to obtain the first content; receiving the first content sent by the second electronic device; and displaying an interface including the first content.

[0006] In one possible implementation, the input can be touch input, voice command input, or input via a peripheral connected to the first electronic device.

[0007] In one possible implementation, the above input can also be used to indicate operations on the first content, such as displaying the first content, playing the first content, or opening the first content.

[0008] In one possible implementation, if the first electronic device is unable to provide the first content, the first electronic device sends the first information to the second electronic device; if the first electronic device is able to provide the first content, the first electronic device displays an interface including the first content.

[0009] In one possible implementation, the first electronic device may send a request message to the second electronic device, the request message may include first information, and the request message may be used to request the acquisition of first content.

[0010] In this technical solution, in response to user operation, the first electronic device can transfer the first content from the second electronic device to the first electronic device for display. In other words, the user can transfer content from other electronic devices to the first electronic device by operating it, without needing to operate the electronic device providing the content. This results in higher efficiency for the first electronic device in acquiring the first content, stronger content sharing capabilities among multiple electronic devices, higher efficiency in collaborative operation among multiple electronic devices, and a better user experience. Furthermore, the user can acquire the first content without needing to pay attention to or know in advance the source device providing the first content, which helps reduce the operational difficulty for users when multiple devices are working collaboratively.

[0011] In conjunction with the first aspect, in some implementations of the first aspect, before sending the first information to the second electronic device, the method further includes: reading historical operation information, which is used to indicate the source device providing the first content, the source device including the second electronic device.

[0012] In one possible implementation, historical operation information can be stored on a cloud-side device. Before reading the historical operation information, the method further includes receiving the historical operation information sent by the cloud-side device.

[0013] In one possible implementation, historical operation information can be stored locally on the first electronic device.

[0014] In this technical solution, historical operation information may include information about the source device's ability to provide the first content. This historical operation information can also be read by the first electronic device. In other words, the capability information of one electronic device to provide the first content can be shared with another electronic device. The implementation of this technical solution increases the possibility of collaborative work between multiple electronic devices and improves the user experience of using multiple electronic devices collaboratively.

[0015] In conjunction with the first aspect, in some implementations of the first aspect, the source device includes a second electronic device and a third electronic device, wherein the second electronic device displays the first content later than the third electronic device displays the first content, and / or, the device performance of the second electronic device is superior to that of the third electronic device, and / or, the device state of the second electronic device is superior to that of the third electronic device.

[0016] In one possible implementation, device performance may include one or more of the following: device data processing performance, device communication performance, and / or device data read / write performance, etc.

[0017] In one possible implementation, the device status may include one or more of the following: device usage status, device usage mode, device network status, or device battery status.

[0018] In this technical solution, when there are multiple source devices capable of providing the first content, the first electronic device can select a more suitable source device based on the performance, status, and timing of the first content display. Implementing this technical solution helps to optimize the process of transferring the first content from the source device to the first electronic device, improves the efficiency of collaborative work between the first electronic device and the source device, and enhances the user experience in scenarios where the first content is used through inter-device transfer.

[0019] In conjunction with the first aspect, in some implementations of the first aspect, the historical operation information includes: the path through which the first content is displayed by the source device, and / or the historical time during which the first content is displayed by the source device.

[0020] Including the path of the source device displaying the first content in the historical operation information is beneficial for improving the efficiency of the first electronic device acquiring the first content during the flow process. Including the historical time of the source device displaying the first content in the historical operation information is beneficial for determining the latest progress or status of the user viewing the first content. In conjunction with the first aspect, in some implementations of the first aspect, the path includes the operation path of the user viewing the first content and / or the code path of the source device displaying the first content.

[0021] In one possible implementation, the operation path is determined based on manual and / or voice operations.

[0022] Using multiple methods to determine the operation path helps improve the feasibility of this technical solution and enhances its adaptability in different application scenarios.

[0023] Here, the process of the source device displaying the first content can be understood as the process of reading multiple files. The multiple path nodes contained in the code path of the source device displaying the first content can correspond to the multiple files read by the source device.

[0024] Historical operation information contains more information related to the first content, which helps the first electronic device select a more suitable source device to provide the first content and improves the efficiency of the first electronic device and the source device working together.

[0025] In conjunction with the first aspect, in some implementations of the first aspect, the path includes a first path and a second path, and the first information is used to obtain the first content through the first path; wherein the first path corresponds to a second electronic device included in the source device, the second path corresponds to a third electronic device included in the source device, the device performance of the second electronic device is superior to that of the third electronic device, and / or, the device state of the second electronic device is superior to that of the third electronic device; and / or, the time for displaying the first content through the first path is later than the time for displaying the first content through the second path.

[0026] In one possible implementation, the first path and the second path may correspond to the same electronic device, or the first path and the second path may correspond to different electronic devices.

[0027] In this technical solution, when there are multiple paths that can provide the first content, the first electronic device can select a more suitable source device based on the performance, status, and timing of the first content display. Implementing this technical solution optimizes the process of the first content flowing from the source device to the first electronic device, improves the efficiency of collaborative work between the first electronic device and the source device, and enhances the user experience in scenarios where the first content is used through inter-device transfer.

[0028] In conjunction with the first aspect, in some implementations of the first aspect, the path includes a first path and a second path. Before sending the first information to the second electronic device, the method further includes: displaying a path selection interface, the path selection interface including the first path and the second path; and / or playing a path selection voice, the path selection voice including voice for indicating the first path and voice for indicating the second path; sending the first information to the second electronic device includes: in response to the operation of selecting the first path, sending the first information to the second electronic device, the first information being used to obtain first content through the first path.

[0029] In this technical solution, when there are multiple paths that can provide the first content, one path can be determined based on the user's selection. The implementation of this technical solution not only improves the feasibility of the solution but also provides users with greater choice, which is conducive to improving the user experience.

[0030] In conjunction with the first aspect, in some implementations of the first aspect, the historical operation information includes first reference information, which corresponds to the first content, and the first reference information is determined according to machine learning methods.

[0031] This technical solution uses machine learning to determine the first reference information, which can have a stronger correlation with the first content. The implementation of this technical solution is beneficial to improving the accuracy of historical operation information, improving the efficiency of collaborative operation between multiple devices, and enhancing the user experience during the transfer process.

[0032] In conjunction with the first aspect, in some implementations of the first aspect, the first content includes one or more of the following: an application, the interface of the application, a portion of the interface of the application, or multimedia resources.

[0033] In one possible implementation, when the first content is one or more of an application, an application interface, or a portion of the application interface, the flow of the first content can be achieved through a screen mirroring operation from the source device to the first electronic device; when the first content is a multimedia resource, the flow of the first content can be achieved through data transmission from the source device to the first electronic device.

[0034] In a second aspect, a communication method is provided, applied to a fourth electronic device, the method comprising: receiving input from a user for indicating first content; reading historical operation information for indicating a second electronic device providing the first content, and / or a first electronic device for displaying the first content; sending first indication information to the second electronic device for indicating the first content; and / or sending second indication information to the second electronic device for indicating the first content.

[0035] In one possible implementation, the instruction information may include voice commands.

[0036] In this technical solution, users can transfer content from the second electronic device to the first electronic device through a fourth electronic device, in addition to the first and second electronic devices. This increases the efficiency of collaborative work among multiple electronic devices and improves the user experience. Furthermore, historical operation information associated with the second electronic device can be accessed by the fourth electronic device, which also helps improve the efficiency of sharing content across multiple electronic devices.

[0037] In conjunction with the second aspect, in some implementations of the second aspect, the historical operation information includes: the path through which the first content is displayed by the second electronic device, and / or, the historical time during which the first content is displayed by the second electronic device.

[0038] In conjunction with the second aspect, in some implementations of the second aspect, the historical operation information also includes first reference information, which corresponds to the first content and is determined according to machine learning methods.

[0039] In conjunction with the second aspect, in some implementations of the second aspect, the first content includes one or more of the following: an application, the application's interface, a portion of the application's interface, or multimedia resources.

[0040] Thirdly, a communication method is provided for use in a second electronic device. The method includes: determining first reference information and a path for displaying first content based on an operation performed on the second electronic device, wherein the first reference information corresponds to the first content; and sending historical operation information to one or more of a first electronic device, a fourth electronic device, or a cloud-based device, wherein the historical operation information includes the first reference information and the path.

[0041] In this technical solution, the historical operation information generated during the use of the second electronic device can be shared with other electronic devices, which is beneficial to improving the efficiency of sharing the first content among multiple electronic devices and enhancing the user experience in scenarios where multiple electronic devices work together.

[0042] In conjunction with the third aspect, in some implementations of the third aspect, the path includes the operation path for the user to view the first content and / or the code path for the second electronic device to display the first content.

[0043] In some implementations of the third aspect, the first reference information is determined using machine learning methods.

[0044] In conjunction with the third aspect, in some implementations of the third aspect, the method further includes: receiving first information sent by a first electronic device, the first information being used to obtain first content; determining a path based on first reference information; and sending the first content determined based on the path to the first electronic device.

[0045] For detailed explanations and descriptions of the beneficial effects of the following technical solutions, please refer to the relevant content in the first to third aspects, which will not be repeated here.

[0046] Fourthly, an interface display device is provided, the device including an acquisition module and a processing module, the acquisition module being configured to: receive user input, the input being used to indicate first content; send first information to a second electronic device, the first information being used to acquire the first content; and receive the first content sent by the second electronic device; the processing module being configured to: display an interface including the first content.

[0047] In conjunction with the fourth aspect, in some implementations of the fourth aspect, before sending the first information to the second electronic device, the acquisition module is further configured to: read historical operation information, which is used to indicate the source device providing the first content, including the second electronic device.

[0048] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the source device includes a second electronic device and a third electronic device, wherein the second electronic device displays the first content later than the third electronic device displays the first content, and / or, the device performance of the second electronic device is superior to that of the third electronic device, and / or, the device state of the second electronic device is superior to that of the third electronic device.

[0049] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the historical operation information includes: the path through which the first content is displayed by the source device, and / or the historical time when the first content is displayed by the source device.

[0050] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the path includes the operation path for the user to view the first content and / or the code path for the source device to display the first content.

[0051] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the path includes a first path and a second path, and the first information is used to obtain the first content through the first path; wherein, the first path corresponds to a second electronic device included in the source device, the second path corresponds to a third electronic device included in the source device, the device performance of the second electronic device is superior to that of the third electronic device, and / or, the device state of the second electronic device is superior to that of the third electronic device; and / or, the time for displaying the first content through the first path is later than the time for displaying the first content through the second path.

[0052] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the path includes a first path and a second path. Before sending the first information to the second electronic device, the processing module is further configured to: display a path selection interface, which includes a first path and a second path; and / or play a path selection voice, which includes voice indicating the first path and voice indicating the second path. Specifically, the acquisition module is configured to: in response to the operation of selecting the first path, send the first information to the second electronic device, the first information being used to acquire the first content through the first path.

[0053] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the historical operation information includes first reference information, which corresponds to the first content, and the first reference information is determined according to machine learning methods.

[0054] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the first content includes one or more of the following: an application, the application's interface, a portion of the application's interface, or multimedia resources.

[0055] Fifthly, an electronic device is provided, comprising a processor and a memory for storing program instructions, the processor being configured to: receive input from a user for indicating first content; send first information to a second electronic device for acquiring the first content; receive the first content sent by the second electronic device; and display an interface including the first content.

[0056] In conjunction with the fifth aspect, in some implementations of the fifth aspect, before sending the first information to the second electronic device, the processor is further configured to: read historical operation information, which is used to indicate the source device providing the first content, the source device including the second electronic device.

[0057] In conjunction with the fifth aspect, in some implementations of the fifth aspect, the source device includes a second electronic device and a third electronic device, wherein the second electronic device displays the first content later than the third electronic device displays the first content, and / or, the device performance of the second electronic device is superior to that of the third electronic device, and / or, the device state of the second electronic device is superior to that of the third electronic device.

[0058] In conjunction with the fifth aspect, in some implementations of the fifth aspect, historical operation information includes: the path through which the first content is displayed by the source device, and / or the historical time during which the first content is displayed by the source device.

[0059] In conjunction with the fifth aspect, in some implementations of the fifth aspect, the path includes the operation path for the user to view the first content and / or the code path for the source device to display the first content.

[0060] In conjunction with the fifth aspect, in some implementations of the fifth aspect, the path includes a first path and a second path, and the first information is used to obtain the first content through the first path; wherein the first path corresponds to a second electronic device included in the source device, the second path corresponds to a third electronic device included in the source device, the device performance of the second electronic device is superior to that of the third electronic device, and / or, the device state of the second electronic device is superior to that of the third electronic device; and / or, the time for displaying the first content through the first path is later than the time for displaying the first content through the second path.

[0061] In conjunction with the fifth aspect, in some implementations of the fifth aspect, the path includes a first path and a second path. Before sending the first information to the second electronic device, the processor is further configured to: display a path selection interface, the path selection interface including the first path and the second path; and / or play a path selection voice, the path selection voice including voice indicating the first path and voice indicating the second path; the processor is specifically configured to: in response to the operation of selecting the first path, send the first information to the second electronic device, the first information being used to obtain the first content through the first path.

[0062] In conjunction with the fifth aspect, in some implementations of the fifth aspect, the historical operation information includes first reference information, which corresponds to the first content, and the first reference information is determined according to machine learning methods.

[0063] In conjunction with the fifth aspect, in some implementations of the fifth aspect, the first content includes one or more of the following: an application, the interface of the application, a portion of the interface of the application, or multimedia resources.

[0064] In a sixth aspect, a communication device is provided, comprising a transceiver module and a processing module, the processing module being configured to: receive input from a user, the input being used to indicate first content; read historical operation information, the historical operation information being used to indicate a second electronic device providing the first content; the transceiver module being configured to: send first indication information to the second electronic device, the first indication information being used to indicate the first content; and / or, send second indication information to the first electronic device, the second indication information being used to indicate the first content.

[0065] In conjunction with the sixth aspect, in some implementations of the sixth aspect, the historical operation information includes: the path through which the first content is displayed by the second electronic device, and / or, the historical time during which the first content is displayed by the second electronic device.

[0066] In conjunction with the sixth aspect, in some implementations of the sixth aspect, the historical operation information also includes first reference information, which corresponds to the first content, and the first reference information is determined according to machine learning methods.

[0067] In conjunction with the sixth aspect, in some implementations of the sixth aspect, the first content includes one or more of the following: an application, the interface of the application, a portion of the interface of the application, or multimedia resources.

[0068] In a seventh aspect, an electronic device is provided, including a memory and a processor. The memory is used to store program instructions, and the processor is used to: receive input from a user, the input indicating first content; read historical operation information, the historical operation information indicating a second electronic device providing the first content; send first instruction information to the second electronic device, the first instruction information indicating the first content; and / or send second instruction information to the first electronic device, the second instruction information indicating the first content.

[0069] In conjunction with the seventh aspect, in some implementations of the seventh aspect, the historical operation information includes: the path through which the first content is displayed by the second electronic device, and / or, the historical time during which the first content is displayed by the second electronic device.

[0070] In conjunction with the seventh aspect, in some implementations of the seventh aspect, the historical operation information also includes first reference information, which corresponds to the first content, and the first reference information is determined according to machine learning methods.

[0071] In conjunction with the seventh aspect, in some implementations of the seventh aspect, the first content includes one or more of the following: an application, the interface of the application, a portion of the interface of the application, or multimedia resources.

[0072] Eighthly, a communication device is provided, including a processing module and a transceiver module. The processing module is configured to: determine first reference information and a path for displaying first content based on an operation performed on the communication device, wherein the first reference information corresponds to the first content; and the transceiver module is configured to: send historical operation information to one or more of a first electronic device, a fourth electronic device, or a cloud-based device, wherein the historical operation information includes the first reference information and the path.

[0073] In conjunction with the eighth aspect, in some implementations of the eighth aspect, the path includes the operation path for the user to view the first content and / or the code path for the second electronic device to display the first content.

[0074] In conjunction with aspect eight, in some implementations of aspect eight, the transceiver module is further configured to: receive first information sent by the first electronic device, the first information being used to obtain first content; the processing module is further configured to: determine a path based on first reference information; and the transceiver module is further configured to: send the first content determined based on the path to the first electronic device.

[0075] In a ninth aspect, an electronic device is provided, including a processor and a memory for storing program instructions, the processor being configured to: determine, based on an operation performed on the electronic device, first reference information and a path for displaying first content, the first reference information corresponding to the first content; and send historical operation information, including the first reference information and the path, to one or more of a first electronic device, a fourth electronic device, or a cloud-based device.

[0076] In conjunction with the ninth aspect, in some implementations of the ninth aspect, the path includes the operation path for a user to view the first content and / or the code path for a second electronic device to display the first content.

[0077] In conjunction with aspect nine, in some implementations of aspect nine, the transceiver module is further configured to: receive first information sent by the first electronic device, the first information being used to obtain first content; the processing module is further configured to: determine a path based on first reference information; and the transceiver module is further configured to: send the first content determined based on the path to the first electronic device.

[0078] In a tenth aspect, a computer program product is provided, comprising computer program code that, when executed on a computer, causes the methods in the first aspect and any possible implementation thereof to be executed, or causes the methods in the second aspect and any possible implementation thereof to be executed, or causes the methods in the third aspect and any possible implementation thereof to be executed.

[0079] Eleventhly, a computer-readable storage medium is provided that stores computer program code, which, when executed on a computer, causes the method in the first aspect and any possible implementation thereof to be executed, or causes the method in the second aspect and any possible implementation thereof to be executed, or causes the method in the third aspect and any possible implementation thereof to be executed.

[0080] In a twelfth aspect, a chip is provided, including a processor for reading instructions stored in a memory, wherein when the processor executes the instructions, the chip implements the method of the first aspect and any possible implementation thereof, or implements the method of the second aspect and any possible implementation thereof, or implements the method of the third aspect and any possible implementation thereof. Attached Figure Description

[0081] Figure 1 This is a schematic diagram of the hardware architecture of an electronic device provided in an embodiment of this application.

[0082] Figure 2 This is a schematic diagram of the software architecture of an electronic device provided in an embodiment of this application.

[0083] Figure 3 This is a schematic diagram illustrating an application scenario of an interface display method provided in an embodiment of this application.

[0084] Figure 4 This is a schematic diagram of an interface display method provided in an embodiment of this application.

[0085] Figure 5 This is a schematic diagram of a user interface provided in an embodiment of this application.

[0086] Figure 6 This is a schematic diagram of another user interface provided in an embodiment of this application.

[0087] Figure 7 This is a schematic diagram of another interface display method provided in an embodiment of this application.

[0088] Figures 8 to 13 This is a schematic diagram of the user interface provided in an embodiment of this application.

[0089] Figure 14 This is a schematic diagram of another interface display method provided in the embodiments of this application.

[0090] Figure 15 This is a schematic diagram of another interface display method provided in the embodiments of this application.

[0091] Figure 16 This is a schematic diagram of content transfer provided in an embodiment of this application.

[0092] Figure 17 yes Figure 16 A schematic diagram illustrating the composition of the Chinese interface.

[0093] Figure 18 and Figure 19 This is a schematic diagram illustrating a data sharing method among multiple electronic devices provided in an embodiment of this application.

[0094] Figure 20 This is a schematic diagram of a communication method provided in an embodiment of this application.

[0095] Figure 21 This is a schematic diagram of a control for ending a flow provided in an embodiment of this application.

[0096] Figure 22 This is a schematic diagram of an interface display device provided in an embodiment of this application.

[0097] Figure 23 This is a schematic diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0098] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0099] The terminology used in the following embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to also include expressions such as “one or more,” unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, “at least one” and “one or more” refer to one, two, or more than two. The term “and / or” is used to describe the relationship between related objects, indicating that three relationships may exist; for example, A and / or B can indicate: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character “ / ” generally indicates that the preceding and following related objects are in an “or” relationship.

[0100] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0101] The methods provided in this application can be applied to electronic devices such as mobile phones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). This application does not impose any restrictions on the specific type of electronic device.

[0102] For example, Figure 1 A schematic diagram of the structure of electronic device 100 is shown. Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0103] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0104] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0105] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0106] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0107] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0108] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0109] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0110] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0111] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0112] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0113] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0114] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.

[0115] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0116] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0117] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0118] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0119] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0120] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0121] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP performs Fourier transforms on the frequency energy.

[0122] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0123] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0124] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0125] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0126] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0127] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0128] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0129] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.

[0130] Figure 2This is a software structure block diagram of the electronic device 100 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces.

[0131] In some examples, such as Figure 2 The illustration in Figure 2-1 As shown, the system of electronic device 100 can be divided into four layers, from top to bottom: application layer, application framework layer, system service layer and kernel layer.

[0132] For example, the application layer may include system applications and third-party non-system applications. One possibility is that the application of an electronic device may consist of one or more feature abilities (FAs) or particle capabilities (PAs). Feature abilities may include a user interface, providing the ability to interact with the user; particle capabilities may be user-less, providing the ability to run background tasks and a unified data access abstraction. Applications developed based on feature abilities and / or particle capabilities can implement specific business functions and support cross-device scheduling and distribution.

[0133] For example, the application framework layer can be used to provide multi-language user program frameworks and capability frameworks in Java / C / C++ / JS, as well as multi-language framework application programming interfaces (APIs) for various software and hardware services to be exposed to the outside world for applications within the system of electronic devices.

[0134] For example, the system service layer can be used to provide services to applications through the framework layer. By way of example and not limitation, the system service layer may include a set of basic system capability subsystems, a set of basic software service subsystems, a set of enhanced software service subsystems, and a set of hardware service subsystems.

[0135] The system's basic capabilities subsystem set provides foundational capabilities for the operation, scheduling, and migration of distributed applications across multiple devices. It can consist of a distributed soft bus, distributed data management, distributed task scheduling, the Ark multi-language runtime subsystem, a common basic library subsystem, a multi-modal input subsystem, a graphics subsystem, a security subsystem, and an artificial intelligence subsystem. For example, the Ark runtime subsystem can provide runtime environments for multiple languages ​​such as C / C++ / JS and basic system class libraries, and can also provide runtime environments for Java programs statically generated using the Ark compiler.

[0136] The basic software service subsystem set can be used to provide public and general software services, and can consist of an event notification subsystem, a telephone subsystem, a multimedia subsystem, and a debug, fault and trace (DFX) subsystem, etc.

[0137] The enhanced software service subsystem suite can be used to provide differentiated capability-enhancing software services for different devices. For example, it can consist of a smart screen proprietary business subsystem, a wearable proprietary business subsystem, an Internet of Things proprietary business subsystem, etc.

[0138] The hardware service subsystem set can be used to provide hardware services and can consist of location service subsystems, biometric recognition subsystems, wearable proprietary hardware service subsystems, and IoT proprietary hardware service subsystems. Depending on the deployment environment of different device forms, the basic software service subsystem set, the enhanced software service subsystem set, and the hardware service subsystem set can be tailored at the subsystem granularity, and each subsystem can be further tailored at the functional granularity.

[0139] For example, the kernel layer may include a kernel subsystem, a driver subsystem, and a kernel abstraction layer (KAL). The kernel subsystem may include multiple kernels to support the selection of the appropriate operating system kernel for different devices. The KAL can provide basic kernel capabilities to upper layers by shielding the differences between multiple kernels, including process / thread management, memory management, file system, network management, and peripheral device management. The driver subsystem can provide unified peripheral access capabilities and a framework for driver development and management.

[0140] In some embodiments, such as Figure 2 The illustration in Figure 2-2 As shown, the system of electronic device 100 can be divided into four layers, from top to bottom: application (app) layer, application framework layer, Android runtime and system library, and kernel layer.

[0141] For example, the application layer may include a series of application packages. Application packages may include applications such as camera, gallery, calendar, calling, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0142] For example, the application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0143] As an example, the application framework layer may include a window manager, content provider, resource manager, view system, phone manager, notification manager, etc.

[0144] The resource manager service (RMS) provides applications with various resources, such as localized strings, icons, images, layout files, video files, and so on.

[0145] The window manager, also known as the window manager service (WMS), is used to manage window programs. The window manager can obtain the screen size, determine if a status bar is present, lock the screen, and capture screenshots, among other things.

[0146] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0147] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0148] For example, a system library may include multiple functional modules. Examples include: a surface manager, media libraries, a 3D graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), etc.

[0149] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0150] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0151] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0152] A 2D graphics engine is a graphics engine for 2D drawing.

[0153] For example, the kernel layer is the layer between hardware and software. The kernel layer includes at least display drivers, camera drivers, audio drivers, and sensor drivers.

[0154] It should be understood that the technical solutions in the embodiments of this application can be used in systems such as Android, iOS, and HarmonyOS.

[0155] Figure 3 The diagram shown illustrates a scenario 10 provided in an embodiment of this application. Scenario 10 may involve multiple electronic devices, such as a smart screen (or smart TV, etc.) 11, a tablet computer 12, a mobile phone 13, and a smart speaker 14. In scenario 10, content from one of the multiple electronic devices can be transferred to another electronic device for display. For ease of explanation, the electronic device providing the transferred content will be referred to as the source device, the electronic device receiving the transferred content or displaying the transferred content will be referred to as the target device, and other devices besides the source device and the target device will be referred to as reference devices.

[0156] It should be noted that for the same electronic device, it may belong to the source device, the target device, or the reference device in different flow events.

[0157] Figure 3 Scenario 10 can be referred to as a home scenario. It should be noted that the method provided in this application is not limited to applications in home scenarios, but can also be applied to cockpit scenarios (or driving scenarios) or office scenarios, etc.

[0158] In some examples, the content being transferred may include, but is not limited to, one or more of the following: applications, application interfaces, portions of application interfaces, or multimedia resources. Details regarding the content being transferred will be provided below and will not be elaborated upon here.

[0159] For example, in a home setting, the video playback interface on the tablet 12 can be transferred to the smart screen 11, or the game interface on the mobile phone 13 can be transferred to the smart screen 11.

[0160] For example, in a cockpit scenario, the driver's mobile phone navigation interface can be transferred to the vehicle's infotainment system display screen, or a passenger's mobile phone image can be transferred to the vehicle's infotainment system display screen.

[0161] For example, in an office setting, data files on a laptop can be transferred to a smart screen in a meeting room, or the display interface of a presentation on a tablet can be transferred to a smart screen in a meeting room.

[0162] In some scenarios, users can manipulate the source device to transfer streaming content to the target device. In other words, referencing... Figure 4 When a user's streaming operation is detected, the source device can determine the target device that needs to receive the streaming content based on the user's operation, and send the streaming content to the target device. Upon receiving the streaming content, the target device can display an interface containing the streaming content.

[0163] S101, the source device detects user operations.

[0164] In some examples, the user's actions on the source device described above may include one or more of the following: touch operation, voice command, gesture operation (such as air gesture operation), or input operation through a peripheral device (such as mouse, keyboard, stylus, remote control, or touchpad).

[0165] For example, when the source device is a tablet 12 or a mobile phone 13, the user can operate these source devices through touch operation or voice commands; when the source device is a smart speaker 14, the user can operate the source device through voice commands; when the source device is a smart screen 11, the user can operate the source device through voice commands, remote control or other peripherals; when the source device is a laptop or similar device, the user can operate the source device through a mouse, keyboard, touchpad or other peripherals.

[0166] S102, the source device determines the content to be transferred and the target device.

[0167] In some examples, the source device can determine the target device based on device information from multiple devices.

[0168] For example, if the source device detects that there are electronic devices with better performance and / or better status in the current usage scenario during the user's use of the source device, then the source device can use these electronic devices as target devices.

[0169] For example, when streaming is triggered by a source device, the source device can use the application currently being used by the user, the interface currently displayed on the device, a portion of the area currently displayed on the device, or the multimedia file currently being operated by the user as the streaming content.

[0170] For example, refer to Figure 5 When a user watches the "Example Video" on a tablet computer 12, and the tablet computer 12 detects that the scene 10 also includes a smart screen 11 with better display performance, a larger screen, or better sound effects, the tablet computer 12 can determine that the smart screen 11 is the target device in the scene; accordingly, the tablet computer 12 can determine the "Example Video" file or the playback interface of the "Example Video" as the streaming content.

[0171] For detailed instructions on determining the content to be transferred or identifying the target equipment based on equipment information, please refer to the description below, which will not be elaborated here.

[0172] In some examples, the source device can determine the target device based on the user's action. As one possible approach, the source device can display one or more candidate target devices for the user to choose from. In response to the user's selection of one of the candidate target devices, the source device can use that candidate target device as the target device and provide streaming content to that candidate target device.

[0173] Here, the candidate target device can be one or more of the following: a device that has already established a communication connection with the source device, a device that has previously established a communication connection with the source device, a device that is connected to the same network as the source device, a device that is less than the distance threshold from the source device, or a device that has logged into the same user account as the source device.

[0174] For example, the user interface of the source device may display an icon for triggering a flow operation. In response to the user selecting the icon, the source device may display a flow control, which may include one or more electronic devices. In response to the user selecting one of the electronic devices, the source device may use the electronic device selected by the user as the target device.

[0175] In other words, the user operation used to determine the target device can be understood as the user's operation of selecting one electronic device from multiple electronic devices. As an example and not a limitation, the user's operation of selecting an electronic device may include one or more of the following: touch operation, voice command, gesture operation (such as air gesture operation), or input operation through peripheral devices (such as mouse, keyboard, stylus, remote control, or touchpad).

[0176] For example, when a stream is triggered by the aforementioned icon, the source device can use the object indicated by the icon or the object corresponding to the icon as the stream content. Here, the object indicated by the icon can be any of the following: an application, the application's interface, a portion of the application's interface, or a multimedia file, etc.

[0177] For example, refer to Figure 6 The illustration in Figure 6-1 On the playback interface 70 of the "Sample Video" in the "Videos" app on mobile phone 13, a control 52 can be displayed. This control 52 can be used to trigger streaming. In response to the user's selection of the control 52, the electronic device can display... Figure 6 The illustration in Figure 6-2The control 54 shown can be used to select the target device to receive the streaming content. For example, the control 54 can display a smart screen 11 and a tablet computer 12. In response to the user's selection of the smart screen 11 or the tablet computer 12, the mobile phone 13 can select the smart screen 11 or the tablet computer 12 as the target device. Accordingly, the mobile phone 13 can select the playback interface 70 as the streaming content, or the mobile phone 13 can select a portion of the playback interface 70 displaying the "Example Video" as the streaming content, or the mobile phone 13 can select the "Example Video" file as the streaming content.

[0178] In the example above, the user's action of selecting the smart screen 11 or the tablet computer 12 can be used as an example of the action of selecting the target device mentioned above.

[0179] S103, the source device sends the streaming content, and the target device receives the streaming content accordingly.

[0180] In some examples, there can be a communication connection between the source device and the target device, which can be a direct or indirect connection. For instance, the source and target devices can be connected to each other via Bluetooth, NFC, or WLAN. Alternatively, the source and target devices can be connected to the same network device (such as a router or Bluetooth gateway), thus achieving an indirect connection between the two devices.

[0181] When the source and target devices are directly connected, the source device can send the streaming content directly to the target device, and the target device can directly receive the streaming content from the source device. When the source and target devices are indirectly connected through other network devices, the source device can send the streaming content to that network device, and that network device can send the streaming content to the target device, and the target device can receive the streaming content from the network device.

[0182] For example, in Figure 5 In the indicated state, in response to the user inputting the voice command "flow" or "flow to smart screen 11" to the tablet computer 12, or in response to the user clicking the control 50, the tablet computer 12 can send the data or information corresponding to the playback interface of the "Example Video" to the smart screen 11, and correspondingly, the smart screen 11 can receive the data or information corresponding to the playback interface of the "Example Video".

[0183] For example, in Figure 6 The illustration in Figure 6-2 In the indicated state, in response to the user's selection of the smart screen 11, the mobile phone 13 can send data or information corresponding to the "Example Video" file to the smart screen 11, and correspondingly, the smart screen 11 can receive the data or information corresponding to the "Example Video" file.

[0184] S104, The target device displays an interface containing the streaming content.

[0185] When the target device receives data or information from the source device that corresponds to the content being streamed, the target device can display an interface containing the streamed content.

[0186] For example, when the smart screen 11 receives data or information corresponding to the playback interface of the "Example Video" from the tablet computer 12 or the mobile phone 13, the smart screen 11 can display the playback interface of the "Example Video".

[0187] For example, when the smart screen 11 receives a "Sample Video" file from the tablet computer 12 or the mobile phone 13, the smart screen 11 can display an interface containing the "Sample Video" file.

[0188] In some scenarios, to improve the efficiency of information sharing between different devices and enhance the streaming performance of electronic devices, users can operate the target device to transfer content from the source device to the target device. In other words, in response to a user's operation on the target device, content from the source device can be transferred to the target device. Alternatively, in response to a user's operation, content from other electronic devices can be transferred to the electronic device the user is currently operating.

[0189] refer to Figure 7 Upon detecting a user's streaming operation, the target device can determine the source device and the streaming content based on the user's operation. Based on the determined source device, the target device can send first information to the source device to obtain the streaming content. Correspondingly, upon receiving the aforementioned first information, the source device can send the streaming content to the target device, and upon receiving the streaming content, the target device can display an interface containing that streaming content.

[0190] S201, The target device detects the user's operation.

[0191] In some examples, the user's actions on the target device may include one or more of the following: touch operation, voice command, gesture operation (e.g., air gesture operation), or input operation through peripheral devices (e.g., mouse, keyboard, stylus, remote control, or touchpad).

[0192] For example, when the target device is a tablet computer 12 or a mobile phone 13, the user can operate these target devices through touch operation or voice commands; when the target device is a smart speaker 14, the user can operate the target device through voice commands; when the target device is a smart screen 11, the user can operate the target device through voice commands, remote control or other peripherals; when the target device is a laptop or similar device, the user can operate the target device through a mouse, keyboard, touchpad or other peripherals.

[0193] S202, The target device determines the content to be transferred.

[0194] In some examples, the target device can determine the content to be streamed based on the user's actions.

[0195] Here, the user's action can be understood as an input operation performed on the target device, such as a search or lookup operation performed on the target device. Alternatively, the target device can determine that the content the user searches for is the streaming content, or that the content corresponding to the user's search or lookup operation is the streaming content. For example, the user's action can be used to indicate the streaming content.

[0196] For example, a user's operation may include: inputting a voice command containing the name of the content to be streamed into the target device, which can be used to indicate the content to be streamed; or, for another example, a user's operation may include: inputting text information that identifies the content to be streamed, such as the name of the content, into a query control on the target device, which can be used to indicate the content to be streamed.

[0197] For example, a user's actions can be used to instruct on the content being streamed and how to manipulate the content.

[0198] For example, a user's operation may include: inputting a voice command into the target device containing the name of the streaming content and the method of operating the streaming content, which can be used to instruct on the streaming content and the method of operating the streaming content.

[0199] For example, the above-mentioned methods of transferring content may include one or more of the following: displaying, playing, viewing, opening, compressing, inserting, or transferring.

[0200] For example, the above voice commands could be: play the "Example Video" on Smart Screen 11, stream the "Example Music" to Smart Screen 11 for playback, open Document A on Phone 13 on Tablet 12, compress Image B on Phone 13 to Tablet 12, or insert Image C from Smart Screen 11 into Document A on Phone 13, etc. The following examples will primarily focus on the voice command "Play the 'Example Video'".

[0201] Taking the Smart Screen 11 as an example, users can search for content by inputting voice commands into the Smart Screen 11, or by inputting commands into the Smart Screen 11 via the remote control. One possibility is that the Smart Screen 11 cannot provide the content the user is searching for. In this case, the Smart Screen 11 can obtain this content from other devices through a transfer mechanism. Based on this, the Smart Screen 11 can determine that the content indicated by the user's voice command or the content indicated by the command received from the remote control is the transferred content.

[0202] As an example, in Figure 3 In scenario 10, as shown, the user can input the voice command "Play the example video" into the smart screen 11, and the smart screen 11 can display the following: Figure 8 As shown in interface 72, the smart screen 11 can identify the "Example Video" as streaming content. In some scenarios, interface 72 can be considered as the interface of the voice assistant application on the smart screen 11.

[0203] As an example, in Figure 3 In scenario 10 shown, the user can use the remote control on the smart screen 11, as shown in the image. Figure 9 When you enter information such as "example video" on the search interface 74 shown, the smart screen 11 can determine that "example video" is the streaming content.

[0204] It should be noted that the above is only an example of a user's intention to play the "Example Video" on the Smart Screen 11. In some examples, users may also trigger the flow operation with the intention of playing music, viewing pictures, viewing application interfaces, or viewing parts of the application interface on the Smart Screen 11. This application does not impose any restrictions on this.

[0205] One possibility is that the playback source of the "Sample Video" can be found on the Smart Screen 11. For example, the "Huawei Video" application on the Smart Screen 11 can play the "Sample Video". In this case, the Smart Screen 11 can display the playback interface of the "Sample Video".

[0206] If the playback source for the "Sample Video" can be found on the Smart Screen 11, the Smart Screen 11 can also determine whether other electronic devices can provide a playback source for the "Sample Video". If other electronic devices can also provide a playback source for the "Sample Video", the Smart Screen 11 can compare the attributes of the "Sample Video" provided by multiple playback sources and use the playback source corresponding to the "Sample Video" with better attributes to play the "Sample Video".

[0207] S203, Target device determines source device.

[0208] In some examples, the target device is unable to provide the content that the user is looking for or searching for. In such cases, the target device can use an electronic device that is able to provide the aforementioned content (streaming content) as the source device.

[0209] As an example, and not a limitation, the target device can determine the source device based on the user's selection. In one possible implementation, the target device can display one or more candidate source devices. The target device can attempt to obtain streaming content through these candidate source devices. If streaming content can be obtained through these devices, the target device can determine the source device based on the user's selection. If streaming content cannot be obtained through these devices, the target device can provide feedback such as "unable to obtain streaming content".

[0210] As an example, if the playback source for the "Example Video" cannot be found on the Smart Screen 11, the Smart Screen 11 can display something like this: Figure 9 The control 20 shown can be used to indicate that there is no playback source for the "Example Video" on the smart screen 11. The control 20 can also be used to indicate that the video can be streamed using other electronic devices (e.g., tablet 12 or mobile phone 13).

[0211] In the above example, other electronic devices displayed on the control 20, such as tablet computer 12 and mobile phone 13, can be regarded as candidate source devices. These electronic devices may have already established a communication connection with the smart screen 11, or these electronic devices may have previously established a communication connection with the smart screen 11, or these electronic devices may be connected to the smart screen 11 in the same network (e.g., under the same WLAN), or these electronic devices may be logged into the same user account as the smart screen 11, or the distance between these electronic devices and the smart screen 11 is less than or equal to a preset threshold.

[0212] When there are multiple candidate source devices, the target device can attempt to obtain streaming content from each of the candidate source devices and display the results returned by each candidate source device. In response to the user's action on the feedback result, the target device can determine the source device and thus obtain the streaming content from that source device.

[0213] For example, in response to a confirmation operation performed on control 20 mentioned above, the smart screen 11 can search for the "Example Video" via tablet computer 12 and mobile phone 13.

[0214] One possibility is that the tablet 12 can find the playback source for the "Example Video". In this case, the smart screen 11 can display something like this. Figure 10The control 22 shown can be used to prompt the tablet computer 12 that it can play the "Sample Video". The control 22 can also be used to obtain an indication whether to use the tablet computer 12 for streaming playback. And / or, the smart screen 11 can play a voice prompt indicating that the tablet computer 12 can play the "Sample Video", and the smart screen 11 can obtain an indication whether to use the tablet computer 12 for streaming playback based on the user's response to the voice prompt.

[0215] When the user inputs the voice command "Confirm" or manually selects the "Confirm" option on control 22, the smart screen 11 can determine that the tablet computer 12 is the source device providing the streaming content and can communicate with the tablet computer 12 to stream the content to the smart screen 11; when the user inputs the voice command "Cancel" or manually selects the "Cancel" option on control 22, the smart screen 11 can display a prompt message similar to "Playing of 'Sample Video' has been canceled".

[0216] One possibility is that the playback source for the "Example Video" can be found on both the tablet 12 and the mobile phone 13. In this case, the smart screen 11 can display something like this. Figure 11 The control 23 shown can be used to obtain indication information from the user's selection of the source device providing the streaming content. And / or, the smart screen 11 can play a voice prompt indicating that the tablet 12 or mobile phone 13 can play the "Example Video". The smart screen 11 can obtain an indication of whether to use the tablet 12 or mobile phone 13 to stream the video based on the user's response to the voice prompt.

[0217] For example, the control 23 described above can display a prompt message indicating that the "Sample Video" can be played from other electronic devices. The control 23 can also display an option 62 indicating that the tablet 12 is the source device and an option 64 indicating that the mobile phone 13 is the source device. In response to the user selecting option 62 and confirming, the smart screen 11 can determine that the tablet 12 is the source device; in response to the user selecting option 64 and confirming, the smart screen 11 can determine that the mobile phone 13 is the source device; in response to the user's cancellation operation, the smart screen 11 can display a prompt message similar to "Playback of the 'Sample Video' has been cancelled."

[0218] As an example, and not a limitation, the target device can determine the source device based on historical operation information. Here, historical operation information can be understood as the user's historical operation information on electronic devices.

[0219] In some examples, historical operation information can be used to indicate electronic devices capable of providing streaming content.

[0220] For example, historical operation information can be used to instruct the tablet computer 12 that can display the playback interface of the aforementioned "Example Video" and / or the mobile phone 13 that can provide the aforementioned "Example Video" file.

[0221] In some examples, historical operation information may include the path through which the source device provided the streaming content.

[0222] For example, the above path may include the user's operation path for viewing the streaming content and / or the code path (code-level path) for the source device to display the streaming content.

[0223] As an example, in the above example, the user can operate the tablet computer 12 to play the "Example Video" by following path A (Tablet 12 → Desktop → Video → Movie → Click to play "Example Video"). In this example, the operation path included in the historical operation information can be: Tablet computer 12 → Desktop → Video → Movie → Click to play "Example Video".

[0224] As an example, in the above example, the user can operate the phone 13 to play the "Example Video" by following path B (phone 13 → desktop → video → history → click to play "Example Video"). In this example, the operation path included in the history operation information can be: phone 13 → desktop → video → history → click to play "Example Video".

[0225] As an example and not a limitation, the above operation path can be determined based on the user's repeated taps on the screen of the electronic device. For example, the user taps the icon of the "Videos" application on the desktop application interface of the tablet 12, then taps the icon of the "TV Series" category on the "Videos" application interface, and then taps "Sample Video". Alternatively, the above operation path can also be determined based on the user's repeated voice commands. For example, when the desktop application interface is displayed on the phone 13, the user enters the following voice commands into the phone 13 in sequence: Open "Videos", Open "History", Play "Sample Video".

[0226] As an example, in the above example, the code path for the playback interface of the "Example Video" displayed on the tablet 12 can be: tablet 12 / com.xxx.video / home / movie / ex_video. In this example, the code path included in the historical operation information can be: tablet 12 / com.xxx.video / home / movie / ex_video.

[0227] As an example, in the above example, the code path for displaying the playback interface of "Example Video" on mobile phone 13 can be: mobile phone 13 / com.xxx.video / user / recent / ex_video. In the same example, the code path included in the historical operation information can be: mobile phone 13 / com.xxx.video / user / recent / ex_video.

[0228] In some scenarios, electronic devices can display content on their screens by reading and writing multiple files (e.g., the example video). The code path for displaying the streaming content on the source device in the above scheme can be understood as the path composed of multiple files during the process of the source device reading and writing these files. In other words, each node on the code path in the above scheme can correspond to one of the multiple files read by the electronic device.

[0229] In some examples, the path provided by the source device for streaming content can be used for accessing local data on the source device, or it can also be used for accessing data from other electronic devices via the source device. In other words, the streaming content can be provided by the source device, or it can be provided by the source device after being obtained from other devices outside the source device.

[0230] As an example, the aforementioned "Example Video" file can be stored locally on the tablet computer 12, and the playback interface of the "Example Video" can be the playback interface of the tablet computer 12 when the local file is opened. Alternatively, the playback interface of the aforementioned "Example Video" can be displayed on the tablet computer 12 by other electronic devices such as laptops through screen mirroring or other means.

[0231] In some examples, historical operation information may include the historical time when the source device displayed the streaming content.

[0232] For example, historical operation information may include the time when tablet 12 displayed the playback interface of the "Example Video" (e.g., 10:08 AM on June 1, 2022). As another example, historical operation information may include the time when mobile phone 13 displayed the playback interface of the "Example Video" (e.g., 7:13 PM on June 2, 2022).

[0233] When there are multiple paths corresponding to the same source device, the historical operation information may include the historical time corresponding to each of the aforementioned paths.

[0234] For example, the tablet computer 12 can display the playback interface of the "Example Video" via path A and path B. In this case, the historical operation information can include historical time A and historical time B. Historical time A can correspond to the aforementioned path A, or in other words, historical time A can be used to indicate the time when the tablet computer 12 displays the playback interface of the "Example Video" according to path A; historical time B can correspond to the aforementioned path B, or in other words, historical time B can be used to indicate the time when the tablet computer 12 displays the playback interface of the "Example Video" according to path B.

[0235] In some examples, historical operation information may include reference information that corresponds to the content being processed. In other words, reference information can be used to identify the content being processed.

[0236] For example, refer to Figure 6 In interface 70, when the content being streamed is a playback interface for "Example Video", the reference information corresponding to this content can be the text information of the playback interface for "Example Video", such as the text "Example Video". As another example, when the content being streamed is an interface for URL A, the reference information corresponding to this content can be the World Wide Web address of URL A (e.g., https: / / example.xxx.xx).

[0237] Reference information is associated with the content being processed during the circulation process. To more accurately determine the content being circulated, electronic devices can use machine learning to determine the reference information.

[0238] In some examples, electronic devices can determine reference information based on one or more of the following data: the application's interface, interface interaction data, interface elements, gaze data, or touch point data.

[0239] For example, the application's interface may include one or more interfaces that a user opens while using the application.

[0240] For example, interface interaction data can be used to include one or more interaction events that occur after a user opens an interface, such as clicks, swipes, touches, or mouse hovers.

[0241] For example, interface elements may include the shape, size, position, or state of buttons, input boxes, images, etc., contained on the interface opened by the user.

[0242] For example, gaze data may include the location of the user's gaze point after the user opens the interface. As an example and not a limitation, the gaze data may be recorded by an eye-tracking camera or the like.

[0243] For example, touch point data may include the location of the touch device's display screen after the user opens the interface.

[0244] In some examples, electronic devices can perform the following data analysis based on at least one of the above data, and determine reference information based on the results of the data analysis: interaction pattern analysis, interface element analysis, user attention distribution analysis, or contextual information analysis, etc.

[0245] For example, interaction pattern analysis can be used to determine a user's interaction behavior with electronic devices in different scenarios. These different scenarios can be determined based on factors such as time, location, and the user's historical behavior. For instance, on Monday noon, a user might open the "Videos" app to browse multiple short videos; on Saturday evening, the user might open the "Videos" app to play the "Sample Video".

[0246] For example, interface element analysis can be used to mark the interface elements that users interact with and the positions of these elements within the overall interface. Figure 6 Taking the interface 70 shown as an example, interface element analysis can be used to mark the position of control 56, etc.

[0247] For example, user attention distribution analysis can be used to determine the distribution of user attention at different locations on the interface based on fixation point data. Figure 6 Taking the interface 70 shown as an example, during the time period of the electronic device displaying the interface 70, the user's gaze point is located within the display area where the control 56 is located for more than 80% of the time, and the user's gaze point is located outside the display area where the control 56 is located for about 10% of the time.

[0248] For example, during the context information analysis process, electronic devices can combine various factors such as the user's historical behavior, time, and location to comprehensively determine the user's operational intent, or the reference information mentioned above.

[0249] In some examples, during the data processing described above, electronic devices can use convolutional neural networks to process image data and transformer models to process sequence data during user interaction.

[0250] In some examples, the content being streamed may include one or more of the following: an application, an application's interface, a portion of an application's interface, or multimedia resources. Details regarding the content being streamed will be provided below and will not be elaborated upon here.

[0251] In some examples, there may be multiple electronic devices providing the streaming content. For instance, the electronic devices providing the playback source for the "Example Video" may include tablet 12 and mobile phone 13. In this case, the target device can determine the source device from among the multiple electronic devices based on device information and / or the aforementioned historical operation information.

[0252] For example, the target device can identify the electronic device that displays streaming content later as the source device. In other words, the target device can determine the source device based on the historical time when the electronic device displays streaming content, which is contained in the historical operation information.

[0253] For example, if the tablet 12 displays the playback interface of the "Example Video" later than the phone 13 displays the playback interface of the "Example Video", then the smart screen 11 can use the tablet 12 as the source device.

[0254] For example, the target device can determine an electronic device with better attributes of the provided streaming content as the source device. For instance, if the streaming content is an image, the attributes of the streaming content may include the image resolution or whether it is compressed; if the streaming content is an audio file, the attributes may include the audio file format (lossy or lossless) or bitrate; if the streaming content is a video file, the attributes may include the screen resolution, frame rate, color quality, format, or encoding.

[0255] As an example, if the resolution of the "Example Video" file provided by the tablet 12 is higher than that of the "Example Video" file provided by the mobile phone 13, then the smart screen 11 can use the tablet 12 as the source device.

[0256] For example, a target device can identify an electronic device with superior device performance as the source device. In other words, the target device can acquire device information from multiple electronic devices, which may include performance information indicating the device performance of the electronic devices. The target device can determine the source device based on the content being streamed and the performance of the electronic device corresponding to that content.

[0257] The above example illustrates a scenario where streaming content cannot be found on the target device, demonstrating how the target device can select a source device based on the attributes of the streaming content. It's important to note that even if streaming content can be found on the target device, the target device can still determine which device provides the streaming content from among itself and other devices capable of providing such content. For instance, the target device can determine the device providing the streaming content with the best attributes based on the quality of the streaming content offered by different devices. When the device providing the streaming content is the target device, the target device can obtain the streaming content without going through the streaming process itself. In this scenario, the streaming content can be understood as content that the user wants to obtain, view, display, or manipulate.

[0258] As an example, device performance may include one or more of the following: device data processing performance, device communication performance, and / or device data read / write performance. Specifically, device data processing performance can indicate the device's ability to perform data processing, such as the data processing capability of the central processing unit (e.g., the number of cores in the central processing unit, the operating frequency of different cores, etc.), the data processing capability of the graphics processing unit, or the data processing capability of the neural network processing unit. Device communication performance can indicate the attributes of the hardware units used by the device for content streaming, such as the number of antennas included in the device, the data transfer rate supported by the modem, etc.

[0259] For example, when the content being streamed is video applications, games, or video conferencing applications and interfaces that have high latency requirements for data transmission, the performance of the electronic device corresponding to this content can include the device's communication performance. The target device can prioritize the electronic device with better communication performance as the source device.

[0260] For example, a target device can identify an electronic device with a superior device state as the source device. In other words, the target device can acquire device information from multiple electronic devices, which may include status information indicating the device state of the electronic devices, and the target device can determine the source device based on this status information.

[0261] As an example, the status of a device can include one or more of the following: device usage status, device usage mode, device network status, or device battery status. Specifically, device usage status can indicate whether the device is operating under high or low load; device usage mode can indicate whether the device is in a do-not-disturb mode or a normal usage mode; device network status can indicate the latency of network communication; and device battery status can indicate the remaining battery power.

[0262] For example, for multiple electronic devices in different usage states, the target device may prioritize selecting an electronic device in a low-load operating state as the source device, and / or, the target device may prioritize selecting an electronic device in normal usage mode (non-do-disturb usage mode) as the source device, and / or, the target device may prioritize selecting an electronic device with good network status (e.g., low network latency) as the source device, and / or, the target device may prioritize selecting an electronic device with high remaining battery power as the source device.

[0263] In some examples, when the playback source cannot be found on other devices, the Smart Screen 11 can display something like this. Figure 13The control 26 shown can be used to indicate that a playback source for the "Example Video" cannot be found. Exemplarily, the control 26 can also be used to display search entries where a playback source for the "Example Video" might be found. In response to the user selecting one or more search entries, the smart screen 11 can continue searching for a playback source for the "Example Video" within the user-selected search entries. For example, refer to... Figure 13 The aforementioned search entry points can be "Platform A," "Platform B," and "Platform C." In response to the user selecting "Platform B" and confirming, the Smart Screen 11 can continue searching for the playback source of the "Example Video" within "Platform B." Here, "Platform A," "Platform B," and "Platform C" can be understood as websites, databases, content libraries, etc., that can provide information related to the "Example Video." The acquisition methods for these websites, databases, and content libraries can be provided by the Smart Screen 11, or by other electronic devices such as the tablet computer 12 or mobile phone 13; this application does not impose any restrictions on this.

[0264] In some examples, there can be multiple paths corresponding to the streaming content, or in other words, the target device can obtain the streaming content through multiple paths. For example, the paths used to display the playback interface of the aforementioned "Example Video" may include path A and path C, which may correspond to tablet 12 and mobile phone 13 respectively, or both path A and path C may correspond to tablet 12. In this case, the target device can determine one path from the multiple paths to obtain the streaming content based on device information and / or the aforementioned historical operation information. The aforementioned multiple paths will be referred to as candidate paths, and the path selected from the multiple candidate paths will be referred to as the target path.

[0265] For example, when there are multiple candidate paths, the target device can obtain the user's selection operation and determine the target path based on the user's operation.

[0266] In one possible implementation, the target device can display one or more candidate paths. The target device can attempt to obtain streaming content through these candidate paths. If streaming content can be obtained through these candidate paths, the target device can determine the path that provides the streaming content based on the user's selection. If streaming content cannot be obtained through these candidate paths, the target device can provide feedback such as "unable to obtain streaming content".

[0267] For example, the content to be streamed can be the playback interface of the "Example Video". The historical operation information can include the operation path 1 of playing the "Example Video" using tablet computer 12, and the historical operation information can also include the operation path 2 of playing the "Example Video" using mobile phone 13.

[0268] In the above scenario, the target device can display a prompt control similar to control 23 mentioned earlier. This prompt control indicates operation path 1 and operation path 2 for playing the "Example Video". The target device can determine the path for playing the "Example Video" based on the user's selection of this prompt control. Specifically, if the user selects operation path 1, the target device can use operation path 1 (using tablet 12 as the source device for the streaming operation) to obtain the "Example Video"; if the user selects operation path 2, the target device can use operation path 2 (using mobile phone 13 as the source device for the streaming operation) to obtain the "Example Video".

[0269] For example, when there are multiple candidate paths, the target device can determine the path where the content is displayed later as the target path. In other words, the target device can determine the target path based on the historical display time of the content corresponding to different paths, which is included in the historical operation information.

[0270] For example, if the playback interface of the "Example Video" is displayed later using path A than it is displayed using path C, then the Smart Screen 11 can prioritize path A as the target path.

[0271] For example, when different candidate paths correspond to different electronic devices, the target device can determine the source device from multiple electronic devices based on device information and / or historical operation information, and take the path corresponding to the source device as the target path.

[0272] The method for determining the source device from multiple electronic devices based on device information and / or historical operation information can be found in the previous description and will not be repeated here.

[0273] In some examples, the preferred operation path described above is available, or the source device selected from multiple candidate electronic devices is available, and the target device can obtain the streaming content from the source device according to the operation path and display the user interface corresponding to the streaming content.

[0274] In some examples, the preferred operation path described above is unavailable, or the source device selected from multiple candidate electronic devices is unavailable. For example, the electronic device corresponding to the operation path is in a state of being unable to connect (e.g., the electronic device is powered off or in airplane mode). The electronic device can select other alternative operation paths, and the target device can communicate with the electronic device corresponding to the alternative operation path and complete the transfer operation, displaying a user interface corresponding to the transfer content.

[0275] For example, the tablet computer 12 mentioned earlier can play the "Example Video" via operation path 1, and the mobile phone 13 can play the "Example Video" via operation path 2. Operation path 1 can be considered the preferred path for streaming the "Example Video" on the smart screen 11, while operation path 2 can be considered the secondary path. When the tablet computer 12 is powered off or has no network connection, or when the smart screen 11 cannot establish a communication connection with the tablet computer 12, or when the preferred operation path 1 is unavailable, the smart screen 11 can use the secondary operation path 2 to stream and play the "Example Video".

[0276] S204, the target device sends the first information, and correspondingly, the source device receives the first information.

[0277] In some examples, the initial information can be used to obtain the content being streamed.

[0278] For example, the first information may be a request message for requesting access to streaming content, which may include indication information for indicating the streaming content and information about the target device for accessing the streaming content.

[0279] S205, the source device sends the streaming content, and the target device receives the streaming content accordingly.

[0280] S206, The target device displays an interface containing the streaming content.

[0281] For example, when the smart screen 11 receives streaming content such as the playback interface of the "Example Video" sent by the tablet computer 12 or the mobile phone 13, the smart screen 11 can display the playback interface of the "Example Video".

[0282] In some examples, while displaying the playback interface of the "Example Video", the Smart Screen 11 can also display other elements such as... Figure 12 The control 24 shown can be used to indicate that the "Sample Video" is being streamed. For example, the control 24 can also be used to indicate that the playback interface of the "Sample Video" on the tablet 12 is being streamed to the smart screen 11. For instance, the control 24 may include information such as "Streaming the 'Sample Video' to the smart screen 11" or "Streaming the 'Sample Video' from the tablet 12 to the smart screen 11".

[0283] In some scenarios, to improve the efficiency of information sharing between different devices and enhance the streaming performance of electronic devices, users can operate a reference device to transfer streaming content from the source device to the target device. Alternatively, in response to operations performed on other electronic devices besides the source and target devices, streaming content can be transferred from the source device to the target device.

[0284] For example, in Figure 3 In scenario 10 shown, users can use the smart speaker 14 to transfer content from the tablet 12 or mobile phone 13 to the smart screen 11.

[0285] In one possible implementation, refer to Figure 14 When a user's streaming operation is detected, the reference device can determine the streaming content and the source device based on the user's operation. Based on the determined source device, the reference device can send second information to the source device. After receiving the second information, the source device can send the streaming content to the target device. After receiving the streaming content, the target device can display an interface containing the streaming content.

[0286] S301, Reference device detects user operations.

[0287] In some examples, the user's actions on the reference device described above may include one or more of the following: touch operation, voice command, gesture operation (e.g., air gesture operation), or input operation through a peripheral device (e.g., mouse, keyboard, stylus, remote control, or touchpad).

[0288] For example, when the reference device is a tablet computer 12 or a mobile phone 13, the user can operate these reference devices through touch operation or voice commands; when the reference device is a smart speaker 14, the user can operate the reference device through voice commands; when the reference device is a smart screen 11, the user can operate the reference device through voice commands, remote control or other peripherals; when the reference device is a laptop computer, the user can operate the reference device through a mouse, keyboard, touchpad or other peripherals.

[0289] S302, Refer to the equipment to determine the content to be transferred.

[0290] In some examples, the reference device can determine the content to be streamed based on the user's actions.

[0291] Here, the user's operation can be understood as an input operation performed on the reference device, such as a search operation performed on the reference device. Alternatively, the reference device can determine that the content the user searches for is the flowing content, or that the reference device can determine that the content corresponding to the user's search operation is the flowing content.

[0292] For example, user actions can be used to instruct the flow of content.

[0293] For example, a user's operation may include: inputting a voice command containing the name of the streaming content into a reference device, which can be used to indicate the streaming content; or, for another example, a user's operation may include: inputting text information that identifies the streaming content, such as the name of the streaming content, into a query control on the reference device, which can be used to indicate the streaming content.

[0294] For example, a user's actions can be used to instruct on the content being streamed and how to manipulate the content.

[0295] For example, a user's operation may include: inputting a voice command into a reference device containing the name of the streaming content and the method of operating the streaming content, which can be used to instruct on the streaming content and the method of operating the streaming content.

[0296] For example, the above-mentioned methods of transferring content may include one or more of the following: displaying, playing, viewing, opening, compressing, inserting, or transferring.

[0297] For example, the above voice commands could be: play the "Example Video" on the smart screen 11, stream the "Example Music" to the smart screen 11 for playback, open document A on the phone 13 on the tablet 12, compress image B on the phone 13 to the tablet 12, or insert image C on the smart screen 11 into document A on the phone 13, etc.

[0298] In one possible implementation, the reference device may be equipped with a voice assistant application that can receive and parse voice commands input by the user, and determine the content to be transmitted based on the parsing results of the voice commands.

[0299] For detailed information on determining the content to be transferred for reference equipment, please refer to the relevant description of determining the content to be transferred for target equipment mentioned above.

[0300] S303, Reference device determines source device.

[0301] In some examples, the reference device can determine the source device based on the user's actions.

[0302] For example, a user's operation on a reference device can be used to instruct a source device, in which case the reference device can determine the source device based on the user's operation.

[0303] For example, a user can issue a voice command to the speaker 14 to "stream the 'Example Video' on the tablet 12 to the smart screen 11 for playback". The reference device can parse the aforementioned voice command input by the user and determine the tablet 12 as the source device based on the parsing result.

[0304] In some examples, the reference device can determine the source device based on the content being streamed.

[0305] As an example and not a limitation, the reference device may determine multiple electronic devices that can provide streaming content based on the streaming content, and in response to a user's selection of one of the aforementioned multiple electronic devices, the reference device may determine the source device.

[0306] As an example rather than a limitation, the reference device can be used to determine the source device based on historical operation information. Here, historical operation information can be understood as the historical information of a user's operation of an electronic device.

[0307] In some examples, historical operation information can be used to indicate electronic devices capable of providing streaming content.

[0308] In some examples, historical operation information may include the path through which the source device provided the streaming content.

[0309] In some examples, historical operation information may include the historical time when the source device displayed the streaming content. When there are multiple paths corresponding to the same source device, the historical operation information may include the historical time corresponding to each of the aforementioned paths.

[0310] In some examples, historical operation information may include reference information that corresponds to the content being processed. In other words, reference information can be used to identify the content being processed.

[0311] The method for determining the source device from the reference device is roughly similar to the method for determining the source device from the target device described above. For details, please refer to the description above, which will not be repeated here.

[0312] In some examples, the reference device can determine the target device based on the user's actions.

[0313] For example, a user's operation on a reference device can be used to instruct a target device, in which case the reference device can determine the target device based on the user's operation.

[0314] For example, a user can issue a voice command to speaker 14 to "stream the 'Example Video' to smart screen 11 for playback". The reference device can parse the aforementioned voice command input by the user and determine smart screen 11 as the target device based on the parsing result.

[0315] In some examples, the reference device can determine the electronic device that can be used to receive the streaming content based on the streaming content and device information; in other words, the reference device can determine the target device based on the streaming content and device information.

[0316] In some examples, the device information mentioned above may include: device status information and / or device performance information.

[0317] For example, the device's status information may include one or more of the following: device usage status information, device usage mode information, device network status information, device battery status information, or device location information. Specifically, the device usage status information can indicate whether the device is operating under high or low load; the device usage mode can indicate whether the device is in a do-not-disturb mode or a normal usage mode; the device network status information can indicate the latency of the device's network communication; the device battery status information can indicate the remaining battery power; and the device location information can indicate the device's location in the scene, such as its relative position to a reference device.

[0318] For example, when the streaming content is video applications, game applications, and application interfaces, the performance of the electronic device corresponding to this streaming content can include the performance of the graphics processing unit (GPU), and the reference device can prioritize the electronic device with better GPU performance as the target device. When the streaming content is audio applications and application interfaces, the performance of the electronic device corresponding to this streaming content can include the audio playback performance, and the reference device can prioritize the electronic device with better audio playback performance as the target device. When the streaming content is video conferencing or other applications and application interfaces with high latency requirements for data transmission, the performance of the electronic device corresponding to this streaming content can include the device communication performance, and the reference device can prioritize the electronic device with better communication performance as the target device.

[0319] For example, the device's performance information may include one or more of the following: the device's data processing performance, the device's communication performance, and / or the device's data read / write performance. The device's data processing performance can indicate the device's ability to perform data processing, such as the data processing capability of the central processing unit (e.g., the number of cores in the central processing unit, the operating frequency of different cores, etc.), the data processing capability of the graphics processing unit, or the data processing capability of the neural network processing unit. The device's communication performance can indicate the attributes of the hardware units used by the device for content streaming, such as the number of antennas included in the device, the data transmission rate supported by the modem, etc.

[0320] For example, for multiple electronic devices in different usage states, the reference device may prioritize the electronic device in a low-load operating state as the target device for receiving streaming content, and / or, the reference device may prioritize the electronic device in normal usage mode (non-do-disturb usage mode) as the target device for receiving streaming content, and / or, the reference device may prioritize the electronic device with good network status (e.g., low network latency) as the target device for receiving streaming content, and / or, the reference device may prioritize the electronic device with high remaining battery power as the target device for receiving streaming content.

[0321] S304, the reference device sends the second information, and the source device receives the second information accordingly.

[0322] In one possible implementation, the second information can be used to instruct a user operation performed on the reference device in step S302, which can be used to determine the content being transferred. Alternatively, the second information can be used to instruct a user operation in step S302 to search for or locate the content being transferred on the reference device.

[0323] For example, in S302, the reference device can determine the content to be streamed based on the received voice command from the user. In this case, the second information mentioned above may include the voice command. In S302, the reference device can determine the content to be streamed based on the user's touch operation. In this case, the second information mentioned above may include the relevant information of the aforementioned touch operation.

[0324] In one possible implementation, the second information may include information about the content being transferred.

[0325] For example, the second information may include the name of the streaming content. For instance, in the case of a playback interface where the streaming content is "Example Video", the second information may include the text "Example Video".

[0326] In one possible implementation, the second information may also include information about the target device.

[0327] When the target device is determined by the reference device, the second information may also include information about the target device, such as the target device's address information and / or identification information.

[0328] S305, Source device determines target device.

[0329] In some examples, the source device can determine the target device based on the received second information.

[0330] In some examples, the source device can determine the target device based on the content being streamed.

[0331] As an example rather than a limitation, the source device can determine the target device based on the user's selected actions.

[0332] As an example rather than a limitation, the source device can determine the electronic device that can be used to receive the streaming content based on the streaming content and device information; in other words, the source device can determine the target device based on the streaming content and device information.

[0333] In some examples, the device information mentioned above may include: device status information and / or device performance information.

[0334] The method for determining the target device from the source device is roughly similar to the method for determining the target device from the reference device in S303 above. For details, please refer to the description above, which will not be repeated here.

[0335] S306, the source device sends the streaming content, and the target device receives the streaming content accordingly.

[0336] S307, The target device displays an interface containing the streaming content.

[0337] For example, when the smart screen 11 receives streaming content such as the playback interface of the "Example Video" sent by the tablet computer 12 or the mobile phone 13, the smart screen 11 can display the playback interface of the "Example Video".

[0338] In some examples, while displaying the playback interface of the "Example Video", the Smart Screen 11 can also display other elements such as... Figure 12 The control 24 shown can be used to indicate that the "Sample Video" is being streamed. For example, the control 24 can also be used to indicate that the playback interface of the "Sample Video" on the tablet 12 is being streamed to the smart screen 11. For instance, the control 24 may include information such as "Streaming the 'Sample Video' to the smart screen 11" or "Streaming the 'Sample Video' from the tablet 12 to the smart screen 11".

[0339] In one possible implementation, refer to Figure 15 When a user's streaming operation is detected, the reference device can determine the streaming content and the target device based on the user's operation. Based on the determined target device, the reference device can send third information to the target device. After receiving the third information, the target device can communicate with the source device and obtain the streaming content from the source device. After receiving the streaming content, the target device can display an interface containing the streaming content.

[0340] S401, Reference device detects user operations.

[0341] In some examples, the user's actions on the reference device described above may include one or more of the following: touch operation, voice command, gesture operation (e.g., air gesture operation), or input operation through a peripheral device (e.g., mouse, keyboard, stylus, remote control, or touchpad).

[0342] For example, when the reference device is a tablet computer 12 or a mobile phone 13, the user can operate these reference devices through touch operation or voice commands; when the reference device is a smart speaker 14, the user can operate the reference device through voice commands; when the reference device is a smart screen 11, the user can operate the reference device through voice commands, remote control or other peripherals; when the reference device is a laptop computer, the user can operate the reference device through a mouse, keyboard, touchpad or other peripherals.

[0343] S402, Refer to the equipment to determine the content to be transferred.

[0344] In some examples, the reference device can determine the content to be streamed based on the user's actions.

[0345] Here, the user's operation can be understood as an input operation performed on the reference device, such as a search operation performed on the reference device. Alternatively, the reference device can determine that the content the user searches for is the flowing content, or that the reference device can determine that the content corresponding to the user's search operation is the flowing content.

[0346] For example, user actions can be used to instruct the flow of content.

[0347] For example, a user's operation may include: inputting a voice command containing the name of the streaming content into a reference device, which can be used to indicate the streaming content; or, for another example, a user's operation may include: inputting text information that identifies the streaming content, such as the name of the streaming content, into a query control on the reference device, which can be used to indicate the streaming content.

[0348] For example, a user's actions can be used to instruct on the content being streamed and how to manipulate the content.

[0349] For example, a user's operation may include: inputting a voice command into a reference device containing the name of the streaming content and the method of operating the streaming content, which can be used to instruct on the streaming content and the method of operating the streaming content.

[0350] For example, the above-mentioned methods of transferring content may include one or more of the following: displaying, playing, viewing, opening, compressing, inserting, or transferring.

[0351] For example, the above voice commands could be: play the "Example Video" on the smart screen 11, stream the "Example Music" to the smart screen 11 for playback, open document A on the phone 13 on the tablet 12, compress image B on the phone 13 to the tablet 12, or insert image C on the smart screen 11 into document A on the phone 13, etc.

[0352] In one possible implementation, the reference device may be equipped with a voice assistant application that can receive and parse voice commands input by the user, and determine the content to be transmitted based on the parsing results of the voice commands.

[0353] For detailed information on determining the content to be transferred for reference equipment, please refer to the relevant description of determining the content to be transferred for target equipment mentioned above.

[0354] S403, Reference device determines target device.

[0355] In some examples, the reference device can determine the target device based on the user's actions.

[0356] For example, a user's operation on a reference device can be used to instruct a target device, in which case the reference device can determine the target device based on the user's operation.

[0357] For example, a user can issue a voice command to speaker 14 to "stream the 'Example Video' to smart screen 11 for playback". The reference device can parse the aforementioned voice command input by the user and determine smart screen 11 as the target device based on the parsing result.

[0358] In some examples, the reference device can determine the electronic device that can be used to receive the streaming content based on the streaming content and device information; in other words, the reference device can determine the target device based on the streaming content and device information.

[0359] In some examples, the device information mentioned above may include: device status information and / or device performance information.

[0360] For example, the device's status information may include one or more of the following: device usage status information, device usage mode information, device network status information, device battery status information, or device location information. Specifically, the device usage status information can indicate whether the device is operating under high or low load; the device usage mode can indicate whether the device is in a do-not-disturb mode or a normal usage mode; the device network status information can indicate the latency of the device's network communication; the device battery status information can indicate the remaining battery power; and the device location information can indicate the device's location in the scene, such as its relative position to a reference device.

[0361] For example, when the streaming content is video applications, game applications, and application interfaces, the performance of the electronic device corresponding to this streaming content can include the performance of the graphics processing unit (GPU), and the reference device can prioritize the electronic device with better GPU performance as the target device. When the streaming content is audio applications and application interfaces, the performance of the electronic device corresponding to this streaming content can include the audio playback performance, and the reference device can prioritize the electronic device with better audio playback performance as the target device. When the streaming content is video conferencing or other applications and application interfaces with high latency requirements for data transmission, the performance of the electronic device corresponding to this streaming content can include the device communication performance, and the reference device can prioritize the electronic device with better communication performance as the target device.

[0362] For example, the device's performance information may include one or more of the following: the device's data processing performance, the device's communication performance, and / or the device's data read / write performance. The device's data processing performance can indicate the device's ability to perform data processing, such as the data processing capability of the central processing unit (e.g., the number of cores in the central processing unit, the operating frequency of different cores, etc.), the data processing capability of the graphics processing unit, or the data processing capability of the neural network processing unit. The device's communication performance can indicate the attributes of the hardware units used by the device for content streaming, such as the number of antennas included in the device, the data transmission rate supported by the modem, etc.

[0363] For example, for multiple electronic devices in different usage states, the reference device may prioritize selecting the electronic device in a low-load operating state as the target device, and / or, the reference device may prioritize selecting the electronic device in normal usage mode (non-do-disturb usage mode) as the target device, and / or, the reference device may prioritize selecting the electronic device with good network status (e.g., low network latency) as the target device, and / or, the reference device may prioritize selecting the electronic device with high remaining battery power as the target device.

[0364] In some examples, the reference device can determine the source device based on the user's actions.

[0365] For example, a user's operation on a reference device can be used to instruct a source device, in which case the reference device can determine the source device based on the user's operation.

[0366] For example, a user can issue a voice command to the speaker 14 to "stream the 'Example Video' on the tablet 12 to the smart screen 11 for playback". The reference device can parse the aforementioned voice command input by the user and determine the tablet 12 as the target device based on the parsing result.

[0367] In some examples, the reference device can determine the source device based on the content being streamed.

[0368] As an example and not a limitation, the reference device may determine multiple electronic devices that can provide streaming content based on the streaming content, and in response to a user's selection of one of the aforementioned multiple electronic devices, the reference device may determine the source device.

[0369] As an example rather than a limitation, the reference device can be used to determine the source device based on historical operation information. Here, historical operation information can be understood as the historical information of a user's operation of an electronic device.

[0370] In some examples, historical operation information can be used to indicate electronic devices capable of providing streaming content.

[0371] In some examples, historical operation information may include the path through which the source device provided the streaming content.

[0372] In some examples, historical operation information may include the historical time when the source device displayed the streaming content. When there are multiple paths corresponding to the same source device, the historical operation information may include the historical time corresponding to each of the aforementioned paths.

[0373] In some examples, historical operation information may include reference information that corresponds to the content being processed. In other words, reference information can be used to identify the content being processed.

[0374] The method for determining the source device from the reference device is roughly similar to the method for determining the source device from the target device described above. For details, please refer to the description above, which will not be repeated here.

[0375] S404, the reference device sends third information, and the target device receives the third information accordingly.

[0376] In one possible implementation, the third information can be used to instruct a user operation in S402 performed on the reference device, which can be used to determine the content being transferred. Alternatively, the third information can be used to instruct a user operation in S402 to search for or locate the content being transferred on the reference device.

[0377] For example, in S402, the reference device can determine the content to be transferred based on the received voice command from the user. In this case, the aforementioned third information may include the voice command. In S402, the reference device can determine the content to be transferred by detecting the user's touch operation. In this case, the aforementioned third information may include the relevant information of the aforementioned touch operation.

[0378] In one possible implementation, the third information may include information about the content being transferred.

[0379] For example, the third information may include the name of the streaming content. For instance, in the case of a playback interface where the streaming content is "Example Video", the third information may include the text "Example Video".

[0380] In one possible implementation, the third information may also include information about the source device.

[0381] When the source device is determined by the reference device, the third information may also include information about the source device, such as the source device's address information and / or identification information.

[0382] S405, Target device determines source device.

[0383] In some examples, the target device can determine the source device based on the received third-party information.

[0384] In some examples, the target device can determine the source device based on the content being streamed.

[0385] As an example rather than a limitation, the target device can determine the source device based on the user's selected actions.

[0386] As an example, and not a limitation, the target device can determine the source device based on historical operation information. Here, historical operation information can be understood as the historical information of a user's operation on multiple electronic devices.

[0387] In some examples, historical operation information can be used to indicate electronic devices capable of providing streaming content.

[0388] In some examples, historical operation information may include the path through which the source device provided the streaming content.

[0389] In some examples, historical operation information may include the historical time when the source device displayed the streaming content. When there are multiple paths corresponding to the same source device, the historical operation information may include the historical time corresponding to each of the aforementioned paths.

[0390] In some examples, historical operation information may include reference information that corresponds to the content being processed. In other words, reference information can be used to identify the content being processed.

[0391] The method for determining the source device from the target device is roughly similar to the method in S203 above. For details, please refer to the description above, which will not be repeated here.

[0392] S406, the target device sends the fourth information, and the source device receives the fourth information accordingly.

[0393] In some examples, the fourth piece of information can be used to obtain the content being streamed.

[0394] For example, the fourth information may be a request message for requesting access to streaming content, which may include indication information for indicating the streaming content and information about the target device for accessing the streaming content.

[0395] S407, the source device sends the streaming content, and the target device receives the streaming content accordingly.

[0396] S408, The target device displays an interface containing the streaming content.

[0397] For example, when the smart screen 11 receives streaming content such as the playback interface of the "Example Video" sent by the tablet computer 12 or the mobile phone 13, the smart screen 11 can display the playback interface of the "Example Video".

[0398] In some examples, while displaying the playback interface of the "Example Video", the Smart Screen 11 can also display other elements such as... Figure 12 The control 24 shown can be used to indicate that the "Sample Video" is being streamed. For example, the control 24 can also be used to indicate that the playback interface of the "Sample Video" on the tablet 12 is being streamed to the smart screen 11. For instance, the control 24 may include information such as "Streaming the 'Sample Video' to the smart screen 11" or "Streaming the 'Sample Video' from the tablet 12 to the smart screen 11".

[0399] In some scenarios, multiple electronic devices can receive and execute the same flow operation instructions. In this case, multiple electronic devices can process the instructions. When executing the flow operation, the same flow operation within a preset time period can be executed only once.

[0400] For example, in Figure 3 In scenario 10, the user can issue a voice command to "play the sample video on the smart screen 11." The smart screen 11, tablet 12, mobile phone 13, and smart speaker 14 in scenario 10 can all receive and process this voice command. For example, after receiving the aforementioned voice command, the smart screen 11 can locate the playback source of the sample video and display the video as described above. Figures 8 to 11 The interface shown; after receiving the aforementioned voice command, the tablet computer 12 can search for the playback source of the "Example Video". If the playback source is found locally on the device, the playback interface of the "Example Video" can be transferred to the smart screen 11; after receiving the aforementioned voice command, the mobile phone 13 or smart speaker 14 can also search for the playback source of the "Example Video". If it is determined that the tablet computer 12 contains the playback source, it can communicate with the tablet computer 12 or smart screen 11 to trigger the transfer operation of the "Example Video".

[0401] One possible scenario is that, within a preset time period, multiple electronic devices will identify the tablet 12 as the source device and send instructions to the tablet 12 to stream the playback interface of the "Example Video" to the smart screen 11. The tablet 12 can receive the aforementioned instructions multiple times. In this case, the tablet 12 can perform the aforementioned streaming operation once, thereby reducing the probability of pauses or interruptions during the streaming process and improving the user's experience of content streaming between devices.

[0402] One possibility is that within a preset time period, the Smart Screen 11 can receive streaming content of the "Example Video" from multiple electronic devices. In this case, the Smart Screen 11 can receive the streaming content sent first, thereby reducing the probability of pauses or interruptions during the streaming process and improving the user experience of content streaming between devices.

[0403] In the above example, the content being transferred can be an application, the application's interface, a portion of the application's interface, or multimedia resources, etc.

[0404] by Figure 16 Taking the "Video" application interface 30 as an example, the interface 30 may include a display area 32, a display area 34, and a display area 36. The display area 32 may include a playback control 40 and an adjustment control 41. The playback control 40 can be used to display video content, and the adjustment control 41 can be used to control the playback mode of the video in the playback control 40. The display area 34 may include a title control 42 and a selection control 43. The title control 42 can be used to display the title of the video played in the display area 32, and the selection control 43 can be used to select the content of the video played in the display area 32. The display area 36 may include a comment control 44, which can be used to input comment content.

[0405] One possibility is that the aforementioned content can be... Figure 16 The "Video" application shown.

[0406] One possibility is that the aforementioned content can be... Figure 16 The interface 30 of the "Video" application is shown.

[0407] One possibility is that the aforementioned content can be part of the content in interface 30. For example, the operation target can be one or more of display area 32, display area 34 or display area 36, ​​or the operation target can be the playback control 40 and / or adjustment control 41 in display area 32.

[0408] One possibility is that the aforementioned content could be a video file from the "Example Video".

[0409] For example, Figure 17 Provided Figure 16 The diagram illustrates the composition method of interface 30. Interface 30 may include multiple interface elements, which can be arranged in a tree diagram to form interface 30.

[0410] For example, window A can be used to contain all the interface elements included in interface 30; in some scenarios, window A can be considered to correspond to interface 30. Controls B, C, and D can be used to contain... Figure 16 The interface elements contained in area 32, area 34, and area 36 are respectively. In other words, controls B, C, and D can correspond to areas 32, 34, and 36 respectively. Playback control 40 and adjustment control 41 can be contained in control B, title control 42 and selection control 43 can be contained in control C, and comment control 44 can be contained in control D.

[0411] exist Figure 17 In the tree diagram shown, window A can be used as... Figure 17 The root node of the tree diagram (represented by interface 30 in the figure), controls B, C and D can be regarded as child nodes of window A (represented by area 32, area 34 and area 36 in the figure respectively), play control 40 and adjustment control 41 can be regarded as child nodes of control B, title control 42 and selection control 43 can be regarded as child nodes of control C, and comment control 44 can be regarded as child node of control D.

[0412] In some examples, the content being circulated can be an application. In this case, the reference information used to indicate the content being circulated can be the application's identification information, which can be one or more of the following: application name, application package name (such as com.example.appname), an identifier in the app store, or the application's digital signature, etc.

[0413] In some examples, the content being flowed can be the application's interface. In this case, the reference information used to indicate the content being flowed can be information extracted from the application's interface, such as the interface's title, identifier, or type (e.g., login page, home page, or details page).

[0414] In some examples, the content to be flowed can be a portion of the application's interface. In this case, the reference information used to indicate the content to be flowed can be one or more of the following: the location of the portion of the interface on the interface, the interface element corresponding to the portion of the interface, or the interface element contained in the portion of the interface.

[0415] In one possible implementation, the streaming content may include one or more interface elements, or in other words, one or more interface elements may constitute the streaming content. For example, if the streaming content is area 32 of interface 30, the streaming content may include control B and the playback control 40 and adjustment control 41 contained in control B; for example, if the streaming content is interface 30, the streaming content may include window A and controls B, C and D contained in window A, as well as the playback control 40, adjustment control 41, title control 42, selection control 43 and comment control 44 contained in controls B, C and D.

[0416] As previously explained, in one possible implementation, the content being transferred can be an application. It should be noted that the application here can include applications installed locally on the electronic device, as well as applications that do not need to be installed locally on the electronic device, such as quick apps, lightweight apps, and mini-programs. It can also include application icons, widgets, application plugins, application components, service cards or sets of widgets, sets of cards, etc., placed on the interface of the desktop application.

[0417] For example, a widget can be a weather widget, a search widget, a photo album widget, a widget of a third-party application, etc. A widget set or a card set can be a set of at least two of the aforementioned one or more widgets, one or more application plugins, or one or more service cards.

[0418] As an example, when the content being streamed is an application icon or widget, the interface used by the target device to display the content can be the interface of the target device's desktop application.

[0419] When the content being streamed is an application, an application's interface, or a portion of an application's interface, the target device may display the application, its interface, or a portion of its interface corresponding to the streamed content. In this case, the target device can respond to user actions on the streamed content displayed on the target device.

[0420] For example, when the content being streamed is the aforementioned interface 30, in response to the user's selection of the comment control 44 on the interface 30 of the smart screen 11, the smart screen 11 can display an input control, which can be used to input information into the comment control 44.

[0421] In other words, when the content being transferred is an application, the application's interface, or a portion of the application's interface, the user can access all or part of the application's functionality through the target device.

[0422] One possible implementation is that, in cases where the content being transferred is an application, the application's interface, or a portion thereof, the content being transferred may also include program code and data that implement all or part of the application's functionality.

[0423] As an example, the content being streamed may include features and capabilities with a user interface on the source device. The content being streamed may also include granular capabilities without a user interface corresponding to the aforementioned features and capabilities. These granular capabilities can be used to provide the ability to run background tasks and the same data access abstraction.

[0424] When the streaming content is a multimedia resource, the streaming content may include one or more data files such as text files, audio files, or video files. In response to receiving these types of streaming content, the target device may display an interface containing these streaming contents, or the target device may display an interface after opening these data files.

[0425] In one possible implementation, when the content to be transferred is an application, its interface, or a portion thereof, it can be achieved by projecting all or part of the content displayed on the source device's screen onto the target device. In this scenario, the process of transferring content from the source device to the target device can also be understood as a projection process from the source device to the target device.

[0426] For example, the content being streamed can be a "game" application installed on the tablet 12. When the smart screen 11 receives the "game" application, it can display a control configuration interface. This control configuration interface can be determined based on the control device connected to the smart screen 11. For example, if the device connected to the smart screen 11 is a keyboard, the control configuration interface can be used to configure the functions of different keys on the keyboard. Alternatively, if the device connected to the smart screen 11 is a gamepad, the control configuration interface can be used to configure the functions of different keys on the gamepad.

[0427] For example, the content being transferred can be a navigation card installed on mobile phone 13, and the target device can be the vehicle's infotainment system. In this case, when the target device receives the navigation card, it can display the navigation status on the navigation card in full screen on the vehicle's infotainment system. Alternatively, in response to the user's operation on the navigation card displayed on the vehicle's infotainment system, the vehicle's infotainment system can display the interface of the application corresponding to the navigation card.

[0428] For example, the content being streamed can be the user's own video window in a video application during a video conferencing scenario. This video application can be installed on the tablet 12. When the smart screen 11 receives this content, it can call the camera of the smart screen 11 to capture the user's image and display the user's own video window.

[0429] In one possible implementation, when the content to be streamed is a multimedia resource, this can be achieved by transmitting the multimedia resource from the source device to the target device. In this scenario, the process of streaming content from the source device to the target device can also be understood as the process of data transmission from the source device to the target device.

[0430] For example, the content to be transferred can be the phone number of a contact found on the smart screen 11. When the mobile phone 13 receives the phone number, it can display a dialing interface on the dialing interface, where the number to be dialed is the phone number of the contact indicated by the content to be transferred.

[0431] For example, the content to be streamed can be an audio file stored on the phone 13, and the speaker 14 can play the audio file when it receives the streamed content.

[0432] One possibility is that historical operation information can include information about a user's operations on multiple electronic devices. Alternatively, historical operation information can include multiple sub-historical operation information sets, each corresponding to a specific electronic device. In other words, sub-historical operation information corresponding to different electronic devices can be shared among multiple electronic devices.

[0433] For example, historical operation information may include reference information and operation paths determined by the user during the operation of the tablet computer 12 mentioned earlier. Alternatively, historical operation information may also include reference information and operation paths determined by the user during the operation of the smart screen 11 mentioned earlier. Or, historical operation information may also include reference information and operation paths determined by the user during the operation of the smart speaker 14.

[0434] As one possible implementation, such as Figure 18 As shown, different electronic devices can establish communication connections with each other, or in other words, different electronic devices can form an interconnected communication network. Sub-historical operation information corresponding to different electronic devices can be transmitted from one electronic device to another through this communication connection. In other words, sub-historical operation information corresponding to different electronic devices can be shared through communication links between electronic devices. As an example, the historical operation information containing multiple sub-historical operation information can be stored separately on the local storage media of multiple electronic devices.

[0435] As one possible implementation, such as Figure 19As shown, the sub-historical operation information corresponding to different electronic devices can be stored in the same database (e.g., a cloud database). When an electronic device receives a request for a transfer operation, it can send the transfer operation information to an electronic device 15 (e.g., a cloud server, hereinafter referred to as cloud-side device 15) associated with the database. The cloud-side device 15 can query the database based on the received transfer operation information to determine the source device and target device for implementing the transfer operation.

[0436] based on Figure 18 and Figure 19 And the relevant descriptions of the embodiments in the preceding text, such as Figure 20 As shown in the embodiments of this application, a communication method is also provided. Different devices may provide different content. To improve the efficiency of content flow between different devices and enhance the collaborative capabilities of multiple devices, the communication method provided in this embodiment allows a first device among multiple devices to determine, in response to a user's operation, first information corresponding to the first content and the path for displaying the first content, and then send this information (historical operation information) to a second device. After obtaining this information, the second device can determine that the first device can provide the first content. When a user needs to display or operate the aforementioned first content on the second device, the second device can obtain the first content from the first device using the method described above.

[0437] S501, the first device determines the first reference information and the path for displaying the first content.

[0438] Here, the first device can be understood as the electronic device that can provide the content to be streamed, as mentioned above. For different types of content to be streamed, the source device, target device, and reference device mentioned above can all be used as the first device here.

[0439] In some examples, the first device can determine the first reference information and the path to display the first content based on the user's actions on the first device. Here, the actions performed on the first device can be understood as the user's actions to view the first content on the first device.

[0440] In some examples, the first reference information may correspond to the first content, or in other words, the first reference information may be used to identify the flowing content. In some examples, the path for displaying the first content may include the operation path of a user viewing the first content on a first device, and / or the code path of the first device displaying the first content.

[0441] For information regarding the first reference information and the path to display the first content, please refer to the previous text; it will not be repeated here.

[0442] In some scenarios, the primary content can also be called the circulating content. The primary content can include one or more of the following: application, application interface, part of the application interface, or multimedia resources.

[0443] The description of the first content is similar to that of the circulating content in the previous text. For details, please refer to the previous text. It will not be repeated here.

[0444] S502, the first device sends historical operation information, and correspondingly, the second device receives the historical operation information.

[0445] Here, the second device may include any electronic device that establishes a communication connection with the first device. For example, the second electronic device may be the source device, target device, reference device, or cloud-side device 15 corresponding to the database that stores historical operation information in the cloud, as mentioned above.

[0446] In some examples, historical operation information can be used to indicate electronic devices capable of providing streaming content.

[0447] In some examples, historical operation information may include the path through which the source device provided the streaming content.

[0448] In some examples, historical operation information may include the historical time when the source device displayed the streaming content. When there are multiple paths corresponding to the same source device, the historical operation information may include the historical time corresponding to each of the aforementioned paths.

[0449] In some examples, historical operation information may include reference information that corresponds to the content being processed. In other words, reference information can be used to identify the content being processed.

[0450] For details regarding historical operation information, please refer to the previous text; further details will not be provided here.

[0451] When content is transferred from the source device to the target device and displayed on the target device, in response to user actions on the source device, the source device can display a control to end the transfer operation. In response to user actions on this control, the source device can end the transfer of content to the target device.

[0452] For example, still in the previous text Figure 6 Taking the example video from mobile phone 13 being streamed to smart screen 11 as an example, when the example video is played on smart screen 11, in response to the user clicking on control 52 on interface 70 mentioned above, mobile phone 13 can display as follows: Figure 21The control 58 shown can be used to display the streaming status of the "Sample Video". For example, the control 58 can be used to show that the "Sample Video" is being streamed from mobile phone 13 (the device) to smart screen 11. Exemplarily, the control 58 can also display a "Stop Streaming" button 60, which, in response to the user selecting the "Stop Streaming" button 60, allows mobile phone 13 to stop streaming the "Sample Video" to smart screen 11.

[0453] When content is transferred from the source device to the target device and displayed on the target device, the target device can exit the display interface of the transferred content in response to the user's operation on the target device, or in other words, the target device can end the display of the transferred content.

[0454] For example, still in the previous text Figure 6 Taking the example video from mobile phone 13 being streamed to smart screen 11 as an example, when the example video is played on smart screen 11, in response to the user pressing the "back" button on the smart screen 11 remote control, smart screen 11 can end the playback of the example video and display the desktop interface (or main interface) of smart screen 11. Alternatively, smart screen 11 can also display an "End Streaming" confirmation control. In response to the user's confirmation operation of the "End Streaming" confirmation control, smart screen 11 can end the playback of the example video and display the desktop interface (or main interface) of smart screen 11.

[0455] It should be noted that in the above examples, the numbers S101, S302, S502, etc. are only used to identify different steps and should not be interpreted as the order in which different steps are executed. In other words, this application does not restrict the order in which different steps are executed in the above examples. For example, in some examples, S402 can be executed before S403.

[0456] Based on the same inventive concept, such as Figure 22 As shown in the illustration, this application also provides an interface display device 2200. This device 2200 can possess the functions of an electronic device described in the above method embodiments and can be used to execute the steps performed by the functions of the electronic device in the above method embodiments. This function can be implemented in hardware, or in software, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0457] In one possible implementation, the interface display device 2200 may include an acquisition module 2210 and a processing module 2220, which are coupled to each other.

[0458] In some examples, the acquisition module 2210 can be used to support the functions of the electronic device in the foregoing embodiments, such as acquiring voice commands input by the user.

[0459] The processing module 2220 is used to support the electronic device in performing the processing actions in the above method embodiments, such as displaying the source device determined based on historical operation information.

[0460] Optionally, the interface display device 2200 may also include a storage module 2230 for storing the program code and data of the interface display device 2200.

[0461] This application also provides a communication device that can possess the functions of an electronic device described in the above method embodiments, and can be used to execute the steps performed by the functions of the electronic device in the above method embodiments. This function can be implemented in hardware, or in software, or in software executed by hardware. The hardware or software includes one or more modules corresponding to the above functions.

[0462] In one possible implementation, the communication device may include a transceiver module and a processing module, which are coupled to each other.

[0463] In some examples, the transceiver module can be used to support the function of the electronic device sending information in the foregoing embodiments; the processing module can be used to support the processing actions of the electronic device in determining the source device and / or the target device. Optionally, the communication device may also include a storage module for storing the program code and data of the communication device.

[0464] Figure 23 An electronic device 2300 provided in this application embodiment is shown in the figure. The electronic device 2300 includes at least one processor 2310 and a transceiver 2320. The processor 2310 is coupled to a memory and is used to execute instructions stored in the memory to control the transceiver 2320 to transmit and / or receive signals.

[0465] Optionally, the electronic device 2300 also includes a memory 2330 for storing instructions.

[0466] In some embodiments, the processor 2310 and the memory 2330 can be combined into a single processing device, with the processor 2310 executing program code stored in the memory 2330 to achieve the aforementioned functions. In specific implementations, the memory 2330 can be integrated into the processor 2310 or independent of the processor 2310.

[0467] In some embodiments, transceiver 2320 may include a receiver and a transmitter.

[0468] The transceiver 2320 may further include an antenna, and the number of antennas may be one or more. The transceiver 2320 may be a communication interface or an interface circuit.

[0469] When the electronic device 2300 is a chip, the chip includes a transceiver module and a processing module. The transceiver module can be an input / output circuit or a communication interface; the processing module can be a processor, microprocessor, or integrated circuit integrated on the chip.

[0470] This embodiment also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the interface display method or communication method in the above embodiment.

[0471] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned related steps to implement the interface display method or communication method in the above embodiment.

[0472] Furthermore, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory. The memory stores computer-executable instructions. When the apparatus is running, the processor can execute the computer-executable instructions stored in the memory to cause the chip to perform the interface display method or communication method in the above-described method embodiments.

[0473] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0474] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0475] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0476] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0477] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0478] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0479] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for displaying an interface, characterized in that, Applied to a first electronic device, the method includes: Receive user input, the input being used to indicate first content; Send first information to the second electronic device, the first information being used to obtain the first content; Receive the first content sent by the second electronic device; Display an interface that includes the first content.

2. The method according to claim 1, characterized in that, Before sending the first information to the second electronic device, the method further includes: Read historical operation information, which is used to indicate the source device that provides the first content, and the source device includes the second electronic device.

3. The method according to claim 2, characterized in that, The source device includes a third electronic device and a second electronic device, wherein the second electronic device displays the first content later than the third electronic device displays the first content, and / or the device performance of the second electronic device is superior to that of the third electronic device, and / or the device state of the second electronic device is superior to that of the third electronic device.

4. The method according to claim 2 or 3, characterized in that, The historical operation information includes: the path through which the first content was displayed by the source device, and / or the historical time when the first content was displayed by the source device.

5. The method according to claim 4, characterized in that, The path includes the user's operation path for viewing the first content and / or the code path for the source device to display the first content.

6. The method according to claim 4 or 5, characterized in that, The path includes a first path and a second path, and the first information is used to obtain the first content through the first path; Wherein, the first path corresponds to the second electronic device included in the source device, the second path corresponds to the third electronic device included in the source device, the device performance of the second electronic device is superior to that of the third electronic device, and / or, the device state of the second electronic device is superior to that of the third electronic device; and / or, The time when the first content is displayed via the first path is later than the time when the first content is displayed via the second path.

7. The method according to any one of claims 4 to 6, characterized in that, The path includes a first path and a second path. Before sending the first information to the second electronic device, the method further includes: Display a path selection interface, which includes the first path and the second path; and / or, Play path selection voice, which includes voice for indicating the first path and voice for indicating the second path; Sending the first information to the second electronic device includes: In response to the operation of selecting the first path, the first information is sent to the second electronic device, the first information being used to obtain the first content through the first path.

8. The method according to any one of claims 2 to 7, characterized in that, The historical operation information includes first reference information, which corresponds to the first content, and the first reference information is determined according to a machine learning method.

9. The method according to any one of claims 1 to 8, characterized in that, The first content includes one or more of the following: an application, the application's interface, a portion of the application's interface, or multimedia resources.

10. A communication method, characterized in that, Applied to a fourth electronic device, the method includes: Receive user input, the input being used to indicate first content; Read historical operation information, which is used to instruct a second electronic device to provide the first content; Send a first instruction message to the second electronic device, the first instruction message being used to indicate the first content; and / or send a second instruction message to the first electronic device, the second instruction message being used to indicate the first content.

11. The method according to claim 10, characterized in that, The historical operation information includes: the path through which the first content is displayed via the second electronic device, and / or the historical time through which the first content is displayed via the second electronic device.

12. The method according to claim 10 or 11, characterized in that, The historical operation information includes first reference information, which corresponds to the first content, and the first reference information is determined according to a machine learning method.

13. The method according to any one of claims 10 to 12, characterized in that, The first content includes one or more of the following: an application, the application's interface, a portion of the application's interface, or multimedia resources.

14. A communication method, characterized in that, Applied to a second electronic device, the method includes: Based on the operation performed on the second electronic device, a first reference information and a path for displaying the first content are determined, wherein the first reference information corresponds to the first content; Historical operation information is sent to one or more of a first electronic device, a fourth electronic device, or a cloud-side device, the historical operation information including the first reference information and the path.

15. The method according to claim 14, characterized in that, The path includes the user's operation path for viewing the first content and / or the code path for the second electronic device to display the first content.

16. The method according to claim 14 or 15, characterized in that, The method further includes: Receive first information sent by the first electronic device, the first information being used to acquire the first content; The path is determined based on the first reference information; Send the first content, determined according to the path, to the first electronic device.

17. An electronic device, characterized in that, It includes a processor and a memory, the memory being used to store program instructions, and the processor being used to invoke the program instructions to perform the method of any one of claims 1 to 9, 10 to 13, or 14 to 16.

18. A computer-readable storage medium, characterized in that, It contains a computer program that, when executed by a computer, enables the implementation of the method according to any one of claims 1 to 9, 10 to 13, or 14 to 16.

19. A chip, characterized in that, The device includes a processor and a memory, the processor being configured to read instructions stored in the memory, and when the processor executes the instructions, causing the chip to implement the method of any one of claims 1 to 9, 10 to 13, or 14 to 16.

Images