A distributed display method of interface, electronic equipment and communication system
By detecting a touch operation with the second electronic device on the first electronic device and sending the content of the first functional area for display, the problem of the inability to realize distributed collaborative display of different contents on different devices in the prior art is solved, and the user experience and operation convenience are improved.
Patent Information
- Application Number
- CN202011149035.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-09-29
- Filing Date
- 2020-10-23
- Publication Date
- 2025-03-04
- Estimated Expiration
- 2040-10-23
AI Technical Summary
The prior art cannot realize distributed collaborative display and collaborative operation of different contents on different devices on interfaces, which limits user experience and operation convenience.
By detecting a touch operation with the second electronic device on the first electronic device, the content of the first functional area is responsively sent to the second electronic device for display, thereby realizing distributed collaborative display of multiple functional areas.
It realizes distributed collaborative display of different contents on the same interface, improving user convenience and experience, and making it easier for users to handle different tasks through multiple electronic devices.
Smart Images

Figure CN114327324B_ABST
Abstract
Description
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on September 29, 2020, with application number 202011050573.7, and invention name “A distributed display method, electronic device and communication system for an interface”, and the Chinese patent application filed with the State Intellectual Property Office on September 29, 2020, with application number 202011053974.8, and invention name “A multi-task collaborative display method, electronic device and communication system”, the entire contents of which are incorporated by reference in this application. Technical Field
[0002] The embodiments of the present application relate to the field of electronic technology, and in particular to a distributed display method of an interface, an electronic device, and a communication system. Background Art
[0003] With the development of terminal technology, multi-device display has brought more and more convenience to people's lives. Multi-device display refers to the interface display achieved through multiple electronic device displays.
[0004] Typically, multi-device display may include mirroring display, transferring display, or extending display. Figure 1 As shown in (a) in FIG, mirroring display means mirroring the interface a displayed on device A to device B, where the same interface is displayed on the display screens of device B and device A. Figure 1 As shown in (b) in FIG. 1 , transfer display refers to transferring interface a displayed on device A to device B for display. Extended display refers to displaying an interface on the display screens of device B and device A together. For example, Figure 1 As shown in (c) in the figure, interface a is split into interface a1 and interface a2 from a geometric perspective, and interface a1 and interface a2 are displayed on the display screen of device A and the display screen of device B respectively.
[0005] However, the mirror display and transfer display in the above conventional technologies cannot realize the distributed collaborative display of different contents on the interface on different devices. The above extended display can realize the splicing display of the same interface on multiple devices, but it still cannot realize the distributed collaborative display and collaborative operation of different contents on the same interface on different devices. In some scenarios, the distributed display and collaborative operation of interface content are very important for improving user experience. Summary of the invention
[0006] The present application provides a distributed display method of an interface and an electronic device, which can realize distributed collaborative display of different contents on the same interface, improve user convenience, and improve user experience.
[0007] In order to achieve the above purpose, the embodiment of the present application adopts the following technical solution:
[0008] In a first aspect, a distributed display method of an interface is provided, the method comprising: a first electronic device displays a first interface of a first application including at least a first function area and a second function area; the first electronic device detects a touch operation with a second electronic device; in response to the detected touch operation, the first electronic device sends the content of the first function area to the second electronic device for display; the first electronic device displays a second interface of the first application, the second interface including the second function area but not the first function area.
[0009] In the solution provided in the first aspect above, the first electronic device can display the contents of multiple function areas (such as the first function area and the second function area) in a distributed and collaborative manner on the first electronic device and other electronic devices (such as the second electronic device). Specifically, when the first electronic device displays the contents of the first function area and the contents of the second function area, the first electronic device can send the contents of one of the function areas (such as the first function area) to the second electronic device for display. Through this solution, it is convenient for users to process different tasks through multiple electronic devices, which is convenient for user operation.
[0010] In a possible implementation, after the first electronic device sends the content of the first functional area to the second electronic device for display, the method further includes: the first electronic device reallocates the display layout of the remaining functional areas on the first electronic device. The present application supports flexible adjustment of the display layout of multiple functional areas.
[0011] In a possible implementation, the first function area is determined by the first electronic device according to the user's selection operation on the function area; or, the first function area is determined by the first electronic device according to the function implemented by the function area on the first interface. This application supports sending the content of a function area to other electronic devices for display according to the actual selection of the user, or sending the content of a function area to other electronic devices for display according to the specific functions implemented by different function areas.
[0012] In a possible implementation, the first function area is determined by the first electronic device according to the user's selection operation on the content of the function area; or, the first function area is determined by the first electronic device according to the task attribute of the content of the function area on the first interface. This application supports sending the content of a function area to other electronic devices for display according to the actual selection of the user, or sending the content of a function area to other electronic devices for display according to the specific task attributes of the content of different function areas.
[0013] In a possible implementation, the first function area and the second function area on the first interface are arranged on the first electronic device in a preset relative position relationship.
[0014] In a possible implementation, the first functional area and the second functional area support adjustment of adaptability; the adaptability includes: stretching capability, scaling capability, hiding capability, line-folding capability, equal-division capability, proportion capability and extension capability. In the present application, each first functional area can accept flexible adjustment of adaptability, including stretching capability, scaling capability, hiding capability, line-folding capability, equal-division capability, proportion capability and extension capability.
[0015] In a possible implementation, the method further includes: the first electronic device, in response to the user triggering the operation of retracting the collaborative display, retracts the content of the first functional area from the second electronic device; after the first electronic device retracts the content of the first functional area from the second electronic device, the first electronic device displays the first interface of the first application, and the first interface includes at least the first functional area and the second functional area. In this application, the main device (i.e., the first device) can retract the content of the functional area sent to the secondary device (i.e., the second device) at any time.
[0016] In a possible implementation, the content of the first functional area and the content of the second functional area on the first interface are jointly rendered on the virtual screen of the first electronic device by the first electronic device in the form of one or more atomic services according to a preset framework template. In the present application, since the content of multiple functional areas is jointly rendered in the form of one or more atomic services according to a preset framework template, it is acceptable to split the content at the granularity of the functional area.
[0017] In a possible implementation, the first electronic device sends the content of the first functional area to the second electronic device for display, including: the first electronic device sends the standard video stream corresponding to the content of the first functional area on the virtual screen to the second electronic device for display.
[0018] In a second aspect, a first electronic device is provided, which includes: a memory for storing computer program code, wherein the computer program code includes instructions; a radio frequency circuit for sending and receiving wireless signals; a processor for executing the instructions so that the first electronic device displays a first interface of a first application including at least a first function area and a second function area; and when a touch operation with a second electronic device is detected, in response to the detected touch operation, the content of the first function area is sent to the second electronic device for display; wherein, after the first electronic device sends the content of the first function area to the second electronic device for display via the radio frequency circuit, the first electronic device displays a second interface of the first application, and the second interface includes the second function area but does not include the first function area.
[0019] According to the solution provided in the second aspect, the first electronic device can display the contents of multiple functional areas (such as the first functional area and the second functional area) in a distributed and collaborative manner on the first electronic device and other electronic devices (such as the second electronic device). Specifically, when the first electronic device displays the contents of the first functional area and the contents of the second functional area, the first electronic device can send the contents of one of the functional areas (such as the first functional area) to the second electronic device for display via a radio frequency circuit. This solution can facilitate users to process different tasks through multiple electronic devices, making user operations more convenient.
[0020] In a possible implementation, the processor is further configured to execute the instruction so that the radio frequency circuit of the first electronic device reallocates the display layout of the remaining functional areas on the first electronic device after sending the content of the first functional area to the second electronic device for display via the radio frequency circuit. The present application supports flexible adjustment of the display layout of multiple functional areas.
[0021] In a possible implementation, the first function area is determined by the processor executing the instructions according to the user's selection operation on the function area; or, it is determined by itself according to the function implemented by the function area on the first interface. This application supports sending the content of a function area to other electronic devices for display according to the actual selection of the user, or sending the content of a function area to other electronic devices for display according to the specific functions implemented by different function areas.
[0022] In a possible implementation, the first function area is determined by the processor executing the instructions according to the user's selection operation on the content of the function area; or, it is determined according to the task attribute of the content of the function area on the first interface. This application supports sending the content of a function area to other electronic devices for display according to the actual selection of the user, or sending the content of a function area to other electronic devices for display according to the specific task attributes of the content of different function areas.
[0023] In a possible implementation, the first function area and the second function area on the first interface are arranged on the first electronic device in a preset relative position relationship.
[0024] In a possible implementation, the first functional area and the second functional area support adjustment of adaptability; the adaptability includes: stretching capability, scaling capability, hiding capability, line-folding capability, equal-division capability, proportion capability and extension capability. In the present application, each first functional area can accept flexible adjustment of adaptability, including stretching capability, scaling capability, hiding capability, line-folding capability, equal-division capability, proportion capability and extension capability.
[0025] In a possible implementation, the processor is further configured to execute the instruction, and in response to the user triggering the operation of retracting the collaborative display, retract the content of the first functional area from the second electronic device; after the first electronic device retracts the content of the first functional area from the second electronic device, the first electronic device displays the first interface of the first application, and the first interface includes at least the first functional area and the second functional area. In this application, the primary device (i.e., the first device) can retract the content of the functional area sent to the secondary device (i.e., the second device) at any time.
[0026] In a possible implementation, the contents of the first functional area and the contents of the second functional area on the first interface are jointly rendered on the virtual screen of the first electronic device in the form of one or more atomic services according to a preset framework template by the processor executing the instructions. In the present application, since the contents of multiple functional areas are jointly rendered in the form of one or more atomic services according to a preset framework template, it is acceptable to split the content at the granularity of the functional area.
[0027] In a possible implementation, the processor is specifically used to execute the instruction so that the first electronic device sends the standard video stream corresponding to the content of the first functional area on the virtual screen to the second electronic device through the radio frequency circuit for display.
[0028] According to a third aspect, a first electronic device is provided, comprising: a display unit for displaying a first interface of a first application including at least a first function area and a second function area; a transceiver unit and a processing unit, wherein the processing unit is used to send the content of the first function area to the second electronic device for display in response to the detected touch operation when a touch operation with the second electronic device is detected; wherein, after the first electronic device sends the content of the first function area to the second electronic device for display via the transceiver unit, the first electronic device displays the second interface of the first application, and the second interface includes the second function area but does not include the first function area.
[0029] In the solution provided in the third aspect above, the first electronic device can display the contents of multiple function areas (such as the first function area and the second function area) in a distributed and collaborative manner on the first electronic device and other electronic devices (such as the second electronic device). Specifically, when the first electronic device displays the contents of the first function area and the contents of the second function area, the first electronic device can send the contents of one of the function areas (such as the first function area) to the second electronic device for display. Through this solution, it is convenient for users to process different tasks through multiple electronic devices, which is convenient for user operations.
[0030] In a possible implementation, the processing unit is further configured to reallocate the display layout of the remaining functional areas on the first electronic device after the content of the first functional area is sent to the second electronic device for display via the transceiver unit. The present application supports flexible adjustment of the display layout of multiple functional areas.
[0031] In a possible implementation, the first function area is determined by the processing unit according to the user's selection operation on the function area; or, it is determined by the processing unit according to the function implemented by the function area on the first interface. This application supports sending the content of a function area to other electronic devices for display according to the actual selection of the user, or sending the content of a function area to other electronic devices for display according to the specific functions implemented by different function areas.
[0032] In a possible implementation, the first function area is determined by the processing unit according to the user's selection operation on the content of the function area; or, it is determined by itself according to the task attribute of the content of the function area on the first interface. This application supports sending the content of a function area to other electronic devices for display according to the actual selection of the user, or sending the content of a function area to other electronic devices for display according to the specific task attributes of the content of different function areas.
[0033] In a possible implementation, the first function area and the second function area on the first interface are arranged on the first electronic device in a preset relative position relationship.
[0034] In a possible implementation, the first functional area and the second functional area support adjustment of adaptability; the adaptability includes: stretching capability, scaling capability, hiding capability, line-folding capability, equal-division capability, proportion capability and extension capability. In the present application, each first functional area can accept flexible adjustment of adaptability, including stretching capability, scaling capability, hiding capability, line-folding capability, equal-division capability, proportion capability and extension capability.
[0035] In a possible implementation, the processing unit is further used to, in response to a user triggering an operation to retract the collaborative display, retract the content of the first functional area from the second electronic device; after the first electronic device retracts the content of the first functional area from the second electronic device, the first electronic device displays a first interface of the first application, the first interface including at least the first functional area and the second functional area. In this application, the primary device (i.e., the first device) can retract the content of the functional area sent to the secondary device (i.e., the second device) at any time.
[0036] In a possible implementation, the content of the first functional area and the content of the second functional area on the first interface are jointly rendered on the virtual screen of the first electronic device by the processing unit in the form of one or more atomic services according to a preset framework template. In the present application, since the content of multiple functional areas is jointly rendered in the form of one or more atomic services according to a preset framework template, it is acceptable to split the content at the granularity of the functional area.
[0037] In a possible implementation, the processing unit is specifically configured to send the standard video stream corresponding to the content of the first functional area on the virtual screen to the second electronic device through the transceiver unit for display.
[0038] In a fourth aspect, a distributed display method of an interface is provided, the method comprising: a first electronic device displays a first interface including at least a first application interface, a second application interface and a third application interface; the first electronic device detects a touch operation with a second electronic device; in response to detecting the touch operation, the first electronic device sends the content of the first application interface to the second electronic device for display; the first electronic device displays a second interface, the second interface including the second application interface and the third application interface and not including the first application interface.
[0039] In the solution provided in the fourth aspect above, the first electronic device can display the contents of multiple application interfaces (such as the first application interface, the second application interface, and the third application interface) in a distributed and collaborative manner on the first electronic device and other electronic devices (such as the second electronic device). Specifically, when the first electronic device displays the first application interface, the second application interface, and the third application interface, the first electronic device can send the contents of one of the application interfaces (such as the first application interface) to the second electronic device for display. Through this solution, it is convenient for users to process different tasks through multiple electronic devices, which is convenient for user operations.
[0040] In one possible implementation, after the first electronic device sends the content of the first application interface to the second electronic device for display, the method further includes: the first electronic device reallocates the display layout of the remaining application interfaces on the first electronic device. The present application supports flexible adjustment of the display layout of multiple application interfaces.
[0041] In a possible implementation, the first application interface is determined by the first electronic device according to the user's selection operation on the application interface; or, the first application interface is determined by the first electronic device according to the functions implemented by the first application interface, the second application interface and the third application interface. This application supports sending a certain application interface to other electronic devices for display according to the actual selection of the user, or sending a certain application interface to other electronic devices for display according to the specific functions implemented by different application interfaces.
[0042] In one possible implementation, the windows of the first application interface, the second application interface and the third application interface support adjustment of adaptability; the adaptability includes: stretching capability, scaling capability, hiding capability, line breaking capability, equal division capability, proportion capability and extension capability.
[0043] In a possible implementation, the method further includes: the first electronic device retracts the first application interface from the second electronic device in response to the user triggering the operation of retracting the collaborative display; after the first electronic device retracts the first application interface from the second electronic device, the first electronic device displays the first interface, and the first interface includes at least the first application interface, the second application interface, and the third application interface. In this application, the main device (i.e., the first device) can retract the application interface sent to the secondary device (i.e., the second device) at any time.
[0044] In a fifth aspect, a first electronic device is provided, comprising: a memory for storing a computer program code, wherein the computer program code comprises instructions; a radio frequency circuit for sending and receiving wireless signals; a processor for executing the instructions so that the first electronic device displays a first interface comprising at least a first application interface, a second application interface and a third application interface; and, when a touch operation with a second electronic device is detected, in response to detecting the touch operation, sending the content of the first application interface to the second electronic device for display; wherein, after the first electronic device sends the content of the first application interface to the second electronic device for display, the first electronic device displays a second interface, wherein the second interface comprises the second application interface and the third application interface and does not include the first application interface.
[0045] In the scheme provided in the fifth aspect above, the first electronic device can display the contents of multiple application interfaces (such as the first application interface, the second application interface, and the third application interface) in a distributed and collaborative manner on the first electronic device and other electronic devices (such as the second electronic device). Specifically, when the first electronic device displays the first application interface, the second application interface, and the third application interface, the first electronic device can send the contents of one of the application interfaces (such as the first application interface) to the second electronic device for display. Through this scheme, it is convenient for users to process different tasks through multiple electronic devices, which is convenient for user operations.
[0046] In one possible implementation, the processor is further configured to execute the instruction so that the first electronic device reallocates the display layout of the remaining application interfaces on the first electronic device after sending the content of the first application interface to the second electronic device for display. The present application supports flexible adjustment of the display layout of multiple application interfaces.
[0047] In a possible implementation, the first application interface is determined by the processor executing the above instructions according to the user's selection operation on the application interface; or, it is determined by itself according to the functions implemented by the first application interface, the second application interface and the third application interface. This application supports sending a certain application interface to other electronic devices for display according to the actual selection of the user, or sending a certain application interface to other electronic devices for display according to the specific functions implemented by different application interfaces.
[0048] In one possible implementation, the windows of the first application interface, the second application interface and the third application interface support adjustment of adaptability; the adaptability includes: stretching capability, scaling capability, hiding capability, line breaking capability, equal division capability, proportion capability and extension capability.
[0049] In a possible implementation, the processor is further used to execute the instructions, and in response to the user triggering the operation of retracting the collaborative display, the first application interface is retracted from the second electronic device; after the first electronic device retracts the first application interface from the second electronic device, the first electronic device displays the first interface, and the first interface includes at least the first application interface, the second application interface, and the third application interface. In this application, the primary device (i.e., the first device) can retract the application interface sent to the secondary device (i.e., the second device) at any time.
[0050] In a sixth aspect, a first electronic device is provided, comprising: a display unit for displaying a first interface including at least a first application interface, a second application interface and a third application interface; a transceiver unit and a processing unit, wherein the processing unit is configured to, when a touch operation with a second electronic device is detected, send the content of the first application interface to the second electronic device for display via the transceiver unit in response to detecting the touch operation; wherein, after the first electronic device sends the content of the first application interface to the second electronic device for display, the first electronic device displays a second interface, which includes the second application interface and the third application interface and does not include the first application interface.
[0051] In the solution provided in the sixth aspect above, the first electronic device can display the contents of multiple application interfaces (such as the first application interface, the second application interface, and the third application interface) in a distributed and collaborative manner on the first electronic device and other electronic devices (such as the second electronic device). Specifically, when the first electronic device displays the first application interface, the second application interface, and the third application interface, the first electronic device can send the contents of one of the application interfaces (such as the first application interface) to the second electronic device for display. Through this solution, it is convenient for users to process different tasks through multiple electronic devices, which is convenient for user operations.
[0052] In a possible implementation, the processing unit is further configured to reallocate the display layout of the remaining application interfaces on the first electronic device after sending the content of the first application interface to the second electronic device for display. The present application supports flexible adjustment of the display layout of multiple application interfaces.
[0053] In a possible implementation, the first application interface is determined by the processing unit according to the user's selection operation on the application interface; or, it is determined by the processing unit according to the functions implemented by the first application interface, the second application interface and the third application interface. This application supports sending a certain application interface to other electronic devices for display according to the actual selection of the user, or sending a certain application interface to other electronic devices for display according to the specific functions implemented by different application interfaces.
[0054] In one possible implementation, the windows of the first application interface, the second application interface and the third application interface support adjustment of adaptability; the adaptability includes: stretching capability, scaling capability, hiding capability, line breaking capability, equal division capability, proportion capability and extension capability.
[0055] In a possible implementation, the processing unit is further used to, in response to a user triggering an operation to retract the collaborative display, retract the first application interface from the second electronic device; after the first electronic device retracts the first application interface from the second electronic device, the first electronic device displays the first interface, which includes at least the first application interface, the second application interface, and the third application interface. In this application, the primary device (i.e., the first device) can retract the application interface sent to the secondary device (i.e., the second device) at any time.
[0056] In a seventh aspect, a communication system is provided, comprising a first electronic device as in any possible implementation of the second aspect, the third aspect, the fifth aspect or the sixth aspect, and a second electronic device.
[0057] In an eighth aspect, a distributed display method of an interface is provided, the method comprising: a first electronic device displays a first interface, wherein the first interface includes an electronic document list, and the electronic document list includes at least one unread electronic document and at least one read electronic document; the first electronic device detects a touch operation with a second electronic device, and determines that the second electronic device is a slave device of the first electronic device; the first electronic device searches for the most recent unread electronic document among the at least one unread electronic document, and displays the details interface of the most recent unread electronic document on the second electronic device; the first electronic device continues to display the electronic document list, wherein the most recent unread electronic document in the electronic document list is marked as read.
[0058] In the solution provided in the eighth aspect, the first electronic device can display the electronic document list and the detail interface of the unread electronic document (for example, the most recent unread electronic document) in a distributed and coordinated manner on the first electronic device and other electronic devices (for example, the second electronic device). Specifically, when the first electronic device displays the electronic document list, the first electronic device can display the detail interface of the most recent unread electronic document on the second electronic device. Through this solution, it is convenient for users to process different tasks through multiple electronic devices, which is convenient for user operations.
[0059] In a possible implementation, the first electronic device searches for the most recent unread electronic document among at least one unread electronic document, and displays the details interface of the most recent unread electronic document on the second electronic device, including: in response to a touch operation, the first electronic device searches for the most recent unread electronic document among at least one unread electronic document, and sends the details interface of the most recent unread electronic document to the second electronic device for display. In the present application, when displaying the electronic document list, the first electronic device can send the details interface of the most recent unread electronic document to the second electronic device for display in response to receiving a preset operation (such as a touch operation between the second electronic device and the first electronic device), so as to facilitate users to process different tasks through multiple electronic devices and facilitate user operations.
[0060] In a possible implementation, the electronic document list is any one of the following: an email list, a short message list, or a memo list. The solution provided in the present application supports the distributed collaborative display of the list interface and the detail interface of electronic documents such as emails, short messages, or memos on different electronic devices, so that users can process different tasks through multiple electronic devices and facilitate user operations.
[0061] In a possible implementation, the electronic document list is an email list or a short message list; the method further includes: in response to receiving an editing operation of a user on a detail interface of a most recent unread electronic document, the second electronic device sends an input keyboard to the first electronic device for display, and the second electronic device only displays the editing interface of the most recent unread electronic document. In the present application, when the second electronic device displays the editing interface of an electronic document in the electronic document list on the first electronic device in a distributed and collaborative manner, the second electronic device can also display the input keyboard in a distributed and collaborative manner on the first electronic device, so that the user can edit the electronic document through the first electronic device, which is convenient for the user to operate.
[0062] In a possible implementation, the electronic document list is an email list or a short message list; the method further includes: in response to receiving an editing operation of a user on the details interface of a most recent unread electronic document, the second electronic device suspends or superimposes an input keyboard on the editing interface of the most recent unread electronic document; in response to detecting a touch operation with the first electronic device, the second electronic device sends the input keyboard to the first electronic device for display, and the second electronic device only displays the editing interface of the most recent unread electronic document. In the present application, when the second electronic device displays the editing interface of an electronic document in the electronic document list on the first electronic device in a distributed and coordinated manner, the second electronic device can also distribute and coordinately display the suspended or superimposed input keyboard on the first electronic device, so that the user can edit the electronic document through the first electronic device, which is convenient for the user to operate.
[0063] In a possible implementation, the electronic document list is an email list or a short message list; the method further includes: in response to receiving a user's reply operation to a most recent unread electronic document, the second electronic device sends an input keyboard to the first electronic device for display, and the second electronic device only displays the reply interface of the most recent unread electronic document. In the present application, when the second electronic device displays the reply interface of an electronic document in the electronic document list on the first electronic device in a distributed and coordinated manner, the second electronic device can also display the input keyboard in a distributed and coordinated manner on the first electronic device, so that the user can reply to the electronic document through the first electronic device, which is convenient for the user to operate.
[0064] In a possible implementation, the electronic document list is an email list or a short message list; the method further includes: in response to receiving a user's reply operation to a most recent unread electronic document, the second electronic device suspends or superimposes an input keyboard on the reply interface of the most recent unread electronic document; in response to detecting a touch operation with the first electronic device, the second electronic device sends the input keyboard to the first electronic device for display, and the second electronic device only displays the reply interface of the most recent unread electronic document. In the present application, when the second electronic device displays the reply interface of an electronic document in the electronic document list on the first electronic device in a distributed and coordinated manner, the second electronic device can also distribute and coordinately display the suspended or superimposed input keyboard on the first electronic device, so that the user can reply to the electronic document through the first electronic device, which is convenient for the user to operate.
[0065] In a possible implementation, the electronic document list is a memo list; the method further includes: in response to receiving an editing operation of the user on the most recent unprocessed memo note, the second electronic device sends the input keyboard to the first electronic device for display, and the second electronic device only displays the editing interface of the most recent unprocessed memo note. In the present application, when the second electronic device displays the editing interface of an electronic document (such as the most recent unprocessed memo note) in the electronic document list on the first electronic device in a distributed and collaborative manner, the second electronic device can also display the input keyboard displayed in suspension or superimposed manner in a distributed and collaborative manner on the first electronic device, so that the user can process the most recent unprocessed memo note through the first electronic device, which is convenient for the user to operate.
[0066] In one possible implementation, the electronic document list is a memo list; the method further includes: in response to receiving a user's editing operation on the most recent unprocessed memo note, the second electronic device suspends or superimposes an input keyboard on the editing interface of the most recent unprocessed memo note; in response to detecting a touch operation with the first electronic device, the second electronic device sends the input keyboard to the first electronic device for display, and the second electronic device only displays the editing interface of the most recent unprocessed memo note. In the present application, when the second electronic device displays the editing interface of an electronic document (such as the most recent unprocessed memo note) in the electronic document list on the first electronic device in a distributed and collaborative manner, the second electronic device can also distribute and collaboratively display the suspended or superimposed input keyboard on the first electronic device, so that the user can process the electronic document through the first electronic device and the user's operation is convenient.
[0067] In a possible implementation, the first electronic device determines that the second electronic device is a secondary device of the first electronic device, including: the first electronic device determines that the second electronic device is a secondary device of the first electronic device according to the second operation of the user; wherein the second operation is a selection operation of the user on the prompt box; the prompt box is displayed on the display screen of the first electronic device in response to the touch operation of the first electronic device, and the prompt box is used for the user to select the main device and the secondary device. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) to be displayed in a distributed and coordinated manner with the first electronic device according to the user's selection.
[0068] In a possible implementation, the first electronic device determines that the second electronic device is a secondary device of the first electronic device, including: the first electronic device determines that the second electronic device is a secondary device of the first electronic device according to the second operation of the user; wherein the second operation is a selection operation of the user on the prompt box; the prompt box is displayed on the display screen of the first electronic device by the first electronic device in response to the user dragging the draggable icon, the prompt box is used for the user to select the main device and the secondary device, and the draggable icon is displayed on the display screen of the first electronic device by the first electronic device in response to the touch operation. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) to be displayed in a distributed and coordinated manner with the first electronic device according to the user's selection.
[0069] In a possible implementation, the first electronic device determines that the second electronic device is a secondary device of the first electronic device, including: the first electronic device determines that the second electronic device is a secondary device of the first electronic device according to the motion data of the first electronic device; wherein the motion data of the first electronic device indicates that the first electronic device is stationary or the motion acceleration is less than a preset threshold. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) for distributed collaborative display with the first electronic device according to the motion data of the first electronic device.
[0070] In a ninth aspect, a communication system is provided, comprising: a first electronic device, configured to display a first interface, wherein the first interface comprises an electronic document list, wherein the electronic document list comprises at least one unread electronic document and at least one read electronic document; the first electronic device detects a touch operation with a second electronic device, and determines that the second electronic device is a slave device of the first electronic device; the first electronic device searches for a most recent unread electronic document among the at least one unread electronic document, and displays a detail interface of the most recent unread electronic document on the second electronic device; a second electronic device, configured to display a detail interface of the most recent unread electronic document from the first electronic device; wherein, after the first electronic device sends the detail interface of the most recent unread electronic document to the second electronic device, the first electronic device continues to display the electronic document list, wherein the most recent unread electronic document in the electronic document list is marked as read.
[0071] In the method provided in the ninth aspect, the first electronic device can display the electronic document list and the details interface of the unread electronic document (for example, the most recent unread electronic document) in a distributed and collaborative manner on the first electronic device and other electronic devices (for example, the second electronic device). Specifically, when the first electronic device displays the electronic document list, the first electronic device can display the details interface of the most recent unread electronic document on the second electronic device. Through this solution, it is convenient for users to process different tasks through multiple electronic devices, which is convenient for user operations.
[0072] In a possible implementation, the first electronic device is specifically used to, in response to a touch operation, search for the most recent unread electronic document among at least one unread electronic document, and send the details interface of the most recent unread electronic document to the second electronic device for display. In the present application, when displaying the electronic document list, the first electronic device can, in response to receiving a preset operation (such as a touch operation between the second electronic device and the first electronic device), send the details interface of the most recent unread electronic document to the second electronic device for display, so that the user can process different tasks through multiple electronic devices and facilitate user operations.
[0073] In a possible implementation, the electronic document list is any one of the following: an email list, a short message list, or a memo list. The solution provided in the present application supports the distributed collaborative display of the list interface and the detail interface of electronic documents such as emails, short messages, or memos on different electronic devices, so that users can process different tasks through multiple electronic devices and facilitate user operations.
[0074] In a possible implementation, the electronic document list is an email list or a short message list; the second electronic device is also used to send an input keyboard to the first electronic device for display in response to receiving an editing operation of a user on the details interface of a most recent unread electronic document; wherein, after the second electronic device sends the input keyboard to the first electronic device for display, the first electronic device displays the input keyboard, and the second electronic device only displays the editing interface of the most recent unread electronic document. In the present application, when the second electronic device displays the editing interface of an electronic document in the electronic document list on the first electronic device in a distributed and collaborative manner, the second electronic device can also display the input keyboard in a distributed and collaborative manner on the first electronic device, so that the user can edit the electronic document through the first electronic device, which is convenient for the user to operate.
[0075] In a possible implementation, the electronic document list is an email list or a short message list; the second electronic device is also used to, in response to receiving an editing operation of a user on the details interface of a most recent unread electronic document, suspend or superimpose an input keyboard on the editing interface of the most recent unread electronic document; in response to detecting a touch operation with the first electronic device, send the input keyboard to the first electronic device for display; wherein, after the second electronic device sends the input keyboard to the first electronic device for display, the first electronic device displays the input keyboard, and the second electronic device only displays the editing interface of the most recent unread electronic document. In the present application, when the second electronic device displays the editing interface of an electronic document in the electronic document list on the first electronic device in a distributed and cooperative manner, the second electronic device can also display the suspended or superimposed input keyboard in a distributed and cooperative manner on the first electronic device, so that the user can edit the electronic document through the first electronic device, which is convenient for the user to operate.
[0076] In a possible implementation, the electronic document list is an email list or a short message list; the second electronic device is also used to send an input keyboard to the first electronic device for display in response to receiving a user's reply operation to the most recent unread electronic document; wherein, after the second electronic device sends the input keyboard to the first electronic device for display, the first electronic device displays the input keyboard, and the second electronic device only displays the reply interface of the most recent unread electronic document. In the present application, when the second electronic device displays the reply interface of an electronic document in the electronic document list on the first electronic device in a distributed and coordinated manner, the second electronic device can also display the input keyboard in a distributed and coordinated manner on the first electronic device, so that the user can reply to the electronic document through the first electronic device, which is convenient for the user to operate.
[0077] In a possible implementation, the electronic document list is an email list or a short message list; the second electronic device is also used to, in response to receiving a user's reply operation to the most recent unread electronic document, suspend or superimpose an input keyboard on the reply interface of the most recent unread electronic document; in response to detecting a touch operation with the first electronic device, send the input keyboard to the first electronic device for display; wherein, after the second electronic device sends the input keyboard to the first electronic device for display, the first electronic device displays the input keyboard, and the second electronic device only displays the reply interface of the most recent unread electronic document. In the present application, when the second electronic device displays the reply interface of an electronic document in the electronic document list on the first electronic device in a distributed and coordinated manner, the second electronic device can also distribute and coordinately display the suspended or superimposed input keyboard on the first electronic device, so that the user can reply to the electronic document through the first electronic device, which is convenient for the user to operate.
[0078] In one possible implementation, the electronic document list is a memo list; the second electronic device is also used to send an input keyboard to the first electronic device for display in response to receiving an editing operation of the user on the most recent unprocessed memo note; wherein, after the second electronic device sends the input keyboard to the first electronic device for display, the first electronic device displays the input keyboard, and the second electronic device only displays the editing interface of the most recent unprocessed memo note. In the present application, when the second electronic device displays the editing interface of an electronic document (such as the most recent unprocessed memo note) in the electronic document list on the first electronic device in a distributed and collaborative manner, the second electronic device can also display the input keyboard displayed in a suspended or superimposed manner in a distributed and collaborative manner on the first electronic device, so that the user can process the most recent unprocessed memo note through the first electronic device, thereby facilitating user operation.
[0079] In one possible implementation, the electronic document list is a memo list; the second electronic device is also used to, in response to receiving a user's editing operation on the most recent unprocessed memo note, suspend or superimpose an input keyboard on the editing interface of the most recent unprocessed memo note; in response to detecting a touch operation with the first electronic device, send the input keyboard to the first electronic device for display; wherein, after the second electronic device sends the input keyboard to the first electronic device for display, the first electronic device displays the input keyboard, and the second electronic device only displays the editing interface of the most recent unprocessed memo note. In the present application, when the second electronic device displays the editing interface of an electronic document (such as the most recent unprocessed memo note) in the electronic document list on the first electronic device in a distributed and collaborative manner, the second electronic device can also display the suspended or superimposed input keyboard in a distributed and collaborative manner on the first electronic device, so that the user can process the electronic document through the first electronic device and the user's operation is convenient.
[0080] In a possible implementation, the first electronic device determines that the second electronic device is a secondary device of the first electronic device, including: the first electronic device determines that the second electronic device is a secondary device of the first electronic device according to the second operation of the user; wherein the second operation is a selection operation of the user on the prompt box; the prompt box is displayed on the display screen of the first electronic device in response to the touch operation of the first electronic device, and the prompt box is used for the user to select the main device and the secondary device. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) that is displayed in a distributed and coordinated manner with the first electronic device according to the user's selection.
[0081] In a possible implementation, the first electronic device determines that the second electronic device is a secondary device of the first electronic device, including: the first electronic device determines that the second electronic device is a secondary device of the first electronic device according to the second operation of the user; wherein the second operation is a selection operation of the user on the prompt box; the prompt box is displayed on the display screen of the first electronic device by the first electronic device in response to the user dragging the draggable icon, the prompt box is used for the user to select the main device and the secondary device, and the draggable icon is displayed on the display screen of the first electronic device in response to the touch operation of the first electronic device. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) that is displayed in a distributed and coordinated manner with the first electronic device according to the user's selection.
[0082] In a possible implementation, the first electronic device determines that the second electronic device is a secondary device of the first electronic device, including: the first electronic device determines that the second electronic device is a secondary device of the first electronic device according to the motion data of the first electronic device; wherein the motion data of the first electronic device indicates that the first electronic device is stationary or the motion acceleration is less than a preset threshold. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) for distributed collaborative display with the first electronic device according to the motion data of the first electronic device.
[0083] In a tenth aspect, a first electronic device is provided, comprising: a memory for storing a computer program code, the computer program code comprising instructions; a radio frequency circuit for sending and receiving wireless signals; a processor for executing the instructions so that the first electronic device displays a first interface, wherein the first interface comprises an electronic document list, the electronic document list comprises at least one unread electronic document and at least one read electronic document; and detecting a touch operation with a second electronic device, determining that the second electronic device is a slave device of the first electronic device; and searching for the most recent unread electronic document among the at least one unread electronic document, and displaying a details interface of the most recent unread electronic document on the second electronic device; wherein, after displaying the details interface of the most recent unread electronic document on the second electronic device, the first electronic device continues to display the electronic document list, wherein the most recent unread electronic document in the electronic document list is marked as read.
[0084] In the solution provided in the tenth aspect, the first electronic device can display the electronic document list and the details interface of the unread electronic document (for example, the most recent unread electronic document) in a distributed and coordinated manner on the first electronic device and other electronic devices (for example, the second electronic device). Specifically, when the first electronic device displays the electronic document list, the first electronic device can display the details interface of the most recent unread electronic document on the second electronic device. Through this solution, it is convenient for users to process different tasks through multiple electronic devices, which is convenient for user operations.
[0085] In a possible implementation, the processor is specifically used to execute the instructions so that the first electronic device searches for the most recent unread electronic document among at least one unread electronic document in response to a touch operation, and sends the details interface of the most recent unread electronic document to the second electronic device for display through a radio frequency circuit. In the present application, when displaying a list of electronic documents, the first electronic device can send the details interface of the most recent unread electronic document to the second electronic device for display in response to receiving a preset operation (such as a touch operation between the second electronic device and the first electronic device), so that the user can process different tasks through multiple electronic devices and facilitate user operations.
[0086] In a possible implementation, the electronic document list is any one of the following: an email list, a short message list, or a memo list. The solution provided in the present application supports the distributed collaborative display of the list interface and the detail interface of electronic documents such as emails, short messages, or memos on different electronic devices, so that users can process different tasks through multiple electronic devices and facilitate user operations.
[0087] In a possible implementation, the processor is specifically used to execute the instructions so that the first electronic device determines the second electronic device as a secondary device of the first electronic device according to the second operation of the user; wherein the second operation is a selection operation of the user on the prompt box; the prompt box is displayed on the display screen of the first electronic device in response to the touch operation of the first electronic device, and the prompt box is used for the user to select the main device and the secondary device. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) that is displayed in a distributed and coordinated manner with the first electronic device according to the user's selection.
[0088] In a possible implementation, the processor is specifically used to execute the instructions so that the first electronic device determines that the second electronic device is a secondary device of the first electronic device according to the second operation of the user; wherein the second operation is a selection operation of the user on the prompt box; the prompt box is displayed on the display screen of the first electronic device by the first electronic device in response to the user dragging the draggable icon, the prompt box is used by the user to select the main device and the secondary device, and the draggable icon is displayed on the display screen of the first electronic device in response to the touch operation of the first electronic device. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) to be displayed in a distributed and coordinated manner with the first electronic device according to the user's selection.
[0089] In a possible implementation, the processor is specifically used to execute the instructions so that the first electronic device determines that the second electronic device is a secondary device of the first electronic device according to the motion data of the first electronic device; wherein the motion data of the first electronic device indicates that the first electronic device is stationary or the motion acceleration is less than a preset threshold. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) for distributed collaborative display with the first electronic device according to the motion data of the first electronic device.
[0090] In an eleventh aspect, a first electronic device is provided, comprising: a display screen for displaying a first interface, wherein the first interface includes an electronic document list, and the electronic document list includes at least one unread electronic document and at least one read electronic document; a processing unit, for detecting a touch operation with a second electronic device on the first electronic device, determining that the second electronic device is a slave device of the first electronic device; and searching for a most recent unread electronic document among the at least one unread electronic document, and displaying a detail interface of the most recent unread electronic document on the second electronic device; wherein, after displaying the detail interface of the most recent unread electronic document on the second electronic device, the first electronic device continues to display the electronic document list, wherein the most recent unread electronic document in the electronic document list is marked as read.
[0091] In the solution provided in the eleventh aspect above, the first electronic device can display the electronic document list and the detail interface of the unread electronic document (for example, the most recent unread electronic document) in a distributed and coordinated manner on the first electronic device and other electronic devices (for example, the second electronic device). Specifically, when the first electronic device displays the electronic document list, the first electronic device can display the detail interface of the most recent unread electronic document on the second electronic device. Through this solution, it is convenient for users to process different tasks through multiple electronic devices, which is convenient for user operations.
[0092] In a possible implementation, the first electronic device further includes: a transceiver unit; the processing unit is specifically used to enable the first electronic device to search for the most recent unread electronic document among at least one unread electronic document in response to a touch operation, and to send the details interface of the most recent unread electronic document to the second electronic device for display through the transceiver unit. In the present application, when displaying the electronic document list, the first electronic device can send the details interface of the most recent unread electronic document to the second electronic device for display in response to receiving a preset operation (such as a touch operation between the second electronic device and the first electronic device), so as to facilitate the user to process different tasks through multiple electronic devices and facilitate user operation.
[0093] In a possible implementation, the electronic document list is any one of the following: an email list, a short message list, or a memo list. The solution provided in the present application supports the distributed collaborative display of the list interface and the detail interface of electronic documents such as emails, short messages, or memos on different electronic devices, so that users can process different tasks through multiple electronic devices and facilitate user operations.
[0094] In a possible implementation, the processing unit is specifically used to enable the first electronic device to determine that the second electronic device is a secondary device of the first electronic device according to the second operation of the user; wherein the second operation is a selection operation of the user on the prompt box; the prompt box is displayed on the display screen of the first electronic device in response to the touch operation of the first electronic device, and the prompt box is used by the user to select the main device and the secondary device. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) that is displayed in a distributed and coordinated manner with the first electronic device according to the user's selection.
[0095] In a possible implementation, the processing unit is specifically used to enable the first electronic device to determine that the second electronic device is a secondary device of the first electronic device according to the second operation of the user; wherein the second operation is a selection operation of the user on the prompt box; the prompt box is displayed on the display screen of the first electronic device by the first electronic device in response to the user dragging the draggable icon, the prompt box is used by the user to select the main device and the secondary device, and the draggable icon is displayed on the display screen of the first electronic device in response to the touch operation of the first electronic device. In the present application, the first electronic device can determine the second electronic device (i.e., the secondary device) that is displayed in a distributed and coordinated manner with the first electronic device according to the user's selection.
[0096] In a possible implementation, the processing unit is specifically used to enable the first electronic device to determine that the second electronic device is a secondary device of the first electronic device based on the motion data of the first electronic device; wherein the motion data of the first electronic device indicates that the first electronic device is stationary or the motion acceleration is less than a preset threshold. In this application, the first electronic device can determine the second electronic device (i.e., the secondary device) for distributed collaborative display with the first electronic device based on the motion data of the first electronic device.
[0097] In a twelfth aspect, a computer-readable storage medium is provided, on which computer-readable storage medium is stored computer-executable instructions, which, when executed by a processor, implement a method in any possible implementation manner of the first aspect, the fourth aspect, or the eighth aspect.
[0098] In a thirteenth aspect, a chip system is provided, the chip system includes a processor and a memory, wherein instructions are stored in the memory; when the instructions are executed by the processor, the method in any possible implementation of the first aspect, the fourth aspect, or the eighth aspect is implemented. The chip system may be composed of a chip, or may include a chip and other discrete devices.
[0099] In a fourteenth aspect, a computer program product is provided, which, when executed on a computer, implements a method as in any possible implementation of the first aspect, the fourth aspect or the eighth aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0100] Figure 1 Schematic diagram of three multi-device display modes;
[0101] Figure 2 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;
[0102] Figure 3 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;
[0103] Figure 4 Two examples of application scenarios of distributed display of interfaces provided in the embodiments of the present application Figure 1 ;
[0104] Figure 5 Two examples of application scenarios of distributed display of interfaces provided in the embodiments of the present application Figure 2 ;
[0105] Figure 6 Two examples of application scenarios of distributed display of interfaces provided in the embodiments of the present application Figure 3 ;
[0106] Figure 7 A first operation example diagram provided in an embodiment of the present application;
[0107] Figure 8 Three first operation example diagrams provided for the embodiments of the present application;
[0108] Fig. 9 Three other first operation example diagrams provided for the embodiments of the present application;
[0109] Fig.10 A schematic diagram of a method for an electronic device to determine a primary device and a secondary device provided in an embodiment of the present application;
[0110] Fig.11A A schematic diagram of another method for an electronic device to determine a primary device and a secondary device provided in an embodiment of the present application;
[0111] Fig. 11BA schematic diagram of a method for determining a primary device and a secondary device by a third electronic device provided in an embodiment of the present application;
[0112] Fig.12 A schematic diagram of an operation method for removing an option of a draggable icon provided in an embodiment of the present application;
[0113] Fig.13 An example of a distributed display interface provided in the embodiment of the present application Figure 1 ;
[0114] Fig.14 An example of a distributed display interface provided in the embodiment of the present application Figure 2 ;
[0115] Fig.15A An example of a distributed display interface provided in the embodiment of the present application Figure 3 ;
[0116] Fig. 15B An example of a distributed display interface provided in the embodiment of the present application Figure 4 ;
[0117] Fig. 15C An example of a distributed display interface provided by an embodiment of the present application Figure 5 ;
[0118] Fig.16 An example of a distributed display interface provided in the embodiment of the present application Figure 6 ;
[0119] Fig.17 An example of a distributed display interface provided in the embodiment of the present application Figure 7 ;
[0120] Fig.18 An example of a distributed display interface provided in the embodiment of the present application Figure 8 ;
[0121] Fig.19 An example of a distributed display interface provided in the embodiment of the present application Figure 9 ;
[0122] Fig. 20 An example of a distributed display interface provided in the embodiment of the present application Figure 10 ;
[0123] Fig.21 An example of a distributed display interface provided in the embodiment of the present application Figure 10 one;
[0124] Fig. 22 An example of a distributed display interface provided in the embodiment of the present application Figure 10 two;
[0125] Fig.23 An example of a distributed display interface provided in the embodiment of the present application Figure 10 three;
[0126] Fig.24 An example diagram of several adaptation capabilities provided in the embodiments of the present application;
[0127] Fig.25 A schematic diagram of a distributed interface selection provided in an embodiment of the present application;
[0128] Fig.26 A schematic diagram of retracting a distributed interface provided in an embodiment of the present application;
[0129] Fig. 27 A schematic diagram of another method of retracting a distributed interface provided in an embodiment of the present application;
[0130] Fig.28 A structural block diagram of an electronic device provided in an embodiment of the present application;
[0131] Fig.29 A schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0132] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0133] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.
[0134] An embodiment of the present application provides a distributed display method of an interface, which can be used to display different contents on an interface in a distributed and coordinated manner on different electronic devices.
[0135] The electronic device in the present application includes one or more display screens. For example, the electronic device may be a smart phone, a netbook, a tablet computer, a smart camera, a PDA, a portable multimedia player (PMP), an augmented reality (AR) / virtual reality (VR) device, a notebook computer, a personal computer (PC), an ultra-mobile personal computer (UMPC), etc. Alternatively, the electronic device may also be an electronic device of other types or structures including a display screen, which is not limited in the present application.
[0136] Please refer to Figure 2 , Figure 2 Taking a smart phone as an example, a hardware structure diagram of an electronic device provided by an embodiment of the present application is shown. Figure 2 As shown, the electronic device may include a processor 210, a memory (including an external memory interface 220 and an internal memory 221), a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc. The sensor module 280 may include a gyroscope sensor 280A, an acceleration sensor 280B, a magnetic sensor 280C, a touch sensor 280D, a fingerprint sensor 280E, and a pressure sensor 280F. In some embodiments, the sensor module 280 may also include an air pressure sensor, a distance sensor, a proximity light sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, and the like.
[0137] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0138] The processor 210 may include one or more processing units. For example, the processor 210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a flight controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.
[0139] The processor 210 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store instructions or data that the processor 210 has just used or cyclically used. If the processor 210 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.
[0140] In some embodiments, the processor 210 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0141] The charging management module 240 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 240 may receive charging input from a wired charger through the USB interface 230. In some wireless charging embodiments, the charging management module 240 may receive wireless charging input through a wireless charging coil of the electronic device. While the charging management module 240 is charging the battery 242, it may also power the electronic device through the power management module 241.
[0142] The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240, and supplies power to the processor 210, the internal memory 221, the display screen 294, the camera 293, and the wireless communication module 260. The power management module 241 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some embodiments, the power management module 241 can also be set in the processor 210. In other embodiments, the power management module 241 and the charging management module 240 can also be set in the same device.
[0143] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor and baseband processor.
[0144] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0145] The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to electronic devices. The mobile communication module 250 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 250 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 250 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the same device as at least some of the modules of the processor 210.
[0146] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 270A, a receiver 270B, etc.), or displays an image or video through a display screen 294. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 210 and be set in the same device as the mobile communication module 250 or other functional modules.
[0147] The wireless communication module 260 can provide wireless communication solutions including wireless local area networks (WLAN) (such as WiFi networks), Bluetooth BT, global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to electronic devices. The wireless communication module 260 can be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 210. The wireless communication module 260 can also receive the signal to be sent from the processor 210, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0148] In some embodiments, the antenna 1 of the electronic device is coupled to the mobile communication module 250, and the antenna 2 is coupled to the wireless communication module 260, so that the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0149] The electronic device implements the display function through a GPU, a display screen 294, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs that execute program instructions to generate or change display information.
[0150] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device may include 1 or N display screens 294, where N is a positive integer greater than 1.
[0151] The electronic device can realize the shooting function through ISP, camera 293, video codec, GPU, display screen 294 and application processor.
[0152] The external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.
[0153] The internal memory 221 can be used to store computer executable program codes, which include instructions. The internal memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 210 executes various functional applications and data processing of the portable device by running instructions stored in the internal memory 221 and / or instructions stored in a memory provided in the processor.
[0154] The gyro sensor 280A can be used to determine the posture of the electronic device during movement. In some embodiments, the angular velocity of the electronic device in a preset coordinate system can be determined by the gyro sensor 280A.
[0155] The acceleration sensor 280B can detect the movement direction and acceleration of the electronic device. When the electronic device is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of the electronic device and is applied to applications such as pedometers.
[0156] The magnetic sensor 280C is used to convert the magnetic property changes of the sensitive element caused by external factors such as magnetic field, current, stress strain, temperature, light, etc. into electrical signals, and detect the corresponding physical quantity in this way. In some embodiments, the magnetic sensor can measure the angle between the electronic device and the four directions of east, south, west and north.
[0157] The touch sensor 280D may also be referred to as a "touch panel". The touch sensor 280D may be disposed on the display screen 294, and the touch sensor 280D and the display screen 294 form a touch screen, also referred to as a "touch screen". The touch sensor 280D is used to detect touch operations acting on or near it. The touch sensor 280D may transmit the detected touch operations to an application processor to determine the type of touch event. The electronic device may provide visual outputs related to the touch operations through the display screen 294. In other embodiments, the touch sensor 280D may also be disposed on the surface of the electronic device, at a different location from the display screen 294.
[0158] The fingerprint sensor 280E is used to collect fingerprints. The electronic device can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0159] The pressure sensor 280F is used to sense the pressure signal and convert the pressure signal into an electrical signal. For example, the pressure sensor 280F can be set on the display screen 294. Among them, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions.
[0160] The electronic device can realize audio functions through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C and the application processor, such as music playing and recording. For the specific working principles and functions of the audio module 270, the speaker 270A, the receiver 270B and the microphone 270C, reference can be made to the introduction in the conventional technology.
[0161] The key 290 includes a power key, a volume key, etc. The key 290 can be a mechanical key or a touch key. The electronic device can receive key input and generate key signal input related to user settings and function control of the electronic device.
[0162] Motor 291 can generate vibration prompts. Motor 291 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 294, motor 291 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0163] Indicator 292 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0164] The SIM card interface 295 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device by inserting it into the SIM card interface 295 or pulling it out from the SIM card interface 295. The electronic device can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 295 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 295 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 295 can also be compatible with different types of SIM cards. The SIM card interface 295 can also be compatible with external memory cards. The electronic device interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device and cannot be separated from the electronic device.
[0165] It should be noted that Figure 2 The hardware modules included in the electronic device are only described for example, and do not limit the specific structure of the electronic device. For example, the electronic device may also include other functional modules.
[0166] In this application, the operating system of the electronic device may include but is not limited to (Symbian), (Android), (iOS), (Blackberry), Hongmeng (Harmony) and other operating systems, this application is not limited.
[0167] Please refer to Figure 3 , Figure 3 Taking the Android operating system as an example, a schematic diagram of the software structure of the electronic device in the embodiment of the present application is specifically introduced.
[0168] like Figure 3As shown, the Android operating system may include an application layer, an application framework layer (framework, FWK), a system library, an Android runtime and a kernel layer (kernel).
[0169] The application layer can provide some core applications. For the convenience of description, the application is referred to as application below. The applications in the application layer can include native applications (such as applications installed in the electronic device when the operating system is installed before the electronic device leaves the factory), such as Figure 3 The applications in the application layer can also include third-party applications (such as applications downloaded and installed by users through application stores), such as Figure 3 Tik Tok, email, Toutiao and video apps, etc. are shown.
[0170] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0171] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. Figure 3 As shown, the application framework layer may include a window manager service (VMS), an activity manager service (AMS) and an input event management server (IMS). In some embodiments, the application framework layer may also include a content provider, a view system, a phone manager, a resource manager, a notification manager, etc. ( Figure 3 not shown).
[0172] like Figure 3 As shown, the application framework layer may include a window manager service (VMS), an activity manager service (AMS), an input event management server (IMS), a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0173] The window management server is used to manage window programs. The window management server can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0174] The activity manager service (AMS) is responsible for managing activities, starting, switching, and scheduling components in the system, and managing and scheduling applications.
[0175] The input manager service (IMS) can be used to translate and encapsulate the original input events to obtain input events containing more information and send them to the window management server, which stores the clickable area (such as controls) of each application, the location information of the focus window, etc. Therefore, the window management server can correctly distribute the input events to the specified controls or focus windows.
[0176] Content providers are used to store and retrieve data and make it accessible to applications. The data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0177] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0178] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including answering, hanging up, etc.).
[0179] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0180] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0181] The system library and Android runtime include the functions that FWK needs to call, the Android core library, and the Android virtual machine. The system library can include multiple functional modules. For example: browser kernel, three-dimensional (3D) graphics, font library, etc.
[0182] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGLES), 2D graphics engine (such as SGL), etc.
[0183] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0184] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0185] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0186] A 2D graphics engine is a drawing engine for 2D drawings.
[0187] The kernel layer is the foundation of the Android operating system. The final functions of the Android operating system are completed through the kernel layer. The kernel layer can include display drivers, input / output device drivers (for example, keyboards, touch screens, headphones, speakers, microphones, etc.), device nodes, Bluetooth drivers, camera drivers, audio drivers, and sensor drivers. Users perform input operations through input devices, and the kernel layer can generate corresponding raw input events based on the input operations and store them in device nodes.
[0188] As mentioned above, it can be understood that conventional multi-device display can achieve mirror display, transfer display or spliced extended display. For example, based on the Sidecar function of Mac OS, the iPad display can be used as an extended screen of the Mac to achieve mirror display (i.e., let the iPad mirror the interface displayed on the mac OS device), transfer display (i.e., transfer the interface displayed on the macOS device to the iPad) or spliced extended display (i.e., let the iPad splice and extend the interface displayed on the mac OS device). Simply put, the Sidecar function can make the iPad an external display for the Mac. In the process of implementing the Sidecar function, the iPad and Mac need to be connected wirelessly in the same network environment, or connected via a USB-C data cable.
[0189] However, the above-mentioned mirror display, transfer display and spliced extended display do not involve the distributed display of different contents on the interface. For example, the above-mentioned extended display can realize the splicing display of the same interface on multiple devices, but it still cannot realize the distributed collaborative display and collaborative operation of different contents on the same interface on different devices. In some scenarios, the distributed collaborative display and collaborative operation of different contents on an interface can often bring great convenience to users, which is very important for improving user experience.
[0190] For example, see Figure 4 , Figure 4 The following diagram shows two example application scenarios of interface distribution provided by the embodiment of the present application. Figure 4 As shown in (a) in the electronic classroom, the electronic device simultaneously displays the teacher's live video, electronic handouts, and class communication group interface. In some scenarios, such as Figure 4 As shown in (a) in the figure, the electronic device may also display a student's memo. During the live broadcast of the electronic classroom, students can refer to the content in the electronic handout while watching the teacher's live video. In some scenarios, students can record classroom notes such as knowledge points and questions in the memo. In some scenarios, students can view messages from teachers or other students on the class communication group interface, such as notifications, questions, and other related information.
[0191] In e.g. Figure 4 In the multi-task interface shown in (a), the teacher needs to switch multiple task interfaces on the same electronic device to complete live video, electronic handout display or annotation, group message publishing, etc. Students also need to switch multiple task interfaces on the same electronic device to complete live video viewing, electronic handout viewing or annotation, group message viewing or publishing, class note taking, etc. The above multiple task interfaces will cause the task interface (such as group message interface and memo interface) to be displayed incompletely on one display screen. In addition, switching the above multi-task interface is complicated for users (such as teachers or students).
[0192] In addition, in order to clearly display the above-mentioned multiple task interfaces and facilitate users to watch, the above-mentioned multiple task interfaces are usually displayed on a large-screen device (such as a computer). However, since users (such as teachers or students) need to control large-screen devices (such as computers) at any time, they need to keep a close distance from the large-screen device. If users keep a close distance from large-screen devices for a long time, it will affect the user's vision health.
[0193] Another example Figure 4 As shown in (b) of FIG. 1 , the electronic device simultaneously displays a memo interface and a short message interface in split screen. The user can use the electronic device to process memo-related tasks and short message-related tasks at the same time. However, for some small-screen devices, such as smartphones, etc., Figure 4 In the multitasking interface shown in (b), the display area of the memo interface and the short message interface will be very small, and the screen area available for users to handle memo-related tasks and short message-related tasks will also be very small, which will greatly affect the efficiency of users in handling memo-related tasks and short message-related tasks, and will affect the users' eyesight health.
[0194] Another example Figure 5 As shown in (a) of FIG. 1 , a video playback interface is displayed on the electronic device. The video playback interface includes a video playback box, a video selection area, a quick processing area (for commenting, collecting, downloading or sharing, etc.), and an area for more videos. Users can use the electronic device to perform other operations related to the video playback interface while watching the video in the video playback box, such as posting comments, browsing more videos, etc. However, for some small-screen devices, such as smartphones, etc., in the case of Figure 5 In the multitasking interface shown in (a), if the user posts a comment or browses more videos, the user will be forced to not maximize the video playback box. The inability to maximize the video playback box will greatly affect the user's video viewing experience.
[0195] Another example Figure 5 As shown in (b) of FIG. 1 , the electronic device displays a short video interface of Douyin. The short video interface of Douyin includes a video playback frame and a comment area. Figure 5 As shown in (b) in the figure, when a user posts a comment in the comment area, the Douyin application will call the input keyboard. The input keyboard is displayed on the short video interface in a suspended or superimposed form. Users can use electronic devices to enter comments through the input keyboard while watching short videos and browsing comments. However, the above-mentioned suspended or superimposed input keyboard will block most of the comment area. Therefore, it will affect the user's experience of browsing comments.
[0196] Another example Figure 6 As shown in (a) in the figure, a picture list is displayed on the electronic device, and the picture list includes thumbnails of multiple pictures. The user can select a picture in the picture list to enter the details interface of the selected picture to browse the picture details. However, the above method of viewing the details interface of the picture is complicated to operate, and the user needs to select pictures one by one, view the details interface of the picture, return to the picture list, and select another picture to enter the details interface of the picture... In addition, the above method of viewing the details interface of the picture will affect the efficiency of the user browsing the details interface of the picture.
[0197] Another example Figure 6As shown in (b) in the figure, an email list is displayed on the electronic device, and the email list includes an abbreviated list of multiple emails (including unread emails and / or read emails). The user can select an email in the email list to enter the details interface of the selected email to browse the email details. However, the above method of viewing the email details interface is complicated to operate. The user needs to select emails one by one, process the emails in the email details interface, return to the email list, and select another email to enter the details interface of the email... In addition, the above method of viewing the details interface of the email will affect the efficiency of the user in processing the details interface of the email.
[0198] Based on the above considerations, the present application provides a distributed display method of an interface. The present application provides a distributed display method of an interface, which is specifically used to distribute and collaboratively display the content displayed on a first electronic device on multiple different electronic devices (such as a first electronic device and a second electronic device). So that users can handle different tasks through multiple electronic devices, which is convenient for user operation.
[0199] For example, the one interface is the first interface. The first interface can be the interface of any application. For example, the first interface is the interface of an application (i.e., a native application) installed in the first electronic device when the operating system is installed before the first electronic device leaves the factory, such as Figure 3 The first interface is the interface of the short message application, the address book application or the gallery application shown in FIG. For another example, the first interface is the interface of the application (i.e., the third-party application) downloaded and installed by the user through the application store, such as Figure 3 shown Apps, Email Apps, The present application does not limit the specific application corresponding to the first interface and the specific content displayed on the interface. In some embodiments, the first electronic device can respond to the user's operation (such as the first operation) for triggering distributed collaborative display, and display part of the content on the first interface on the second electronic device in a distributed collaborative manner. For example, the first electronic device displays Figure 5 The video selection area, the quick processing area (for commenting, collecting, downloading or sharing, etc.) and the more video area shown in (a) of FIG. 1 are displayed by the second electronic device. Figure 5 For example, the first electronic device displays the video playback frame shown in (a) of FIG. Figure 5 The video play frame and comment area shown in (b) of FIG. 1 ; the second electronic device displays the video play frame and comment area shown in (b) of FIG. 1 ; Figure 5 The input keyboard is shown in (b).
[0200] Further, in some embodiments, the first interface may include multiple task interfaces. In some embodiments, the first electronic device may display the above-mentioned multiple task interfaces in a distributed and collaborative manner on the second electronic device in response to an operation (such as a first operation) performed by a user to trigger a distributed collaborative display. For example, the first electronic device displays the first interface of a first application, and the first interface includes at least a first function area and a second function area. The content of the first function area is the first task interface, and the content of the second function area is the second task interface. The first electronic device may send the first task interface of the first function area to the second electronic device for display. After the first electronic device can send the first task interface of the first function area to the second electronic device for display, the first electronic device displays the second interface of the first application, and the second interface includes the second function area but does not include the first function area. For example, the first electronic device displays as Figure 4 The second electronic device displays the live video shown in (a) of Figure 4 The electronic handouts, class communication group interface and memo shown in (a) of FIG. 1 are shown in FIG. 1 . Figure 4 The second electronic device displays the memo interface shown in (b) of Figure 4 The short message interface shown in (b) in FIG.
[0201] It should be noted that the first electronic device and the second electronic device in the present application can be electronic devices including display screens of any type or structure. For example, the first electronic device and the second electronic device can be the above-mentioned smart phones, netbooks, tablet computers, smart cameras, PDAs, PMPs, AR / VR devices, laptop computers, PCs, UMPCs, etc., and the present application does not limit them.
[0202] In addition, in the present application, the first electronic device and the second electronic device may be electronic devices of the same type. For example, the first electronic device is a smartphone 1, and the second electronic device is a smartphone 2. The first electronic device and the second electronic device may also be electronic devices of different types. For example, the first electronic device is a smartphone, and the second electronic device is a tablet computer.
[0203] In addition, it should be noted that in this application, the number of electronic devices n for distributed collaborative display is greater than or equal to 2, where n is an integer. For example, n=2, it means that different contents on an interface displayed on the first electronic device are distributed and collaboratively displayed on the first electronic device and a second electronic device, a total of 2 electronic devices. For another example, n=3, it means that different contents on an interface displayed on the first electronic device are distributed and collaboratively displayed on the first electronic device and two second electronic devices, a total of 3 electronic devices.
[0204] The following will describe in detail a distributed display method of an interface provided in an embodiment of the present application in conjunction with the accompanying drawings.
[0205] In an embodiment of the present application, the first interface may include multiple functional areas (such as a first functional area and a second functional area). The contents of different functional areas are used to implement different functions. The first electronic device may also be referred to as a main device. The main device may transfer one or more of the multiple task interfaces displayed on the main device to a device of one or more other devices. For example, the task interface of one or more functional areas is transferred to a second electronic device for display. The opposite of the main device is a secondary device (i.e., a second electronic device).
[0206] like Figure 5 As shown in (a) of FIG. 1 , the video playback interface (i.e., the first interface) includes a functional area for playing videos, i.e., a video playback frame, and also includes functional areas for commenting, collecting, downloading, or sharing, i.e., a video selection area and a quick processing area. For another example, Figure 5 As shown in (b) in FIG. 1 , the short video interface of Douyin (i.e., the first interface) includes a functional area for playing videos, i.e., a video play frame, and a functional area for making comments, i.e., a comment area. When a user makes a comment in the comment area, the short video interface of Douyin (i.e., the first interface) also includes a functional area for inputting comments, i.e., an input keyboard.
[0207] For another example, the first interface may include multiple application interfaces or multiple mini-program interfaces, such as Figure 4 (a) or Figure 4 As shown in (b) in . Among them, the above-mentioned multiple application interfaces can be composed of task interfaces of multiple applications, or they can be composed of different task interfaces of the same application. The above-mentioned multiple mini-program interfaces can be composed of task interfaces of multiple mini-programs, or they can be composed of different task interfaces of the same mini-program. This application does not limit the specific source of the multiple task interfaces displayed on the first electronic device.
[0208] In some embodiments, the multiple task interfaces displayed on the first electronic device may be different application interfaces. For example, the multiple task interfaces may be any multiple application interfaces installed in the first electronic device.
[0209] In some other embodiments, the multiple task interfaces displayed on the first electronic device may be the same application interface. It is understandable that the same application may include different application interfaces at different levels. The different levels may have a hierarchical relationship or may not have any hierarchical relationship. In response to a user operation on an interface, the interface may call the next level interface of the interface. Therefore, the multiple task interfaces displayed on the first electronic device may be application interfaces of the same level or different levels of the same application. For example, two application interfaces are displayed on the first electronic device, one of which is The first is the Moments interface, and the second is the official account interface.
[0210] In some other embodiments, the plurality of task interfaces displayed on the first electronic device may be mini-program interfaces. or ) in the applet interface.
[0211] Among them, multiple task interfaces in the embodiment of the present application can be displayed in the same window, or can be displayed in multiple windows respectively, which is not limited in the present application.
[0212] In some embodiments, multiple task interfaces in the embodiments of the present application can be displayed in one window. For example, if the multiple task interfaces in the embodiments of the present application are a combination of multiple mini-program interfaces, the multiple task interfaces can be displayed in one window. Figure 4 As shown in (a) in the figure, the live video interface, the electronic handout interface, the class communication group interface and the memo interface are displayed in one application (such as Figure 4 In the electronic classroom application window shown in (a) in the figure.
[0213] In other embodiments, the multiple task interfaces in the embodiment of the present application may be displayed in multiple windows respectively. For example, if the multiple task interfaces in the embodiment of the present application include multiple application interfaces, the multiple task interfaces may be displayed in multiple windows. Figure 4 As shown in (b) in the figure, the memo interface is displayed in the memo application window, and the short message interface is displayed in the short message application window.
[0214] In some embodiments, multiple task interfaces of multiple functional areas (such as the first functional area and the second functional area) on the first interface can be laid out on the display screen of the first electronic device in a preset relative position relationship. For example, multiple frame templates are pre-set in the first electronic device, and the multiple frame templates are used to specify the number of functional areas, the position of each functional area, the shape and size of each functional area, etc.; or to specify the number of task interfaces that can be displayed, the position where each task interface is displayed, the shape and size of each task interface, etc., which are not limited in this application. Multiple task interfaces can be arranged on the display screen of the first electronic device according to a suitable frame template.
[0215] Exemplarily, in an embodiment of the present application, the first interface may be a first electronic device that renders the first content in the form of an atomic service in the first functional area of the virtual screen according to a preset framework template, and renders the second content in the form of another atomic service in the second functional area of the virtual screen, and displays the first content and the second content rendered together on the virtual screen on the display screen of the first electronic device. Taking the first interface including the first functional area and the second functional area as an example, the first electronic device may render the first content in the form of an atomic service in the first functional area of the virtual screen according to a preset framework template, and render the second content in the form of another atomic service in the second functional area of the virtual screen, and display the first content and the second content rendered together on the virtual screen on the display screen of the first electronic device.
[0216] It can be understood that in the embodiment of the present application, the business logic of the application can be decoupled and divided into atomic capabilities that can work independently on any device. Based on different atomic capabilities, it is possible to achieve cross-device migration on a distributed infrastructure. Among them, each atomic capability can realize a program function. In addition, the interface can be opened to developers and directly called by this system or other systems. In addition, different atomic capabilities can support flexible assembly to form an interface of an application, such as the first interface in the embodiment of the present application. In some embodiments, the first electronic device can determine which framework template to use based on the number and function of the functional area. For example, if the first interface includes 2 functional areas, the framework template of the upper and lower split screen display or the left and right split screen display is used to display the 2 functional areas. For example, if the first interface includes 5 functional areas, one of which is used to implement the core function and the remaining 4 functional areas are used to implement non-core functions, then the framework template of 1 large functional area + 4 small functional areas is used to display the 5 functional areas.
[0217] In other embodiments, the first electronic device may determine which frame template to use according to the number and attributes of the task interfaces. For example, if there are two task interfaces, the frame template of the upper and lower split screen display or the left and right split screen display is used to display the two task interfaces, such as Figure 4As shown in (b) in . For another example, if there are 5 task interfaces, one of which is a core task interface and the other 4 are non-core task interfaces, then use Figure 4 The framework template of 1 large interface + 4 small interfaces shown in (a) in FIG. 1 shows the 5 task interfaces, such as Figure 4 As shown in (a) in .
[0218] In an embodiment of the present application, when the first electronic device displays the first interface, the first electronic device can transfer part of the content on the first interface to the second electronic device in response to the first operation of the user. For example, one or more task interfaces of the first functional area are sent to the second electronic device for display. The first functional area is any functional area in the functional area on the first interface of the first electronic device. For example, the functional area selected by the user, the functional area determined by the first electronic device, etc.
[0219] In an embodiment of the present application, the first electronic device transferring part of the content on the first interface to the second electronic device may specifically include: the first electronic device sending a standard video stream corresponding to the part of the content on the first interface to the second electronic device for display. For example, the first electronic device sends a standard video stream corresponding to the content of one or more functional areas to the second electronic device for display. The content of different functional areas corresponds to different task interfaces.
[0220] In some embodiments, the first operation may include, but is not limited to, a touch operation between the first electronic device and the second electronic device (for example, a user holds the second electronic device and touches (i.e., "touches") the first electronic device), a user "shakes" the first electronic device and the second electronic device at the same time, a user "shakes" the first electronic device, a user's preset gesture operation on the first electronic device, a user's preset operation on a physical button of the first electronic device (for example, a preset operation on a power button, a volume increase ("+") button, and a volume decrease ("-") button), a user's operation on a virtual button of the first electronic device (including single-click, double-click, long-press, etc.), or a user's selection operation on an option displayed on the display screen of the first electronic device (including a selection operation on one or more options), etc. Alternatively, the first operation may also be other preset operations for triggering a distributed display of an interface, and the present application does not limit the specific form of operation.
[0221] Please refer to Figure 7 , Figure 7 FIG. 1 shows a first operation example diagram provided by an embodiment of the present application. Assume that a display such as Figure 5 The first interface shown in (a) in FIG. Figure 7 As shown, the first operation is an operation 703 in which a user holds a smartphone 702 and “touches” the smartphone 701 .
[0222] It should be noted that the above Figure 7 Only a corner of the smart phone 701 and a corner of the smart phone 702 are used as an example of "bumping". In the embodiment of the present application, the "bumping" can be performed between any part of the first electronic device and any part of the second electronic device.
[0223] Among them, in the embodiment of the present application, the electronic device (such as Figure 7 The smart phone 701 or smart phone 702 shown in the figure can collect the movement direction, movement acceleration and movement speed of the electronic device in real time through the acceleration sensor and / or gravity sensor to determine whether the electronic device has undergone a "touch and touch" operation. For example, if the electronic device suddenly stops moving while moving at a certain speed, the electronic device may infer that the electronic device may have touched other electronic devices.
[0224] In other embodiments, the electronic device may collect the rotation direction, rotation angular velocity, rotation angle, etc. of the electronic device in real time through a gyroscope sensor to determine whether a "touch and touch" operation has occurred on the electronic device. For example, if the electronic device suddenly stops moving while moving at a certain rotation angular velocity, the electronic device may infer that the electronic device may have touched another electronic device.
[0225] In other embodiments, the electronic device can determine whether a "touch and touch" operation has occurred on the electronic device by analyzing the audio data collected by the microphone. For example, if the screen data received by the microphone meets a certain pitch, a certain loudness, and a specific impact timbre, the electronic device infers that the electronic device may have touched other electronic devices. Regarding the basis for the electronic device to determine whether a touch operation with other electronic devices has occurred, reference can be made to conventional technologies, which will not be listed here one by one.
[0226] Another example: Figure 8 1 and 2 show three first operation examples provided by the embodiments of the present application. Assume that a first interface is displayed on a smart phone 701 (i.e., a first electronic device). Figure 8 As shown in (a) of FIG. 1 , the first operation is a preset gesture operation 801 performed by a user on the touch screen (i.e., display screen) of the smart phone 701. Figure 8 As shown in (b) of FIG. 8 , the first operation is an operation 802 in which the user simultaneously presses the power button and the volume up (“+”) button of the smartphone 701. Figure 8 As shown in (c) in the figure, the first operation is a click operation 803 (including single click, double click, long press, etc.) of a virtual button on the first interface by a user.
[0227] in, Figure 8(a) in the figure takes the user's "one"-shaped preset gesture operation in the middle of the touch screen of the smartphone 701 as an example. In the embodiment of the present application, the specific trajectory of the preset gesture is not limited. For example, the preset gesture can also be any shape such as "○", "∠" or "└". The embodiment of the present application also does not limit the specific form of the gesture. For example, it can also be a multi-finger (such as three-finger) sliding gesture. Furthermore, the present application does not limit the input position of the preset gesture. For example, the preset gesture can also be a user sliding inward from the edge of the touch screen of the smartphone 701. In addition, Figure 8 (b) in the figure takes the example that the power button is located on the short side above the screen of the smartphone 701, and the volume up ("+") button and the volume down ("-") button are located on the long side on the right side of the screen of the smartphone 701, and shows the first operation in which the user simultaneously presses the power button and the volume up ("+") button of the smartphone 701. In the embodiment of the present application, the specific position of each physical button on the electronic device is not limited. In addition, Figure 8 (c) in the figure takes the virtual button displayed in the lower left corner of the touch screen of the smart phone 701 as an example. In the embodiment of the present application, the virtual button can also be displayed at any other position of the touch screen, which is not limited by the present application.
[0228] Another example: Fig. 9 by Figure 4 Taking the multi-tasking scenario of the electronic classroom shown in (a) as an example, three other first operation example diagrams provided in the embodiments of the present application are introduced.
[0229] like Fig. 9 As shown in (a), a virtual key 901 for triggering multi-task distributed display is displayed on the display screen of the first electronic device. In response to the user clicking the virtual key 901, the first electronic device triggers the multi-task distributed display and transfers one or more of the multiple task interfaces displayed on the display screen to the second electronic device.
[0230] like Fig. 9 As shown in (b) of FIG. 1 , a virtual key 901 for triggering multi-task distributed display is displayed on the display screen of the first electronic device. In response to the user clicking the virtual key 901, the first electronic device displays an option box 902. Fig. 9 As shown in (b) of FIG. 1 , the option box 902 includes a second electronic device list for the user to select a second electronic device to be displayed in a distributed manner with the first electronic device, for example Fig. 9In response to the user selecting a second electronic device (e.g., "my tablet") from the second electronic device list, the first electronic device triggers a multi-task distributed display and transfers one or more of the multiple task interfaces displayed on the display screen to the second electronic device (e.g., "my tablet") selected by the user.
[0231] Another example Fig. 9 As shown in (c) of FIG. 1 , an option box 902 for triggering multi-task distributed display is displayed on the display screen of the first electronic device. Fig. 9 As shown in (b) of FIG. 1 , the option box 902 includes a second electronic device list for the user to select a second electronic device to be displayed in a distributed manner with the first electronic device, for example Fig. 9 In response to the user selecting a second electronic device (e.g., "my tablet") from the second electronic device list, the first electronic device triggers a multi-task distributed display and transfers one or more of the multiple task interfaces displayed on the display screen to the second electronic device (e.g., "my tablet") selected by the user.
[0232] In some examples, such as Fig. 9 (b) and Fig. 9 As shown in (c) in the figure, the option box 902 may also display options for multi-device display modes, such as mirror display, transfer display, or distributed collaborative display. In response to the user selecting a second electronic device (such as "my tablet") from the second electronic device list, and the user selecting a multi-task collaborative display, the user clicks on the confirmation option, and the first electronic device triggers a multi-task distributed collaborative display, and transfers one or more of the multiple task interfaces displayed on the display screen to the second electronic device (such as "my tablet") selected by the user.
[0233] In other examples, such as Fig. 9 (b) and Fig. 9 As shown in (c) in the figure, the device option for audio output can also be displayed in the option box 902. This option is used for the user to select the device for audio output. For example, in response to the user selecting the second electronic device (such as "my tablet") from the second electronic device list, the user selecting the multi-task collaborative display operation, and the operation of outputting audio through "my tablet", the user clicks on the operation of confirming the option, and the first electronic device triggers the multi-task distributed collaborative display, and transfers one or more of the multiple task interfaces displayed on the display screen to the second electronic device (such as "my tablet") selected by the user. Among them. "My tablet" is responsible for outputting audio.
[0234] It should be noted that Fig. 9 (a) Fig. 9 (b) and Fig. 9 (b) in the figure only takes the first operation of clicking a virtual button or selecting an option as an example, and shows several possible first operations in the embodiment of the present application. The present application does not limit the specific virtual button icon form, display position, or specific display form, display position, or specific content of the option. For example, the option box 902 can also display device options for a camera that collects a user's head portrait, or device options for a microphone that collects a user's voice, etc.
[0235] in addition, Fig. 9 (a) Fig. 9 (b) and Fig. 9 (b) is based on Figure 4 The multi-tasking scenario of the electronic classroom shown in (a) is taken as an example. Fig. 9 (a) Fig. 9 (b) and Fig. 9 The first operation based on a virtual key or option shown in (b) is applicable to any multitasking scenario, and the embodiments of the present application will not be listed one by one.
[0236] In some embodiments, the virtual buttons or options may be always displayed in a suspended manner on the first electronic device. Fig. 9 (a) and Fig. 9 As shown in (b) in FIG. 1 , the virtual key 901 is finally displayed in a floating manner on the interface of the first electronic device.
[0237] In other embodiments, the virtual buttons or options may also be hidden and displayed on the first electronic device. Fig. 9 (b) or Fig. 9 By clicking the retract key 903 shown in (c) in the figure, the first electronic device hides the display option box 902 on the interface.
[0238] It should be noted that, in the present application, the second electronic device used for distributed collaborative display with the first electronic device can be determined by the first electronic device according to the user's first operation, or can be determined by the first electronic device itself in response to the user's first operation, and this application does not limit this.
[0239] For the case where the first electronic device determines the second electronic device based on the user's first operation, for example, assuming that the first operation is an operation in which the user holds the first electronic device and "touches" the second electronic device, the first electronic device can determine the second electronic device by detecting a device whose distance from the first electronic device is less than a preset threshold (such as 5 cm). For another example, assuming that the first operation is an operation in which the user "shakes" the first electronic device and the second electronic device at the same time, the first electronic device can determine the second electronic device by detecting a device that is "shaking" near the first electronic device.
[0240] For example, assuming that the first operation is Fig. 9 In the example shown in (a) of FIG. 1 , the user selects an option displayed on the display screen of the first electronic device (including a selection operation on one or more options), the second electronic device may also be determined by the first electronic device according to the user's selection operation on the option displayed on the display screen of the first electronic device, for example, Fig. 9 (b) or Fig. 9 In the example shown in (c), the second electronic device is determined by the first electronic device based on an option selected by the user.
[0241] For the case where the first electronic device determines the second electronic device by itself in response to the user's first operation, exemplarily, assuming that the first operation is the user's "shaking" operation of the first electronic device, the user's preset gesture operation on the first electronic device, the user's preset operation on the physical key of the first electronic device, or the user's operation on the virtual key of the first electronic device, the first electronic device can respond to the user's first operation, and obtain the electronic device information of the distributed display interface content with the first electronic device within a preset time period, so as to determine the second electronic device based on the electronic device information. For example, the second electronic device can be the electronic device that has the most distributed display interface content with the first electronic device within the preset time period. For another example, the second electronic device can be the electronic device that has the most distributed display interface content with the first electronic device for the last time. Among them, the above-mentioned preset time period can include the last three days, the last week, the last month, or the last three months, etc., which is not limited in this application.
[0242] For example, the first operation is Fig. 9In (a) of the figure, the user's selection operation on the options displayed on the display screen of the first electronic device (including the selection operation on one or more options) may be determined by the first electronic device based on the information of the electronic devices that collaboratively display the multi-task interface with the first electronic device in a preset time period. Exemplarily, the second electronic device may be the electronic device that collaboratively displays the multi-task interface with the first electronic device the most times in a preset time period. For another example, the second electronic device may be the electronic device that most recently collaboratively displays the multi-task interface with the first electronic device in a distributed manner. Among them, the above-mentioned preset time period may include the past three days, the past week, the past month, or the past three months, etc., which is not limited in this application.
[0243] In some embodiments of the present application, it is necessary to first determine the primary device and the secondary device. For different forms of the first operation, the primary device and the secondary device can be determined in at least the following two ways:
[0244] Method 1: Determine the primary device and the secondary device according to the user's selection.
[0245] In some embodiments, the primary device and the secondary device may be determined based on a selection operation (i.e., a second operation) performed by the user on an interface (e.g., a second interface) displayed by the electronic device in response to the user's first operation. This method is applicable to any form of the first operation described above.
[0246] In some examples, in response to a first operation by the user, the electronic device may display a prompt box for the user to select a primary device and a secondary device.
[0247] For example, suppose the first operation is an operation in which a user holds the first electronic device and “touches” the second electronic device (eg, Figure 7 In operation 703 shown in FIG. 1 , in response to the user's first operation, the interface (such as the second interface) displayed by the first electronic device may be as follows: Fig.10 In some examples, a prompt box 1002 is displayed on the interface 1001 to prompt the user to "touch" the device with the device model (which can also be a device identifier or a user-defined device name, Fig.10 In some other embodiments, as shown in interface 1001, prompt box 1002 is also used for the user to choose whether to extend the interface content of the local device (i.e., the first electronic device) to the second electronic device, or to choose to extend the interface content of the second electronic device to the local device (i.e., the first electronic device).
[0248] based on Fig.10In the prompt box 1002 on the interface 1001 shown in (a), if the user selects the option "Extend the local device to the second electronic device" (i.e., the second operation), the first electronic device determines that the first electronic device is the primary device and the second electronic device is the secondary device. That is, the first electronic device determines to distribute and display part of the content on the first interface of the first electronic device to the second electronic device.
[0249] If the user selects the option "Extend the second electronic device to the local device" (i.e., the second operation), the first electronic device determines that the second electronic device is the primary device and the first electronic device is the secondary device. That is, the first electronic device determines that the first electronic device displays part of the content on the first interface of the second electronic device in a distributed manner.
[0250] For another example, suppose the first operation is an operation in which a user holds the first electronic device and “touches” the second electronic device (eg Figure 7 In operation 703 shown in FIG. 1 , in response to the user's first operation, the interface (such as the second interface) displayed by the second electronic device may be as follows: Fig.10 In some examples, a prompt box 1004 is displayed on the interface 1003 to prompt the user to "touch" the device with the device model (which may also be a device identifier or a user-defined device name, Fig.10 In some other embodiments, as shown in interface 1003, prompt box 1004 is also used for the user to choose whether to expand the interface content of the local device (i.e., the second electronic device) to the first electronic device, or to choose to expand the interface content of the first electronic device to the local device (i.e., the second electronic device).
[0251] based on Fig.10 In the prompt box 1004 on the interface 1003 shown in (b), if the user selects the option "Extend the local device to the first electronic device" (i.e., the second operation), the second electronic device determines that the second electronic device is the primary device and the first electronic device is the secondary device. That is, the second electronic device determines to distribute and display part of the content on the first interface of the second electronic device to the first electronic device.
[0252] If the user selects the option "Expand the first electronic device to the local device" (i.e., the second operation), the second electronic device determines that the first electronic device is the primary device and the second device is the secondary device. That is, the second electronic device determines that the second electronic device displays part of the content on the first interface of the first electronic device in a distributed manner.
[0253] It should be noted that, in some embodiments, it is assumed that the first operation is an operation in which a user holds the first electronic device and “touches” the second electronic device (eg Figure 7In operation 703 shown in FIG, in response to the user's first operation, both the first electronic device and the second electronic device may display a prompt box. Fig.10 In the interface 1001 shown in (a), the second electronic device displays Fig.10 In this case, the user can choose to expand the interface content of the local device (i.e., the second electronic device) to the first electronic device, or to expand the interface content of the first electronic device to the local device (i.e., the second electronic device) through the prompt box on the interface 1001 or the interface 1003. The response of the device that receives the user's selection operation first is taken as the final result.
[0254] In another example, in response to the user's first operation, the electronic device may display a draggable icon to determine the main device and the secondary device based on the user's dragging action and the user's selection operation on the third interface displayed by the electronic device in response to the user's dragging action.
[0255] For example, in response to a first operation of a user on a first electronic device (eg Figure 7 Operation 703 shown, Figure 8 Operation 801 shown in (a) Figure 8 Operation 802 shown in (b) or Figure 8 In operation 803 shown in (c), the first electronic device displays Fig.11A (a) or Fig. 11B The interface 1101 (i.e., the second interface) shown in (a) of FIG. 1101 includes an icon “transmission corner” 1102. The “transmission corner” 1102 is used by the user to determine the interface content to be distributed and displayed on other devices through a dragging action.
[0256] based on Fig.11A (a) or Fig. 11B In the "transmission corner" 1102 of the interface 1101 shown in (a), if the first electronic device receives the user's drag operation on the "transmission corner" 1102, it can be preliminarily determined that the first electronic device is the main device. The user's drag operation on the "transmission corner" 1102 may include but is not limited to the user dragging the "transmission corner" 1102 to the content area to be extended to other devices for distributed display, or the user dragging the content to be extended to other devices for distributed display to the "transmission corner" 1102, which is not limited in this application.
[0257] In some embodiments, when the "transmission corner" 1102 first appears, the interface 1101 (ie, the second interface) may also display instructions for using the "transmission corner" 1102, such as Fig.11A (a) or Fig. 11BAs shown in the guide frame 1103 in (a).
[0258] In some embodiments, the first electronic device can determine that the second electronic device is a slave device of the first electronic device according to the second operation of the user. The second operation is a selection operation of the user on the prompt box; the prompt box is displayed on the first electronic device in response to the user dragging the draggable icon, and the prompt box is used by the user to select the main device and the slave device, and the draggable icon is displayed on the first electronic device in response to the touch operation. For example, in response to the user dragging the "transmission angle" 1102, the first electronic device displays the following Fig.11A The interface 1104 (i.e., the third interface) shown in (b) of FIG. 1104 includes a prompt box 1105. In some embodiments, Fig.11A As shown in (b) in FIG. 1 , the prompt box 1105 is used for the user to choose whether to expand the interface content of the local device (ie, the first electronic device) to the second electronic device, or to choose to expand the interface content of the second electronic device to the local device (ie, the first electronic device).
[0259] based on Fig.11A In the prompt box 1105 on the interface 1104 shown in (b), if the user selects the option "Extend the local device to the second electronic device" (i.e., the third operation), the first electronic device can be further determined to be the primary device and the second electronic device to be the secondary device. That is, the first electronic device determines to distribute and display part of the content on the first interface of the first electronic device to the second electronic device.
[0260] If the user selects the option "Extend the second electronic device to the local device" (i.e., the third operation), the second electronic device can be further determined as the primary device and the first electronic device as the secondary device. That is, the first electronic device determines that the first electronic device displays part of the content on the first interface of the second electronic device in a distributed manner.
[0261] In some other embodiments, in response to the user's dragging operation on the "transmission angle" 1102 (ie, the second operation), the first electronic device displays the following Fig. 11B The interface 1106 (i.e., the third interface) shown in (b) of FIG. 1106 includes a prompt box 1107. In some embodiments, Fig. 11B As shown in (b) of FIG. 1 , the prompt box 1107 is used by the user to determine whether to extend the interface content of the local device (ie, the first electronic device) to the second electronic device.
[0262] based on Fig. 11BIn the prompt box 1107 on the interface 1106 shown in (b), if the user determines to extend the interface content of the local device (i.e., the first electronic device) to the second electronic device, the second electronic device can be determined as a secondary device. That is, the first electronic device determines to distribute and display part of the content on the first interface of the first electronic device to the second electronic device. If the user cancels extending the interface content of the local device (i.e., the first electronic device) to the second electronic device, the current distributed display process is terminated.
[0263] In another example, in response to the user's first operation, the electronic device may display a draggable icon to determine the primary device according to the user's dragging action (ie, the second operation), and determine the secondary device by itself.
[0264] For example, in response to a first operation of a user on a first electronic device (eg Figure 7 Operation 703 shown, Figure 8 Operation 801 shown in (a) Figure 8 Operation 802 shown in (b) or Figure 8 In operation 803 shown in (c), the first electronic device displays Fig.11A (a) or Fig. 11B The interface 1101 (i.e., the second interface) shown in (a) of FIG. 1101 includes an icon “transmission corner” 1102. The “transmission corner” 1102 is used by the user to determine the interface content to be distributed and displayed on other devices through a dragging action.
[0265] based on Fig.11A (a) or Fig. 11B In the “transmission angle” 1102 of the interface 1101 shown in (a), if the first electronic device receives a drag operation (ie, a second operation) on the “transmission angle” 1102 by the user, it can be determined that the first electronic device is the main device.
[0266] In another example, the electronic device may also display a message when it is found that a device has established a connection with it (such as a wired connection or a wireless connection). Fig.10 The prompt box 1002 shown in (a) or Fig.10 The prompt box 1004 shown in (b) allows the user to select a primary device and a secondary device.
[0267] In other examples, the electronic device may also display a draggable icon when it finds that a device has established a connection with it (such as a wired connection or a wireless connection) to determine the primary device according to the user's dragging action (i.e., the second operation), and determine the secondary device by itself. Alternatively, the primary device and the secondary device may be determined according to the user's dragging action (i.e., the second operation) in combination with the user's selection operation (i.e., the third operation) on the third interface displayed by the electronic device in response to the user's dragging action (i.e., the second operation).
[0268] Furthermore, the first electronic device may obtain information about electronic devices that display interface content in a distributed manner with the first electronic device within a preset time period, so as to determine the second electronic device based on the electronic device information. For example, the second electronic device may be the electronic device that displays interface content in a distributed manner with the first electronic device the most times within a preset time period. For another example, the second electronic device may be the electronic device that most recently displayed interface content in a distributed manner with the first electronic device, which is not limited in this application.
[0269] In some embodiments, the above-mentioned draggable icon (e.g., "transfer corner") can always be displayed floating on the display screen of the main device during the distributed display of the main device (i.e., the first electronic device) and the secondary device (i.e., the second electronic device), so that the user can adjust the interface content to be transferred to the secondary device at any time.
[0270] In other embodiments, the master device may display an option to remove the draggable icon for the user to select when the master device (i.e., the first electronic device) and the slave device (i.e., the second electronic device) start a distributed display. Fig.12 As shown in (a) of FIG. 1 , in response to the user clicking to remove the draggable icon 1201, the master device removes the draggable icon (eg, “transmission corner” 1202) and the icon 1201 at the same time. In other examples, such as Fig.12 As shown in (b) in FIG. 1 , if the main device does not receive an operation of the user clicking the icon 1201 within a preset time (eg, within 10 seconds), the main device removes the icon 1201 but still displays the “transmission corner” 1202 .
[0271] It should be noted that this application Fig.10 (a) Fig.10 The prompt box 1004 shown in (b) is only an example, and the present application does not limit the specific display form of the prompt box, including the display position and size of the prompt box on the display screen, the specific language expression in the prompt box, etc. Fig.11A (a) Fig.11A (b) Fig. 11B (a) and Fig. 11B The "transmission angle" 1102 in (b) is Fig.12 (a) and Fig.12 The "transmission angle" 1202 in (b) is only an example of a draggable icon. The present application does not limit the specific display form of the draggable icon, including the icon form of the draggable icon, the display position and size on the display screen, etc.
[0272] In addition, this application Fig.12 (a) and Fig.12(b) in the figure takes the example of the option of removing the draggable icon being displayed suspended above the draggable icon. The present application does not limit the specific display form of the option of removing the draggable icon. For example, the option can also be displayed in other positions independently of the draggable icon. Also, the option of removing the draggable icon can also be displayed to the user in other forms of icons.
[0273] Method 2: Determine the master device and slave device based on the motion data of the electronic device.
[0274] Among them, this method is applicable to the "touch and pay" operation.
[0275] Taking the operation of a user holding a first electronic device and "touching" a second electronic device (i.e., the first operation) as an example, illustratively, in response to the user's first operation, the first electronic device and / or the second electronic device may collect their own motion data. The motion data may include but is not limited to the motion direction, motion acceleration, motion speed, rotation direction, rotation angular velocity, and rotation angle of the device.
[0276] In some examples, it can be determined based on the motion data of the first electronic device and / or the second electronic device that the stationary device is the primary device and the moving device is the secondary device.
[0277] In other examples, it can be determined based on the motion data of the first electronic device and / or the second electronic device that a device with a small motion acceleration (such as less than a preset threshold) is a primary device, and a device with a large motion acceleration (such as greater than a preset threshold) is a secondary device.
[0278] In other examples, if the motion acceleration of the first electronic device and the second electronic device is the same, the primary device and the secondary device can be determined according to the user's selection. For example, the first electronic device and / or the second electronic device can pop up a prompt box (such as Fig.10 (a) or Fig.10 (b) in the figure) allows the user to select which device's interface content is extended to which device, that is, allows the user to select which device is the main device and which device is the secondary device.
[0279] In the present application, after determining the main device (ie, the first electronic device) and the secondary device (ie, the second electronic device), the main device (ie, the first electronic device) transfers part of the content on the first interface to the secondary device (ie, the second electronic device) for display.
[0280] The embodiment of the present application does not limit the number of task interfaces displayed on each second electronic device.
[0281] In some embodiments, when the first electronic device and the second electronic device are distributed and collaboratively displayed, each of the second electronic devices displays one of the above multiple task interfaces. Figure 4 When multiple task interfaces are shown in (a) of FIG. 1 , the second electronic device may display Figure 4 Any one of the live video interface, electronic handout interface, class communication group interface or memo interface shown in (a) of FIG. 1 . For another example, when the first electronic device and the second electronic device display the distributed collaborative Figure 4 When multiple task interfaces are shown in (b) in FIG. 1 , the second electronic device may display Figure 4 The memo interface or short message interface shown in (b) .
[0282] like Fig.13 As shown, Fig.13 The first electronic device is a laptop computer, the second electronic device is a tablet computer, and the laptop computer displays Figure 4 Taking the multi-task scenario of the electronic classroom shown in (a) as an example, an example diagram of a distributed display interface provided by an embodiment of the present application is introduced. Fig.13 As shown, in response to the user selecting "My Tablet" from the second electronic device list in the option box 902 by the mouse cursor, the user selecting the multi-task collaborative display operation, and the user selecting the operation of outputting audio through "My Tablet", the user clicks the operation of confirming the option, and the laptop triggers the multi-task distributed collaborative display. Fig.13 As shown, the laptop computer transfers the memo interface to the tablet computer for display, and the laptop computer displays the live video interface, the electronic handout interface and the class communication group interface.
[0283] in, Fig.13 In the distributed collaborative display example shown, in response to the user selecting "My Tablet" from the second electronic device list in option box 902 with the mouse cursor, the user selecting the multi-task collaborative display operation, and the operation of selecting to output audio through "My Tablet", the user clicking the OK option operation, the laptop computer can decouple the displayed multiple task interfaces, for example, decoupling the live video interface, the electronic handout interface, and the class communication group interface into one atomic capability (such as the first atomic capability), and decoupling the memo interface into another atomic capability (such as the second atomic capability). And, the memo interface corresponding to the second atomic capability is transferred to the tablet computer for display, and the laptop computer still displays the live video interface, the electronic handout interface, and the class communication group interface corresponding to the first atomic capability.
[0284] Another example Fig.14 As shown, Fig.14The first electronic device is a smartphone A, the second electronic device is a smartphone B, and smartphone A displays Figure 4 Taking the split screen display scene shown in (b) as an example, an example diagram of a distributed display interface provided by an embodiment of the present application is introduced. Fig.14 As shown, in response to the user selecting "my smartphone" from the second electronic device list in option box 902, the user selecting multi-task collaborative display, and selecting to output audio through "my smartphone", the user clicks on the confirmation option, and smartphone A triggers multi-task distributed collaborative display. Fig.14 As shown, smartphone A transfers the memo interface to smartphone B for display, and smartphone A displays the short message interface.
[0285] In some other embodiments, each second electronic device displays multiple of the multiple task interfaces. Figure 4 When multiple task interfaces are shown in (a) of FIG. 1 , the second electronic device may display Figure 4 Two or more of the live video interface, electronic handout interface, class communication group interface or memo interface shown in (a).
[0286] like Fig.15A As shown, Fig.15A The first electronic device is a laptop computer, the second electronic device is a tablet computer, and the laptop computer displays Figure 4 Taking the multi-task scenario of the electronic classroom shown in (a) as an example, an example diagram of a distributed display interface provided by an embodiment of the present application is introduced. Fig.15A As shown, in response to the user selecting "My Tablet" from the second electronic device list in the option box 902 by the mouse cursor, the user selecting the multi-task collaborative display operation, and the user selecting the operation of outputting audio through "My Tablet", the user clicks the operation of confirming the option, and the laptop triggers the multi-task distributed collaborative display. Fig.15A As shown, the laptop computer transfers the memo interface and the class communication group interface to the tablet computer for display, and the laptop computer displays the live video interface and the electronic handout interface.
[0287] Another example Fig. 15B As shown, Fig. 15BTaking the split-screen display scenario where the first electronic device is smartphone A and the second electronic device is smartphone B, as an example, an example diagram of an interface distributed display provided by an embodiment of the present application is introduced. Assuming that smartphone A displays a memo interface, a short message interface, and a video interface in split screen, in response to the user selecting "My Smartphone" from the second electronic device list in option box 902, the user selecting multi-task collaborative display, and selecting to output audio through "My Smartphone", the user clicks on the confirmation option, and smartphone A triggers the multi-task distributed collaborative display. Fig. 15B As shown, smartphone A transfers the video interface to smartphone B for display, and smartphone A displays the short message interface and the memo interface. The short message interface and the memo interface can be as shown in FIG. Fig. 15B The upper and lower split screen is shown on smartphone A. In an embodiment of the present application, after the multiple task interfaces displayed on the first electronic device are distributed and collaboratively displayed on the first electronic device and the second electronic device, that is, after one or more of the multiple task interfaces displayed on the first electronic device are transferred to the second electronic device, the first electronic device will reallocate the display layout of the remaining functional areas on the first electronic device. For example, the first electronic device will reallocate the functional areas of the display screen, and rearrange the remaining task interfaces in the reallocated functional areas. For example, assuming that the first electronic device sends the task interface of the first functional area to the second electronic device for display, the first electronic device will jointly render the remaining functional areas on the virtual screen of the first electronic device according to the successfully newly determined framework template, and send them to the display screen of the first electronic device for display.
[0288] Among them, the distributed display method of an interface provided by the embodiment of the present application can support but is not limited to the following specific methods of distributed display: method (1) the second electronic device displays the focused content on the first interface; method (2) the second electronic device displays the lower interface information of the first interface; method (3) the second electronic device displays the floating content or superimposed content on the first interface; and method (4) the second electronic device displays the task interface of the function area selected by the user on the first interface. The following will be combined with the accompanying drawings to specifically introduce the distributed display methods of interfaces based on the above four methods.
[0289] Method (1): The second electronic device displays the key content on the first interface.
[0290] In this application, the key focus content can be understood as the interface content that is of high concern to the user or the core content of the first interface. In some embodiments, the core content can be defined by business attributes or application attributes.
[0291] In some examples, the first electronic device can determine the interface content or core content on the first interface that is of high user interest based on the application attributes corresponding to the first interface. For example, for a map application interface, the interface content that is of high user interest is the interface content corresponding to the navigation window, and the core content of the map application interface is also the interface content corresponding to the navigation window. In this case, the interface content corresponding to the navigation window can be transferred from the display screen of the first electronic device to the second electronic device for display, and the first electronic device displays other relevant information remaining on the first interface (such as other optional routes, nearby supermarkets, banks, etc.).
[0292] For another example, for a video playback interface, the interface content that attracts the most attention from users is the interface content corresponding to the video playback frame, and the core content of the video playback interface is also the interface content corresponding to the video playback frame. In this case, the interface content corresponding to the video playback frame can be transferred from the display screen of the first electronic device to the second electronic device for display, and the first electronic device displays other related information remaining in the first interface (such as selected episodes, more video information).
[0293] Please refer to Fig.16 , Fig.16 FIG. 1 shows an example diagram of a distributed display of an interface provided by an embodiment of the present application. Fig.16 As shown in (a) of FIG. 1 , it is assumed that a video playback interface 1601 (i.e., the first interface) is displayed vertically on a smartphone 1601 (i.e., the first electronic device). The interface content corresponding to the video playback frame 1602 is the focus content on the video playback interface 1601 (i.e., the first interface), and the remaining content is video-related content. In this case, Fig.16 As shown in (b), the smart phone 1601 can transfer the interface content corresponding to the video playback box 1602 to the tablet computer 1603 (i.e., the second electronic device) for playback, and the remaining video-related content is still displayed on the smart phone 1601 (i.e., the first electronic device).
[0294] It should be noted that, in the present application, the interface content on the first interface that is transferred and has a high degree of user attention or the core content of the first interface (such as Fig.16 The video playback frame 1602 shown in (b) can be displayed in full screen on the second electronic device (such as the tablet computer 1603), or can be displayed in the form of a window display on the second electronic device, which is not limited in this application.
[0295] For example, see Fig.17 , Fig.17The smartphone 1601 (i.e., the first electronic device) transfers the video play frame 1602 on the vertical video play interface 1601 (i.e., the first interface) to the tablet computer 1603. The tablet computer 1603 displays the video play frame 1602 transferred from the smartphone 1601 in the form of a video play window (i.e., Fig.17 1701). The video play window 1701 displays a window adjustment button, a close button, and a drag button. The window adjustment button is used to adjust the shape and size of the video play window 1701; the close button is used to close the video play window 1701 on the smart phone 1603 (i.e., the second electronic device); and the drag button is used to change the position of the video play window 1701 by dragging.
[0296] in, Fig.16 or Fig.17 The scenario in which the first electronic device transfers the video playback frame to the second electronic device is applicable to any of the above embodiments of the present application. Fig.16 or Fig.17 The distributed display scheme of the interface shown in the figure allows the user to watch a video on the tablet computer 1603 while browsing video-related content on the smart phone 1601. This greatly improves the convenience of the user in watching videos and browsing other video-related information.
[0297] For another example, in some embodiments of the present application, the first electronic device determines the first functional area according to the functions implemented by the multiple functional areas, and determines the task interface to be transferred from the first electronic device to the second electronic device. For example, the task interface on the functional area that implements the main function (i.e., the interface of the focused content on the first interface) can be displayed preferentially on a large-screen device; the task interface on the functional area that implements the secondary function can be displayed preferentially on a small-screen device. Among them, the main function can be understood as the function that can be achieved by the task that is of high concern to the user. Figure 4 The electronic lecture interface and live video interface shown in (a).
[0298] In some embodiments, the user can also return to the current video playback interface on the smart phone 1601 to browse its upper level interface. In other embodiments, the user can also click an option on the current video playback interface to enter the next level interface. In other embodiments, the user can also exit the current video playback interface and open the interface of other applications.
[0299] In some embodiments, the form in which the second electronic device (and secondary device) displays the interface content transferred from the first electronic device (i.e., the main device), including full-screen display form or window display form, can be determined by the application attributes corresponding to the first interface, and can also be customized or adjusted by the user, which is not limited in this application.
[0300] In some embodiments, the second electronic device can also accept user customized adjustments (such as dragging a corner of the window) to adjust the shape and size of the window, etc. For details, please refer to the conventional technology for adjusting the application window, which will not be described in detail here.
[0301] Method (two): the second electronic device displays the lower-level interface information of the first interface.
[0302] The lower-level interface information of the first interface can be understood as the hidden interface information of the first interface, such as the detailed interface information. It can be understood that the same application can include different application interfaces at different levels. The different levels can have a hierarchical relationship or no hierarchical relationship. In response to the user's operation on an interface, the interface can call the next level interface of the interface.
[0303] For example, the lower interface information of the first interface refers to the next level interface of part of the content on the first interface, such as the details interface information. Exemplarily, the first interface includes an electronic document list, and the electronic document list includes at least one electronic document. Among them, the electronic document list can be any of the following: an email list, a picture list, a short message list, or a memo list. The first electronic device can then send the corresponding email details interface, picture details interface, short message details interface, or memo details interface to the second electronic device for display. In some embodiments, the above-mentioned electronic document list may include at least one unread electronic document. For example, the electronic document list can be an email list or a short message list, etc.
[0304] Exemplarily, in some embodiments, the first electronic device displays a first interface, wherein the first interface includes an electronic document list, and the electronic document list includes at least one unread electronic document; after the first electronic device detects a touch operation with the second electronic device, it determines that the second electronic device is a secondary device of the first electronic device; then the first electronic device searches for the most recent unread electronic document among the at least one unread electronic document, and displays the details interface of the most recent unread electronic document on the second electronic device. After the first electronic device displays the details interface of the most recent unread electronic document on the second electronic device, the first electronic device continues to display the electronic document list, wherein the most recent unread electronic document in the electronic document list is marked as read.
[0305] In some embodiments, if the electronic document list includes at least one unread electronic document, the electronic document list may also include at least one read electronic document.
[0306] For example, the first interface includes a picture list, and the picture list includes thumbnails of multiple pictures. Then the lower interface information of the first interface can be a detailed interface of a picture (such as the picture selected by the user or the most recent picture). Fig.18 ,like Fig.18 As shown in (a) of FIG. 1 , it is assumed that a thumbnail interface 1802 (i.e., the first interface) of a gallery application is displayed on a tablet computer 1801 (i.e., the first electronic device). The thumbnail interface 1802 includes thumbnails of multiple pictures. In this case, it is assumed that the second electronic device (i.e., the secondary device) is a smartphone 1803. If the user selects (e.g., clicks) the thumbnail of picture A on the thumbnail interface 1802, Fig.18 As shown in (b), the tablet computer 1801 (i.e., the first electronic device) can transfer the next level interface of picture A (i.e., picture A details interface 1104) to the smart phone 1803 (i.e., the second electronic device) for display, and the tablet computer 1801 (i.e., the first electronic device) still displays the original thumbnail interface 1802 (i.e., the first interface).
[0307] pass Fig.18 In the distributed display scheme of the interface shown, the user can browse thumbnails on the tablet computer 1801 while viewing the picture details interface on the smart phone 1803. This greatly reduces the operation complexity of the user when using the gallery and improves the convenience of the user when using the gallery.
[0308] For another example, the first interface includes an email list, which includes a list of abbreviated emails (including unread emails and / or read emails). The lower interface information of the first interface may be a detailed interface of a certain email (such as the email selected by the user). Fig.19 ,like Fig.19 As shown in (a) of FIG. 1 , it is assumed that a tablet computer 1901 (i.e., the first electronic device) displays an email list interface 1902 (i.e., the first interface) of an email application. The email list interface 1902 includes thumbnail information of multiple emails. In this case, it is assumed that the second electronic device (i.e., the secondary device) is a smartphone 1903. If the user selects (e.g., clicks) the thumbnail information of email A on the email list interface 1902, Fig.19As shown in (b), the tablet computer 1901 (i.e., the first electronic device) can transfer the next level interface of email A (i.e., email A details interface 1904) to the smart phone 1903 (i.e., the second electronic device) for display, and the tablet computer 1901 (i.e., the first electronic device) still displays the original email list interface 1902 (i.e., the first interface).
[0309] Alternatively, it is assumed that the first electronic device displays an email list interface (i.e., the first interface) of an email application. The email list interface includes abbreviated information of multiple emails. The multiple emails include at least one unread email. In this case, if the first electronic device and the second electronic device establish a communication connection, the second electronic device can display the email details interface of the most recent unread email by default. That is, the first electronic device transfers the next-level interface (i.e., the email details interface) of the most recent unread email to the second electronic device for display, and the first electronic device still displays the original email list interface. The most recent unread email on the original email list interface is marked as read. Alternatively, it is assumed that the first electronic device displays an email list interface (i.e., the first interface) of an email application. The email list interface includes abbreviated information of multiple emails. The multiple emails include at least one unread email and at least one read email. In this case, if the first electronic device and the second electronic device establish a communication connection, the second electronic device can display the email details interface of the most recent email by default. That is, the first electronic device transfers the next level interface (i.e., the email details interface) of the most recent email to the second electronic device for display, and the first electronic device still displays the original email list interface. If the most recent email is an unread email, the most recent email on the original email list interface is marked as read.
[0310] It should be noted that, in the present application, if the first electronic device transfers the lower layer interface information of the first interface to the second electronic device, the lower layer interface information of the first interface can be displayed in full screen on the second electronic device (such as Fig.18 (b) and Fig.19 If the lower-layer interface information of the first interface is displayed on the second electronic device in the form of a window display, in some embodiments, the shape, size or position of the window can also be customized (for example, by dragging the window), which is not described in detail in this application.
[0311] by Fig. 20 As shown in the figure, the tablet computer 1901 transfers the next level interface of email A (ie, email A details interface 2001) to the smart phone 1903 (ie, the second electronic device) for display. Fig. 20As shown, the email A details interface 2001 is displayed in the form of a window display on the smart phone 1903 (ie, the second electronic device). Fig. 20 The window 2001 shown in (b) in FIG. 1 shows a window adjustment button, a close button and a drag button. The window adjustment button is used to adjust the shape and size of the window 2001; the close button is used to close the window 2001 on the smart phone 1903 (i.e., the second electronic device); and the drag button is used to change the position of the window 2001 by dragging.
[0312] pass Fig.19 or Fig. 20 In the distributed display scheme of the interface shown, the user can browse the thumbnail information of the email on the tablet computer 1901 while viewing the email details interface on the smart phone 1903. This greatly reduces the operation complexity of the user when processing emails and improves the convenience of the user when processing emails.
[0313] For another example, the first interface includes a short message list. If the first electronic device and the second electronic device have established a communication connection, and the short message list includes at least one short message, the first electronic device may send the most recent short message or the short message selected by the user to the second electronic device for display by default, and the first electronic device still displays the original short message list. Alternatively, further, if the short message list includes at least one unread short message, the second electronic device may send the most recent unread short message to the second electronic device for display by default, and the first electronic device still displays the original short message list, wherein the most recent unread short message on the original short message list interface is marked as read.
[0314] For another example, the first interface includes a memo list. If the first electronic device and the second electronic device establish a communication connection, and the short message list includes at least one memo note, the first electronic device can send the most recent memo note or the memo note selected by the user to the second electronic device for display by default, and the memo list will still be displayed on the first electronic device.
[0315] Method (three): The second electronic device displays the floating content or the superimposed content on the first interface.
[0316] In some embodiments, the floating content or overlay content on the first interface may be interface content corresponding to an auxiliary function, such as an input keyboard.
[0317] like Fig.21 As shown in (a) of FIG. 1 , it is assumed that a small video interface 2102 (i.e., the first interface) of Douyin is displayed on a smart phone 2101 (i.e., the first electronic device). Among them, the small video interface 2102 includes a video playback box and a comment area. When a user posts a comment in the comment area, the Douyin application will call the input keyboard. Among them, Fig.21 As shown in (a) of FIG. 1 , the input keyboard 2103 is displayed in a suspended or superimposed form on the small video interface 2102. In this case, it is assumed that the second electronic device (i.e., the secondary device) is a smart phone 2104. Fig.21 As shown in (b), the smartphone 2101 (i.e., the first electronic device) can transfer the input keyboard 2103 to the smartphone 2104 (i.e., the second electronic device) for playback, and the remaining short video related content (such as the video playback box and the comment area) is still displayed on the smartphone 2101 (i.e., the first electronic device).
[0318] pass Fig.21 The distributed display scheme of the interface shown in the figure allows users to watch short videos and make comments on smart phone 2101 while using smart phone 2104 as an input keyboard to make comments, which greatly improves the convenience of users watching short videos and making comments.
[0319] In some embodiments, in response to receiving a user editing operation on the detail interface of the most recent unread electronic document, the second electronic device sends an input keyboard to the first electronic device for display, and the second electronic device only displays the editing interface of the most recent unread electronic document.
[0320] For example, in other embodiments, in response to receiving an editing operation performed by a user on the details interface of a most recent unread electronic document, the second electronic device displays an input keyboard floating or superimposed on the editing interface of the most recent unread electronic document; and in response to detecting a touch operation with the first electronic device, the second electronic device sends the input keyboard to the first electronic device for display, and the second electronic device only displays the editing interface of the most recent unread electronic document.
[0321] Exemplarily, assuming that the electronic document list is an email list or a short message list, in response to receiving a user's reply operation to a most recent unread electronic document (such as an unread email or an unread short message), the second electronic device sends an input keyboard to the first electronic device for display, and the second electronic device only displays the reply interface of the most recent unread electronic document (such as an unread email or an unread short message). Alternatively, in response to receiving a user's reply operation to a most recent unread electronic document (such as an unread email or an unread short message), the second electronic device suspends or superimposes an input keyboard on the reply interface of the most recent unread electronic document (such as an unread email or an unread short message); and, in response to detecting a touch operation with the first electronic device, the second electronic device sends an input keyboard to the first electronic device for display, and the second electronic device only displays the reply interface of the most recent unread electronic document (such as an unread email or an unread short message). Fig. 22As shown in (a) of FIG. 1 , it is assumed that the tablet computer 1901 transfers the next level interface of email A (i.e., email A details interface 2001) to the smart phone 1903 (i.e., the second electronic device) for display, wherein the email A details interface 2001 is displayed in the form of a window display on the smart phone 1903 (i.e., the second electronic device). Further, it is assumed that the user clicks the edit button below the email A details interface 2001, and the smart phone 1903 (i.e., the second electronic device) sends the input keyboard to the tablet computer 1901 (i.e., the first electronic device) for display.
[0322] In some embodiments, assuming that the user clicks the edit button below the email A details interface 2001, Fig. 22 As shown in (b) , the smart phone 1903 (ie, the second electronic device) displays an input keyboard 2202 on the email A editing interface 2201 in a floating or superimposed manner.
[0323] Further, assuming that the tablet computer 1901 and the smart phone 1903 are in Fig. 22 When the tablet computer 1901 and / or the smart phone 1903 receives the first operation (e.g., “touch”) from the user, Fig. 22 As shown in (c) , the smartphone 1903 sends the input keyboard 2202 to the tablet computer 1901 for display, and the email A editing interface 2201 is still displayed on the smartphone 1903 .
[0324] For another example, suppose that the first electronic device transfers the next level interface (i.e., the short message details interface) of a short message (such as a default short message, the most recent unread short message, or a short message selected by the user) to the second electronic device for display. Furthermore, suppose that the user clicks the reply button on the short message details interface, then the second electronic device sends the input keyboard to the first electronic device for display. The short message reply interface is displayed on the second electronic device.
[0325] In some embodiments, assuming that the user clicks the reply button on the short message details interface, the second electronic device displays an input keyboard floating or superimposed on the short message editing interface. Further, assuming that the second electronic device receives the user's first operation (such as a touch operation with the first electronic device), the second electronic device sends the input keyboard to the first electronic device for display, and the short message reply interface is still displayed on the second electronic device.
[0326] For another example, suppose that the first electronic device transfers the next level interface (i.e., the memo note details interface) of a certain memo note (such as the most recent memo note or the memo note selected by the user) to the second electronic device for display. Furthermore, suppose that the user clicks the reply button on the memo note details interface, then the second electronic device sends the input keyboard to the first electronic device for display. The memo note editing interface is displayed on the second electronic device.
[0327] In some embodiments, assuming that the user clicks the edit button on the memo note details interface, the second electronic device displays the input keyboard floating or superimposed on the memo note editing interface. Further, assuming that the second electronic device receives the user's first operation (such as a touch operation with the first electronic device), the second electronic device sends the input keyboard to the first electronic device for display, and the memo note editing interface is still displayed on the second electronic device.
[0328] It should be noted that, in the present application, the floating content or superimposed content (such as Fig. 22 The input keyboard 2202 shown in (c) can be displayed on the tablet computer 1901 in a horizontal state or in a vertical state, which is not limited in this application.
[0329] pass Fig. 22 In the distributed display scheme of the interface shown, the user can view the email details interface on the smart phone 1903 while editing the email using the tablet computer 1901 as an input keyboard, which greatly improves the convenience of the user in processing emails.
[0330] Method (four) The second electronic device displays the task interface of the function area selected by the user on the first interface.
[0331] For example, in some other embodiments of the present application, the first electronic device can determine the first functional area according to the user's selection operation on the functional area on the first interface, and determine the task interface transferred from the first electronic device to the second electronic device. For example, the first electronic device can determine the functional area to which the touch screen area receiving the user's selection operation belongs, and determine all task interfaces on the functional area.
[0332] In some examples, the tablet computer 1901 can determine whether to display the input keyboard 2202 in a horizontal screen state or in a vertical screen state according to its device state. Fig. 22 As shown in (c) in FIG. 1 , the device state of the tablet computer 1901 is the horizontal screen state, and the tablet computer 1901 displays the input keyboard 2202 in the horizontal screen state. Assuming that the device state of the tablet computer 1901 is the vertical screen state, the tablet computer 1901 can display the input keyboard in the vertical screen state.
[0333] Another example: Fig.23 When the smartphone 2101 (i.e., the first electronic device) transfers the input keyboard 2103 displayed suspended or superimposed on the small video interface 2102 (i.e., the first interface) to the smartphone 2104, the smartphone 2104 can determine to display the input keyboard transferred from the smartphone 2101 in a horizontal screen state according to its device state. Fig.23 As shown in (b), the smartphone 2104 displays the input keyboard 2301 in a horizontal state, and the remaining short video related content (such as the video play box and the comment area) is still displayed on the smartphone 2101 (ie, the first electronic device).
[0334] pass Fig.23 The distributed display scheme of the interface shown in the figure allows users to watch short videos and make comments on smart phone 2101 while using smart phone 2104 as an input keyboard to make comments, which greatly improves the convenience of users watching short videos and making comments.
[0335] In some embodiments, after the content displayed on the first electronic device is distributed and collaboratively displayed on the first electronic device and the second electronic device, if there is a task interface remaining on the first electronic device (such as a task interface on the second functional area), the first electronic device can display the remaining task interface in full screen. Alternatively, the first electronic device can display the remaining task interface in a window of a preset size. Alternatively, the first electronic device can display the interface at the optimal display ratio of the remaining task interface, which is not limited in this application.
[0336] In other embodiments, after the content displayed on the first electronic device is distributed and collaboratively displayed on the first electronic device and the second electronic device, if there are two task interfaces remaining on the first electronic device (such as the task interface on the second functional area and the task interface on the third functional area), the two task interfaces can be displayed in a left-right split screen or in a top-bottom split screen, which is not limited in this application. Fig. 15B As shown, the remaining interfaces after the display of smartphone A is transferred, the short message interface and the memo interface are displayed in an upper and lower split screen on smartphone A.
[0337] In some embodiments, the first electronic device may determine the split-screen mode of the remaining content interface (such as the task interface on the second functional area and the task interface on the third functional area) according to the device state. For example, if the first electronic device is in a vertical state, the remaining content interface (such as the task interface on the second functional area and the task interface on the third functional area) may be displayed in an upper and lower split-screen mode. Fig. 15BIf the first electronic device is in landscape mode, the left and right split screens display the remaining content interface. In the embodiment of the present application, the interface transferred from the first electronic device to the second electronic device can be displayed in landscape mode on the second electronic device or in portrait mode on the second interface, which is not limited in the present application. For example, Fig. 15B The video interface transferred from smartphone A to smartphone B is displayed vertically on smartphone B. A window adjustment button, a close button, and a drag button are displayed on the video window. The window adjustment button is used to adjust the shape and size of the video window; the close button is used to close the video window; and the drag button is used to change the position of the video window by dragging.
[0338] In some embodiments, the second electronic device can determine the interface transferred from the first electronic device according to the device state. For example, if the second electronic device is in a vertical screen state, the vertical screen displays the interface transferred from the first electronic device (such as Fig. 15B If the second electronic device is in landscape mode, the interface transferred from the first electronic device is displayed in landscape mode (such as Fig. 15C shown).
[0339] In other embodiments, after the content displayed on the first electronic device is distributed and collaboratively displayed on the first electronic device and the second electronic device, if there are more than two task interfaces remaining on the first electronic device (such as the task interface on the second functional area and the task interface on the third functional area), the first electronic device can be arranged on the display screen of the first electronic device in a preset relative position relationship. For example, the first electronic device can determine (such as determined according to the number, attributes, functions, etc. of the task interfaces) using a suitable frame template to display the above-mentioned multiple task interfaces on the display screen of the first electronic device from a plurality of frame templates pre-set in the first electronic device. Similarly, if more than two task interfaces (i.e., multiple task interfaces) are displayed on the second electronic device, the second electronic device can determine (such as determined according to the number, attributes, functions, etc. of the task interfaces) using a suitable frame template to display the above-mentioned multiple task interfaces on the display screen of the first device from a plurality of frame templates pre-set in the second electronic device.
[0340] It should be noted that the above embodiment takes the distributed display of the multi-task interface by the first electronic device and a second electronic device as an example, and the present application does not limit the number of second electronic devices that cooperate with the first electronic device to display the multi-task interface.
[0341] For example, the first electronic device is a laptop computer, the second electronic device is a tablet computer and a smart phone, and the laptop computer displays Figure 4Taking the distributed collaborative scenario of the electronic classroom shown in (a) as an example, in response to the user selecting "My Tablet" from the second electronic device list in the option box 502 with the mouse cursor, the user selecting the multi-task collaborative display operation, and the operation of outputting audio through "My Tablet", the user clicks the operation of confirming the option, and the laptop triggers the multi-task distributed collaborative display. For example, the laptop transfers the memo interface to the tablet computer for display, transfers the class communication group interface to the smart phone for display, and the laptop displays the live video interface and the electronic handout interface.
[0342] Through the interface distributed display method provided in the embodiment of the present application, the content displayed on one electronic device (such as the first electronic device) can be distributed and collaboratively displayed on multiple different electronic devices (such as the first electronic device and the second electronic device), so that users can process different tasks through multiple electronic devices, which is convenient for user operation. In addition, it can solve the problems of incomplete task interface display and inconvenient operation caused by multiple tasks on one display screen.
[0343] In some embodiments, the window of the task interface displayed on the first electronic device and the second electronic device, or the task interface can accept the adjustment of the adaptability. The adjustment of the adaptability is used to adapt the display screen size of the device and the display effect of the task interface. The adjustment of the adaptability may include but is not limited to automatic adjustment of the device and adjustment of the device accepting user operations (such as drag operations). The adaptability may include but is not limited to stretching ability, scaling ability, hiding ability, line folding ability, equal division ability, proportion ability and extension ability.
[0344] Among them, stretching capability refers to the ability to change the shape and size of a window / interface. For example, the ability to change the shape and size of a window / interface through adaptive adjustment of the device or through the user's operation of stretching the window / interface. The stretching capability may include horizontal stretching capability and vertical stretching capability. Scaling capability refers to the ability to change the size of a window / interface without changing the shape of the window / interface. The ability to change the size of a window / interface through adaptive adjustment of the device or through the operation of dragging a corner of the window / interface by the user. Scaling capability may include the ability to reduce and enlarge. Hiding capability refers to the ability to adjust the display form of a window / interface. Hiding capability may include the ability to hide a window / interface and the ability to display a window / interface. For example, the ability to hide a window / interface or display a window / interface through adaptive adjustment of the device or through the user's selection operation. Line folding capability refers to the ability to adjust multiple windows / interfaces from one row to multiple rows. For example, the ability to adjust multiple windows / interfaces from one row to multiple rows through adaptive adjustment of the device or through the operation of dragging the window / interface by the user. Equal distribution capability refers to the ability to display multiple windows / interfaces in equally divided functional areas. For example, the ability to display multiple windows / interfaces in equally divided functional areas through device adaptive adjustment or through the user's selection of an equal division option. Proportion capability refers to the ability to adjust the ratio of the functional areas of multiple windows / interfaces on the device display to the display screen. For example, the ability to adjust the ratio of the functional areas of multiple windows / interfaces on the device display to the display screen through device adaptive adjustment or through a ratio input by the user. Extension capability refers to the ability to adjust the display of multiple windows / interfaces from multiple rows (such as two rows) to one row. For example, the ability to adjust the display of multiple windows / interfaces from multiple rows (such as two rows) to one row through device adaptive adjustment or through the user's dragging of windows / interfaces.
[0345] Please refer to Fig.24 , Fig.24 The following diagram shows several examples of adaptation capabilities provided by the embodiments of the present application. Fig.24 (a) shows the stretching ability, Fig.24 (b) shows the scaling capability, Fig.24 (c) in the figure shows the hidden capability. Fig.24 (d) in the figure shows the line-folding capability. Fig.24 (e) in the figure shows the ability to share equally, Fig.24 (f) in the figure shows the proportion capability. Fig.24 (g) in the figure shows the extension capability. Fig.24 The several adaptation capabilities shown are only examples. The adaptation capabilities described in the embodiments of the present application may also include other window / interface adjustment capabilities for adapting the display screen size of the device and the display effect of the task interface.
[0346] In an embodiment of the present application, multiple task interfaces can be rendered together on the virtual screen of the first electronic device and sent to the first electronic device for display. For example, the first electronic device renders different task interfaces in different functional areas of the virtual screen according to a preset framework template.
[0347] In an embodiment of the present application, the first electronic device can determine the first functional area from the multiple functional areas by any of the following methods: automatically determining the first functional area according to task attributes corresponding to multiple task interfaces; determining the first functional area according to a user's selection operation on one or more task interfaces, wherein the one or more task interfaces are located in the first functional area; automatically determining the first functional area according to functions implemented by multiple functional areas; determining the first functional area according to a user's selection operation on the functional area.
[0348] In some embodiments of the present application, the first electronic device determines the first functional area according to the task attributes of the content of the functional area on the first interface, and determines the task interface to be transferred from the first electronic device to the second electronic device. The task interface is the task interface on the functional area determined by the first electronic device. For example, for the key task interface or the main task interface, it can be displayed on a large-screen device first; for the secondary task interface, it can be displayed on a small-screen device first. The key task interface or the main task interface can be understood as a task interface that is of high concern to the user or a core task interface in a multi-task interface displayed by the first electronic device. Figure 4 For another example, assuming that the second electronic device is a large-screen device (such as a TV or a laptop), the first electronic device can send content suitable for display on the large-screen device (such as a video playback interface on the video function area) to the second electronic device for display.
[0349] In other embodiments of the present application, the first electronic device determines the first functional area according to the user's selection operation (such as a click operation, a drag operation, etc.) of the functional area on the first interface, and determines the task interface transferred from the first electronic device to the second electronic device. The task interface is the task interface on the functional area selected by the user.
[0350] For example, in response to a user selecting an interface on the multi-task interface according to a reminder from the first electronic device, the first electronic device transfers the task interface selected by the user to the second electronic device for display. Fig.25 As shown, the first electronic device can respond to the user selecting "my tablet" from the second electronic device list in the option box 902, the user selecting the multi-task collaborative display operation, and the user selecting the operation of outputting audio through "my tablet", and the user clicking the operation of confirming the option, the first electronic device displays Fig.25The prompt box 2501 shown is used to prompt the user to select the task interface to be transferred to the second electronic device (ie, “my tablet computer”) through a click operation on the multitasking interface.
[0351] In some embodiments, when the first electronic device determines the content to be transferred to the second electronic device, the first electronic device can transfer the corresponding content to the second electronic device, and re-render the remaining content (such as the remaining task interface) to the virtual screen of the first electronic device and re-display it to the first electronic device. For example, the first electronic device re-renders the remaining task interface to a different area of the virtual screen according to the re-determined frame template.
[0352] In some embodiments, during the process of the first electronic device and the second electronic device collaboratively displaying the multitasking interface, the first electronic device can retrieve the content transferred to the second electronic device at any time. For example, the first electronic device can respond to the user (i.e., the task interface transferred to the second electronic device).
[0353] For example, the user can click Fig. 9 (c) or Fig. 9 The corresponding device button in the option box 902 shown in (c) in FIG. 1 is used to retrieve the task interface transferred to the second electronic device. Fig.26 As shown, it is assumed that the laptop computer and the tablet computer display a multi-task interface in a distributed collaborative manner, wherein the laptop computer displays a live video interface, an electronic handout interface, and a class communication group interface, and the tablet computer displays a memo interface. In response to the user clicking again on the "My Tablet Computer" operation in the option box 502 displayed on the laptop computer, the laptop computer retracts the memo interface transferred to the tablet computer. After the laptop computer retracts the memo interface transferred to the tablet computer, the laptop computer displays the live video interface, the electronic handout interface, the class communication group interface, and the memo interface (i.e., the first interface).
[0354] For example, users can click Fig. 9 (b) or Fig. 9 In the option box 902 shown in (c), the task interface transferred to the second electronic device is retrieved. Fig. 27 As shown, it is assumed that smartphone A and smartphone B display multitasking interfaces in a distributed collaborative manner, wherein smartphone A displays a short message interface and smartphone B displays a memo interface. In response to the user clicking the button retract key 903 on smartphone A that hides the option box, smartphone A displays an option box 902. In response to the user clicking "Retract to main device" in option box 902, smartphone A retracts the memo interface transferred to smartphone B. After smartphone A retracts the memo interface transferred to smartphone B, smartphone A displays the short message interface and the memo interface (i.e., the first interface).
[0355] It is understandable that the electronic device (such as the first electronic device or the second electronic device) includes hardware structures and / or software modules corresponding to the execution of each function in order to implement the functions of any of the above-mentioned embodiments. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0356] The embodiment of the present application can divide the electronic device (such as the first electronic device or the second electronic device) into functional modules. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0357] For example, when the functional modules are divided in an integrated manner, Fig.28 , which is a structural block diagram of an electronic device provided in an embodiment of the present application. The electronic device may be a first electronic device or a second electronic device. The electronic device may include a processing unit 2810, a transceiver unit 2820, and a display 2830.
[0358] When the electronic device is a first electronic device, the display unit 2830 is used to support the first electronic device to display a first interface of a first application program including at least a first functional area and a second functional area. The processing unit 2810 is used to support the first electronic device to send the content of the first functional area to the second electronic device for display through the transceiver unit 2820 in response to the detected touch operation when the touch operation of the second electronic device is detected. The transceiver unit 2820 will send the content of the first functional area to the second electronic device for display. After the transceiver unit 2820 sends the content of the first functional area to the second electronic device for display, the first electronic device displays the second interface of the first application program, and the second interface includes the second functional area but does not include the first functional area.
[0359] Alternatively, when the electronic device is a first electronic device, the display unit 2830 is used to support the first electronic device to display a first interface including a list of electronic documents. The list of electronic documents includes at least one unread electronic document and at least one read electronic document. The processing unit 2810 is used to support the first electronic device to detect a touch operation with the second electronic device on the first electronic device, determine that the second electronic device is a secondary device of the first electronic device; and search for the most recent unread electronic document among the at least one unread electronic document, and display the details interface of the most recent unread electronic document on the second electronic device. The transceiver unit 2820 is used to support the first electronic device to send the details interface of the most recent unread electronic document to the second electronic device for display. After the transceiver unit 2820 sends the details interface of the most recent unread electronic document to the second electronic device for display, the display unit 2830 continues to display the list of electronic documents, wherein the most recent unread electronic document in the list of electronic documents is marked as read.
[0360] It should be noted that the above-mentioned transceiver unit 2820 may include a radio frequency circuit. Specifically, the electronic device may receive and send wireless signals through the radio frequency circuit. Generally, the radio frequency circuit includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency circuit may also communicate with other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to global system for mobile communications, general packet radio service, code division multiple access, wideband code division multiple access, long term evolution, email, short message service, etc.
[0361] It should be understood that each module in the electronic device can be implemented in software and / or hardware form, and there is no specific limitation on this. In other words, the electronic device is presented in the form of functional modules. The "module" here can refer to a specific application integrated circuit ASIC, a circuit, a processor and a memory that executes one or more software or firmware programs, an integrated logic circuit, and / or other devices that can provide the above functions. Optionally, in a simple embodiment, a person skilled in the art can imagine that the electronic device can adopt Fig.29 The processing unit 2810 can be Fig.29 The transceiver unit 2820 can be implemented by the processor 2910 shown in FIG. Fig.29 Specifically, the processor is implemented by executing a computer program stored in the memory. Optionally, the memory is a storage unit in the chip, such as a register, a cache, etc. The storage unit may also be a storage unit in the computer device located outside the chip, such as Fig.29 Memory 2930 is shown.
[0362] In an optional manner, when data transmission is implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is implemented in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server, or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.
[0363] The steps of the method or algorithm described in conjunction with the embodiments of the present application can be implemented in hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a mobile hard disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in an electronic device. Of course, the processor and the storage medium can also be present in an electronic device as discrete components.
[0364] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0365] In an optional manner, the present application provides a communication system, which includes a first electronic device and a second electronic device, and the first electronic device and the second electronic device are used to implement a method in any possible implementation manner provided in the present application.
[0366] In an optional manner, the present application provides a chip system, which includes a processor and a memory, wherein instructions are stored in the memory; when the instructions are executed by the processor, the method in any possible implementation manner provided by the present application is implemented. The chip system can be composed of a chip, or can include a chip and other discrete devices.
[0367] In the several embodiments provided in the present application, it should be understood that the disclosed electronic devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0368] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0369] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0370] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program code.
[0371] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A distributed display method of an interface, characterized in that: The method comprises: The first electronic device displays a first interface of a first application, wherein the first interface includes at least a first function area and a second function area; The first electronic device detects a touch operation with the second electronic device; In response to the touch operation, the first electronic device sends the content of the first functional area to the second electronic device for display; The first electronic device displays a second interface of the first application, where the second interface includes the second function area but does not include the first function area.
2. The method according to claim 1, characterized in that After the first electronic device sends the content of the first function area to the second electronic device for display, the method further includes: The first electronic device reallocates the display layout of the remaining functional areas on the first electronic device.
3. The method according to claim 1 or 2, characterized in that: The first function area is determined by the first electronic device according to a user's selection operation on the function area; or, the first function area is determined by the first electronic device itself according to the function realized by the function area on the first interface.
4. The method according to claim 1 or 2, characterized in that: The first function area is determined by the first electronic device according to a user's selection operation on the content of the function area; or, The first function area is determined by the first electronic device according to the task attribute of the content of the function area on the first interface.
5. The method according to claim 1 or 2, characterized in that: The first function area and the second function area on the first interface are arranged on the first electronic device in a preset relative position relationship.
6. The method according to claim 1 or 2, characterized in that: The first functional area and the second functional area support adjustment of adaptation capabilities; the adaptation capabilities include: stretching capability, scaling capability, hiding capability, line breaking capability, equal division capability, proportion capability and extension capability.
7. The method according to claim 1 or 2, characterized in that: The method further comprises: The first electronic device, in response to a user triggering an operation of retracting the collaborative display, retracts the content of the first functional area from the second electronic device; After the first electronic device retrieves the content of the first function area from the second electronic device, the first electronic device displays a first interface of the first application, where the first interface includes at least the first function area and the second function area.
8. The method according to claim 1 or 2, characterized in that: The content of the first function area and the content of the second function area on the first interface are jointly rendered on the virtual screen of the first electronic device by the first electronic device in the form of one or more atomic services according to a preset framework template.
9. The method according to claim 8, characterized in that The first electronic device sending the content of the first functional area to the second electronic device for display, including: The first electronic device sends a standard video stream corresponding to the content of the first functional area on the virtual screen to the second electronic device for display.
10. A first electronic device, characterized in that: The first electronic device comprises: A memory for storing computer program code, wherein the computer program code includes instructions; Radio frequency circuit, used for sending and receiving wireless signals; a processor, configured to execute the instruction so that the first electronic device displays a first interface of a first application, wherein the first interface includes at least a first function area and a second function area; and When a touch operation with a second electronic device is detected, in response to the touch operation, the content of the first function area is sent to the second electronic device for display; After the first electronic device sends the content of the first function area to the second electronic device for display, the first electronic device displays a second interface of the first application, where the second interface includes the second function area but does not include the first function area.
11. The first electronic device according to claim 10, characterized in that: The processor is further configured to execute the instruction so that the first electronic device reallocates the display layout of the remaining functional areas on the first electronic device after sending the content of the first functional area to the second electronic device for display.
12. The first electronic device according to claim 10 or 11, characterized in that: The first function area is determined by the processor executing the instruction according to the user's selection operation on the function area; or, it is determined automatically according to the function implemented by the function area on the first interface.
13. The first electronic device according to claim 10 or 11, characterized in that: The first function area is determined by the processor executing the instruction according to the user's selection operation on the content of the function area; or, it is determined automatically according to the task attribute of the content of the function area on the first interface.
14. The first electronic device according to claim 10 or 11, characterized in that: The first function area and the second function area on the first interface are arranged on the first electronic device in a preset relative position relationship.
15. The first electronic device according to claim 10 or 11, characterized in that: The first functional area and the second functional area support adjustment of adaptation capabilities; the adaptation capabilities include: stretching capability, scaling capability, hiding capability, line breaking capability, equal division capability, proportion capability and extension capability.
16. The first electronic device according to claim 10 or 11, characterized in that: The processor is further configured to execute the instruction so that the first electronic device, in response to a user triggering an operation of retracting the collaborative display, retracts the content of the first functional area from the second electronic device; After the first electronic device retrieves the content of the first function area from the second electronic device, the first electronic device displays a first interface of the first application, where the first interface includes at least the first function area and the second function area.
17. The first electronic device according to claim 10 or 11, characterized in that: The contents of the first function area and the contents of the second function area on the first interface are jointly rendered on the virtual screen of the first electronic device in the form of one or more atomic services according to a preset framework template by the processor executing the instructions.
18. The first electronic device according to claim 17, characterized in that: The processor is specifically configured to: The instruction is executed so that the first electronic device sends the standard video stream corresponding to the content of the first functional area on the virtual screen to the second electronic device for display.
19. A distributed display method of an interface, characterized in that: The method comprises: The first electronic device displays a first interface, where the first interface includes at least a first application interface, a second application interface, and a third application interface; The first electronic device detects a touch operation with the second electronic device; In response to the touch operation, the first electronic device sends the content of the first application interface to the second electronic device for display; The first electronic device displays a second interface, which includes the second application interface and the third application interface but does not include the first application interface.
20. The method according to claim 19, characterized in that After the first electronic device sends the content of the first application interface to the second electronic device for display, the method further includes: The first electronic device reallocates display layouts of remaining application interfaces on the first electronic device.
21. The method according to claim 19 or 20, characterized in that The first application interface is determined by the first electronic device according to a user's selection operation on the application interface; or, the first application interface is determined by the first electronic device according to functions implemented by the first application interface, the second application interface and the third application interface.
22. The method according to claim 19 or 20, characterized in that The windows of the first application interface, the second application interface and the third application interface support adjustment of adaptability; the adaptability includes: stretching capability, scaling capability, hiding capability, line breaking capability, equal division capability, proportion capability and extension capability.
23. The method according to claim 19 or 20, characterized in that The method further comprises: The first electronic device retracts the first application interface from the second electronic device in response to the user triggering an operation of retracting the collaborative display; After the first electronic device retracts the first application interface from the second electronic device, the first electronic device displays the first interface, which at least includes the first application interface, the second application interface, and the third application interface.
24. A first electronic device, characterized in that: The first electronic device comprises: A memory for storing computer program code, wherein the computer program code includes instructions; Radio frequency circuit, used for sending and receiving wireless signals; A processor is used to execute the instructions so that the first electronic device implements the method as described in any one of claims 19-23.
25. A communication system, characterized in that: The communication system comprises: The first electronic device as claimed in any one of claims 10 to 18, or the first electronic device as claimed in claim 24; and a second electronic device.
26. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by the processing circuit, the method according to any one of claims 1-9 or 19-23 is implemented.
27. A computer program product, characterized in that The computer program product comprises program instructions, and when the program instructions are executed, the method according to any one of claims 1-9 or 19-23 is implemented.
Citation Information
Patent Citations
Methods and systems for using external display devices with a mobile computing device
CN102027450A
An application display method and a mobile terminal
CN109271121A
Display control method and device
CN110515576A