Display control method and apparatus

By automatically recognizing and projecting the running interface of mobile phone background applications onto the computer display interface in screen mirroring mode, the problem of low control efficiency and poor user experience in existing screen mirroring technology is solved, and multiple applications can be displayed and controlled simultaneously.

CN113826067BActive Publication Date: 2026-01-27HUAWEI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202080035558.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-07-08
Filing Date
2020-07-08
Publication Date
2026-01-27
Estimated Expiration
2040-07-08

AI Technical Summary

Technical Problem

In existing screen mirroring technologies, a mobile phone can only project one application that the user clicks onto the computer screen, resulting in low control efficiency and a poor user experience.

Method used

When the phone is confirmed to be in screen mirroring mode, it automatically identifies and projects the running interface of a background application with the same attributes as the foreground application onto the computer display screen, allowing the user to control the display of the application by operating the computer interface.

Benefits of technology

It improves the efficiency of application display control, enhances the user experience when casting to the screen, and meets the user's need to view multiple applications with the same attributes simultaneously.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113826067B_ABST
    Figure CN113826067B_ABST
Patent Text Reader

Abstract

A display control method and device are applied to a first device (1) supporting screen projection. When the first device (1) determines that it is in a state of projecting to a second device (2), after the first device (1) receives a first instruction of running a first application in the foreground, when it is determined that the first device (1) is in a display state of projecting to the second device (2), the first device (1) determines at least one second application with the same attribute information running in the background in the first device (1) according to the first instruction, and projects the running interface of the first application and the running interface of the determined at least one second application to the display interface of the second device (2) for display, thereby improving the display control efficiency of the application and improving the user experience of the user when using the first device (1) to project and display to the second device (2).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority to Chinese Patent Application No. 2019106112766, filed on July 8, 2019, entitled “Display Control Method and Apparatus”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to electronic technology, and more particularly to a display control method and apparatus. Background Technology

[0003] With the continuous development of electronic and terminal technologies, traditional mobile phones and other electronic devices, due to their small screens, can no longer meet users' display requirements. Therefore, screen mirroring technology allows mobile phones to project their display interface onto electronic devices with larger screens. For example, a mobile phone can project its display interface onto a computer, which then displays it on its screen. Screen mirroring technology enables mobile phones to project more content onto a computer's display.

[0004] In existing technology, after a mobile phone establishes a screen mirroring connection with a computer, it can project application icons from its screen to the computer, where they are displayed. The user can then use the computer's mouse to click the icons on the computer's screen to open the corresponding application on the phone. After the phone runs the application based on the user's input, it continues to project the application's running interface to the computer, where it is displayed.

[0005] However, in existing screen mirroring technologies, a mobile phone can only project one application that the user clicks onto the computer at a time, which is then displayed on the computer's screen. This results in low control efficiency when controlling the display of applications and a poor user experience when screen mirroring. Summary of the Invention

[0006] This application provides a display control method and apparatus, applied to a first device that supports screen projection. When the first device determines that it is in a state of projecting to a second device, after receiving a first instruction from a first application running in the foreground, and determining that the first device is in a display state of projecting to the second device, the first device determines at least one second application with the same attribute information running in the background of the first device according to the first instruction, and simultaneously projects the running interface of the first application and the running interface of the determined at least one second application to the second device, which then displays them on its display interface. This improves the display control efficiency of the application and enhances the user experience when using the first device to project to the second device.

[0007] The first aspect of this application provides a display control method, including:

[0008] The first device receives a first instruction; the first instruction is used to instruct the first device to run a first application in the foreground;

[0009] When it is determined that the first device is in a display state of projecting screen to the second device, the first device determines at least one second application in the first device according to the first instruction; the attribute information of the second application and the first application are the same, and the second application is in a background running state;

[0010] The first device projects the running interface of the first application and the running interface of the determined at least one second application to the second device;

[0011] The second device displays the running interface of the first application and the running interface of the determined at least one second application on the display interface.

[0012] In summary, the display control method provided in this embodiment can, when the first device, which supports screen projection, projects a display to the second device, upon receiving an instruction from the first device to run a first application in the foreground, determine at least one second application with the same attribute information running in the background on the first device. This allows the first device to automatically project more applications with the same attribute information to the second device based on the user's viewing needs for an application. Consequently, the second device can simultaneously display the running interface of the first application and the running interface of at least one second application with the same attribute information on its display screen, thereby more intelligently meeting the user's need to view applications with the same attribute information simultaneously.

[0013] In one embodiment of the first aspect of this application, the first device projects the running interface of the first application and the running interface of the determined at least one second application onto the display interface of the second device for display, including:

[0014] The first device projects the running interface of the first application and the first control onto the display interface of the second device for display.

[0015] The second device receives a first target operation from the user on the first control;

[0016] The second device sends a second instruction to the first device according to the first target operation;

[0017] The first device receives the second instruction;

[0018] The first device projects the running interface of the first application and the running interface of the determined at least one second application to the second device according to the second instruction;

[0019] The second device displays the running interface of the first application and the running interface of the determined at least one second application on the display interface.

[0020] In summary, in the display control method provided in this embodiment, the first device only projects the running interface of the first application and the running interfaces of all second applications to the second device simultaneously after the second device detects the first target operation on the first control, and the second device displays them on its display interface. This embodiment can meet the needs of different application scenarios. Only after the user clicks the first control, and the second device detects the first target operation on the first control and sends a second instruction to the first device, does the first device expand at least one second application according to the second instruction. This enriches the functions that the display control method can provide, further improves the efficiency of display control of applications, and improves the user experience when using the first device and the second device for screen projection.

[0021] In one embodiment of the first aspect of this application, the first device projects the running interface of the first application and the first control onto the display interface of the second device for display, including:

[0022] The first device projects the running interface of the first application, the first control, and the running interface of at least one second application (which is displayed in a collapsed manner) onto the second device;

[0023] The second device displays the running interface of the first application, the first control, and the running interface of the at least one second application in a collapsed display on the display interface.

[0024] The first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device according to the second instruction, including:

[0025] According to the second instruction, the first device projects the running interface of the at least one second application, which is displayed in a tiled manner, and the running interface of the first application onto the second device.

[0026] In summary, the display control method provided in this embodiment enables the first device to project a screen onto the second device. When the first device receives an instruction to run a first application in the foreground, it determines that at least one second application with the same attribute information is running in the background on the first device. Instead of directly projecting the running interfaces of all applications onto the second device, it only displays the running interface of the first application corresponding to the instruction, while folding the second applications. This prompts the user that there are folded background applications of the same type. Only after the second device detects the first target operation on the first control does the first device further project the running interface of the first application and the running interfaces of all second applications onto the display interface of the second device simultaneously.

[0027] In one embodiment of the first aspect of this application, the first device projects the running interface of the first application and the running interface of the determined at least one second application onto the display interface of the second device according to the second instruction, including:

[0028] The first device projects the running interface of the first application, the running interface of the determined at least one second application, and the second control to the second device according to the second instruction.

[0029] The second device displays the running interface of the first application, the running interface of the determined at least one second application, and a second control on the display interface;

[0030] After the first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device according to the second instruction, it further includes:

[0031] The second device receives a second target operation from the user on the second control;

[0032] The second device sends a third instruction to the first device according to the second target operation;

[0033] The first device receives the third instruction.

[0034] According to the third instruction, the first device projects the running interface of the first application, the first control, and the running interface of at least one second application (which is displayed in a collapsed manner) to the second device;

[0035] The second device displays the running interface of the first application, the first control, and the running interface of the at least one second application in a collapsed display on the display interface.

[0036] In summary, the display control method provided in this embodiment can further display a second control on the display interface after the first device projects the running interface of the first application and the running interface of at least one second application onto the display interface. After the second device detects a third target operation of the second control, the first device then projects the at least one collapsed second application onto the second device. This achieves a more flexible display control method and further improves the user experience of the electronic device.

[0037] In one embodiment of the first aspect of this application, before the first device receives the first instruction, it further includes:

[0038] The first device projects the third control corresponding to the first application to the second device;

[0039] The second device displays the third control on the display interface;

[0040] The second device receives a third target operation from the user on the third control;

[0041] The second device sends the first instruction to the first device according to the third target operation.

[0042] In one embodiment of the first aspect of this application, the attribute information includes: the category to which the application belongs, keywords in the application name, or tag information of the application.

[0043] In one embodiment of the first aspect of this application, when the first device projects the running interface of at least one second application running in the background onto the second device, the running interface of each second application is the same as the running interface of the second application before it was switched to the background running state.

[0044] In summary, in the display control method provided in this embodiment, when the first device projects at least one determined second application onto the second device for display, it specifically projects the interface of the second application that was running in the background before switching it to the previous background running state. This enables real-time display of the second application when controlling its display. In application scenarios such as price comparison, this allows for more flexible application display control, further improving the user experience.

[0045] A second aspect of this application provides a screen projection system, comprising:

[0046] A first device and a second device; the first device has screen mirroring capability and supports screen mirroring to the second device;

[0047] The first device is used for:

[0048] Receive a first instruction; the first instruction is used to instruct the first device to run a first application in the foreground.

[0049] When it is determined that the screen is being projected onto the second device, at least one second application in the first device is identified according to the first instruction; the attribute information of the second application and the first application are the same, and the second application is running in the background;

[0050] The running interface of the first application and the running interface of the determined at least one second application are projected onto the second device;

[0051] The second device is used to display the running interface of the first application and the running interface of the determined at least one second application on a display screen.

[0052] In one embodiment of the second aspect of this application, the first device is specifically used to project the running interface of the first application and the first control onto the display interface of the second device for display.

[0053] The second device is configured to receive a first target operation from the user on the first control, and send a second instruction to the first device according to the first target operation;

[0054] The first device is specifically used to receive the second instruction and project the running interface of the first application and the running interface of the determined at least one second application to the second device according to the second instruction.

[0055] The second device is specifically used to display the running interface of the first application and the running interface of the determined at least one second application on a display screen.

[0056] In one embodiment of a second aspect of this application, the first device is specifically used for,

[0057] The running interface of the first application, the first control, and the running interface of the at least one second application (displayed in a collapsed manner) are projected onto the second device.

[0058] The second device is specifically used to display the running interface of the first application, the first control, and the running interface of the at least one second application displayed in a collapsed manner on a display interface.

[0059] In one embodiment of a second aspect of this application, the first device is specifically used for,

[0060] According to the second instruction, the running interface of the at least one second application, which is displayed in a tiled manner, is projected onto the second device along with the first application;

[0061] The second device displays the running interface of the first application and the running interface of the at least one second application side by side on the display interface.

[0062] In a second aspect of this application, the first device is specifically configured to, according to the second instruction, project the running interface of the first application, the running interface of the determined at least one second application, and the second control onto the second device.

[0063] The second device is further configured to display the running interface of the first application, the running interface of the determined at least one second application, and a second control on a display interface;

[0064] The second device is further configured to receive a second target operation from the user on the second control, and send a third instruction to the first device according to the second target operation;

[0065] The first device is specifically used to receive the third instruction and, according to the third instruction, project the running interface of the first application, the first control, and the running interface of at least one second application (which is displayed in a collapsed manner) to the second device.

[0066] The second device is specifically used to display the running interface of the first application, the first control, and the running interface of the at least one second application displayed in a collapsed manner on a display interface.

[0067] In one embodiment of the second aspect of this application, the first device is further configured to project a third control corresponding to the first application to the second device;

[0068] The second device is also used to display the third control on a display interface;

[0069] The second device is further configured to receive a third target operation from the user on the third control, and send the first instruction to the first device according to the third target operation.

[0070] In one embodiment of the second aspect of this application, the attribute information includes: the category to which the application belongs, keywords in the application name, or tag information of the application.

[0071] In one embodiment of the second aspect of this application, the first device projects the running interface of at least one second application running in the background onto the second device, wherein the running interface of each second application is the same as the running interface of the second application before it was switched to the background running state.

[0072] A third aspect of this application provides a display control method applied to a first device that supports screen projection, the method comprising: when the first device determines that it is in a state of projecting its screen to a second device,

[0073] The first device receives a first instruction; the first instruction is used to instruct the first device to run a first application in the foreground;

[0074] When it is determined that the first device is in a display state of projecting screen to the second device, the first device determines at least one second application in the first device according to the first instruction; the attribute information of the second application and the first application are the same, and the second application is in a background running state;

[0075] The first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

[0076] In one embodiment of a third aspect of this application, the first device projects the running interface of the first application and the running interface of the determined at least one second application to the second device, including:

[0077] The first device projects the running interface of the first application and the first control to the second device, so that the running interface of the first application and the first control are displayed on the display interface of the second device at the same time;

[0078] The first device receives a second instruction, which is generated in response to a first target operation by the user on the first control;

[0079] According to the second instruction, the first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

[0080] In one embodiment of a third aspect of this application, the first device projects the running interface of the first application and the first control onto the display interface of the second device, such that the running interface of the first application and the first control are simultaneously displayed on the display interface of the second device, including:

[0081] The first device projects the running interface of the first application, the first control, and the running interface of at least one second application (which is displayed in a collapsed manner) onto the second device, so that the running interface of the first application, the first control, and the running interface of at least one second application (which is displayed in a collapsed manner) are simultaneously displayed on the display interface of the second device.

[0082] In one embodiment of the third aspect of this application, the second instruction is generated by the second device in response to a user's first target operation on the first control; or the second instruction is generated by the first device in response to a user's first target operation on the first control.

[0083] In one embodiment of a third aspect of this application, the first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device according to the second instruction, such that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device, including:

[0084] According to the second instruction, the first device projects the running interface of the at least one second application, which is displayed in a tiled manner, and the running interface of the first application, onto the second device, so that the running interface of the first application and the running interface of the at least one second application are displayed side by side on the display interface of the second device.

[0085] In one embodiment of the third aspect of this application,

[0086] The first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device according to the second instruction, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device, including:

[0087] According to the second instruction, the first device projects the running interface of the first application, the running interface of the determined at least one second application, and the second control onto the second device, so that the running interface of the first application, the running interface of the determined at least one second application, and the second control are simultaneously displayed on the display interface of the second device.

[0088] The first device, according to the second instruction, projects the running interface of the first application, the running interface of the determined at least one second application, and the second control onto the second device, so that the running interface of the first application, the running interface of the determined at least one second application, and the second control are simultaneously displayed on the display interface of the second device, and then further includes:

[0089] The first device receives the third instruction, which is generated in response to a second target operation by the user on the second control;

[0090] According to the third instruction, the first device projects the running interface of the first application, the first control, and the running interface of the at least one second application (which is displayed in a collapsed manner) onto the second device, so that the running interface of the first application, the first control, and the running interface of the at least one second application (which is displayed in a collapsed manner) are simultaneously displayed on the display interface of the second device.

[0091] In one embodiment of the third aspect of this application, before the first device receives the first instruction, the method further includes: the first device projecting a third control corresponding to the first application to the second device, so that the second device displays the third control on a display interface.

[0092] In one embodiment of the third aspect of this application, the attribute information includes: the category to which the application belongs, keywords in the application name, or tag information of the application.

[0093] In one embodiment of the third aspect of this application, when the first device projects the running interface of at least one second application running in the background onto the second device, the running interface of each second application is the same as the running interface of the second application before it was switched to the background running state.

[0094] This application provides a fourth aspect of a display control device for executing the display control method of the third aspect of this application. The device includes: a receiving module for receiving a first instruction; the first instruction instructing a first device to run a first application in the foreground; a processing module for determining, when it is determined that the first device is in a display state of projecting onto a second device, at least one second application in the first device according to the first instruction; the second application and the first application have the same attribute information, and the second application is in a background running state; and a sending module for projecting the running interface of the first application and the running interface of the determined at least one second application onto the second device, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

[0095] In one embodiment of the fourth aspect of this application, the sending module is specifically configured to project the running interface of the first application and the first control to the second device, such that the running interface of the first application and the first control are simultaneously displayed on the display interface of the second device; the receiving module is further configured to receive a second instruction, the second instruction being generated in response to a first target operation of the user on the first control; the sending module is specifically configured to, according to the second instruction, project the running interface of the first application and the running interface of the determined at least one second application to the second device, such that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

[0096] In one embodiment of the fourth aspect of this application, the sending module is specifically configured to project the running interface of the first application, the first control, and the running interface of the at least one second application that is folded and displayed to the second device, so that the running interface of the first application, the first control, and the running interface of the at least one second application that is folded and displayed simultaneously are displayed on the display interface of the second device.

[0097] In one embodiment of the fourth aspect of this application, the second instruction is generated by the second device in response to a user's first target operation on the first control; or the second instruction is generated by the first device in response to a user's first target operation on the first control.

[0098] In one embodiment of the fourth aspect of this application, the sending module is specifically configured to, according to the second instruction, project the running interface of the at least one second application, which is displayed in a tiled manner, and the running interface of the first application, onto the second device, such that the running interface of the first application and the running interface of the at least one second application are displayed side by side on the display interface of the second device.

[0099] In one embodiment of the fourth aspect of this application, the sending module is specifically configured to, according to the second instruction, project the running interface of the first application, the running interface of the determined at least one second application, and the second control to the second device, such that the running interface of the first application, the running interface of the determined at least one second application, and the second control are simultaneously displayed on the display interface of the second device; the receiving module is further configured to, receive the third instruction, the third instruction being generated in response to a second target operation of the user on the second control; the sending module is further configured to, according to the third instruction, project the running interface of the first application, the first control, and the folded running interface of the at least one second application to the second device, such that the running interface of the first application, the first control, and the folded running interface of the at least one second application are simultaneously displayed on the display interface of the second device.

[0100] In one embodiment of the fourth aspect of this application, the sending module is further configured to project a third control corresponding to the first application to the second device, so that the second device displays the third control on a display interface.

[0101] In one embodiment of the fourth aspect of this application, the attribute information includes: the category to which the application belongs, keywords in the application name, or tag information of the application.

[0102] In one embodiment of the fourth aspect of this application, the sending module projects the running interface of at least one second application running in the background to the second device, wherein the running interface of each second application is the same as the running interface of the second application before it was switched to the background running state.

[0103] The fifth aspect of this application provides an electronic device with screen projection capability, which can be used to perform the method performed by the first device as described in any one of the third aspects of this application. The electronic device includes: a receiver, a processor, and a transmitter; wherein the processor is coupled to both the transmitter and the receiver.

[0104] The receiver is used to receive a first instruction; the first instruction is used to instruct the first device to run a first application in the foreground; the processor is used to determine at least one second application in the first device according to the first instruction when it is determined that the first device is in a display state of projecting to the second device; the second application and the first application have the same attribute information, and the second application is in a background running state; the transmitter is used to project the running interface of the first application and the running interface of the determined at least one second application to the second device, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

[0105] In one embodiment of the fifth aspect of this application, the transmitter is specifically configured to project the running interface of the first application and the first control to the second device, such that the running interface of the first application and the first control are simultaneously displayed on the display interface of the second device; the receiver is further configured to receive a second instruction, the second instruction being generated in response to a first target operation of the user on the first control; the transmitter is specifically configured to, according to the second instruction, project the running interface of the first application and the running interface of the determined at least one second application to the second device, such that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

[0106] In one embodiment of the fifth aspect of this application, the transmitter is specifically configured to project the running interface of the first application, the first control, and the running interface of the at least one second application (which is displayed in a collapsed manner) to the second device, such that the running interface of the first application, the first control, and the running interface of the at least one second application (which is displayed in a collapsed manner) are simultaneously displayed on the display interface of the second device.

[0107] In one embodiment of the fifth aspect of this application, the second instruction is generated by the second device in response to a first target operation by the user on the first control; or the second instruction is generated by the first device in response to a first target operation by the user on the first control.

[0108] In one embodiment of the fifth aspect of this application, the transmitter is specifically configured to project the running interface of the at least one second application, which is tiled and displayed, and the running interface of the first application, onto the second device according to the second instruction, such that the running interface of the first application and the running interface of the at least one second application are tiled and displayed side by side on the display interface of the second device.

[0109] In one embodiment of the fifth aspect of this application, the transmitter is specifically configured to, according to the second instruction, project the running interface of the first application, the running interface of the determined at least one second application, and the second control onto the second device, such that the running interface of the first application, the running interface of the determined at least one second application, and the second control are simultaneously displayed on the display interface of the second device; the receiver is further configured to, receive the third instruction, the third instruction being generated in response to a second target operation of the user on the second control; the transmitter is further configured to, according to the third instruction, project the running interface of the first application, the first control, and the folded running interface of the at least one second application onto the second device, such that the running interface of the first application, the first control, and the folded running interface of the at least one second application are simultaneously displayed on the display interface of the second device.

[0110] In one embodiment of the fifth aspect of this application, the transmitter is further configured to project a third control corresponding to the first application to the second device, such that the second device displays the third control on a display interface.

[0111] In one embodiment of the fifth aspect of this application, the attribute information includes: the category to which the application belongs, keywords in the application name, or tag information of the application.

[0112] In one embodiment of the fifth aspect of this application, the transmitter projects the running interface of at least one second application running in the background to the second device, wherein the running interface of each second application is the same as the running interface of the second application before it was switched to the background running state.

[0113] A sixth aspect of this application provides an electronic device, comprising: a communication interface, one or more processors and one or more memories, a plurality of application programs, and one or more programs; wherein the one or more programs are stored in the one or more memories; the communication interface is configured to receive signals from outside the electronic device and to send data to other devices connected to the electronic device according to instructions from the processor; the processor, when executing the one or more programs, performs the method as described in any one of the third aspects of this application.

[0114] A seventh aspect of this application provides a computer-readable storage medium including instructions that, when executed on a computer, cause the computer to perform the method described in any of the third aspects above.

[0115] The eighth aspect of this application provides a computer program product containing instructions that, when run on an electronic device, cause the electronic device to perform the method as described in any of the third aspects above. Attached Figure Description

[0116] Figure 1 This is a schematic diagram illustrating the application scenario of this application;

[0117] Figure 2 This is a schematic diagram of a first device projecting a main interface onto a second device for display in the prior art;

[0118] Figure 3 This is a schematic diagram of a first device projecting the running interface of an application onto a second device for display in the prior art;

[0119] Figure 4 This is a schematic diagram illustrating how a first device projects the running interface of an application onto a second device for display, as described in the prior art.

[0120] Figure 5 A flowchart illustrating a display control method provided in this application;

[0121] Figure 6 A schematic diagram illustrating the determination of the first instruction in the display control method provided in this application;

[0122] Figure 7 A schematic diagram of the display interface of a second device provided in this application;

[0123] Figure 8 A flowchart illustrating another display control method provided in this application;

[0124] Figure 9 A schematic diagram of display mode one of the display interfaces of the second device provided in this application;

[0125] Figure 10 A schematic diagram of the second display mode of the display interface of the second device provided in this application;

[0126] Figure 11 A schematic diagram of the structure of a display control device provided in this application;

[0127] Figure 12 A schematic diagram of the structure of an electronic device with screen projection capability provided in this application;

[0128] Figure 13 This is a schematic diagram of the structure of a device provided in this application. Detailed Implementation

[0129] Figure 1 This is a schematic diagram illustrating the application scenario of this application, such as... Figure 1As shown, the embodiments of this application can be applied to application scenarios where the first device 1 projects the display content to the second device 2. In this application, the device that provides the display content is referred to as the first device 1; and the device that receives the display content provided by the first device 1 and displays it is referred to as the second device 2.

[0130] Optionally, the first device 1 can be an electronic device capable of providing display content, such as a mobile phone, tablet computer, or laptop computer. Furthermore, the first device 1 supports screen mirroring, meaning that the first device 1 can project the content to be displayed to the second device 2, allowing the second device 2 to display the content projected by the first device 1. Optionally, the second device 2 can be an electronic device with a display interface, such as a tablet computer, laptop computer, desktop computer, or television.

[0131] exist Figure 1 In the scenario shown, the first device 1 is a mobile phone and the second device 2 is a laptop computer as an example. In order for the first device 1 to project the content to be displayed to the second device 2 and display it on the second device 2's display interface, a screen projection connection 3 needs to be established between the first device 1 and the second device 2.

[0132] Optionally, the screen projection connection relationship 3 includes a screen projection connection relationship based on wireless communication or a screen projection connection relationship based on wired communication. The embodiments of this application do not specifically limit the screen projection connection relationship between the first device 1 and the second device 2.

[0133] For example, in wireless screen mirroring connections, the first device 1 and the second device 2 can connect via near field communication (NFC). In some specific applications, the first device 1 and the second device 2 can be connected via an NFC-based screen mirroring connection by simply tapping them together. Alternatively, the first device 1 and the second device 2 can also connect via near field communication methods such as Bluetooth or Wireless Fidelity (WiFi).

[0134] For example, in wired communication screen mirroring connections, the first device 1 and the second device 2 can be connected via a video graphics array (VGA), a digital visual interface (DVI), or a high definition multimedia interface (HDMI).

[0135] In addition, the screen projection connection between the first device 1 and the second device 2 includes a direct connection between the first device 1 and the second device 2; or, it also includes the first device 1 connecting to the second device 2 through a relay device (e.g., a router), so that the first device 1 can project the content to be displayed to the second device 2 through the relay device, and the second device 2 can display it on its display interface.

[0136] Then it should be like this Figure 1 After establishing a screen projection connection 3 between the first device 1 and the second device 2, the first device 1 can project the content to be displayed to the second device 2, which will then display it on its display interface, thus realizing the screen projection display from the first device 1 to the second device.

[0137] In a specific screen mirroring implementation method, such as Figure 1 As shown, the first device 1 can project its display interface 11 onto the display interface 21 of the second device 2. Furthermore, the second device 2 can display the projected display interface 11 of the first device 1 through a window 22 within its display interface 21. It can be seen that the content displayed in real-time on the display interface 11 of the first device 1 can be completely and synchronously displayed on the display interface 21 of the second device 2.

[0138] In another specific screen mirroring implementation, after the first device 1 and the second device 2 establish a screen mirroring connection, the first device 1 can switch to a screen-off state and project the content it needs to display onto the display interface of the second device. For example, in... Figure 2 As shown, Figure 2 This is a schematic diagram illustrating how a first device projects its main interface onto a second device in the prior art. After establishing a projection connection 3 between the first device 1 and the second device 2, the first device 1 no longer displays its display interface 11 but switches to a screen-off state. Simultaneously, in the screen-off state, the first device 1 can project the content displayed on its display interface 11 onto the second device 2, where it is displayed within a window 22 of its display interface 21. Furthermore, since the display interface 21 of the second device 2 is larger than the display interface 11 of the first device 1, the first device 1 can simultaneously project more sub-interfaces from its main interface onto the second device 2 for display. For example, in... Figure 2 In the example shown, the main interface of the first device 1 includes at least three sub-interfaces ①, ② and ③. Each sub-interface includes at least one control corresponding to an application. The first device 1 can simultaneously project the sub-interfaces ①, ② and ③ included in its main interface to the second device 2, which will then display them on the display interface 21.

[0139] Furthermore, when the first device 1 passes through as... Figure 2The content to be displayed is projected to the second device 2 in the manner shown. After the second device 2 displays the content on its display interface 21, if the second device 2 detects that the user clicks on any control corresponding to an application within the display interface 21, the second device 2 can send the corresponding application instruction to the first device 1 through the screen projection connection, so that the first device 1 determines and runs the application according to the instruction, and then projects the running interface of the application to the second device 2, which displays the content on its display interface 21.

[0140] For example, in such Figure 2 In the example shown, the first device 1 projects its main interface onto the second device 2, which displays it on the display interface 21. Sub-interface ② includes icons for shopping application A and shopping application B, and sub-interface ③ includes an icon for shopping application C. When the second device 2 detects a user's click on the icon of shopping application A, it sends a command to the first device 1 via connection 3, instructing the first device 1 that the icon of shopping application A has been clicked and that shopping application A needs to be run in the foreground. Upon receiving this command, the first device 1 runs shopping application A in the foreground and projects its interface onto the second device 2, which then displays it on its display interface 21. For example, Figure 3 This is a schematic diagram of a prior art method where a first device projects the running interface of an application to a second device for display. The first device 1 can run a shopping application A in the foreground and then project the running interface of the shopping application A to the second device 2, where it is displayed in a window 221 within its display interface 21. Optionally, if the shopping application A is running in the background, the first device 1 switches the shopping application A to the foreground running state according to an instruction; if the shopping application A is not running, the first device 1 runs the shopping application A in the foreground according to an instruction.

[0141] At this time, Figure 3 In the example shown, when the first device 1 projects the running interface of shopping application A onto the second device 2, and the second device 2 displays it on its display interface 21, the price of "product X" as "1219 yuan" can only be viewed through shopping application A in window 221. If the user wants to compare the price of the same product across different shopping applications by viewing the price in other shopping applications B, they still need to return to the window 221. Figure 2 In the displayed interface, after clicking the icon of shopping application B, the second device 2 sends a command to the first device 1 via connection relationship 3, instructing the first device 1 that the icon of shopping application B has been clicked and that shopping application B needs to be run in the foreground. Then, as shown... Figure 4 As shown, Figure 4 This illustration illustrates another prior art method where a first device projects the running interface of an application to a second device for display. When the first device 1 receives the instruction, it runs a shopping application B in the foreground and projects the running interface of the shopping application B to the second device 2, where it is displayed in window 222 within its display interface 21. It should be noted that the method by which the first device 1 projects the content to be displayed to the second device 2 is not limited in the embodiments of this application; various existing screen mirroring protocols can be used, such as push-mode protocols like DLNA and AirPlay.

[0142] Protocols such as Lelink or mirrored protocols such as Miracast, AirPlay, and Lelink.

[0143] Combination Figure 3 and Figure 4 As can be seen, in existing screen mirroring technologies, when the first device 1 projects the running interface of an application to the second device 2 for display on its display interface 21, it can only project the running interface of that single application to the second device 2 after detecting a user's click on the icon of that application. That is, different applications are displayed through different windows 221 and 222, requiring the user to constantly return to the previous screen. Figure 2 The main interface shown above requires clicking the icons of the corresponding applications in sequence, and then dragging the different windows that open to view the running interfaces of the two different applications simultaneously.

[0144] In the aforementioned application scenario, the first device 1 is unable to simultaneously project multiple shopping applications to the second device 2 for display on its display interface 21. Even before establishing a projection connection between the first device 1 and the second device 2, multiple shopping applications are already running in the background on the first device 1, and each application's background display interface shows the price of "Product X". After establishing the projection connection, the second device 2 still needs to sequentially detect the user's clicks on each individual shopping application's icon before the first device 1 can project the corresponding single shopping application to the second device 2 for display on its display interface 21. Consequently, in scenarios such as price comparison, the first device 1 cannot intelligently display similar shopping applications simultaneously on the second device 2's display interface 21, resulting in low display control efficiency and a reduced user experience when using projection between the first device 1 and the second device 2.

[0145] Therefore, this application provides a display control method, apparatus, and system, applied during the process of a first device projecting a display onto a second device (if the first device is not in the process of projecting a display, it responds to user operations according to the prior art and displays the corresponding information on the first device's display). When the first device receives an instruction to run a first application in the foreground, it determines at least one second application with the same attribute information running in the background on the first device, and simultaneously projects the running interface of the first application and the running interface of the at least one second application onto the second device, which then displays the information on its display interface. This improves display control efficiency and enhances the user experience when using the first device and the second device for projecting a display.

[0146] The embodiments provided in this application will now be described with reference to the accompanying drawings. Figure 5 A flowchart illustrating a display control method provided in this application is shown below. Figure 5 The method shown can be applied to, for example Figure 1 The application scenario illustrated is executed by a first device and a second device. The first and second devices together form a projection system, and a projection connection exists between them. The first device can project content to be displayed to the second device through this connection, where it is displayed on the second device's screen. Specifically, the display control method provided in this embodiment includes:

[0147] S101: The first device receives a first instruction, which instructs the first device to run a first application in the foreground.

[0148] Specifically, in S101 of this embodiment, the first device receives a first instruction to instruct the first application to run in the foreground. At this time, the first application is either in a non-running state or in a background running state.

[0149] The first instruction may be that the first device projects the icon control of the first application to the second device, which then displays it on its display interface. After the second device detects the user's operation on the icon control of the first application, the second device sends the first instruction to the first device.

[0150] For example, Figure 6 A schematic diagram illustrating the determination of the first instruction in the display control method provided in this application, in such a way as Figure 6 In the example shown, a screen mirroring connection has been established between the first device 1 and the second device 2. Optionally, before S101 in this embodiment, the first device and the second device can also establish a screen mirroring connection through S100. The method for establishing a screen mirroring connection between the first device and the second device in this embodiment is not limited.

[0151] Subsequently, the first device 1 can project its main interface to the second device 2, which will then display it on its display interface 21. The main interface includes at least an icon control corresponding to the first application (in this embodiment, the control corresponding to the first application is referred to as the third control), specifically... Figure 6 In the example shown, application A in the diagram is designated as the first application. Then, the second device 2 detects a third target operation by the user on the controls of application A on the display interface 21 and sends a first instruction to the first device. The third target operation can be a mouse click or a touch click; for example, the second device 2 can send the first instruction to the first device after detecting a mouse click operation by the user on the icon of application A using the mouse 23 displayed on the display interface 21; or, if the display interface 21 of the second device 2 is a touch screen, it can also send the first instruction to the first device after detecting a touch click operation by the user's finger on the icon of application A.

[0152] Optionally, the second device 2 sends a first instruction to the first device 1 through its screen mirroring connection 3 with the first device 1. The first instruction can be used to instruct the first device 1 to run application A in the foreground. Upon receiving the first instruction, the first device 1 can directly determine that application A needs to be run in the foreground. Alternatively, the first instruction can be used to instruct the icon of application A to detect a target operation. Upon receiving the first instruction, the first device 1 determines that the icon of application A has detected a target operation, thereby indirectly determining that the first application needs to be run in the foreground.

[0153] In addition, Figure 5 In the illustrated embodiment, besides the second device sending a first instruction to the first device, in other possible implementations, the first instruction can also be generated by the user interacting with the first device. For example, the first device 1 can display an icon of a first application on its display interface 11. When the first device 1 detects the user's interaction with the icon of the first application displayed on its display interface 11, it can determine that the first application needs to be run in the foreground based on this interaction.

[0154] S102: When it is determined that the first device is in a display state of projecting the screen to the second device, the first device determines at least one second application running in the background on the first device according to the first instruction received in S101.

[0155] In this embodiment, upon receiving the first instruction, the first device needs to determine whether it is currently projecting its screen to the second device before determining at least one second application. The display state of the first device includes at least two states: a normal display state where the first device's screen displays content, and a projection display state where the first device is projecting its screen to the second device. It is understood that after establishing a projection connection between the first and second devices in S100 of this embodiment, the first device is in the projection display state, i.e., in a state where the first device determines it is projecting its screen to the second device, and the first device can execute this embodiment. To distinguish its display state, the first device can set a flag bit. For example, a flag bit set to "1" indicates that the first device is in the projection display state, while a flag bit set to "0" indicates that the first device is in the normal display state. Alternatively, the first device can also determine its display state through a state machine or other methods; this application does not limit this.

[0156] Specifically, in this embodiment S102, the attribute information of at least one second application determined by the first device is the same as the attribute information of the first application. Optionally, the attribute information includes, but is not limited to: the category to which the application belongs, keywords in the application name, and application tag information, etc.

[0157] For example, in such Figure 6 In the example shown, if the attribute information includes the category to which the application belongs, then the shopping applications in the first device 1 are: shopping application A, shopping application B, and shopping application C. It is assumed that all three shopping applications are running in the background. When the first device receives a first instruction to run shopping application A in the foreground, it can determine, based on the first instruction, that shopping applications B and C, which also belong to the shopping category and are running in the background, will be the second application. Optionally, the category to which the application belongs in this embodiment can be the category used by the application store, including categories such as games, shopping, and lifestyle. This application does not limit the specific classification method of the applications.

[0158] For example, if the attribute information includes keywords in the application name, such as applications that all include "weather", then when the first device receives a first instruction to run a weather application in the foreground, it can determine at least one other weather application whose name includes the keyword "weather" as the second application based on the first instruction.

[0159] For example, if the attribute information includes application tag information, then the tag information can be obtained by the user of the first device adding different tags to different applications. Based on the tags added by the user, applications with the same tags can be identified as the second application according to the first instruction. The tag information can also come from other devices connected to the first device, or it can come from a network server.

[0160] S103: The first device simultaneously projects the running interface of the first application and the running interface of at least one second application determined in S102 onto the second device. This allows the second device, in S104, to simultaneously display the running interface of the first application and the running interface of at least one determined second application on its display screen, based on the content projected by the first device in S103.

[0161] In this process, after the first device determines at least one second application through S102, the first device projects the running interface of the first application and the running interface of at least one second application to the second device simultaneously according to the first instruction, and the second device displays them on its display interface.

[0162] Specifically, Figure 7 This is a schematic diagram of the display interface of a second device provided in this application, in which... Figure 7 The example shown is in Figure 6 Based on the example shown, after the first device determines shopping applications B and C, which have the same attributes and are running in the background, according to shopping application A, it can project the running interfaces 31 of shopping application A, 32 of shopping application B, and 33 of shopping application C simultaneously to the second device 2. This allows the second device 2 to simultaneously display the running interfaces 31, 32, and 33 of shopping application A, B, and C on its display interface 21. Optionally, the second device 2 can simultaneously display the running interfaces 31, 32, and 33 of shopping application A, B, and C within the same window 223 of the display interface 21.

[0163] When the display interface 21 of the second device 2 simultaneously displays the running interface 31 of shopping application A, the running interface 32 of shopping application B, and the running interface 33 of shopping application C, the user can simultaneously view the price of product X in different shopping applications through the display interface 21 of the second device 2, and can operate the application corresponding to the running interface of each application individually through the running interface of each application.

[0164] Optionally, in this embodiment, the first device projects the running interface of at least one second application running in the background onto the second device, so that when displayed on the second device's display screen, the running interface of each second application is the same as its running interface before it was switched to the background running state. Specifically, assuming that before establishing a screen projection connection between the first device 1 and the second device 2, the user of the first device 1 sequentially opens the shopping application AC on the first device 1, and after viewing the price interface of "Product X" in each shopping application, switches the shopping application to the background running state, then in the case of... Figure 7 In the example shown, after the first device determines shopping application B and shopping application C according to the first instruction to run shopping application A in the foreground, the running interface 31 of shopping application A, the running interface 32 of shopping application B and the running interface 33 of shopping application C projected onto the display interface 21 of the second device 2 are all price interfaces for "product X".

[0165] In summary, the display control method provided in this embodiment enables the first device to project a display onto the second device. When the first device receives an instruction to run a first application in the foreground, it determines at least one second application with the same attribute information running in the background on the first device. The first device then projects the running interface of the first application and the running interface of at least one second application onto the second device simultaneously, allowing the second device to display them on its display screen. This allows the first device to automatically project more applications with the same attribute information onto the second device based on the user's viewing needs for an application. Consequently, the second device can simultaneously display the running interface of the first application and the running interface of at least one second application with the same attribute information on its display screen, thereby satisfying the user's need to view applications with the same attribute information simultaneously. Especially when the display control method provided in this embodiment is applied to application scenarios such as price comparison, after the user has viewed the price of the same product through multiple shopping applications on the first device and switched the shopping applications to the background running state, the first device can project all the shopping applications that the user has opened to the second device according to the user's instruction to view one of the shopping applications. This allows the second device to display all the opened shopping applications on its display interface at the same time, thereby improving the efficiency of display control of applications and improving the user experience when using the first device and the second device for screen projection.

[0166] Furthermore, in such Figure 5-7In the illustrated embodiment, after the first device determines at least one second application with the same attributes as the first application according to the first instruction in S102, it directly projects the running interface of the first application and the running interfaces of all the second applications to the second device simultaneously in S103, so that the display interface of the second device can be displayed. Specifically, the rendered data containing the running interface of the first application and the running interfaces of all the second applications can be sent to the second device, and the second device can directly display it after receiving it; alternatively, the data of the running interface of the first application and the running interfaces of all the second applications can be sent to the second device, and it can be instructed that both should be displayed on the same interface at the same time. The second device can then render and display the data, so that the running interface of the first application and the running interface of the second application are displayed simultaneously on the display interface of the second device; of course, other methods can also be used to transmit the running interface data of the first and second applications between the first and second devices, so that the running interface of the first application and the running interface of the second application are displayed simultaneously on the display interface of the second device. To meet the needs of different application scenarios, based on the above embodiments, this application also provides a method where, after the first device determines at least one second application with the same attributes as the first application according to the first instruction in S102, only the running interface of the first application and the first control are projected onto the display interface of the second device. Furthermore, only after detecting a user's first target operation on the first control is the running interface of the first application and the running interfaces of all second applications simultaneously projected onto the second device, which then displays them on its display interface. The following description is in conjunction with the accompanying drawings.

[0167] in, Figure 8 A flowchart illustrating another display control method provided in this application; as shown Figure 8 The method shown can be applied to, for example Figure 1 In the application scenario shown, steps S100-S102 of this method can be referred to as follows: Figure 5 The implementation and principle of the embodiments shown are the same, and will not be repeated here. Figure 8 The method shown, following S102, further includes:

[0168] S203: The first device projects the application interface of the first application to the second device according to the first instruction, so that the second device displays it on its display interface. At the same time, the first device also projects the first control to the second device, so that the second device also displays it on its display interface. Then in S204, the second device displays the running interface of the first application and the first control on its display interface simultaneously, according to the content projected by the first device in S203.

[0169] For example, Figure 9This is a schematic diagram of display mode one of the display interfaces of the second device provided in this application, as shown in... Figure 9 In the example shown, shopping application A is referred to as the first application, and shopping applications B and C are referred to as the second applications. When the first device 1 projects the running interface 31 of shopping application A to the second device 2 according to the first instruction, the second device 2 not only displays the running interface 31 of application A on its display interface 21, but also projects the first control 4 to the second device 2, so that the second device 2 also displays the first control 4 on its display interface. The first control can be used to simultaneously display shopping application A and C, and the first control can be used to display shopping application A and C in various ways. Figure 9 The example shown is "Expanded". This application does not limit the display format of the first control.

[0170] Optionally, in one specific implementation of this embodiment, in S203, the first device may further project at least one determined second application to the second device in a folded display manner, so that the second device displays at least one second application on its display interface in a folded manner. For example, in Figure 9 In the example shown, the first device, after determining that shopping applications B and C have the same attribute information as shopping application A, projects a portion of the running interface 32 of shopping application B and a portion of the running interface 33 of shopping application C onto the second device 2 in a collapsed manner. This causes the second device 2 to display the collapsed portions of the running interfaces 32 and 33 of shopping application B and C on the display interface 21. The collapsed running interfaces 32 and 33 can be located after the running interface 31, displaying only the application's title and icon information, without showing the actual content of the running interface. Alternatively, they can be completely obscured by the allowed interface 31, only displaying an indicator message to inform the user of the obscured interface.

[0171] S205: The second device receives the user's first target operation on the first control.

[0172] S206: The second device sends a second instruction to the first device according to the first target operation.

[0173] Subsequently, after the first control is projected and displayed on the display interface of the second device, the second device can detect the user's first target operation on the first control through S205; and after detecting the user's first target operation on the first control, the second device sends a second instruction to the first device through S206.

[0174] The second instruction is generated by the second device in response to a user's first target operation on the first control. Optionally, the first target operation in this embodiment may be a mouse click operation or a touch click operation on the first control. The second instruction can be used to directly instruct the first device to simultaneously display the running interfaces of the first application and at least one second application; or, the second instruction can be used to instruct the first control to detect the first target operation. Alternatively, the second instruction may also be that after the second device detects the first target operation of the first control, it instructs the first device to detect the first target operation of the first control, causing the first device to generate the second instruction according to the instruction of the second device.

[0175] S207: After receiving the second instruction, the first device projects the running interface of the first application and the running interface of at least one second application onto the second device according to the second instruction. This causes the second device, in S208, to display the running interface of the first application and the running interface of at least one second application on its display screen according to the content projected by the first device in S207.

[0176] When the first device receives the second instruction sent by the second device, it simultaneously projects the running interface of the first application and the running interface of at least one second application to the second device, which then displays them on its display interface.

[0177] For example, Figure 10 This is a schematic diagram illustrating a second display mode of the display interface of the second device provided in this application. It shows that when the second device 2 detects the first target operation of the first control 4, the first device simultaneously projects the running interfaces 31 of shopping application A, 32 of shopping application B, and 33 of shopping application C onto the second device 2, which then displays them on its display interface 21. Specifically, the second device 2 fully displays the running interfaces 32 of shopping application B and 33 of shopping application C on the display interface 21.

[0178] Optionally, the first device 1, according to the second instruction, will... Figure 9 The running interfaces 32 of shopping application B and 33 of shopping application C are shown side-by-side and tiled. Figure 10 During the side-by-side display process shown, continuous animation effects can be added to enhance the display effect.

[0179] Furthermore, in such Figure 10In the example shown, in addition to projecting the running interface of the first application and the running interface of at least one second application onto the second device for display on its display screen, the first device 1 can also simultaneously project the second control onto the display screen of the second device for display.

[0180] For example, in such Figure 10 In the example shown, the first device 1 projects the second control 5 to the second device 2, and the second device 2 displays the second control 5 projected by the first device 1 on the display interface 21. Then, the second device 2 detects the user's second target operation on the second control 5, and after detecting the user's second target operation on the second control 5, the second device sends a third instruction to the first device.

[0181] The third instruction is generated by the second device in response to a second target operation by the user on the second control. Optionally, the second target operation in this embodiment may be a mouse click operation or a touch click operation on the second control. The third instruction can be used to directly instruct the second device to collapse and display the running interface of at least one second application; or, the third instruction can be used to instruct the second control to detect the second target operation.

[0182] When the first device receives the third instruction sent by the second device, it projects the running interface of the first application onto the second device, which then displays it on its display screen. Simultaneously, it collapses and projects the running interfaces of at least one application onto the second device, which then displays them on its display screen. The resulting display effect can be as follows: Figure 9 As shown.

[0183] In summary, in the display control method provided in this embodiment, when the first device projects a screen to the second device, after the first device receives an instruction to run a first application in the foreground, it determines that at least one second application with the same attribute information is running in the background on the first device. Instead of directly projecting the running interfaces of all applications to the second device, it only projects the running interface of the first application corresponding to the instruction and the first control to the second device, so that the second device first displays the first control and the running interface of the first application on its display screen. Subsequently, only when the second device detects a first target operation on the first control and sends a second instruction to the first device, does the first device further project the running interface of the first application and the running interfaces of all second applications simultaneously to the second device according to the second instruction, and the second device displays them on its display screen. This can meet the needs of different application scenarios. Only after the user clicks the first control and the second device detects the first target operation on the first control will at least one second application be expanded. This enriches the functions provided by the display control method, further improves the efficiency of application display control, and enhances the user experience when using the first device and the second device for screen projection.

[0184] In the embodiments provided above, the methods provided by the embodiments of this application have been described from the perspectives of the first device, the second device, and the interaction between the first device and the second device. To implement the functions of the methods provided in the embodiments of this application, the first device and the second device may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0185] Figure 11 A schematic diagram of a display control device provided in this application is shown below. Figure 11 The display control device shown can be the first device in the foregoing embodiments and can be used to perform the functions of the first device. Specifically, the display control device includes: a receiving module 1101, a processing module 1102, and a sending module 1103.

[0186] Wherein, when the display control device determines that it is in the state of projecting its screen onto the second device, the receiving module 1101 is used to receive a first instruction; the first instruction is used to instruct the first device to run a first application in the foreground; the processing module 1102 is used to, when it is determined that the display control device is in the display state of projecting its screen onto the second device, determine at least one second application in the first device according to the first instruction; the second application and the first application have the same attribute information, and the second application is in the background running state; the sending module 1103 is used to project the running interface of the first application and the running interface of the determined at least one second application to the second device, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

[0187] Optionally, in the above embodiments, the sending module 1103 is specifically used to project the running interface of the first application and the first control to the second device, so that the running interface of the first application and the first control are simultaneously displayed on the display interface of the second device; the receiving module 1101 is further used to receive a second instruction sent by the second device; the sending module 1103 is specifically used to project the running interface of the first application and the running interface of at least one determined second application to the second device according to the second instruction, so that the running interface of the first application and the first control are simultaneously displayed on the display interface of the second device.

[0188] Optionally, the second instruction is generated by the second device in response to the user's first target operation on the first control; or the second instruction is generated by the first device in response to the user's first target operation on the first control.

[0189] Optionally, in the above embodiments, the sending module 1103 is specifically used to project the running interface of the first application, the first control, and the running interface of the at least one second application that is folded and displayed to the second device, so that the running interface of the first application, the first control, and the running interface of the at least one second application that is folded and displayed are simultaneously displayed on the display interface of the second device.

[0190] Optionally, in the above embodiments, the sending module 1103 is specifically used to project the running interface of the at least one second application, which is displayed in a tiled manner, and the running interface of the first application, to the second device according to the second instruction, so that the running interface of the first application and the running interface of the at least one second application are displayed side by side on the display interface of the second device.

[0191] Optionally, in the above embodiments, the sending module 1103 is specifically configured to, according to the second instruction, project the running interface of the first application, the running interface of the determined at least one second application, and the second control to the second device, so that the running interface of the first application, the running interface of the determined at least one second application, and the second control are simultaneously displayed on the display interface of the second device; the receiving module 1101 is further configured to, receive a third instruction sent by the second device, the third instruction being generated in response to a second target operation of the user on the second control; the sending module 1103 is specifically configured to, according to the third instruction, project the running interface of the first application, the first control, and the folded running interface of the at least one second application to the second device, so that the running interface of the first application, the first control, and the folded running interface of the at least one second application are simultaneously displayed on the display interface of the second device.

[0192] Optionally, in the above embodiments, the sending module 1103 is further configured to project the third control corresponding to the first application to the second device, so that the third control is displayed on the display interface of the second device.

[0193] Optionally, in the above embodiments, the attribute information includes: the category to which the application belongs, keywords in the application name, or the application's tag information.

[0194] Optionally, in the above embodiments, the sending module 1103 projects the running interface of at least one second application running in the background to the second device, and the running interface of each second application is the same as the running interface of the second application before it is switched to the background running state.

[0195] The display control device provided in this embodiment can be used as a first device to execute any of the display control methods in the foregoing embodiments. Its implementation method and principle are the same, and will not be described again.

[0196] The module division in this embodiment is illustrative and represents only one logical functional division. In actual implementation, other division methods may be used. Furthermore, the functional modules in each embodiment of this application can be integrated into a single processor, exist as separate physical entities, or be integrated into a single module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0197] Figure 12 A schematic diagram of the structure of an electronic device with screen projection capability provided in this application is shown below. Figure 12The illustrated electronic device can be the first device in the foregoing embodiments and can be used to perform the functions of the first device. Specifically, the electronic device includes: a receiver 1201, a processor 1202, and a transmitter 1203. The processor 1202 is coupled to the transmitter 1203 and the receiver 1201.

[0198] Wherein, when the electronic device determines that it is in a state of projecting its screen onto the second device, the receiver 1201 is used to receive a first instruction; the first instruction is used to instruct the first device to run a first application in the foreground; the processor 1202 is used to, when it is determined that the electronic device is in a display state of projecting its screen onto the second device, determine at least one second application in the first device according to the first instruction; the second application and the first application have the same attribute information, and the second application is in a background running state; the transmitter 1203 is used to project the running interface of the first application and the running interface of the determined at least one second application onto the second device, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

[0199] Optionally, in the above embodiments, the transmitter 1203 is specifically used to project the running interface of the first application and the first control to the second device, so that the running interface of the first application and the first control are simultaneously displayed on the display interface of the second device; the receiver 1201 is further used to receive a second instruction sent by the second device; the transmitter 1203 is specifically used to project the running interface of the first application and the running interface of at least one determined second application to the second device according to the second instruction, so that the running interface of the first application and the first control are simultaneously displayed on the display interface of the second device.

[0200] Optionally, the second instruction is generated by the second device in response to the user's first target operation on the first control; or the second instruction is generated by the first device in response to the user's first target operation on the first control.

[0201] Optionally, in the above embodiments, the transmitter 1203 is specifically used to project the running interface of the first application, the first control, and the running interface of the at least one second application that is folded and displayed to the second device, so that the running interface of the first application, the first control, and the running interface of the at least one second application that is folded and displayed are simultaneously displayed on the display interface of the second device.

[0202] Optionally, in the above embodiments, the transmitter 1203 is specifically used to project the running interface of the at least one second application, which is displayed in a tiled manner, and the running interface of the first application, onto the second device according to the second instruction, so that the running interface of the first application and the running interface of the at least one second application are displayed side by side on the display interface of the second device.

[0203] Optionally, in the above embodiments, the transmitter 1203 is specifically configured to project the running interface of the first application, the running interface of the determined at least one second application, and the second control to the second device according to the second instruction, so that the running interface of the first application, the running interface of the determined at least one second application, and the second control are simultaneously displayed on the display interface of the second device; the receiver 1201 is further configured to receive a third instruction sent by the second device, the third instruction being generated in response to a second target operation of the user on the second control; the transmitter 1203 is specifically configured to project the running interface of the first application, the first control, and the folded running interface of the at least one second application to the second device according to the third instruction, so that the running interface of the first application, the first control, and the folded running interface of the at least one second application are simultaneously displayed on the display interface of the second device.

[0204] Optionally, in the above embodiments, the transmitter 1203 is further configured to project the third control corresponding to the first application to the second device, so that the third control is displayed on the display interface of the second device.

[0205] Optionally, in the above embodiments, the attribute information includes: the category to which the application belongs, keywords in the application name, or the application's tag information.

[0206] Optionally, in the above embodiments, the transmitter 1203 projects the running interface of at least one second application running in the background to the second device, and the running interface of each second application is the same as the running interface of the second application before it was switched to the background running state.

[0207] The display control device provided in this embodiment can be used as a first device to execute any of the display control methods in the foregoing embodiments. Its implementation method and principle are the same, and will not be described again.

[0208] Figure 13 This is a schematic diagram of the structure of a device provided in this application. In one specific implementation, such as... Figure 13The device 1000 shown may be a terminal device, which may serve as the first device described in any of the foregoing embodiments of this application and perform the functions of the first device; or, the device 1000 may also be a chip system in the first device, which may consist of one or more chips or may include chips and other discrete devices.

[0209] Specifically, the device 1000 includes at least one processor 1020 and at least one memory 1030, the memory 1030 being used to store program instructions and / or data. The memory 1030 and the processor 1020 are coupled. The coupling in this embodiment is an indirect coupling or communication connection between devices, units, or modules, and can be electrical, mechanical, or other forms, used for information exchange between devices, units, or modules. The processor 1020 may operate collaboratively with the memory 1030.

[0210] For example, such as Figure 13 The device 1000 shown is a terminal device. When the processor 1020 in the device 1000 calls and executes the program instructions stored in the memory 1030, the processor 1020 performs the following steps: receiving a first instruction through the communication interface 1010; the first instruction is used to instruct the first device to run a first application in the foreground; when it is determined that the terminal device is in a display state of projecting to the second device, at least one second application in the first device is determined according to the first instruction; the attribute information of the second application and the first application are the same, and the second application is in a background running state; the running interface of the first application and the running interface of the determined at least one second application are projected to the second device through the communication interface 1010, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

[0211] Optionally, in the above embodiments, the processor 1020 further projects the running interface of the first application and the first control to the second device through the communication interface 1010, so that the running interface of the first application and the first control are simultaneously displayed on the display interface of the second device; and receives a second instruction sent by the second device through the communication interface 1010; according to the second instruction, projects the running interface of the first application and the running interface of at least one determined second application to the second device through the communication interface 1010, so that the running interface of the first application and the running interface of the at least one determined second application are simultaneously displayed on the display interface of the second device.

[0212] Optionally, in the above embodiments, the processor 1020 specifically projects the running interface of the first application, the first control, and the running interface of at least one second application that is folded and displayed to the second device through the communication interface 1010, so that the running interface of the first application, the first control, and the running interface of the at least one second application that is folded and displayed are simultaneously displayed on the display interface of the second device.

[0213] Optionally, in the above embodiments, the processor 1020 specifically projects the running interface of the at least one second application, which is displayed in a tiled manner, and the running interface of the first application, onto the second device according to the second instruction, so that the running interface of the first application and the running interface of the at least one second application are displayed side by side on the display interface of the second device.

[0214] Optionally, in the above embodiments, the processor 1020 specifically projects the running interface of the first application, the running interface of the determined at least one second application, and the second control to the second device according to the second instruction, so that the running interface of the first application, the running interface of the determined at least one second application, and the second control are simultaneously displayed on the display interface of the second device; the processor 1020 also receives a third instruction sent by the second device through the communication interface 1010; the processor 1020 specifically projects the running interface of the first application, the first control, and the folded running interface of the at least one second application to the second device through the communication interface 1010 according to the third instruction, so that the running interface of the first application, the first control, and the folded running interface of the at least one second application are simultaneously displayed on the display interface of the second device.

[0215] Optionally, in the above embodiments, the processor 1020 also projects the third control corresponding to the first application to the second device through the communication interface 1010, so that the third control is displayed on the display interface of the second device.

[0216] Optionally, in the above embodiments, the attribute information includes: the category to which the application belongs, keywords in the application name, or the application's tag information.

[0217] Optionally, in the above embodiments, when the processor 1020 projects the running interface of at least one second application running in the background to the second device through the communication interface 1010, the running interface of each second application is the same as the running interface of the second application before it switched to the background running state.

[0218] The terminal device provided in this embodiment can be used as a first device to execute any of the display control methods in the foregoing embodiments. Its implementation method and principle are the same, and will not be described again.

[0219] The embodiments of this application do not limit the specific connection medium between the communication interface 1010, the processor 1020, and the memory 1030. The embodiments of this application... Figure 13 The memory 1030, processor 1020, and communication interface 1010 are connected via a bus 1040. Figure 13 The connections between other components are shown in bold and are for illustrative purposes only, not as limiting information. The bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, Figure 10 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0220] In the embodiments of this application, the processor may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components, capable of implementing or executing the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules within the processor.

[0221] In the embodiments of this application, the memory can be non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), or it can be volatile memory, such as random-access memory (RAM). Memory is any other medium capable of carrying or storing desired program code in the form of instructions or data structures, and accessible by a computer, but is not limited thereto. The memory in the embodiments of this application can also be a circuit or any other device capable of implementing storage functions, used to store program instructions and / or data.

[0222] The methods provided in this application can be implemented entirely or partially through software, hardware, firmware, or any combination thereof. When implemented in software, they can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital video discs (DVDs)), or semiconductor media (e.g., SSDs), etc.

[0223] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A display control method, applied to a first device supporting screen projection, characterized in that, The method includes: when the first device determines that it is in a state of projecting its screen to the second device, The first device receives a first instruction; the first instruction is used to instruct the first device to run a first application in the foreground; When it is determined that the first device is in a display state of projecting screen to the second device, the first device determines at least one second application in the first device according to the first instruction; the attribute information of the second application and the first application are the same, and the second application is in a background running state; The first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device; wherein the running interface of the first application and the running interface of the at least one second application are displayed in the same window of the display interface.

2. The method according to claim 1, characterized in that, The first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device, including: The first device projects the running interface of the first application and the first control to the second device, so that the running interface of the first application and the first control are displayed on the display interface of the second device at the same time; The first device receives a second instruction, which is generated in response to a first target operation by the user on the first control; According to the second instruction, the first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

3. The method according to claim 2, characterized in that, The first device projects the running interface of the first application and the first control onto the display interface of the second device, so that the display interface of the second device simultaneously displays the running interface of the first application and the first control, including: The first device projects the running interface of the first application, the first control, and the running interface of at least one second application (which is displayed in a collapsed manner) onto the second device, so that the running interface of the first application, the first control, and the running interface of at least one second application (which is displayed in a collapsed manner) are simultaneously displayed on the display interface of the second device.

4. The method according to claim 2 or 3, characterized in that, The second instruction is generated by the second device in response to the user's first target operation on the first control; or the second instruction is generated by the first device in response to the user's first target operation on the first control.

5. The method according to claim 3, characterized in that, The first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device according to the second instruction, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device, including: According to the second instruction, the first device projects the running interface of the at least one second application, which is displayed in a tiled manner, and the running interface of the first application, onto the second device, so that the running interface of the first application and the running interface of the at least one second application are displayed side by side on the display interface of the second device.

6. The method according to any one of claims 2-3 and 5, characterized in that, The first device projects the running interface of the first application and the running interface of the determined at least one second application onto the second device according to the second instruction, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device, including: According to the second instruction, the first device projects the running interface of the first application, the running interface of the determined at least one second application, and the second control onto the second device, so that the running interface of the first application, the running interface of the determined at least one second application, and the second control are simultaneously displayed on the display interface of the second device. The first device, according to the second instruction, projects the running interface of the first application, the running interface of the determined at least one second application, and the second control onto the second device, so that the running interface of the first application, the running interface of the determined at least one second application, and the second control are simultaneously displayed on the display interface of the second device, and then further includes: The first device receives a third instruction, which is generated in response to a second target operation by the user on the second control; According to the third instruction, the first device projects the running interface of the first application, the first control, and the running interface of the at least one second application (which is displayed in a collapsed manner) onto the second device, so that the running interface of the first application, the first control, and the running interface of the at least one second application (which is displayed in a collapsed manner) are simultaneously displayed on the display interface of the second device.

7. The method according to any one of claims 1-3 and 5, characterized in that, The attribute information includes: the category to which the application belongs, keywords in the application name, or the application's tag information.

8. An electronic device with screen projection capability, characterized in that, include: A receiver, a transmitter, and a processor, wherein the processor is coupled to both the transmitter and the receiver. The receiver is used to receive a first instruction; the first instruction is used to instruct the electronic device to run a first application in the foreground. The processor is configured to, upon determining that it is in a state of projecting its screen to a second device: According to the first instruction, at least one second application in the electronic device is determined; the attribute information of the second application and the first application are the same, and the second application is running in the background; The program determines to project the running interface of the first application and the running interface of the at least one second application onto the second device, such that the running interface of the first application and the running interface of the at least one second application are simultaneously displayed on the display interface of the second device; wherein the running interface of the first application and the running interface of the at least one second application are displayed in the same window of the display interface. The transmitter is configured to project the running interface of the first application and the running interface of the determined at least one second application to the second device according to the instructions of the processor.

9. The electronic device according to claim 8, characterized in that, The step of determining to project the running interface of the first application and the running interface of the at least one second application onto the second device includes: The first application's running interface and the first control are projected onto the second device, so that the second device's display interface simultaneously displays the first application's running interface and the first control. Receive a second instruction, which is generated in response to a first target operation by the user on the first control; According to the second instruction, it is determined that the running interface of the first application and the running interface of the determined at least one second application will be projected onto the second device, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device.

10. The electronic device according to claim 9, characterized in that, The step of determining to project the running interface of the first application and the first control onto the display interface of the second device, so that the display interface of the second device simultaneously displays the running interface of the first application and the first control, includes: The system determines to project the running interface of the first application, the first control, and the running interface of at least one second application (which is displayed in a collapsed manner) onto the second device, such that the running interface of the first application, the first control, and the running interface of at least one second application (which is displayed in a collapsed manner) are simultaneously displayed on the display interface of the second device.

11. The electronic device according to claim 10, characterized in that, The step of determining, according to the second instruction, to project the running interface of the first application and the running interface of the determined at least one second application onto the second device, so that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device, includes: According to the second instruction, the running interfaces of the at least one second application, which are displayed in a tiled manner, and the running interface of the first application are projected onto the second device, so that the running interfaces of the first application and the running interfaces of the at least one second application are displayed side by side on the display interface of the second device.

12. The electronic device according to any one of claims 9-11, characterized in that, The step of determining, according to the second instruction, to project the running interface of the first application and the running interface of the determined at least one second application onto the second device, such that the running interface of the first application and the running interface of the determined at least one second application are simultaneously displayed on the display interface of the second device, includes: According to the second instruction, the running interface of the first application, the running interface of the determined at least one second application, and the second control are projected onto the second device, so that the running interface of the first application, the running interface of the determined at least one second application, and the second control are simultaneously displayed on the display interface of the second device. The receiver is further configured to receive a third instruction, the third instruction being generated in response to a second target operation by the user on the second control; The processor is further configured to, according to the third instruction, determine to project the running interface of the first application, the first control, and the running interface of the at least one second application (which is displayed in a collapsed manner) onto the second device, such that the running interface of the first application, the first control, and the running interface of the at least one second application (which is displayed in a collapsed manner) are simultaneously displayed on the display interface of the second device.

13. The electronic device according to any one of claims 8-11, characterized in that, The attribute information includes: the category to which the application belongs, keywords in the application name, or the application's tag information.

14. An electronic device, characterized in that, include: A communication interface, one or more processors and one or more memories, multiple applications, and one or more programs; The one or more programs are stored in the one or more memories; The communication interface is used to receive signals from outside the electronic device and to send data to other devices connected to the electronic device according to the instructions of the processor; when the processor executes the one or more programs, it performs the method as described in any one of claims 1 to 7.

15. A computer-readable storage medium comprising instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-7.

16. A computer program product containing instructions, characterized in that, When the computer program product is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1-7.

Citation Information

Patent Citations

  • Mobile terminal and controling method thereof

    CN103379221A

  • Remote operation of applications using received data

    CN105359121A