Screen mirroring method and apparatus, and electronic device

Abstract

The present application relates to the technical field of electronic devices, and discloses a screen mirroring method and apparatus, and an electronic device, for use in achieving multi-screen simultaneous viewing during different-source screen mirroring. The method is applied to a screen mirroring system, and comprises: a first electronic device creates a first virtual screen in response to a screen mirroring operation of a user for an application, and generates a user interface of the application on the first virtual screen; and the first electronic device can mirror the user interface of the application generated on the first virtual screen to a second electronic device, and at the same time, copy the user interface generated on the first virtual screen to a display screen of the first electronic device for display, achieving multi-screen simultaneous viewing of the first electronic device and the second electronic device.

Description

Screen projection method, device and electronic device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on September 19, 2023, with application number 202311215613.2 and application name “A screen projection method, device and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The embodiments of the present application relate to the technical field of electronic devices, and in particular to a screen projection method, device, and electronic device. Background Art

[0004] With the advancement of life and technology, screen projection technology is becoming increasingly popular. Screen projection technology allows an electronic device to project its display interface onto another electronic device for display. For example, a movie on a mobile phone can be projected onto a computer, or a video on a car's central control screen can be projected onto a tablet.

[0005] However, when the first electronic device performs heterogeneous screen projection on the second electronic device, the projection interface is only displayed on the second electronic device but not on the first electronic device, which affects the user experience.

[0006] Summary of the Invention

[0007] The embodiments of the present application provide a screen projection method, device and electronic device for realizing multi-screen viewing during heterogeneous screen projection and reducing power consumption.

[0008] In a first aspect, an embodiment of the present application provides a screen projection method, which is applied to a screen projection system. The screen projection system includes a first electronic device and a second electronic device. The method includes:

[0009] The first electronic device can create a first virtual screen in response to a user's screen projection operation for an application. After the first electronic device generates a user interface of the application on the created first virtual screen, it sends the projection data to the second electronic device and copies the user interface generated on the first virtual screen to the display screen of the first electronic device for display. The projection data includes the user interface of the application generated on the first virtual screen.

[0010] In this method, the first electronic device creates a first virtual screen in response to the user's screen projection operation for the application, and generates a user interface of the projected application on the first virtual screen. The first electronic device can send the projection data containing the user interface displayed on the first virtual screen to the second electronic device, and can also copy the user interface generated on the first virtual screen to the display screen of the first electronic device for display, thereby realizing multi-screen viewing of the first electronic device and the second electronic device. In addition, the first electronic device only creates the first virtual screen during the implementation process, which reduces the power consumption of the projection screen compared to similar solutions of creating multiple virtual screens.

[0011] In an optional design, the first electronic device creates a first virtual screen according to screen parameters of the display screen of the first electronic device in response to the screen projection operation.

[0012] Through this design, the first virtual screen created by the first electronic device has completely consistent screen parameters with the display screen of the first electronic device. In this way, the user interface generated on the first virtual screen can be directly copied to the display screen of the first electronic device for display, thereby achieving the purpose of reducing power consumption.

[0013] In an optional design, the first electronic device generates identification information of the first virtual screen and establishes a mapping relationship between the identification information and the application.

[0014] This design establishes a mapping between the identification information of the first virtual screen and the application, providing a data basis for the first electronic device to determine the first virtual screen for generating the user interface of the application. In this way, the first electronic device can quickly determine the first virtual screen for generating the user interface based on the mapping relationship, perform layer replication, and display the user interface on the display screen of the first electronic device, thereby improving the efficiency of interface display.

[0015] In an optional design, the first electronic device may also generate projection data based on the user interface generated on the first virtual screen and send the projection data to the second electronic device, wherein the projection data is used by the second electronic device to display the user interface of the application in the projection window.

[0016] Through this design, the first electronic device can complete heterogeneous screen projection, projecting the user interface of the application of the first electronic device to the second electronic device for display, thereby playing the user interface of the application on the second electronic device.

[0017] In an optional design, the first electronic device obtains layer data of a user interface generated on the first virtual screen, performs layer synthesis on the layer data to obtain image data, and encodes the image data to obtain projection data.

[0018] With this design, the first electronic device can obtain the application's user interface from the first virtual screen in real time and generate projection data based on the user interface, which is then sent to the second electronic device. The second electronic device can then display the user interface on its display screen based on the received projection data. This allows the second electronic device to synchronize the application playback, enabling simultaneous viewing on multiple screens.

[0019] In an optional design, the first electronic device creates a native window, which is used to display the user interface of the application on the display screen of the first electronic device. The first electronic device may also copy the user interface generated on the first virtual screen to the native window and display the user interface in the native window.

[0020] Through this design, during the screen projection process, the first electronic device can copy the user interface generated on the first virtual screen to a local native window and display the user interface in the native window, so that the first electronic device can also display the user interface on the display screen of the first electronic device when performing heterogeneous screen projection, thereby enabling the simultaneous viewing of applications of the first electronic device and the second electronic device, thereby improving the user experience.

[0021] In an optional design, after creating the native window, the first electronic device may further determine the first virtual screen for generating the user interface of the application based on a mapping relationship between the identification information of the first virtual screen and the application.

[0022] Through this design, the first electronic device can quickly and accurately determine the first virtual screen for generating the user interface of the application, and perform layer-by-layer copying of the user interface on the first virtual screen to achieve the purpose of displaying the user interface on the display screen of the first electronic device, thereby improving the accuracy and efficiency of the local display of the user interface.

[0023] In one optional design, the first electronic device performs layer replication on the user interface generated on the first virtual screen to obtain layer data of the user interface. The first electronic device performs layer synthesis on the layer data to obtain image data. The first electronic device displays the user interface in a native window based on the image data.

[0024] Through this design, the first electronic device can copy the user interface generated on the first virtual screen and display it in the native window, so that the user interface can be displayed locally during the heterogeneous screen projection process, thereby achieving synchronous playback of the application on the first electronic device and the second electronic device.

[0025] In an optional design, the first electronic device may also determine that the first electronic device and the second electronic device display the user interface of the application after detecting a screen projection operation triggered by the user for the application.

[0026] Through this design, users can choose whether to display the application on the first electronic device and the second electronic device separately, or play it simultaneously on the first electronic device and the second electronic device. The first electronic device can determine whether the user interface of the application needs to be displayed on the second electronic device and the first electronic device at the same time. This can improve the flexibility of screen projection and the user experience.

[0027] In a second aspect, the present application provides a screen projection device, applied to a first electronic device, the screen projection device comprising:

[0028] a display screen, for displaying a user interface;

[0029] a communication unit for receiving and sending data;

[0030] A processing unit is used to create a first virtual screen in response to a user's screen projection operation for an application, and generate a user interface of the application on the first virtual screen; send the projection data to the second electronic device; the projection data includes the user interface of the application generated on the first virtual screen; and copy the user interface generated on the first virtual screen to the display screen of the first electronic device for display.

[0031] In a third aspect, the present application provides an electronic device comprising a display screen, one or more processors, and one or more memories. The display screen is configured to display a user interface; the one or more memories are configured to store one or more computer programs and data information; and the one or more processors are configured to execute the computer programs stored in the one or more memories, so that the electronic device performs the method described in any of the first aspects above. This electronic device may be the first electronic device described in the first aspect above.

[0032] In a fourth aspect, the present application provides a computer-readable storage medium, in which a computer program or instruction is stored. When the computer program or instruction is executed by a computing device, the computing device executes the method of any aspect of the above-mentioned first aspect and any possible implementation of any aspect.

[0033] In a fifth aspect, an embodiment of the present application provides a chip, which is coupled to a memory in an electronic device so that the chip calls a computer program stored in the memory during operation to implement a method that may be designed in any aspect of the first aspect of the embodiment of the present application.

[0034] In a sixth aspect, the present application provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are executed by a computing device, the computing device executes the method of any aspect of the above-mentioned first aspect and any possible implementation of any aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] FIG1 is a schematic diagram of the architecture of a screen projection system;

[0036] FIG2 is a schematic diagram of the hardware structure of a possible electronic device exemplarily provided in this application;

[0037] FIG3 is a schematic diagram of a multi-screen collaboration scenario exemplarily provided in this application;

[0038] FIG4 is a flow chart of a screen projection method provided by the present application;

[0039] FIG5 is a schematic diagram of an application scenario of a screen projection method provided by this application;

[0040] FIG6 is a schematic diagram of a screen projection operation provided by the present application;

[0041] FIG7 is a schematic diagram of a display interface provided by the present application;

[0042] FIG8 is a schematic diagram of another screen projection operation provided by the present application;

[0043] FIG9 is a schematic structural diagram of an operating system of a first electronic device provided by the present application;

[0044] FIG10 is a schematic diagram of a screen projection scenario provided by this application;

[0045] FIG11 is a schematic structural diagram of a second electronic device provided by the present application;

[0046] FIG12 is a schematic diagram of a screen projection use case provided by this application;

[0047] FIG13 is a schematic diagram of a specific use case of screen projection provided by this application;

[0048] FIG14 is a schematic diagram of the architecture of a screen projection system provided by the present application;

[0049] FIG15 is a flow chart of an example of a screen projection method provided by the present application;

[0050] FIG16 is a schematic diagram of a complete process of a screen projection method provided by this application;

[0051] Figure 17 is a structural schematic diagram of a screen projection device provided in this application. DETAILED DESCRIPTION

[0052] The technical solutions in the embodiments of the present application will be described in detail below in conjunction with the drawings in the following embodiments of the present application.

[0053] First, the concepts related to the embodiments of the present application are explained.

[0054] 1) Application (app) is a software program that can realize one or more specific functions. In this embodiment, the application refers to a software program that can provide a user interface. Generally, multiple applications can be installed in an electronic device. For example, a camera application, a text messaging application, an image application, various mailbox applications, instant messaging software or a video application. The applications mentioned below can be applications that are installed on the electronic device when it leaves the factory, or they can be applications downloaded from the Internet or obtained from other electronic devices by the user during the use of the electronic device (for example, applications sent by other electronic devices).

[0055] 2) A virtual display (VD) is a system component created in an electronic device's operating system for screen recording and other related functions. The application's user interface can be run on this system component without being displayed to the user. Developers can control the creation and destruction of VDs through the operating system interface, where the operating system provides system capabilities such as VD creation, destruction, screen recording, and mapping. The developer is the developer of the operating system. In the embodiments of this application, virtual screen is a Chinese interpretation of virtual display. Virtual display can also be interpreted as virtual display, which is not limited here.

[0056] In some examples, developers can set trigger conditions for VD creation, destruction, screen recording, and mapping through the operating system interface. For example, when a user triggers a screen projection operation on an electronic device, the electronic device can create a system component as a virtual screen in response to the user-triggered screen projection operation. When the user ends the screen projection operation, the electronic device can destroy the virtual screen.

[0057] After creating a virtual screen, the electronic device can generate the user interface of the application on the virtual screen. The user interface exists in code form, and the virtual screen cannot display the user interface to the user. For example, when the electronic device projects the user interface on the virtual screen to another electronic device, the electronic device will recognize the virtual screen as a system component as a screen displaying the user interface during the projection process. The user interface on the virtual screen will not be displayed to the user.

[0058] 3) Display manager service (DMS), which is used for display management and is responsible for the management of display devices within the system, including the management of all local screens (i.e., all display screens of electronic devices) and virtual screens.

[0059] 4) Activity manager service (AMS), used for task operation management.

[0060] 5) Window manager service (WMS), which is used for window management, specifically for calculating the position, size, and hierarchical relationship of each application's layer in the entire layer stack.

[0061] 6) Heterogeneous screen projection refers to an electronic device projecting the user interface of an application loaded on it to another electronic device for display.

[0062] In the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

[0063] Furthermore, unless otherwise indicated, ordinal numbers such as "first" and "second" in the embodiments of this application are used to distinguish between multiple objects and are not used to limit the size, content, order, timing, priority, or importance of the multiple objects. For example, "second file" and "second file" are only used to distinguish different files and do not indicate a difference in size, content, priority, or importance between the two files.

[0064] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0065] Figure 1 is a schematic diagram of the architecture of a screen projection system applicable to the method provided in an embodiment of the present application. Specifically, the screen projection system includes a first electronic device 10 and a second electronic device 20. The first electronic device 10 and the second electronic device 20 can communicate with each other via a communication network.

[0066] The communication network may be a local area network or a wide area network relayed by a relay device. When the communication network is a local area network, illustratively, the communication network may be a short-range communication network such as a Wi-Fi hotspot network, a Wi-Fi direct network, a Bluetooth network, a ZigBee network, or a near field communication (NFC) network. When the communication network is a wide area network, illustratively, the communication network may be a third-generation wireless telephone technology (3G) network, a fourth-generation mobile communication technology (4G) network, a fifth-generation mobile communication technology (5G) network, a future-evolved public land mobile network (PLMN), or the Internet.

[0067] Among them, the first electronic device 10 refers to a device that actively shares the system interface or application interface, that is, the screen projection electronic device. Exemplarily, the first electronic device 10 can be a mobile phone, tablet computer, laptop computer, car equipment, etc. The second electronic device 20 refers to a device that passively receives the interface shared by the first electronic device 10, that is, the electronic device that displays the screen projection window. Exemplarily, the second electronic device 20 can be a mobile phone, tablet computer, laptop computer, etc.

[0068] In some embodiments, the screen projection system can be a multi-screen viewing system, the first electronic device 10 can be a main device, and the second electronic device 20 can be a secondary device.

[0069] FIG2 shows a schematic diagram of the hardware structure of a possible electronic device. The electronic device 100 may be the first electronic device 10 in FIG1 or the second electronic device 20 in FIG1. ​​As shown in FIG2, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0070] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a microcontroller unit (MCU), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors. The controller may serve as the nerve center and command center of the electronic device 100. The controller may generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. The processor 110 may also include memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. This memory may store instructions or data that have just been used or are being recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can directly call it from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

[0071] In an embodiment of the present application, the processor 110 can store one or more applications, and in response to a user's screen projection operation on an application, project the user interface of the application to the projected electronic device, and display the user interface on the display screen 194. In addition, the processor 110 can also display the user interface on the display screen 194 based on the projection data.

[0072] The USB interface 130 is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160.

[0073] The wireless communication functionality of electronic device 100 can be implemented using antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, and a baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0074] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. In an embodiment of the present application, the display screen 194 can be used to display a main interface, a user interface, granularity adjustment controls, etc.

[0075] The camera 193 is used to capture still images or videos. The camera 193 may include a front camera and a rear camera.

[0076] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and software code of at least one application (such as Huawei Video, Changlian, etc.). The data storage area can store data (such as images, videos, etc.) generated during the use of the electronic device 100. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0077] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as pictures and videos can be stored on the external memory card.

[0078] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0079] It is understood that the components shown in FIG2 do not constitute a specific limitation on the electronic device. The electronic device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. In the following embodiments, the electronic device 100 shown in FIG2 is used as an example for description.

[0080] Based on the screen projection system shown in Figure 1 and the electronic device shown in Figure 2, the present application exemplarily provides a multi-screen viewing scenario, as shown in Figure 3. Among them, the first electronic device 10 can be specifically a car device 31, and the second electronic device 20 can be specifically a tablet device 32. For example, the user can select the application to be shared on the car machine central control screen of the car machine device 31, trigger the screen projection operation to project the application to the tablet device 32. In response to the screen projection operation triggered by the user, the car machine device 31 projects the application to the tablet device 32. However, the screen projection interface of the application is only displayed on the tablet device 32, and will not be displayed on the car machine central control screen of the car machine device 31, affecting the user experience.

[0081] Based on the above problems, the present application provides a screen projection method to solve the problem that the projection interface is only displayed on the projected device during heterogeneous screen projection. In this method, the first electronic device can create a first virtual screen in response to the screen projection operation triggered by the user for the application, and generate the user interface of the application on the first virtual screen. The first electronic device sends the projection data of the user interface of the application generated on the first virtual screen to the second electronic device, and copies the user interface generated on the first virtual screen to the display screen of the first electronic device for display. In this way, multi-screen viewing of the second electronic device and the first electronic device can be achieved, thereby improving the user experience.

[0082] The screen projection method is described below based on specific embodiments.

[0083] FIG4 is a flow chart of a screen projection method provided in an embodiment of the present application. The flow includes:

[0084] S401: The first electronic device creates a first virtual screen in response to a user's screen projection operation on an application, and generates a user interface of the application on the first virtual screen.

[0085] The user can select the application that needs to be projected in the multi-screen management interface of the first electronic device and trigger the projection operation. Among them, the projection operation can be a multi-screen viewing operation. After the first electronic device detects the projection operation triggered by the user for the application, it determines the user interface of the application displayed on the first electronic device and the second electronic device. The first electronic device can also project the application to the second electronic device in response to the projection operation triggered by the user, and copy the user interface to the display screen of the first electronic device for display.

[0086] The application is an application loaded on the first electronic device, and may be a video application or other applications, which is not limited here.

[0087] For example, as shown in Figure 5, the first electronic device is a car machine device 31, and the second electronic device is an in-car PAD (tablet) 32. The user can move the user interface displayed on the car machine central control screen of the car machine device 31 to the whole car sharing area by operation to complete the operation of sharing the application to the in-car PAD. Exemplarily, as shown in Figure 6, the car machine central control screen displays a user interface and a whole car sharing area. The user can click on the user interface displayed on the car machine central control screen and drag it to the whole car sharing area for sharing. In response to the application sharing operation triggered by the user, the car machine device 31 creates a first virtual screen and generates the user interface of the application on the first virtual screen. The car machine device 31 can send the user interface code generated on the first virtual screen to the in-car PAD 32. In addition, the car machine device 31 can also copy the user interface generated on the first virtual screen to the display screen of the car machine device 31 for display.

[0088] In some examples, the display screen of the first electronic device may further display multiple screen areas. Each screen area corresponds to the screen of an electronic device. For example, as shown in FIG7 , four screen areas and the user interface of the application may be displayed on the display screen of the first electronic device. Screen area 1 corresponds to electronic device 1, screen area 2 corresponds to electronic device 2, screen area 3 corresponds to electronic device 3, and screen area 4 corresponds to electronic device 4. The user can drag the user interface to the corresponding screen area to achieve the purpose of projecting the user interface onto the screen of the electronic device corresponding to the screen area. As shown in FIG8 , the user can drag the user interface to screen area 1 to achieve the purpose of projecting the user interface onto electronic device 1. In response to the projection operation triggered by the user, the first electronic device projects the user interface onto electronic device 1 while displaying the user interface on the first electronic device. Exemplarily, the first electronic device may be a vehicle-mounted device 31, and electronic device 1, electronic device 2, electronic device 3, and electronic device 4 may be an in-vehicle PAD 32.

[0089] In some embodiments, as shown in Figure 9, the operating system of the first electronic device may include a multi-screen management module, a multi-screen viewing module, and a screen projection module. The first electronic device can use the multi-screen management module, the multi-screen viewing module, and the screen projection module to achieve the purpose of synchronously displaying the user interface of the projected application on the second electronic device and the first electronic device. The specific process is as follows:

[0090] After detecting the screen projection operation triggered by the user, the multi-screen management module of the first electronic device determines the second electronic device that displays the user interface of the application synchronously with the first electronic device, and sends a simultaneous viewing instruction to the multi-screen simultaneous viewing module. The simultaneous viewing instruction is used to instruct the first electronic device and the second electronic device to display the user interface of the application at the same time. The simultaneous viewing instruction may include the application to be projected, and the device information of the second electronic device to be projected. After receiving the simultaneous viewing instruction, the multi-screen simultaneous viewing module can initiate a heterogeneous screen projection process to the screen projection module, and the screen projection module responds to the screen projection operation triggered by the user, creates a first virtual screen, and generates the user interface of the application on the first virtual screen.

[0091] The screen projection module of the first electronic device may create the first virtual screen in the following manner:

[0092] After receiving the heterogeneous screen projection instruction initiated by the multi-screen viewing module, the screen projection module can respond to the screen projection operation and create a VD based on the screen parameters of the display screen of the first electronic device. The screen parameters include but are not limited to: the physical resolution of the display screen, the screen density, and the horizontal and vertical orientation of the screen. Exemplarily, the screen projection module of the first electronic device can create the VD through the display manager service (DMS).

[0093] When creating the first virtual screen, the first electronic device may also create identification information of the first virtual screen and establish a mapping relationship between the identification information and the application, so that the first electronic device can subsequently determine the virtual screen for generating the user interface of the application based on the identification information.

[0094] The first electronic device may also move the application to the first virtual screen and run the application on the first virtual screen.

[0095] After creating the first virtual screen, the first electronic device moves the application from the display screen of the first electronic device to the first virtual screen, and generates a user interface of the application on the first virtual screen. Exemplarily, the screen projection module of the first electronic device can move the application to the first virtual screen through the AMS.

[0096] As shown in Figure 10, an embodiment of the present application provides a schematic diagram of a screen projection scenario. In response to the user's screen projection operation for the application, the first electronic device creates a first virtual screen, moves the application stack to the first virtual screen, and generates the user interface of the application on the first virtual screen. As shown in Figure 10, the user interface of the application is displayed on the first virtual screen. Among them, the user interface displayed on the first virtual screen will not be displayed on the display screen of the first electronic device.

[0097] S402: The first electronic device sends screen projection data to the second electronic device, wherein the screen projection data includes a user interface of an application generated on the first virtual screen.

[0098] In some embodiments, the first electronic device may synthesize and encode the user interface generated on the first virtual screen to obtain projection data.

[0099] The first electronic device may obtain layer data of the user interface generated on the first screen, and perform layer synthesis on the layer data to obtain image data of the user interface.

[0100] The first electronic device may also encode the image data to obtain projection data. The projection data is used by the second electronic device to display the user interface of the application in the projection window. Exemplarily, the projection data may be a video stream.

[0101] The first electronic device can send the projection data to the second electronic device through the network, so that the second electronic device displays the user interface of the application in the projection window according to the received projection data.

[0102] Continuing with Figure 9 as an example, the screen projection module of the first electronic device can obtain the layer data of the user interface generated on the first virtual screen, and perform layer synthesis on the layer data. The screen projection module of the first electronic device can also encode the image data to obtain the projection data. The screen projection module of the first electronic device can also transmit the projection data to the second electronic device through the network. As shown in Figure 11, the second electronic device may include a screen projection module and a screen projection player. The second electronic device can receive the projection data sent by the screen projection module of the first electronic device through the screen projection module. In addition, the screen projection module of the second electronic device can decode the projection data to obtain image data. The screen projection module of the second electronic device can send the image data to the screen projection player, and the screen projection player displays the user interface of the application in the projection window based on the received image data.

[0103] In some examples, after creating the first virtual screen, the projection module of the first electronic device can establish a connection with the projection module of the second electronic device. After establishing a connection with the projection module of the first electronic device, the projection module of the second electronic device can create a projection window through the projection player of the second electronic device. After receiving the projection data, the projection module of the second electronic device can inject the received projection data into the surfaceview of the projection window. The projection player of the second electronic device displays the user interface in the projection window.

[0104] S403: The first electronic device copies the user interface generated on the first virtual screen to the display screen of the first electronic device for display.

[0105] In some embodiments, the first electronic device may display a user interface on a display screen by following the steps below:

[0106] A1: The first electronic device creates a native window, wherein the native window is used to display a user interface of an application on a display screen of the first electronic device.

[0107] After creating the first virtual screen, the screen projection module of the first electronic device can also send identification information of the first virtual screen to the multi-screen viewing module.

[0108] After receiving the identification information of the first virtual screen, the multi-screen viewing module can determine the first virtual screen for generating the user interface of the application according to the mapping relationship between the identification information of the first virtual screen and the application.

[0109] Optionally, upon receiving the identification information of the first virtual screen used to generate the user interface of the application, the multi-screen viewing module creates a native window that displays the user interface of the application on the display screen of the first electronic device. In other words, the multi-screen viewing module establishes a binding relationship between the identification information of the first virtual screen and the created native window.

[0110] A2: The first electronic device copies the user interface generated on the first virtual screen to the native window, and displays the user interface in the native window.

[0111] In some embodiments, the first electronic device may perform layer copying on the user interface generated on the first virtual screen to obtain layer data of the user interface.

[0112] The multi-screen simultaneous viewing module of the first electronic device can determine identification information of a first virtual screen that is mapped to the application to be projected; and based on the identification information of the first virtual screen, perform layer replication on the user interface generated on the first virtual screen to obtain layer data of the user interface. The identification information includes an ID of the first virtual screen.

[0113] The multi-screen viewing module can also copy the obtained layer data to the surface view of the native window and display the application's user interface in the native window.

[0114] The multi-screen viewing module of the first electronic device can also perform layer synthesis on the layer data to obtain image data. The multi-screen viewing module of the first electronic device can display the user interface in a native window based on the image data.

[0115] In the embodiment of the present application, steps S402 and S403 are executed in any order. The first electronic device can realize multi-screen simultaneous viewing of the first electronic device and the second electronic device by executing steps S402 and S403 at the same time.

[0116] [Corrected 14.10.2024 in accordance with Rule 91] When the first electronic device and the second electronic device are displaying user interfaces, the first electronic device may suspend updating the user interfaces. That is, the user interfaces displayed by the first and second electronic devices are the user interfaces of the application when the user triggers the screen projection operation. The user can operate the user interface on the display of the first electronic device to update the application's user interface. Additionally, the user can operate the user interface on the display of the second electronic device to update the application's user interface. In this way, the first electronic device will generate a new user interface on the first virtual screen, copy the updated user interface to the display of the first electronic device for display, and project the updated user interface to the second electronic device for display. For example, if the application is a video application, using Figure 5 as an example, when a user shares the video application to an in-vehicle PAD, the vehicle-mounted device 31 projects the video application to the in-vehicle PAD, which displays the video application's user interface in the projection window. The video user interface is displayed in the native window of the vehicle-mounted device 31. When the vehicle-mounted device 31 and the in-vehicle PAD 32 display the video application's user interface, the video application's user interface is not played. The user can click the user interface on the display screen of the vehicle-mounted device 31 or the in-vehicle PAD 32 to play the video application. In this way, the vehicle-mounted device 31 and the in-vehicle PAD 32 can play the user interface of the video application.

[0117] As shown in Figure 10, the first electronic device can copy the user interface generated on the first virtual screen to the display screen of the first electronic device for display. At the same time, the first electronic device can also send the projection data of the user interface generated on the first virtual screen to the second electronic device. In this way, the first electronic device can synchronously display the projected user interface locally when performing heterogeneous screen projection. Among them, the user interface on the first virtual display screen will not actually be displayed.

[0118] In the embodiment of the present application, although the second electronic device displays the user interface slower than the first electronic device displays the user interface, the playback delay between the two is small (for example, less than 75ms), and the time difference is within a reasonable range, meeting the standard for simultaneous viewing. Therefore, it can be considered that the screen projection method provided in the embodiment of the present application can achieve the requirement of the first electronic device and the second electronic device playing the user interface at the same time. In this way, in the embodiment of the present application, when the first electronic device projects the application to the second electronic device, the first electronic device and the second electronic device display the user interface of the application at the same time, solving the problem that heterogeneous screen projection cannot be displayed locally.

[0119] In some embodiments, the first electronic device may also include multiple display screens, display screen 1, ..., display screen N. The first electronic device creates a first virtual screen in response to a screen projection operation triggered by the user for an application. As shown in Figure 12, the first electronic device moves the application stack to the first virtual screen and generates a user interface of the application on the first virtual screen. The first electronic device sends the user interface code generated on the first virtual screen to the second electronic device, and displays the user interface of the application on the display screen of the second electronic device. At the same time, the first electronic device can also copy the user interface generated on the first virtual screen to the display screen 1, ..., display screen N of the first electronic device for display. In this way, display screen 1, ..., display screen N and the display screen of the second electronic device can synchronously display the user interface of the application. Among them, the user interface in the first virtual screen will not be actually displayed.

[0120] Exemplarily, the first electronic device may be a vehicle-mounted device, and the display screen of the vehicle-mounted device includes a vehicle-mounted central control screen and a vehicle-mounted co-pilot screen. The second electronic device may be an in-vehicle PAD. As shown in FIG13 , the vehicle-mounted device may create a first virtual screen in response to a multi-screen simultaneous viewing operation triggered by the user, and move the application from the vehicle-mounted central control screen to the first virtual screen, run the application on the first virtual screen, and generate a user interface for the application. The vehicle-mounted device may encode the user interface generated on the first virtual screen and send it to the in-vehicle PAD, which displays the user interface on the display screen of the in-vehicle PAD. At the same time, the vehicle-mounted device may also copy the user interface generated on the first virtual screen to the vehicle-mounted central control screen and the vehicle-mounted co-pilot screen for display. In this way, the vehicle-mounted central control screen, the vehicle-mounted co-pilot screen, and the in-vehicle PAD can display the user interface synchronously to achieve multi-screen simultaneous viewing. Among them, the user interface in the first virtual screen will not be actually displayed.

[0121] In some embodiments, the user can also share the application of the first electronic device with multiple second electronic devices to achieve multi-screen viewing. The first electronic device obtains the layer data of the user interface of the application generated on the first virtual screen, and performs layer synthesis on the layer data to obtain image data. The first electronic device can copy the image data to the display screen of the first electronic device for display. At the same time, the first electronic device can also encode the image data to obtain projection data, and send the projection data to multiple second electronic devices through the network. Each second electronic device among the multiple second electronic devices can decode the received projection data to obtain image data. In addition, each second electronic device can also display the user interface in the projection window based on the image data.

[0122] Based on the contents described in the above embodiments, an embodiment of the present application provides a possible screen projection system. Figure 14 is an architectural diagram of a screen projection system provided in an embodiment of the present application. The system includes a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device are located in a distributed multi-device environment. A communication link can be established between the first electronic device and the second electronic device through wireless or wired means to form a distributed multi-device environment. For example, the first electronic device and the second electronic device can establish a Bluetooth link through Bluetooth, or establish a Wi-Fi communication link through Wi-Fi, or establish a connection through a wired link.

[0123] The operating system of the first electronic device may include a multi-screen management module, a multi-screen viewing module, and a screen projection module. The second electronic device may include a screen projection module and a screen projection player.

[0124] In some embodiments, the first electronic device and the second electronic device can transmit screen projection data through the screen projection module to form a screen projection system in a multi-device environment.

[0125] As shown in Figure 14, the multi-screen management module of the first electronic device detects the multi-screen co-viewing operation triggered by the user, and determines the application and the second electronic device for multi-screen co-viewing. The multi-screen management module initiates an instruction to the multi-screen co-viewing module to watch with the second electronic device, and the multi-screen co-viewing module initiates heterogeneous screen projection through the screen projection module according to the instruction sent by the multi-screen management module. When the multi-screen co-viewing module initiates heterogeneous screen projection, the screen projection module can respond to the screen projection operation, control the DMS to create a VD, and move the application stack to the VD through the AMS. Among them, the first electronic device generates the user interface of the application on the VD. The screen projection module in the first electronic device returns the identification information of the created VD to the multi-screen co-viewing module. After returning the identification information of the VD to the multi-screen co-viewing module, the screen projection module of the first electronic device can also establish a WIFI connection with the second electronic device through the WIFI module.

[0126] After the second electronic device establishes a connection with the first electronic device, the screen projection module of the second electronic device starts the screen projection player. After starting, the screen projection player creates a screen projection window. The screen projection window is used to display the user interface of the first electronic device projected to the second electronic device.

[0127] The screen projection module of the first electronic device obtains the layer data applied on the VD through the DMS, and performs layer synthesis on the layer data to obtain image data. The screen projection module of the first electronic device encodes the image data to obtain the projection data. The screen projection module of the first electronic device transmits the projection data to the screen projection module of the second electronic device through a WIFI connection. The screen projection module of the second electronic device decodes the projection data to obtain image data. The second electronic device sends the image data to the projection player, and the projection player displays the user interface in the projection window of the display screen of the second electronic device.

[0128] After receiving the identification information, the multi-screen viewing module of the first electronic device can create a native window, wherein the native window is used to display the user interface on the display screen of the first electronic device. The multi-screen viewing module can perform layer copying on the user interface generated on the VD according to the identification information to obtain image data of the user interface. The multi-screen viewing module can also copy the obtained layer data to the surface view of the native window. The multi-screen viewing module can also perform layer synthesis on the layer data to obtain image data, and display the user interface in the native window based on the image data.

[0129] FIG15 is an example of a screen projection method provided in an embodiment of the present application, wherein the example includes the following steps.

[0130] S1501: The user may select an application in the multi-screen management interface of the first electronic device and initiate multi-screen viewing.

[0131] S1502: The multi-screen management module of the first electronic device may initiate multi-screen simultaneous viewing through the multi-screen simultaneous viewing module in response to a multi-screen simultaneous viewing operation initiated by the user.

[0132] S1503: The multi-screen viewing module of the first electronic device initiates heterogeneous screen projection through the screen projection module of the first electronic device.

[0133] S1504: The screen projection module of the first electronic device can create a VD through the DSM in response to the screen projection operation.

[0134] S1505: The screen projection module of the first electronic device may move the application stack to the VD through the AMS and generate a user interface of the application on the VD.

[0135] S1506: The screen projection module of the first electronic device establishes a connection with the screen projection module of the second electronic device.

[0136] S1507: The screen projection module of the second electronic device starts the screen projection player.

[0137] S1508: The screen projection player creates a screen projection window.

[0138] The screen projection module of the second electronic device creates a surface view of the screen projection window.

[0139] S1509: The screen projection module of the first electronic device obtains the layer data of the user interface generated on the VD.

[0140] Among them, step S1507 and step S1509 are performed in no particular order.

[0141] S1510: The screen projection module of the first electronic device performs image synthesis on the layer data to obtain image data.

[0142] S1511: The screen projection module of the first electronic device encodes the image data to obtain screen projection data.

[0143] S1512: The screen projection module of the first electronic device can transmit the screen projection data to the screen projection module of the second electronic device.

[0144] S1513: The screen projection module of the second electronic device decodes the screen projection data to obtain image data.

[0145] S1514: The screen projection module of the second electronic device sends the image data to the screen projection player of the second electronic device.

[0146] S1515: The screen projection player of the second electronic device displays the user interface of the application in the screen projection window according to the image data.

[0147] After executing step S1505, the first electronic device may further execute step S1516, that is, step S1516 and step S1506 may be executed in any order.

[0148] S1516: The screen projection module of the first electronic device returns the identification information of the VD to the multi-screen viewing module.

[0149] After creating the VD, the screen projection module of the first electronic device may also generate identification information of the VD. The first electronic device may also establish a mapping relationship between the identification information of the VD and the application.

[0150] S1517: After receiving the identification information of the VD, the multi-screen viewing module of the first electronic device creates a native window, wherein the native window is used to display the user interface on the display screen of the first electronic device.

[0151] S1518: The multi-screen viewing module of the first electronic device copies the layer of the user interface generated on the VD through the WMS according to the identification information to obtain the layer data of the user interface.

[0152] In some embodiments, the multi-screen viewing module of the first electronic device determines a VD for generating a user interface of the application based on a mapping relationship between the identification information and the application. The multi-screen viewing module performs layer replication on the user interface generated on the VD via WMS to obtain layer data of the user interface.

[0153] S1519: The multi-screen viewing module of the first electronic device may also copy the obtained layer data to the native window.

[0154] Exemplarily, the multi-screen viewing module of the first electronic device may also copy the obtained layer data to the surfaceview of the native window.

[0155] S1520: The multi-screen viewing module of the first electronic device may perform layer synthesis on the layer data to obtain image data.

[0156] S1521: The multi-screen viewing module of the first electronic device can also display the user interface of the application in the native window according to the obtained image data.

[0157] Based on the content shown in Figure 15, the multi-screen management module of the first electronic device can determine the first electronic device and the second electronic device that display the user interface of the application. The multi-screen viewing module of the first electronic device can copy the user interface generated on the VD to the display screen of the first electronic device for display. And the screen projection module of the first electronic device can create a VD to realize heterogeneous screen projection of the second electronic device. Moreover, in the process of completing heterogeneous screen projection and layer copying, the first electronic device only creates one VD, which reduces the power consumption of multi-screen viewing while realizing multi-screen viewing.

[0158] FIG16 is a schematic diagram of a complete process of a screen projection method provided by the present application. As shown in FIG16 , the method includes the following steps:

[0159] S1601: The user selects an application on the display screen of the first electronic device and initiates a screen projection operation.

[0160] S1602: After detecting a user's screen projection operation on an application, the first electronic device determines that the first electronic device and the second electronic device display a user interface of the application.

[0161] S1603: The first electronic device creates a first virtual screen according to screen parameters of the display screen of the first electronic device in response to the user's screen projection operation on the application.

[0162] S1604: The first electronic device generates a user interface of the application on the first virtual screen.

[0163] Exemplarily, after creating the first virtual screen, the first electronic device moves the application stack to the first virtual screen and generates a user interface on the first virtual screen.

[0164] S1605: The first electronic device generates identification information of the first virtual screen.

[0165] S1606: The first electronic device establishes a mapping relationship between the identification information of the first virtual screen and the application.

[0166] S1607: The first electronic device obtains layer data of the user interface generated on the first virtual screen.

[0167] S1608: The first electronic device performs layer synthesis on the layer data to obtain image data.

[0168] S1609: The first electronic device encodes the image data to obtain projection data.

[0169] The projection data is used by the second electronic device to display the user interface of the application in the projection window.

[0170] S1610: The first electronic device sends the screen projection data to the second electronic device.

[0171] In some embodiments, after creating the first virtual screen, the first electronic device establishes a connection with the second electronic device. The second electronic device creates a projection window on the display screen to display the user interface.

[0172] S1611: The second electronic device displays the user interface of the application in the projection window according to the projection data.

[0173] S1612: The first electronic device creates a native window.

[0174] The native window is used to display the user interface of the application on the display screen of the first electronic device.

[0175] There is no particular order in which step S1607 and step S1612 are executed.

[0176] S1613: The first electronic device determines, according to the mapping relationship, to generate a first virtual screen for a user interface of the application.

[0177] S1614: The first electronic device performs layer replication on the user interface generated on the first virtual screen to obtain layer data of the user interface.

[0178] S1615: The first electronic device performs layer synthesis on the layer data to obtain image data.

[0179] S1616: The first electronic device displays a user interface in a native window according to the image data.

[0180] Based on the content shown in Figure 16, the first electronic device creates a first virtual screen and generates a user interface of the projected application on the first virtual screen. When the first electronic device synthesizes and encodes the user interface on the first virtual screen and transmits it to the second electronic device for display, it can also copy the user interface on the first virtual screen to the display screen of the first electronic device for display. In this way, the first electronic device and the second electronic device can be viewed on multiple screens at the same time, and the power consumption of viewing on multiple screens is reduced.

[0181] Based on the above content and the same concept, Figure 17 is a structural schematic diagram of a possible screen projection device 1700 provided in this application. The screen projection device 1700 is applied to a screen projection system consisting of a first electronic device and a second electronic device.

[0182] In some embodiments, the first electronic device includes the screen projection device 1700, or the first electronic device is the screen projection device 1700. The screen projection device 1700 can be used to implement the functions of the first electronic device in the above method embodiment, and thus can also achieve the beneficial effects of the above method embodiment.

[0183] Display screen 1701, used to display a user interface;

[0184] Communication unit 1702, used to receive and send data;

[0185] Processing unit 1703 is used to create a first virtual screen in response to the user's screen projection operation for the application, and generate the user interface of the application on the first virtual screen; send the projection data to the second electronic device; the projection data includes the user interface of the application generated on the first virtual screen; and copy the user interface generated on the first virtual screen to the display screen 1701 of the first electronic device for display.

[0186] In an optional implementation manner, the processing unit 1703 is specifically configured to:

[0187] In response to the screen projection operation, a first virtual screen is created according to the screen parameters of the display screen 1701 of the first electronic device.

[0188] In an optional implementation manner, the processing unit 1703 is further configured to:

[0189] generating identification information of a first virtual screen;

[0190] A mapping relationship between the identification information of the first virtual screen and the application is established.

[0191] In an optional implementation manner, the processing unit 1703 is specifically configured to:

[0192] Generate screen projection data based on the user interface generated on the first virtual screen; the screen projection data is used by the second electronic device to display the user interface of the application in the screen projection window;

[0193] The projection data is sent to the second electronic device.

[0194] In an optional implementation manner, the processing unit 1703 is specifically configured to:

[0195] Acquire layer data of the user interface generated on the first virtual screen;

[0196] Perform layer synthesis on the layer data to obtain image data;

[0197] . Encode the image data to get the projection data

[0198] In an optional implementation manner, the processing unit 1703 is specifically configured to:

[0199] Creating a native window, where the native window is used to display a user interface of the application on the display screen 1701 of the first electronic device;

[0200] The user interface generated on the first virtual screen is copied to the native window, and the user interface is displayed in the native window.

[0201] In an optional implementation, after creating the native window, the processing unit 1703 is further configured to:

[0202] A first virtual screen for generating a user interface of the application is determined according to a mapping relationship between the identification information of the first virtual screen and the application.

[0203] In an optional implementation manner, the processing unit 1703 is specifically configured to:

[0204] Performing layer copying on the user interface generated on the first virtual screen to obtain layer data of the user interface;

[0205] Perform layer synthesis on the layer data to obtain image data;

[0206] Displays the user interface in a native window based on the image data.

[0207] In an optional implementation manner, the processing unit 1703 is further configured to:

[0208] After detecting a screen projection operation triggered by a user for an application, the first electronic device and the second electronic device are determined to display a user interface of the application.

[0209] Based on the above content and the same concept, the present application provides an electronic device, including a display screen, a processor and a memory, the display screen is used to display a user interface, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the electronic device performs the steps performed by the first electronic device in the above method embodiment.

[0210] Based on the above content and the same concept, the present application provides a computer-readable storage medium, which stores a computer program or instruction. When the computer program or instruction is executed by a computing device, the computing device executes the steps performed by the first electronic device in the above method embodiment.

[0211] Based on the above content and the same concept, the present application provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are executed by a computing device, the computing device executes the steps performed by the first electronic device in the above method embodiment.

[0212] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0213] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or box in the flow chart and / or block diagram, as well as the combination of the flow chart and / or box in the flow chart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more flow charts and / or one or more boxes in the block diagram.

[0214] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0215] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0216] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A screen projection method, applied to a screen projection system, wherein the screen projection system includes the first electronic device and the second electronic device, characterized in that: The method comprises: The first electronic device creates a first virtual screen in response to a screen projection operation of the user on the application, and generates a user interface of the application on the first virtual screen; The first electronic device sends screen projection data to the second electronic device; the screen projection data includes a user interface of the application generated on the first virtual screen; The first electronic device copies the user interface generated on the first virtual screen to a display screen of the first electronic device for display.

2. The method according to claim 1, characterized in that: The first electronic device creates a first virtual screen in response to a screen projection operation for an application, including: The first electronic device creates the first virtual screen according to screen parameters of the display screen of the first electronic device in response to the screen projection operation.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: The first electronic device generates identification information of the first virtual screen; The first electronic device establishes a mapping relationship between the identification information of the first virtual screen and the application.

4. The method according to any one of claims 1 to 3, characterized in that: The first electronic device sending the screen projection data to the second electronic device includes: The first electronic device generates the screen projection data according to the user interface generated on the first virtual screen; the screen projection data is used by the second electronic device to display the user interface of the application in the screen projection window; The first electronic device sends the screen projection data to the second electronic device.

5. The method according to claim 4, characterized in that The first electronic device generates the screen projection data according to the user interface generated on the first virtual screen, including: The first electronic device acquires layer data of a user interface generated on the first virtual screen; The first electronic device performs layer synthesis on the layer data to obtain image data; The first electronic device encodes the image data to obtain the projection data.

6. The method according to any one of claims 1 to 5, characterized in that: The first electronic device copies the user interface generated on the first virtual screen to a display screen of the first electronic device for display, including: The first electronic device creates a native window, where the native window is used to display a user interface of the application on a display screen of the first electronic device; The first electronic device copies the user interface generated on the first virtual screen to the native window, and displays the user interface in the native window.

7. The method according to claim 6, characterized in that After the first electronic device creates a native window, the method further includes: The first electronic device determines, according to a mapping relationship between the identification information of the first virtual screen and the application, a first virtual screen for generating a user interface of the application.

8. The method according to claim 7, characterized in that The first electronic device copies the user interface generated on the first virtual screen to the native window, and displays the user interface in the native window, including: The first electronic device performs layer replication on the user interface generated on the first virtual screen to obtain layer data of the user interface; The first electronic device performs layer synthesis on the layer data to obtain the image data; The first electronic device displays the user interface in the native window according to the image data.

9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: After detecting the screen projection operation triggered by the user for the application, the first electronic device determines that the first electronic device and the second electronic device display the user interface of the application.

10. A screen projection device, applied to a first electronic device in a screen projection system, characterized in that: The device comprises: A display screen, used for displaying a user interface; A communication unit for receiving and sending data; A processing unit, configured to create a first virtual screen in response to a user's screen projection operation for an application, and generate a user interface of the application on the first virtual screen; send projection data to the second electronic device; the projection data includes the user interface of the application generated on the first virtual screen; and copy the user interface generated on the first virtual screen to a display screen of the first electronic device for display.

11. The device according to claim 10, characterized in that The processing unit is specifically used for: In response to the screen projection operation, the first virtual screen is created according to screen parameters of the display screen of the first electronic device.

12. The device according to claim 10 or 11, characterized in that The processing unit is also used for: generating identification information of the first virtual screen; A mapping relationship between the identification information of the first virtual screen and the application is established.

13. The device according to any one of claims 10 to 12, characterized in that: The processing unit is specifically used for: Generate the projection data according to the user interface generated on the first virtual screen; the projection data is used for the second electronic device to display the user interface of the application in the projection window; The screen projection data is sent to the second electronic device.

14. The device according to claim 13, characterized in that The processing unit is specifically used for: Acquire layer data of a user interface generated on the first virtual screen; Performing layer synthesis on the layer data to obtain image data; The image data is encoded to obtain the projection data.

15. The device according to any one of claims 10 to 14, characterized in that: The processing unit is specifically used for: Creating a native window, where the native window is used to display a user interface of the application on a display screen of the first electronic device; The user interface generated on the first virtual screen is copied to the native window, and the user interface is displayed in the native window.

16. The device according to claim 15, characterized in that After creating the native window, the processing unit is further configured to: A first virtual screen for generating a user interface of the application is determined according to a mapping relationship between the identification information of the first virtual screen and the application.

17. The device according to claim 16, characterized in that The processing unit is specifically used for: Performing layer replication on the user interface generated on the first virtual screen to obtain layer data of the user interface; Performing layer synthesis on the layer data to obtain the image data; The user interface is displayed in the native window according to the image data.

18. The device according to any one of claims 10 to 17, characterized in that: The processing unit is also used for: After detecting that the screen projection operation triggered by the user for the application is detected, determining that the first electronic device and the second electronic device display the user interface of the application.

19. An electronic device, characterized in that: include: Display screen; one or more processors; one or more memories; The display screen is used to display a user interface; The one or more memories are used to store one or more computer programs and data information; wherein the one or more computer programs include instructions; When the instructions are executed by the one or more processors, the electronic device executes the method according to any one of claims 1 to 9.

20. A chip, characterized in that: The chip is coupled to a memory in an electronic device, so that the chip calls a computer program stored in the memory when running to implement the method according to any one of claims 1 to 9.

21. A computer storage medium, characterized in that The computer-readable storage medium comprises a computer program, and when the computer program is executed on the electronic device, the electronic device causes the method according to any one of claims 1 to 9 to be performed.

22. A computer program product, characterized in that When the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 9.

Images