Screen projection control method and device, equipment and storage medium

By negotiating the determination of the screen projection resolution and encoding parameters in the screen projection technology, and creating a virtual screen and encoder, the problems of picture stretching and black edges in the existing screen projection technology are solved, and high-quality screen projection effect is achieved.

CN119728950APending Publication Date: 2025-03-28GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202311284301.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-09-28
Publication Date
2025-03-28

AI Technical Summary

Technical Problem

In the existing screen projection technology, the source device directly captures the screen image and sends it to the target device, which is prone to black edges or screen stretching and distortion, affecting the screen projection effect.

Method used

By negotiating the first resolution and target encoding parameters of the projection projection between the source device and the target device, a virtual screen and an encoder are created to adapt to the respective display performance parameters to ensure the quality of the display content displayed on the target device.

Benefits of technology

It realizes high-quality display of screen projection content on the target device, avoids the problems of black edges and picture stretching and distortion, and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119728950A_ABST
    Figure CN119728950A_ABST
Patent Text Reader

Abstract

The invention discloses a screen projection control method and device, equipment and a storage medium, and the method comprises the steps: determining a first resolution and a target coding parameter of screen projection from source end equipment to target equipment after a screen projection link between the source end equipment and the target equipment is established; creating a virtual screen for screen projection according to the first resolution; creating a first encoder according to the target encoding parameter and the first resolution; under the condition that the source end equipment enters the background screen projection state, background screen projection content of the source end equipment is sent to the virtual screen for bearing according to the first encoder; and sending the content carried in the virtual screen to the target device so as to display the content on the target device. According to the method, the first resolution and the target coding parameter of the projection screen are supported by both parties, and the subsequently created virtual screen and the first encoder are also created based on the parameters negotiated by both parties, so that each self-display performance parameter adapted to the source end equipment and the target equipment is considered, and relatively high interface display quality can be presented.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of screen projection technology, and specifically to a screen projection control method, device, equipment and storage medium. Background Art

[0002] In the current screen projection technology, the source device projects the screen through a single application so that users can perform other operations while projecting the screen. The small window projection mode is only for the convenience of users to retrieve the projection application, but does not pay attention to the specific performance on the target device after the screen is projected. There are some display problems, such as the full-screen video cannot be fully displayed, affecting viewing, or the source device application cannot adapt to the resolution of the target device and appears to be stretched or compressed. Summary of the invention

[0003] The present application provides a screen projection control method, apparatus, device and storage medium, which can prevent other services on the device from illegally accessing the data transmitted between devices by the current service, thereby improving the security of device communication. At the same time, the session key derived from key negotiation is used to synchronize device status data, which can improve the confidentiality and integrity of data transmission. New session keys can also be derived at any time based on long-term business key pairs to synchronize device status data, thereby further improving the security of device status data synchronization.

[0004] In a first aspect, the present application provides a screen projection control method, which is applied to a source device, and the method includes:

[0005] After establishing a screen projection link between a source device and a target device, determining a first resolution and a target encoding parameter for projecting a screen from the source device to the target device, wherein the first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device;

[0006] Creating a virtual screen for screen projection according to the first resolution;

[0007] Creating a first encoder according to the target encoding parameters and the first resolution;

[0008] When the source device enters the background screen projection state, the background screen projection content of the source device is sent to the virtual screen bearer according to the first encoder;

[0009] The content carried in the virtual screen is sent to the target device to be displayed on the target device.

[0010] In a second aspect, the present application provides a screen projection control method, which is applied to a target device, and the method includes:

[0011] After establishing a screen projection link between the source device and the target device, determining a first resolution and a target encoding parameter at which the target device receives the screen projection of the source device, wherein the first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device;

[0012] When the source device enters the background screen projection state, multimedia content sent by the source device is received, where the multimedia content is content carried in a virtual screen of the source device, the virtual screen is created based on the first resolution, and the content carried in the virtual screen is sent according to a first encoder, which is created based on the target encoding parameters and the first resolution.

[0013] In a third aspect, the present application provides a screen projection control device, which is applied to a source device, and the device includes:

[0014] A determination module, configured to determine, after establishing a screen projection link between a source device and a target device, a first resolution and a target encoding parameter for projecting a screen from the source device to the target device, wherein the first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device;

[0015] A creation module, configured to create a virtual screen for screen projection according to the first resolution; and to create a first encoder according to the target encoding parameters and the first resolution;

[0016] The screen projection module is used to send the background projection content of the source device to the virtual screen according to the first encoder when the source device enters the background projection state; and send the content carried in the virtual screen to the target device for display on the target device.

[0017] In a fourth aspect, the present application provides a screen projection control device, which is applied to a target device, and the device includes:

[0018] A determination module, used to determine, after establishing a screen projection link between a source device and a target device, a first resolution and a target encoding parameter at which the target device receives the screen projection of the source device, wherein the first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device;

[0019] A screen projection module is used to receive multimedia content sent by the source device when the source device enters a background screen projection state, wherein the multimedia content is content carried in a virtual screen of the source device, the virtual screen is created based on the first resolution, and the content carried in the virtual screen is sent according to a first encoder, which is created based on the target encoding parameters and the first resolution.

[0020] In a fifth aspect, the present application provides an electronic device comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps in the screen projection control method described in any one of the first aspect or the second aspect.

[0021] In a sixth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is loaded by a processor to execute the steps in the screen projection control method as described in any one of the first aspect or the second aspect.

[0022] A screen projection control method, apparatus, device and storage medium are provided in the embodiments of the present application. After a screen projection link is established between a source device and a target device, a first resolution and target encoding parameters for projecting the screen from the source device to the target device are determined through negotiation between the source device and the target device. Since the first resolution and target encoding parameters for projecting the screen are supported by both parties, the subsequently created virtual screen and first encoder are also created based on the parameters negotiated by both parties, taking into account the respective display performance parameters adapted by the source device and the target device, and can present a higher interface display quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0024] Figure 1 It is a schematic diagram of the network architecture provided by the embodiment of the present application;

[0025] Figure 2 This is a schematic diagram of an embodiment of the screen projection control method provided in the embodiments of the present application;

[0026] Figure 3 This is a schematic diagram of an embodiment of the process of establishing a screen projection relationship between a source device and a target device in an embodiment of the present application;

[0027] Figure 4 It is a flowchart of another embodiment of the screen projection control method provided in the embodiments of the present application;

[0028] Figure 5 It is a flowchart of another embodiment of the screen projection control method provided in the embodiments of the present application;

[0029] Figure 6 It is a flowchart of an embodiment of the corresponding relationship between the source device, the virtual screen and the display screen in the target device after the screen projection starts in the embodiment of the present application;

[0030] Figure 7 It is a flowchart of an embodiment of the correspondence between the source device, the virtual screen and the display screen in the target device when the target application supports horizontal screen switching in the embodiment of the present application;

[0031] Figure 8 It is a flow chart of an embodiment of the source device exiting the background screen projection, and a corresponding relationship between the source device, the virtual screen and the display screen in the target device in the embodiment of the present application;

[0032] Fig. 9 It is a schematic diagram of the structure of an embodiment of the screen projection control device provided in the embodiments of the present application;

[0033] Fig.10 is a schematic structural diagram of another embodiment of the screen projection control device provided in the embodiments of the present application;

[0034] Fig.11 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0036] In the following description, the specific embodiments of the present application will be described with reference to the steps and symbols performed by one or more computers, unless otherwise specified. Therefore, these steps and operations will be mentioned several times as being performed by a computer, and the computer execution referred to herein includes the operation of a computer processing unit by an electronic signal representing data in a structured form. This operation converts the data or maintains it at a location in the memory system of the computer, which can be reconfigured or otherwise change the operation of the computer in a manner familiar to testers in the field. The data structure maintained by the data is a physical location in the memory, which has specific characteristics defined by the data format. However, the principles of the present application are described in the above text, which does not represent a limitation, and testers in the field will understand that the various steps and operations described below can also be implemented in hardware.

[0037] The terms "module" or "unit" used herein may be considered as software objects executed on the computing system. The different components, modules, engines and services described herein may be considered as implementation objects on the computing system. The devices and methods described herein are preferably implemented in software, but may also be implemented in hardware, all within the scope of protection of this application.

[0038] It will be understood by those skilled in the art that, unless expressly stated, the singular forms "one", "said", and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present application refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof. It should be understood that when we refer to an element as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be an intermediate element. In addition, the "connection" or "coupling" used herein may include wireless connection or wireless coupling. The term "and / or" used herein includes all or any unit and all combinations of one or more associated listed items.

[0039] In the current screen projection technology, the source device directly captures the image displayed on the screen, and then sends it directly to the target device for screen projection. When the target device displays the screen projection sent by the source device, black edges or picture stretching and distortion are prone to occur, affecting the screen projection effect.

[0040] Therefore, when projecting the screen, we can consider the problem of resolution adaptation. In the related technology, resolution adaptation is mainly divided into two strategies. One is to adapt according to the resolution of the source device. The advantage of this is that the applications running on the source device can be displayed on different target devices, and can present a higher interface display quality. However, the resolution of the target device is not considered, and the projection end may not be fully covered, resulting in a poor user experience. The other is to adapt according to the resolution of the target device. The advantage of this method is that the projection screen can be displayed on the projection end without any black edges, but the disadvantage is that the resolution of the source device is inconsistent with the target device, and stretching or compression may occur. After detailed analysis and research, the inventor found that the related technology has the following technical problems:

[0041] In response to the above problems, the inventors have discovered after long-term research and proposed a screen projection control method, device, equipment and storage medium provided in the embodiments of the present application.

[0042] like Figure 1 As shown, it is a network architecture diagram of the screen projection scenario in an embodiment of the present application. The modules involved in the screen projection scenario are:

[0043] Source device 100: A virtual screen 300 can be created in the source device. The source device can send the projection content to the virtual screen, and then send the content carried in the virtual screen to at least one target device 200 for display on the target device 200.

[0044] Target device 200: receives and displays the projection content transmitted by the source device 100.

[0045] The present application embodiment can be applied to Figure 1 In the network architecture diagram shown, those skilled in the art can understand that Figure 1 The application environment shown in the figure is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or fewer target devices as shown in , for example Figure 1 Only one target device is shown. It can be understood that the network architecture diagram may also include one or more other target devices connected to the source device network, which is not specifically limited here.

[0046] Specifically, the target device and the source device of the embodiments of the present application can both be electronic devices, wherein the electronic device can be a terminal, wherein the terminal can be a mobile phone, a tablet computer, a laptop computer, a smart TV, a desktop computer, a wearable smart device, a personal computer (PC), and other devices.

[0047] It should be noted that the electronic device in the embodiment of the present application may be a device that includes both receiving and transmitting hardware, that is, a device with receiving and transmitting hardware that can perform two-way communication on a two-way communication link. Such a device may include: a cellular or other communication device with a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. That is, the source device and the target device in the embodiment of the present application may be devices that include receiving and transmitting hardware, so that they can be used as source devices in some business scenarios and as target devices in other businesses.

[0048] In addition, in the embodiment of the present application, a memory may also be included for storing data, such as separately storing device status data.

[0049] It should be noted that Figure 1 The network architecture diagram shown is only an example. The network architecture diagram and scenario described in the embodiment of the present application are intended to more clearly illustrate the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided in the embodiment of the present application. Ordinary technicians in this field can know that with the evolution of technology and the emergence of new business scenarios, the technical solution provided in the embodiment of the present application is also applicable to similar technical problems.

[0050] The following describes it in detail with reference to specific embodiments.

[0051] In the embodiments of the present application, it will first be described from the perspective of a screen projection control device, which can be specifically integrated in a source device.

[0052] See also Figure 2 , Figure 2 The screen projection control method provided in the embodiment of the present application includes the following steps 201 to 205:

[0053] 201. After establishing a screen projection link between a source device and a target device, determine a first resolution and target encoding parameters for projecting the screen from the source device to the target device.

[0054] Among them, the first resolution is within the first resolution capability parameter supported by the source device and within the second resolution capability parameter supported by the target device, and the target encoding parameter is within the first encoding capability parameter supported by the source device and within the second encoding capability parameter supported by the target device. In order to ensure the interface display effect as much as possible, usually, the first resolution is within the first resolution capability parameter supported by the source device and within the second resolution capability parameter supported by the target device, and the first resolution can be the highest resolution among the resolutions supported by both the target device and the source device; the target encoding parameter is within the first encoding capability parameter supported by the source device and within the second encoding capability parameter supported by the target device, and the target encoding parameter can be the best encoding parameter among the encoding capability parameters supported by both the target device and the source device (if there are multiple encoding parameters in the encoding capability parameter, then the multiple encoding parameters are all the best encoding parameters).

[0055] The source device and the target device may first establish a communication connection, which may include but is not limited to a wireless communication connection or a wired communication connection. Optionally, a screen projection link may be established between the source device and the target device based on the communication connection, and the screen projection link may be used to transmit multimedia data and information such as parameters related to the screen projection during the screen projection process, wherein the multimedia data may include video stream data and audio stream data, etc., and the parameters related to the screen projection may include one or more of the resolution information corresponding to the video stream data, the encoding capability parameters, the volume corresponding to the audio stream data, the channel, etc.

[0056] In some embodiments, the user may initiate a request to establish a screen projection link on the source device or the target device. After the source device and the target device establish a communication connection, the screen projection control may be displayed on the source device and / or the target device. The user may trigger the screen projection control. For example, the user triggers the screen projection control displayed on the source device, and the source device responds to the trigger operation for the screen projection control and sends a request to the target device to establish a screen projection link. The target device may respond to the request to establish a screen projection link with the source device. For another example, the user triggers the screen projection control displayed on the target device, and the target device responds to the trigger operation for the screen projection control and sends a request to the source device to establish a screen projection link. The source device may respond to the request to establish a screen projection link with the target device.

[0057] Furthermore, when the user triggers the screen projection control, the user can select the screen projection relationship between the source device and the target device, such as selecting the screen projection relationship of the source device to the target device. Optionally, the screen projection relationship between the source device and the target device can also be set by default, such as the screen projection relationship of the computer to the TV, the screen projection relationship of the mobile phone to the computer, etc., according to the device type, but not limited to this. The user can initiate the establishment of a screen projection link on any terminal device, and can determine the screen projection relationship according to actual needs, meeting the different needs of users.

[0058] After establishing a screen projection link between the source device and the target device, the source device can obtain the screen projection parameters corresponding to the target device, which may include the first resolution corresponding to the screen projection window of the target device and the encoding capability corresponding to the target device. Among them, the target device may be provided with a screen projection window, which is used to display the projection screen of the source device. Optionally, the screen projection window may be a full-screen window, and the source device can play the projection screen in full screen through the screen projection window. The screen projection window can also be a window of custom size, for example, a window that occupies half of the screen, or a window that occupies three quarters of the screen. The first resolution corresponding to the screen projection window may refer to the number of pixels that can be displayed in the screen projection window, which can be expressed as the number of horizontal pixels * the number of vertical pixels. The encoding capability corresponding to the target device may include, but is not limited to, one or more parameters of the video format supported by the target device for encoding, the maximum video width and height parameters supported for encoding, the frame rate, the bit rate, etc.

[0059] 202. Create a virtual screen for screen projection according to the first resolution.

[0060] At present, the functions of electronic devices such as mobile phones and tablets are becoming increasingly rich. Users can browse web pages and videos through electronic devices, but due to the size of electronic devices, the content viewed through the display screen of electronic devices is not clear and cannot meet user needs. As a result, screen projection technology has emerged. Screen projection refers to projecting the content of electronic devices to large-screen devices such as TVs, computers, and projectors to meet audio and video entertainment needs. When users use devices to project screens, they cannot conveniently perform other tasks and it is inconvenient to monitor the projected content.

[0061] In the embodiment of the present application, a virtual screen for screen projection is created according to the first resolution determined in step 201, and the virtual screen is used for background screen projection of the source device, so that the user can more conveniently perform other tasks when the screen is projected through the device. Among them, the virtual screen for screen projection is created according to the first resolution, that is, the resolution of the virtual screen is the first resolution.

[0062] 203. Create a first encoder according to the target encoding parameter and the first resolution.

[0063] In the embodiment of the present application, a first encoder for encoding the projection content can be created according to the determined target encoding parameters and the first resolution. It should be noted that the means of creating an encoder based on the encoding capability parameters and the resolution is a prior art, and will not be described in detail here.

[0064] 204. When the source device enters the background screen projection state, the background screen projection content of the source device is sent to the virtual screen according to the first encoder.

[0065] Specifically, when the source device has not entered the background screen projection state, the screen content of the source device can be directly displayed. When the source device enters the background screen projection state, the background screen projection content of the source device is sent to the virtual screen according to the first encoder.

[0066] 205. Send the content carried in the virtual screen to the target device for display on the target device.

[0067] After establishing a screen projection link between the source device and the target device, the embodiment of the present application determines the first resolution and target encoding parameters of the screen projection from the source device to the target device through negotiation between the source device and the target device. Since the first resolution and target encoding parameters of the screen projection are supported by both parties, the subsequently created virtual screen and the first encoder are also created based on the parameters negotiated by both parties, taking into account the respective row display performance parameters adapted by the source device and the target device, and can present a higher interface display quality.

[0068] In some embodiments of the present application, determining the first resolution and target encoding parameters of the screen projection of the source device to the target device in step 201 may include the following steps:

[0069] (1) Receive a second resolution capability parameter and a second encoding capability parameter number sent by the target device.

[0070] (2) Determine a first resolution of the screen projection of the source device to the target device according to the first resolution capability parameter and the second resolution capability parameter.

[0071] Specifically, the resolution capability parameter of the device indicates the resolution range supported by the device, which can be expressed as the highest supported resolution. According to the first resolution capability parameter and the second resolution capability parameter, the first resolution of the source device projecting the screen to the target device can be determined by comparing the highest resolution supported by the source device and the highest resolution supported by the target device, and taking the lower of the two as the first resolution of the source device projecting the screen to the target device, because the lower of the two indicates a resolution supported by both the source device and the target device. For example, if the highest resolution supported by the source device is 1000*2000 and the highest resolution supported by the target device is 500*1000, then the first resolution is determined to be 500*1000.

[0072] (3) Determine a target encoding parameter for projecting a screen from the source device to the target device based on the first encoding capability parameter and the second encoding capability parameter.

[0073] Specifically, the coding capability parameter of the device can indicate the coding capability range supported by the device, and can be expressed by the optimal coding capability parameter. According to the first coding capability parameter and the second coding capability parameter, the target coding parameter for projecting the screen from the source device to the target device can be determined by comparing the optimal coding capability parameter of the source device and the optimal coding capability parameter of the target device, and taking the lower one as the target coding parameter for projecting the screen from the source device to the target device.

[0074] Taking the frame rate included in the encoding capability parameter as an example, assuming that the maximum frame rate supported by the first encoding capability parameter of the source device is 60, and the maximum frame rate supported by the second encoding capability parameter of the target device is 50, then the frame rate in the target encoding parameter for projecting the screen from the source device to the target device is determined to be 50. The lower of the two indicates the frame rate that can be supported by both the source device and the target device.

[0075] (4) Feedback the first resolution to the target device.

[0076] like Figure 3 As shown, the specific implementation method of screen projection between the source device and the target device is explained in combination with a specific application scenario:

[0077] like Figure 3 As shown, the user first initiates screen projection, and needs to establish a media transmission P2P channel between the source device (Source end) and the target device (Sink end), which mainly includes RTSP channel and RTP channel, among which RTSP channel is mainly used for media negotiation, while RTP channel is mainly used for actual media data transmission; then, the Source end negotiates parameters such as resolution and encoding capability parameters with the Sink end, and the Source end saves the relevant capability parameters of the current Sink end (such as resolution and encoding parameters); then the Source end selects the highest resolution supported by both parties according to the resolution and encoding capability of the local end, and notifies the sink end of the final resolution. The Source end creates an encoder and a virtual screen according to the above-determined resolution, encoding parameters, etc., and then sends audio and video encoding data.

[0078] In the embodiments of the present application, there are many usage scenarios for the source device to project the screen to the target device, which are described below with examples:

[0079] (1) The source device does not enter the background screen projection

[0080] At this time, after the source device establishes the screen projection link between the source device and the target device, the main interface content of the current source device is directly projected.

[0081] (2) The source device enters the background screen projection

[0082] At this time, the background screen projection content of the source device is sent to the virtual screen; the content carried in the virtual screen is sent to the target device to be displayed on the target device.

[0083] like Figure 4 As shown, in some embodiments of the present application, the screen projection control method in the embodiment of the present application may also include the following steps 401 to 404:

[0084] 401. When a target screen projection scenario occurs on a source device, determine a target resolution and a target encoder for the current screen projection.

[0085] 402. Determine the size of the virtual screen according to the target resolution.

[0086] 403. Send the background projection content of the source device to the virtual screen according to the target encoder.

[0087] 404. Send the content carried in the virtual screen to the target device according to the target encoder, so as to be displayed on the target device.

[0088] After the source device enters the background screen projection, there are multiple application scenarios. The target screen projection scenario belongs to the application scenario after the source device enters the background screen projection. The target screen projection scenario can include multiple application scenarios. For example, the target screen projection scenario includes the scenario in which the target application is opened on the source device and the source device enters the background screen projection state. The target screen projection scenario also includes the scenario in which the source device exits the background screen projection state after entering the background screen projection. The specific details are not limited here.

[0089] In the case of different target screen projection scenarios on the source device, there are different ways to determine the target resolution and target encoder of the current screen projection. The following examples are used to illustrate:

[0090] (1) The target screen projection scenario is when the target application is opened on the source device and the source device enters the background screen projection state

[0091] At this time, determining the target resolution and target encoder of the current screen projection in step 401 may include: determining whether the target application is a playback application; if so, determining whether the target application is currently in a horizontal or vertical state; if the target application is currently in a horizontal state, determining that the target resolution of the current screen projection is a second resolution, and the second resolution is the horizontal resolution corresponding to the first resolution; recreating a second encoder based on the second resolution and target encoding parameters, and using the second encoder as the target encoder.

[0092] When the target application is a playback application, after the source device enters the background screen projection, it will enter the single application screen projection state, and the screen needs to be projected according to the application situation. If the target application is not a playback application, the source device will enter the background screen projection and continue to project the screen according to the current projection resolution.

[0093] It should be noted that the playback application can be an audio and video application, a game application (playback scenario within a game application), or a document application, and the specifics are not limited here.

[0094] Specifically, determining whether the target application is a playback application may be as follows: determining whether the target application is in a target application list, which may be a preset application list; if it is in the target application list, it is determined to be a playback application; if not, it is determined not to be a playback application.

[0095] That is, the method for judging playback applications mainly depends on the setting of the application whitelist (i.e., the target application list). In a specific embodiment, the whitelist can be used to survey the actual situation of playback applications (including long and short video applications) of the top 100 applications at home and abroad in advance, and configure corresponding whitelists for different playback application situations. The whitelist can be updated in real time through the RUS service and pushed to the source device.

[0096] At this time, determining the size of the virtual screen according to the target resolution in step 402 may include: resetting the size of the virtual screen according to the second resolution.

[0097] At this time, in step 403, according to the target encoder, the content carried in the virtual screen is sent to the target device for display on the target device, which may include: according to the second encoder, the background projection content of the source device is sent to the virtual screen with a reset size for carrying; according to the second encoder, the content carried in the virtual screen with a reset size is sent to the target device for display on the target device.

[0098] In the target screen projection scenario described above, the target application is currently in a horizontal screen state. In the target screen projection scenario, the target application is opened on the source device, and the source device enters the background screen projection state. The target application may also be in a vertical screen state. At this time, determining the target resolution and target encoder of the current screen projection in step 401 can also include two other specific scenarios for implementation:

[0099] 1. The target application is currently in portrait mode. The target application supports landscape mode switching.

[0100] In one embodiment, specifically, determining the target resolution and target encoder of the current projection in step 401 may also include: if the target application is a playback application and the target application is currently in portrait mode, determining whether the target application supports horizontal screen playback switching; if the target application supports horizontal screen playback switching, determining that the target resolution of the current projection is a second resolution, and determining a target angle that the target application needs to be rotated to switch to landscape mode, the second resolution being the horizontal screen resolution corresponding to the first resolution; and recreating a third encoder based on the second resolution and the target encoding parameters, and using the third encoder as the target encoder.

[0101] At this time, determining the size of the virtual screen according to the target resolution in step 402 includes: resetting the size of the virtual screen according to the second resolution.

[0102] At this time, in step 403, the content carried in the virtual screen is sent to the target device according to the target encoder for display on the target device, including: sending the background projection content of the source device to the virtual screen with the reset size according to the third encoder; rotating the content carried in the virtual screen with the reset size to the target angle according to the third encoder, and sending it to the target device for display on the target device.

[0103] 2. The target application is currently in portrait mode and does not support horizontal screen playback switching.

[0104] In one embodiment, specifically, determining the target resolution and target encoder of the current screen projection in step 401 may also include: if the target application is a playback application, the target application is currently in portrait mode and the target application does not support horizontal screen playback switching, determining that the target resolution of the current screen projection is the first resolution, and the target encoder of the current screen projection is the first encoder.

[0105] At this time, in step 403, the content carried in the virtual screen is sent to the target device according to the target encoder for display on the target device, including: sending the background projection content of the source device to the virtual screen according to the first encoder, and sending the content carried in the virtual screen to the target device according to the first encoder for display on the target device.

[0106] The following is a detailed description based on a specific application scenario:

[0107] When the user does not open a playback application, the screen will still be projected according to the resolution of the current projection when entering the background projection; when the user opens a playback application, it is necessary to first determine whether the current application is in landscape playback state or portrait state. If it is in landscape state, the encoder is recreated according to the resolution of the sink end (target device), and the size of the virtual screen is reset before the application is pulled up to the virtual screen for display; the current playback application enters the background projection in portrait state, and it is necessary to determine whether the playback application supports landscape playback switching. If the playback application supports landscape playback switching, the angle that the application needs to be rotated to switch to landscape is obtained, and then the encoder is recreated according to the sink end, the size of the virtual screen is reset, and then the playback application is rotated to a certain angle and pulled up to the virtual screen; if the current playback application enters the background projection in portrait state, and the application cannot be switched to landscape, the original projection encoder and virtual screen state are maintained, and the application is directly pulled up to the virtual screen.

[0108] (2) The target screen projection scenario is the scenario where the source device exits the background screen projection state

[0109] At this time, the target resolution and target encoder of the current projection are determined in step 401, including:

[0110] If the current projection screen resolution is the highest resolution supported by the source device, determine that the target resolution is the first resolution, and the target encoder of the current projection screen is the first encoder;

[0111] At this time, in step 403, the content carried in the virtual screen is sent to the target device according to the target encoder for display on the target device, including: exiting the target application, sending the main screen content of the source device to the virtual screen, and sending the content carried in the virtual screen to the target device according to the first encoder for display on the target device.

[0112] In some embodiments, determining the target resolution and target encoder of the current projection in step 401 may further include: if the current projection resolution is the highest resolution supported by the target device, determining the target resolution to be the highest resolution supported by the target device; recreating an encoder according to the highest resolution supported by the target device to obtain a fourth encoder, and using the fourth encoder as the target encoder;

[0113] At this time, determining the size of the virtual screen according to the target resolution in step 402 includes: resetting the current virtual screen size according to the highest resolution supported by the target device;

[0114] At this time, in step 403, the content carried in the virtual screen is sent to the target device according to the target encoder for display on the target device, including: exiting the current application, sending the content carried in the virtual screen of the reset size from the source device, and sending the content carried in the virtual screen of the reset size to the target device according to the fourth encoder for display on the target device.

[0115] The following is a detailed description based on a specific application scenario:

[0116] When the source device exits background screen projection, if the current resolution is created based on the source device, the current playback application will be exited directly, and the main screen content of the source device will be pulled up and displayed directly on the virtual screen.

[0117] When the source device exits the background, if the current resolution is created according to the target device, you need to recreate the encoder according to the previous resolution scheme of the source device, reset the size of the virtual screen, and then exit the current application to pull the main screen content of the source device to the virtual screen for display.

[0118] During the entire implementation process of the above-mentioned multiple embodiments, when the source device enters and exits the background screen projection, no new virtual screen is created, but the previous virtual screen is reused, and the size of the virtual screen is simply reset according to the current actual situation. This not only reduces overhead, but also reduces development and maintenance costs.

[0119] At the same time, after the source device enters the background screen projection, based on the actual situation of the current application, choose whether to make corresponding switches according to the resolution of the source device, so as to achieve the effect of adaptive switching to full-screen playback, improving the user viewing experience and interface display effect.

[0120] The above embodiment describes the screen projection control method from the perspective of the source device, and the following embodiment describes the screen projection control method from the perspective of the target device.

[0121] In this embodiment, the description will be made from the perspective of a screen projection control device, which can be specifically integrated into a target device.

[0122] See also Figure 5 , Figure 5 This is a flow chart of another embodiment of the screen projection control method in the embodiment of the present application. The screen projection control method may specifically include the following steps 501 to 502:

[0123] 501. After establishing a screen projection link between a source device and a target device, determine a first resolution and target encoding parameters for the target device to receive the screen projection of the source device.

[0124] The first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device;

[0125] 502. When the source device enters the background screen projection state, receive the multimedia content sent by the source device.

[0126] Among them, the multimedia content is the content carried in the virtual screen of the source device, the virtual screen is created based on the first resolution, the content carried in the virtual screen is sent according to the first encoder, and the first encoder is created based on the target encoding parameters and the first resolution.

[0127] After establishing a screen projection link between the source device and the target device, the embodiment of the present application determines the first resolution and target encoding parameters of the screen projection from the source device to the target device through negotiation between the source device and the target device. Since the first resolution and target encoding parameters of the screen projection are supported by both parties, the subsequently created virtual screen and the first encoder are also created based on the parameters negotiated by both parties, taking into account the respective row display performance parameters adapted by the source device and the target device, and can present a higher interface display quality.

[0128] It should be noted that the target device is the screen projection device of the source device. Some specific implementation details of the screen projection control method on the target device side can refer to the specific implementation details of the screen projection control method on the source device side, and will not be repeated here.

[0129] The following is an introduction to the embodiment of the present application in conjunction with a specific application scenario in which the corresponding relationship between a source device, a virtual screen, and a display screen in a target device changes:

[0130] The user initiates screen projection and establishes a screen projection link between the source device and the target device. After the virtual screen is created, screen projection begins between the source device and the target device. Figure 6 As shown, it shows the correspondence between the source device, virtual screen and display screen in the target device after the screen projection starts.

[0131] When the user enters the background screen projection on the source device and enters the target application, if the target application does not support horizontal screen switching, the virtual screen remains unchanged and Figure 6 In the projection mode, if the target application supports horizontal screen switching, Figure 7 As shown, the angle required for the application to switch to landscape mode is obtained, the size of the virtual screen is reset, and then the target application is rotated to the angle and then pulled up to the virtual screen.

[0132] When the user exits background screen projection on the source device, it is determined whether the virtual screen is consistent with that before entering the background screen projection. That is, when exiting the background screen projection, if the current resolution is created according to the highest resolution supported by the source device, the current target application is exited directly, and the main screen content is pulled up and displayed directly on the virtual screen.

[0133] When exiting background screen projection, if the current resolution is created based on the highest resolution supported by the target device, such as Figure 8 As shown, you need to recreate the encoder according to the resolution scheme of the previous source device, reset the virtual screen size, and then exit the current target application to pull the main screen content up to the virtual screen for display.

[0134] During the entire implementation process of the above embodiment, when the source device enters and exits the background screen projection, no new virtual screen is created. Instead, the previous virtual screen is reused. The size of the virtual screen is simply reset according to the current actual situation, thereby achieving normalization of the virtual screen. This not only reduces overhead, but also reduces development and maintenance costs.

[0135] In order to facilitate better implementation of the screen projection control method provided in the embodiment of the present application, the embodiment of the present application also provides a device based on the above screen projection control method. The meanings of the terms are the same as those in the above screen projection control method, and the specific implementation details can refer to the description in the method embodiment.

[0136] See also Fig. 9 , Fig. 9 A schematic diagram of the structure of a screen projection control device provided in an embodiment of the present application is applied to a target device in a device group, wherein the screen projection control device 900 may include a determination module 901, a creation module 902 and a screen projection module 903, wherein:

[0137] A determination module 901 is used to determine, after establishing a screen projection link between a source device and a target device, a first resolution and a target encoding parameter for projecting a screen from the source device to the target device, wherein the first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device;

[0138] A creation module 902 is used to create a virtual screen for screen projection according to the first resolution; and to create a first encoder according to the target encoding parameters and the first resolution;

[0139] The screen projection module 903 is used to send the background projection content of the source device to the virtual screen according to the first encoder when the source device enters the background projection state; and send the content carried in the virtual screen to the target device for display on the target device.

[0140] In some embodiments of the present application, the determination module 901 is specifically used to:

[0141] Receiving a second resolution capability parameter and a second encoding capability parameter sent by the target device;

[0142] Determining a first resolution of projecting a screen of the source device to the target device according to the first resolution capability parameter and the second resolution capability parameter;

[0143] Determining a target encoding parameter for projecting a screen from the source device to the target device according to the first encoding capability parameter and the second encoding capability parameter;

[0144] The first resolution is fed back to the target device.

[0145] In some embodiments of the present application, the screen projection module 903 is also used to:

[0146] When a target screen projection scenario occurs on the source device, determine a target resolution and a target encoder for the current screen projection;

[0147] Determining the size of the virtual screen according to the target resolution;

[0148] Sending the background screen projection content of the source device to the virtual screen carrier according to the target encoder;

[0149] The content carried in the virtual screen is sent to the target device according to the target encoder so as to be displayed on the target device.

[0150] In some embodiments of the present application, the target screen projection scenario includes a scenario in which a target application is opened on the source device and the source device enters a background screen projection state;

[0151] The screen projection module 903 is specifically used for:

[0152] Determine whether the target application is a playback application;

[0153] If yes, determine whether the target application is currently in a landscape state or a portrait state;

[0154] If the target application is currently in a horizontal screen state, determining that the target resolution of the current projection is a second resolution, where the second resolution is a horizontal screen resolution corresponding to the first resolution;

[0155] re-create a second encoder according to the second resolution and the target encoding parameter, and use the second encoder as a target encoder;

[0156] resetting the size of the virtual screen according to the second resolution;

[0157] According to the second encoder, the background screen projection content of the source device is sent to the virtual screen with a reset size; according to the second encoder, the content carried in the virtual screen with a reset size is sent to the target device for display on the target device.

[0158] In some embodiments of the present application, the screen projection module 903 is specifically used for:

[0159] If the target application is a playback application and the target application is currently in portrait mode, determining whether the target application supports landscape playback switching;

[0160] If the target application supports horizontal screen playback switching, determine that the target resolution of the current projection is a second resolution, and determine a target angle that the target application needs to rotate to switch to horizontal screen, where the second resolution is the horizontal screen resolution corresponding to the first resolution;

[0161] re-create a third encoder according to the second resolution and the target encoding parameter, and use the third encoder as a target encoder;

[0162] resetting the size of the virtual screen according to the second resolution;

[0163] According to the third encoder, the background projection content of the source device is sent to the virtual screen with a reset size; according to the third encoder, the content carried on the virtual screen with a reset size is rotated to the target angle and sent to the target device for display on the target device.

[0164] In some embodiments of the present application, the screen projection module 903 is further used for:

[0165] If the target application is a playback application, the target application is currently in a portrait mode and does not support landscape playback switching, determining that the target resolution of the current projection is the first resolution and the target encoder of the current projection is the first encoder;

[0166] According to the first encoder, the background projection content of the source device is sent to the virtual screen for carrying, and according to the first encoder, the content carried in the virtual screen is sent to the target device for display on the target device.

[0167] In some embodiments of the present application, the target screen projection scenario includes a scenario in which the source device exits the background screen projection state;

[0168] The screen projection module 903 is also specifically used for:

[0169] If the current projection screen resolution is the highest resolution supported by the source device, determine that the target resolution is the first resolution, and the target encoder of the current projection screen is the first encoder;

[0170] Exit the target application, send the main screen content of the source device to the virtual screen, and send the content carried in the virtual screen to the target device according to the first encoder to be displayed on the target device.

[0171] In some embodiments of the present application, the screen projection module 903 is further used for:

[0172] If the current projection screen resolution is the highest resolution supported by the target device, then determining the target resolution to be the highest resolution supported by the target device;

[0173] re-creating an encoder according to the highest resolution supported by the target device to obtain a fourth encoder, and using the fourth encoder as a target encoder;

[0174] Reset the current virtual screen size according to the highest resolution supported by the target device;

[0175] Exit the current application, carry the content sent by the source device to the resized virtual screen, and send the content carried in the resized virtual screen to the target device according to the fourth encoder to be displayed on the target device.

[0176] After establishing a screen projection link between the source device and the target device, the embodiment of the present application determines the first resolution and target encoding parameters of the screen projection from the source device to the target device through negotiation between the source device and the target device. Since the first resolution and target encoding parameters of the screen projection are supported by both parties, the subsequently created virtual screen and the first encoder are also created based on the parameters negotiated by both parties, taking into account the respective row display performance parameters adapted by the source device and the target device, and can present a higher interface display quality.

[0177] The above embodiments describe the screen projection control device from the perspective of the source device, and the following embodiments describe the screen projection control device from the perspective of the target device.

[0178] See also Fig.10 , Fig.10 A schematic diagram of the structure of a screen projection control device provided in an embodiment of the present application is applied to a first source device in a device group, wherein the screen projection control device 1000 may include a determination module 1001 and a screen projection module 1002, wherein:

[0179] A determination module 1001 is used to determine, after establishing a screen projection link between a source device and a target device, a first resolution and a target encoding parameter for the target device to receive the screen projection of the source device, wherein the first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device;

[0180] The screen projection module 1002 is used to receive multimedia content sent by the source device when the source device enters the background screen projection state, wherein the multimedia content is the content carried in the virtual screen of the source device, the virtual screen is created based on the first resolution, and the content carried in the virtual screen is sent according to the first encoder, which is created based on the target encoding parameters and the first resolution.

[0181] In some embodiments of the present application, the determination module 1001 is specifically used to:

[0182] Sending its own second resolution capability parameter and second encoding capability parameter to the source device, so that the source device determines a first resolution of the screen projected by the source device to the target device according to the first resolution capability parameter and the second resolution capability parameter, and determines a target encoding parameter for the screen projected by the source device to the target device according to the first encoding capability parameter and the second encoding capability parameter;

[0183] Receive the first resolution fed back by the source device.

[0184] After establishing a screen projection link between the source device and the target device, the embodiment of the present application determines the first resolution and target encoding parameters of the screen projection from the source device to the target device through negotiation between the source device and the target device. Since the first resolution and target encoding parameters of the screen projection are supported by both parties, the subsequently created virtual screen and the first encoder are also created based on the parameters negotiated by both parties, taking into account the respective row display performance parameters adapted by the source device and the target device, and can present a higher interface display quality.

[0185] The present application also provides an electronic device, such as Fig.11 As shown, it shows a schematic diagram of the structure of the electronic device involved in the embodiment of the present application, specifically:

[0186] The electronic device may include components such as a processor 1101 with one or more processing cores, a memory 1102 with one or more computer-readable storage media, a power supply 1103, and an input unit 1104. Those skilled in the art will appreciate that Fig.11 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0187] The processor 1101 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 1102, and calling data stored in the memory 1102, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. Optionally, the processor 1101 may include one or more processing cores; preferably, the processor 1101 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operation storage medium, user interface and application program, etc., and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 1101.

[0188] The memory 1102 can be used to store software programs and modules. The processor 1101 executes various functional applications and data processing by running the software programs and modules stored in the memory 1102. The memory 1102 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating storage medium, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 1102 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 1102 may also include a memory controller to provide the processor 1101 with access to the memory 1102.

[0189] The electronic device also includes a power supply 1103 for supplying power to each component. Preferably, the power supply 1103 can be logically connected to the processor 1101 through a power management storage medium, so as to manage charging, discharging, and power consumption through the power management storage medium. The power supply 1103 can also include any components such as one or more DC or AC power supplies, recharge storage media, power failure detection circuits, power converters or inverters, and power status indicators.

[0190] The electronic device may further include an input unit 1104, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0191] Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically in this embodiment, the processor 1101 in the electronic device will load the executable file corresponding to the process of one or more applications into the memory 1102 according to the instruction, and the processor 1101 will run the application stored in the memory 1102, thereby implementing the steps in the above-mentioned screen projection control method embodiment.

[0192] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0193] To this end, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. The computer program is loaded by a processor to execute the steps in any screen projection control method provided in the embodiment of the present application.

[0194] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0195] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0196] Since the computer program stored in the computer-readable storage medium can execute the steps in any one of the screen projection control methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the screen projection control methods provided in the embodiments of the present application can be achieved. Please see the previous embodiments for details and will not be repeated here.

[0197] The above is a detailed introduction to a screen projection control method, device, equipment and storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A screen projection control method, characterized in that: Applied to a source device, the method comprises: After establishing a screen projection link between a source device and a target device, determining a first resolution and a target encoding parameter for projecting a screen from the source device to the target device, wherein the first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device; Creating a virtual screen for screen projection according to the first resolution; Creating a first encoder according to the target encoding parameters and the first resolution; When the source device enters the background screen projection state, the background screen projection content of the source device is sent to the virtual screen bearer according to the first encoder; The content carried in the virtual screen is sent to the target device to be displayed on the target device.

2. The screen projection control method according to claim 1, characterized in that: The determining of a first resolution and a target encoding parameter for projecting a screen from the source device to the target device includes: Receiving a second resolution capability parameter and a second encoding capability parameter sent by the target device; Determining a first resolution of projecting a screen of the source device to the target device according to the first resolution capability parameter and the second resolution capability parameter; Determining a target encoding parameter for projecting a screen from the source device to the target device according to the first encoding capability parameter and the second encoding capability parameter; The first resolution is fed back to the target device.

3. The screen projection control method according to claim 1, characterized in that: The method further comprises: When a target screen projection scenario occurs on the source device, determine a target resolution and a target encoder for the current screen projection; Determining the size of the virtual screen according to the target resolution; Sending the background screen projection content of the source device to the virtual screen carrier according to the target encoder; The content carried in the virtual screen is sent to the target device according to the target encoder so as to be displayed on the target device.

4. The screen projection control method according to claim 3, characterized in that: The target screen projection scenario includes a scenario in which a target application is opened on the source device and the source device enters a background screen projection state; Determining the target resolution and target encoder of the current projection screen includes: Determine whether the target application is a playback application; If yes, determine whether the target application is currently in a landscape state or a portrait state; If the target application is currently in a horizontal screen state, determining that the target resolution of the current projection is a second resolution, where the second resolution is a horizontal screen resolution corresponding to the first resolution; re-create a second encoder according to the second resolution and the target encoding parameter, and use the second encoder as a target encoder; Determining the size of the virtual screen according to the target resolution includes: resetting the size of the virtual screen according to the second resolution; The sending of the content carried in the virtual screen to the target device according to the target encoder for display on the target device includes: sending the background projection content of the source device to the resized virtual screen for carrying according to the second encoder; sending the content carried in the resized virtual screen to the target device according to the second encoder for display on the target device.

5. The screen projection control method according to claim 4, characterized in that: Determining the target resolution and target encoder of the current screen projection also includes: If the target application is a playback application and the target application is currently in portrait mode, determining whether the target application supports landscape playback switching; If the target application supports horizontal screen playback switching, determine that the target resolution of the current projection is a second resolution, and determine a target angle that the target application needs to rotate to switch to horizontal screen, where the second resolution is the horizontal screen resolution corresponding to the first resolution; re-create a third encoder according to the second resolution and the target encoding parameter, and use the third encoder as a target encoder; Determining the size of the virtual screen according to the target resolution includes: resetting the size of the virtual screen according to the second resolution; The method of sending the content carried in the virtual screen to the target device according to the target encoder for display on the target device includes: sending the background projection content of the source device to the virtual screen with a reset size according to the third encoder; rotating the content carried in the virtual screen with a reset size to the target angle according to the third encoder, and sending it to the target device for display on the target device.

6. The screen projection control method according to claim 4 or 5, characterized in that: The determining of the target resolution and target encoder of the current screen projection also includes: If the target application is a playback application, the target application is currently in a portrait mode and does not support landscape playback switching, determining that the target resolution of the current projection is the first resolution and the target encoder of the current projection is the first encoder; The method of sending the content carried in the virtual screen to the target device according to the target encoder for display on the target device includes: sending the background projection content of the source device to the virtual screen according to the first encoder, and sending the content carried in the virtual screen to the target device according to the first encoder for display on the target device.

7. The screen projection control method according to claim 3, characterized in that: The target screen projection scenario includes a scenario in which the source device exits the background screen projection state; Determining the target resolution and target encoder of the current projection screen includes: If the current projection screen resolution is the highest resolution supported by the source device, determine that the target resolution is the first resolution, and the target encoder of the current projection screen is the first encoder; The sending of the content carried in the virtual screen to the target device according to the target encoder for display on the target device includes: exiting the target application, sending the main screen content of the source device to the virtual screen for carrying, and sending the content carried in the virtual screen to the target device according to the first encoder for display on the target device.

8. The screen projection control method according to claim 7, characterized in that: Determining the target resolution and target encoder of the current screen projection also includes: If the current projection screen resolution is the highest resolution supported by the target device, then determining the target resolution to be the highest resolution supported by the target device; re-creating an encoder according to the highest resolution supported by the target device to obtain a fourth encoder, and using the fourth encoder as a target encoder; Determining the size of the virtual screen according to the target resolution includes: resetting the current virtual screen size according to the highest resolution supported by the target device; The sending of the content carried in the virtual screen to the target device according to the target encoder for display on the target device includes: exiting the current application, carrying the content sent by the source device on the virtual screen with a reset size, and sending the content carried in the virtual screen with a reset size to the target device according to the fourth encoder for display on the target device.

9. A screen projection control method, characterized in that: Applied to a target device, the method comprises: After establishing a screen projection link between the source device and the target device, determining a first resolution and a target encoding parameter at which the target device receives the screen projection of the source device, wherein the first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device; When the source device enters the background screen projection state, multimedia content sent by the source device is received, where the multimedia content is content carried in a virtual screen of the source device, the virtual screen is created based on the first resolution, and the content carried in the virtual screen is sent according to a first encoder, which is created based on the target encoding parameters and the first resolution.

10. The screen projection control method according to claim 9, characterized in that: The step of determining the first resolution and target encoding parameters of the target device receiving the screen projection of the source device includes: Sending its own second resolution capability parameter and second encoding capability parameter to the source device, so that the source device determines a first resolution of the screen projected by the source device to the target device according to the first resolution capability parameter and the second resolution capability parameter, and determines a target encoding parameter for the screen projected by the source device to the target device according to the first encoding capability parameter and the second encoding capability parameter; Receive the first resolution fed back by the source device.

11. A screen projection control device, characterized in that: Applied to a source device, the device comprises: A determination module, configured to determine, after establishing a screen projection link between a source device and a target device, a first resolution and a target encoding parameter for projecting a screen from the source device to the target device, wherein the first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device; A creation module, configured to create a virtual screen for screen projection according to the first resolution; and to create a first encoder according to the target encoding parameters and the first resolution; The screen projection module is used to send the background projection content of the source device to the virtual screen according to the first encoder when the source device enters the background projection state; and send the content carried in the virtual screen to the target device for display on the target device.

12. A screen projection control device, characterized in that: Applied to a target device, the apparatus comprises: A determination module, used to determine, after establishing a screen projection link between a source device and a target device, a first resolution and a target encoding parameter at which the target device receives the screen projection of the source device, wherein the first resolution is within a first resolution capability parameter supported by the source device and within a second resolution capability parameter supported by the target device, and the target encoding parameter is within a first encoding capability parameter supported by the source device and within a second encoding capability parameter supported by the target device; A screen projection module is used to receive multimedia content sent by the source device when the source device enters a background screen projection state, wherein the multimedia content is content carried in a virtual screen of the source device, the virtual screen is created based on the first resolution, and the content carried in the virtual screen is sent according to a first encoder, which is created based on the target encoding parameters and the first resolution.

13. An electronic device, characterized in that: It includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps in the screen projection control method as described in any one of claims 1 to 10.

14. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in the screen projection control method described in any one of claims 1 to 10.

Citation Information

Patent Citations

  • Self-adaptive interconnection screen projection method for mobile phone and computer terminal

    CN110286864A

  • Application screen projection control method and device, equipment and medium

    CN111432070A

  • Screen projection resolution conversion method and device, equipment and storage medium

    CN113284472A

  • Screen projection method and electronic equipment

    CN116033157A