Screen projection control method and device, computer readable medium and electronic equipment

By realizing the screen projection protocol conversion on the TV-side public screen projection protocol service, the security and control capabilities problems in wireless screen projection technology are solved and the user experience is improved.

CN119071546APending Publication Date: 2024-12-03TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310638380.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

Wireless screen projection technology has access security issues when playing videos, limited playback of encrypted content and poor playback control capabilities. Especially when using private screen projection protocol, it is necessary to manually open the TV application, which affects the user experience.

Method used

By using the third-party screen projection service of the TV side that is permanently resident public screen projection protocol, the screen projection protocol is implemented, so as to use the private screen projection protocol to project without manually opening the target side of the screen projection to improve the user experience .

Benefits of technology

It achieves better screen projection effect and higher security and control capabilities, avoids the tedious operation of manually opening the target end of the screen projection, and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071546A_ABST
    Figure CN119071546A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a screen projection control method and device, a computer readable medium and electronic equipment. The method comprises the following steps: generating a screen projection control instruction, wherein the screen projection control instruction comprises identification information and screen projection parameter information of a screen projection source end; the screen projection control instruction is sent to a third-party screen projection service based on the first screen projection protocol, so that the third-party screen projection service pulls up a screen projection target end corresponding to the screen projection source end, and the screen projection parameter information is sent to the screen projection target end; receiving a second screen projection protocol-based connection request sent by the screen projection target end according to the screen projection parameter information; and in response to the connection request, carrying out connection with the screen projection target end based on a second screen projection protocol and carrying out screen projection processing. According to the technical scheme provided by the invention, a better screen projection effect can be realized by using the second screen projection protocol (such as a private screen projection protocol), and the tedious operation of manually opening the screen projection target end in advance when the second screen projection protocol is used can be avoided, so that the screen projection experience of a user is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer and communication technology, and more specifically, to a screen projection control method, device, computer-readable medium and electronic device. Background Art

[0002] Wireless screen projection technology refers to the technology of projecting the screen of terminal devices (such as mobile phones, tablets, etc.) to projection devices (such as smart TVs, etc.) for display. With the development of Internet technology, wireless screen projection technology has been widely used in the field of video playback. Common application scenarios include projecting videos played on mobile phones to smart TVs for playback through wireless screen projection technology.

[0003] When casting videos, if the mobile phone uses the DLNA (Digital Living Network Alliance) public casting protocol to cast to the smart TV, there will be access security issues, and the playback of encrypted content is limited and the playback control ability is also poor. However, if the mobile phone uses the content platform's private casting protocol to cast to the smart TV, then when casting, you need to open the content platform's application on the TV first, which has the problem of limited use. Summary of the invention

[0004] The embodiments of the present application provide a screen projection control method, device, computer-readable medium and electronic device, which can not only use a private screen projection protocol to achieve a better screen projection effect, but also avoid the tedious operation of manually opening the screen projection target end in advance when using a private screen projection protocol, which is conducive to improving the user's screen projection experience.

[0005] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by the practice of the present application.

[0006] According to one aspect of an embodiment of the present application, a screen projection control method is provided, including: generating a screen projection control instruction, the screen projection control instruction including identification information of a screen projection source end and screen projection parameter information; sending the screen projection control instruction to a third-party screen projection service based on a first screen projection protocol, so that the third-party screen projection service pulls up a screen projection target end corresponding to the screen projection source end, and sends the screen projection parameter information to the screen projection target end; receiving a connection request based on a second screen projection protocol sent by the screen projection target end according to the screen projection parameter information; in response to the connection request, connecting with the screen projection target end based on the second screen projection protocol and performing screen projection processing.

[0007] According to one aspect of an embodiment of the present application, a screen projection control method is provided, including: receiving a screen projection control instruction sent by a screen projection source end based on a first screen projection protocol, the screen projection control instruction including identification information and projection parameter information of the screen projection source end; if it is determined that the screen projection protocol conversion processing can be performed on the screen projection source end according to the identification information of the screen projection source end, then pulling up the screen projection target end corresponding to the screen projection source end; after the screen projection target end is started, sending the screen projection parameter information to the screen projection target end, so that the screen projection target end establishes a connection with the screen projection source end based on the second screen projection protocol based on the screen projection parameter information and performs screen projection processing.

[0008] According to one aspect of an embodiment of the present application, a screen projection control method is provided, including: starting a screen projection target end according to a pull-up request initiated by a third-party screen projection service that supports a first screen projection protocol, the pull-up request being sent by the third-party screen projection service after determining that the third-party screen projection service can perform screen projection protocol conversion processing on the screen projection source end according to a screen projection control instruction sent by a screen projection source end; receiving screen projection parameter information sent by the third-party screen projection service, the screen projection parameter information being included in the screen projection control instruction; initiating a connection request based on a second screen projection protocol to the screen projection source end according to the screen projection parameter information; and after establishing a connection based on the second screen projection protocol with the screen projection source end, performing screen projection processing through the second screen projection protocol.

[0009] According to one aspect of an embodiment of the present application, a screen projection control device is provided, including: a generating unit, configured to generate a screen projection control instruction, wherein the screen projection control instruction includes identification information of a screen projection source end and screen projection parameter information; a first sending unit, configured to send the screen projection control instruction to a third-party screen projection service based on a first screen projection protocol, so that the third-party screen projection service pulls up a screen projection target end corresponding to the screen projection source end, and sends the screen projection parameter information to the screen projection target end; a first receiving unit, configured to receive a connection request based on a second screen projection protocol sent by the screen projection target end according to the screen projection parameter information; a first processing unit, configured to connect with the screen projection target end based on the second screen projection protocol and perform screen projection processing in response to the connection request.

[0010] In some embodiments of the present application, based on the aforementioned scheme, the screen projection control device also includes: an acquisition unit, configured to search for available screen projection devices and obtain device description information corresponding to the third-party screen projection service provided by the screen projection device before the first sending unit sends the screen projection control instruction to the third-party screen projection service based on the first screen projection protocol, wherein the device description information includes a target field for indicating whether the third-party screen projection service based on the first screen projection protocol supports screen projection protocol conversion; a parsing unit, configured to parse the device description information and obtain the value of the target field; the first sending unit is configured to: if it is determined that the third-party screen projection service supports screen projection protocol conversion according to the value of the target field, then send the screen projection control instruction to the third-party screen projection service.

[0011] In some embodiments of the present application, based on the aforementioned scheme, the screen projection parameter information includes the network address information of the screen projection source end; the screen projection control device also includes: a connection establishment unit configured to establish a connection with the screen projection service backend; the first receiving unit is configured to: receive a connection request forwarded by the screen projection service backend, the connection request is sent by the screen projection target end to the screen projection service backend, and carries the network address information of the screen projection source end.

[0012] In some embodiments of the present application, based on the aforementioned scheme, the connection establishment unit is configured to: when the screen projection source needs to project the screen, start the screen projection service corresponding to the screen projection source; and establish a connection with the screen projection service background through the screen projection service.

[0013] In some embodiments of the present application, based on the aforementioned scheme, the screen projection parameter information includes the local area network service address information corresponding to the screen projection source end; the first receiving unit is configured to: receive a connection request based on the second screen projection protocol initiated by the screen projection target end based on the local area network service address information.

[0014] In some embodiments of the present application, based on the aforementioned scheme, the screen projection control device also includes: an execution unit, configured to start the screen projection service corresponding to the screen projection source end when the screen projection source end needs to project the screen; establish a local area network server through the screen projection service, and use the address information of the local area network server as the local area network service address information corresponding to the screen projection source end.

[0015] According to one aspect of an embodiment of the present application, a screen projection control device is provided, including: a second receiving unit, configured to receive a screen projection control instruction sent by a screen projection source end based on a first screen projection protocol, the screen projection control instruction including identification information of the screen projection source end and screen projection parameter information; a second processing unit, configured to pull up a screen projection target end corresponding to the screen projection source end if it is determined that screen projection protocol conversion processing can be performed on the screen projection source end according to the identification information of the screen projection source end; a second sending unit, configured to send the screen projection parameter information to the screen projection target end after the screen projection target end is started, so that the screen projection target end establishes a connection with the screen projection source end based on the second screen projection protocol based on the screen projection parameter information and performs screen projection processing.

[0016] In some embodiments of the present application, based on the aforementioned scheme, the screen projection control device also includes: a generating unit, configured to generate service declaration information before the second receiving unit receives the screen projection control instruction sent by the screen projection source end based on the first screen projection protocol, the service declaration information including device description information corresponding to the third-party screen projection service, and the device description information including a target field for indicating whether the third-party screen projection service supports screen projection protocol conversion; the second sending unit is also configured to: send the service declaration information to the screen projection source end, so that the screen projection source end sends the screen projection control instruction to the third-party screen projection service when it determines that the third-party screen projection service supports screen projection protocol conversion according to the value of the target field.

[0017] In some embodiments of the present application, based on the aforementioned scheme, the target field contains at least one screen projection source identifier; the screen projection source identifier is used to indicate that the third-party screen projection service supports the corresponding screen projection source to perform screen projection protocol conversion processing.

[0018] In some embodiments of the present application, based on the aforementioned scheme, the process of the second processing unit pulling up the projection target end corresponding to the projection source end includes: if it is detected that the projection target end has been installed, and the version of the installed projection target end meets the set version requirement, then calling the application programming interface corresponding to the projection target end to start the projection target end; if it is detected that the projection target end is not installed, or the version of the projection target end does not meet the set version requirement, then presenting download prompt information for the projection target end, and after the installation of the projection target end is completed based on the download prompt information, calling the application programming interface corresponding to the projection target end to start the projection target end.

[0019] In some embodiments of the present application, based on the aforementioned scheme, the second processing unit is also configured to: before pulling up the projection target end corresponding to the projection source end, if it is detected that the projection target end is not installed, or the version of the projection target end does not meet the set version requirements, then according to the projection parameter information, perform screen projection processing with the projection source end based on the first projection protocol.

[0020] According to one aspect of an embodiment of the present application, a screen projection control device is provided, including: a starting unit, configured to start a screen projection target end according to a pull-up request initiated by a third-party screen projection service that supports a first screen projection protocol, the pull-up request is sent by the third-party screen projection service after determining that the third-party screen projection service can perform screen projection protocol conversion processing on the screen projection source end according to the screen projection control instruction sent by the screen projection source end; a third receiving unit, configured to receive screen projection parameter information sent by the third-party screen projection service, the screen projection parameter information is included in the screen projection control instruction; a third sending unit, configured to initiate a connection request based on a second screen projection protocol to the screen projection source end according to the screen projection parameter information; a third processing unit, configured to perform screen projection processing through the second screen projection protocol after establishing a connection based on the second screen projection protocol with the screen projection source end.

[0021] In some embodiments of the present application, based on the aforementioned scheme, the screen projection parameter information includes the network address information of the screen projection source, and a connection is established between the screen projection source and the screen projection service backend; the third sending unit is configured to: send a connection request carrying the network address information and based on the second screen projection protocol to the screen projection service backend, so that the screen projection service backend forwards the connection request to the screen projection source according to the network address information of the screen projection source.

[0022] In some embodiments of the present application, based on the aforementioned scheme, the screen projection parameter information includes the local area network service address information corresponding to the screen projection source; the third sending unit is configured to: based on the local area network service address information, initiate a connection request based on the second screen projection protocol to the screen projection source.

[0023] According to one aspect of an embodiment of the present application, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the screen projection control method as described in the above embodiment is implemented.

[0024] According to one aspect of an embodiment of the present application, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more computer programs, wherein when the one or more computer programs are executed by the one or more processors, the electronic device implements the screen projection control method as described in the above embodiments.

[0025] According to one aspect of an embodiment of the present application, a computer program product is provided, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium. A processor of an electronic device reads and executes the computer program from the computer-readable storage medium, so that the electronic device executes the screen projection control method provided in the above-mentioned various optional embodiments.

[0026] In the technical solutions provided in some embodiments of the present application, the screen projection source end can send the generated screen projection control instruction to a third-party screen projection service based on the first screen projection protocol, and then the third-party screen projection service can pull up the screen projection target end corresponding to the screen projection source end, and send the screen projection parameter information to the screen projection target end, and then the screen projection source end can receive the connection request based on the second screen projection protocol sent by the screen projection target end according to the screen projection parameter information, and connect with the screen projection target end based on the second screen projection protocol based on the connection request and perform screen projection processing. It can be seen that the technical solution of the embodiments of the present application can use a third-party screen projection service that is resident on the screen projection target end and adopts the first screen projection protocol (such as a public screen projection protocol) to realize the conversion processing of the screen projection protocol (such as conversion to a private screen projection protocol), and then can use the second screen projection protocol (such as a private screen projection protocol) to achieve a better screen projection effect, and can avoid the cumbersome operation of manually opening the screen projection target end in advance when using the second screen projection protocol, which is conducive to improving the user's screen projection experience.

[0027] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A schematic diagram showing an exemplary system architecture to which the technical solution of the embodiments of the present application can be applied;

[0029] Figure 2 A flow chart of a screen projection control method according to an embodiment of the present application is shown;

[0030] Figure 3 A flow chart of a screen projection control method according to an embodiment of the present application is shown;

[0031] Figure 4 A flow chart of a screen projection control method according to an embodiment of the present application is shown;

[0032] Figure 5 A schematic diagram of a screen projection interface according to an embodiment of the present application is shown;

[0033] Figure 6 A schematic diagram of a screen casting switching interface using the technical solution of the present application according to an embodiment of the present application is shown;

[0034] Figure 7 A schematic diagram of a system architecture of the technical solution of an embodiment of the present application is shown;

[0035] Figure 8 A process flow chart of a device discovery phase according to an embodiment of the present application is shown;

[0036] Fig. 9 A flowchart of initiating a screen projection control instruction according to an embodiment of the present application is shown;

[0037] Fig.10 A flowchart of reconnecting based on screen projection parameter information according to an embodiment of the present application is shown;

[0038] Fig.11 A flow chart of establishing a private screen projection protocol connection through local area network transmission according to an embodiment of the present application is shown;

[0039] Fig.12 A flow chart of establishing a private screen projection protocol connection through cloud transmission according to an embodiment of the present application is shown;

[0040] Fig.13 A block diagram of a screen projection control device according to an embodiment of the present application is shown;

[0041] Fig.14 A block diagram of a screen projection control device according to an embodiment of the present application is shown;

[0042] Fig.15 A block diagram of a screen projection control device according to an embodiment of the present application is shown;

[0043] Fig.16 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION

[0044] The exemplary embodiments are now described in a more comprehensive manner with reference to the accompanying drawings. However, the exemplary embodiments can be implemented in various forms and should not be understood as being limited to these examples; on the contrary, the purpose of providing these embodiments is to make this application more comprehensive and complete, and to fully convey the concept of the exemplary embodiments to those skilled in the art.

[0045] In addition, the features, structures or characteristics described in the present application may be combined in one or more embodiments in any suitable manner. In the following description, there are many specific details so that the embodiments of the present application can be fully understood. However, those skilled in the art will appreciate that when implementing the technical scheme of the present application, all the detailed features in the embodiments may not be needed, one or more specific details may be omitted, or other methods, elements, devices, steps, etc. may be adopted.

[0046] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0047] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0048] It should be noted that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0049] It can be understood that in the specific implementation of this application, related data such as the screen projection protocol are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0050] In an application scenario of the present application, users can cast the video played on the mobile phone to the smart TV for playback based on wireless screen projection technology, so as to obtain a better video viewing experience. Generally speaking, the smart TV systems launched by TV manufacturers are built-in with integrated public screen projection protocol services (such as screen projection services based on DLNA protocol, etc.), which can run permanently. As long as the TV is turned on, the mobile phone can be used for screen projection, which meets the needs of users to cast the screen and watch videos at any time. However, the public screen projection protocol service integrated in the smart TV system has problems such as device access security, limited playback of encrypted content, and poor playback control capabilities. For example, since the public screen projection protocol screen projection service uses a video address when playing, it is impossible to automatically cut the episode after leaving the mobile phone, and it is also impossible to switch the video playback clarity. It is also difficult to perceive the real-time playback status, and it is impossible to perform interactive operations (such as barrage).

[0051] Therefore, in order to improve the video projection experience, content platforms can usually establish private projection protocols to provide a safer, more stable, and richer projection experience between mobile applications and TV applications. For example, it is possible to perceive the playback status of the TV in real time, and support functions such as episode switching, clarity switching, and interaction on the TV. Although private projection protocols have many advantages, since the processes of TV applications provided by content platforms are not resident, if users need to use private projection protocols for projection, they also need to manually open the TV application in advance, which is relatively limited in use.

[0052] Based on the above-mentioned problems existing in the screen projection process, the embodiment of the present application proposes a new screen projection control solution. A third-party screen projection service that is resident on the TV and adopts a public screen projection protocol can be used to implement the conversion process of the screen projection protocol (such as conversion to a private screen projection protocol). Therefore, the private screen projection protocol can be used to achieve a better screen projection effect, and the tedious operation of manually opening the TV application in advance when using the private screen projection protocol can be avoided, which is beneficial to improving the user's screen projection experience.

[0053] Specifically, in a system architecture using the technical solution of the embodiment of the present application, Figure 1 As shown, it may include a projection source terminal 110, a projection target terminal 130 and a server 120. The server 120 may be a server that provides content to the projection source terminal 110, such as providing playable video content to the projection source terminal 110, and the projection source terminal 110 may deliver the video content being played to the projection target terminal for playback.

[0054] Among them, the server 120 involved in the embodiment of the present application can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and basic cloud computing services such as big data and artificial intelligence platforms. The screen projection source end 110 can be a terminal device such as a mobile phone, tablet computer, laptop computer, PDA or personal computer with screen projection function, or an application client running on these terminal devices; the screen projection target end 130 can be a smart TV or other screen projection devices, or an application client running on these screen projection devices, etc., but is not limited to this.

[0055] Optionally, the screen projection source terminal 110 and the screen projection target terminal 130 can establish communication through a local area network (LAN) or a wide area network (WAN). In one example, when the user uses the same account to log in to the screen projection source terminal 110 and the screen projection target terminal 130, the screen projection source terminal 110 and the screen projection target terminal 130 can communicate with each other through the wide area network. In another example, the screen projection source terminal 110 and the screen projection target terminal 130 used by the user are connected to the same router. At this time, a local area network can be formed between the screen projection source terminal 110 and the screen projection target terminal 130, and each device in the local area network can communicate with each other through the router.

[0056] Optionally, the connection between the server 120 and the screen projection source end 110, and the connection between the server 120 and the screen projection target end 130 can be communicated through a wireless network, a wired network or a removable storage medium.

[0057] In one embodiment of the present application, the screen projection source end 110 may be a video client running on a terminal device (for ease of description, referred to as a source client), and the screen projection target end 130 may be a video client running on a screen projection device (such as a smart TV) (for ease of description, referred to as a target client). The source client obtains the video content from the server 120 and plays it. When the user wishes to project the video content played by the source client to a screen projection device with a larger screen for playback, the source client may generate a screen projection control instruction, which includes the source client's identification information and screen projection parameter information, and then the source client sends the screen projection control instruction to the screen projection device, and a third-party screen projection service based on a first screen projection protocol (such as a public screen projection protocol) is running on the screen projection device. Therefore, after receiving the screen projection control instruction, if the third-party screen projection service determines that the screen projection protocol conversion process can be performed on the source client according to the source client's identification information, then the third-party screen projection service can pull up the target client corresponding to the source client and send the screen projection parameter information to the target client.

[0058] After receiving the screen projection parameter information, the target client can send a connection request based on the second screen projection protocol (such as a private screen projection protocol) to the source client according to the screen projection parameter information, and then the source client can respond to the connection request, connect with the target client based on the second screen projection protocol and perform screen projection. It can be seen that the technical solution of the embodiment of the present application can realize the conversion process of the screen projection protocol (such as conversion to a private screen projection protocol) through a resident third-party screen projection service that adopts the first screen projection protocol, and then the second screen projection protocol (such as a private screen projection protocol) can be used to achieve a better screen projection effect, and the tedious operation of manually opening the target client in advance when using the second screen projection protocol can be avoided, which is conducive to improving the user's screen projection experience.

[0059] The implementation details of the technical solution of the embodiment of the present application are described in detail below:

[0060] Figure 2 The flowchart of the screen projection control method according to an embodiment of the present application is shown. The screen projection control method can be executed by a terminal device installed with a screen projection source terminal, such as a mobile phone, a tablet computer, etc. Figure 2 As shown, the screen projection control method includes at least steps S210 to S240, which are described in detail as follows:

[0061] In step S210, a screen projection control instruction is generated, which includes identification information of the screen projection source and screen projection parameter information.

[0062] In some optional embodiments, the identification information of the screen projection source is used to identify the source of the screen projection content. For example, if the screen projection source is a mobile video client developed by a content platform, the identification information of the screen projection source may be the name of the mobile video client, etc. The screen projection parameter information includes relevant parameters used when performing screen projection, such as the video content information to be projected, the login status information on the screen projection source (such as the video client) (such as whether logged in, login account information, etc.), and the device information of the terminal device where the screen projection source (such as the video client) is located (such as the IP address, network port, etc.).

[0063] In step S220, the screen projection control instruction is sent to a third-party screen projection service based on the first screen projection protocol, so that the third-party screen projection service pulls up the screen projection target end corresponding to the screen projection source end, and sends the screen projection parameter information to the screen projection target end.

[0064] In some optional embodiments, the third-party screen projection service based on the first screen projection protocol can be a third-party screen projection service running on a screen projection device (such as a smart TV), such as a screen projection service provided by a TV manufacturer using a public screen projection protocol. In other words, the first screen projection protocol can be a public screen projection protocol, and the third-party screen projection service can be a screen projection service resident on the screen projection device, so that the screen projection control instructions initiated by the screen projection source can be received at any time.

[0065] Optionally, the screen projection target end may be a video client running on the screen projection device, such as a TV-side video client developed by a content platform. The screen projection source end and the corresponding screen projection target end may adopt a second screen projection protocol developed by the content platform that is different from the first screen projection protocol for screen projection processing. For example, the second screen projection protocol may be a private screen projection protocol developed by the content platform.

[0066] In some optional embodiments, before a terminal device with a screen projection source installed sends a screen projection control instruction to a third-party screen projection service based on the first screen projection protocol, it is necessary to perform a device search process to search for available screen projection devices. After searching for an available screen projection device, the device description information corresponding to the third-party screen projection service provided by the screen projection device can be obtained. The device description information contains a target field for indicating whether the third-party screen projection service based on the first screen projection protocol supports the screen projection protocol conversion. Furthermore, the terminal device with the screen projection source installed can obtain the value of the target field by parsing the device description information, and when it is determined that the third-party screen projection service supports the screen projection protocol conversion according to the value of the target field, the screen projection control instruction is sent to the third-party screen projection service. Alternatively, when it is determined that the third-party screen projection service supports the screen projection protocol conversion according to the value of the target field, the screen projection control instruction in the aforementioned embodiment can be generated and sent to the third-party screen projection service.

[0067] It should be noted that if the projection parameter information includes the video content information to be projected, the login status information on the projection source (such as the video client), the device information of the terminal device where the projection source (such as the video client) is located, etc. Then after receiving the projection parameter information, the projection target end can determine the login account information of the video client (such as whether it is a member account login) based on the login status information, and determine the video content that needs to be played after the projection based on the video content information to be projected. The device information of the terminal device where the projection source is located is used for the projection target end to initiate a connection request based on the second projection protocol with the projection source end.

[0068] In step S230, a connection request based on the second screen projection protocol sent by the screen projection target end according to the screen projection parameter information is received.

[0069] In some optional embodiments, the screen projection source can establish a connection with the screen projection service background, and the screen projection parameter information can include the network address information of the screen projection source, which is the network address information of the terminal device on which the screen projection source is installed, such as an IP address. In this case, the screen projection target can carry the network address information of the screen projection source to send a connection request to the screen projection service background, and then the screen projection service background forwards the connection request to the screen projection source, and then the screen projection source can receive the connection request based on the second screen projection protocol sent by the screen projection target. The technical solution of this embodiment is to realize the connection between the screen projection target and the screen projection source through the cloud.

[0070] Optionally, when the screen projection source needs to project the screen, it can start the screen projection service corresponding to the screen projection source, and then establish a connection with the screen projection service background through the screen projection service. It should be noted that the screen projection service can be, for example, a screen projection SDK (Software Development Kit), and the screen projection service and the screen projection source run on the same terminal device. Of course, in other embodiments of the present application, the screen projection source may not start the screen projection service, but may directly establish a connection with the screen projection service background.

[0071] In some optional embodiments, the screen projection parameter information may include the local area network service address information corresponding to the screen projection source. In this case, the screen projection target end may initiate a connection request based on the second screen projection protocol to the screen projection source end based on the local area network service address information. The technical solution of this embodiment is to realize the connection between the screen projection target end and the screen projection source end through a local area network.

[0072] Optionally, when the screen projection source needs to project the screen, it can start the screen projection service corresponding to the screen projection source, and then establish a LAN server through the screen projection service, such as a TCP (Transmission Control Protocol) Server, and use the address information of the LAN server as the LAN service address information corresponding to the screen projection source. It should be noted that the screen projection service can be, for example, a screen projection SDK, and the screen projection service and the screen projection source run on the same terminal device. Of course, in other embodiments of the present application, the screen projection source may not start the screen projection service, but may directly establish a LAN server, and establish a connection with the screen projection service background through the LAN service address information.

[0073] In step S240, in response to the connection request sent by the screen projection target end, a connection is established with the screen projection target end based on the second screen projection protocol and screen projection processing is performed.

[0074] It should be noted that after the screen projection source receives the connection request sent by the screen projection target end, it can establish a connection based on the second screen projection protocol with the screen projection target end, and perform screen projection processing based on the second screen projection protocol, that is, realize the conversion from the first screen projection protocol to the second screen projection protocol. If the second screen projection protocol is a public screen projection protocol, and the first screen projection protocol is a private screen projection protocol of the content platform, then the technical solution of the embodiment of the present application can use a resident third-party screen projection service that adopts a public screen projection protocol to realize the conversion processing of the screen projection protocol (such as conversion to a private screen projection protocol), thereby using the private screen projection protocol to achieve a better screen projection effect, and avoid the tedious operation of manually opening the screen projection target end in advance when using the private screen projection protocol, which is beneficial to improving the user's screen projection experience.

[0075] Figure 3 A flowchart of a screen projection control method according to an embodiment of the present application is shown. The screen projection control method can be executed by a screen projection device running a third-party screen projection service, such as a smart TV, a display, or other screen projection device. Figure 3 As shown, the screen projection control method at least includes steps S310 to S330, which are described in detail as follows:

[0076] In step S310, a screen projection control instruction sent by a screen projection source is received based on the first screen projection protocol, and the screen projection control instruction includes identification information of the screen projection source and screen projection parameter information.

[0077] In some optional embodiments, the screen projection source is the source of the screen projection content, and the identification information of the screen projection source is used to identify the source of the screen projection content. For example, if the screen projection source is a mobile video client developed by a content platform, then the identification information of the screen projection source may be the name of the mobile video client, etc. The screen projection parameter information includes relevant parameters used when performing screen projection, such as the video content information to be projected, the login status information on the screen projection source (such as the video client) (such as whether logged in, login account information, etc.), and the device information of the terminal device where the screen projection source (such as the video client) is located (such as IP address, network port, etc.).

[0078] Optionally, the first screen projection protocol can be a public screen projection protocol on the screen projection device, and the third-party service using the first screen projection protocol can be a screen projection service resident on the screen projection device, so that the screen projection control instructions initiated by the screen projection source can be received at any time.

[0079] In some optional embodiments, before the projection device running a third-party screen projection service receives the projection control instruction sent by the projection source end based on the first screen projection protocol, it is necessary to perform a device search process with the projection source end. Specifically, the projection device running a third-party screen projection service can generate service declaration information, which includes device description information corresponding to the third-party screen projection service, and the device description information includes a target field for indicating whether the third-party screen projection service supports the projection protocol conversion. Then the projection device running the third-party screen projection service can send the service declaration information to the projection source end (for example, it can be sent by broadcasting so that the projection source end can obtain the service declaration information), so that when the projection source end determines that the third-party screen projection service supports the projection protocol conversion according to the value of the target field, it sends the projection control instruction to the third-party screen projection service.

[0080] Optionally, the target field contained in the device description information in the service declaration information may contain at least one projection source identifier, which is used to indicate that the third-party projection service supports the corresponding projection source to perform projection protocol conversion processing. For example, if the target field contains the identifier of video client 1 and the identifier of video client 2, it means that the third-party projection service supports protocol conversion processing for video client 1 and video client 2.

[0081] In step S320, if it is determined that the screen projection protocol conversion process can be performed on the screen projection source end according to the identification information of the screen projection source end, the screen projection target end corresponding to the screen projection source end is pulled up.

[0082] In some optional embodiments, the process of pulling up the projection target end corresponding to the projection source end is to start the projection target end corresponding to the projection source end through a third-party service resident in the projection device. Specifically, if it is detected that the projection target end has been installed, and the version of the installed projection target end meets the set version requirement (for example, higher than a certain version), then the application programming interface corresponding to the projection target end can be called to start the projection target end. If it is detected that the projection target end is not installed, or the version of the projection target end does not meet the set version requirement, then a download prompt message for the projection target end can be presented to prompt the user whether to download and install the projection target end that meets the requirements. If the user confirms to download and install, then after the projection target end is downloaded and installed, the application programming interface corresponding to the projection target end can be called to start the projection target end.

[0083] In some optional embodiments, if it is detected that the screen projection target end is not installed, or the version of the screen projection target end does not meet the set version requirements, the screen projection processing can also be performed directly based on the screen projection parameter information, based on the first screen projection protocol and the screen projection source end. And the user can also be prompted whether to download and install the screen projection target end that meets the requirements. If the user confirms to download and install, the download and installation process of the screen projection target end can be executed, so that the third-party service can pull up the screen projection target end for screen projection processing next time.

[0084] In step S330, after the screen projection target end is started, the screen projection parameter information is sent to the screen projection target end, so that the screen projection target end establishes a connection with the screen projection source end based on the second screen projection protocol based on the screen projection parameter information and performs screen projection processing.

[0085] Optionally, the process of establishing a connection between the projection target end and the projection source end based on the projection parameter information and performing projection processing based on the second projection protocol can refer to Figure 4 The technical solution of the embodiment shown.

[0086] Figure 4 The flowchart of a screen projection control method according to an embodiment of the present application is shown. The screen projection control method can be executed by a screen projection device installed with a screen projection target terminal, such as a smart TV, a display, or other screen projection device. Figure 4 As shown, the screen projection control method at least includes steps S410 to S440, which are described in detail as follows:

[0087] In step S410, the screen projection target end is started according to a pull-up request initiated by a third-party screen projection service that supports the first screen projection protocol. The pull-up request is sent by the third-party screen projection service after determining that the third-party screen projection service can perform screen projection protocol conversion processing for the screen projection source end based on the screen projection control instruction sent by the screen projection source end.

[0088] Optionally, after determining that the third-party screen projection service can perform screen projection protocol conversion processing on the screen projection source end, it can start the screen projection target end by calling the application programming interface corresponding to the screen projection target end. The specific process can refer to the technical solution of the aforementioned embodiment and will not be repeated here.

[0089] In step S420, screen projection parameter information sent by a third-party screen projection service is received, and the screen projection parameter information is included in the screen projection control instruction.

[0090] In some optional embodiments, the screen projection parameter information includes relevant parameters used when performing screen projection, such as the video content information to be projected, the login status information on the screen projection source (such as the video client) (such as whether logged in, login account information, etc.), and the device information of the terminal device where the screen projection source (such as the video client) is located (such as the IP address, network port, etc.). Optionally, after receiving the screen projection parameter information, the screen projection target end can determine the login account information of the video client (such as whether it is a member account login) based on the login status information, and determine the video content that needs to be played after the screen projection based on the video content information to be projected. The device information of the terminal device where the screen projection source is located is used for the screen projection target end to initiate a connection request based on the second screen projection protocol with the screen projection source end.

[0091] In step S430, a connection request based on the second screen projection protocol is initiated to the screen projection source according to the screen projection parameter information.

[0092] In some optional embodiments, the screen projection source can establish a connection with the screen projection service background, and the screen projection parameter information can include the network address information of the screen projection source, which is the network address information of the terminal device on which the screen projection source is installed, such as an IP address. In this case, the screen projection target can send a connection request based on the second screen projection protocol and carrying the network address information of the screen projection source to the screen projection service background, and then the screen projection service background forwards the connection request to the screen projection source, and then the screen projection source can receive the connection request based on the second screen projection protocol sent by the screen projection target. The technical solution of this embodiment is to realize the connection between the screen projection target and the screen projection source through the cloud.

[0093] In some optional embodiments, the screen projection parameter information may include the local area network service address information corresponding to the screen projection source. In this case, the screen projection target end may initiate a connection request based on the second screen projection protocol to the screen projection source end based on the local area network service address information. The technical solution of this embodiment is to realize the connection between the screen projection target end and the screen projection source end through a local area network.

[0094] In step S440, after establishing a connection with the screen projection source based on the second screen projection protocol, screen projection processing is performed through the second screen projection protocol.

[0095] It should be noted that if the second screen projection protocol is a public screen projection protocol and the first screen projection protocol is the private screen projection protocol of the content platform, then the technical solution of the embodiment of the present application can use a resident third-party screen projection service that adopts a public screen projection protocol to realize the conversion processing of the screen projection protocol (such as conversion to a private screen projection protocol). In this way, the private screen projection protocol can be used to achieve a better screen projection effect, and the tedious operation of manually opening the screen projection target end in advance when using the private screen projection protocol can be avoided, which is conducive to improving the user's screen projection experience.

[0096] The following combination Figures 5 to 12 , the implementation details of the technical solution of the embodiment of the present application are elaborated in detail:

[0097] First, combine Figure 5 and Figure 6 The interface presentation effect of the technical solution of the embodiment of the present application is described as follows: Figure 5 The figure shows the selection interface when the user uses a terminal device (such as a mobile phone) to cast the screen. In this interface, multiple screen casting options are displayed. Figure 5 501 shown in the figure is the screen projection protocol option provided by TV manufacturer x. Since the screen projection protocol of TV manufacturer x is a screen projection protocol resident in the TV background (i.e., a public screen projection protocol), it can receive screen projection requests from users at any time. Figure 5 Click the "Cast Now" button corresponding to the TV manufacturer x screen casting protocol shown in the figure. The interface is as follows: Figure 6 As shown in the figure, the connection interface based on the TV manufacturer's x screen projection protocol 601 is first displayed through Figure (A), and then the prompt information 602 is displayed on the interface based on Figure (B) to prompt the user that the user will switch to the xxTV screen projection service (i.e., the screen projection service using a private screen projection protocol). After the switch, as shown in Figure (C), the display interface that has switched to the xxTV screen projection service (such as the prompt information shown in 603) will be displayed.

[0098] It should be noted that, in the embodiments of the present application, Figure 6 The (B) diagram shown in the figure is not a necessary interface, but can be directly displayed by Figure 6 The (A) diagram shown in the figure is switched to the (C) diagram. Optionally, Figure 6 The (A) diagram shown in the figure may also be an interface that is not necessarily displayed. When the user clicks Figure 5 After clicking the "Cast Now" button corresponding to the TV manufacturer x screen casting protocol shown in the figure, you can also switch directly to Figure 6 As shown in (C) figure.

[0099] pass Figure 5 and Figure 6It can be seen that in the embodiments of the present application, the screen projection protocol can be converted into a private screen projection protocol based on a resident third-party screen projection service that adopts a public screen projection protocol. Therefore, the private screen projection protocol can be used to achieve a better screen projection effect, and the tedious operation of manually opening the screen projection target end in advance when using the private screen projection protocol can be avoided, which is conducive to improving the user's screen projection experience.

[0100] Figure 7 A system architecture diagram of the technical solution of an embodiment of the present application is shown, wherein the xx video mobile terminal is the screen projection source terminal, the third-party DLNA DMR (Digital Media Renderer) service is the third-party screen projection service, and xxTV is the screen projection target terminal. In the specific implementation, xxTV can be a video client installed on the screen projection device.

[0101] During the DLNA device discovery phase, third-party DLNA DMR services need to declare that DMR supports traffic diversion, where supporting traffic diversion means supporting the conversion of public screen projection protocols to private screen projection protocols. After discovering the device, the xx video mobile terminal parses the DMR service declaration information to identify the DMR service that supports traffic diversion.

[0102] Optionally, the third-party DLNA DMR service can declare that DMR supports streaming in the device description information (ie, description). The declaration field can be castService. When castService is declared as xxVideo, it means that streaming of xx video is supported. For example, the declaration method can be as follows: <castservice> xxVideo< / castservice> Optionally, the DMR service can also declare in the description that it supports multiple traffic diversion methods. The mobile terminals corresponding to these multiple traffic diversion methods can be separated by English commas. For example, the following declaration method indicates that the diversion processing of xx video and yy video is supported: <castservice> xxVideo,yyVideo< / castservice> .

[0103] Continue to refer to Figure 7 As shown in the figure, when the user chooses a third-party DLNA DMR service that supports diversion to initiate screen projection, the user can carry the xx video identifier (i.e., the identifier information of the screen projection source) and the public-to-private transparent transmission parameters (i.e., the screen projection parameter information) to initiate the screen projection control instruction. After receiving the screen projection control instruction, the third-party DLNA DMR service determines that the public-to-private processing of the xx video is supported based on the xx video identifier, and then determines whether xxTV is installed and whether the version meets the requirements.

[0104] For example, if it is agreed that versions with a version number greater than or equal to 11.1.5 support public-to-private conversion, then after reading versionName to obtain the version number, the first three segments of the version number are judged. If they are greater than or equal to 11.5.0, then the version is considered to support public-to-private conversion. For example, 11.5.0, 11.5.2, 11.6.0, and 12.0.0 all support it.

[0105] If xxTV is not installed or the version does not meet the requirements, you can guide the download and installation of xxTV. When guiding the download of xxTV, you can display a prompt message to the user. If the user confirms the download and installation, the download and installation progress can be displayed and the user can be prompted to wait. At the same time, the user can also choose to use the DLNA public screen projection protocol for screen projection and playback, or can choose to pull up xxTV after installation for screen projection and playback processing using the private screen projection protocol. If the user does not agree to download and install, screen projection and playback can be performed using the public screen projection protocol.

[0106] It should be noted that during the download and installation process, the screen can also be cast using the original public screen casting protocol. If xxTV is installed, you can also not execute the public-to-private jump to xxTV for screen casting and playback, but continue to use the public screen casting protocol of the third-party DLNA DMR service for screen casting and playback until the next screen casting is performed through the public-to-private protocol conversion, and pull up xxTV to use the private screen casting protocol for screen casting and playback.

[0107] If xxTV has been installed or the version meets the requirements, xxTV will be launched, and the public-to-private transparent transmission parameters will be transparently transmitted to xxTV. xxTV will complete the process of converting the public screen projection protocol to the private screen projection protocol. After completing the reconnection of the private screen projection protocol, the xx video mobile terminal and xxTV will communicate through the private screen projection protocol.

[0108] like Figure 8 As shown, the processing flow of the device discovery phase according to an embodiment of the present application includes the following steps:

[0109] S801, the third-party DLNA DMR service executes the DLNA standard process, and the broadcasting device goes online.

[0110] S802, the xx video mobile terminal executes the DLNA standard process to search for devices.

[0111] S803, the xx video mobile terminal executes the DLNA standard process to obtain device description information description.

[0112] S804: The third-party DLNA DMR service executes the DLNA standard process and returns a description.

[0113] As mentioned above, the device description information description may declare that the third-party DLNA DMR service supports streaming. The declaration field may be castService. When castService is declared as xxVideo, it indicates that streaming processing of xx video is supported.

[0114] S805, this step is a newly added process in the embodiment of the present application, that is, parsing the description, obtaining the declaration field to identify whether the DMR service supports traffic diversion.

[0115] In one embodiment of the present application, if it is determined according to the declaration field in description that the third-party DLNA DMR service supports streaming, the xx video mobile terminal can initiate a screen projection control instruction to the third-party DLNA DMR service. Fig. 9 As shown, the following steps are included:

[0116] S901, the xx video mobile terminal sends a screen projection control instruction to the third-party DLNA DMR service.

[0117] Optionally, the screen projection control instruction can be the SetAVTransportURI instruction in the DLNA protocol, which can contain the SourceID field and the MetaDataExtra field, where the SourceID field is used to identify the source of the screen projection (i.e., the identification information of the source end of the screen projection), and the MetaDataExtra field contains the public-to-private transparent transmission parameters, such as the video content played by the xx video mobile terminal, the login status information of the xx video mobile terminal, and the information of the terminal device where the xx video mobile terminal is located (such as network address information, network port information, etc.). Optionally, the screen projection source can be identified as xx video in the following ways: <sourceid> xxVideo< / sourceid> .

[0118] Optionally, the public-to-private transparent transmission parameters can be identified in the following ways: <metadataextra> Public to private transparent transmission parameters< / metadataextra> .

[0119] S902, the third-party DLNA DMR service parses the screen projection control instruction and obtains the screen projection source and public-to-private transparent transmission parameters.

[0120] Optionally, when receiving the SetAVTransportURI instruction, the third-party DLNA DMR service parses the SourceID field to identify the source of the screen projection while parsing the playback information CurrentURIMetaData, and parses the MetaDataExtra field to read the public-to-private transparent transmission parameters. The public-to-private transparent transmission parameters obtained after reading MetaDataExtra do not need to be parsed and can be directly transmitted to xxTV when xxTV is launched.

[0121] In one embodiment of the present application, after the third-party DLNA DMR service pulls up xxTV, xxTV can parse the public-to-private transparent transmission parameters contained in the screen projection control instruction and initiate a private screen projection protocol connection. The specific process can be referred to Fig.10 In Fig.10 In the process shown, TV Agent can be deployed on the same screen projection device as xxTV; the screen projection SDK is a screen projection service initiated by the xx video mobile terminal, which can be deployed on the same terminal device as the xx video mobile terminal.

[0122] Reference Fig.10 As shown, when xxTV is pulled up externally (i.e., pulled up by a third-party DLNA DMR service), the screen projection parameter information is parsed. The screen projection parameter information includes relevant parameters used when performing screen projection, such as the video content information to be projected, the login status information on the screen projection source (i.e., the xx video mobile terminal) (such as whether logged in, login account information, etc.), and the device information of the terminal device where the screen projection source (i.e., the xx video mobile terminal) is located (such as IP address, network port, etc.). Optionally, xxTV determines the login account information of the xx video mobile terminal (such as whether it is a member account login) based on the login status information, and determines the video content that needs to be played after the screen projection based on the video content information to be projected. The device information of the terminal device where the screen projection source is located will be sent to the TV Agent, and then the TV Agent controls xxTV to establish a connection with the screen projection SDK for a private screen projection protocol through the diversion logic (it should be noted that the diversion logic is used to execute the corresponding control logic in the public-to-private processing process) based on the device information.

[0123] In one embodiment of the present application, Fig.10 As shown, TV Agent can request the screen projection SDK to establish a private screen projection protocol connection through cloud transmission and local area network transmission. After the screen projection SDK receives the private screen projection protocol connection request sent by TV Agent through cloud transmission or local area network transmission, it can establish a private screen projection protocol connection with the Agent device service in the TV Agent based on the TV Agent information detected by the device detection module through the diversion logic.

[0124] It should be noted that when implementing the technical solution of the embodiment of the present application, the TV Agent can request the screen casting SDK to establish a private screen casting protocol connection through one of the cloud transmission and the local area network transmission, or the TV Agent can request the screen casting SDK to establish a private screen casting protocol connection through both the cloud transmission and the local area network transmission. If the TV Agent requests the screen casting SDK to establish a private screen casting protocol connection through both the cloud transmission and the local area network transmission, the screen casting SDK can follow the request received first. The following is combined with Fig.11 and Fig.12 The process of establishing a private screen projection protocol connection through cloud transmission and LAN transmission is described below:

[0125] like Fig.11 As shown, according to an embodiment of the present application, the process of establishing a private screen projection protocol connection through local area network transmission includes the following steps:

[0126] S1101, the xx video mobile terminal sends a command to the screen casting SDK to start the diversion. Here, starting the diversion is to start the conversion process from the public screen casting protocol to the private screen casting protocol.

[0127] S1102, the screen projection SDK starts the LAN TCP Server.

[0128] S1103, the screen projection SDK sends a message to the xx video mobile terminal indicating that the diversion has been successfully started.

[0129] S1104, the xx video mobile terminal obtains the diversion information from the screen projection SDK. Optionally, the diversion information includes the video information to be projected and the TCP Server information (such as the port information and address information of the TCP Server).

[0130] S1105, the screen projection SDK returns the diversion information to the xx video mobile terminal, including the aforementioned video information to be projected and TCP Server information.

[0131] S1106, the xx video mobile terminal initiates a screen projection control instruction to the third-party DLNA DMR service. The screen projection control instruction may include the aforementioned video information and TCP Server information to be projected, and may also include the account login status information on the xx video mobile terminal (such as whether logged in, whether a member), and the xx video mobile terminal identifier.

[0132] S1107, the third-party DLNA DMR service launches xxTV according to the screen projection control instruction, and sends the parameters contained in the screen projection control instruction, such as the video information to be projected, TCP Server information, account login status information on the xx video mobile terminal, etc., to xxTV. Specifically, if the third-party DLNA DMR service determines that the public-to-private conversion process is supported according to the xx video mobile terminal identifier contained in the screen projection control instruction, then xxTV can be launched.

[0133] S1108, xxTV notifies TV Agent that traffic diversion is started. Traffic diversion starts, indicating that the conversion process from the public screen projection protocol to the private screen projection protocol has begun.

[0134] S1109, TV Agent requests a private screen projection protocol connection from the screen projection SDK through the local area network.

[0135] S1110, the screen projection SDK parses the Agent LAN service information.

[0136] S1111, the screen projection SDK reconnects to the TV Agent through the private screen projection protocol.

[0137] S1112, TV Agent returns a message indicating that the reconnection is successful to the screen projection SDK.

[0138] S1113, the screen casting SDK feeds back to the xx video mobile terminal that it needs to switch to the private screen casting protocol for screen casting processing. Next, the xx video mobile terminal can use the private screen casting protocol to cast the video content to be played to xxTV.

[0139] It should be noted that in Fig.11 In the illustrated embodiment, the screen projection SDK can also be integrated with the xx video mobile terminal, and the TV Agent can be integrated with the xxTV, that is, the xx video mobile terminal can have the function of the screen projection SDK, and the xxTV can have the function of the TV Agent.

[0140] like Fig.12 As shown, according to an embodiment of the present application, the process of establishing a private screen projection protocol connection through cloud transmission includes the following steps:

[0141] S1201, the xx video mobile terminal recognizes that the third-party DLNA DMR service supports traffic diversion, that is, it supports the conversion process from the public screen projection protocol to the private screen projection protocol.

[0142] S1202, the xx video mobile terminal establishes a connection with the long connection background. It should be noted that the long connection background can be the screen projection management background corresponding to the xx video mobile terminal.

[0143] S1203, the xx video mobile terminal initiates a screen projection control instruction to the third-party DLNA DMR service. The screen projection control instruction may include the video information to be projected, the network address of the xx video mobile terminal, and the account login status information on the xx video mobile terminal (such as whether logged in, whether a member), and the xx video mobile terminal identifier.

[0144] S1204, the third-party DLNA DMR service launches xxTV according to the screen projection control instruction, and sends the parameters contained in the screen projection control instruction, such as the video information to be projected, the network address of the xx video mobile terminal, the account login status information on the xx video mobile terminal, etc., to xxTV. Specifically, if the third-party DLNA DMR service determines that the public-to-private conversion process is supported according to the xx video mobile terminal identifier contained in the screen projection control instruction, then xxTV can be launched.

[0145] S1205, xxTV pushes a reconnection request to the xx video mobile terminal through the persistent connection background, carrying the network address / port of xxTV.

[0146] S1206, the long connection background sends a reconnection request to the xx video mobile terminal.

[0147] S1207, the xx video mobile terminal establishes a connection with xxTV using a private screen projection protocol through the network address / port of xxTV.

[0148] S1208, xxTV returns the information that the two-way communication is established to the xx video mobile terminal.

[0149] S1209, the xx video mobile terminal switches the screen projection target terminal, that is, switches to xxTV.

[0150] S1210, the xx video mobile terminal initiates screen projection to the xxTV. After receiving the screen projection initiated by the xx video mobile terminal, if the video information to be projected this time is the same as the video information included in the screen projection control instruction, then the playback of the corresponding video does not need to be restarted.

[0151] S1211, xxTV and xx video mobile terminals perform screen projection status synchronization.

[0152] It should be noted that in Fig.12 In the embodiment shown, the screen projection SDK can also be set on the xx video mobile terminal, so the screen projection SDK can execute Fig.12 At least one of steps S1202, S1206 and S1209 in the above embodiment and interact with the xx video mobile terminal to process information. Optionally, a TV Agent may be set up on the xxTV terminal, and the TV Agent may execute Fig.12At least one of steps S1205 and S1208.

[0153] The technical solution of the above-mentioned embodiments of the present application can use a third-party screen projection service that is resident on the screen projection target end and adopts a public screen projection protocol to realize the conversion processing of the screen projection protocol. Therefore, it is possible to use a private screen projection protocol to achieve a better screen projection effect, and avoid the tedious operation of manually opening the screen projection target end in advance when using a private screen projection protocol, which is beneficial to improving the user's screen projection experience.

[0154] The following describes an embodiment of the device of the present application, which can be used to execute the screen projection control method in the above embodiment of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the screen projection control method in the above embodiment of the present application.

[0155] Fig.13 A block diagram of a screen projection control device according to an embodiment of the present application is shown.

[0156] Reference Fig.13 As shown, according to an embodiment of the present application, a screen projection control device 1300 includes: a generating unit 1302 , a first sending unit 1304 , a first receiving unit 1306 and a first processing unit 1308 .

[0157] Among them, the generating unit 1302 is configured to generate a screen projection control instruction, which includes identification information of the screen projection source and screen projection parameter information; the first sending unit 1304 is configured to send the screen projection control instruction to a third-party screen projection service based on the first screen projection protocol, so that the third-party screen projection service pulls up the screen projection target end corresponding to the screen projection source end, and sends the screen projection parameter information to the screen projection target end; the first receiving unit 1306 is configured to receive a connection request based on the second screen projection protocol sent by the screen projection target end according to the screen projection parameter information; the first processing unit 1308 is configured to respond to the connection request, connect with the screen projection target end based on the second screen projection protocol and perform screen projection processing.

[0158] In some embodiments of the present application, based on the aforementioned scheme, the screen projection control device 1300 also includes: an acquisition unit, configured to search for available screen projection devices and obtain device description information corresponding to the third-party screen projection service provided by the screen projection device before the first sending unit 1304 sends the screen projection control instruction to the third-party screen projection service based on the first screen projection protocol, wherein the device description information includes a target field for indicating whether the third-party screen projection service based on the first screen projection protocol supports screen projection protocol conversion; a parsing unit, configured to parse the device description information and obtain the value of the target field; the first sending unit is configured to: if it is determined that the third-party screen projection service supports screen projection protocol conversion according to the value of the target field, then the screen projection control instruction is sent to the third-party screen projection service.

[0159] In some embodiments of the present application, based on the aforementioned scheme, the screen projection parameter information includes the network address information of the screen projection source end; the screen projection control device 1300 also includes: a connection establishment unit, configured to establish a connection with the screen projection service backend; the first receiving unit 1306 is configured to: receive a connection request forwarded by the screen projection service backend, the connection request is sent by the screen projection target end to the screen projection service backend, and carries the network address information of the screen projection source end.

[0160] In some embodiments of the present application, based on the aforementioned scheme, the connection establishment unit is configured to: when the screen projection source needs to project the screen, start the screen projection service corresponding to the screen projection source; and establish a connection with the screen projection service background through the screen projection service.

[0161] In some embodiments of the present application, based on the aforementioned scheme, the screen projection parameter information includes the local area network service address information corresponding to the screen projection source end; the first receiving unit 1306 is configured to: receive a connection request based on the second screen projection protocol initiated by the screen projection target end based on the local area network service address information.

[0162] In some embodiments of the present application, based on the aforementioned scheme, the screen projection control device 1300 also includes: an execution unit, configured to start the screen projection service corresponding to the screen projection source end when the screen projection source end needs to project the screen; establish a local area network server through the screen projection service, and use the address information of the local area network server as the local area network service address information corresponding to the screen projection source end.

[0163] Fig.14 A block diagram of a screen projection control device according to an embodiment of the present application is shown.

[0164] Reference Fig.14As shown, according to an embodiment of the present application, a screen projection control device 1400 includes: a second receiving unit 1402 , a second processing unit 1404 and a second sending unit 1406 .

[0165] Among them, the second receiving unit 1402 is configured to receive a screen projection control instruction sent by the screen projection source end based on the first screen projection protocol, and the screen projection control instruction includes identification information and projection parameter information of the screen projection source end; the second processing unit 1404 is configured to pull up the screen projection target end corresponding to the screen projection source end if it is determined according to the identification information of the screen projection source end that the screen projection protocol conversion processing can be performed on the screen projection source end; the second sending unit 1406 is configured to send the screen projection parameter information to the screen projection target end after the screen projection target end is started, so that the screen projection target end establishes a connection with the screen projection source end based on the second screen projection protocol based on the screen projection parameter information and performs screen projection processing.

[0166] In some embodiments of the present application, based on the aforementioned scheme, the screen projection control device 1400 also includes: a generating unit, configured to generate service declaration information before the second receiving unit receives the screen projection control instruction sent by the screen projection source end based on the first screen projection protocol, the service declaration information including device description information corresponding to the third-party screen projection service, and the device description information including a target field for indicating whether the third-party screen projection service supports the screen projection protocol conversion; the second sending unit 1406 is also configured to: send the service declaration information to the screen projection source end, so that the screen projection source end sends the screen projection control instruction to the third-party screen projection service when it determines that the third-party screen projection service supports the screen projection protocol conversion according to the value of the target field.

[0167] In some embodiments of the present application, based on the aforementioned scheme, the target field contains at least one screen projection source identifier; the screen projection source identifier is used to indicate that the third-party screen projection service supports the corresponding screen projection source to perform screen projection protocol conversion processing.

[0168] In some embodiments of the present application, based on the aforementioned scheme, the process of the second processing unit 1404 pulling up the projection target end corresponding to the projection source end includes: if it is detected that the projection target end has been installed, and the version of the installed projection target end meets the set version requirement, then calling the application programming interface corresponding to the projection target end to start the projection target end; if it is detected that the projection target end is not installed, or the version of the projection target end does not meet the set version requirement, then presenting download prompt information for the projection target end, and after the installation of the projection target end is completed based on the download prompt information, calling the application programming interface corresponding to the projection target end to start the projection target end.

[0169] In some embodiments of the present application, based on the aforementioned scheme, the second processing unit 1404 is also configured to: before pulling up the projection target end corresponding to the projection source end, if it is detected that the projection target end is not installed, or the version of the projection target end does not meet the set version requirements, then according to the projection parameter information, perform screen projection processing with the projection source end based on the first projection protocol.

[0170] Fig.15 A block diagram of a screen projection control device according to an embodiment of the present application is shown, and the screen projection control device can be applied to a screen projection device installed with a screen projection target terminal.

[0171] Reference Fig.15 As shown, according to an embodiment of the present application, a screen projection control device 1500 includes: a starting unit 1502 , a third receiving unit 1504 , a third sending unit 1506 and a third processing unit 1508 .

[0172] Among them, the starting unit 1502 is configured to start the screen projection target end according to a pull-up request initiated by a third-party screen projection service that supports the first screen projection protocol, and the pull-up request is sent by the third-party screen projection service after determining that the third-party screen projection service can perform screen projection protocol conversion processing on the screen projection source end according to the screen projection control instruction sent by the screen projection source end; the third receiving unit 1504 is configured to receive the screen projection parameter information sent by the third-party screen projection service, and the screen projection parameter information is included in the screen projection control instruction; the third sending unit 1506 is configured to initiate a connection request based on the second screen projection protocol to the screen projection source end according to the screen projection parameter information; the third processing unit 1508 is configured to perform screen projection processing through the second screen projection protocol after establishing a connection based on the second screen projection protocol with the screen projection source end.

[0173] In some embodiments of the present application, based on the aforementioned scheme, the screen projection parameter information includes the network address information of the screen projection source, and a connection is established between the screen projection source and the screen projection service backend; the third sending unit 1506 is configured to: send a connection request carrying the network address information and based on the second screen projection protocol to the screen projection service backend, so that the screen projection service backend forwards the connection request to the screen projection source according to the network address information of the screen projection source.

[0174] In some embodiments of the present application, based on the aforementioned scheme, the screen projection parameter information includes the local area network service address information corresponding to the screen projection source; the third sending unit 1506 is configured to: based on the local area network service address information, initiate a connection request based on the second screen projection protocol to the screen projection source.

[0175] Fig.16A structural schematic diagram of a computer system of an electronic device suitable for implementing an embodiment of the present application is shown. The electronic device may be a terminal device with a screen projection source installed in the aforementioned embodiment, or a screen projection device running a third-party screen projection service, or a screen projection device with a screen projection target installed, etc.

[0176] It should be noted that Fig.16 The computer system 1600 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0177] like Fig.16 As shown, the computer system 1600 may include a central processing unit (CPU) 1601, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1602 or the program loaded from the storage part 1608 to the random access memory (RAM) 1603, such as executing the method described in the above embodiment. In RAM 1603, various programs and data required for system operation are also stored. CPU 1601, ROM 1602 and RAM 1603 are connected to each other through bus 1604. Input / output (I / O) interface 1605 is also connected to bus 1604.

[0178] The following components can be connected to the I / O interface 1605: an input section 1606 including a keyboard, a mouse, etc.; an output section 1607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1608 including a hard disk, etc.; and a communication section 1609 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1609 performs communication processing via a network such as the Internet. A drive 1610 is also connected to the I / O interface 1605 as needed. A removable medium 1611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1610 as needed so that a computer program read therefrom is installed into the storage section 1608 as needed.

[0179] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program is used to perform the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 1609, and / or installed from a removable medium 1611. When the computer program is executed by a central processing unit (CPU) 1601, various functions defined in the system of the present application are executed.

[0180] It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a computer program, which may be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0181] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of the boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and a computer program.

[0182] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0183] As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable medium carries one or more computer programs, and when the above one or more computer programs are executed by an electronic device, the electronic device implements the method described in the above embodiment.

[0184] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0185] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable an electronic device to execute the method according to the implementation methods of the present application.

[0186] For example, the electronic device may be a terminal device with a screen projection source installed. Then the terminal device with the screen projection source installed may execute Figure 2 As another example, the electronic device may be a screen projection device running a third-party screen projection service, and the screen projection device running the third-party screen projection service may execute Figure 3 As another example, the electronic device may also be a screen projection device with a screen projection target terminal installed, and the screen projection device with the screen projection target terminal installed may execute Figure 4 The screen projection control method shown.

[0187] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.

[0188] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A screen projection control method, characterized in that: include: Generate a screen projection control instruction, wherein the screen projection control instruction includes identification information of the screen projection source end and screen projection parameter information; Sending the screen projection control instruction to a third-party screen projection service based on the first screen projection protocol, so that the third-party screen projection service pulls up the screen projection target end corresponding to the screen projection source end, and sends the screen projection parameter information to the screen projection target end; Receiving a connection request based on a second screen projection protocol sent by the screen projection target end according to the screen projection parameter information; In response to the connection request, a connection is established with the screen projection target end based on the second screen projection protocol and screen projection processing is performed.

2. The screen projection control method according to claim 1, characterized in that: Before sending the screen projection control instruction to a third-party screen projection service based on the first screen projection protocol, the screen projection control method further includes: Search for available screen projection devices, and obtain device description information corresponding to the third-party screen projection service provided by the screen projection device, wherein the device description information includes a target field for indicating whether the third-party screen projection service based on the first screen projection protocol supports screen projection protocol conversion; Parsing the device description information to obtain the value of the target field; The sending of the screen projection control instruction to a third-party screen projection service based on the first screen projection protocol includes: if it is determined according to the value of the target field that the third-party screen projection service supports screen projection protocol conversion, then the screen projection control instruction is sent to the third-party screen projection service.

3. The screen projection control method according to claim 1, characterized in that: The screen projection parameter information includes the network address information of the screen projection source end; The screen projection control method further includes: establishing a connection with a screen projection service backend; The receiving a connection request based on a second screen projection protocol sent by the screen projection target end according to the screen projection parameter information includes: Receive a connection request forwarded by the screen projection service backend, where the connection request is sent by the screen projection target end to the screen projection service backend and carries the network address information of the screen projection source end.

4. The screen projection control method according to claim 3, characterized in that: The establishment of a connection with the screen projection service backend includes: When the screen projection source needs to project the screen, start the screen projection service corresponding to the screen projection source; Establish a connection with the screen projection service backend through the screen projection service.

5. The screen projection control method according to claim 1, characterized in that: The screen projection parameter information includes the local area network service address information corresponding to the screen projection source end; The receiving a connection request based on a second screen projection protocol sent by the screen projection target end according to the screen projection parameter information includes: Receive a connection request based on a second screen projection protocol initiated by the screen projection target end based on the local area network service address information.

6. The screen projection control method according to claim 5, characterized in that: The screen projection control method further includes: When the screen projection source needs to project the screen, start the screen projection service corresponding to the screen projection source; A local area network server is established through the screen projection service, and the address information of the local area network server is used as the local area network service address information corresponding to the screen projection source.

7. A screen projection control method, characterized in that: include: Receive a screen projection control instruction sent by a screen projection source end based on a first screen projection protocol, wherein the screen projection control instruction includes identification information of the screen projection source end and screen projection parameter information; If it is determined according to the identification information of the screen projection source end that the screen projection protocol conversion process can be performed on the screen projection source end, then the screen projection target end corresponding to the screen projection source end is pulled up; After the screen projection target end is started, the screen projection parameter information is sent to the screen projection target end, so that the screen projection target end establishes a connection with the screen projection source end based on the second screen projection protocol based on the screen projection parameter information and performs screen projection processing.

8. The screen projection control method according to claim 7, characterized in that: Before receiving the screen projection control instruction sent by the screen projection source end based on the first screen projection protocol, the screen projection control method further includes: Generate service declaration information, wherein the service declaration information includes device description information corresponding to the third-party screen projection service, and the device description information includes a target field for indicating whether the third-party screen projection service supports screen projection protocol conversion; The service declaration information is sent to the screen projection source end, so that when the screen projection source end determines that the third-party screen projection service supports screen projection protocol conversion according to the value of the target field, the screen projection control instruction is sent to the third-party screen projection service.

9. The screen projection control method according to claim 8, characterized in that: The target field contains at least one screen projection source identifier; the screen projection source identifier is used to indicate that the third-party screen projection service supports the corresponding screen projection source to perform screen projection protocol conversion processing.

10. The screen projection control method according to claim 7, characterized in that: The pulling up the screen projection target end corresponding to the screen projection source end includes: If it is detected that the screen projection target end has been installed, and the version of the installed screen projection target end meets the set version requirement, then the application programming interface corresponding to the screen projection target end is called to start the screen projection target end; If it is detected that the projection target end is not installed, or the version of the projection target end does not meet the set version requirement, a download prompt message for the projection target end is presented. After the installation of the projection target end is completed based on the download prompt message, the application programming interface corresponding to the projection target end is called to start the projection target end.

11. The screen projection control method according to claim 7, characterized in that: Before pulling up the screen projection target end corresponding to the screen projection source end, the screen projection control method further includes: If it is detected that the screen projection target end is not installed, or the version of the screen projection target end does not meet the set version requirement, screen projection processing is performed based on the first screen projection protocol and the screen projection source end according to the screen projection parameter information.

12. A screen projection control method, characterized in that: include: Starting the screen projection target end according to a pull-up request initiated by a third-party screen projection service that supports the first screen projection protocol, wherein the pull-up request is sent by the third-party screen projection service after determining that the third-party screen projection service can perform screen projection protocol conversion processing on the screen projection source end according to the screen projection control instruction sent by the screen projection source end; Receiving screen projection parameter information sent by the third-party screen projection service, wherein the screen projection parameter information is included in the screen projection control instruction; Initiate a connection request based on a second screen projection protocol to the screen projection source end according to the screen projection parameter information; After establishing a connection with the screen projection source based on the second screen projection protocol, screen projection processing is performed through the second screen projection protocol.

13. The screen projection control method according to claim 12, characterized in that: The screen projection parameter information includes the network address information of the screen projection source end, and a connection is established between the screen projection source end and the screen projection service backend; Initiating a connection request based on a second screen projection protocol to the screen projection source end according to the screen projection parameter information, including: Send a connection request carrying the network address information and based on the second screen projection protocol to the screen projection service background, so that the screen projection service background forwards the connection request to the screen projection source end according to the network address information of the screen projection source end.

14. The screen projection control method according to claim 12, characterized in that: The screen projection parameter information includes the local area network service address information corresponding to the screen projection source end; Initiating a connection request based on a second screen projection protocol to the screen projection source end according to the screen projection parameter information, including: Based on the local area network service address information, a connection request based on a second screen projection protocol is initiated to the screen projection source.

15. A screen projection control device, characterized in that: include: A generating unit configured to generate a screen projection control instruction, wherein the screen projection control instruction includes identification information of a screen projection source and screen projection parameter information; A first sending unit is configured to send the screen projection control instruction to a third-party screen projection service based on a first screen projection protocol, so that the third-party screen projection service pulls up a screen projection target end corresponding to the screen projection source end, and sends the screen projection parameter information to the screen projection target end; A first receiving unit is configured to receive a connection request based on a second screen projection protocol sent by the screen projection target end according to the screen projection parameter information; The first processing unit is configured to respond to the connection request, connect with the screen projection target end based on the second screen projection protocol and perform screen projection processing.

16. A screen projection control device, characterized in that: include: A second receiving unit is configured to receive a screen projection control instruction sent by a screen projection source end based on the first screen projection protocol, wherein the screen projection control instruction includes identification information of the screen projection source end and screen projection parameter information; A second processing unit is configured to pull up a screen projection target end corresponding to the screen projection source end if it is determined that the screen projection protocol conversion process can be performed on the screen projection source end according to the identification information of the screen projection source end; The second sending unit is configured to send the screen projection parameter information to the screen projection target end after the screen projection target end is started, so that the screen projection target end establishes a connection with the screen projection source end based on the second screen projection protocol based on the screen projection parameter information and performs screen projection processing.

17. A screen projection control device, characterized in that: include: A starting unit, configured to start the screen projection target end according to a pull-up request initiated by a third-party screen projection service that supports the first screen projection protocol, wherein the pull-up request is sent by the third-party screen projection service after determining that the third-party screen projection service can perform screen projection protocol conversion processing on the screen projection source end according to the screen projection control instruction sent by the screen projection source end; A third receiving unit is configured to receive screen projection parameter information sent by the third-party screen projection service, where the screen projection parameter information is included in the screen projection control instruction; A third sending unit is configured to initiate a connection request based on a second screen projection protocol to the screen projection source end according to the screen projection parameter information; The third processing unit is configured to perform screen projection processing through the second screen projection protocol after establishing a connection with the screen projection source end based on the second screen projection protocol.

18. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the screen projection control method as described in any one of claims 1 to 14 is implemented.

19. An electronic device, characterized in that: include: one or more processors; A memory for storing one or more computer programs, which, when executed by the one or more processors, enables the electronic device to implement the screen projection control method as described in any one of claims 1 to 14.

20. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a computer-readable storage medium. The processor of the electronic device reads and executes the computer program from the computer-readable storage medium, so that the electronic device executes the screen projection control method as described in any one of claims 1 to 14.