Screen projection processing method and device

Abstract

The invention discloses a screen projection processing method and device, a mobile terminal searches for screen projection equipment through a preset service discovery protocol in a screen projection assistant, if the mobile terminal receives a response message returned by the screen projection assistant, it is determined that the screen projection equipment is searched, and the mobile terminal sends an instruction containing a preset field domain to the screen projection assistant, the instruction of the preset field domain is used for determining whether the projection screen device has the projection screen drainage capability, if the mobile terminal receives a reply message that the projection screen device has the projection screen drainage capability returned by a projection screen assistant, the mobile terminal is connected with the projection screen device, and when the mobile terminal is in a connected state with the projection screen device, the projection screen device is connected with the projection screen assistant. And the mobile terminal touches the screen projection information to the screen projection application program of the screen projection equipment through the mobile terminal application program so as to realize interconnection and interaction between the mobile terminal and the screen projection equipment.

Description

Technical Field

[0001] The present application relates to the technical field of data communication development for smart televisions and smart phones, and more specifically, to a screen projection processing method and device. Background Art

[0002] Currently, TV screen projection is mainly based on (Digital Living Network Alliance, DLNA) projection. DLNA projection adopts the push mode of standard protocol, that is, the video content on the mobile phone is pushed to the TV screen projection assistant application (Application, APP) in the form of (Uniform ResourceLocator, URL). The TV screen projection assistant APP parses the playback address according to the protocol specification and calls the system player to complete the video playback.

[0003] However, in the above-mentioned method of pushing videos according to the standard protocol, although DLNA screen projection can project videos on the mobile phone to the TV for playback, the playback experience is limited by the protocol itself and the interaction with the system player. The information that can be displayed on the system playback screen is limited, and the interactive experience is also limited, resulting in poor playback effect compared to TV movie APP. In addition, the screen projection content on the mobile phone can only be played for free on the TV side, and the advertising content of the video copyright holder cannot be placed. As a result, the content presented on the screen is limited to video and picture playback, resulting in limitations on the content of the screen projection.

[0004] Therefore, how to reduce the limitations of screen projection content is an issue that needs to be urgently addressed in this application. Summary of the invention

[0005] In view of this, the present application discloses a screen projection processing method and device, which realizes the interconnection and interaction between the mobile terminal and the screen projection device through the diversion intermediary, the mobile terminal application and the application of the screen projection device, and the mobile terminal application and the application of the screen projection device are developed by the same provider, so it is possible to realize advertising, member conversion, adding more interactive scenes, etc., rather than being limited to the screen projection of video and picture playback, so that the mobile terminal and the screen projection device will not be subject to interaction restrictions during the interconnection and interaction process, thereby reducing the limitations of the screen projection content.

[0006] In order to achieve the above purpose, the disclosed technical solution is as follows:

[0007] The first aspect of the present application discloses a screen projection processing method, which is applied to a mobile terminal and includes:

[0008] Search for projection devices through the preset service discovery protocol in the projection assistant;

[0009] If a response message is received from the screen projection assistant, it is confirmed that the screen projection device has been searched;

[0010] Sending a command containing a preset field field to the screen projection assistant; wherein the command in the preset field field is used to determine whether the screen projection device has the screen projection and drainage capability;

[0011] If a reply message is received from the screen projection assistant indicating that the screen projection device has the screen projection and drainage capability, the screen projection device is connected;

[0012] When the screen projection device is connected, the screen projection information is transmitted to the screen projection application of the screen projection device through the mobile application to achieve interconnection and interaction with the screen projection device.

[0013] Preferably, the searching for the screen projection device through a preset service discovery protocol in the screen projection assistant includes:

[0014] Add a field domain to the search instruction corresponding to the simple service discovery protocol in the screen projection assistant; wherein the field domain includes at least a screen projection party identification field and a screen projection type field;

[0015] Search for screen projection devices through the simple service discovery protocol after adding the field domain.

[0016] Preferably, if a reply message is received from the screen projection assistant indicating that the screen projection device has the screen projection and drainage capability, connecting with the screen projection device comprises:

[0017] Parse the reply message returned by the screen projection assistant, and if there is a preset field in the reply message, determine that a reply message returned by the screen projection assistant with screen projection and traffic diversion capability is received; wherein the preset field includes at least a manufacturer identification field and a screen projection and traffic diversion field; the screen projection and traffic diversion field is used to indicate the screen projection and traffic diversion capability possessed by the screen projection device;

[0018] Upon receiving a reply message from the screen projection assistant indicating that the screen projection assistant has the screen projection and traffic diversion capability, obtaining the screen projection device IP address and downloading the screen projection device application through the screen projection assistant;

[0019] A long connection with the local area network of the projection device is achieved through the mobile application, the projection device application, the projection device IP and a pre-set port number.

[0020] Preferably, when the screen projection device is connected, the screen projection information is transmitted to the screen projection application of the screen projection device through the mobile terminal application to achieve interconnection and interaction with the screen projection device, including:

[0021] In a state where the screen projection device is in a long connection with the local area network, source information is marked on the screen projection information according to a preset service discovery protocol to obtain the screen projection information; wherein the source information mark at least includes setting the current playback instance, the playback resource address mark and the content data of the media item;

[0022] Through the screen projection assistant and mobile application, the projection information is delivered to the projection application of the projection device to achieve interconnection and interaction with the projection device.

[0023] Preferably, it also includes:

[0024] Receive the drainage status of the screen projection device returned by the screen projection assistant and synchronize it.

[0025] The second aspect of the present application discloses a screen projection processing method, which is applied to a screen projection device, and the method includes:

[0026] Send a reply message with screen projection and traffic diversion capabilities to the mobile terminal through the screen projection assistant to trigger a connection with the mobile terminal;

[0027] While being connected to the mobile terminal, obtaining the screen projection information sent by the mobile terminal;

[0028] Realize interconnection and interaction with the mobile terminal according to the projection information;

[0029] Among them, the screen projection device is a screen projection device with screen projection and traffic diversion capabilities that is searched through a preset service discovery protocol in the screen projection assistant.

[0030] Preferably, it also includes:

[0031] The diversion status is synchronized to the mobile terminal through the screen projection assistant.

[0032] The third aspect of the present application discloses a screen projection processing device, which is applied to a mobile terminal and includes:

[0033] A search unit, used to search for a screen projection device through a preset service discovery protocol in the screen projection assistant;

[0034] A determination unit, configured to determine that a screen projection device has been searched if a response message returned by the screen projection assistant is received;

[0035] A sending unit, used to send an instruction containing a preset field field to the screen projection assistant; wherein the instruction in the preset field field is used to determine whether the screen projection device has the screen projection and drainage capability;

[0036] A connecting unit, configured to connect to the screen projection device upon receiving a reply message from the screen projection assistant indicating that the screen projection device has the screen projection and drainage capability;

[0037] The reaching unit is used to reach the projection information to the projection application of the projection device through the mobile application when the projection device is connected to the projection device, so as to realize the interconnection and interaction with the projection device.

[0038] Preferably, the search unit comprises:

[0039] An adding module is used to add a field domain to the search instruction corresponding to the simple service discovery protocol in the screen projection assistant; wherein the field domain includes at least a screen projection party identification field and a screen projection type field;

[0040] The search module is used to search for projection devices through the simple service discovery protocol after adding the field domain.

[0041] In a fourth aspect, the present application discloses a screen projection processing device, which is applied to a screen projection device, and includes:

[0042] A sending trigger unit, used to send a reply message with screen projection and traffic diversion capability to the mobile terminal through the screen projection assistant, triggering a connection with the mobile terminal;

[0043] The acquisition unit is used to acquire the screen projection information sent by the mobile terminal when being connected to the mobile terminal.

[0044] An interconnection and interaction unit is used to achieve interconnection and interaction with the mobile terminal according to the screen projection information; wherein, the screen projection device is a screen projection device with screen projection and drainage capabilities searched through a preset service discovery protocol in the screen projection assistant.

[0045] It can be seen from the above technical solution that the present application discloses a screen projection processing method and device, in which the mobile terminal searches for the projection device through the preset service discovery protocol in the projection assistant. If the mobile terminal receives a response message returned by the projection assistant, it determines that the projection device is searched, and the mobile terminal sends an instruction containing a preset field domain to the projection assistant, wherein the instruction in the preset field domain is used to determine whether the projection device has the ability to project and drain screen traffic. If the mobile terminal receives a reply message from the projection assistant that the projection device has the ability to project and drain screen traffic, the mobile terminal connects to the projection device. When the mobile terminal and the projection device are connected, the mobile terminal transmits the projection information to the projection application of the projection device through the mobile terminal application, so as to realize the interconnection and interaction between the mobile terminal and the projection device. Based on the above scheme, through the preset service discovery protocol in the screen projection assistant, the screen projection assistant is used as a diversion intermediary, so that when the mobile terminal and the screen projection device are in a state of long connection in the local area network, the mobile terminal and the screen projection device are interconnected and interactive through the diversion intermediary, the mobile terminal application and the screen projection device application. Moreover, the mobile terminal application and the screen projection device application are developed by the same provider, so it is possible to realize advertising, member conversion, adding more interactive scenes, etc., rather than being limited to the screen projection of video and picture playback, so that the mobile terminal and the screen projection device will not be subject to interaction restrictions during the interconnection and interaction process, thereby reducing the limitations of the screen projection content. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0047] Figure 1 An interactive schematic diagram of a screen projection processing method disclosed in an embodiment of the present application;

[0048] Figure 2 A schematic diagram of the interaction between the mobile application, the screen projection assistant and the screen projection application disclosed in the embodiment of the present application;

[0049] Figure 3 A flowchart of a screen projection processing method disclosed in an embodiment of the present application;

[0050] Figure 4 A flowchart of another screen projection processing method disclosed in an embodiment of the present application;

[0051] Figure 5 A schematic diagram of the structure of a screen projection processing device disclosed in an embodiment of the present application;

[0052] Figure 6 A schematic diagram of the structure of another screen projection processing device disclosed in an embodiment of the present application;

[0053] Figure 7 This is a schematic diagram of the structure of an electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0054] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0055] In this application, the terms "comprises", "comprising" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element.

[0056] As can be seen from the background technology, the current TV screen projection is mainly DLNA screen projection. DLNA screen projection adopts the so-called push mode, which is essentially to push the video content on the mobile phone to the TV screen projection assistant APP of the screen projection device in the form of a uniform resource locator (Uniform Resource Locator, URL). The screen projection assistant parses the playback address according to the protocol specification and calls the system player to complete the video playback. In this way of pushing videos according to the standard protocol, the system playback screen can only display limited information, and the interactive experience is also limited, which is quite different from the playback effect of the TV movie APP. Although DLNA screen projection can project the video on the mobile phone to the TV side for playback, the playback experience is limited by the protocol itself and the interaction of the system player. The system playback screen can only display limited information, and the interactive experience is also limited, resulting in poor playback effect with the TV movie APP. In addition, the screen projection content on the mobile phone can only be played for free on the TV side, and the advertising content of the video copyright holder cannot be placed. As a result, the content presented on the screen is limited to video and picture playback, which causes the limitation of the content of the screen projection. Therefore, how to reduce the limitation of the content of the screen projection is an urgent problem to be solved in this application.

[0057] In order to solve the above problems, the present application discloses a screen projection processing method and device, which is of great significance to realize a set of screen projection and diversion playback technical solutions that connect the mobile APP, TV screen projection assistant APP, and TV film and television APP of the screen projection device. Through the preset service discovery protocol in the screen projection assistant, the screen projection assistant is used as a diversion intermediary, so that when the mobile terminal and the screen projection device are in a state of long connection in the local area network, the mobile terminal and the screen projection device are interconnected and interactive through the diversion intermediary, the mobile terminal application and the application of the screen projection device, and the mobile terminal application and the application of the screen projection device are developed by the same provider, so that advertising, member conversion, adding more interactive scenes, etc. can be realized, and it is not limited to the screen projection of video and picture playback, so that the mobile terminal and the screen projection device will not be subject to interaction restrictions during the process of interconnection and interaction, thereby reducing the limitations of the screen projection content. The specific implementation method is specifically described through the following embodiments.

[0058] refer to Figure 1 FIG. 1 is an interactive schematic diagram of a screen projection processing method disclosed in an embodiment of the present application. The screen projection processing method mainly includes the following steps:

[0059] S101: The mobile terminal searches for the projection device through the preset service discovery protocol in the projection assistant. If the mobile terminal receives a response message returned by the projection assistant, it determines that the projection device has been searched.

[0060] The preset service discovery protocol includes but is not limited to the Simple Service Discovery Protocol (SSDP). The preset service discovery protocol of the present application is preferably SSDP.

[0061] In S101, when searching for a screen projection device through the Phone Video APP on the mobile terminal, a source identifier is added to the SSDP protocol.

[0062] The source identifier is to allow the screen casting assistant to recognize that the mobile phone screen casting comes from the partner. By adding the source identifier in the SSDP protocol, the screen casting assistant can provide the ability to cast the screen to the partner's TV movie APP. Otherwise, it only provides the standard screen casting and playback capabilities.

[0063] Among them, the Screen Casting Assistant APP supports functions such as downloading, installing, and launching TV video APPs.

[0064] The TV Cast Assistant APP replies to the Phone Movie APP on the mobile terminal with the traffic status.

[0065] The diversion status includes downloading and installing the application of the screen projection device (such as TV Film and Television APP), successful diversion and launching of the TV Film and Television APP, and failure of diversion and launching of the TV Film and Television APP.

[0066] S102: The mobile terminal sends an instruction containing a preset field domain to the screen projection assistant; wherein the instruction in the preset field domain is used to determine whether the screen projection device has the screen projection and drainage capability.

[0067] In S102, the mobile terminal adds a preset field domain to the search instruction corresponding to SSDP in the screen projection assistant through the Phone Film and Television APP, and searches for the projection device through the SSDP search instruction after adding the preset field domain.

[0068] When the screen projection assistant app replies, add an indicator in the SSDP protocol to indicate whether it supports the screen projection and diversion capability.

[0069] Among them, Phone Movie APP adds the preset field "USER-QUERY: XTV / 1,2,3" in the SSDP M-Search instruction header to inquire whether TV Screen Mirroring Assistant APP has the capabilities specified by Phone Movie APP; XTV in XTV / 1,2,3 represents the screen mirroring party identifier, and 1,2,3 represents the capabilities that Phone Movie APP needs to inquire. Phone Movie APP and TV Screen Mirroring Assistant APP predetermine the meaning of the identifier.

[0070] It should be noted that the preset field domain includes at least a projection party identification field and a projection type field. The projection type field includes 1, 2, and 3. Among them, 1 represents video playback projection; 2 represents picture playback projection; and 3 represents game projection.

[0071] The mobile terminal uses the Phone Movie APP to provide its own identity and the capabilities it is searching for when searching for devices, so that the TV Casting Assistant APP of the casting device can recognize and respond.

[0072] The relevant codes with pre-defined identification meanings between Phone Movie APP and TV Screen Mirroring Assistant APP are as follows:

[0073] Simple Service Discovery Protocol

[0074] M-SEARCH*HTTP / 1.1\r\n

[0075] HOST:239.255.255.250:1900\r\n

[0076] MAN:"ssdp:discover"\r\n

[0077] MX:1\r\n

[0078] ST:urn:dial-multiscreen-org:service:dial:1\r\n

[0079] USER-AGENT:Google Chrome / 114.0.5735.134Windows\r\n

[0080] USER-QUERY: XTV / 1\r\n

[0081] [Full request URI:http: / / 239.255.255.250:1900*]

[0082] [HTTP request 1 / 4]

[0083] [Next request in frame:239].

[0084] S103: The screen projection assistant receives an instruction containing a preset field domain and forwards the instruction containing the preset field domain to the screen projection device.

[0085] The TV Screen Casting Assistant APP in the Screen Casting Assistant recognizes the SSDP search instruction after the field domain is added. If it is determined that the screen casting device has the screen casting and drainage capability, the TV Screen Casting Assistant adds YFactory / 1 to the end of the ServerCap field content in the response header.

[0086] Among them, YFactory represents the TV manufacturer's ID; 1 represents the capabilities supported by the TV end.

[0087] Specifically, the TV Screen Mirroring Assistant APP adds the code of YFactory / 1 at the end of the ServerCap field in the response header as follows:

[0088] Simple Service Discovery Protocol

[0089] HTTP / 1.1200OK\r\n

[0090] Location:http: / / 192.168.0.108:16422\r\n

[0091] Cache-Control:max-age=66\r\n

[0092] Server:UPnP / 1.0,DLNADOC / 1.50Platinum / 1.0.5.13\r\n

[0093] ServerCap:YFactory / 1\r\n

[0094] EXT:\r\n

[0095] OPT:"http: / / schemas.upnp.org / upnp / 1 / 0 / ";ns=01\r\n

[0096] 01-NLS:1688037904\r\n

[0097] USN:uuid:67ebb2bf-787f-4163-b7ff-76f678bf3f73::upnp:rootdevice\r\n

[0098] ST:upnp:rootdevice\r\n

[0099] Date:Thu,29Jun 202311:30:45GMT\r\n

[0100] \r\n

[0101] [HTTP response 1 / 8]

[0102] [Next response in frame:10806].

[0103] S104: The screen projection device sends a reply message with screen projection and traffic diversion capabilities to the screen projection assistant.

[0104] The reply message stores the screen projection type field of the screen projection device's screen projection and diversion capabilities, such as 1, 2, and 3, which represent the capabilities that the Phone Movie APP needs to inquire about. 1 represents video playback screen projection; 2 represents picture playback screen projection; and 3 represents game screen projection.

[0105] S105: The screen projection assistant forwards a reply message to the mobile terminal indicating that the screen projection device has the screen projection and traffic diversion capability.

[0106] S106: When the mobile terminal receives a reply message indicating that the screen projection device has the screen projection and traffic diversion capability, it connects to the screen projection device.

[0107] The specific process of connecting to the screen projection device is as follows:

[0108] First, when the mobile terminal receives a reply message that the screen projection device has the screen projection and drainage capability, if there is a preset field in the reply message, it is determined that the reply message returned by the screen projection assistant has the screen projection and drainage capability; wherein the preset field includes at least a manufacturer identification field and a screen projection and drainage field; the screen projection and drainage field is used to indicate the screen projection and drainage capability of the screen projection device;

[0109] Then, upon receiving a reply message from the screen projection assistant indicating that it has the screen projection and drainage capability, obtain the screen projection device IP, and download the screen projection device application through the screen projection assistant, or activate the screen projection device application;

[0110] Finally, a long connection with the LAN of the projection device is achieved through the mobile application, the projection device application, the projection device IP and the pre-set port number.

[0111] Among them, LAN long connection refers to maintaining a continuous communication session through TCP connection in a LAN environment, allowing multiple data packets to be sent continuously on a single connection. During this connection period, if no data packets are sent, both parties need to send link detection packets to maintain this connection. Simply put, a long connection means that after the connection between the two parties is established, the connection can be maintained for a long time and data can be continuously transmitted without having to re-establish a new connection before sending data each time. This connection method has a high data transmission efficiency in the network because it avoids the overhead of frequently establishing and disconnecting connections. It is suitable for application scenarios that require real-time data interaction, such as online games, real-time communications, etc.

[0112] S107: When the mobile terminal is connected to the projection device, the projection information is transmitted to the projection application of the projection device through the mobile terminal application to achieve interconnection and interaction with the projection device.

[0113] When casting the screen through the Phone Movie APP on the mobile terminal, the SOAP protocol is extended to add source identification and screen casting forwarding transparent transmission fields, where the transparent transmission fields include but are not limited to json format.

[0114] Among them, the transparent transmission field is any parameter agreed upon by the Phone APP and the TV APP, including the page path, video ID, user token, playback address, etc. that need to be cast and pulled up.

[0115] The mobile application and the application for the projection device are preferably developed by the same provider.

[0116] After the long connection channel is established, all playback control operation instructions can be directly accessed from the Phone Movie APP to the TV Movie APP. Since the Phone Movie APP and the TV Movie APP are developed by the same content provider, advertising, member conversion, and more interactive scenarios can be added, such as: barrage interaction, game control, fitness, etc. The TV Movie APP of the screen projection device analyzes the screen projection transparent transmission field and pulls up any desired function page (not limited to the video playback page).

[0117] Phone Movie APP and TV Movie APP establish a long connection on the local area network, and use the long connection channel to complete the interaction between large and small screens. The interaction and linkage between large and small screens will generate more innovative business scenarios and promote the further development of large and small screen businesses.

[0118] In order to facilitate the understanding of the screen projection process, combined with Figure 2 The following is an example of a scenario:

[0119] ① When searching for screen casting devices, the Phone Film and Television APP brings its own identity and the capabilities it is querying for the TV Screen Casting Assistant APP to identify and respond.

[0120] Phone Video APP adds the field "USER-QUERY: XTV / 1,2,3" in the SSDP M-Search instruction header to query the TV Screen Mirroring Assistant APP through this field to see if it has the capabilities specified by Phone Video APP; in XTV / 1,2,3, XTV represents the screen mirroring party identifier, and 1, 2, and 3 all represent the capabilities that Phone Video APP needs to inquire about. Phone Video APP and TV Screen Mirroring Assistant APP predetermine the meaning of the identifier.

[0121] The relevant codes for the pre-defined logo meanings of Phone Movie APP and TV Screen Mirroring Assistant APP are as follows:

[0122]

[0123] ② TV Cast Assistant APP response:

[0124] The TV Screen Casting Assistant APP in the Screen Casting Assistant identifies the SSDP search instruction after the field domain is added. If it is determined that the screen casting device has the screen casting and drainage capability, the TV Screen Casting Assistant adds YFactory / 1 to the end of the ServerCap field content in the response header, where YFactory represents the TV manufacturer's logo; 1 represents the capabilities supported by the TV end.

[0125] Specifically, the TV Screen Mirroring Assistant APP adds the code of YFactory / 1 at the end of the ServerCap field in the response header as follows:

[0126]

[0127] ③Phone video APP sends screen projection information.

[0128] After the SOAP protocol is confirmed in the previous step, there is no need to worry about conflicts in the subsequent protocols. You only need to complete the parameter transfer and reply to the pull-up result. Use the previous protocol.

[0129] Send from mobile terminal:

[0130] Phone Movie APP is extended in the SOAP protocol body to complete the marking of mobile source information and the transparent transmission parameters required after launching the third-party application APP.

[0131] In the SOAP protocol, the current video playback action is set. The unified name is SetAVTransportURI, and the required parameters include:

[0132] InstanceID: Set the current playback instance to 0;

[0133] CurrentURI: playback resource address;

[0134] CurrentURIMetaData: media meta data, empty.

[0135] The above mandatory parameters need to be extended. Add the following fields under the CurrentURIMetaData item node:

[0136] SourceId: to mark the source information of the sender, for example, video X is marked as:

[0137] <sourceid> XTVVideo< / sourceid> ;

[0138] MetaDataExtra: After the TV Screen Casting Assistant APP launches the TV Movie APP, the necessary business parameters are parsed internally by the TV Movie APP. The manufacturer does not need to parse and directly transmit the parameter value.

[0139] The complete example of transparently transmitting the parameter value is as follows:

[0140]

[0141]

[0142] ④TV Cast Assistant APP downloads TV Movie APP.

[0143] After receiving the screen projection information, the TV Screen Casting Assistant APP determines whether the TV system has installed the TV Movie APP. If not, it calls the TV application store to install the TV Movie APP. The TV Screen Casting Assistant APP also uses the system player to play the projected video stream.

[0144] ⑤ Call the TV App Store to install the TV Movie APP. After the installation is complete, reply to the TV Cast Assistant APP.

[0145] ⑥TV Screen Mirroring Assistant APP launches TV Movie APP through deeplink:

[0146] If the system has installed the TV Movie APP, the TV Screen Mirroring Assistant APP will directly launch the TV Movie APP. The launching scheme is as follows:

[0147]

[0148] It should be noted that MetaDataExtra is the SOAP protocol body of Phone Movie APP screen casting. <metadataextra>< / metadataextra> Transparent parameter value.

[0149] ⑦The TV Screen Casting Assistant APP will synchronize the traffic status to the Phone Movie APP.

[0150] After receiving the push information from Phone Movies APP, TV Screen Mirroring Assistant APP parses the push information and obtains the current TV status (downloading TV Movies APP, successfully diverting to TV Movies APP, failed to divert to TV Movies APP, etc.), and TV Screen Mirroring Assistant APP replies to Phone Movies APP with the screen mirroring status according to the current TV status. Add the field STATUS / xx in Response to identify the screen mirroring and diversion status.

[0151] The meanings of xx are as follows:

[0152] 1. Indicates downloading and installing third-party applications (TV film and television APP);

[0153] 2. It means that the TV Screen Mirroring Assistant APP has successfully directed traffic to the TV Movie APP;

[0154] 3. Screen projection is successful, and the system player is playing the projection content;

[0155] 4. It means that the TV Screen Casting Assistant APP failed to redirect traffic to the TV Movie APP.

[0156] The specific code is as follows:

[0157] HTTP / 1.1200OK\r\n

[0158] Ext:\r\n

[0159] Date:Tue,13Jun 202310:54:19GMT\r\n

[0160] Content-Language:en\r\n

[0161] Content-Length:277\r\n

[0162] Content-Type: text / xml; charset="utf-8"\r\n

[0163] Server:UPnP / 1.0,DLNADOC / 1.50Platinum / 1.0.5.13\r\n

[0164] STATUS:2\r\n

[0165] <? xml version="1.0" encoding="UTF-8"? >

[0166] <s:Envelope s:encodingStyle="http: / / schemas.xmlsoap.org / soap / encoding / "xmlns:s="http: / / schemas.xmlsoap.org / soap / envelope / ">

[0167] <s:body>

[0168] <u:SetAVTransportURIResponsexmlns:u="urn:schemas-upnp-org:service:AVTransport:1" / >

[0169] < / s:body>

[0170] .

[0171] ⑧Phone Film and Television APP establishes a long LAN connection with TV Film and Television APP through websocket.

[0172] After the LAN long connection channel is established, all playback control operation instructions can be directly reached from the Phone Movie APP to the TV Movie APP. Since the Phone Movie APP and the TV Movie APP are developed by the same content provider, they can achieve advertising, member conversion, and add more interactive scenarios, such as: barrage interaction, game control, fitness, etc.

[0173] This application agrees on the protocol specifications with the TV manufacturer's screen casting assistant APP; the Phone-side APP implements the screen casting discovery (search), identification, sending, and long connection capabilities according to the protocol; the screen casting assistant APP implements the response reply of the screen casting search, the identification of the screen casting content, the download / installation / pull-up of the TV-side APP, the playback of the cast video, etc. according to the protocol; the TV-side APP responds to the pull-up command of the TV screen casting assistant APP, parses the transparent transmission parameters, and completes the display of the cast content and the operation of the functions. The Phone film and television APP and the TV-side APP establish a long connection in the local area network according to the agreed protocol to realize the interconnection and interaction of large and small screens.

[0174] This application increases the number of new and active users of the TV APP; increases advertising and membership revenue; and derives more innovative business scenarios through the linkage between large and small screens, promoting the further development of large and small screen businesses.

[0175] The beneficial effects of the embodiments of the present application: through the preset service discovery protocol in the screen projection assistant, the screen projection assistant is used as a diversion intermediary, so that when the mobile terminal and the screen projection device are in a state of long-term connection in the local area network, the mobile terminal and the screen projection device are interconnected and interactive through the diversion intermediary, the mobile terminal application and the screen projection device application, and the mobile terminal application and the screen projection device application are developed by the same provider, so it is possible to achieve advertising, member conversion, adding more interactive scenes, etc., rather than just limited to video and picture playback screen projection, so that the mobile terminal and the screen projection device will not be subject to interaction restrictions during the process of interconnection and interaction, thereby reducing the limitations of the screen projection content. In addition, this solution does not require additional hardware equipment, thereby improving economic efficiency.

[0176] refer to Figure 3 As shown, a screen projection processing method disclosed in an embodiment of the present application is applied to the above-mentioned embodiment. Figure 1 The screen projection processing method mainly includes the following steps:

[0177] S301: The mobile terminal searches for the screen projection device through the preset service discovery protocol in the screen projection assistant.

[0178] In S301, a field domain is added to the search instruction corresponding to the Simple Service Discovery Protocol (SSDP) in the screen projection assistant, and the screen projection device is searched through the SSDP protocol after the field domain is added.

[0179] The field domain includes at least a projection party identification field and a projection type field. The projection type field includes 1, 2, and 3. 1 represents video playback projection; 2 represents picture playback projection; and 3 represents game projection.

[0180] S302: If the mobile terminal receives a response message returned by the screen projection assistant, it determines that the screen projection device has been searched.

[0181] S303: The mobile terminal sends an instruction containing a preset field domain to the screen projection assistant; wherein the instruction in the preset field domain is used to determine whether the screen projection device has the screen projection and traffic diversion capability.

[0182] S304: If the mobile terminal receives a reply message from the screen projection assistant indicating that the screen projection device has the screen projection and traffic diversion capability, it connects to the screen projection device.

[0183] In S304, the reply message returned by the screen projection assistant is parsed. If there is a preset field in the reply message, it is determined that a reply message with screen projection and drainage capabilities is received from the screen projection assistant. Under the condition that a reply message with screen projection and drainage capabilities is received from the screen projection assistant, the IP of the screen projection device is obtained, and the screen projection device application is downloaded through the screen projection assistant, or the screen projection device application is activated. Through the mobile application, the screen projection device application, the screen projection device IP and the pre-set port number, a long connection with the screen projection device in the LAN is realized.

[0184] Among them, the preset fields include at least a manufacturer identification field and a screen projection and diversion field.

[0185] The Screen Casting Traffic Drainage field is used to indicate the screen casting traffic drainage capabilities of the screen casting device (including video playback traffic drainage, picture playback traffic drainage, game traffic drainage, etc.

[0186] S305: When the mobile terminal is connected to the projection device, the projection information is transmitted to the projection application of the projection device through the mobile terminal application to achieve interconnection and interaction with the projection device.

[0187] When the mobile terminal and the projection device are in a long-term connection in the local area network, the source information of the projection information is marked according to the preset service discovery protocol to obtain the projection information. The mobile terminal transmits the projection information to the projection application of the projection device through the projection assistant and the mobile terminal application to achieve interconnection and interaction with the projection device.

[0188] The source information tag at least includes setting the current playback instance, the playback resource address tag and the content data (CurrentURIMetaData) of the media item.

[0189] The mobile terminal receives the diversion status of the screen projection device returned by the screen projection assistant (downloading the film and television APP, successfully diverting to the TV film and television APP, failing to divert to the TV film and television APP, etc.) and synchronizes it.

[0190] The execution process and execution principle of S301-S305 are consistent with the execution process and execution principle of the above-mentioned S101-S107 and ① to ⑧, which can be used as a reference and will not be repeated here.

[0191] The beneficial effects of the embodiments of the present application: through the preset service discovery protocol in the screen projection assistant, the screen projection assistant is used as a traffic diversion intermediary, so that when the mobile terminal and the screen projection device are in a state of long connection in the local area network, the mobile terminal and the screen projection device are interconnected and interactive through the traffic diversion intermediary, the mobile terminal application and the screen projection device application, and the mobile terminal application and the screen projection device application are both developed by the same provider, so it is possible to achieve advertising, member conversion, adding more interactive scenarios, etc., rather than just being limited to the projection of video and picture playback, so that the mobile terminal and the screen projection device will not be subject to interaction restrictions during the interconnection and interaction process, thereby reducing the limitations of the projection content.

[0192] refer to Figure 4 As shown, another screen projection processing method disclosed in the embodiment of the present application is applied to the above embodiment. Figure 1 The screen projection device in the screen projection assistant is a screen projection device with screen projection and traffic diversion capabilities searched through a preset service discovery protocol in the screen projection assistant. The screen projection processing method includes the following steps:

[0193] S401: The screen projection device sends a reply message with screen projection and traffic diversion capabilities to the mobile terminal through the screen projection assistant, triggering a connection with the mobile terminal.

[0194] S402: The screen projection device obtains screen projection information sent by the mobile terminal while being connected to the mobile terminal.

[0195] S403: The screen projection device realizes interconnection and interaction with the mobile terminal according to the screen projection information.

[0196] The execution process and execution principle of S401-S403 are consistent with the execution process and execution principle of S101-S107 and (1) to (8) mentioned above, which can be used as a reference and will not be repeated here.

[0197] The beneficial effects of the embodiments of the present application: through the preset service discovery protocol in the screen projection assistant, the screen projection assistant is used as a traffic diversion intermediary, so that when the mobile terminal and the screen projection device are in a state of long connection in the local area network, the mobile terminal and the screen projection device are interconnected and interactive through the traffic diversion intermediary, the mobile terminal application and the screen projection device application, and the mobile terminal application and the screen projection device application are both developed by the same provider, so it is possible to achieve advertising, member conversion, adding more interactive scenarios, etc., rather than just being limited to the projection of video and picture playback, so that the mobile terminal and the screen projection device will not be subject to interaction restrictions during the interconnection and interaction process, thereby reducing the limitations of the projection content.

[0198] Based on the above embodiments Figure 3 A screen projection processing method is disclosed, and the embodiment of the present application also discloses a screen projection processing device, such as Figure 5 As shown, the screen projection processing device is applied to a mobile terminal, and the screen projection processing device includes:

[0199] A search unit 501 is used to search for a screen projection device through a preset service discovery protocol in the screen projection assistant;

[0200] A determination unit 502 is used to determine that a screen projection device has been searched if a response message returned by the screen projection assistant is received;

[0201] The sending unit 503 is used to send an instruction containing a preset field field to the screen projection assistant; wherein the instruction in the preset field field is used to determine whether the screen projection device has the screen projection and drainage capability;

[0202] A connecting unit 504 is configured to connect to the screen projection device if a reply message is received from the screen projection assistant indicating that the screen projection device has the screen projection and drainage capability;

[0203] The reaching unit 505 is used to reach the projection information to the projection application of the projection device through the mobile application when the projection device is connected to the projection device, so as to realize the interconnection and interaction with the projection device.

[0204] Further, the search unit 501 includes:

[0205] Add a module for adding a field domain to the search instruction corresponding to the simple service discovery protocol in the screen projection assistant; wherein the field domain includes at least a screen projection party identification field and a screen projection type field;

[0206] The search module is used to search for projection devices through the simple service discovery protocol after adding the field domain.

[0207] Furthermore, the connection unit 504 includes:

[0208] A determination module is used to parse the reply message returned by the screen projection assistant, and if there is a preset field in the reply message, determine that the reply message returned by the screen projection assistant has the screen projection and drainage capability; wherein the preset field includes at least a manufacturer identification field and a screen projection and drainage field; the screen projection and drainage field is used to indicate the screen projection and drainage capability of the screen projection device;

[0209] The download acquisition module is used to obtain the IP address of the screen projection device and download the screen projection device application through the screen projection assistant when receiving a reply message from the screen projection assistant indicating that the screen projection device has the screen projection and drainage capability;

[0210] Implementation module, used to realize long connection with LAN of projection device through mobile application, projection device application, projection device IP and pre-set port number.

[0211] Furthermore, the reaching unit 505 includes:

[0212] A marking module is used to mark the source information of the screen to be projected according to a preset service discovery protocol when the screen projection device is in a state of long connection with the local area network, so as to obtain the screen projection information; wherein the source information mark at least includes setting the current playback instance, the playback resource address mark and the content data of the media item;

[0213] The reach module is used to deliver the projection information to the projection application of the projection device through the projection assistant and mobile application, so as to achieve interconnection and interaction with the projection device.

[0214] A further screen projection processing device further includes:

[0215] The receiving synchronization unit is used to receive and synchronize the drainage status of the screen projection device returned by the screen projection assistant.

[0216] The beneficial effects of the embodiments of the present application: through the preset service discovery protocol in the screen projection assistant, the screen projection assistant is used as a traffic diversion intermediary, so that when the mobile terminal and the screen projection device are in a state of long connection in the local area network, the mobile terminal and the screen projection device are interconnected and interactive through the traffic diversion intermediary, the mobile terminal application and the screen projection device application, and the mobile terminal application and the screen projection device application are both developed by the same provider, so it is possible to achieve advertising, member conversion, adding more interactive scenarios, etc., rather than just being limited to the projection of video and picture playback, so that the mobile terminal and the screen projection device will not be subject to interaction restrictions during the interconnection and interaction process, thereby reducing the limitations of the projection content.

[0217] Based on the above embodiments Figure 4 Another screen projection processing method disclosed, the embodiment of the present application also discloses another screen projection processing device, such as Figure 6 As shown, the screen projection processing device is applied to a screen projection device, and the screen projection processing device includes:

[0218] The sending trigger unit 601 is used to send a reply message with screen projection and traffic diversion capability to the mobile terminal through the screen projection assistant to trigger a connection with the mobile terminal;

[0219] The acquisition unit 602 is used to acquire the screen projection information sent by the mobile terminal while being connected to the mobile terminal;

[0220] The interconnection and interaction unit 603 is used to realize interconnection and interaction with the mobile terminal according to the screen projection information; wherein, the screen projection device is a screen projection device with screen projection and drainage capabilities searched through the preset service discovery protocol in the screen projection assistant.

[0221] Furthermore, the screen projection processing device also includes:

[0222] The synchronization unit is used to synchronize the traffic status to the mobile terminal through the screen projection assistant.

[0223] The beneficial effects of the embodiments of the present application: through the preset service discovery protocol in the screen projection assistant, the screen projection assistant is used as a traffic diversion intermediary, so that when the mobile terminal and the screen projection device are in a state of long connection in the local area network, the mobile terminal and the screen projection device are interconnected and interactive through the traffic diversion intermediary, the mobile terminal application and the screen projection device application, and the mobile terminal application and the screen projection device application are both developed by the same provider, so it is possible to achieve advertising, member conversion, adding more interactive scenarios, etc., rather than just being limited to the projection of video and picture playback, so that the mobile terminal and the screen projection device will not be subject to interaction restrictions during the interconnection and interaction process, thereby reducing the limitations of the projection content.

[0224] An embodiment of the present application also provides a storage medium, which includes stored instructions, wherein when the instructions are executed, the device where the storage medium is located is controlled to execute the screen projection processing method as described above.

[0225] The present application also provides an electronic device, whose structural diagram is as follows: Figure 7 As shown, it specifically includes a memory 701 and one or more instructions 702, wherein the one or more instructions 702 are stored in the memory 701 and are configured to be executed by one or more processors 703 to execute the one or more instructions 702 to perform the above-mentioned screen projection processing method.

[0226] For the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0227] It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For system embodiments, since they are basically similar to method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0228] The steps in the methods of the embodiments of the present application can be adjusted in order, combined, and deleted according to actual needs.

[0229] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are merely used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations.

[0230] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

[0231] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A screen projection processing method, characterized in that: The method is applied to a mobile terminal, and the method includes: Search for projection devices through the preset service discovery protocol in the projection assistant; If a response message is received from the screen projection assistant, it is confirmed that the screen projection device has been searched; Sending a command containing a preset field field to the screen projection assistant; wherein the command in the preset field field is used to determine whether the screen projection device has the screen projection and drainage capability; If a reply message is received from the screen projection assistant indicating that the screen projection device has the screen projection and drainage capability, the screen projection device is connected; When the screen projection device is connected, the screen projection information is transmitted to the screen projection application of the screen projection device through the mobile application to achieve interconnection and interaction with the screen projection device.

2. The method according to claim 1, characterized in that: The search for the screen projection device through the preset service discovery protocol in the screen projection assistant includes: Add a field domain to the search instruction corresponding to the simple service discovery protocol in the screen projection assistant; wherein the field domain includes at least a screen projection party identification field and a screen projection type field; Search for screen projection devices through the simple service discovery protocol after adding the field domain.

3. The method according to claim 1, characterized in that If a reply message is received from the screen projection assistant indicating that the screen projection device has the screen projection and drainage capability, connecting with the screen projection device includes: Parse the reply message returned by the screen projection assistant, and if there is a preset field in the reply message, determine that a reply message returned by the screen projection assistant with screen projection and traffic diversion capability is received; wherein the preset field includes at least a manufacturer identification field and a screen projection and traffic diversion field; the screen projection and traffic diversion field is used to indicate the screen projection and traffic diversion capability possessed by the screen projection device; Upon receiving a reply message from the screen projection assistant indicating that the screen projection assistant has the screen projection and traffic diversion capability, obtaining the screen projection device IP address and downloading the screen projection device application through the screen projection assistant; A long connection with the local area network of the projection device is achieved through the mobile application, the projection device application, the projection device IP and a pre-set port number.

4. The method according to claim 1, characterized in that: In the state of being connected with the projection device, the projection information is transmitted to the projection application of the projection device through the mobile terminal application to realize the interconnection and interaction with the projection device, including: In a state where the screen projection device is in a long connection with the local area network, source information is marked on the screen projection information according to a preset service discovery protocol to obtain the screen projection information; wherein the source information mark at least includes setting the current playback instance, the playback resource address mark and the content data of the media item; Through the screen projection assistant and mobile application, the projection information is delivered to the projection application of the projection device to achieve interconnection and interaction with the projection device.

5. The method according to claim 1, characterized in that Also includes: Receive the drainage status of the screen projection device returned by the screen projection assistant and synchronize it.

6. A screen projection processing method, characterized in that: The method is applied to a screen projection device, and the method includes: Send a reply message with screen projection and traffic diversion capabilities to the mobile terminal through the screen projection assistant to trigger a connection with the mobile terminal; While being connected to the mobile terminal, obtaining the screen projection information sent by the mobile terminal; Realize interconnection and interaction with the mobile terminal according to the projection information; Among them, the screen projection device is a screen projection device with screen projection and traffic diversion capabilities that is searched through a preset service discovery protocol in the screen projection assistant.

7. The method according to claim 6, characterized in that Also includes: The diversion status is synchronized to the mobile terminal through the screen projection assistant.

8. A screen projection processing device, characterized in that: The device is applied to a mobile terminal, and the device includes: A search unit, used to search for a screen projection device through a preset service discovery protocol in the screen projection assistant; A determination unit, configured to determine that a screen projection device has been searched if a response message returned by the screen projection assistant is received; A sending unit, used to send an instruction containing a preset field field to the screen projection assistant; wherein the instruction in the preset field field is used to determine whether the screen projection device has the screen projection and drainage capability; A connecting unit, configured to connect to the screen projection device upon receiving a reply message from the screen projection assistant indicating that the screen projection device has the screen projection and drainage capability; The reaching unit is used to reach the projection information to the projection application of the projection device through the mobile application when the projection device is connected to the projection device, so as to realize the interconnection and interaction with the projection device.

9. The device according to claim 8, characterized in that The search unit comprises: An adding module is used to add a field domain to the search instruction corresponding to the simple service discovery protocol in the screen projection assistant; wherein the field domain includes at least a screen projection party identification field and a screen projection type field; The search module is used to search for projection devices through the simple service discovery protocol after adding the field domain.

10. A screen projection processing device, characterized in that: The device is applied to a screen projection device, and the device includes: A sending trigger unit, used to send a reply message with screen projection and traffic diversion capability to the mobile terminal through the screen projection assistant, triggering a connection with the mobile terminal; An acquisition unit is used to acquire the projection information sent by the mobile terminal when the mobile terminal is connected. An interconnection and interaction unit is used to achieve interconnection and interaction with the mobile terminal according to the screen projection information; wherein, the screen projection device is a screen projection device with screen projection and drainage capabilities searched through a preset service discovery protocol in the screen projection assistant.

Images