Screen projection control method and device and readable storage medium

Abstract

The application discloses two screen projection control methods, devices and readable storage media in the technical field of computer application. In the embodiments of the application, the two screen projection control methods can realize at least one of the switching functions of subtitle switching and audio track switching in the process of screen projection playing based on a description file including switching service and a switching control flow, and can meet the differentiated needs of users.

Description

Technical Field

[0001] This application relates to the field of computer application technology, and in particular to screen projection control methods, devices and readable storage media. Background Technology

[0002] Screen mirroring refers to projecting files, videos, or audio from one device onto another for display. For example, projecting a movie from your phone onto a TV.

[0003] In DLNA (Digital Living Network Alliance) screen mirroring technology, the initiating device can only search for devices, send video links, and control basic commands such as video playback, pause, and volume adjustment. The receiving device can only play the video in default mode, which fails to meet the diverse needs of users.

[0004] In conclusion, how to effectively solve the problem of limited screen projection control functions is a technical problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0005] The purpose of this application is to provide a screen projection control method, device, and readable storage medium that can enable subtitle and audio track switching, add screen projection functionality, and meet the diverse needs of users.

[0006] To solve the above-mentioned technical problems, this application provides the following technical solution:

[0007] A screen mirroring control method, comprising:

[0008] In response to a screen mirroring device search that initiates a screen mirroring device broadcast, feedback includes a description file for switching services;

[0009] Play the video based on the video file link sent by the initiating screen mirroring device, and obtain the audio track and / or subtitle information of the video file;

[0010] After receiving the audio track and / or subtitle acquisition instruction sent by the screen projection initiating device according to the description file, the corresponding audio track and / or subtitle information is sent to the screen projection initiating device;

[0011] Receive audio track and / or subtitle switching instructions sent by the screen projection device;

[0012] Follow the audio track and / or subtitle switching instructions to complete the audio track and / or subtitle switching.

[0013] Preferably, in response to a screen mirroring device search that initiates a screen mirroring device broadcast, the feedback includes a description file for switching services, including:

[0014] In response to the screen projection device search, a device description file and a service description file are returned;

[0015] The device description file contains a switching service description, and the service description file includes a switching description file.

[0016] Preferably, the audio track and / or subtitle switching is completed according to the audio track and / or subtitle switching instructions, including:

[0017] From the switching description file, find the status variable corresponding to the audio track and / or subtitle switching instruction, and store the input parameters corresponding to the audio track and / or subtitle switching instruction into the status variable to complete the audio track and / or subtitle switching.

[0018] Preferably, it includes:

[0019] Receive the basic instructions sent by the device that initiated the screen mirroring;

[0020] Respond to the basic instructions according to the description file.

[0021] A screen mirroring control method, comprising:

[0022] Search for broadcast projection devices and obtain description files including the switching service from the receiving projection devices;

[0023] Send a video file link to the receiving projection device;

[0024] After confirming that the receiving screen projection device has played successfully, the audio track and / or subtitle information is obtained from the receiving screen projection device;

[0025] Output the audio track and / or subtitle information in the UI interface;

[0026] In response to the audio track and / or subtitle switching operation of the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving projection device according to the description file, so that the receiving projection device can complete the audio track and / or subtitle switching.

[0027] Preferably, in response to the audio track and / or subtitle switching operation of the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving projection device according to the description file, including:

[0028] In response to the audio track and / or subtitle switching operation, the audio track and / or subtitle switching instruction is determined according to the instruction description in the description file;

[0029] Send the audio track and / or subtitle switching command to the receiving projection device.

[0030] Preferably, obtaining audio track and / or subtitle information from the receiving projection device includes:

[0031] According to the instructions described in the description file, send an audio track and / or subtitle acquisition instruction to the receiving screen projection device;

[0032] Receive the audio track and / or subtitle information fed back by the receiving screen projection device.

[0033] A screen projection receiving device, comprising:

[0034] Memory, used to store computer programs;

[0035] A processor is used to implement the steps of the screen projection control method described above when executing the computer program.

[0036] A screen mirroring device includes:

[0037] Memory, used to store computer programs;

[0038] A processor is used to implement the steps of the screen projection control method described above when executing the computer program.

[0039] A readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the above-described screen projection control method.

[0040] Applying the method provided in the embodiments of this application, in response to a screen-sharing device search broadcast by the initiating screen-sharing device, a description file including a switching service is returned; the video is played based on the video file link sent by the initiating screen-sharing device, and the audio track and / or subtitle information of the video file is obtained; after receiving the audio track and / or subtitle acquisition instruction sent by the initiating screen-sharing device according to the description file, the corresponding audio track and / or subtitle information is sent to the initiating screen-sharing device; the audio track and / or subtitle switching instruction sent by the initiating screen-sharing device is received; and the audio track and / or subtitle switching is completed according to the audio track and / or subtitle switching instruction.

[0041] In this application, when the initiating screen-sharing device broadcasts a screen-sharing device search, a description file including a switching service is sent back to the initiating screen-sharing device. Then, the video is played based on the video file link sent by the initiating screen-sharing device, and the audio track and / or subtitle information of the video file can be obtained. Since the initiating screen-sharing device obtained the description file including the switching service during the search phase, it can send an audio track and / or subtitle retrieval command according to the description file. After sending the audio track and / or subtitle information to the initiating screen-sharing device, it can send an audio track and / or subtitle switching command according to the description file. Finally, the audio track and / or subtitle switching can be completed according to the audio track and / or subtitle switching command. In other words, in this application, based on the description file including the switching service and the switching control flow, at least one switching function of subtitle switching and audio track switching can be implemented during screen-sharing playback, which can meet the differentiated needs of users.

[0042] Using the method provided in the embodiments of this application, a broadcast screen-sharing device search is performed, and a description file including a switching service is obtained from the receiving screen-sharing device; a video file link is sent to the receiving screen-sharing device; after confirming that the receiving screen-sharing device has played the video successfully, audio track and / or subtitle information is obtained from the receiving screen-sharing device; audio track and / or subtitle information is output on the UI interface; in response to the audio track and / or subtitle switching operation on the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving screen-sharing device according to the description file, so that the receiving screen-sharing device can complete the audio track and / or subtitle switching.

[0043] When screen mirroring is required, a screen mirroring device search is first broadcast, and then a description file including a switching service is obtained from the receiving screen mirroring device. Next, a video file link is sent to the receiving screen mirroring device so that it can play the video based on that link. After confirming successful playback on the receiving screen mirroring device, audio track and / or subtitle information is obtained from it. This audio track and / or subtitle information is then output to the UI interface. When the user needs to switch audio tracks or subtitles, they can perform the switching operation on the UI interface. Correspondingly, in response to the audio track and / or subtitle switching operation on the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving screen mirroring device according to the description file, enabling the receiving screen mirroring device to complete the audio track and / or subtitle switching. In other words, this application, based on a description file including a switching service and a switching control flow, can implement at least one switching function—subtitle switching or audio track switching—during screen mirroring playback, thus meeting the diverse needs of users.

[0044] Accordingly, embodiments of this application also provide a device and a readable storage medium corresponding to the above-described screen projection control method, which have the above-described technical effects, and will not be repeated here. Attached Figure Description

[0045] To more clearly illustrate the technical solutions in the embodiments or related technologies of this application, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0046] Figure 1 This is a flowchart illustrating the implementation of a screen projection control method in this application.

[0047] Figure 2 This is a flowchart illustrating another screen projection control method in this application.

[0048] Figure 3 This is a schematic diagram of a screen projection process in an embodiment of this application. Detailed Implementation

[0049] To enable those skilled in the art to better understand the present application, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. Obviously, the described embodiments are merely some embodiments of the present application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0050] Please refer to Figure 1 , Figure 1 This is a flowchart of a screen projection control method according to an embodiment of this application. The method can be applied to a screen projection receiving device (such as a television device), and includes the following steps:

[0051] S101, In response to the screen casting device search that initiated the screen casting device broadcast, the feedback includes a description file for switching services.

[0052] When a user needs to cast their screen, they can control the device initiating the casting (such as a smartphone) to search for the device via local area network multicast or broadcast.

[0053] When the receiving device receives a broadcast from the device that initiated the screen mirroring search, it can respond to the search by providing a description file that includes the service switching information.

[0054] After the receiving device sends a description file to the initiating device, the initiating device can send a link to the video file it wants to cast to the receiving device.

[0055] In one specific embodiment of this application, in response to a screen casting device search that initiates a screen casting device broadcast, a description file including a switching service is fed back, including: in response to a screen casting device search, a device description file and a service description file are fed back; wherein, the device description file contains a switching service description, and the service description file includes the switching description file.

[0056] In the standard DLNA (DIGITAL LIVING NETWORK ALLIANCE) screen mirroring technology, the initiating and receiving screen mirroring devices support three services: ConnectionManager, AVTransport, and RenderingControl. These services respectively implement functions for connection management, audio and video transmission, and rendering control, and support basic commands such as sending playback links, playing, pausing, adjusting volume, and setting playback progress.

[0057] According to the DLNA screen mirroring technical specifications, the receiving device generates a device description XML file, recording the types of services it supports, and also generates the three service description XML files mentioned above, recording the commands and parameter types supported by each service. When the initiating screen mirroring device searches for receiving devices, it parses the receiving device's XML files to determine the services and commands supported by the receiving device. Detailed format and content of the XML files can be found in device.xml and service.xml.

[0058] In this embodiment of the application, a new custom service is added on the basis of the original DLNA screen casting technology, namely a switching service, for example named ThunderControl service. In the ThunderControl service, instructions for obtaining audio track information, obtaining subtitle information, switching audio track, and switching subtitle are implemented.

[0059] Specifically, the receiving screen-casting device implements the ThunderControl service and command functions. Then, the device description XML file is modified to add description information of the ThunderControl service (i.e., add ThunderControl service information to device.xml). Finally, an XML file for the ThunderControl service is generated, recording the commands and parameter types that the service supports for obtaining audio track information, obtaining subtitle information, switching audio tracks, and switching subtitles. For details, please refer to service.xml described below.

[0060] Specifically, the XML file mainly records basic device information, such as name, manufacturer, unique identifier (UDN), version number, and supported service types. When the device initiating screen mirroring searches, it parses this file to obtain the basic information of the receiving device and a list of supported services.

[0061] In this embodiment, the XML file may include the following: receiving basic information about the screen-casting device, receiving a list of services supported by the screen-casting device, mainly recording the service name, ID, and URL path of the service details description file (service.xml). The services supported by the screen-casting device include:

[0062] The standard DLNA screen mirroring technology defines a service responsible for connection management;

[0063] The standard DLNA screen mirroring technology defines a service responsible for audio and video transmission;

[0064] The standard DLNA projection technology defines a service responsible for rendering control;

[0065] The switching service is used to switch between audio tracks and subtitles.

[0066] The description of the service switch includes:

[0067] Service type definition;

[0068] A unique identifier for the service;

[0069] The URL of this service is described in detail. The device initiating the screen mirroring can read the contents of the service.xml file through this path;

[0070] The URL used for control; the device initiating the screen mirroring sends instructions to this path to control the receiving device.

[0071] The URL for subscribing to events allows the device initiating the screen mirroring to subscribe to and receive events emitted by the screen mirroring device.

[0072] The XML file corresponding to the service switching is a detailed description file of the service switching process, mainly recording the command information supported by the service. When the device initiating screen mirroring searches, it parses this file to obtain the commands and parameters supported by Xunlei's custom service, and can then send corresponding commands for control.

[0073] The XML file (service.xml) corresponding to this service switch includes:

[0074]

[0075]

[0076] Thus, when the initiating device searches for the receiving device, after parsing the receiving device's XML file, it will find that the receiving device has the ThunderControl service and supports commands to obtain audio track information, obtain subtitle information, switch audio tracks, and switch subtitles. After successful screen mirroring, it can send the corresponding commands to the receiving end to realize the function of switching audio tracks or subtitles.

[0077] S102. Play the video based on the video file link sent by the initiating screen mirroring device, and obtain the audio track and / or subtitle information of the video file.

[0078] When the receiving device receives a video file link sent by the initiating device, it can play the video based on the link and obtain at least one of the following information: audio track information and subtitle information. That is, the receiving device can obtain only the audio track information, only the subtitle information, or both.

[0079] After the device initiating the screen mirroring sends a video file link to the receiving device, the device initiating the screen mirroring can query the receiving device to see if the playback was successful.

[0080] After receiving a query from the initiating screen-sharing device regarding whether playback was successful, the receiving screen-sharing device can return a status indicating that playback is in progress.

[0081] After confirming that the receiving device has successfully played the video, the device that initiated the screen mirroring can send an audio track and / or subtitle retrieval command to the receiving device based on the description file.

[0082] S103. After receiving the audio track and / or subtitle acquisition instruction sent by the screen projection device according to the description file, send the corresponding audio track and / or subtitle information to the screen projection device.

[0083] Once the receiving screen mirroring device receives the audio track and / or subtitle acquisition instruction sent by the initiating screen mirroring device, it can send the corresponding audio track and / or subtitle information to the initiating screen mirroring device.

[0084] Specifically, when the receiving screen mirroring device receives an audio track acquisition instruction, it can send the audio track information to the initiating screen mirroring device; when the receiving screen mirroring device receives a subtitle acquisition instruction, it can send the corresponding subtitle information to the initiating screen mirroring device; when the receiving screen mirroring device receives the audio track and subtitle acquisition instructions sent by the initiating screen mirroring device, it can send the corresponding audio track and subtitle information to the initiating screen mirroring device.

[0085] Once the initiating screen mirroring device receives the audio track and / or subtitle information, it can send audio track and / or subtitle switching commands to the receiving screen mirroring device based on user input. These audio track and / or subtitle switching commands are also sent based on a description file.

[0086] S104. Receive audio track and / or subtitle switching instructions sent by the device initiating the screen mirroring.

[0087] Understandably, when the information fed back to the initiating screen-sharing device is audio track information, the switching command corresponds to the audio track switching command; when the information fed back to the initiating screen-sharing device is subtitle information, the switching command corresponds to the subtitle switching command; and when the information fed back to the initiating screen-sharing device is both audio track and subtitle information, the switching command corresponds to both audio track and subtitle switching commands.

[0088] S105. Follow the audio track and / or subtitle switching instructions to complete the audio track and / or subtitle switching.

[0089] After receiving a switching instruction for at least one of the audio track and subtitles, the corresponding audio track and subtitle can be switched according to the switching instruction.

[0090] Specifically, according to the audio track and / or subtitle switching instructions, the audio track and / or subtitle switching is completed, including: finding the status variable corresponding to the audio track and / or subtitle switching instructions from the switching description file, and storing the input parameters corresponding to the audio track and / or subtitle switching instructions into the status variable to complete the audio track and / or subtitle switching.

[0091] In other words, after receiving a switching instruction, the system finds the corresponding status variable from the switching description file, and then stores the input parameters corresponding to the switching instruction into the corresponding status variable, thereby completing the audio track or subtitle switching.

[0092] During screen mirroring, the receiving device can not only switch audio tracks and subtitles, but also perform other basic functions. The specific implementation process includes:

[0093] Step 1: Receive the basic instructions sent by the device initiating the screen mirroring;

[0094] Step 2: Respond to basic instructions according to the description file.

[0095] For ease of description, the two steps above will be explained together below.

[0096] When routine control is required, the initiating device can send basic commands to the receiving device based on the description of basic commands in the configuration file. The basic commands referred to in this article are those supporting functions related to link management, audio / video transmission, and rendering control, such as sending playback links, playing, pausing, adjusting volume, and setting playback progress.

[0097] Applying the method provided in the embodiments of this application, in response to a screen-sharing device search broadcast by the initiating screen-sharing device, a description file including a switching service is returned; the video is played based on the video file link sent by the initiating screen-sharing device, and the audio track and / or subtitle information of the video file is obtained; after receiving the audio track and / or subtitle acquisition instruction sent by the initiating screen-sharing device according to the description file, the corresponding audio track and / or subtitle information is sent to the initiating screen-sharing device; the audio track and / or subtitle switching instruction sent by the initiating screen-sharing device is received; and the audio track and / or subtitle switching is completed according to the audio track and / or subtitle switching instruction.

[0098] In this application, when the initiating screen-sharing device broadcasts a screen-sharing device search, a description file including a switching service is sent back to the initiating screen-sharing device. Then, the video is played based on the video file link sent by the initiating screen-sharing device, and the audio track and / or subtitle information of the video file can be obtained. Since the initiating screen-sharing device obtained the description file including the switching service during the search phase, it can send an audio track and / or subtitle retrieval command according to the description file. After sending the audio track and / or subtitle information to the initiating screen-sharing device, it can send an audio track and / or subtitle switching command according to the description file. Finally, the audio track and / or subtitle switching can be completed according to the audio track and / or subtitle switching command. In other words, in this application, based on the description file including the switching service and the switching control flow, at least one switching function of subtitle switching and audio track switching can be implemented during screen-sharing playback, which can meet the differentiated needs of users.

[0099] Please refer to Figure 2 , Figure 2 This is a flowchart of another screen mirroring control method in this application embodiment. This method can be applied to a screen mirroring initiating device (such as a smartphone), and includes the following steps:

[0100] S201. Search for broadcast projection devices and obtain a description file including the switching service from the receiving projection device.

[0101] When a device needs to cast its screen, it can broadcast a search for casting devices.

[0102] The receiving device can respond to the search for screen-sharing devices broadcast by the initiating device by sending back a description file including the service switching information to the initiating device.

[0103] That is, after the receiving screen projection device searches, the broadcast screen projection device can obtain the description file from the receiving screen projection device.

[0104] This description file includes information such as the service descriptions supported by the receiving screen projection device and related instruction descriptions.

[0105] S202. Send a video file link to the receiving screen mirroring device.

[0106] After the device initiating the screen mirroring receives the description file, it can send the link to the video file to be mirrored to the receiving device.

[0107] Once the receiving device receives the video file link, it can play the video based on the link and parse the video file to obtain either the audio track information or the subtitle information.

[0108] After the initiating screen mirroring device sends a video file link to the receiving screen mirroring device, it can send a playback query to the receiving screen mirroring device to obtain the playback status feedback from the receiving screen mirroring device.

[0109] S203. After confirming that the receiving screen projection device has played successfully, obtain the audio track and / or subtitle information from the receiving screen projection device.

[0110] After the initiating screen mirroring device confirms that the playback has been successfully received, at least one of the following information can be obtained from the receiving screen mirroring device: audio track information or subtitle information.

[0111] Specifically, audio track and / or subtitle information is obtained from the receiving projection device, including:

[0112] Step 1: According to the instructions described in the description file, send the audio track and / or subtitle acquisition instructions to the receiving screen projection device;

[0113] Step 2: Receive the audio track and / or subtitle information fed back by the screen projection device.

[0114] For ease of description, the two steps above will be explained together below.

[0115] The description file contains information about the services supported by the receiving screen mirroring device and the corresponding instruction descriptions. Therefore, the screen mirroring initiating device can send at least one of the audio track acquisition instructions and subtitle acquisition instructions to the receiving screen mirroring device according to the instruction descriptions in the description file.

[0116] After receiving the acquisition command, the receiving screen-sharing device can send corresponding information back to the initiating screen-sharing device. In this way, the initiating screen-sharing device can obtain the desired information, such as at least one of the following: subtitle information and audio track information.

[0117] S204. Output audio track and / or subtitle information in the UI interface.

[0118] After the device initiating the screen mirroring obtains at least one of the audio track information and subtitle information, it can output this information on the UI interface to facilitate user switching.

[0119] Of course, the UI interface can also provide operation buttons or input boxes for switching audio tracks and subtitles, as well as interface icons or input positions to facilitate user operation and switching.

[0120] S205. In response to the audio track and / or subtitle switching operation of the UI interface, send an audio track and / or subtitle switching instruction to the receiving screen projection device according to the description file, so that the receiving screen projection device can complete the audio track and / or subtitle switching.

[0121] After the audio track and / or subtitle information is output in the UI interface, users can switch between audio tracks and / or subtitles in the UI interface according to their actual needs.

[0122] In response to the audio track and / or subtitle switching operation, the screen mirroring initiating device can send an audio track and / or subtitle switching command to the receiving screen mirroring device according to the description file.

[0123] Once the screen mirroring receiving device receives the audio track and / or subtitle switching command, it can switch the audio track and / or subtitle.

[0124] In one specific embodiment of this application, in response to an audio track and / or subtitle switching operation on the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving projection device according to the description file, including:

[0125] Step 1: In response to audio track and / or subtitle switching operations, determine the audio track and / or subtitle switching instructions according to the instructions described in the description file;

[0126] Step 2: Send audio track and / or subtitle switching instructions to the receiving projection device.

[0127] For ease of description, the two steps above will be explained together below.

[0128] After the user switches the audio track and / or subtitles in the UI, the initiating projection device can determine the audio track and / or subtitle switching command based on the instruction description obtained from the description file of the receiving projection device. Then, it sends the audio track and / or subtitle switching command to the receiving projection device.

[0129] Using the method provided in the embodiments of this application, a broadcast screen-sharing device search is performed, and a description file including a switching service is obtained from the receiving screen-sharing device; a video file link is sent to the receiving screen-sharing device; after confirming that the receiving screen-sharing device has played the video successfully, audio track and / or subtitle information is obtained from the receiving screen-sharing device; audio track and / or subtitle information is output on the UI interface; in response to the audio track and / or subtitle switching operation on the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving screen-sharing device according to the description file, so that the receiving screen-sharing device can complete the audio track and / or subtitle switching.

[0130] When screen mirroring is required, a screen mirroring device search is first broadcast, and then a description file including a switching service is obtained from the receiving screen mirroring device. Next, a video file link is sent to the receiving screen mirroring device so that it can play the video based on that link. After confirming successful playback on the receiving screen mirroring device, audio track and / or subtitle information is obtained from it. This audio track and / or subtitle information is then output to the UI interface. When the user needs to switch audio tracks or subtitles, they can perform the switching operation on the UI interface. Correspondingly, in response to the audio track and / or subtitle switching operation on the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving screen mirroring device according to the description file, enabling the receiving screen mirroring device to complete the audio track and / or subtitle switching. In other words, this application, based on a description file including a switching service and a switching control flow, can implement at least one switching function—subtitle switching or audio track switching—during screen mirroring playback, thus meeting the diverse needs of users.

[0131] It is important to note that the screen mirroring control methods applied to the initiating screen mirroring device and the receiving screen mirroring device can be used independently or in combination in practice. The independent application process can be referred to the description above, and will not be repeated here.

[0132] When combined, they can be used within a single screen mirroring scenario. In other words, for the same video mirroring, applications such as... Figure 2 The screen mirroring control method shown is applied on the receiving screen mirroring device as follows: Figure 1 The screen mirroring control method shown.

[0133] To help those skilled in the art better understand how to combine the two methods for application, the following section provides a detailed explanation of the two screen projection control methods using specific screen projection scenarios as examples.

[0134] Please refer to Figure 3 , Figure 3 This is a schematic diagram of a screen mirroring process according to an embodiment of this application. The specific implementation process includes the following steps:

[0135] 1) The device initiating the screen mirroring searches for devices on the network that can receive the screen mirroring. After confirming the receiving device, it sends the link of the video file to be mirrored.

[0136] 2) After receiving the video file link, the receiving screen mirroring device starts playing the video, parses the audio track and subtitle information in the video file, and plays it using the default audio track and subtitles.

[0137] 3) After the initiating screen mirroring device detects that the receiving screen mirroring device has successfully played the video, it sends a command to the receiving screen mirroring device to obtain the audio track or subtitle information, and the receiving screen mirroring device returns the audio track or subtitle information.

[0138] 4) After receiving the audio track or subtitle information, the device that initiates the screen mirroring can display it on its own UI interface, and the user can switch the audio track or subtitle through the UI interface.

[0139] 5) The initiating screen projection device sends a command to the receiving screen projection device to switch the audio track or switch the subtitles, and the receiving screen projection device executes the function of switching the audio track or switching the subtitles.

[0140] In contrast, DLNA screen mirroring technology cannot switch audio tracks and subtitles on the device initiating the mirroring, causing users to only accept the default audio tracks and subtitles when using the mirroring function, which affects the user's video viewing experience. The technical solution provided in this application embodiment can meet the user's need to select audio tracks and subtitles during DLNA screen mirroring, thereby improving the user experience.

[0141] Corresponding to the above method embodiments, this application also provides a screen projection receiving device, the screen projection receiving device described below is the same as described above. Figure 1 The screen projection control methods shown can be used as corresponding references.

[0142] The receiving and projection device includes:

[0143] Memory, used to store computer programs;

[0144] A processor is used to execute computer programs to achieve, for example, Figure 1 The steps of the screen mirroring control method are shown.

[0145] That is, when executing a computer program in this processor, the following steps are performed:

[0146] In response to a screen mirroring device search that initiates a screen mirroring device broadcast, feedback includes a description file for switching services;

[0147] Play the video based on the video file link sent by the initiating screen mirroring device, and obtain the audio track and / or subtitle information of the video file;

[0148] After receiving the audio track and / or subtitle acquisition instruction sent by the initiating screen projection device according to the description file, the corresponding audio track and / or subtitle information is sent to the initiating screen projection device.

[0149] Receive audio track and / or subtitle switching instructions sent by the device initiating the screen mirroring;

[0150] Follow the audio track and / or subtitle switching instructions to complete the audio track and / or subtitle switching.

[0151] In one specific embodiment of this application, in response to a screen mirroring device search that initiates a screen mirroring device broadcast, a description file including a service switching feature is provided, comprising:

[0152] In response to the search for screen mirroring devices, it provides device description files and service description files.

[0153] The device description file contains a handover service description, and the service description file includes the handover description file.

[0154] In one specific embodiment of this application, switching between audio tracks and / or subtitles is performed according to audio track and / or subtitle switching instructions, including:

[0155] From the switching description file, find the status variables corresponding to the audio track and / or subtitle switching instructions, and store the input parameters corresponding to the audio track and / or subtitle switching instructions into the status variables to complete the audio track and / or subtitle switching.

[0156] One specific embodiment of this application includes:

[0157] Receive basic instructions sent by the device initiating screen mirroring;

[0158] Respond to basic instructions based on the description file.

[0159] Corresponding to the above method embodiments, this application also provides a screen casting initiation device. The screen casting initiation device described below is similar to the one described above. Figure 2 The screen projection control methods shown can be used as corresponding references.

[0160] Specifically, the screen projection device is characterized by comprising:

[0161] Memory, used to store computer programs;

[0162] A processor is used to execute computer programs to achieve, for example, Figure 2 The steps of the screen mirroring control method are shown.

[0163] That is, when the processor executes a computer program, it performs the following steps:

[0164] Search for broadcast projection devices and obtain description files including the switching service from the receiving projection devices;

[0165] Send a video file link to the receiving screen mirroring device;

[0166] After confirming that the receiving screen projection device has played successfully, obtain the audio track and / or subtitle information from the receiving screen projection device;

[0167] Output audio track and / or subtitle information in the UI interface;

[0168] In response to audio track and / or subtitle switching operations on the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving screen projection device according to the description file, so that the receiving screen projection device can complete the audio track and / or subtitle switching.

[0169] In one specific embodiment of this application, in response to an audio track and / or subtitle switching operation on the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving projection device according to the description file, including:

[0170] In response to audio track and / or subtitle switching operations, determine the audio track and / or subtitle switching instructions based on the instructions described in the description file;

[0171] Send audio track and / or subtitle switching instructions to the receiving screen mirroring device.

[0172] In one specific embodiment of this application, obtaining audio track and / or subtitle information from the receiving projection device includes:

[0173] According to the instructions described in the description file, send an audio track and / or subtitle acquisition instruction to the receiving screen projection device;

[0174] Receive audio track and / or subtitle information from the screen projection device.

[0175] It is important to note that the specific structure of the initiating and receiving screen-sharing devices can vary significantly due to differences in configuration and performance. They may include one or more central processing units (CPUs) and memory, with the memory storing one or more computer programs or data. The memory can be temporary or permanent storage. The program stored in the memory may include one or more modules, each of which may include a series of instruction operations on the data processing device. Furthermore, the processor may be configured to communicate with the memory and execute the series of instruction operations stored in the memory on the device.

[0176] The device may also include one or more power supplies, one or more wired or wireless network interfaces, one or more input / output interfaces, and / or one or more operating systems.

[0177] Corresponding to the above method embodiments, this application also provides a readable storage medium. The readable storage medium described below can be referred to in conjunction with the screen projection control method described above.

[0178] A readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the screen projection control method described in the above method embodiments.

[0179] Specifically, the readable storage medium can be a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, or any other readable storage medium capable of storing program code.

[0180] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to in the method section.

[0181] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0182] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0183] Finally, it should be noted that in this document, relationships such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "include," "contain," or any other variations are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus.

[0184] This document uses specific examples to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the methods and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A screen projection control method, characterized in that, include: In response to a screen mirroring device search that initiates a screen mirroring device broadcast, feedback includes a description file for switching services; Play the video based on the video file link sent by the initiating screen mirroring device, and obtain the audio track and / or subtitle information of the video file; After receiving the audio track and / or subtitle acquisition instruction sent by the screen projection initiating device according to the description file, the corresponding audio track and / or subtitle information is sent to the screen projection initiating device; Receive audio track and / or subtitle switching instructions sent by the screen projection device; Follow the audio track and / or subtitle switching instructions to complete the audio track and / or subtitle switching.

2. The screen projection control method according to claim 1, characterized in that, In response to the screen mirroring device search that initiated the screen mirroring device broadcast, the feedback includes a description file for switching services, including: In response to the screen projection device search, a device description file and a service description file are returned; The device description file contains a switching service description, and the service description file includes a switching description file.

3. The screen projection control method according to claim 2, characterized in that, According to the audio track and / or subtitle switching instructions, complete the audio track and / or subtitle switching, including: From the switching description file, find the status variable corresponding to the audio track and / or subtitle switching instruction, and store the input parameters corresponding to the audio track and / or subtitle switching instruction into the status variable to complete the audio track and / or subtitle switching.

4. The screen projection control method according to any one of claims 1 to 3, characterized in that, include: Receive the basic instructions sent by the device that initiated the screen mirroring; Respond to the basic instructions according to the description file.

5. A screen projection control method, characterized in that, include: Search for broadcast projection devices and obtain description files including the switching service from the receiving projection devices; Send a video file link to the receiving projection device; After confirming that the receiving screen projection device has played successfully, the audio track and / or subtitle information is obtained from the receiving screen projection device; Output the audio track and / or subtitle information in the UI interface; In response to the audio track and / or subtitle switching operation of the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving projection device according to the description file, so that the receiving projection device can complete the audio track and / or subtitle switching.

6. The screen projection control method according to claim 5, characterized in that, In response to the audio track and / or subtitle switching operation of the UI interface, an audio track and / or subtitle switching instruction is sent to the receiving projection device according to the description file, including: In response to the audio track and / or subtitle switching operation, the audio track and / or subtitle switching instruction is determined according to the instruction description in the description file; Send the audio track and / or subtitle switching command to the receiving projection device.

7. The screen projection control method according to claim 5, characterized in that, Obtaining audio track and / or subtitle information from the receiving projection device includes: According to the instructions described in the description file, send an audio track and / or subtitle acquisition instruction to the receiving screen projection device; Receive the audio track and / or subtitle information fed back by the receiving screen projection device.

8. A receiving and projection device, characterized in that, include: Memory, used to store computer programs; A processor, configured to implement the steps of the screen projection control method as described in any one of claims 1 to 4 when executing the computer program.

9. A screen projection initiation device, characterized in that, include: Memory, used to store computer programs; A processor, configured to implement the steps of the screen projection control method as described in any one of claims 5 to 7 when executing the computer program.

10. A readable storage medium, characterized in that, The readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the screen projection control method as described in any one of claims 1 to 7.

Images