Wireless screen projection method, device and system and storage medium

Abstract

The invention discloses a wireless screen projection method, device and system and a storage medium, and relates to the technical field of screen projection. The method comprises the steps that a sending end starts a third-party application to an established WIFI virtual screen by calling a preset function, first WIFI virtual screen data of the WIFI virtual screen are sent to a receiving end through Miracast connection, and the preset function is used for specifying a virtual screen bearing audios and videos; and the receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data. According to the technical scheme provided by the embodiment of the invention, the established WIFI virtual screen is connected with the Miracast, so that a third-party application can easily realize wireless different display screen projection without system signature or system framework modification.

Description

Technical Field

[0001] The present invention relates to the field of screen projection technology, and in particular to a wireless screen projection method, device, system and storage medium. Background Art

[0002] With the increasing popularity of smart cars, smart homes, and office devices, the demand for multi-screen interactive applications is increasing. Wireless display (WFD) technology wirelessly transmits images and audio from a device to a display. WFD typically uses Wi-Fi networks for data transmission, establishing a wireless connection between the device and the display through specific protocols and adapters.

[0003] However, in the Android system, especially Android 10 and above, there are certain permission restrictions on directly launching non-system-signed applications on different display screens, making it difficult for ordinary application developers or enterprises to implement different-screen display of third-party applications without system signatures. Summary of the Invention

[0004] The present invention provides a wireless screen projection method, device, system and storage medium to solve the problem of different screen displays of third-party applications.

[0005] In a first aspect, the present invention provides a wireless screen projection method, comprising:

[0006] The sending end starts the third-party application to the created WIFI virtual screen by calling a preset function, and sends the first WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection, wherein the preset function is used to specify the virtual screen that carries audio and video;

[0007] The receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data.

[0008] In a second aspect, the present invention provides a wireless screen projection device, comprising:

[0009] The data sending module in the sending end is used to launch the third-party application to the created WIFI virtual screen by calling a preset function, and send the first WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection, wherein the preset function is used to specify the virtual screen that carries audio and video;

[0010] The playing module in the receiving end is used to play the audio and video of the third-party application according to the first WIFI virtual screen data.

[0011] In a third aspect, the present invention provides a wireless screen projection system, which includes a receiving end and a transmitting end;

[0012] Among them, the receiving end can execute the steps performed by the receiving end in the wireless screen projection method described in the first aspect above, and the sending end can execute the steps performed by the sending end in the wireless screen projection method described in the first aspect above.

[0013] In a fourth aspect, the present invention provides a computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a processor to implement the wireless screen projection method of the first aspect mentioned above when executed.

[0014] The wireless screen projection solution provided by the present invention is that the sending end starts the third-party application to the created WIFI virtual screen by calling a preset function, and sends the first WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection, wherein the preset function is used to specify the virtual screen that carries audio and video, and the receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data. By adopting the above technical solution, using the created Miracast connection and WIFI virtual (different display) screen, the third-party application (i.e., the sending end) can easily realize wireless different display screen projection without system signature or modification of the system framework.

[0015] It should be understood that the content described in this section is not intended to identify the key or important features of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 This is a flow chart of a wireless screen projection method provided according to the first embodiment of the present invention;

[0018] Figure 2 This is a flow chart of a wireless screen projection method provided according to the second embodiment of the present invention;

[0019] Figure 3 This is a structural diagram of a wireless screen projection device provided according to the third embodiment of the present invention;

[0020] Figure 4 This is a structural diagram of a wireless screen projection system provided according to embodiment 4 of the present invention. DETAILED DESCRIPTION

[0021] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0022] It should be noted that the terms "first," "second," and the like in the specification and claims of the present invention and the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than that illustrated or described herein. In the description of the present invention, unless otherwise specified, "plurality" refers to two or more. "And / or" describes an association relationship between associated objects, indicating that three relationships can exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship. In addition, the terms "including" and "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such process, method, product, or device.

[0023] Example 1

[0024] Figure 1 A flowchart of a wireless screen projection method is provided for the first embodiment of the present invention. This embodiment is applicable to the case of wireless screen projection. The method can be executed by a wireless screen projection device. The wireless screen projection device can be implemented in the form of hardware and / or software. The wireless screen projection device can be configured in a wireless screen projection system. The wireless screen projection system can be composed of two or more physical entities.

[0025] like Figure 1 As shown, the wireless screen projection method provided in the first embodiment of the present invention specifically includes the following steps:

[0026] S101. The sending end starts a third-party application to the created WIFI virtual screen by calling a preset function, and sends the first WIFI virtual screen data of the WIFI virtual screen to the receiving end through a Miracast connection, wherein the preset function is used to specify the virtual screen that carries audio and video.

[0027] In this embodiment, the Source end (i.e., the transmitting end) can be a terminal such as a mobile phone, and the receiving end can be a display screen end in a vehicle, etc. A third-party application is configured in the transmitting end. When the third-party application in the transmitting end needs to cast the screen to the receiving end, the transmitting end can establish a Miracast connection with the Sink end (i.e., the receiving end) through the built-in wireless connection module. Then a WIFI virtual screen of type TYPE_WIFI can be created, and then the preset function can be used to first start the third-party application to the created WIFI virtual screen, that is, the audio and video of the third-party application are cast to the WIFI virtual screen. After the Real Time Streaming Protocol (RTSP) channel is established, the first WIFI virtual screen data of the WIFI virtual screen is sent to the receiving end through the Miracast connection. Among them, the first WIFI virtual screen data includes the audio and video stream data of the third-party application.

[0028] S102: The receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data.

[0029] In this embodiment, the receiving end can first establish a Miracast connection with the sending end by calling the Miracast component built into the Android system, such as WifiDisplaySinkActivity. Then, the receiving end receives the first Wi-Fi virtual screen data sent by the sending end, and plays the audio and video of the third-party application based on the data.

[0030] The wireless screen projection method provided by the embodiment of the present invention is that the sending end starts the third-party application to the created WIFI virtual screen by calling a preset function, and sends the first WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection, wherein the preset function is used to specify the virtual screen that carries audio and video, and the receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data. The technical solution of the embodiment of the present invention utilizes the created Miracast connection and WIFI virtual (different display) screen, so that the third-party application (i.e., the sending end) can easily realize wireless different display screen projection without system signature or modification of the system framework.

[0031] Optionally, after the receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data, it also includes: the receiving end receives editing instruction information triggered by the user, and sends the editing instruction information to the sending end; the sending end determines the area corresponding to the touch area corresponding to the editing instruction information in the WIFI virtual screen, and determines whether the corresponding area is an editable area; if so, the sending end intercepts the editing event corresponding to the editing instruction information to prevent the editing tool corresponding to the editing instruction information from being displayed on the sending end.

[0032] Specifically, the user can input editing instruction information to the receiving end through touch or other methods. After receiving the editing instruction information triggered by the user, the receiving end can send the editing instruction information to the sending end through the wireless network, wherein the editing instruction information includes touch area information. After receiving the editing instruction information, the sending end can first determine the corresponding touch area, and then determine the area corresponding to the touch area in the WIFI virtual screen, and determine whether the corresponding area is an editable area in the WIFI virtual screen. If so, it means that the touch area is the top-level editable area, and the sending end will intercept the editing event corresponding to the editing instruction information to prevent the editing tool corresponding to the editing instruction information from being displayed on the sending end. For example, prevent the soft keyboard from being displayed on the sending end.

[0033] Optionally, the receiving end plays the audio and video of the third-party application based on the first Wi-Fi virtual screen data, including: the receiving end crops the third-party application video frames in the first Wi-Fi virtual screen data to obtain a video to be displayed, and plays a partial video of the third-party application by playing the video to be displayed. The advantage of this setting is that it ensures that only the specified content area of ​​the third-party application is displayed, effectively protecting user privacy and preventing the leakage of sensitive information.

[0034] Specifically, the receiving end can process the third-party application video frames in the first Wi-Fi virtual screen data, such as scaling or cropping, to remove irrelevant status bars, navigation bars, or black borders, thereby displaying the specified image in the third-party application video. This step does not involve the video encoding process on the sending end, but optimizes the final displayed video frames, thereby improving the display's relevance and visual experience.

[0035] Optionally, the receiving end is configured in a vehicle.

[0036] Specifically, the receiving end may be a vehicle-mounted secondary screen.

[0037] Optionally, the receiving end may also be a smart home, etc.

[0038] Example 2

[0039] Figure 2 This is a flow chart of a wireless screen projection method provided in the second embodiment of the present invention. The technical solution of the embodiment of the present invention is further optimized on the basis of the above-mentioned optional technical solutions, and a specific method of wireless screen projection is given.

[0040] Optionally, the sending end launches the third-party application on the created WIFI virtual screen by calling a preset function, including: the sending end listens for WIFI virtual screen generation events by calling the DisplayManager.registerDisplayListener interface and determines the WIFI virtual screen ID based on the monitoring result; the sending end launches the third-party application on the WIFI virtual screen corresponding to the WIFI virtual screen ID by calling the ActivityOptions.setLaunchDisplayId function. The advantage of this setting is that the sending end does not need to customize special permissions and uses the Android system's DisplayManager class and ActivityOptions.setLaunchDisplayId function to achieve cross-screen display, making development and deployment simple and fast.

[0041] Optionally, after the receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data, it also includes: the receiving end receives the screen control instruction information triggered by the user, and sends the screen control instruction information to the sending end; the sending end uses the Accessibility Service to inject the control event corresponding to the screen control instruction information into the WIFI virtual screen, and sends the second WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection; the receiving end receives the second WIFI virtual screen data based on the Miracast connection, and plays the audio and video corresponding to the screen control instruction information according to the second WIFI virtual screen data. The advantage of this setting is that it realizes the reverse control of the main screen application by the different display screen, ensuring the user's interactive experience.

[0042] Optionally, after the sending end intercepts the editing event corresponding to the editing instruction information, the process further includes: the receiving end displays the editing tool corresponding to the editing instruction information, receives the editing information input by the user through the editing tool, and sends the editing information to the sending end; the sending end uses AccessibilityService to inject the editing information into the target area of ​​the WIFI virtual screen, wherein the target area is the editing area corresponding to the editing information in the WIFI virtual screen. The advantage of this setting is that it enables the receiving end to input the editing application of the sending end, ensuring the user's interactive experience.

[0043] like Figure 2 As shown, a wireless screen projection method provided by the second embodiment of the present invention specifically includes the following steps:

[0044] S201. The sending end monitors the WIFI virtual screen generation event by calling the DisplayManager.registerDisplayListener interface, and determines the WIFI virtual screen ID according to the monitoring result.

[0045] Specifically, the sender can call the DisplayManager.registerDisplayListener interface of the Android system to listen for the event of the WIFI virtual screen generating. When listening, the WIFI virtual screen ID can be captured and recorded as displayId_wifi.

[0046] S202. The sending end launches the third-party application to the WIFI virtual screen corresponding to the WIFI virtual screen ID by calling the ActivityOptions.setLaunchDisplayId function, and sends the first WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection.

[0047] Specifically, by calling the ActivityOptions.setLaunchDisplayId function, the sender can start any third-party application (such as third-party map navigation software, video playback software, or game software, etc.) and direct it to the WIFI virtual screen corresponding to the displayId_wifi corresponding to Miracast without the need for system signature permission, thereby realizing the different display of third-party applications.

[0048] S203: The receiving end crops the third-party application video frame in the first WIFI virtual screen data to obtain a video to be displayed, and plays a partial video of the third-party application by playing the video to be displayed.

[0049] S204: The receiving end receives the screen control instruction information triggered by the user, and sends the screen control instruction information to the sending end.

[0050] Specifically, the user can input screen control instruction information to the receiving end by touching, etc. After receiving the screen control instruction information triggered by the user, the receiving end will send the instruction to the sending end via the wireless network.

[0051] S205: The sending end uses AccessibilityService to inject the control event corresponding to the screen control instruction information into the WIFI virtual screen, and sends the second WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection.

[0052] Specifically, the sender can use the AccessibilityService API (Application Programming Interface) to inject the control event corresponding to the screen control instruction information into the Wi-Fi virtual screen, and send the second Wi-Fi virtual screen data of the Wi-Fi virtual screen to the receiver via the Miracast connection to achieve remote touch interaction. The second Wi-Fi virtual screen data has the same data type as the first Wi-Fi virtual screen data, which is also audio and video stream data.

[0053] S206. The receiving end receives the second WIFI virtual screen data based on the Miracast connection, and plays the audio and video corresponding to the screen control instruction information according to the second WIFI virtual screen data.

[0054] Specifically, after receiving the second WIFI virtual screen data, the receiving end can play the audio and video in response to the screen control instruction information according to the second WIFI virtual screen data.

[0055] S207: The receiving end receives the editing instruction information triggered by the user, and sends the editing instruction information to the sending end.

[0056] S208. The sending end determines the area corresponding to the touch area corresponding to the editing instruction information in the WIFI virtual screen, and determines whether the corresponding area is an editable area; if so, the sending end intercepts the editing event corresponding to the editing instruction information to prevent the editing tool corresponding to the editing instruction information from being displayed on the sending end.

[0057] S209: The receiving end displays the editing tool corresponding to the editing instruction information, receives the editing information input by the user through the editing tool, and sends the editing information to the sending end.

[0058] Specifically, the sending end does not display the editing tool corresponding to the editing instruction information, but the receiving end will display the editing tool and receive the input editing information, such as text data, through the editing tool. Then, the editing information is sent to the sending end via the wireless network.

[0059] S210: The sending end uses AccessibilityService to inject the editing information into a target area in the WIFI virtual screen, wherein the target area is the editing area corresponding to the editing information in the WIFI virtual screen.

[0060] Specifically, the sender can use the API of AccessibilityService to inject the editing information into the target area of ​​the WIFI virtual screen, such as an editable box, to achieve smooth input interaction of "what you see is what you get" on the receiver's screen.

[0061] For example, the specific implementation process of text injection and gesture injection by the sender through AccessibilityService includes:

[0062] Taking the TouchService as an example, you need to declare AccessibilityService in AndroidManifest.xml and enable the corresponding accessibility service permissions in Settings. Then, call TouchService.getEditableNodesWithLayer() to traverse the AccessibilityWindowInfo corresponding to the Wi-Fi virtual screen, recursively collecting nodes with isEditable == true, along with their screen coordinates and window hierarchy. Call TouchService.getValidRegionForNode() to remove any areas of the screen rectangle at higher hierarchies and obscured by controls from each node's screen rectangle to obtain the node's valid touchable area. Next, use TouchService.isTouchInsideValidArea() to use this list of valid touchable areas to determine whether the remotely sent (x, y) touch point falls within the valid area of ​​a node. If so, update currentFocusedNode and trigger the subsequent text injection operation. For unfocused nodes, first execute currentFocusedNode.performAction(ACTION_FOCUS), then use ACTION_SET_TEXT to directly write text into the target control, bypassing the soft keyboard. You can also inject touch gesture events by calling GestureDescription.Builder.setDisplayId() and dispatchGesture().

[0063] The wireless screen projection method provided by the embodiment of the present invention does not require the sending end to customize special permissions. It uses the DisplayManager class and ActivityOptions.setLaunchDisplayId function of the Android system to realize different-screen display. The development and deployment are simple and fast, and the receiving end can realize the reverse control and editing input of the sending end application, ensuring the user's interactive experience. It has the characteristics of low cost, easy implementation, good interactive experience and wide application scenarios.

[0064] Example 3

[0065] Figure 3 This is a schematic diagram of the structure of a wireless screen projection device provided in the third embodiment of the present invention. Figure 3 As shown, the device includes: a data sending module 301 in a sending end and a playing module 302 in a receiving end, wherein:

[0066] The data sending module in the sending end is used to launch the third-party application to the created WIFI virtual screen by calling a preset function, and send the first WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection, wherein the preset function is used to specify the virtual screen that carries audio and video;

[0067] The playing module in the receiving end is used to play the audio and video of the third-party application according to the first WIFI virtual screen data.

[0068] The wireless screen projection device provided by the embodiment of the present invention utilizes the created Miracast connection and WIFI virtual (different display) screen to enable third-party applications (i.e., the sending end) to easily realize wireless different display screen projection without system signature or modification of the system framework.

[0069] Optionally, the data sending module includes:

[0070] A virtual screen identification determination unit is used to monitor the WIFI virtual screen generation event by calling the DisplayManager.registerDisplayListener interface, and determine the WIFI virtual screen ID according to the monitoring result;

[0071] The screen projection unit is used to launch the third-party application to the WIFI virtual screen corresponding to the WIFI virtual screen ID by calling the ActivityOptions.setLaunchDisplayId function.

[0072] Optionally, the device further includes:

[0073] The instruction sending module in the receiving end is used to receive screen control instruction information triggered by the user after the receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data, and send the screen control instruction information to the sending end;

[0074] The virtual screen data sending module in the sending end is used to use AccessibilityService to inject the control event corresponding to the screen control instruction information into the WIFI virtual screen, and send the second WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection;

[0075] The response image playback module in the receiving end is used to receive the second WIFI virtual screen data based on the Miracast connection, and play the audio and video corresponding to the screen control instruction information according to the second WIFI virtual screen data.

[0076] Optionally, the device further includes:

[0077] The editing instruction information sending module in the receiving end is configured to receive the editing instruction information triggered by the user after the receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data, and send the editing instruction information to the sending end;

[0078] The judgment module in the transmitting end is used to determine the area corresponding to the touch area corresponding to the editing instruction information in the WIFI virtual screen, and to judge whether the corresponding area is an editable area;

[0079] The interception module in the sending end is used to intercept the editing event corresponding to the editing instruction information if the information returned by the judgment module is true, so as to prevent the editing tool corresponding to the editing instruction information from being displayed on the sending end.

[0080] Optionally, the device further includes:

[0081] The editing information sending module in the receiving end is configured to, after the sending end intercepts the editing event corresponding to the editing instruction information, display the editing tool corresponding to the editing instruction information, receive the editing information input by the user through the editing tool, and send the editing information to the sending end;

[0082] The information injection module in the sending end is used to use AccessibilityService to inject the editing information into the target area in the WIFI virtual screen, wherein the target area is the editing area corresponding to the editing information in the WIFI virtual screen.

[0083] Optionally, the playback module is specifically configured to enable the receiving end to crop the third-party application video frame in the first WIFI virtual screen data to obtain a video to be displayed, and to play a partial video of the third-party application by playing the video to be displayed.

[0084] Optionally, the receiving end is configured in a vehicle.

[0085] The wireless screen projection device provided in the embodiment of the present invention can execute the wireless screen projection method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0086] Example 4

[0087] Figure 4 A schematic structural diagram of a wireless projection system 40 that can be used to implement an embodiment of the present invention is shown. The receiving end and the transmitting end in the wireless projection system can be various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices can also be represented. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0088] like Figure 4 As shown, the wireless screen projection system 40 includes a receiving end 41 and a transmitting end 42. The receiving end can execute the steps performed by the receiving end in the wireless screen projection method described above, and the transmitting end can execute the steps performed by the transmitting end in the wireless screen projection method described above.

[0089] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip (SOC) systems, complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0090] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0091] The computer device provided above can be used to execute the wireless screen projection method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0092] Example 5

[0093] In the context of the present invention, a computer-readable storage medium may be a tangible medium, and the computer-executable instructions, when executed by a computer processor, are used to perform a wireless screen projection method, the method comprising:

[0094] The sending end starts the third-party application to the created WIFI virtual screen by calling a preset function, and sends the first WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection, wherein the preset function is used to specify the virtual screen that carries audio and video;

[0095] The receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data.

[0096] In the context of the present invention, computer-readable storage medium can be a tangible medium that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage medium can include but is not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage medium can be a machine-readable signal medium. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0097] The computer device provided above can be used to execute the wireless screen projection method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0098] It is worth noting that in the embodiment of the above-mentioned wireless projection device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0099] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the concept of the present invention. The scope of the present invention is determined by the scope of the appended claims.

Claims

1. A wireless screen projection method, characterized in that: include: The sending end starts the third-party application to the created WIFI virtual screen by calling a preset function, and sends the first WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection, wherein the preset function is used to specify the virtual screen that carries audio and video; The receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data.

2. The method according to claim 1, characterized in that The sending end starts the third-party application to the created WIFI virtual screen by calling a preset function, including: The sending end monitors the WIFI virtual screen generation event by calling the DisplayManager.registerDisplayListener interface, and determines the WIFI virtual screen ID according to the monitoring result; The sending end launches the third-party application to the WIFI virtual screen corresponding to the WIFI virtual screen ID by calling the ActivityOptions.setLaunchDisplayId function.

3. The method according to claim 1, characterized in that After the receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data, the method further includes: The receiving end receives the screen control instruction information triggered by the user, and sends the screen control instruction information to the sending end; The sending end uses AccessibilityService to inject the control event corresponding to the screen control instruction information into the WIFI virtual screen, and sends the second WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection; The receiving end receives the second WIFI virtual screen data based on the Miracast connection, and plays the audio and video corresponding to the screen control instruction information according to the second WIFI virtual screen data.

4. The method according to any one of claims 1 to 3, characterized in that After the receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data, the method further includes: The receiving end receives the editing instruction information triggered by the user, and sends the editing instruction information to the sending end; The sending end determines the area corresponding to the touch area corresponding to the editing instruction information in the WIFI virtual screen, and determines whether the corresponding area is an editable area; If so, the sending end intercepts the editing event corresponding to the editing instruction information to prevent the editing tool corresponding to the editing instruction information from being displayed on the sending end.

5. The method according to claim 4, characterized in that After the sending end intercepts the editing event corresponding to the editing instruction information, the method further includes: The receiving end displays the editing tool corresponding to the editing instruction information, receives the editing information input by the user through the editing tool, and sends the editing information to the sending end; The sending end uses AccessibilityService to inject the editing information into a target area in the WIFI virtual screen, wherein the target area is the editing area corresponding to the editing information in the WIFI virtual screen.

6. The method according to claim 1, characterized in that The receiving end plays the audio and video of the third-party application according to the first WIFI virtual screen data, including: The receiving end crops the third-party application video frame in the first WIFI virtual screen data to obtain a video to be displayed, and plays a partial video of the third-party application by playing the video to be displayed.

7. The method according to claim 1, characterized in that The receiving end is configured in a vehicle.

8. A wireless screen projection device, characterized in that: include: The data sending module in the sending end is used to launch the third-party application to the created WIFI virtual screen by calling a preset function, and send the first WIFI virtual screen data of the WIFI virtual screen to the receiving end through the Miracast connection, wherein the preset function is used to specify the virtual screen that carries audio and video; The playing module in the receiving end is used to play the audio and video of the third-party application according to the first WIFI virtual screen data.

9. A wireless screen projection system, characterized in that: The wireless screen projection system includes a receiving end and a transmitting end; Among them, the receiving end can execute the steps performed by the receiving end in the wireless screen projection method described in any one of claims 1-7, and the sending end can execute the steps performed by the sending end in the wireless screen projection method described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the wireless screen projection method according to any one of claims 1 to 7 when executed.

Images