Multi-path screen projection method, multi-path screen projection device and display device

Abstract

The present disclosure relates to a multi-path screen projection method, a multi-path screen projection device and a display device, and is applied to the technical field of screen projection. The method comprises the following steps: in response to a plurality of received screen projection requests, determining a screen projection protocol corresponding to each screen projection request; determining a multi-frequency multi-connection screen projection mode based on the screen projection protocol corresponding to each screen projection request; determining that a wireless network WiFi module has loaded a target driver corresponding to the multi-frequency multi-connection screen projection mode, so that a plurality of interfaces corresponding to the target driver can work normally, and each interface corresponds to a communication frequency band; receiving screen projection data corresponding to the plurality of screen projection requests through each communication frequency band corresponding to the plurality of interfaces; and splitting and displaying the screen projection data corresponding to the plurality of screen projection requests. The multi-path screen projection is realized without increasing the cost.

Description

Technical Field

[0001] This application relates to screen projection technology. More specifically, it relates to a multi-channel screen projection method, a multi-channel screen projection device, and a display device. Background Technology

[0002] With the continuous development of smart TVs, there are higher requirements for screen casting functionality. Currently, screen casting on the market can be roughly divided into three categories: Digital Living Network Alliance (DLNA) screen casting, AirPlay screen casting, and Miracast screen casting. Among them, DLNA and AirPlay are screen casting methods based on local area networks (LANs), while Miracast does not rely on LANs and casts screens through a peer-to-peer connection.

[0003] Existing smart TVs already support multiple screen mirroring methods. The TV uses a split-screen display. To enable simultaneous screen mirroring from multiple devices, the current solution is to add a WiFi module to the TV. Using multiple WiFi modules to enable simultaneous screen mirroring from multiple devices will inevitably increase costs and make the development of the underlying software of the WiFi module more difficult. Summary of the Invention

[0004] In order to solve the above-mentioned technical problems, or at least partially solve the above-mentioned technical problems, this application provides a multi-channel projection method, a multi-channel projection device and a display device, which can realize multi-channel projection without increasing costs.

[0005] In a first aspect, embodiments of this application provide a multi-channel screen mirroring method, comprising: responding to multiple received screen mirroring requests, determining a screen mirroring protocol corresponding to each screen mirroring request; determining a multi-frequency multi-connection screen mirroring mode based on the screen mirroring protocol corresponding to each screen mirroring request; determining that the wireless network WiFi module has loaded a target driver program corresponding to the multi-frequency multi-connection screen mirroring mode, so that multiple interfaces corresponding to the target driver program can work normally, each interface corresponding to a communication frequency band; receiving screen mirroring data corresponding to multiple screen mirroring requests through the various communication frequency bands corresponding to the multiple interfaces; and displaying the screen mirroring data corresponding to the multiple screen mirroring requests in a split-screen manner.

[0006] Secondly, this application provides a multi-channel screen projection device, comprising: a determining module, configured to determine the screen projection protocol corresponding to each received screen projection request in response to multiple screen projection requests; the determining module is further configured to determine a multi-frequency multi-connection screen projection mode based on the screen projection protocol corresponding to each screen projection request; the determining module is further configured to determine that the wireless network WiFi module has loaded the target driver corresponding to the multi-frequency multi-connection screen projection mode, so that multiple interfaces corresponding to the target driver can work normally, each interface corresponding to a communication frequency band; a receiving module, configured to receive screen projection data corresponding to multiple screen projection requests through the communication frequency bands corresponding to the multiple interfaces; and a display module, configured to display the screen projection data corresponding to the multiple screen projection requests in a split-screen manner.

[0007] Thirdly, this application provides a computer-readable storage medium, including: storing a computer program on the computer-readable storage medium, wherein when the computer program is executed by a processor, it implements the multi-screen projection method as shown in the first aspect.

[0008] Fourthly, this application provides a computer program product, including: when the computer program product is run on a computer, causing the computer to implement the multi-screen projection method as shown in the first aspect.

[0009] Compared with the prior art, the technical solution provided in this application has the following advantages: In this application embodiment, in response to multiple received screen projection requests, the screen projection protocol corresponding to each screen projection request is determined; based on the screen projection protocol corresponding to each screen projection request, a multi-frequency multi-connection screen projection mode is determined; it is determined that the wireless network WiFi module has loaded the target driver corresponding to the multi-frequency multi-connection screen projection mode, so that the multiple interfaces corresponding to the target driver can work normally, and each interface corresponds to a communication frequency band; screen projection data corresponding to multiple screen projection requests is received through the various communication frequency bands corresponding to the multiple interfaces; and the screen projection data corresponding to multiple screen projection requests is displayed in a split-screen manner. Thus, for the screen mirroring receiver, based on the existing WiFi module, multiple interfaces are driven to work through the target driver. Each interface corresponds to a different communication frequency band. For multiple screen mirroring requests based on the local area network, screen mirroring data can be received simultaneously through multiple communication frequency bands. As long as the signal strength of any communication frequency band is good, screen mirroring data will not be lost, avoiding the problems of stuttering or screen distortion during screen mirroring. For multiple screen mirroring requests based on the local area network and P2P, screen mirroring data from the local area network can be received through one communication frequency band, and screen mirroring data from the P2P communication frequency band can be received through another communication frequency band. The two frequency bands do not interfere with each other, avoiding channel congestion, thereby making the transmission efficiency of screen mirroring data higher. Moreover, this solution does not add a WiFi module, resulting in lower cost. Attached Figure Description

[0010] To more clearly illustrate the implementation methods in the embodiments of this application or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings.

[0011] Figure 1 An operational scenario between a control device and a display device according to some embodiments is illustrated;

[0012] Figure 2 A hardware configuration block diagram of a control device 100 according to some embodiments is shown;

[0013] Figure 3 A hardware configuration block diagram of a display device 200 according to some embodiments is shown;

[0014] Figure 4 One of the flowcharts of a multi-screen projection method according to some embodiments is shown;

[0015] Figure 5 A schematic diagram illustrating various screen projection protocols adapted to display devices according to some embodiments is shown;

[0016] Figure 6 A schematic diagram of the interface provided by a conventional WiFi module according to some embodiments is shown;

[0017] Figure 7 A schematic diagram of the interfaces provided by a WiFi module according to some embodiments is shown;

[0018] Figure 8 A schematic diagram of another WiFi module's external interface, according to some embodiments, is shown;

[0019] Figure 9 A second flowchart illustrating a multi-channel projection method according to some embodiments is shown;

[0020] Figure 10 The third flowchart of a multi-channel projection method according to some embodiments is shown;

[0021] Figure 11 This is illustrated in the fourth flowchart of a multi-channel projection method according to some embodiments.

[0022] Figure 12 The fifth flowchart illustrates a multi-channel projection method according to some embodiments;

[0023] Figure 13 A flowchart of a multi-channel projection method according to some embodiments is shown in diagram six.

[0024] Figure 14 The seventh flowchart illustrates a multi-channel projection method according to some embodiments;

[0025] Figure 15 This is the eighth flowchart illustrating a multi-channel projection method according to some embodiments;

[0026] Figure 16 A structural block diagram of a multi-channel projection device according to some embodiments is shown;

[0027] Figure 17 A schematic diagram of the hardware structure of a display device according to some embodiments is shown. Detailed Implementation

[0028] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.

[0029] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0030] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0031] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0032] The multi-channel projection method provided in this application can be used in display devices. The specific display devices can have various implementation forms, such as televisions, smart televisions, laser projection devices, monitors, electronic bulletin boards, electronic tables, mobile phones, tablet computers, laptops, handheld computers, vehicle-mounted display devices, etc.

[0033] The multi-channel projection method of this application is applied to a display device, such as... Figure 1The diagram illustrates an operational scenario between a display device and a control device, where the control device includes intelligent devices or control units. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control device 100.

[0034] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.

[0035] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.

[0036] In some embodiments, the display device may receive instructions not through the aforementioned smart devices or control devices, but through touch or gestures.

[0037] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0038] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0039] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, an external memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0040] like Figure 3The display device 200 includes at least one of the following: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a user interface 280, an external memory, and a power supply.

[0041] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first interface to an nth interface for input / output.

[0042] The display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals from the controller output, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.

[0043] The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0044] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

[0045] User interface 280 can be used to receive control signals from control device 100 (such as an infrared remote control). It can also be used to directly receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to; in this case, it can be called a user input interface.

[0046] Detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0047] The external device interface 240 may include, but is not limited to, one or more of the following: High-definition multimedia interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0048] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

[0049] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0050] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory (internal or external memory). The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can perform operations related to the object selected by the user command.

[0051] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), and random access memory (RAM), read-only memory (ROM), a first to an nth interface for input / output, a communication bus, etc.

[0052] RAM, also known as main memory, is an internal memory that directly exchanges data with the controller. It can be read and written at any time (except during refresh) and is very fast, typically serving as temporary data storage for the operating system or other running programs. Its biggest difference from ROM is data volatility; data stored in RAM is lost when power is off. RAM is used in computers and digital systems to temporarily store programs, data, and intermediate results. ROM operates in a non-destructive read-only manner; information can only be read, not written. Once information is written, it is fixed and will not be lost even if power is cut off; therefore, it is also called fixed-function memory.

[0053] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0054] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of a display device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0055] The execution subject of the multi-channel projection method provided in this application embodiment can be a display device. The display device can be the aforementioned display device, or it can be a functional module and / or functional entity in the display device that can implement the multi-channel projection method. The specific implementation can be determined according to actual usage requirements, and this application embodiment does not limit it.

[0056] The multi-channel screen projection method provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0057] like Figure 4 As shown, this application provides a multi-channel screen projection method. The following description uses a display device (hereinafter referred to as the projection receiver) as the executing entity to illustrate the multi-channel screen projection method provided in this application. The method may include steps 101 to 105 as described below.

[0058] 101. In response to multiple received screen mirroring requests, determine the screen mirroring protocol corresponding to each screen mirroring request.

[0059] It can be understood that each of the multiple screen mirroring requests corresponds to a sending device (hereinafter referred to as the screen mirroring sender). The screen mirroring sender can be any device capable of communicating with the display device, such as a mobile phone or tablet. Multiple screen mirroring requests may include various screen mirroring protocols. Each screen mirroring request may correspond to a different screen mirroring protocol (i.e., one screen mirroring request sent by one sender corresponds to one screen mirroring protocol, and different senders may send screen mirroring requests corresponding to different screen mirroring protocols), or multiple screen mirroring requests may correspond to a single screen mirroring protocol (i.e., multiple screen mirroring requests sent by multiple senders correspond to the same screen mirroring protocol).

[0060] It is understood that existing screen mirroring methods correspond to protocols including DLNA, AirPlay, and Miracast, with the corresponding screen mirroring methods being DLNA screen mirroring, AirPlay screen mirroring, and Miracast screen mirroring, respectively. DLNA and AirPlay screen mirroring are both based on a local area network (LAN), requiring the sending and receiving ends to be on the same LAN (simply put, connected to the same router). Screen mirroring data is sent from the sending end to the receiving end via the LAN. Miracast screen mirroring, however, does not rely on a LAN; the sending and receiving ends connect directly via peer-to-peer (P2P), with the sending end directly sending screen mirroring data to the receiving end through the P2P connection. This application does not limit the screen mirroring protocol; other screen mirroring protocols may be included depending on the specific circumstances.

[0061] Specifically, DLNA was initiated by Sony, Intel, Microsoft, and others. DLNA is functionally similar to AirPlay, and their protocols are largely the same. AirPlay is a wireless technology developed by Apple, primarily used to enable iOS devices, including iPhones, iPads, and MacBooks, to transmit images, audio, and video to AirPlay-enabled screen mirroring receivers via WiFi. Miracast is a wireless display standard developed by the WiFi Alliance in 2012, based on WiFi Direct. Devices supporting this standard can share video feeds in a peer-to-peer manner.

[0062] It's understandable that display devices need to adapt to various screen mirroring protocols in order to achieve multi-channel screen mirroring, such as... Figure 5As shown, the display device includes application interaction for providing an interactive interface, unified management of multi-channel push, and separate management of URL push projection and mirror push projection; Application Programming Interface (API) for providing various types of interfaces, including unified projection management API, URL push projection API, and mirror push projection API, as well as other APIs. The URL push projection API includes DLNA URL adaptation and AirPlay URL adaptation; the mirror push projection API includes AirPlay mirror adaptation and Miracast mirror adaptation. Projection protocols include DLNA, AirPlay, and Miracast; transport protocols include Hypertext Transfer Protocol (HTTP), Simple Service Discovery Protocol (SSDP), Real-time Transport Protocol (RTP), Multicast Domain Name System (DNS), Real-Time Stream Protocol (RTSP), Transmission Control Protocol (TCP), and User Datagram Protocol (UDP). Protocol (UDP); transmission networks include: wired, WiFi, Bluetooth, and P2P. DLNA and AirPlay screen mirroring correspond to URL push screen mirroring, while Miracast screen mirroring corresponds to mirror push screen mirroring.

[0063] 102. Determine the multi-frequency, multi-connection screen mirroring mode based on the screen mirroring protocol corresponding to each screen mirroring request.

[0064] It is understandable that the multi-frequency multi-connection screen casting mode includes at least two screen casting methods. Taking screen casting methods such as DLNA screen casting, AirPlay screen casting, or Miracast screen casting as an example, the multi-frequency multi-connection screen casting mode includes: dual WLAN mode (such as DLNA screen casting and AirPlay screen casting), WLAN and P2P mode (such as DLNA screen casting and Miracast screen casting, AirPlay screen casting and Miracast screen casting), and dual WLAN and P2P mode (such as DLNA screen casting, AirPlay screen casting, and Miracast screen casting).

[0065] 103. Confirm that the WiFi module of the wireless network has loaded the target driver corresponding to the multi-frequency multi-connection screen projection mode.

[0066] Specifically, it is determined that the WiFi module of the wireless network has loaded the target driver corresponding to the multi-frequency multi-connection screen projection mode, so that the multiple interfaces corresponding to the target driver can work normally, and each interface corresponds to a communication frequency band.

[0067] It is understandable that the purpose of loading the target driver is to enable the WiFi module to receive screen projection data from different communication frequency bands.

[0068] For example, such as Figure 6 As shown, this is the interface provided by a traditional WiFi module. This interface corresponds to a communication frequency band. Screen projection data sent by multiple projection terminals is received through this communication frequency band. If the network environment of this communication frequency band is unstable, the projection data received by the projection receiver will be incomplete, resulting in problems such as stuttering and screen distortion during display. Figure 7 As shown, these are the interfaces provided by the WiFi module of this application. Each interface corresponds to a communication frequency band. If both the first and second interfaces receive screen projection data via a local area network (LAN), the screen projection sending end sends the screen projection data to the screen projection receiving end through a router. Since both communication frequency bands of the WiFi module can receive the screen projection data, even if the network environment of one communication frequency band is unstable, the screen projection receiving end can still receive the complete screen projection data through the other communication frequency band, avoiding problems such as lag and screen distortion. If the first interface receives screen projection data via a LAN and the second interface receives screen projection data via P2P, since the communication frequency bands for receiving screen projection data are different, they do not interfere with each other, avoiding channel congestion and thus making the transmission efficiency of screen projection data higher. Figure 8 As shown, this is another WiFi module provided to the outside world, including a first interface, a second interface and a third interface.

[0069] 104. Receive screen projection data corresponding to multiple screen projection requests through various communication frequency bands corresponding to multiple interfaces.

[0070] It's understandable that if multiple screen mirroring requests involve screen mirroring protocols based on a local area network (LAN), such as DLNA and AirPlay, a dual-band router will forward the received screen mirroring data to the receiving end via the first communication band and simultaneously forward it to the receiving end via the second communication band. If multiple screen mirroring requests involve screen mirroring protocols that include both LAN-based and P2P-based methods, such as a combination of DLNA or AirPlay with Miracast, the router will forward the received screen mirroring data to the receiving end via the first communication band (LAN-based), while the receiving end directly receives the screen mirroring data from the sending end via the second communication band (P2P).

[0071] 105. Display the screen projection data corresponding to multiple screen projection requests in a split-screen format.

[0072] It can be understood that multiple screen-sharing requests are displayed in a split-screen manner, with each request corresponding to a screen-sharing sender and each sender corresponding to a display area. For example, if two screen-sharing requests are sent by the first and second senders respectively, the receiving end will display the received data from the first sender in the first area of ​​the display and the received data from the second sender in the second area. Specifically, the first and second areas correspond to the left and right halves of the display, or the top and bottom halves. This application does not specifically limit the area for split-screen display.

[0073] For example, taking the screen mirroring receiver of this application as an example, which includes an application layer, a framework layer, and a driver layer, the three layers work together to achieve the goal of optimizing the screen mirroring effect. The application layer, as the entry point, can distinguish between two different scenarios. The framework layer, as the middle layer, is responsible for connecting the upper layer input and coordinating the lower layer logic. The driver layer is responsible for providing a coexistence mode corresponding to multiple screen mirroring methods, maximizing the use of radio frequency resources without increasing hardware costs. Specifically, the screen mirroring application in the application layer sets attribute values ​​for different multi-frequency multi-connection screen mirroring modes (e.g., setting the attribute value to 0 for dual WLAN mode, setting the attribute value to 1 for WLAN and P2P mode, and setting the attribute value to 1 for dual WLAN and P2P mode). The framework layer reads the attribute values ​​and determines the corresponding target driver based on the attribute values. The driver layer loads the target driver (if other drivers already exist, they are uninstalled first, and then the target driver is loaded). After the target driver is successfully loaded, the system service is notified. Based on the target driver, the framework layer connects to the WiFi of each communication frequency band or establishes a connection (P2P connection) with the corresponding screen mirroring sender. The WiFi connected to the frame layer can be a previously connected WiFi network in the screen mirroring receiver. If a WiFi network on a certain communication frequency band does not exist in the previously connected WiFi network, a prompt message can be displayed to prompt the user to connect manually.

[0074] In this embodiment, in response to multiple received screen mirroring requests, the screen mirroring protocol corresponding to each screen mirroring request is determined; based on the screen mirroring protocol corresponding to each screen mirroring request, a multi-frequency multi-connection screen mirroring mode is determined; it is determined that the wireless network WiFi module has loaded the target driver corresponding to the multi-frequency multi-connection screen mirroring mode, so that the multiple interfaces corresponding to the target driver can work normally, and each interface corresponds to a communication frequency band; screen mirroring data corresponding to multiple screen mirroring requests is received through the various communication frequency bands corresponding to the multiple interfaces; and the screen mirroring data corresponding to multiple screen mirroring requests is displayed in a split-screen manner. Thus, for the screen mirroring receiver, based on the existing WiFi module, multiple interfaces are driven to work through the target driver. Each interface corresponds to a different communication frequency band. For multiple screen mirroring requests based on the local area network, screen mirroring data can be received simultaneously through multiple communication frequency bands. As long as the signal strength of any communication frequency band is good, screen mirroring data will not be lost, avoiding the problems of stuttering or screen distortion during screen mirroring. For multiple screen mirroring requests based on the local area network and P2P, screen mirroring data from the local area network can be received through one communication frequency band, and screen mirroring data from the P2P communication frequency band can be received through another communication frequency band. The two frequency bands do not interfere with each other, avoiding channel congestion, thereby making the transmission efficiency of screen mirroring data higher. Moreover, this solution does not add a WiFi module, resulting in lower cost.

[0075] In some embodiments of this application, such as Figure 9 As shown, multiple screen projection requests include multiple WLAN screen projection requests, multi-frequency multi-connection screen projection mode includes multiple WLAN screen projection, and the communication frequency bands corresponding to multiple interfaces include the first WiFi frequency band and the second WiFi frequency band; the above step 104 can be implemented through the following step 104a.

[0076] 104a. Receive screen projection data corresponding to multiple WLAN screen projection requests via the first WiFi band and the second WiFi band.

[0077] It is understandable that multiple screen mirroring requests include multiple WLAN screen mirroring requests, that is, multiple screen mirroring requests include multiple screen mirroring requests based on local area networks. For example, multiple screen mirroring requests may include screen mirroring protocols such as DLNA and AirPlay.

[0078] It is understood that the communication frequency bands of the first WiFi band and the second WiFi band are different. For example, the first WiFi band is a 2.4GHz WiFi band, and the second WiFi band is a 5GHz WiFi band. This application does not limit the specific communication frequency bands of the first WiFi band and the second WiFi band.

[0079] For example, the screen mirroring receiver connects to a first WiFi network operating on the 2.4GHz WiFi band and a second WiFi network operating on the 5GHz WiFi band. The first and second screen mirroring transmitters connect to the first and / or second WiFi networks. The first screen mirroring transmitter sends first screen mirroring data to the screen mirroring receiver via a dual-band router (supporting both 2.4GHz and 5GHz WiFi bands). The screen mirroring receiver simultaneously receives the first screen mirroring data via both the first and second WiFi networks. Combining the screen mirroring data received simultaneously by the first and second WiFi networks, the receiver obtains complete first screen mirroring data and displays it. In this way, complete screen mirroring data can be obtained even with a strong WiFi signal, resulting in a smoother screen mirroring display.

[0080] In this embodiment, multiple screen mirroring requests include multiple WLAN screen mirroring requests, and the multi-frequency, multi-connection screen mirroring mode includes multiple WLAN screen mirroring. The communication frequency bands corresponding to the multiple interfaces include a first WiFi frequency band and a second WiFi frequency band. Receiving screen mirroring data corresponding to multiple screen mirroring requests through the communication frequency bands corresponding to the multiple interfaces includes receiving screen mirroring data corresponding to multiple WLAN screen mirroring requests through the first WiFi frequency band and the second WiFi frequency band. Receiving screen mirroring data through different WiFi frequency bands ensures that more complete screen mirroring data is received, thereby avoiding stuttering or screen distortion during screen mirroring.

[0081] In some embodiments of this application, such as Figure 10 As shown, multiple screen projection requests also include P2P screen projection requests, multi-frequency multi-connection screen projection mode also includes P2P screen projection, and the communication frequency bands corresponding to multiple interfaces also include P2P frequency bands; the above step 104 specifically includes the following step 104b.

[0082] 104b. Receive the screen projection data corresponding to the P2P screen projection request via the P2P frequency band.

[0083] It is understandable that multiple screen casting requests include P2P screen casting requests, meaning that at least one P2P screen casting request is included among the multiple screen casting requests. For example, multiple screen casting requests may include screen casting protocols such as Miracast.

[0084] It is understandable that screen mirroring requests based on local area networks receive screen mirroring data through the first WiFi band and the second WiFi band, while screen mirroring requests based on P2P receive screen mirroring data through the P2P band. Receiving screen mirroring data through different channels does not affect each other, resulting in higher transmission efficiency of screen mirroring data and smoother display of the screen mirroring screen.

[0085] It is understandable that using WiFi and P2P simultaneously in a WiFi module can lead to channel switching issues, which incur significant resource overhead. Existing technologies employ Single-Channel Concurrency (SCC) at the underlying layer to prevent channel switching, meaning data transmitted via WiFi and P2P runs on the same channel. However, this can cause channel congestion. In this application, to simultaneously use WiFi and P2P while reducing the resource overhead from channel switching, Multi-Channel Concurrency (MCC) is used at the underlying layer. This reduces the resource overhead from channel switching and also solves the channel congestion problem.

[0086] In this embodiment, the multiple screen mirroring requests also include P2P screen mirroring requests, the multi-frequency multi-connection screen mirroring mode also includes P2P screen mirroring, and the communication frequency bands corresponding to the multiple interfaces also include P2P frequency bands. Receiving screen mirroring data corresponding to multiple screen mirroring requests through the communication frequency bands corresponding to the multiple interfaces further includes: receiving screen mirroring data corresponding to P2P screen mirroring requests through the P2P frequency band. Receiving screen mirroring data corresponding to multiple WLAN screen mirroring requests through the first WiFi frequency band and the second WiFi frequency band, and receiving screen mirroring data corresponding to P2P screen mirroring requests through the P2P frequency band, ensures that the received screen mirroring data corresponding to multiple WLAN screen mirroring requests is more complete, without stuttering or screen tearing, and also prevents channel congestion when receiving screen mirroring data corresponding to P2P screen mirroring requests, resulting in higher screen mirroring efficiency and smoother displayed screen mirroring.

[0087] In some embodiments of this application, such as Figure 11 As shown, step 104a can be implemented through steps 104c to 104e, and step 105 can be implemented through step 105a.

[0088] 104c. Receive the first screen projection data corresponding to the target screen projection request through the first WiFi frequency band.

[0089] 104d. Receive the second screen projection data corresponding to the target screen projection request through the second WiFi frequency band.

[0090] The target screen mirroring request can be any one of the multiple WLAN screen mirroring requests.

[0091] 104e. Based on the first projection data and the second projection data, determine the target projection data.

[0092] 105a. Display the target screen projection data in the area corresponding to the target screen projection request.

[0093] It is understandable that the first and second screen-sharing data are sent by the same screen-sharing sender. The first and second screen-sharing data may be the same or different. For example, if the signal strength of both the first and second WiFi bands is good, and complete screen-sharing data can be received, then the first and second screen-sharing data are the same, and the target screen-sharing data is either the first or the second screen-sharing data. Alternatively, if the signal strength of the first WiFi band is good, but the signal strength of the second WiFi band is poor, the first screen-sharing data is a complete frame, while the second screen-sharing data is a portion of the first screen-sharing data; in this case, the target screen-sharing data is the first screen-sharing data. (The signal strength of the second WiFi band is good, but the signal strength of the first WiFi band is poor, for the same reason); if the signal strength of both the first and second WiFi bands is poor, then the first and second screen projection data are incomplete, and may be the same or different. In this case, the first and second screen projection data are merged to obtain the target screen projection data. The target screen projection data includes the data that is repeated in the first and second screen projection data as well as the data that is not repeated in the first and second screen projection data (e.g., if the first screen projection data is 12589 and the second screen projection data is 1345679, then the target screen projection data is 123456789).

[0094] In this embodiment, receiving screen projection data corresponding to multiple WLAN screen projection requests via a first WiFi band and a second WiFi band includes: receiving first screen projection data corresponding to a target screen projection request via the first WiFi band; receiving second screen projection data corresponding to the target screen projection request via the second WiFi band, where the target screen projection request is any one of the multiple WLAN screen projection requests; determining the target screen projection data based on the first and second screen projection data; and displaying the screen projection data corresponding to multiple screen projection requests in a split-screen manner, including displaying the target screen projection data in the area corresponding to the target screen projection request. The target screen projection data obtained based on the received first and second screen projection data ensures that the target screen projection data is as complete as possible, reducing stuttering or screen distortion issues caused by incomplete screen projection data during the screen projection process.

[0095] In some embodiments of this application, such as Figure 12 As shown, step 104e above can be implemented through steps 104e1 and 104e2 as described below.

[0096] 104e1. If the signal strength of the first WiFi band is greater than or equal to the signal strength of the second WiFi band, the first screen projection data is determined as the target screen projection data.

[0097] 104e2. If the signal strength of the first WiFi band is less than that of the second WiFi band, the second projection data is determined as the target projection data.

[0098] It is understandable that the frequency band with better signal strength receives more complete screen projection data. Therefore, the target screen projection data is the more complete screen projection data received.

[0099] In this embodiment, determining the target projection data based on the first projection data and the second projection data includes: determining the first projection data as the target projection data when the signal strength of the first WiFi band is greater than or equal to the signal strength of the second WiFi band; and determining the second projection data as the target projection data when the signal strength of the first WiFi band is less than the signal strength of the second WiFi band. Determining the data received from the frequency band with better signal strength as the target projection data can reduce stuttering or screen flickering issues caused by incomplete projection data during the projection process.

[0100] In some embodiments of this application, such as Figure 13 As shown, step 104e above can also be implemented through step 104e3 below.

[0101] 104e3. Combine the target data with the second projection data to obtain the target projection data.

[0102] The target data is the data in the first projection data excluding duplicate data, and the duplicate data is the same data in the first projection data and the second projection data.

[0103] It is understandable that when both the first and second screen projection data are incomplete, the target screen projection data is obtained by integrating duplicate and non-duplicate data from the first and second screen projection data (e.g., if the first screen projection data is 12589 and the second screen projection data is 1345679, then the target screen projection data is 123456789).

[0104] In this embodiment, determining the target projection data based on the first projection data and the second projection data includes: synthesizing the target data and the second projection data to obtain the target projection data. The target data is the data in the first projection data excluding duplicate data, and the duplicate data is the same data in both the first and second projection data. Synthesizing the first and second projection data makes the target projection data more complete, thereby reducing stuttering or screen flickering issues caused by incomplete projection data during the projection process.

[0105] In some embodiments of this application, such as Figure 14As shown, multiple screen projection requests include WLAN screen projection requests and P2P screen projection requests; multi-frequency multi-connection screen projection modes include WLAN screen projection and P2P screen projection; and the communication frequency bands corresponding to multiple interfaces include the target WiFi frequency band and the P2P frequency band. The above step 104 can be implemented through the following steps 104f and 104g.

[0106] 104f. Receive the screen mirroring data corresponding to the WLAN screen mirroring request via the target WiFi frequency band.

[0107] 104g, via the P2P band, receives screen casting data corresponding to P2P screen casting requests.

[0108] It is understood that the target WiFi frequency band and the P2P frequency band are different. For example, the target WiFi frequency band is the 2.4GHz WiFi frequency band, and the P2P frequency band is the 5GHz P2P frequency band. This application does not limit the specific communication frequency band of the target WiFi frequency band and the P2P frequency band.

[0109] In this embodiment, multiple screen mirroring requests include WLAN screen mirroring requests and P2P screen mirroring requests. The multi-frequency, multi-connection screen mirroring mode includes WLAN screen mirroring and P2P screen mirroring. The communication frequency bands corresponding to the multiple interfaces include the target WiFi frequency band and the P2P frequency band. Screen mirroring data corresponding to multiple screen mirroring requests is received through the communication frequency bands corresponding to the multiple interfaces, including: receiving screen mirroring data corresponding to WLAN screen mirroring requests through the target WiFi frequency band; and receiving screen mirroring data corresponding to P2P screen mirroring requests through the P2P frequency band. Receiving screen mirroring data corresponding to WLAN screen mirroring requests and P2P screen mirroring requests through different frequency bands does not interfere with each other, avoiding channel congestion, resulting in higher transmission efficiency of screen mirroring data and smoother displayed screen mirroring.

[0110] In some embodiments of this application, such as Figure 15 As shown, step 103 above can also be implemented through steps 103a and 103b below.

[0111] 103a. If the currently loaded driver is different from the target driver, uninstall the current driver and then load the target driver.

[0112] 103b. If the current driver and the target driver are the same, determine that the current driver is the target driver.

[0113] It is understood that when the screen mirroring receiver is powered on, it can load a driver corresponding to a multi-frequency multi-connection mode, such as the driver that was last used or the driver that was set by default. The specific implementation of this application does not limit this.

[0114] In this embodiment, determining that the WiFi module has loaded the target driver corresponding to the multi-frequency multi-connection screen mirroring mode includes: if the currently loaded driver is different from the target driver, unloading the current driver and then loading the target driver; if the current driver and the target driver are the same, determining that the current driver is the target driver. Preloading the driver, if the current driver and the target driver are the same, can reduce the screen mirroring process time and improve screen mirroring efficiency.

[0115] Figure 16 This is a structural block diagram of a multi-channel projection device shown in an embodiment of this application, such as... Figure 16 As shown, the system includes: a determining module 1601, used to determine the screen projection protocol corresponding to each received screen projection request in response to multiple screen projection requests; the determining module 1601 is also used to determine a multi-frequency multi-connection screen projection mode based on the screen projection protocol corresponding to each screen projection request; the determining module 1601 is also used to determine that the wireless network WiFi module has loaded the target driver corresponding to the multi-frequency multi-connection screen projection mode, so that the multiple interfaces corresponding to the target driver can work normally, and each interface corresponds to a communication frequency band; a receiving module 1602, used to receive screen projection data corresponding to multiple screen projection requests through the various communication frequency bands corresponding to the multiple interfaces; and a display module 1603, used to display the screen projection data corresponding to multiple screen projection requests in a split-screen format.

[0116] In some embodiments of this application, multiple screen projection requests include multiple wireless local area network (WLAN) screen projection requests, multi-frequency multi-connection screen projection mode includes multiple WLAN screen projection, and the communication frequency bands corresponding to multiple interfaces include a first WiFi frequency band and a second WiFi frequency band; the receiving module 1602 is specifically used to receive screen projection data corresponding to multiple WLAN screen projection requests through the first WiFi frequency band and the second WiFi frequency band.

[0117] In some embodiments of this application, multiple screen projection requests also include point-to-point (P2P) screen projection requests, multi-frequency multi-connection screen projection mode also includes P2P screen projection, and the communication frequency bands corresponding to multiple interfaces also include P2P frequency bands; the receiving module 1602 is specifically used to receive screen projection data corresponding to the P2P screen projection request through the P2P frequency band.

[0118] In some embodiments of this application, the receiving module 1602 is specifically used to receive first screen projection data corresponding to the target screen projection request via a first WiFi frequency band; receive second screen projection data corresponding to the target screen projection request via a second WiFi frequency band, wherein the target screen projection request is any one of multiple WLAN screen projection requests; and determine the target screen projection data based on the first screen projection data and the second screen projection data; the display module 1603 is specifically used to display the target screen projection data in the area corresponding to the target screen projection request.

[0119] In some embodiments of this application, the determining module 1601 is specifically used to determine the first projection data as the target projection data when the signal strength of the first WiFi band is greater than or equal to the signal strength of the second WiFi band; and to determine the second projection data as the target projection data when the signal strength of the first WiFi band is less than the signal strength of the second WiFi band.

[0120] In some embodiments of this application, the determining module 1601 is specifically used to synthesize the target data and the second projection data to obtain the target projection data. The target data is the data in the first projection data excluding the duplicate data, and the duplicate data is the same data in the first projection data and the second projection data.

[0121] In some embodiments of this application, multiple screen projection requests include WLAN screen projection requests and P2P screen projection requests; multi-frequency multi-connection screen projection modes include WLAN screen projection and P2P screen projection; and the communication frequency bands corresponding to multiple interfaces include the target WiFi frequency band and the P2P frequency band. The receiving module 1602 is specifically used to receive screen projection data corresponding to the WLAN screen projection request via the target WiFi frequency band and to receive screen projection data corresponding to the P2P screen projection request via the P2P frequency band.

[0122] In some embodiments of this application, the determining module 1601 is specifically used to unload the current driver and load the target driver when the loaded current driver is different from the target driver; and to determine the current driver as the target driver when the current driver and the target driver are the same.

[0123] It should be noted that the aforementioned multi-channel projection device can be the display device in the above method embodiment of this application, or it can be a functional module and / or functional entity in the display device that can realize the function of the device embodiment. This application embodiment does not limit it.

[0124] In this embodiment, each module can implement the multi-channel projection method provided in the above method embodiments and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0125] like Figure 17 As shown, this application embodiment also provides a display device, which may include: a processor 1701, a memory 1702, and a program or instructions stored in the memory 1702 and executable on the processor 1701. When the program or instructions are executed by the processor 1701, they can implement the various processes of the multi-channel projection method provided in the above method embodiment and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0126] The present invention also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the various processes of the above-described multi-channel screen projection method and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0127] The computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.

[0128] The present invention provides a computer program product, comprising: when the computer program product is run on a computer, causing the computer to implement the above-described multi-screen projection method.

[0129] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0130] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are intended to better explain the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A multi-channel screen projection method, characterized in that, include: In response to multiple received screen mirroring requests, determine the screen mirroring protocol corresponding to each screen mirroring request; Based on the screen projection protocol corresponding to each screen projection request, a multi-frequency multi-connection screen projection mode is determined. A wireless network WiFi module is determined to have loaded the target driver corresponding to the multi-frequency multi-connection screen projection mode, so that the multiple interfaces corresponding to the target driver can work normally. Each interface corresponds to a communication frequency band, and the multiple interfaces are on the wireless network WiFi module. Through the various communication frequency bands corresponding to the multiple interfaces, the screen projection data corresponding to the multiple screen projection requests is received, and each communication frequency band is used to receive screen projection data corresponding to one screen projection request. The screen projection data corresponding to the multiple screen projection requests will be displayed in a split-screen format.

2. The method according to claim 1, characterized in that, The multiple screen projection requests include multiple wireless LAN screen projection requests, the multi-frequency multi-connection screen projection mode includes multiple LAN screen projection, and the communication frequency bands corresponding to the multiple interfaces include the first WiFi frequency band and the second WiFi frequency band. Receiving screen projection data corresponding to the multiple screen projection requests through the various communication frequency bands corresponding to the multiple interfaces includes: The system receives screen projection data corresponding to the multi-WLAN screen projection request via the first WiFi frequency band and the second WiFi frequency band.

3. The method according to claim 2, characterized in that, The multiple screen projection requests also include peer-to-peer (P2P) screen projection requests; the multi-frequency, multi-connection screen projection mode also includes P2P screen projection; and the communication frequency bands corresponding to the multiple interfaces also include P2P frequency bands. Receiving the screen projection data corresponding to the multiple screen projection requests through the communication frequency bands corresponding to the multiple interfaces further includes: The screen projection data corresponding to the P2P screen projection request is received via the P2P frequency band.

4. The method according to claim 2, characterized in that, The step of receiving screen projection data corresponding to the multi-WLAN screen projection request through the first WiFi frequency band and the second WiFi frequency band includes: Receive the first screen projection data corresponding to the target screen projection request through the first WiFi frequency band; The second screen projection data corresponding to the target screen projection request is received through the second WiFi frequency band, wherein the target screen projection request is any one of the multiple WLAN screen projection requests; Based on the first projection data and the second projection data, the target projection data is determined; The step of displaying the projection data corresponding to the multiple projection requests in a split-screen manner includes: The target screen projection data is displayed in the area corresponding to the target screen projection request.

5. The method according to claim 4, characterized in that, The step of determining the target projection data based on the first projection data and the second projection data includes: If the signal strength of the first WiFi band is greater than or equal to the signal strength of the second WiFi band, the first screen projection data is determined as the target screen projection data; If the signal strength of the first WiFi band is less than that of the second WiFi band, the second projection data is determined as the target projection data.

6. The method according to claim 4, characterized in that, The step of determining the target projection data based on the first projection data and the second projection data includes: The target data is synthesized with the second projection data to obtain the target projection data. The target data is the data in the first projection data excluding duplicate data. The duplicate data is the same data in both the first projection data and the second projection data.

7. The method according to claim 1, characterized in that, The multiple screen projection requests include WLAN screen projection requests and P2P screen projection requests; the multi-frequency multi-connection screen projection mode includes WLAN screen projection and P2P screen projection; and the communication frequency bands corresponding to the multiple interfaces include the target WiFi frequency band and the P2P frequency band. Receiving screen projection data corresponding to the multiple screen projection requests through the various communication frequency bands corresponding to the multiple interfaces includes: Receive the screen projection data corresponding to the WLAN screen projection request through the target WiFi frequency band; The screen projection data corresponding to the P2P screen projection request is received via the P2P frequency band.

8. The method according to any one of claims 1 to 7, characterized in that, The step of determining that a wireless network WiFi module has loaded the target driver corresponding to the multi-frequency multi-connection screen projection mode includes: If the currently loaded driver is different from the target driver, the current driver is uninstalled and then the target driver is loaded. If the current driver is the same as the target driver, then the current driver is determined to be the target driver.

9. A multi-channel projection device, characterized in that, include: The determination module is used to respond to multiple received screen projection requests and determine the screen projection protocol corresponding to each screen projection request. The determining module is also used to determine the multi-frequency multi-connection screen projection mode based on the screen projection protocol corresponding to each screen projection request; The determining module is also used to determine that a wireless network WiFi module has loaded the target driver corresponding to the multi-frequency multi-connection screen projection mode, so that the multiple interfaces corresponding to the target driver can work normally, each interface corresponds to a communication frequency band, and the multiple interfaces are on the wireless network WiFi module; The receiving module is used to receive the screen projection data corresponding to the multiple screen projection requests through the various communication frequency bands corresponding to the multiple interfaces. Each communication frequency band is used to receive the screen projection data corresponding to one screen projection request. The display module is used to display the projection data corresponding to the multiple projection requests in a split-screen manner.

10. A display device, characterized in that, It includes a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the multi-screen projection method as described in any one of claims 1 to 8.

Images