Display device, external device, terminal device and screen projection display method

Abstract

The embodiment of the invention provides a display device, an external device, a terminal device and a screen projection display method. The method can receive screen projection data sent by the terminal device based on a second network node. Wherein the second network node is used for establishing wireless communication connection with the terminal equipment, and the screen projection data comprises an internet protocol address of the terminal equipment. And forwarding the screen projection data to a first network node according to a target routing rule of the second network node, wherein the first network node is used for sharing a network with external equipment. And receiving the screen projection data through the first network node, so that a second controller of the external equipment receives the screen projection data based on the first network node, and controls a display to display a screen projection picture of the screen projection data through the second controller. According to the method, the display device and the external device share the hotspot function of the wireless network through the routing rule of the first network node and the second network node, the external device does not need to be repeatedly accessed to a network connecting line, and the complexity of executing hotspot screen projection by the display device is reduced.

Description

Technical Field

[0001] This application relates to the technical field of display devices, and in particular, to a display device, an external device, a terminal device, and a screen mirroring display method. Background Art

[0002] A display device is an intelligent device that can present a user interface and support user interaction. Taking a smart TV as an example, a smart TV is a TV product based on Internet application technology, with an open operating system and a chip, an open application platform, and can realize two-way human-computer interaction functions, integrating various functions such as audio and video, entertainment, and data, to meet the diverse and personalized needs of users.

[0003] The display device can support multiple systems, that is, multiple systems can be installed on the display device to form a multi-system. For example, an OPS (Open Pluggable Specification) device with a built-in Windows system can be externally connected to the display screen of an Android system to form a dual-system display device. To adapt to application scenarios such as office work, meetings, or teaching, the display device can display the screen image of other terminal devices through projection or wired connection. However, the resolution of the above projection method is limited, and problems such as blurred text and images are likely to occur in the display device; while the wired connection method is limited by the connection cable, and problems such as the cable not corresponding to the interface are likely to occur.

[0004] Therefore, to improve the above problems, some display devices also adopt the method of hotspot screen mirroring, that is, the display device enables the hotspot function, and the terminal device transmits the audio and video data of the screen image by connecting to the hotspot of the display device. However, when multiple systems are installed in the display device, when performing hotspot screen mirroring through different systems, it is necessary to separately connect a network connection cable for connecting to the Internet to the hardware module corresponding to the system, and the system without the network connection cable cannot start the hotspot function. For example, when the display screen of the Android system is connected to a network connection cable and the OPS device with a built-in Windows system is not connected to a network connection cable, the OPS device cannot start the hotspot function, resulting in an increase in the complexity of hotspot screen mirroring and a reduction in user experience. Summary of the Invention

[0005] This application provides a display device, an external device, a terminal device, and a screen mirroring display method to solve the problem of high complexity when a multi-system display device performs hotspot screen mirroring.

[0006] In a first aspect, some embodiments of the present application provide a display device, including a display, a communicator, a first controller, and a device interface. Among them, the display is configured to display a screen mirroring image of screen mirroring data; the communicator includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with an external device; the communicator is configured to establish a wireless communication connection with a terminal device based on a second network node; when the communicator establishes a wireless communication connection with the terminal device, the second network node is further used to receive the screen mirroring data sent by the terminal device; the first controller is used to run a first system; the device interface is configured to connect to the external device, and the external device includes a second controller, and the second controller is used to run a second system;

[0007] The first controller is further configured to execute the following program steps:

[0008] Receive the screen mirroring data sent by the terminal device based on the second network node, where the screen mirroring data includes the Internet Protocol address of the terminal device;

[0009] Forward the screen mirroring data to the first network node according to the target routing rule of the second network node, where the target routing rule is used to represent the routing from the first network node to the second network node;

[0010] Receive the screen mirroring data through the first network node, so that the second controller receives the screen mirroring data based on the first network node and controls the display to display the screen mirroring image of the screen mirroring data.

[0011] In a second aspect, some embodiments of the present application further provide an external device, including a device interface and a second controller. Among them, the device interface is configured to connect to a display device, and the display device includes a display, a communicator, and a first controller; the display is configured to display a screen mirroring image of screen mirroring data; the communicator includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with an external device; the communicator is configured to establish a wireless communication connection with a terminal device based on a second network node; when the communicator establishes a wireless communication connection with the terminal device, the second network node is further used to receive the screen mirroring data sent by the terminal device; the first controller is used to run a first system;

[0012] The second controller is used to run a second system, and the second controller is configured to execute the following program steps:

[0013] Receive the screen mirroring data sent by the terminal device based on the target routing rule; the target routing rule is used to characterize the route from the first network node to the second network node, and the screen mirroring data includes the Internet Protocol address of the terminal device;

[0014] Parse the Internet Protocol address of the screen mirroring data;

[0015] Control the display to display the screen mirroring picture of the screen mirroring data according to the Internet Protocol address.

[0016] In a third aspect, some embodiments of the present application further provide a terminal device, including a display module, a communication module, and a control module. Among them, the display module is configured to display a terminal screen; the communication module is configured to establish a wireless communication connection with a display device; the display device includes a display, a communicator, a device interface, and a first controller; the display is configured to display the screen mirroring picture of the screen mirroring data; the communicator includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with an external device; the communication module establishes a wireless communication connection with the display device based on the second network node of the communicator; the first controller is used to run a first system; the device interface is configured to connect to an external device, and the external device includes a second controller, and the second controller is used to run a second system;

[0017] The control module is configured to execute the following program steps:

[0018] In response to a connection event of establishing a wireless communication connection with the display device, record the terminal screen displayed by the display module based on a screen mirroring application to generate recorded data; the screen mirroring application is an application applicable to the second system;

[0019] Perform encoding on the recorded data based on the screen mirroring application to generate screen mirroring data;

[0020] Send the screen mirroring data to the second network node through the communication module, and the screen mirroring data includes the Internet Protocol address of the terminal device.

[0021] Fourth aspect, some embodiments of the present application further provide a screen mirroring display method, which is applied to the display device provided in the first aspect. The display device includes a display, a communicator, a device interface, and a first controller. Among them, the display is configured to display a screen mirroring image of screen mirroring data; the communicator includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with an external device; the communicator is configured to establish a wireless communication connection with a terminal device based on a second network node; when the communicator establishes a wireless communication connection with the terminal device, the second network node is further used to receive the screen mirroring data sent by the terminal device; the first controller is used to run a first system; the device interface is configured to connect to an external device, and the external device includes a second controller, and the second controller is used to run a second system; the method includes:

[0022] Receiving the screen mirroring data sent by the terminal device based on the second network node, where the screen mirroring data includes the Internet Protocol address of the terminal device;

[0023] Forwarding the screen mirroring data to the first network node according to the target routing rule of the second network node, where the target routing rule is used to represent the routing from the first network node to the second network node;

[0024] Receiving the screen mirroring data through the first network node, so that the second controller receives the screen mirroring data based on the first network node and controls the display to display the screen mirroring image of the screen mirroring data.

[0025] As can be seen from the above technical solutions, the display device, external device, terminal device, and screen mirroring display method provided by some embodiments of the present application, the method can receive the screen mirroring data sent by the terminal device based on the second network node. Among them, the second network node is used to establish a wireless communication connection with the terminal device, and the screen mirroring data includes the Internet Protocol address of the terminal device. Then, the screen mirroring data is forwarded to the first network node according to the target routing rule of the second network node, and the target routing rule is used to represent the routing from the first network node to the second network node, and the first network node is used to share the network with the external device. The screen mirroring data is received through the first network node, so that the second controller of the external device receives the screen mirroring data based on the first network node, and the second controller controls the display to display the screen mirroring image of the screen mirroring data. The method enables the display device and the external device to share the hotspot function of the wireless network through the routing rules of the first network node and the second network node, without the external device repeatedly connecting to the network connection line, which can reduce the complexity of hotspot screen mirroring and improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can also be obtained based on these drawings.

[0027] Figure 1 Schematic diagram of the usage scenario of a display device in some embodiments of the present application;

[0028] Figure 2 Hardware configuration block diagram of a display device provided in some embodiments of the present application;

[0029] Figure 3 Hardware configuration block diagram of a control device provided in some embodiments of the present application;

[0030] Figure 4 Schematic diagram of the software configuration in a display device provided in some embodiments of the present application;

[0031] Figure 5 Hardware structure diagram of a terminal device provided in some embodiments of the present application;

[0032] Figure 6 Effect schematic diagram of a network setting interface provided in some embodiments of the present application;

[0033] Figure 7 Connection architecture diagram of a display device and an external device provided in some embodiments of the present application;

[0034] Figure 8 Flow schematic diagram of a display device executing a screen mirroring display method provided in some embodiments of the present application;

[0035] Figure 9 Flow schematic diagram of the startup of an external device provided in some embodiments of the present application;

[0036] Figure 10 Flow schematic diagram of setting network node configuration provided in some embodiments of the present application;

[0037] Figure 11 Flow schematic diagram of an external device executing a screen mirroring display method provided in some embodiments of the present application;

[0038] Figure 12 Architecture diagram of multiple terminal devices connected to a display device provided in some embodiments of the present application;

[0039] Figure 13 Effect schematic diagram of split-screen provided in some embodiments of the present application;

[0040] Figure 14 Schematic diagram of the four-screen effect provided by some embodiments of the present application;

[0041] Figure 15 Schematic flow chart of the screen mirroring display method executed by a terminal device provided by some embodiments of the present application. Detailed implementation manners

[0042] The embodiments will be described in detail below, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0043] It should be noted that the brief description of the terms in the present application is only for facilitating the understanding of the following described implementation manners, rather than intending to limit the implementation manners of the present application. Unless otherwise specified, these terms should be understood in their ordinary and general meanings.

[0044] The terms "first", "second", "third", etc. in the specification, claims and the above-mentioned drawings of the present application are used to distinguish similar or homogeneous objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0045] The terms "including" and "having" and any variations thereof are intended to cover but not exclude inclusion. For example, a product or device including a series of components does not necessarily have to be limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices.

[0046] The term "module" refers to any known or later-developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or / and software code that can perform functions related to the element.

[0047] Figure 1 Schematic diagram of the operation scenario between a display device and a control device provided by some embodiments of the present application. As Figure 1 shown, the user can operate the display device 200 through touch operations, a mobile terminal 300 and a control device 100. Among them, the control device 100 can be a remote control, a stylus, etc.

[0048] In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and establish connection communication through network communication protocols to achieve one-to-one control operations and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.

[0049] As Figure 1 also shown in

[0050] The display device 200 can also provide an intelligent network TV function with computer support functions in addition to the broadcast receiving TV function, including but not limited to, network TV, smart TV, Internet Protocol TV (IPTV), etc.

[0051] Figure 2 For some embodiments of the present application Figure 1 is the hardware configuration block diagram of the display device 200 in

[0052] In some embodiments, the display device 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, a device interface 240, a first controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0053] In some embodiments, the detector 230 is used to collect signals from the external environment or interact with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0054] In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving image display, which is used to receive the image signal output from the controller, and components for displaying video content, image content, and menu manipulation interfaces, as well as user manipulation UI interfaces, etc.

[0055] In some embodiments, the communicator 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may set different chips in the communicator 220 according to different supported communication methods. For example, the communicator may include at least one of a WiFi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip, or other network communication protocol chips or a near-field communication protocol chip, and an infrared receiver.

[0056] The communicator 220 can enable the display device 200 to communicate with an external device or server 400 through a wireless or wired connection. Among them, the wired connection can connect the display device 200 to an external device through components such as a data cable and an interface. The wireless connection can connect the display device 200 to an external device through a wireless signal or a wireless network. The display device 200 can directly establish a connection relationship with an external device or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0057] In some embodiments, the display device 200 can also support establishing communication connection relationships with multiple external devices simultaneously. Multiple external devices can be the same. For example, the external device is a terminal device 500 such as a mobile phone, a tablet computer, or a laptop computer. The terminal device 500 can establish a communication connection with the display device 200 by accessing the wireless local area network where the display device 200 is located. Multiple external devices can also connect to the display device 200 through different types of connection methods. For example, terminal device A connects to the display device 200 through a wireless local area network; terminal device B connects to the display device 200 through Bluetooth.

[0058] To implement the communication connection between the display device 200 and the terminal device 500, communicators that support the same communication type are respectively provided on the display device 200 and the terminal device 500. For example, when the display device 200 is provided with a communicator 220 including a WiFi module, the terminal device 500 should also be provided with a communicator including a WiFi module. And while communicators of the same type are provided, data can also be transmitted between the display device 200 and the terminal device 500 through a specific communication transmission protocol. For example, a WiFi protocol, a Bluetooth connection protocol, a ZigBee protocol, an NFC protocol, etc.

[0059] In some embodiments, the device interface 240 may include but is not limited to the following: a high-definition multimedia interface (HDMI), an analog or data high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, or any one or more of these interfaces. It can also be a composite input / output interface formed by the above multiple interfaces.

[0060] For example, in order to enrich the display types of the display device 200, the HDMI interface can be connected to a device with video and audio input / output functions, and the corresponding audio / video output / input functions can be implemented through the HDMI driver in the hardware layer. The USB interface can be connected to a device with signal and data transmission functions and interactive functions, and based on the USB driver in the hardware layer, access signals, transmit data, and perform specific interactive actions.

[0061] In some embodiments, the first controller 250 includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input / output. The first controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The first controller 250 controls the overall operation of the display device 200.

[0062] In some embodiments, the first controller 250 and the tuner demodulator 210 can be located in different split devices, that is, the tuner demodulator 210 can also be in an external device of the main device where the first controller 250 is located, such as an external set-top box, etc.

[0063] In some embodiments, if a user enters a user command in the graphical user interface (GUI) displayed on the display 260, the user input interface receives the user input command through the graphical user interface (GUI).

[0064] In some embodiments, the user interface 280 is an interface that can be used to receive control inputs.

[0065] Figure 3 For some embodiments provided in this application Figure 1 The hardware configuration block diagram of the control device. As Figure 3 shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0066] The control device 100 is configured to control the display device 200, and can receive user input operation instructions, and convert the operation instructions into instructions recognizable and responsive by the display device 200, acting as an interaction intermediary between the user and the display device 200.

[0067] In some embodiments, the control device 100 can be an intelligent device. For example: The control device 100 can install various applications for controlling the display device 200 according to user needs.

[0068] In some embodiments, such as Figure 1As shown, after installing the application of the control and display device 200, the mobile terminal 300 or other intelligent electronic devices can perform functions similar to those of controlling device 100.

[0069] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the data processing functions between the external and internal.

[0070] Under the control of the controller 110, the communication interface 130 realizes the communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of other near-field communication modules such as a WiFi chip 131, a Bluetooth module 132, an NFC module 133, etc.

[0071] The user input / output interface 140, where the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, a key 144, and other input interfaces.

[0072] In some embodiments, the control device 100 includes at least one of the communication interface 130 and the input / output interface 140. The communication interface 130 configured in the control device 100, such as modules like WiFi, Bluetooth, NFC, etc., can encode the user input instructions through the Wi-Fi protocol, or the Bluetooth protocol, or the NFC protocol and send them to the display device 200.

[0073] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0074] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0075] Such as Figure 4 , in some embodiments, the system is divided into four layers, from top to bottom are the application layer (abbreviation "application layer"), the application framework layer (abbreviation "framework layer"), the Android runtime and system library layer (abbreviation "system runtime library layer"), and the kernel layer.

[0076] In some embodiments, at least one application runs in the application layer. These applications can be window programs, system setting programs, clock programs, etc. that come with the operating system; or they can be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0077] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that decides to make the applications in the application layer take actions. Applications can access the resources in the system and obtain the services of the system through the API interfaces during execution.

[0078] As Figure 4 shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc. Among them, the view system can design and implement the interfaces and interactions of applications. The view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: The activity manager is used to interact with all the activities running in the system; the location manager is used to provide access to the system location service for system services or applications; the package manager is used to retrieve various information related to the application packages currently installed on the device; the notification manager is used to control the display and clearing of notification messages; the window manager is used to manage the icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0079] In some embodiments, the activity manager is used to manage the life cycles of various applications and the general navigation back function, such as controlling the exit, opening, and backward movement of applications. The window manager is used to manage all window programs, such as obtaining the size of the display screen, determining whether there is a status bar, locking the screen, taking screenshots, and controlling the changes in the display window (such as shrinking the display window, jittering display, distorting display, etc.).

[0080] In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer. When the framework layer is used, the Android operating system will run the C / C++ libraries included in the system runtime layer to implement the functions that the framework layer needs to achieve.

[0081] In some embodiments, the kernel layer is the layer between hardware and software. As Figure 4 shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0082] After the above display device 200 establishes a communication connection relationship with the terminal device 500, it can establish a screen mirroring connection channel and transmit screen mirroring data based on the screen mirroring connection, so that the display device 200 can display the screen mirroring image of the terminal device 500. In some embodiments, in order to establish a screen mirroring connection relationship, the user can send a screen mirroring connection request through the terminal device 500 and send the screen mirroring connection request to the display device 200 through the WiFi network. The display device 200 then completes the transmission protocol configuration according to the screen mirroring connection request, thereby establishing a transmission channel for screen mirroring data with the terminal device 500.

[0083] As Figure 5 shown, in some embodiments, the terminal device 500 includes a display module 510, a communication module 520, and a control module 530. The display module 510 is used to receive input data information and generate signal inputs related to the user settings and function control of the terminal device 500. Specifically, the display module 510 can be a touch screen for collecting touch operations of the user on or near it, such as clicking buttons, dragging scroll boxes, etc.

[0084] The display unit 510 can also be used to display information input by the user or information provided to the user, as well as the graphical user interface (GUI) of various menus of the terminal device 500. Specifically, the display unit 510 can be configured in the form of a liquid crystal display, a light emitting diode, etc. The display unit 510 can be used to display various graphical user interfaces described in the present application.

[0085] The communication module 520 may include a Wi-Fi circuit 521, a Bluetooth circuit 522, and an RF circuit 523. The terminal device 500 can help users send and receive emails, browse the web, and access streaming media through the Wi-Fi circuit 521, which provides users with wireless broadband Internet access. The Bluetooth circuit 522 is used to interact with other Bluetooth devices with Bluetooth circuits through the Bluetooth protocol. For example, the terminal device 500 can establish a Bluetooth connection with a wearable electronic device (such as a smart watch) that also has a Bluetooth circuit to perform data interaction. The RF circuit 523 can be used for receiving and transmitting signals during information reception, sending, or calls. It can receive downlink data from the base station and hand it over to the control unit 530 for processing, and can send uplink data to the base station. Generally, the RF circuit includes, but is not limited to, devices such as antennas, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, and a duplexer.

[0086] The display device 200 can also establish a screen mirroring connection with the terminal device 500 through different connection methods. For example, the display device 200 can establish a screen mirroring connection with the terminal device 500 through the hotspot screen mirroring method, that is, the display device 200 creates a hotspot through its built-in WiFi chip, so that other terminal devices 500 can connect to this hotspot to share the terminal screen of the terminal device 500 on the display device 200 for display. Or, the display device 200 can also establish a screen mirroring connection with the terminal device through peer-to-peer (P2P) screen mirroring, such as the Digital Living Network Alliance (DLNA) protocol, the Miracast protocol, the Airplay protocol, etc. That is, the display device 200 can establish a peer-to-peer network with the terminal device 500 through its built-in Wi-Fi chip and share the terminal screen of the terminal device 500 on the display device for display based on the peer-to-peer network.

[0087] Obviously, other wired or wireless connection methods can also be adopted between the display device 200 and the terminal device 500 to establish a screen mirroring connection relationship, such as RF radio frequency connection, infrared connection, cellular network, and other connection methods that those skilled in the art can think of based on the connection methods provided in the above embodiments. It should be noted that the above screen mirroring connection relationship can not only obtain the video data stream in the terminal device 500, but also obtain the audio data stream in the terminal device 500, so that the video data and audio data can be synchronously sent to the display device 200, enabling the display device 200 to play video and audio synchronously.

[0088] To achieve hotspot screen mirroring, in some embodiments, after the display device 200 accesses the Internet, it can respond to the startup event of the hotspot function and create a network node for implementing the hotspot function based on the WiFi chip in the communicator 220, so as to establish a wireless communication connection with other terminal devices 500 through this network node. Exemplarily, the network node created by the communicator 220 for implementing the hotspot function is a wireless access point (Access Point, AP), and the terminal device 500 can access the AP created by the communicator 220 to form a local area network. In this local area network, the AP acts as the central node, responsible for managing network connections and data transmission; the terminal device 500 communicates with the AP through wireless signals to implement functions such as network connection, file transfer, and media sharing. Among them, the AP of the display device 200 can be connected to the terminal device 500 through different communication protocols (such as Wi-Fi, Bluetooth, etc.).

[0089] After the display device 200 creates and enables the AP, the terminal device 500 can search for and connect to the AP hotspot of the display device 200 based on the WI-FI circuit 521 or the Bluetooth circuit 522. For example, after the display device 200 accesses the Internet and enables the hotspot function, the terminal device 500 responds to the operation event of the user starting the network device interface and controls the display module 510 to display the network settings interface. At this time, the user can search for the AP hotspot of the display device 200 in the interface displayed by the display module 510, select the corresponding AP hotspot according to the hotspot name of the AP hotspot, and enter the network connection password to complete the wireless communication connection between the display device 200 and the terminal device 500. After the connection is successful, the terminal device 500 can access the network or perform data transmission with the display device 200 according to this AP hotspot.

[0090] In some embodiments, the startup event of the hotspot function can be generated based on user operations or automatically generated by the display device 200. For example, after the display device 200 starts up and automatically connects to the network, when the user opens the network settings interface of the display device 200, the display device 200 controls the display 260 to display a network settings interface as shown in Figure 6 the figure. The network settings interface includes a startup control 501 for the hotspot function. The display device 200 can respond to the user's click operation on the startup control 501 and create and enable a wireless access point AP based on the communicator 220. For another example, after the display device 200 starts up and automatically connects to the network, it directly creates and enables a wireless access point AP based on the communicator 220 so that the display device 200 can provide the hotspot function.

[0091] As Figure 7As shown, in some embodiments, to adapt to different application scenarios, the display device 200 is connected to other external devices 600 through the device interface 240, such as an OPS (Open Pluggable Specification) device. Among them, the external device 600 has an operating system different from that of the first controller 250, so that the display device 200 can support the switching between dual systems or multiple systems. For the sake of easy distinction, in the embodiments of the present application, the control system running on the first controller 250 of the display device is referred to as the first system, and the control system running on the external device 600 is referred to as the second system.

[0092] Exemplarily, when the first system is the Android system and the second system is the Windows system, the first controller 250 of the display device 200 runs the Android system, and the OPS device runs the Windows system. By connecting the OPS device through the device interface 240 of the display device 200, the display device 200 supports the functions of both the Android and Windows systems at the same time, can be compatible with more software, and thus meets more usage requirements of users.

[0093] Similarly, in some embodiments, the external device 600 also includes a communication unit, which is a component used to communicate with external devices or servers 400 according to various communication protocol types. The external device 600 can set different chips in the communication unit according to different supported communication methods. For example, the communication unit may include at least one of a WiFi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip and other network communication protocol chips or a near-field communication protocol chip, and an infrared receiver.

[0094] It can be understood that the communication unit of the external device 600 can provide the same type of communication method as the communicator 220 of the display device 200, so that the external device 600 establishes a wireless or wired communication connection relationship with other external devices. For example, external devices such as routers and terminal devices 500.

[0095] Based on the above display device 500 and external device 600, the display device 200 can form a dual system by connecting to the external device 600. Users can establish a wireless communication connection with the display device 200 or the external device based on the hotspot function provided by the communicator 220 or the communication unit, and respectively execute the above screen mirroring process based on the first system running on the first controller 250 or the second system running on the external device 600, so that the display screen 260 of the display device 200 displays the corresponding screen mirroring image.

[0096] For example, the first system is the Android system and the second system is the Windows system. When the user controls the display device 200 through the Android system, it is based on the screen mirroring data sent by the terminal device 500 applicable to the Android system's screen mirroring application. At this time, the hotspot function is provided by the Android system, that is, the communicator 220 of the display device 200 creates a wireless access point to connect to the terminal device 500. Or, when the user controls the display device 200 through the Windows system, it is based on the screen mirroring data sent by the terminal device 500 applicable to the Windows system's screen mirroring application. At this time, the hotspot function is provided by the Windows system, that is, the communication unit of the external device 600 creates a wireless access point to connect to the terminal device 500.

[0097] However, in the above-mentioned hotspot screen mirroring method, when the display device 200 is equipped with multiple systems, a network connection line for connecting to the Internet needs to be connected to the hardware module corresponding to the operating system, and the system without the network connection line cannot start the hotspot function to create an AP. For example, when the OPS device with the built-in Windows system is connected to the display screen of the Android system, if the display screen of the Android system is connected to the network connection line and the OPS device of the Windows system is not connected to the network connection line, the OPS device cannot start the hotspot function, and the user cannot perform hotspot screen mirroring with other terminal devices 500 through the Windows system. In this way, when the multi-system display device 200 performs hotspot screen mirroring, it may be necessary to repeatedly connect multiple network connection lines, resulting in an increase in the complexity of hotspot screen mirroring and a reduction in the user experience.

[0098] Based on the above application scenarios, in order to improve the problem of high complexity when the multi-system display device 200 performs hotspot screen mirroring, some embodiments of the present application provide a display device 200, including a display 260, a communicator 220, a first controller 250, and a device interface 240. Among them, the display 260 is configured to display the screen mirroring screen of the screen mirroring data; the communicator 220 includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with an external device. For example, the network interface of the communicator 220 is an Ethernet interface 1, the identification information of the Ethernet interface 1 is eth1, and the first network node is eth1.

[0099] In some embodiments, the communicator 220 of the display device 200 includes multiple network interfaces. Exemplarily, the communicator 220 of the display device 200 includes a first network interface and a second network interface. The first network interface is used to connect to a network, and the second network interface is the network interface for sharing the network with the external device 600 in the above embodiments. Among them, the first network interface may be an Ethernet interface 0, and the Ethernet interface 0 is used to form a third network node eth0; the second network interface may be an Ethernet interface 1, and the Ethernet interface 1 is used to form a first network node eth1. After the display device 200 enables the hotspot function, it creates an AP, receives data packets sent by other terminal devices 500 through the AP, and sends data packets to eth0.

[0100] That is, the communicator 220 is configured to establish a wireless communication connection with the terminal device 500 based on the second network node. When the communicator 220 establishes a wireless communication connection with the terminal device 500, the second network node is also used to receive the screen mirroring data sent by the terminal device 500. For example, the second network node is a wireless access point AP0. After the display device 200 starts the hotspot, it creates AP0 based on the communicator 220, wirelessly communicates with the terminal device 500 through AP0, and receives the data packets sent by the terminal device 500.

[0101] The first controller 250 is used to run a first system, such as the Android system; the device interface 240 of the display device 200 is configured to connect to the external device 600. The external device 600 includes a second controller 620, and the second controller 260 is used to run a second system, such as the Windows system.

[0102] For ease of description, in the following embodiments, the external device 600 is an OPS device, the first system is the Android system, and the second system is the Windows system as an example for illustration. It can be understood that the first system and the second system of the embodiments of the present application may also be other operating systems, such as Linux, etc. The present application does not limit this.

[0103] As Figure 8 shown, the first controller 250 is further configured to execute the following program steps:

[0104] S8001: Receive the screen mirroring data sent by the terminal device based on the second network node.

[0105] After the communicator 200 of the display device 200 accesses the Internet, the hotspot function is started to create a second network node, that is, a wireless access point AP. After establishing a wireless communication connection with the terminal device 500 through the AP. After the display device 200 establishes a wireless communication connection with the terminal device 500 based on the AP, the terminal device 500 can access the network or perform data transmission with the display device 200 based on the AP. After the terminal device 500 establishes a wireless communication connection with the display device 200, it sends screen mirroring data to the display device 200 based on the screen mirroring application. Among them, the screen mirroring data includes the Internet Protocol Address (IP) of the terminal device 500, and the screen mirroring application is an application applicable to the second system. When the terminal device 500 sends screen mirroring data to the AP based on the screen mirroring application, it automatically encapsulates the IP address of the terminal device 500 in the data packet of the screen mirroring application.

[0106] As Figure 9 shown, in some embodiments, in response to a power-on instruction, the display device 200 sends a power-on signal (S9001) to the external device 600 based on the device interface 240, so that the external device 600 powers on and starts in response to the power-on signal. For example, the display device 200 is connected to the OPS device through the device interface 240. After the display device 200 is powered on and started, the display device 240 sends a power-on signal to the OPS device through the device interface 240, and the OPS device then powers on and starts to enter the operating state.

[0107] Since the device interface 240 of the display device 200 is also connected to the external device 600, and the screen mirroring application is an application applicable to the second system, in order to achieve network and data sharing with the external device 600 and reduce the repeated connection of the external device 600 to the network connection line, in some embodiments, as Figure 9 shown, the display device 200 also responds to the power-on instruction of the display device 200 to enable the first network node (S9002). Then enable the second network node, that is, start the hotspot function of the display device 200 to create an AP (S9003). For example, the first network node is the eth1 node and the second network node is the AP0. Eth1 is formed by the network interface in the communicator 200. When the display device 200 is powered on and started, it will automatically enable (up) the first network node through the corresponding driver, so that the eth1 node enters the active state or enabled state. After the eth1 node is up, the display device 200 starts the hotspot function to create and enable the AP0 to establish a wireless communication connection with other terminal devices 500 through the AP0.

[0108] To share the hotspot function with an external device 600, after the first network node comes up, the display device 200 sets the target routing rule for the first network node and the second network node (S9004). The target routing rule is used to represent the route from the first network node to the second network node. Through the program steps S9002 - S9004 above, the display device 200 can forward the data received by AP0 to the eth1 node. The eth1 node can be used to share the network with the external device 600. After the display device 200 connects to the external device 600 through the device interface 240, the external device 600 can directly obtain the data forwarded by AP0 to the eth1 node through the above connection relationship. The display device 200 then establishes a communication connection with the terminal device 500 based on the second network node (S9005). In this way, the display device 200 can forward the screen mirroring data sent by the terminal device 500 to the second network node based on the screen mirroring application to the first network node. That is, forward the screen mirroring data received by the AP to the eth1 node, and no longer forward it to the eth0 node. Since the eth1 node can be used to share the network with the OPS device, the OPS device can receive the above screen mirroring data through the eth1 node.

[0109] That is to say, the display device 200 can forward the screen mirroring data received by the wireless access point AP to the Windows system side through the hotspot function provided by the Android system side. After the external device 600 of the Windows system receives the screen mirroring data, it can process the screen mirroring data and control the display 260 to display the corresponding screen mirroring image through the Windows system.

[0110] S8002: Forward the screen mirroring data to the first network node according to the target routing rule of the second network node.

[0111] After the display device 200 enables the hotspot function and establishes a connection with the terminal device 500 based on the second network node of the hotspot function, it needs to forward the screen mirroring data received by the second network node to the first network node according to the target routing rule from the second network node to the first network node. That is, forward the screen mirroring data received by AP0 to eth1.

[0112] Such as Figure 10 As shown, in some embodiments, when the display device 200 sets the target routing rule, it obtains the network configuration file of the network node (S1001). The network configuration file includes the configuration line of the first network node. Query the configuration line of the first network node in the network configuration file (S1002). Set the target routing rule field in the configuration line of the first network node to generate the target routing rule (S1003). The target routing rule field is used to specify the network address and gateway address of the second network node.

[0113] For example, the display device 200 reads the location of the network configuration file and modifies the network configuration file through a text editor according to the read file location. That is, the following command is used to obtain the network configuration file: arduino vi / file location. Locate the configuration line related to eth1 in the network configuration file. The configuration line contains configuration information about the eth1 interface, including the IP address, subnet mask, etc. of the eth1 interface. Set the gateway pointing to the ap0 interface in the configuration line related to eth1, and configure the ap0 interface with the correct network address and subnet mask. That is, arduino; auto eth1; iface eth1 inet static; address 192.xxx.x.2; netmask 255.xxx.xxx.0; gateway AP0.

[0114] To meet the display requirements of multi-terminal screens, in some embodiments, the display device 200 also sets a disable field in the configuration line of the first network node (S1004). The disable field is used to turn off the Network Address Translation (NAT) function of the first network node. NAT is a network communication protocol that converts private IP addresses into public IP addresses. NAT will present private IPs as a public IP address on the Internet. Therefore, in this embodiment, to distinguish the screen mirroring data sent by different terminal devices 500, the display device 200 turns off the NAT function of the eth1 node to ensure that the IP addresses included in the screen mirroring data are not converted into a unified IP by the NAT function, so that the external device 600 can distinguish the screen mirroring data sent by different terminal devices 500 according to the IP addresses.

[0115] After completing the setting of the above configuration line, the display device 200 then updates the network configuration file (S1005) to complete the configuration of the first network node on the Android system side. For example, after the display device 200 obtains the configuration line of eth1, it adds a disable field of nat: false to the configuration line to disable the NAT function of the first network node. That is, ethernets:eth1:dhcp4:no; nat:false.

[0116] Alternatively, in some embodiments, after the display device 200 obtains the network configuration file of the network node, it can also delete the target field of the NAT configuration in the configuration line of the first network node; or comment out the target field of the NAT configuration to disable the NAT function of the first network node.

[0117] S8003: Receive the screen mirroring data through the first network node, so that the second controller receives the screen mirroring data based on the first network node and controls the display to display the screen mirroring picture of the screen mirroring data.

[0118] After the display device 200 forwards the screen mirroring data received by the second network node to the first network node according to the target routing rule, the external device 600 can receive the screen mirroring data through the first network node. After receiving the screen mirroring data, the external device 600 can distinguish different terminal devices 500 according to the IP address of the screen mirroring data, and control the display 260 of the display device 200 to display the screen mirroring picture corresponding to the screen mirroring data according to the IP address. That is, the process of processing and displaying the screen mirroring data is all executed by the second controller 620.

[0119] For example, after the Android system side is powered on, the eth1 node is enabled, and the hotspot function is started to start AP0. Then set the routing rule from the eth1 node to AP0 to form a route from the eth1 node to AP0. The Android system side then establishes a wireless communication connection with the terminal device 500 through AP0. The terminal device 500 sends the screen mirroring data including the terminal device IP address to AP0. The Android system side forwards the screen mirroring data received by AP0 to the eth1 node for sharing with the Windows system side. When the Windows system side receives the screen mirroring data, it parses and processes the screen mirroring data, and controls the display 260 of the Android system side to display the screen mirroring picture of the screen mirroring data according to the IP address of the screen mirroring data. The window of the Windows system is more flexible and convenient for adjustment, so displaying the above screen mirroring picture through the Windows system can improve the user interaction experience.

[0120] Based on the above process of hotspot screen mirroring, some embodiments of the present application further provide an external device 600, including a device interface 610 and a second controller 620. Among them, the device interface 610 is configured to connect to the display device 200 provided in the above embodiment. The display device 200 includes a display 260, a communicator 220, and a first controller 250. Among them, the display 260 is configured to display the screen mirroring picture of the screen mirroring data; the communicator 220 includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with the external device 600; the communicator 220 is configured to establish a wireless communication connection with the terminal device 500 based on the second network node; when the communicator 200 establishes a wireless communication connection with the terminal device 500, the second network node is further used to receive the screen mirroring data sent by the terminal device 500; the first controller 250 is used to run the first system.

[0121] The second controller 620 is used to run the second system, such as Figure 11As shown, the second controller 620 is configured to execute the following program steps:

[0122] S1101: Receive the screen mirroring data sent by the terminal device based on the target routing rule.

[0123] The second controller 620 receives the screen mirroring data sent by the terminal device 500 based on the first network node through the above routing rule from the first network node to the second network node. Among them, the target routing rule is used to represent the routing from the first network node to the second network node, and the screen mirroring data includes the Internet Protocol address of the terminal device 500. For example, the Android system side of the display device 200 forwards the screen mirroring data received by AP0 to the eth1 node, and the Windows system of the external device 600 receives the screen mirroring data through the eth1 node.

[0124] S1102: Analyze the Internet Protocol address of the screen mirroring data.

[0125] The external device 600 can distinguish different terminal devices 500 through the IP address in the screen mirroring data, so as to display the transmitted screen mirroring data in the corresponding screen mirroring window. Therefore, after the external device 600 receives the screen mirroring data sent by the terminal device based on the first network node, it analyzes the screen mirroring data to obtain the IP address corresponding to each screen mirroring data.

[0126] In some embodiments, the display device 200 receives the screen mirroring data forwarded by the second network node based on the first network node. Among them, the screen mirroring data includes screen mirroring data packets. After the terminal device 500 establishes a wireless communication connection with the second network node, it continuously sends screen mirroring data packets to the second network node. The external device 600 then reads the header information of the screen mirroring data packet and obtains the Internet Protocol address in the header information. In this way, the external device 600 can determine the terminal device 500 corresponding to the current data packet through the IP address of each data packet.

[0127] S1103: Control the display to display the screen mirroring picture of the screen mirroring data according to the Internet Protocol address.

[0128] After the external device 600 resolves the IP address of the screen mirroring data, it can control the display 260 of the display device 200 to display the screen mirroring image of the screen mirroring data according to the IP address. For example, the terminal devices 500 that establish a wireless communication connection with AP0 include terminal device A and terminal device B, and terminal device A and terminal device B continuously send screen mirroring data packets to the second network node. When the two terminal devices send screen mirroring data packets based on their respective screen mirroring applications, the IP addresses corresponding to the terminal devices 500 will be automatically encapsulated in the header information of the screen mirroring data packets. The IP address of terminal device A is address 1, and the IP address of terminal device B is address 2. The Android system end forwards the screen mirroring data packets received by the second network node to the first network node. The Windows system end receives the screen mirroring data packets through the first network node, resolves the IP address in the header information of the screen mirroring data packets, and displays the image of the address 1 screen mirroring data packet in the screen mirroring window of terminal device A, and displays the image of the address 2 screen mirroring data packet in the screen mirroring window of terminal device B.

[0129] To facilitate distinguishing and displaying the screen mirroring images of different terminal devices 500, in some embodiments, the external device 600 generates screen mirroring windows according to the Internet protocol address. Among them, the number of screen mirroring windows is equal to the number of Internet protocol addresses, and there is an association relationship between the screen mirroring windows and the Internet protocol addresses. Then control the display 260 to display the screen mirroring windows, so as to present the picture content of the screen mirroring data through the screen mirroring windows. Decode the screen mirroring data and send the screen mirroring data to the corresponding screen mirroring window according to the Internet address protocol, so that the screen mirroring window presents the screen mirroring image of the screen mirroring data.

[0130] For example, as Figure 12 shown, terminal device A and terminal device B are connected to the wireless access point AP0 provided by the Android system end, and send screen mirroring data packets to AP0 based on the screen mirroring display application. AP0 forwards the screen mirroring data packets to the eth1 node; the IP address of terminal device A is address 1, and the IP address of terminal device B is address 2. The OPS device receives the screen mirroring data packets based on the eth1 node, reads the IP address of the screen mirroring data packets, and decodes the screen mirroring data packets. After respectively reading the above address 1 and address 2, the OPS device creates screen mirroring window A and screen mirroring window B based on the Windows system. Among them, screen mirroring window A is associated with address 1, and screen mirroring window B is associated with address 2. The OPS device sends the decoded screen mirroring data of address 1 to window A for display, and sends the decoded screen mirroring data of address 2 to window B for display, so that each window can continuously present the corresponding screen mirroring image.

[0131] In some embodiments, when the external device 600 sends screen mirroring data to the screen mirroring window, the screen mirroring display application of the external device 600 may use a message mechanism to send the screen mirroring data to the corresponding screen mirroring window. For example, APIs such as SendMessage or PostMessage API are used to construct a message containing the screen mirroring data, and the constructed message is sent to the corresponding screen mirroring window according to the IP address. After receiving the above message, the screen mirroring window calls the corresponding window procedure function to process the message and updates the screen mirroring data in the window for display.

[0132] Moreover, in some embodiments, when the external device 600 controls the display 260 to display the screen mirroring window, the default layout parameters are obtained according to the number of Internet Protocol addresses, and the screen mirroring window is displayed through the default layout parameters. Among them, different numbers of Internet Protocol addresses are configured with different default layout parameters, and the default layout parameters are the layout parameters when the screen mirroring window is initially displayed. For example, as Figure 13 shown, when the IP addresses of the screen mirroring data packets are two, the number of screen mirroring windows is two, and the two screen mirroring windows are equally divided left and right; or, as Figure 14 shown, when the IP addresses of the screen mirroring data packets are four, the number of screen mirroring windows is four, and the four screen mirroring windows are equally divided up, down, left, and right.

[0133] It should be noted that the external device 600 in the embodiments of the present application can plan and layout multiple screen mirroring windows in different ways, such as equal-height display, equal-width display, maximum window area display with priorities, etc. The present application does not limit this.

[0134] Based on the above process of hotspot screen mirroring, some embodiments of the present application further provide a terminal device 500, including a display module 510, a communication module 520, and a control module 530. Among them, the display module 510 is configured to display the terminal screen; the communication module 520 is configured to establish a wireless communication connection with the display device 200; the display device 200 includes a display 260, a communicator 220, a device interface 240, and a first controller 250; the display 260 is configured to display the screen mirroring screen of the screen mirroring data; the communicator 220 includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with the external device 600; the communication module 520 establishes a wireless communication connection with the display device 200 based on the second network node of the communicator 220; the first controller 250 is used to run the first system; the device interface 240 is configured to connect the external device 600, and the external device 600 includes a second controller 620, and the second controller 620 is used to run the second system;

[0135] As Figure 15 shown, the control module 530 is configured to execute the following program steps:

[0136] S1501: In response to a connection event of establishing a wireless communication connection with the display device, record the terminal screen displayed by the display module based on the screen mirroring application to generate recording data.

[0137] After the terminal device 500 connects to the second network node created by the display device 200 based on the hotspot function, it captures the multimedia content currently being played by the terminal device 500 through its built-in screen mirroring application, that is, records the terminal screen currently displayed by the display module 510 through the screen mirroring application to form recording data. Among them, the recording data includes audio data and video data, and the screen mirroring application is an application applicable to the second system, that is, the screen mirroring application of the terminal device 500 is an application program applicable to the Windows system.

[0138] S1502: Execute encoding on the recording data based on the screen mirroring application to generate screen mirroring data.

[0139] After the terminal device 500 records the terminal screen to generate recording data, it also executes encoding on the recording data through the screen mirroring application to convert the recording data into a data format that can be transmitted. It should be noted that the video codec, resolution, frame rate, and bit rate of the encoding process are all encoding settings preset for the screen mirroring data. This application does not limit this.

[0140] Exemplarily, after the display device 200 enables the hotspot function, the user searches for the hotspot name of the display device 200 through the network settings interface of the terminal device 500 and enters the corresponding password to make the terminal device 500 connect to the wireless access point AP0 created by the display device 200 based on the hotspot function. After connecting to AP0, the screen mirroring application of the terminal device 500 automatically records the currently played terminal screen to form audio-video data. The screen mirroring application then executes encoding on the audio-video data according to the preset encoding settings to form screen mirroring data that can be transmitted in the digital transmission system.

[0141] S1503: Send the screen mirroring data to the second network node through the communication module, and the screen mirroring data includes the Internet protocol address of the terminal device.

[0142] After the terminal device 500 encodes to form screen mirroring data, it sends the screen mirroring data to the AP at the Android system end of the display device through the communication module 520. When sending the screen mirroring data, the terminal device 500 will automatically encapsulate its corresponding IP address in the screen mirroring data to represent the source of the terminal device of the screen mirroring data.

[0143] Based on the above embodiments, in the hotspot screen mirroring process provided by the embodiments of the present application, the terminal device 500 records the terminal screen to form recording data. Then, the recording data is encoded to generate screen mirroring data. Next, the encoded screen mirroring data is sent by the terminal device 500 to a second network node of the first system end, namely the wireless access point AP0. The first system end receives the screen mirroring data through AP0 and forwards the screen mirroring data to a second network node, namely the eth1 node, to transmit the screen mirroring data through the eth1 node. The second system end, namely the Windows system end, then receives the screen mirroring data through the eth1 node, decodes the screen mirroring data, and controls the display 260 to display the display screen of the screen mirroring data according to the IP address of the screen mirroring data.

[0144] Based on the above display device 200, external device 600, and terminal device 500, some embodiments of the present application further provide a screen mirroring display method, which is applied to the display device 200 provided in the above embodiments. The display device 200 includes a display 260, a communicator 220, a device interface 240, and a first controller 250. Among them, the display 260 is configured to display the screen mirroring screen of the screen mirroring data; the communicator 220 includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with the external device 600; the communicator 220 is configured to establish a wireless communication connection with the terminal device 500 based on a second network node; when the communicator 220 establishes a wireless communication connection with the terminal device 500, the second network node is further used to receive the screen mirroring data sent by the terminal device 500; the first controller 250 is used to run the first system; the device interface 240 is configured to connect to the external device 600, and the external device 600 includes a second controller 620, and the second controller 620 is used to run the second system; as Figure 8 shown, the method includes:

[0145] S8001: Based on the second network node, receive the screen mirroring data sent by the terminal device, where the screen mirroring data includes the Internet protocol address of the terminal device;

[0146] S8002: Forward the screen mirroring data to the first network node according to the target routing of the second network node, and the target routing rule is used to represent the routing from the first network node to the second network node;

[0147] S8003: Receive the screen mirroring data through the first network node, so that the second controller receives the screen mirroring data based on the first network node and controls the display to display the screen mirroring screen of the screen mirroring data.

[0148] As can be seen from the above technical solutions, for the display device, external device, terminal device, and screen mirroring display method provided in some embodiments of the present application, the method can receive screen mirroring data sent by a terminal device based on a second network node. Among them, the second network node is used to establish a wireless communication connection with the terminal device, and the screen mirroring data includes the Internet Protocol address of the terminal device. Then, the screen mirroring data is forwarded to a first network node according to the target routing rule of the second network node, and the target routing rule is used to represent the route from the first network node to the second network node. The first network node is used to share the network with the external device. The first network node receives the screen mirroring data so that the second controller of the external device can receive the screen mirroring data based on the first network node, and the second controller controls the display to display the screen mirroring picture of the screen mirroring data. Through the routing rules of the first network node and the second network node, the method enables the display device and the external device to share the hotspot function of the wireless network, eliminating the need for the external device to repeatedly connect to the network cable, reducing the complexity of hotspot screen mirroring, and improving the user experience.

[0149] For the same or similar parts among the various embodiments in this specification, reference can be made to each other, and details will not be repeated here.

[0150] Those skilled in the art can clearly understand that the technologies in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solutions in the embodiments of the present invention, in essence, or the part that contributes to the prior art can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disc, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of the various embodiments or some parts of the embodiments of the present invention.

[0151] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the various embodiments of the present application.

[0152] For the sake of convenience of explanation, the above description has been made in combination with specific implementation manners. However, the above exemplary discussion is not intended to be exhaustive or to limit the implementation manners to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above implementation manners are for better explaining the principles and actual applications, so that those skilled in the art can better use the implementation manners and various different modified implementation manners suitable for specific usage considerations.

Claims

1. A display device, characterized in that, Comprising: A display configured to display a screen mirroring image of screen mirroring data; A communicator, the communicator includes a network interface, the network interface is used to form a first network node, and the first network node is used to share the network with an external device; the communicator is configured to establish a wireless communication connection with a terminal device based on a second network node; when the communicator establishes a wireless communication connection with the terminal device, the second network node is further used to receive the screen mirroring data sent by the terminal device; A first controller for running a first system; A device interface configured to connect to the external device, the external device includes a second controller, and the second controller is used to run a second system; The first controller is configured to: Receive the screen mirroring data sent by the terminal device based on the second network node, and the screen mirroring data includes the Internet Protocol address of the terminal device; Forward the screen mirroring data to the first network node according to the target routing rule of the second network node, and the target routing rule is used to represent the routing from the first network node to the second network node; Receive the screen mirroring data through the first network node, so that the second controller receives the screen mirroring data based on the first network node and controls the display to display the screen mirroring image of the screen mirroring data.

2. The display device according to claim 1, wherein The first controller is further configured to: Enable the first network node in response to a power-on instruction of the display device; Enable the second network node; Set the target routing rule from the first network node to the second network node; Establish a communication connection with the terminal device based on the second network node.

3. The display device according to claim 2, characterized in that, When the first controller executes to set the target routing rule from the first network node to the second network node, it is configured to: Obtain a network configuration file of the network node, and the network configuration file includes a configuration line of the first network node; Query the configuration line of the first network node in the network configuration file; Set a target routing rule field in the configuration line of the first network node to generate the target routing rule; the target routing rule field is used to specify the network address and gateway address of the second network node.

4. The display device according to claim 3, characterized in that, After the first controller executes to set the target routing rule from the first network node to the second network node, it is further configured to: Set a disable field in the configuration line of the first network node, and the disable field is used to turn off the network address translation function of the first network node; Update the network configuration file.

5. The display device according to claim 1, wherein The first controller is further configured to: In response to a power-on instruction of the display device, send a power-on signal to the external device through the device interface, so that the external device powers on and starts in response to the power-on signal.

6. An external device, characterized in that, Comprising: A device interface configured to connect to a display device, the display device includes a display, a communicator and a first controller; The display is configured to display a screen mirroring screen of the screen mirroring data; the communicator includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with an external device; the communicator is configured to establish a wireless communication connection with the terminal device based on a second network node; when the communicator establishes a wireless communication connection with the terminal device, the second network node is further used to receive the screen mirroring data sent by the terminal device; the first controller is used to run a first system; A second controller, which is used to run a second system; The second controller is configured to: Receive the screen mirroring data sent by the terminal device based on a target routing rule; the target routing rule is used to characterize the routing from the first network node to the second network node, and the screen mirroring data includes the Internet protocol address of the terminal device; Parse the Internet protocol address of the screen mirroring data; According to the Internet protocol address, control the display to display the screen mirroring screen of the screen mirroring data.

7. The external device according to claim 6, wherein When the second controller executes parsing the Internet protocol address of the screen mirroring data, it is configured to: Receive the screen mirroring data forwarded by the second network node based on the first network node, and the screen mirroring data includes screen mirroring data packets; Read the header information of the screen mirroring data packet; Obtain the Internet protocol address in the header information.

8. The external device according to claim 6, characterized in that, When the second controller executes controlling the display to display the screen mirroring screen of the screen mirroring data according to the Internet protocol address, it is configured to: Generate screen mirroring windows according to the Internet protocol address, the number of the screen mirroring windows is equal to the number of the Internet protocol addresses, and the screen mirroring windows have an association relationship with the Internet protocol addresses; Control the display to display the screen mirroring windows; Decode the screen mirroring data and send the screen mirroring data to the corresponding screen mirroring windows according to the Internet address protocol, so that the screen mirroring windows present the screen mirroring screen of the screen mirroring data.

9. A terminal device, characterized in that, It includes: A display module, which is configured to display a terminal screen; A communication module, which is configured to establish a wireless communication connection with a display device; the display device includes a display, a communicator, a device interface and a first controller; the display is configured to display a screen mirroring screen of the screen mirroring data; the communicator includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with an external device; the communication module establishes a wireless communication connection with the display device based on the second network node of the communicator; the first controller is used to run a first system; the device interface is configured to connect an external device, and the external device includes a second controller, and the second controller is used to run a second system; A control module, which is configured to: In response to a connection event of establishing a wireless communication connection with the display device, record the terminal screen displayed by the display module based on a screen mirroring application to generate recording data; The screen mirroring application is an application applicable to the second system; Encode the recording data based on the screen mirroring application to generate screen mirroring data; Send the screen mirroring data to the second network node through the communication module, where the screen mirroring data includes the Internet Protocol address of the terminal device.

10. A screen projection display method, characterized in that, Applied to a display device, the display device includes a display, a communicator, a device interface, and a first controller; the display is configured to display a screen mirroring picture of the screen mirroring data; the communicator includes a network interface, and the network interface is used to form a first network node, and the first network node is used to share the network with an external device; the communicator is configured to establish a wireless communication connection with the terminal device based on the second network node; when the communicator establishes a wireless communication connection with the terminal device, the second network node is further used to receive the screen mirroring data sent by the terminal device; the first controller is used to run a first system; The device interface is configured to connect to an external device, and the external device includes a second controller, and the second controller is used to run a second system; the method includes: Receive the screen mirroring data sent by the terminal device based on the second network node, where the screen mirroring data includes the Internet Protocol address of the terminal device; Forward the screen mirroring data to the first network node according to the target routing rule of the second network node, and the target routing rule is used to represent the routing from the first network node to the second network node; Receive the screen mirroring data through the first network node, so that the second controller receives the screen mirroring data based on the first network node and controls the display to display the screen mirroring picture of the screen mirroring data.

Images