Display device and data processing method for display device
By detecting the communication module in the display device to provide a network to the networkable network card and creating corresponding routes, the problems of unstable routing settings and limited script execution in the prior art are solved, and stable data sharing between different devices is achieved.
Patent Information
- Application Number
- PCT/CN2024/095566
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-30
- Filing Date
- 2024-05-27
- Publication Date
- 2025-02-20
AI Technical Summary
The prior art When setting up different external devices to obtain routing between network ports of shared networks, the link is unstable, and in the Enforcing mode where selinux permission is enabled on the Android system, script execution is restricted, resulting in failed routing settings and failed data sharing. .
By implementing the detection communication module in the display device to provide a network to the networkable network card, and creating a route between the networkable network card and the wired network node, as well as a route between the wired network node and the hotspot network node, to realize the Data sharing.
Improve the stability and success rate of routing settings, avoid the problem of restricted script execution, and ensure successful data sharing between different devices.
Smart Images

Figure CN2024095566_20022025_PF_FP_ABST
Abstract
Description
Display device and data processing method for display device
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to Chinese patent applications filed on August 14, 2023, with application number 202311021383.6; and filed on August 30, 2023, with application number 202311107340.X, the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The present application relates to the technical field of display devices, and in particular to a display device and a data processing method for the display device. Background Art
[0004] The network card configured for the display device generally includes a wired network card and a wireless network card. When the display device is connected to the network, the network card address for network positioning, i.e., the Internet Protocol Address (IP) address, is allocated to the network card of the display device based on the network protocol to enable network communication between the display device and other devices in the network.
[0005] After the display device is connected to the network, it can also share the network with external devices. After different external devices have obtained the network shared by the display device, the routes between the network ports of these external devices that obtain the shared network can also be set, so that network data packets can be transmitted between different external devices, thereby realizing data sharing between different external devices. Currently, scripts are usually used to set the routes between the network ports of different external devices that obtain the shared network. The principle of setting routes through scripts is to use the existing debugging program of the Android platform to set the command line line by line, so it is actually using fixed code logic to set the routes.
[0006] However, using the above method to set the routes between the network ports of different external devices to obtain the shared network will result in an unstable link, and if the Android system of the display device turns on the Enforcing mode of selinux (file access security policy) permissions, the script execution may be restricted, resulting in the inability to set the routes between the network ports of different external devices to obtain the shared network, which in turn causes data sharing to fail.
[0007] Summary of the Invention
[0008] According to some embodiments of the present application, a display device may include: a display; at least one network card capable of being connected to a communication module, the communication module being configured to provide a network to the display device through the network card; a wired network node being configured to connect to a first device, the first device being able to access the network through the wired network node; a hotspot network node, at least one second device being able to access the network through the hotspot network node; a memory being configured to store computer instructions and / or data associated with the display device; and at least one processor being connected to the memory and the communication module and being configured to execute the computer instructions to cause the display device to execute: if it is detected that the communication module sends a signal to the display device, The networkable network card provides a first network, and at least one second device is connected to the hotspot network node, and the first network is provided to the second device through the hotspot network node, so that the second device accesses the first network; a first route is created between the networkable network card and the wired network node, and the first network is provided to the first device through the first route, so that the first device accesses the first network; a second route is created between the wired network node and the hotspot network node, so that the first device transmits data packets to the second device based on the second route and the first network, or the second device transmits data packets to the first device based on the second route and the first network.
[0009] According to some embodiments of the present application, a data processing method for a display device may include at least one networkable network card, the networkable network card is connected to a communication module, and the communication module can be configured to provide a network to the display device through the networkable network card; a wired network node can be configured to connect to a first device, and the first device can access the network through the wired network node; a hotspot network node, at least one second device can access the network through the hotspot network node; the method may include: if it is detected that the communication module provides a first network to the networkable network card, and at least one second device is connected to the hotspot network node, providing the first network to the second device through the hotspot network node so that the second device accesses the first network; creating a first route between the networkable network card and the wired network node, and providing the first network to the first device through the first route so that the first device accesses the first network; creating a second route between the wired network node and the hotspot network node so that the first device transmits a data packet to the second device based on the second route and the first network, or the second device transmits a data packet to the first device based on the second route and the first network. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] FIG1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to some embodiments of the present application;
[0011] FIG2 is a block diagram of a hardware configuration of a control device according to some embodiments of the present application;
[0012] FIG3 is a block diagram of a hardware configuration of a display device according to some embodiments of the present application;
[0013] FIG4 is a software configuration diagram of a display device according to some embodiments of the present application;
[0014] FIG5 is a schematic diagram of device connections in a data sharing system according to some embodiments of the present application;
[0015] FIG6 is a schematic diagram of a data sharing system framework according to some embodiments of the present application;
[0016] FIG7 is a schematic flow chart of a data processing method for a display device according to some embodiments of the present application;
[0017] FIG8 is a schematic diagram of a path of a first route and a second route according to some embodiments of the present application;
[0018] FIG9 is a schematic diagram of another data sharing system framework according to some embodiments of the present application;
[0019] FIG10 is a schematic diagram of another data sharing system framework according to some embodiments of the present application;
[0020] FIG11 is a schematic diagram of another data sharing system framework according to some embodiments of the present application;
[0021] FIG12 is a flowchart of a method for selecting a second device for data sharing according to some embodiments of the present application;
[0022] FIG13 is a schematic diagram of a user interface of a display device according to some embodiments of the present application;
[0023] FIG14 is a schematic diagram of a user interface of another display device according to some embodiments of the present application;
[0024] FIG15 is a schematic diagram of another data sharing system framework according to some embodiments of the present application;
[0025] FIG16 is a flowchart of another data processing method for a display device according to some embodiments of the present application;
[0026] FIG17 is a schematic diagram of software configuration related to simultaneous screen projection in a display device according to some embodiments of the present application;
[0027] FIG18 is a flow chart of another data processing method for a display device according to some embodiments of the present application;
[0028] FIG19 is a schematic diagram of a display interface of a display device according to some embodiments of the present application;
[0029] FIG20 is a schematic diagram of a display interface of another display device according to some embodiments of the present application;
[0030] FIG21 is a flowchart of yet another data processing method for a display device according to some embodiments of the present application;
[0031] FIG22 is a schematic diagram of a display interface of another display device according to some embodiments of the present application;
[0032] FIG23 is a flowchart of yet another data processing method for a display device according to some embodiments of the present application;
[0033] FIG24 is a flowchart of yet another data processing method for a display device according to some embodiments of the present application;
[0034] FIG25 is a flow chart of yet another data processing method for a display device according to some embodiments of the present application. DETAILED DESCRIPTION
[0035] To make the purpose, scheme and advantages of this application more clear, the following will be combined with the exemplary embodiments of this application and the corresponding drawings to clearly and completely describe the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only part of the embodiments of this application, not all of them.
[0036] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of some embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.
[0037] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.
[0038] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
[0039] The display device provided in the embodiments of the present application can have various implementation forms, for example, it can be a television, a smart TV, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figures 1 and 2 illustrate a specific embodiment of the display device of the present application.
[0040] Figure 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments of the present application. As shown in Figure 1 , a user can operate a display device 200 through a smart terminal 300 and a control device 100 .
[0041] In some embodiments, the control device 100 may be a remote control, and the communication between the remote control and the display device may include infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods to control the display device 200 wirelessly or wiredly. The user can control the display device 200 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc. For example, the user can control the display device 200 to switch the displayed page by using the navigation keys (such as the up key, down key, left key, and right key) on the remote control. For example, the zoom level of the display page of the display device 200 can be adjusted by using the volume plus or minus keys. For example, the user can start the target application (such as the wireless screen mirroring application) by using the navigation keys on the remote control.
[0042] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) can also be used to control the display device 200. For example, the display device 200 can be controlled using an application running on the smart device, which can be configured to provide the user with various controls in an intuitive user interface on a screen associated with the smart device 300. For another example, the display device 200 can be controlled using an application running on the smart device 300.
[0043] In some embodiments, the smart device 300 can connect and communicate with the software applications installed on the display device 200 via a network communication protocol, achieving one-to-one control operations and data communication. For example, the smart device 300 can establish a control command protocol with the display device 200, synchronize a remote control keyboard with the smart device 300, and control the display device 200 by controlling the user interface on the smart device 300. Alternatively, content displayed on the smart device 300 can be transmitted to the display device 200 for synchronized display.
[0044] In some embodiments, the display device may not use the aforementioned smart device or control device to receive instructions, but may receive user control through touch or gestures.
[0045] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.
[0046] In some embodiments, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. For example, the display device 200 receives software program updates or accesses a remotely stored digital media library by sending and receiving messages and interacting with an electronic program guide (EPG). The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.
[0047] The display device 200 may be a liquid crystal display, an organic light-emitting diode (OLED) display, a projection display device, or a smart terminal such as a mobile phone or a tablet computer. The specific display device type, size, and resolution are not limited.
[0048] Figure 2 is a hardware configuration block diagram of a control device according to some embodiments of the present application. As shown in Figure 2, the control device 100 may include at least one processor 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input commands and convert them into commands that the display device 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display device 200.
[0049] FIG3 is a block diagram of a hardware configuration of a display device according to some embodiments of the present application. As shown in FIG3 , the display device 200 may include at least one of a tuner / demodulator 210, a communication device 220, a detector 230, an external device interface 240, at least one processor 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280.
[0050] In some embodiments, the display 260 may include a display screen component for displaying images, a driver component for driving the image display, and a component for receiving image signals output by at least one processor to display video content, image content, a menu control interface, and a user control UI interface. The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.
[0051] In some embodiments, the display 260 may be used to display a display interface of an application program, which may be any page in the application program.
[0052] In some embodiments, the display 260 may be configured to receive audio and video signals output by the audio processor and the video processor, display video content and images, play audio of the video content, and display components of a menu control interface.
[0053] In some embodiments, the display 260 may be used to present a user operation UI interface generated in the display device 200 and used to control the display device 200 .
[0054] In some embodiments, the communication device 220 is a component for communicating with external devices or servers using various communication protocols. For example, the communication device may include at least one of a wireless communication (Wire Fidelity, Wi-Fi, or WiFi) module, a Bluetooth module, a wired Ethernet module, or other network communication protocol chips or near-field communication protocol chips, as well as an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communication device 220.
[0055] In some embodiments, the user interface 280 may be configured to receive a control signal from the control device 100 (eg, an infrared remote controller, etc.).
[0056] In some embodiments, the detector 230 is used to collect signals from the external environment or external interactions. For example, the detector may include a light receiver, a sensor for collecting ambient light intensity, and adaptively adjusting display parameters based on the ambient light intensity. Alternatively, the detector may include a temperature sensor for sensing the ambient temperature, allowing the display device 200 to adaptively adjust the color temperature of the image displayed. For example, when the ambient temperature is high, the color temperature of the image displayed by the display device 200 may be adjusted to a cooler color, or when the ambient temperature is low, the color temperature of the image displayed by the display device 200 may be adjusted to a warmer color. Alternatively, the detector may include an image collector, such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures to adaptively change display parameters, or recognize user gestures to implement user interaction functions. Alternatively, the detector may include a sound collector, such as a microphone, for receiving external sounds. For example, it may include voice signals of user control commands for controlling the display device 200, or collect ambient sounds to identify the type of ambient scene, allowing the display device 200 to adaptively adapt to ambient noise.
[0057] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more of the following: a High Definition Multimedia Interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (Composite Video Broadcast Signal or Composite Video Blanking and Sync, CVBS), a Universal Serial Bus (USB) input interface, an RGB port, or the like. Alternatively, the external device interface 240 may be a composite input / output interface formed by multiple of the aforementioned interfaces.
[0058] In some embodiments, the tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
[0059] In some embodiments, the frequency demodulated by the tuner-demodulator 210 is controlled by at least one processor 250, which can send a control signal based on user selection to enable the modem to respond to the TV signal frequency selected by the user and modulate and demodulate the TV signal carried by the frequency.
[0060] Broadcast television signals can be categorized as terrestrial, cable, satellite, or internet based on the broadcast format. They can also be categorized as digital or analog based on the modulation type. Furthermore, they can be categorized as digital or analog based on the type of signal.
[0061] In some embodiments, at least one processor 250 and the tuner / demodulator 210 may be located in different separate devices, that is, the tuner / demodulator 210 may also be located in an external device of the main device where the at least one processor 250 is located, such as an external set-top box.
[0062] In some embodiments, at least one processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. At least one processor 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the at least one processor 250 can perform operations related to the object selected by the user command. The user can enter user commands through the graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user can enter user commands by inputting specific sounds or gestures, and the user input interface recognizes the sounds or gestures through sensors to receive the user input commands. "User interface" is a media interface for interaction and information exchange between an application or operating system and a user. It realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is GUI, which refers to a user interface related to computer operations displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control may include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets (Web widgets, Widgets) and other visual interface elements.
[0063] In some embodiments, the processor may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a random access memory (RAM), a read-only memory (ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.
[0064] In some embodiments, RAM can be used to store temporary data for the operating system or other running programs; ROM can be used to store various system startup instructions, such as instructions for starting a basic input / output system (BIOS). ROM can be used to perform a power-on self-test on the system, initialize various functional modules in the system, run basic input / output drivers for the system, and boot the operating system.
[0065] In some embodiments, upon receiving a power-on signal, the display device 200 starts to power on, and the central processing unit (CPU) executes system startup instructions in the ROM, copying temporary data of the operating system stored in the memory to the RAM to facilitate booting or running the operating system. After the operating system boot is complete, the CPU copies temporary data of various application programs in the memory to the RAM to facilitate booting or running the various application programs.
[0066] In some embodiments, the central processing unit can be used to execute operating system and application instructions stored in the memory, as well as execute various applications, data and content based on various interactive instructions received from external input, so as to ultimately display and play various audio and video content.
[0067] In some embodiments, the central processing unit (CPU) may include multiple processors. The multiple processors may include a main processor and one or more sub-processors. The main processor is used to perform certain operations of the display device 200 in the pre-power-on mode and / or display images in the normal mode. The one or more sub-processors are used to perform certain operations in the standby mode, etc.
[0068] In some embodiments, the video processor can be configured to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, transparency setting, and image synthesis according to the standard codec protocol of the input signal, to obtain a signal that can be directly displayed or played on the display device 200.
[0069] In some embodiments, the video processor may include a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
[0070] Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if the input Moving Picture Experts Group-2 (MPEG-2) standard is input, the demultiplexing module demultiplexes it into video signals and audio signals, etc.; the video decoding module is used to process the demultiplexed video signal, which may include decoding and scaling processing, transparency setting, etc.
[0071] An image synthesis module, such as an image synthesizer, is used to overlay and mix the GUI signal generated by the graphics generator based on user input or itself with the scaled video image to generate a displayable image signal. A frame rate conversion module is used to convert the input video frame rate, such as from 60Hz to 120Hz or 240Hz, typically using interpolation. A display formatting module is used to convert the received frame rate-converted video output signal to conform to the display format, such as outputting RGB data signals.
[0072] In some embodiments, the audio processor can be used to receive external audio signals, perform decompression and decoding according to the standard codec protocol of the input signal, as well as noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.
[0073] In some embodiments, the video processor may include one or more chips. The audio processor may also include one or more chips. The video processor and audio processor may be separate chips or integrated with at least one processor into one or more chips.
[0074] In some embodiments, the input / output interface can be used for audio output, that is, receiving the sound signal output by the audio processor under the control of at least one processor 250 and outputting it to an external device such as a speaker. In addition to the speaker carried by the display device 200 itself, it can also be output to an external audio output terminal of a generating device of an external device, such as an external audio interface or a headphone jack. The audio output can also include a short-range communication device in the communication interface, such as a Bluetooth module for outputting sound to a Bluetooth-connected speaker.
[0075] In some embodiments, a graphics processor can be used to generate various graphical objects, such as icons, operation menus, and graphics displayed in response to user input commands. The graphics processor may include an arithmetic unit that receives various interactive commands from the user, performs calculations, and displays various objects based on display attributes. The graphics processor may also include a renderer that renders the various objects generated by the arithmetic unit. The rendered objects are then displayed on a display.
[0076] In some embodiments, the graphics processor and the video processor can be integrated or separately set. When integrated, they can perform processing of graphic signals output to the display. When separated, they can perform different functions respectively, such as a graphics processor (GPU) + frame rate conversion technology (FRC) architecture.
[0077] In some embodiments, the memory may include various software modules for driving the display device 200. For example, the various software modules stored in the first memory may include at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules. The basic module is a low-level software module that facilitates signal communication between various hardware components in the display device 200 and sends processing and control signals to higher-level modules. The detection module is a management module that collects various information from various sensors or user input interfaces, performs digital-to-analog conversion, and performs analysis and management.
[0078] The power supply may provide power to the display device 200 through power input from an external power source under the control of the at least one processor 250 .
[0079] In some embodiments, the display device 200 can receive control operations input by the user on the display interface by adding a receiver. For example, when the receiver is a touch component, the touch component can form a touch screen together with the display 260. On the touch screen, the user can input different control instructions through touch operations, such as the user can input touch instructions such as click, slide, long press, double-click, etc. Different touch instructions can represent different control functions. In order to achieve the above-mentioned different touch actions, the touch component can generate different electrical signals when the user inputs different touch actions, and send the generated electrical signals to at least one processor 250. The at least one processor 250 can extract features from the received electrical signals, thereby determining the control function to be executed by the user based on the extracted features.
[0080] In some embodiments, the receiver may also be an external control component connected to the display 260. For example, in a desktop computer, the receiver may be a mouse connected to the display. The user can use the mouse to input various control commands, such as click, slide, and switch operations. When the user performs various control operations on the external control component, the external control component may generate various control signals in response to the user's control operations and transmit the generated control signals to the at least one processor 250. The at least one processor 250 may extract features from the received control signals and determine the control function the user intends to execute based on the extracted features.
[0081] In some embodiments, the receiver may also be a control component connected to the display 260. Taking a desktop computer as an example, the control component may be a keyboard connected to the display. The user may input different control commands through the keyboard, such as click, slide, switch, and other operation commands. The user may input click commands, slide commands, switch commands, and the like through corresponding shortcut keys. For example, the user may trigger a slide operation by selecting the "Tab" key and the arrow keys. That is, when the user selects the "Tab" key and the arrow keys on the keyboard at the same time, the at least one processor 250 may receive the key signal and determine that the user has triggered a slide operation. The user may then control the movement of the position marker in the display interface using the arrow keys. At the same time, the at least one processor 250 may determine the slide direction and slide distance of the slide command based on the position change of the position marker triggered by the user using the arrow keys, and control the display interface to turn pages or scroll in the media display page to display more media options.
[0082] It is understandable that different operation instructions can be input through the above control components, that is, the user can input click operations, zoom operations, switching operations, etc. through different operation methods, such as inputting different shortcut keys.
[0083] As shown in Figure 4, the display device system can be divided into three layers: the application layer, the middleware layer, and the hardware layer, from top to bottom. The application layer primarily includes commonly used TV applications and the application framework. Common applications primarily include browser-based applications, such as HTML5 apps, and native apps. The application framework is a complete programming model that provides all the basic functions required by standard application software, such as file access and data exchange, as well as the user interfaces for these functions (toolbars, status bars, menus, and dialog boxes). Native apps can support online or offline operation, message push, and local resource access. The middleware layer includes various TV protocols, multimedia protocols, and system components. Middleware uses the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, enabling resource and function sharing. The hardware layer primarily includes the HAL interface, hardware, and drivers. The HAL interface is the unified interface for all TV chipsets, with the specific logic implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0084] In order to clearly explain the solution of this application, the terms involved in this application are first explained:
[0085] A network card, also known as a network adapter or network interface card (NIC), is a device that connects a computer or display device to a local area network (LAN). A NIC is inserted into an expansion slot on a computer, display device, or server, and exchanges data and shares resources with the network via a network cable. After installing a NIC, protocol configuration is often required. A NIC encapsulates computer data into frames and sends them to the network via a network cable (or electromagnetic waves for wireless networks). It also receives frames from other devices on the network, reassembles them into data, and sends it to the device where the NIC is located. Network cards are categorized as wired and wireless, namely LAN and WLAN. A LAN card uses a wired communication module to provide a wired network connection, allowing the device to access the LAN via a wired connection. A WLAN card uses a wireless communication module to provide a wireless network connection, allowing the device to access the LAN wirelessly.
[0086] Network nodes, network nodes and routers are key components of the Internet. They enable data transmission and routing on the Internet. A network node can be a network device on the Internet. It can be a network device such as a computer, server, router, switch, or a port on a network device used to transmit or receive data packets. Network nodes can identify and communicate with each other through the Internet Protocol. Each network node has a unique IP address that identifies its location on the Internet. The wired network node involved in some embodiments of the present application is a network port that requires a wired connection. After a device is connected to the network port by wire, it can obtain a network signal from the network port, thereby achieving the purpose of accessing the network.
[0087] A USB network card is a network card with a USB interface.
[0088] Hotspot network nodes, also known as wireless access points (APs), allow devices to share their network. This functionality allows a communication-capable device to convert received General Packet Radio Service (GPRS), third-generation (3G), or fourth-generation (4G) signals into Wi-Fi signals and transmit them, allowing other devices with Wi-Fi modules to access the same network as the display device. In this case, the shared network device acts as a wireless access point (AP). To achieve network sharing, the device must have the WLAN hotspot function enabled.
[0089] Routing is the path information that guides the transmission of IP packets, specifically, the path information that directs how data packets (packets) are sent between nodes. Determining this path requires knowing the port address, so two conditions are required for routing between nodes (ports): the port is open and the port has an IP address. Routing is categorized as dynamic routing and static routing. Dynamic routing refers to the ability of a router to automatically check its routing table and dynamically adjust it based on actual network conditions. Static routing is fixed and does not change with network conditions.
[0090] In some embodiments, after accessing the network, the terminal device can also share the network with external devices. Different external devices can be connected to the same local area network, and routes can be set between the network ports of these external devices to obtain the shared network, allowing network data packets to be transmitted between these external devices, thereby achieving data sharing between different external devices.
[0091] For example, as shown in Figure 5, the display device 200 can share the network it is connected to with the first device 500 via a wired network port. That is, after the first device 500 is connected to the display device 200 using a wired connection, it obtains the network signal from the display device 200 and then accesses the same local area network. The display device 200 itself can also emit a hotspot, and the second device 500 obtains the network signal after connecting to the hotspot and can also access the same local area network. After the first device 500 and the second device 600 are connected to the same local area network, a route can be set between the network port connected to the first device 500 and the network connected to the second device 600. In this way, network data packets can be transmitted between the first device 500 and the second device 600, realizing data sharing between the first device 500 and the second device 600.
[0092] The route between the network port connected to the first device 500 and the network port connected to the second device can be set in the form of a script. The principle of using a script to set the route is to use the existing debugging program of the Android platform (taking the system of the display device as the Android system as an example) to set the command line line by line. When setting the command line, it is necessary to fully understand the information of the link. Based on the fully understood information of the link, it is also necessary to set it step by step according to the needs. Therefore, in fact, using a script to set the route requires relying on a large amount of fixed code logic. If there is a path in the link required for setting the route that is not fully considered, it will cause the route setting to fail, and then cause the data sharing to fail.
[0093] Furthermore, scripts are essentially a combination of commands. Starting a script relies on the logic of the Framework layer. After receiving a network connection broadcast, the Framework layer must start the system-registered service, which then executes the shell script (programmed script). This makes the script execution process complex. If users frequently disconnect from the network, they will need to frequently register for the service. Excessive registration can lead to service registration failures, resulting in shell script execution failures, routing setup failures, and ultimately data sharing failures.
[0094] In view of this, a display device according to some embodiments of the present application may include: a display; at least one network card that can be connected to the network, the network card being connected to a communication module, the communication module being configured to provide a network to the display device through the network card; a wired network node that can be configured to connect to a first device, the first device being able to access the network through the wired network node; a hotspot network node, at least one second device being able to access the network through the hotspot network node; a memory that can be configured to store computer instructions and / or data associated with the display device; at least one processor that is connected to the memory and the communication module and can be configured to execute the computer instructions to cause the display device to execute: if the communication module is detected A first network is provided to the networkable network card, and at least one second device is connected to the hotspot network node, and the first network is provided to the second device through the hotspot network node, so that the second device accesses the first network; a first route is created between the networkable network card and the wired network node, and the first network is provided to the first device through the first route, so that the first device accesses the first network; a second route is created between the wired network node and the hotspot network node, so that the first device transmits data packets to the second device based on the second route and the first network, or the second device transmits data packets to the first device based on the second route and the first network.
[0095] To facilitate understanding of the solutions in some embodiments of the present application, the following describes each step in detail in conjunction with some specific embodiments and accompanying drawings. Figure 6 is a schematic diagram of the data sharing system framework according to some embodiments of the present application. Figure 7 is a flow chart of a data processing method for a display device according to some embodiments of the present application, which is used to implement data sharing.
[0096] As shown in Figure 6, the data sharing system primarily includes: a display device 200, a first device 500, and a second device 600. The display device 200 may include at least one network card, a wired network node eth1, and a hotspot network node AP0. The network card is connected to a communication module, which provides network access to the display device 200 via the network card. The first device 500 is connected to the wired network node eth1, allowing the first device 500 to access the network via the wired network node eth1. If the display device 200 accesses the network, it can also provide network access to at least one second device 600 via the hotspot network node AP0. In other words, at least one second device 600 can access the network via the hotspot network node AP0. For the second device 600, the display device 200 is now a wireless AP, and the hotspot network node AP0 is an AP node. The wired network node eth1, the hotspot network node AP0, and the network card are all provided on a system-on-a-chip (SOC) chip.
[0097] Based on the data sharing system framework diagram shown in FIG6 , as shown in FIG7 , at least one processor may be configured to execute computer instructions stored in a memory to cause the display device to perform the following steps, including but not limited to, to achieve data sharing:
[0098] In step S100, if it is detected that the communication module provides the first network to the network card, and at least one second device is connected to the hotspot network node AP0, the first network is provided to the second device through the hotspot network node AP0 so that the second device can access the first network.
[0099] The network card in some embodiments of the present application may be a wired network card or a wireless network card. Before executing step S100, execute step S100': continuously determine whether the communication module provides the first network to the network card. If the network card is a wired network card, the wired communication module provides the network to the display device through the wired network card, that is, the system of the display device can access the wired network provided by the wired communication module through the wired network card. If the network card is a wireless network card, the wireless communication module provides the network to the display device through the wireless network card, that is, the system of the display device can access the wireless network provided by the wireless communication module through the wireless network card.
[0100] The communication module used can be a Zigbee wireless communication device (Zigbee is a low-power local area network protocol based on the IEEE802.15.4 standard, and ZigBee technology is a short-range, low-power wireless communication technology), a 4G or 5G communication module, a wireless WiFi module, etc. These communication modules can establish communication with the base station and then provide a network for the display device. If the networkable network card is a wireless network card, the communication module that provides the network for the wireless network card is a wireless communication module, such as a wireless WiFi module; if the networkable network card is a wired network card, the communication module that provides the network for the wired network card is a wired communication module, such as a routing device with a communication and networking function connected by a physical medium (such as a network cable, etc.), and the routing device can be regarded as a wired communication module.
[0101] The Android system of the display device can create at least one monitoring service for monitoring the network card that can be connected to the internet, and the monitoring service is used to determine whether the communication module provides the first network to the network card that can be connected to the internet. If the communication module provides the first network to the network card that can be connected to the internet, the network card that can be connected to the internet can receive a data packet from the communication module, so the monitoring service can monitor whether the network card that can be connected to the internet receives a data packet transmitted from the communication module to determine whether the communication module provides the first network to the network card. If it is monitored that the network card that can be connected to the internet obtains a data packet from the communication module, a monitoring event can be generated, and the display device determines that the communication module provides the first network to the network card based on the monitoring event. If the display device includes multiple network cards that can be connected to the internet, the generated monitoring event can be marked with the network card identifier of the network card that can be connected, and based on the network card identifier, the display device can determine which network card is provided with the first network.
[0102] For example, the SOC chip of the display device is configured with network card A, network card B, and network card C. If the communication module provides a first network to network card A, the monitoring service can mark the network card identifier A of network card A on the monitoring event when generating a monitoring event. After receiving the monitoring event, the display device can determine, based on the network card identifier A carried in the monitoring event, whether the communication module provides the first network to network card A. In this way, the route between the network card that has been connected to the network and the first network node can be accurately set. If the communication module provides the first network to network card A and network card B, the monitoring service can generate two monitoring events: a first monitoring event and a second monitoring event, wherein the first monitoring event carries the network card identifier A of network card A, and the second monitoring event carries the network card identifier B of network card B. The display device can determine, based on the first monitoring event and the second monitoring event, whether the communication module provides the first network to network card A and network card B.
[0103] When the communication module provides the first network to the networkable network card, the system can also configure a service for obtaining an IP for the networkable network card. First, the service for obtaining the IP will query whether the first network node of the networkable network card exists, that is, the first network node of the networkable network card is in the up state (normal working state). If the first network node of the networkable network card exists, it means that the first network node corresponding to the networkable network card is ready, and then the networkable network card is started, and the IP is obtained through the dynamic host configuration protocol client. The dynamic host configuration protocol server receives the request and sends the IP to the networkable network card. After the networkable network card obtains the IP, it writes the IP and other information into the networkable network card. At this time, the process of the communication module providing the first network to the networkable network card is completed.
[0104] After detecting that the communication module provides the first network to the networkable network card, it is necessary to continue to determine whether there is at least one second device connected to the hotspot network node AP0. If the communication module provides the first network to the networkable network card, the display device is now connected to the first network. If the display device has the hotspot function turned on (and is set to AP mode instead of STA (station) mode), the first network can also be shared with at least one second device through the hotspot function. The second device refers to the device connected to the hotspot network node AP0, that is, the device connected to the hotspot turned on by the display device at this time.
[0105] The second device may connect to the display device's hotspot in the following ways: After the display device has enabled the hotspot function, the display device may convert the network signal of the connected first network into a Wi-Fi signal and then transmit it. After the second device searches for the Wi-Fi signal shared by the display device via the hotspot, it may connect to the Wi-Fi hotspot by entering the hotspot name and hotspot password on the user interface of the second device, thereby enabling the second device to access the first network via the hotspot network node AP0.
[0106] When the second device accesses the first network, it is also necessary to configure an IP address for the second device. The process of configuring the IP address for the second device may include but is not limited to the following: when the hotspot network node AP0 is turned on, configure the third gateway address for the hotspot network node AP0; when the second device is connected to the hotspot network node AP0, configure the fourth gateway address for the second device according to the third gateway address, so that the second device can access the first network using the fourth gateway address.
[0107] After the display device turns on the hotspot function, it can configure an IP address (third gateway address) for the hotspot network node AP0. At this time, it is actually necessary to create a route between the hotspot network node AP0 and the networkable network card based on the IP address of the hotspot network node AP0 and the IP address of the networkable network card. In this way, the networkable network card can transmit the network signal of the first network to the hotspot network node AP0, and then the hotspot network node AP0 converts the network signal of the first network into a Wi-Fi signal and then sends it out. In this way, the second device can use the hotspot name and hotspot password to connect to the hotspot network node AP0 when searching for the Wi-Fi signal.
[0108] After the hotspot network node AP0 is assigned an IP address, and the second device connects to the hotspot network node AP0 using the hotspot name and hotspot password, the system then configures an IP address (fourth gateway address) for the second device (the second device's wireless network card) based on the IP address of the hotspot network node AP0. The fourth gateway address and the third gateway address are in the same network segment, so that the second device can access the first network (obtain the network signal of the first network) based on the fourth gateway address.
[0109] Step S200: Create a first route between the network card and the wired network node eth1, and provide the first network to the first device through the first route, so that the first device can access the first network.
[0110] Step S100 connects the first device to the first network, while step S200 connects the second device to the first network. Because the first device is connected to wired network node eth1, a first route must be created between the network-capable network card and wired network node eth1. This first route enables network data packets to be transmitted between the network-capable network card and wired network node eth1, thereby connecting the first device to the first network.
[0111] The process of creating a first route between an internet-connected network card and a wired network node eth1 may include, but is not limited to, the following: first, creating a routing file; importing a routing module for creating a route into the routing file; introducing the name and IP address of the node to be linked into the routing module, that is, introducing the name and IP address of the internet-connected network card and the wired network node eth1 for which the route is to be established; creating a routing path based on the name and IP address of the internet-connected network card and the wired network node eth1; creating a routing object based on the created routing path; and exporting the created routing object for external use. After the first route between the internet-connected network card and the wired network node eth1 is created, in the routing diagram shown in FIG8 , the internet-connected network card can provide the network signal of the first network to the wired network node eth1 through the first route, so that the wired network node eth1 is connected to the first network.
[0112] Therefore, before creating the first route, it is necessary to obtain the IP addresses of the network card and the wired network node eth1, and then create the first route between the network card and the wired network node eth1 based on the IP addresses of the network card and the wired network node eth1. The system can also configure a service for obtaining an IP for the network card. When the communication module provides the first network to the network card, it starts the network card and then obtains the IP through the dynamic host configuration protocol client. The dynamic host configuration protocol server receives the request and sends the IP to the network card. After obtaining the IP, the network card writes the IP and other information into the network card. At this time, the network card records the usable IP address, and the IP address can be used to create a route between the network card and other nodes.
[0113] The IP address acquisition process of the wired network node eth1 may include but is not limited to the following: configuring a first gateway address for the wired network node; if it is detected that a path is established between the wired network node and the first device, configuring a second gateway address for the first device according to the first gateway address, so that data packets are transmitted between the first device and the wired network node using the path according to the first gateway address and the second gateway address.
[0114] In some embodiments, as shown in another data sharing system framework diagram in FIG15 , the wired network node eth1 may be a USB network card, and the path may include a USB network card, a USB to LAN network card (Ethernet controller), and a LAN to USB network card (Ethernet controller). The USB network card is connected to the USB to LAN network card, the USB to LAN network card is connected to the LAN to USB network card, and the LAN to USB network card is connected to the first device. The USB network card can convert the network signal into a USB signal, the USB to LAN network card can convert the USB signal into a network signal, and the LAN to USB network card can convert the network signal into a USB signal. The specific implementation process of signal transmission may include, but is not limited to, the following: the wired network node eth1 receives a first network signal, converts the first network signal into a first USB signal, and then transmits the first USB signal to the USB to LAN network card. After the USB to LAN network card converts the first USB signal into a second network signal, it transmits the second network signal to the LAN to USB network card. After the LAN to USB network card converts the second network signal into a second USB signal, it transmits the second USB signal to the first device. In this way, a wired connection can be achieved between the wired network node eth1 and the wired network card on the first device.
[0115] Some embodiments of the present application are based on Android's native logic, which filters out the network cable identification function of the wired network node eth1, that is, if a network cable is inserted into the corresponding port of the wired network node eth1, the insertion of the network cable is not identified, but the wired network node eth1 is used as a node that can share the network. After the Android system of the display device is started, network sharing will be turned on, and then the IP server will be started. At this time, the Android system enters the IP server state and begins to configure and start the Dynamic Host Configuration Protocol (DHCP) server. DHCP is an application layer protocol. When the system IP address of the display device is set to dynamic acquisition mode, the DHCP server will assign an IP to the client according to the DHCP protocol, so that the display device can access the network using the assigned IP.
[0116] The server assigns an IP address to the display device's wired network node eth1 based on DHCP. That is, after assigning the first gateway address, if a path is established between the detected first device and the wired network node eth1 (when the first device is connected to the wired network node eth1 via a network cable, a path is established between the first device and the wired network node eth1), the process of requesting an IP address can be started according to the normal process of inserting the network cable. Since the display device shares the network with the first device through the wired network node eth1, the IP address (second gateway address) that can be obtained by the first device (the wired network card of the first device) and the IP address of eth1 are IP addresses on the same network. In this way, the wired network card of the first device and the wired network node eth1 can transmit data packets.
[0117] After the network card obtains an IP address and the wired network node eth1 obtains an assigned IP address, a first route can be created between the network card and the wired network node eth1. The network card can then send a network signal to the first device that has established a connection with the wired network node eth1 via the first route, allowing the first device to access the first network.
[0118] Step S300 : creating a second route between the wired network node eth1 and the hotspot network node AP0 to transmit data packets between the first device and the second device.
[0119] In this way, the above method can be used to enable the first device to transmit a data packet to the second device based on the second route and the first network, or the second device to transmit a data packet to the first device based on the second route and the first network.
[0120] Based on step S100 and step S200, after the first device and the second device are connected to the first network, it is also necessary to create a second route between the wired network node eth1 and the hotspot network node AP0, so that after the first device and the second device are connected to the same local area network, based on the created second route, data transmission between the first device and the second device can be carried out to achieve data sharing. In the routing diagram shown in Figure 8, after the first device 500 and the second device 600 are connected to the same local area network, the first device 500 can transmit network data packets to the second device 600 via the routing path of the wired network node eth1-hotspot network node AP0-second device 600, and the second device 600 can transmit network data packets to the first device 500 via the routing path of the hotspot network node AP0-wired network node eth1-first device 500, thereby achieving data sharing between the first device 500 and the second device 600.
[0121] The process of creating a second route between the wired network node eth1 and the hotspot network node AP0 may include, but is not limited to, the following: first, creating a routing file; importing a routing module for creating a route into the routing file; introducing the names and IP addresses of the nodes to be linked into the routing module, that is, introducing the names and IP addresses of the wired network node eth1 and the hotspot network node AP0 for which the route is to be established; creating a routing path based on the names and IP addresses of the hotspot network node AP0 and the wired network node eth1; creating a routing object based on the created routing path; and exporting the created routing object for external use. Therefore, before creating the second route, it is also necessary to obtain the IP addresses of the hotspot network node AP0 and the wired network node eth1, and then create the first route between the hotspot network node AP0 and the wired network node eth1 based on the IP addresses of the hotspot network node AP0 and the wired network node eth1.
[0122] It can be seen from the above scheme that according to a data processing method for a display device in some embodiments of the present application, the display device may include at least one network card that can be connected to the internet, and the communication module may be configured to provide a network to the display device through the network card; a wired network node eth1, and the first device can connect to the network through the wired network node eth1. A hotspot network node AP0, and the display device can provide a network to at least one second device through the hotspot network node AP0. If it is detected that the communication module provides a first network to the network card that can be connected to the internet, and at least one second device is connected to the hotspot network node AP0, the first network is provided to the second device through the hotspot network node AP0, and the second device can access the first network. At this time, a first route is created between the network card and the wired network node eth1, and the first network is provided to the first device through the first route, and the first device can access the first network. A second route is created between the wired network node eth1 and the hotspot network node AP0, and data packets can be transmitted between the first device and the second device based on the first network and the second route. Some embodiments of the present application use Android natively encapsulated nodes to set routes between nodes. The routing links set in this way are more stable, and can also avoid the situation where routing setting fails due to limited script execution, thereby improving the success rate of routing setting and thus improving the success rate of data sharing between different devices.
[0123] In some embodiments, as shown in FIG9 , the display device 200 may include two network cards, one wired network card and the other wireless network card. The wired network card is connected to a wired communication module, and the wireless network card is connected to a wireless communication module. Therefore, the network connection of the entire data sharing system may include, but is not limited to, the following:
[0124] As shown in the data sharing system framework diagram in Figure 10, if only the wireless communication module provides a wireless network to the wireless network card WLAN0, the system will only detect that the wireless communication module provides a network to the wireless network card WLAN0. At this time, only the wireless network card WLAN0 is up (normal working state), and the wireless network provided by the wireless communication module to the wireless network card WLAN0 is determined as the first network. The wireless network can be provided to the second device 600 through the hotspot network node AP0, and the second device 600 accesses the wireless network. Then, a first route is created between the wireless network card WLAN0 and the wired network node eth1, so that the wireless network card WLAN0 can provide the wireless network to the first device 500 through the first route, enabling the first device 500 and the second device 600 to access the same local area network. That is, the current wireless network card WLAN0 provides a network to the first device 500 through the wired network node eth1, and provides a network to the second device 600 through the hotspot network node AP0.
[0125] As shown in the data sharing system framework diagram in Figure 11, if the wireless communication module provides a wireless network to the wireless network card WLAN0 while the wired communication module provides a wired network to the wired network card eth0, the system will simultaneously detect that both the wireless network card WLAN0 and the wired network card eth0 are connected to the network. At this point, both the wireless network card WLAN0 and the wired network card eth0 are up. Since wired networks are generally more stable than wireless networks, only the wired network provided by the wired communication module to the wired network card eth0 is determined as the first network. This wired network can be provided to the second device 600 via the hotspot network node AP0, and the second device 600 accesses this wired network. A first route is then created between the wired network card eth0 and the wired network node eth1, allowing the wired network card eth0 to provide the wired network to the first device 500 via the wired network node eth1. This allows the first device 500 and the second device 600 to access the same local area network. This means that the wired network card eth0 currently provides the network to the first device 500 via the wired network node eth1 and to the second device 600 via the hotspot network node AP0.
[0126] If only the wireless communication module provides a wired network to the wired network card eth0, the system will only detect that the wired communication module provides a network to the wired network card eth0. At this time, only the wired network card eth0 is up, and the wired network provided by the wired communication module to the wired network card eth0 is determined as the first network. The wired network can be provided to the second device 600 through the hotspot network node AP0, and the second device 600 accesses the wired network. Then create a first route between the wired network card eth0 and the wired network node eth1, so that the wired network card eth0 can provide the wired network to the first device 500 through the first route, so that the first device 500 and the second device 600 can access the same local area network. That is, the current wired network card eth0 provides a network to the first device 500 through the wired network node eth1, and provides a network to the second device 600 through the hotspot network node AP0.
[0127] As shown in the data sharing system framework diagram of FIG9 , if neither the wired communication module nor the wireless communication module provides a network to the display device 200, then both the wired network card and the wireless network card are down (neither is in normal working state), and data sharing between the first device 500 and the second device 600 cannot be achieved in the manner described in the above embodiment. If the wireless communication module currently provides a network to the display device 200, that is, the first device 500 and the second device 600 are simultaneously connected to the network provided by the wireless network card WLAN0. Furthermore, if it is detected that the wired communication module provides a network to the wired network card eth0, the network provided by the wireless communication module to the wireless network card WLAN0 can be canceled from being designated as the first network, and the wired network provided by the wired communication module to the wired network card eth0 can be re-designated as the first network. Simultaneously, the first route between the wireless network card WLAN0 and the wired network node eth1 is deleted, and the first route between the wired network card eth0 and the wired network node eth1 is created. At this point, the network accessed by the first device 500 is switched to the network provided by the wired network card eth0, and the network accessed by the second device 600 is also switched to the network provided by the wired network card eth0. In this way, the original situation where the first device 500 and the second device 600 simultaneously access the network provided by the wireless network card is transformed into the situation where the first device 500 and the second device 600 simultaneously access the network provided by the wired network card.
[0128] In addition, if the current wired communication module and the wireless communication module provide networks to the wired network card eth0 and the wireless network card WLAN0 respectively at the same time, according to the above embodiment, the wired network card eth0 provides the network to the first device 500 and the second device 600 so that the first device 500 and the second device 600 are connected to the same local area network. During the data packet transmission process, the wired communication module suddenly fails, or the wired network card eth0 fails, resulting in the wired network card eth0 being unable to provide network to the first device 500 and the second device 600. At this time, after the system detects the fault, it can start the wireless network card, so that the wireless network card can provide a wireless network through the hotspot network node AP0 after it is up, and after deleting the first route between the wired network card eth0 and the wired network node eth1, create the first route between the wireless network card WLAN0 and the wired network node eth1, so that the wireless network card WLAN0 can provide a wireless network to the first device 500 through the wired network node eth1. It can be seen that the route creation method of the present application can not only avoid the impact of script limitations on the success rate, but also cope with the impact of network switching or network instability on the route creation success rate, thereby better improving the route creation success rate, thereby achieving an increase in the success rate of data sharing.
[0129] In some embodiments, if there are at least two second devices 600 connected to the local area network to which the current display device 200 is connected via the hotspot network node AP0, the at least two second devices 600 can both transmit data packets with the first device 500. As shown in FIG12 , at this time, at least one processor of the display device 200 can also be configured to execute computer instructions to cause the display device 200 to perform steps including but not limited to the following steps:
[0130] Step S201: monitor whether an access signal of a second device is received. If so, execute step S202; if not, continue monitoring.
[0131] Step S202: Add the identifier of the connected second device to the device list, and display the device list on the display, wherein the device list includes at least two second devices.
[0132] In some embodiments, at least two second devices can each access the current hotspot network using a hotspot name and hotspot password. When the display device detects access signals from at least two second devices, the names of the second devices connected to the hotspot network can be added to a device list. As shown in the user interface diagram of FIG13 , a prompt dialog box can pop up in the user interface of the display device 200. The prompt dialog box may include prompt information and a device list. The prompt information may include, but is not limited to: There are currently multiple devices that want to share data, please select the device to share data with. In this way, through the device list, the user can determine which second devices are currently connected to the hotspot network.
[0133] Step S203: receiving a selection instruction input by the user, wherein the selection instruction represents the second device selected in the device list.
[0134] In the user interface shown in FIG13 , if the selector focus falls on device A, the user clicks the confirmation button control, and then a corresponding selection instruction is generated according to the operation input by the user. The selection instruction at this time indicates that device A is the selected second device 600.
[0135] Step S204: Control the selected second device to share data with the first device according to the selection instruction.
[0136] In some embodiments, the first device can be controlled to transmit data packets to the selected second device based on the second route and the first network according to the selection instruction, or the selected second device can be controlled to transmit data packets to the first device based on the second route and the first network. This application does not make specific limitations.
[0137] Based on the example of step S202, the currently selected second device 600 is device A. Therefore, device A is controlled to transmit data packets to the first device 500 based on the second route and the first network, or the first device 500 is controlled to transmit data packets to device A based on the second route and the first network. Thus, it is possible to operate on the display device 200 to control data sharing between different devices sharing the network of the display device 200. It should be noted that if the display device 200 shares the network with a second device 600 via the hotspot network node AP0, the prompt dialog box shown in Figure 13 does not need to be popped up on the display device 200. The data sharing process between the first device 500 and the second device 600 can be carried out directly.
[0138] In addition, the first device 500 can also simultaneously share data with multiple second devices 600. In the user interface shown in Figure 14, a checkbox can be provided after the device name in the device list. If the user clicks the checkbox corresponding to the device name, it indicates that the device needs to be selected as the second device 600 to share data with the first device 500. The user can click the checkboxes corresponding to multiple device names at the same time to indicate that multiple devices need to be selected as the second device 600 to share data with the first device 500.
[0139] For example, a user clicks the checkboxes corresponding to device A and device B, indicating that both device A and device B need to be selected as the second device 600 for data sharing with the first device 500. After the user simultaneously selects the checkboxes corresponding to device A and device B to be selected, and then clicks the confirmation button control, the generated selection instruction indicates that device A and device B are simultaneously selected as devices that need to share data with the first device 500. The display device 200 can send this selection instruction to the hotspot network node AP0, so that the hotspot network node AP0 can simultaneously transmit the data packets sent by device A and device B to the first device 500, enabling the first device 500 to simultaneously share data with devices A and B.
[0140] In some embodiments, if there are multiple network cards that can be connected to the display device 200 to provide a network, the type of data that the first device 500 or the second device 600 needs to share can be obtained in advance, and then different network cards that can be connected to the display device 200 can be selected according to different data types. For example, the current display device 200 is configured with a wired network card and a wireless network card, and the wired network provided by the wired network card is more stable than the wireless network provided by the wireless network card. If the display device 200 obtains in advance that the data that the first device 500 or the second device 600 needs to share is of video type, it is necessary to use a more stable wired network for data sharing. Therefore, the wired network card can be controlled to provide a wired network for the first device 500 and the second device 600 at the same time in the manner of the above embodiment. If the display device 200 obtains that the data that the first device 500 or the second device 600 needs to share is of text type, a wireless network can be used for data sharing. Therefore, the wireless network card can be controlled to provide a wireless network for the first device 500 and the second device 600 at the same time in the manner of the above embodiment.
[0141] As a specific embodiment, assuming that the first device 500 is an ops computer, the second device 600 is a mobile phone terminal, and the wired network node eth1 of the display device 200 is pre-configured with an IP address (e.g., 192.168.44.1, with a subnet mask of 255.255.255.0). As shown in Figures 15 and 16, the specific process may include but is not limited to the following steps:
[0142] Step S3010: The display device and the ops computer are powered on synchronously.
[0143] In some embodiments, after the display device and the ops computer are powered on synchronously, the wired path from USB to LAN is valid. At this time, the Android system of the display device can detect that the wired network node eth1 is up.
[0144] Step S3011, start the network sharing process for the eth1 node.
[0145] In some embodiments, after detecting that the path between the ops computer and the wired network node eth1 is connected, the process of requesting an IP address can be started according to the normal process of inserting the network cable. Finally, the wired network card of the ops computer can obtain an IP address in the 192.168.44 network segment, and the process of realizing that the display device 200 shares the network with the ops computer is completed. Among them, the process executed on the ops computer side may include but is not limited to the following: step S3011', monitoring the network card UP; step S3011", the network card automatically obtains an IP address (DHCP process); step S3011"', the OPS computer is assigned an IP address: 192.168.44.XX.
[0146] Step S3012: register monitoring of other network nodes.
[0147] In some embodiments, data forwarding of the wired network node eth1 (USB1) is configured, routing is configured, and monitoring of other network nodes is added (for monitoring changes in the upstream network relative to the wired network node eth1, which may include monitoring of the wired network card eth0, the wireless network card WLAN0 (USB2) and AP0).
[0148] Step S3013: If the monitored uplink network has changed, add a policy route from the uplink network to the wired network node eth1, that is, configure routes between other nodes and eth1 so that data packets can be transmitted between the wired network node eth1 and other nodes.
[0149] In some embodiments, if the wired network card eth0 is monitored to be up, the IP address of the wired network card is obtained, and the route between the wired network card eth0 and the wired network node eth1 is configured so that data packets can be transmitted from the wired network card eth0 to the wired network node eth1 (S3014'). If the wireless network card WLAN0 is monitored to be up, the IP address of the wireless network card is obtained, and the route between the wireless network card WLAN0 and the wired network node eth1 is configured so that data packets can be transmitted from the wireless network card WLAN0 to the wired network node eth1 (S3014"). If the Android system of the display device 200 is monitored to turn on the hotspot, the IP address of the hotspot network node AP0 is obtained, and the route between the hotspot network node AP0 and the wired network node eth1 is configured so that data packets can be transmitted from the hotspot network node AP0 to the wired network node eth1 (S3014'").
[0150] If the mobile phone terminal connects to the network currently connected to the display device 200 through the hotspot, and the ops computer also connects to the network currently connected to the display device 200, the mobile phone terminal and the ops computer are connected to the same local area network. Based on the routing configured between the hotspot network node AP0 and the wired network node eth1, data sharing between the mobile phone terminal and the ops computer can be achieved. The data sharing process can include the mobile phone terminal casting the content currently displayed on the display screen to the ops computer, or the ops computer casting the content currently displayed on the display screen to the mobile phone terminal.
[0151] It should be noted that after the ops computer and the mobile phone terminal are connected to the same local area network and the routing configuration between the hotspot network node AP0 and the limited network node eth1 is completed, the screen projection process can be performed without user operation. The routing between the ops computer and the mobile phone terminal can also be set, for example, it is set to only allow the ops computer to project the screen to the mobile phone terminal, or it is set to only allow the mobile phone terminal to project the screen to the ops computer. It can also be set that the display device 200 first receives the content currently displayed on the display screen of the ops computer and the mobile phone terminal. If the ops computer currently displays video content and the mobile phone terminal currently has a black screen or does not display video content, the video content currently displayed on the ops computer is preferentially projected to the mobile phone terminal. If the mobile phone terminal currently displays video content and the ops computer currently has a black screen or does not display video content, the video content currently displayed on the mobile phone terminal is preferentially projected to the ops computer.
[0152] Through the above method, users can easily share multimedia content (such as videos, music, photos or documents, etc.) on other electronic devices (such as mobile phones, tablets or computers, etc.) to the TV screen, achieving a better viewing experience. There are usually two main wireless screen transmission methods supported by TVs. Among them, one wireless screen transmission method is hotspot screen transmission. Specifically, the TV creates a hotspot through its onboard WiFi chip, so that other electronic devices can be connected to the hotspot, so that users can share multimedia content on other electronic devices to the TV for display. Another wireless screen transmission method is point-to-point (P2P) screen transmission (such as Miracast screen transmission). Specifically, the TV can establish a point-to-point network with other electronic devices through its onboard WiFi chip. Based on the point-to-point network, users can share multimedia content on other electronic devices to the TV for display.
[0153] Currently, most TVs are equipped with a single WiFi chip, which means they can only support the ability to select either hotspot or peer-to-peer (P2P) networking. In practice, if the TV's hotspot function is enabled, users cannot enable P2P. If users wish to enable P2P, they must first disable the hotspot function before enabling it. Furthermore, if the P2P function is enabled, the TV will first disable the P2P function before enabling it. Furthermore, with the continuous advancement of TV technology, TVs can now be equipped with dual WiFi chips. However, since most existing TVs run Android, and the Android system architecture is designed based on a single WiFi chip, Android does not support simultaneous activation of both hotspot and peer-to-peer (P2P) networking. Consequently, smart TVs equipped with dual WiFi chips can only support the ability to select either hotspot or peer-to-peer (P2P) networking. Consequently, existing TVs still cannot support simultaneous hotspot and P2P screen sharing. In related technology, by modifying the Android system's dnsmasq configuration file, the Android system can support the hotspot function and peer-to-peer network (P2P) function at the same time, that is, the TV can support hotspot screen transmission and P2P screen transmission at the same time. However, this method is prone to errors during the operation of the TV.
[0154] According to a display device of some embodiments of the present application, the display device may further include: a display, which may be configured to display projection data; a first wireless communication module, which may be configured to establish a communication connection with the electronic device through a first communication mode; a second wireless communication module, which may be configured to establish a communication connection with the electronic device through a second communication mode; at least one processor, connected to the display, the first wireless communication module and the second wireless communication module, and further configured to execute computer instructions stored in the memory to enable the display device to execute: in response to a first operation, enabling a first network node corresponding to the first communication mode, the first communication mode being an access point mode, and the first network node being a wireless access point; in response to a first operation, enabling a first network node corresponding to the first communication mode, the first communication mode being an access point mode, and the first network node being a wireless access point; The second operation is to obtain the first information; when the first information indicates that the display device supports the first communication mode and the second communication mode at the same time, enable the second network node corresponding to the second communication mode, the second communication mode is a point-to-point network mode, and the second network node is a node in the point-to-point network; when the first projection data is received through the first network node and the second projection data is received through the second network node, control the display to display the first projection data and the second projection data in a split-screen manner, so as to realize the simultaneous use of hotspot projection and point-to-point projection, so that the user can watch the projection data from two different electronic devices on the display device at the same time, thereby providing the user with a richer viewing experience.
[0155] In some embodiments, still referring to FIG3 , the communication device 220 may include two WiFi chips (modules), namely a first WiFi chip (i.e., a first wireless communication module) and a second WiFi chip (i.e., a second wireless communication module). On the one hand, the display device 200 can create an access point through the first WiFi chip (i.e., the first wireless communication module) and establish a wireless communication connection with other electronic devices as sites, thereby realizing a hotspot screen transmission function. On the other hand, the display device 200 can establish a point-to-point network connection with other electronic devices through the second WiFi chip (i.e., the second wireless communication module), thereby realizing a point-to-point screen transmission function.
[0156] Figure 17 is a schematic diagram of the software configuration related to simultaneous screen projection in the display device according to some embodiments of the present application. As shown in Figure 17, the system can be divided into four layers, from top to bottom, namely the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the kernel layer and the hardware layer.
[0157] In some embodiments, at least one application is running in the application layer. These applications may be window programs, system settings programs, clock programs, etc. that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples. For example, the application layer may include a wireless screen transmission application (such as a Miracast screen transmission application). The display device 200 can respond to the user's operation of starting the wireless screen transmission application, turn on the wireless screen transmission application, and establish a point-to-point network (i.e., P2P) connection with other electronic devices through the wireless screen transmission application, and then receive and display the projection data sent by other electronic devices based on the point-to-point network (i.e., P2P) connection between the display device and other electronic devices, that is, realize P2P screen transmission.
[0158] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer may include some predefined functions. The application framework layer is equivalent to a processing center that determines the actions to be taken by applications in the application layer. Applications can access resources in the system and obtain system services during execution through the API interface. In some embodiments, the application framework layer may include system services, which can be used to determine whether the display device supports both the first communication mode (i.e., access point mode) and the second communication mode (i.e., point-to-point network mode) when the display device turns on the point-to-point network function, and send a first notification to the kernel layer of the display device if the display device supports both the first communication mode (i.e., access point mode) and the second communication mode (i.e., point-to-point network mode). The first notification is used to indicate that the display device supports both the first communication mode (i.e., access point mode) and the second communication mode (i.e., point-to-point network mode).
[0159] In some embodiments, as shown in FIG17 , the hardware layer may include at least one processor 250 and a display 260 as shown in FIG3 . The hardware layer may also include a communication device, which may include a first WiFi chip (i.e., a first wireless communication module) and a second WiFi chip (i.e., a second wireless communication module).
[0160] The kernel layer is the layer between hardware and software. The kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WiFi driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), MIC driver, and power driver.
[0161] The display driver corresponding to the display can call the display interface to obtain the projection data, or call the display interface to set the display. The audio driver corresponding to the speaker can call the speaker interface to obtain the audio data corresponding to the projection data to be played, or call the speaker interface to set the speaker.
[0162] The WiFi driver may include a first WiFi driver corresponding to the first WiFi chip (ie, the first wireless communication module) and a second WiFi driver corresponding to the second WiFi chip (ie, the second wireless communication module).
[0163] In some embodiments, when the display device is started, the display device loads a first WiFi driver, causing the first WiFi chip to create a first network node, and then loads a second WiFi driver, causing the second WiFi chip to create a second network node. When the display device receives a first operation (i.e., the user turns on the hotspot function of the display device), the first WiFi driver in the kernel layer of the display device activates the first network node. When the display device receives a second operation (i.e., the user turns on the peer-to-peer function of the display device), the framework layer of the display device determines whether the display device supports both the first communication mode (i.e., access point mode) and the second communication mode (i.e., peer-to-peer network mode). If the display device supports both the first communication mode and the second communication mode, the framework layer of the display device sends a first notification to the kernel layer of the display device. After the kernel layer of the display device receives the first notification, the kernel layer of the display device determines whether the WiFi chip onboard the display device can support both the first communication mode (i.e., access point mode) and the second communication mode (i.e., peer-to-peer network mode). If the WiFi chip onboard the display device supports both the first communication mode and the second communication mode, the second WiFi driver in the kernel layer of the display device activates the second network node.
[0164] Afterwards, when the display device receives a first screen projection connection request sent by the first electronic device, the display device establishes a hotspot connection with the first electronic device through the first network node, and based on the hotspot connection between the first electronic device and the display device, the display device can receive the first screen projection data sent by the first electronic device. When the display device receives a second screen projection connection request sent by the second electronic device, the display device establishes a point-to-point network connection with the second electronic device through the second network node, and based on the point-to-point network connection between the second electronic device and the display device, the display device can receive the second screen projection data sent by the second electronic device. The display device can call the display through the display driver to control the display to display the first projection data and the second projection data in a split-screen manner.
[0165] In some embodiments, the first wireless communication module (i.e., the above-mentioned first WiFi chip) can establish a communication connection with the electronic device through a first communication mode. The first communication mode may be an access point mode. The display device can create an access point through the first wireless communication module, and establish a wireless communication connection with other electronic devices serving as sites, thereby realizing a hotspot screen transmission function. The second wireless communication module (i.e., the above-mentioned second WiFi chip) can establish a communication connection with the electronic device through a second communication mode. The second communication mode may be a point-to-point network (i.e., P2P) mode. The display device can establish a point-to-point network connection with other electronic devices through the second wireless communication module, thereby realizing a point-to-point screen transmission function. In other words, the display device is equipped with dual WiFi chips, which can simultaneously support both access point and point-to-point network wireless communication modes, that is, the display device can simultaneously support hotspot screen transmission function and point-to-point screen transmission function.
[0166] Another data processing method (screen projection method) for a display device according to some embodiments of the present application is described. As shown in FIG18 , at least one processor of the display device may be further configured to execute computer instructions to cause the display device to perform steps including but not limited to the following steps S1810 to S1840.
[0167] Step S1810: In response to a first operation, a first network node corresponding to a first communication mode is enabled, where the first communication mode is an access point mode and the first network node is a wireless access point.
[0168] The first network node may be a network node created by the first wireless communication module. In some embodiments, the first network node is a wireless access point (ie, access point, AP) created by the first wireless communication module.
[0169] The first operation can be used to trigger the first communication mode of the display device, that is, to trigger the activation of the first network node corresponding to the first communication mode. The first operation can be a user triggering the hotspot activation control of the display device; or a user powering on the display device.
[0170] For example, the first operation is a user triggering an operation on a hotspot start-up control of a display device. In response to the user's power-on operation on the display device, the display device starts and connects to the network. Afterwards, the user can open the network settings interface of the display device. As shown in Figure 19, the network settings interface of the display device 601 displays a hotspot start-up control 602. In response to the user's triggering operation (such as a click operation) on the hotspot start-up control 602, the display device 601 turns on the hotspot function, that is, the display device 601 enables the first network node corresponding to the first communication mode, that is, the display device 601 enables the wireless access point.
[0171] For another example, consider the first operation being a user powering on a display device. In response to the user powering on the display device, the display device boots up and automatically connects to the network. When the display device is connected to the network, the display device automatically activates a hotspot function, meaning that the display device activates the first network node corresponding to the first communication mode, i.e., the display device activates a wireless access point.
[0172] In some embodiments, the first network node corresponding to the first communication mode is enabled, and at least one processor can be specifically configured to execute computer instructions to enable the display device to execute: the driver corresponding to the first wireless communication module in the driver layer of the display device sets the first network node to an enabled state (or called an activated state), that is, the driver corresponding to the first wireless communication module up the first network node.
[0173] Step S1820: In response to the second operation, obtain first information.
[0174] The first information can be used to indicate whether the display device supports the first communication mode and the second communication mode at the same time, that is, the first information can be used to indicate whether the driver corresponding to the first wireless communication module and the driver corresponding to the second wireless communication module are loaded successfully.
[0175] In some embodiments, the first information may be a field value corresponding to a target field (such as WiFi double support) stored in the display device. For example, if the field value corresponding to the target field (such as WiFi double support) is a first value (such as true), it means that the driver corresponding to the first wireless communication module and the driver corresponding to the second wireless communication module of the display device are both loaded successfully, that is, the display device supports the first communication mode and the second communication mode at the same time, that is, the display device supports hotspot screen transmission and point-to-point (ie P2P) screen transmission at the same time. If the field value corresponding to the target field (such as WiFi double support) is a second value (such as false), it means that the display device does not support the first communication mode and the second communication mode, that is, the display device cannot support hotspot screen transmission and point-to-point (ie P2P) screen transmission at the same time. The second operation can be used to trigger the acquisition of the first information. The second operation can be a trigger operation of the user to start the control of the point-to-point network (ie P2P) of the display device.
[0176] For example, the second operation is a user triggering a peer-to-peer network (i.e., P2P) startup control on a display device. As shown in (a) of FIG20 , a wireless screen mirroring application (e.g., a Miracast screen mirroring application) 702 is installed on the display device 701. In response to the user's triggering operation (e.g., a click operation) on the wireless screen mirroring application 702, as shown in (b) of FIG20 , the display device 701 may display an interface corresponding to the wireless screen mirroring application 702. The interface corresponding to the wireless screen mirroring application 702 may include a peer-to-peer network (i.e., P2P) startup control 703. In response to the user's triggering operation (such as a click operation) on the peer-to-peer network (i.e., P2P) start control 703, the display device 701 obtains the first information. When the first information indicates that the display device supports both the first communication mode and the second communication mode, the display device 701 turns on the peer-to-peer network (i.e., P2P) function, that is, the display device 701 enables the second network node corresponding to the second communication mode, that is, the display device 701 initiates a P2P search, so that the user can use other electronic devices to establish a peer-to-peer network (i.e., P2P) connection with the display device, thereby realizing P2P screen transmission.
[0177] It should be noted that, since the display device can enable a peer-to-peer network function when connected to a network (i.e., the display device has the WiFi function enabled), the at least one processor may be further configured to execute computer instructions to cause the display device to enable the WiFi function of the display device before obtaining the first information in response to the second operation. In some embodiments, in response to a user powering on the display device, the display device boots up and automatically enables the WiFi function, i.e., the display device automatically connects to the network after being powered on.
[0178] It should also be noted that step S1820 can also be executed before step S1810. That is, the user can first enable the hotspot function of the display device and then enable the peer-to-peer network function of the display device. The user can also first enable the peer-to-peer network function of the display device and then enable the hotspot function of the display device. The embodiment of the present application does not limit the execution order of step S1810 and step S1820.
[0179] Step S1830: When the first information indicates that the display device supports both the first communication mode and the second communication mode, enable the second network node corresponding to the second communication mode, the second communication mode is a point-to-point network mode, and the second network node is a node in the point-to-point network.
[0180] The second network node may be a network node created by the second wireless communication module. In some embodiments, the second network node is a node in a point-to-point network (ie, P2P) created by the second wireless communication module.
[0181] After the display device obtains the first information, the framework layer of the display device can determine whether the display device supports both the first communication mode and the second communication mode based on the first information. If the first information indicates that the display device supports both the first communication mode and the second communication mode, the driver corresponding to the second wireless communication module in the driver layer of the display device sets the second network node to an enabled state (or an activated state), that is, the driver corresponding to the second wireless communication module sets the second network node to an enabled state (or an activated state), that is, the driver corresponding to the second wireless communication module sets the second network node to an enabled state, that is, the display device sets the second network node to an enabled state (or an activated state).
[0182] In some embodiments, a driver corresponding to a second wireless communication module in a driver layer of a display device sets a second network node to an enabled state. At least one processor may be configured to execute computer instructions to cause the display device to perform, including but not limited to, the following: when first information indicates that the display device supports both the first communication mode and the second communication mode, the framework layer of the display device sends a first notification to the driver layer of the display device, the first notification being used to notify the driver layer of the display device that the display device supports both the first communication mode and the second communication mode. Upon receiving the first notification, the driver layer of the display device determines, based on the capabilities of the first wireless communication module (i.e., the first WiFi chip) and the second wireless communication module (i.e., the second WiFi chip), whether the first wireless communication module (i.e., the first WiFi chip) and the second wireless communication module (i.e., the second WiFi chip) can support the concurrency of the first communication mode and the second communication mode. If the first wireless communication module (i.e., the first WiFi chip) and the second wireless communication module (i.e., the second WiFi chip) can support the concurrency of the first communication mode and the second communication mode, the driver corresponding to the second wireless communication module in the driver layer of the display device sets the second network node to an enabled state (or an activated state), i.e., the driver corresponding to the second wireless communication module sets the second network node to an enabled state (or an activated state), i.e., the driver corresponding to the second wireless communication module sets the second network node to an enabled state, i.e., the display device enables the second network node created by the second wireless communication module.
[0183] In some embodiments of the present application, before enabling the hotspot function and the peer-to-peer network function on the display device, the display device may load the driver corresponding to the first wireless communication module and the driver corresponding to the second wireless communication module. The following, in conjunction with FIG21 , schematically illustrates the process of loading the driver corresponding to the first wireless communication module and the driver corresponding to the second wireless communication module on the display device.
[0184] In some embodiments, before enabling the first network node corresponding to the first communication mode in response to the first operation, as shown in Figure 21, the at least one processor may also be configured to execute computer instructions to enable the display device to perform including but not limited to the following: step S2110 and step S2120.
[0185] Step S2110: When the display device is started, a driver corresponding to the first wireless communication module is loaded, and a first network node is created through the first wireless communication module.
[0186] The identification information corresponding to the first network node complies with a first identification rule, and the network node identified by the first identification rule can be recognized by the framework layer of the display device. For example, the identification information corresponding to the first network node is ap0. For example, the driver corresponding to the first wireless communication module can be the above-mentioned first WiFi driver.
[0187] In some embodiments, the at least one processor may be further configured to execute computer instructions to cause the display device to: establish, via the first wireless communication module, a third network node and a fourth network node. The third network node may be a wireless local area network node, and the fourth network node may be a node in a peer-to-peer network.
[0188] Compared to the first network node, the identification information corresponding to the third network node and the identification information corresponding to the fourth network node both comply with the second identification rule, and the second identification rule is different from the first identification rule. For example, the identification information corresponding to the third network node is wlanb0. For example, the identification information corresponding to the fourth network node is p2pb0.
[0189] As a specific embodiment, in response to the user's power-on operation on the display device, the display device starts. When the display device starts, the display device loads the driver corresponding to the first wireless communication module and generates a first network node (i.e., ap0), a third network node (i.e., wlanb0), and a fourth network node (i.e., p2pb0). In this regard, since the identification information ap0 corresponding to the first network node complies with the first identification rule, the framework layer of the display device can identify the first network node. Therefore, the first network node (i.e., ap0) generated by the first wireless communication module is available. However, the identification information wlan0 corresponding to the third network node and the identification information p2pb0 corresponding to the fourth network node do not comply with the first identification rule. The framework layer of the display device cannot identify the third network node and the fourth network node. Therefore, the third network node (i.e., wlanb0) and the fourth network node (i.e., p2pb0) generated by the first wireless communication module are unavailable.
[0190] Step S2120: Load the driver corresponding to the second wireless communication module, and create a second network node through the second wireless communication module.
[0191] The identification information corresponding to the second network node complies with the first identification rule, and the network node identified by the first identification rule can be recognized by the framework layer of the display device. For example, the identification information corresponding to the second network node is p2p0. In some embodiments, the driver corresponding to the second wireless communication module can be the second WiFi driver described above.
[0192] In some embodiments, at least one processor can also be configured to execute computer instructions to cause the display device to perform the following: create a fifth network node and a sixth network node through the first wireless communication module; wherein the fifth network node is a wireless local area network node, and the identification information corresponding to the fifth network node complies with the first identification rule; the sixth network node is a wireless access point, and the priority of the sixth network node is lower than that of the second network node.
[0193] As a specific embodiment, in response to the user's power-on operation on the display device, the display device starts. When the display device starts, the display device loads the driver corresponding to the second wireless communication module and generates a second network node (i.e., p2p0), a fifth network node (i.e., wlan0), and a sixth network node (i.e., ap1). Since the identification information p2p0 corresponding to the second network node and the identification information wlan0 corresponding to the fifth network node comply with the first identification rule, the framework layer of the display device can identify the second network node and the fifth network node. Therefore, the second network node (i.e., p2p0) and the fifth network node (i.e., wlan0) are available. In addition, the identification information ap1 corresponding to the sixth network node complies with the first identification rule, and the priority of the sixth network node (i.e., ap1) is lower than that of the first network node (i.e., ap0). Therefore, when the display device turns on the hotspot function, the display device prioritizes running the first network node (i.e., ap0). That is, when the display device turns on the hotspot function, the display device implements the hotspot function through the first wireless communication module (i.e., the first WiFi chip). When the display device turns on the WiFi function and the point-to-point network function (such as point-to-point screen transmission), the display device implements the WiFi function and the point-to-point network function through the second wireless communication module (ie, the second WiFi chip).
[0194] It should be noted that step S2120 may also be executed before step S2110, and step S2120 may also be executed simultaneously with step S2110. The embodiment of the present application does not limit the execution order of step S2120 and step S2110.
[0195] In some embodiments of the present application, when the display device is started, the display device can load the driver corresponding to the first wireless communication module and the driver corresponding to the second wireless communication module. When the display device loads the driver of the first wireless communication module, the first wireless communication module can create an available first network node, and when the display device loads the driver of the second wireless communication module, the second wireless communication module can create an available second network node. In this way, when the user turns on the hotspot function of the display device, the display device can enable the first network node to realize the hotspot function. When the user turns on the point-to-point network function of the display device, the display device can enable the second network node to realize the point-to-point network function.
[0196] After step S1830, step S1840 is executed. When the first projection data is received through the first network node and the second projection data is received through the second network node, the first projection data and the second projection data are displayed in a split-screen manner.
[0197] After the display device enables the first network node, the first electronic device (such as a computer, tablet computer, mobile phone) can be used as a site to connect to the first network node of the display device (i.e., wireless access point ap0), and then the first electronic device can send the first projection data to the display device based on the WiFi connection established between the first electronic device and the display device. After the display device enables the second network node, the second electronic device (such as a computer, tablet computer, mobile phone) can establish a point-to-point network connection with the display device, and then the second electronic device can send the second projection data to the display device based on the point-to-point network connection established between the second electronic device and the display device. Afterwards, when the display device receives the first projection data through the first network node and receives the second projection data through the second network node, the display device can display the first projection data and the second projection data in a split-screen manner.
[0198] For example, taking the first electronic device as a computer and the second electronic device as a computer as an example, as shown in Figure 22, when the first electronic device 902 sends the first projection data to the display device 901 through hotspot screen transmission, and the second electronic device 903 sends the second projection data to the display device 901 through point-to-point screen transmission, the display device 901 displays the first projection data in the first display area (such as the left area of the display) 904, and displays the second projection data in the second display area (such as the right area of the display) 905, that is, the first projection data and the second projection data are displayed in a split-screen manner.
[0199] In some embodiments, before displaying the first projection data and the second projection data in a split-screen manner, as shown in Figure 23, the at least one processor can also be configured to execute computer instructions to enable the display device to perform including but not limited to the following: steps S2310 to S2330.
[0200] Step S2310: Receive a first screen projection connection request sent by a first electronic device.
[0201] The first screen projection connection request can be used to request hotspot screen transmission to the display device, that is, the first screen projection request can be used to request the first network node (that is, wireless access point ap0) created by the first wireless communication module to connect to the display device.
[0202] In some embodiments, the first screen projection connection request may be in response to a user's screen projection connection operation on the first electronic device, and the first electronic device may send the first screen projection connection request to the display device.
[0203] Step S2320: In response to the first screen projection connection request, establish a communication connection with the first electronic device through the first network node.
[0204] In response to the first screen projection connection request, the display device establishes a WiFi connection with the first electronic device through the first network node (ie, wireless access point ap0).
[0205] Step S2330: Establish a communication connection with the first electronic device based on the first network node, and receive the first screen projection data sent by the first electronic device.
[0206] The first electronic device can send the first projection data to the display device based on the WiFi connection established between the first electronic device and the display device. After receiving the first projection data, the display device controls the display to display the first projection data.
[0207] In some embodiments of the present application, after the display device enables the first network node corresponding to the first communication mode, when the first electronic device needs to project the screen to the display device, the first electronic device can send a first screen projection connection request to the display device. In response to the first screen projection connection request, the first electronic device can connect to the first network node of the display device as a site, and then based on the WiFi connection established between the first electronic device and the display device, the first electronic device can send first screen projection data to the display device, and the display device can receive and display the first screen projection data.
[0208] In some embodiments, before displaying the first projection data and the second projection data in a split-screen manner, as shown in Figure 24, the at least one processor can also be configured to execute computer instructions to enable the display device to perform including but not limited to the following: steps S2410 to S2430.
[0209] Step S2410, receiving a second screen projection connection request sent by a second electronic device.
[0210] The second screen projection connection request can be used to request point-to-point screen transmission to the display device, that is, the second screen projection connection request can be used to request a second network node (ie, p2p0) created by the second wireless communication module of the display device.
[0211] Step S2420: In response to the second screen projection connection request, establish a communication connection with the second electronic device through the second network node.
[0212] In response to the second screen projection connection request, the display device establishes a peer-to-peer network connection with the second electronic device through the second network node (ie, p2p0).
[0213] Step S2430: Establish a communication connection with the second electronic device based on the second network node, and receive the second projection data sent by the second electronic device.
[0214] Based on the point-to-point network connection established between the second electronic device and the display device, the second electronic device can send the second projection data to the display device. After receiving the second projection data, the display device controls the display to display the second projection data. That is, the display device displays the first projection data and the second projection data in a split-screen manner.
[0215] In some embodiments of the present application, after the display device enables the second network node corresponding to the second communication mode, when the second electronic device needs to perform point-to-point screen projection to the display device, the second electronic device can send a second screen projection connection request to the display device. In response to the second screen projection connection request, the second electronic device connects to the second network node of the display device, and then based on the point-to-point network connection established between the second electronic device and the display device, the second electronic device can send second screen projection data to the display device, and the display device can receive and display the second screen projection data.
[0216] In some embodiments, after obtaining the first information in response to the second operation, the at least one process can also be configured to execute computer instructions to cause the display device to perform including but not limited to the following: when the first network node is enabled and the first information indicates that the display device cannot simultaneously support the first communication mode and the second communication mode, issuing a prompt message, wherein the prompt message is used to prompt the user to turn off the first network node.
[0217] As a specific embodiment, when a user turns on the peer-to-peer network function of the display device, the user can enter a second operation. In response to the second operation, the display device obtains the first information. If the first information indicates that the display device cannot support both the first communication mode and the second communication mode (i.e., the display device is equipped with a single WiFi chip), the display device obtains the currently enabled network node. If the currently enabled network nodes include the first network node (the first network node is enabled), enabling the second network node fails, and the display device issues a prompt message to prompt the user to turn off the first network node, i.e., prompting the user to turn off the hotspot function of the display device. Afterwards, after the user turns off the hotspot function of the display device (i.e., turns off the first network node), the user can enter a second operation. In response to the second operation, the display device obtains the first information. If the first information indicates that the display device cannot support both the first communication mode and the second communication mode (i.e., the display device is equipped with a single WiFi chip), the display device obtains the currently enabled network node. If the currently enabled network node does not include the first network node (the first network node is enabled), the second network node is enabled, i.e., the peer-to-peer network function of the display device is turned on.
[0218] In some embodiments, when the display device obtains the currently enabled network node, the display device can use the "ifconfig" command to view the network interface information of the display device, that is, to obtain the currently enabled network node. For example,
[0219] console: / #ifconfig
[0220] ap0 Link encap:Ethernet Hwaddr 3e:64:07:ec:c6:ee
[0221] inet addr:172.16.52.1 Bcast:172.16.52.255 Mask:255.255 255.0
[0222] wlan0 Link encap:Ethernet Hwaddr 84:3e:1d:ac:02:b5 Driver usb
[0223] inet addr:192.168.124.8 Bcast:192.168.124.255 Mask:255.255.255.0
[0224] It can be seen that the currently enabled network nodes may include ap0 (ie, the first network node) and wlan0.
[0225] In some embodiments of the present application, when the display device receives the user's second operation, the display device can pre-determine whether it supports the first communication mode and the second communication mode at the same time. If the display device cannot support the first communication mode and the second communication mode at the same time, a prompt message is issued to prompt the user that the hotspot needs to be turned off before the point-to-point network function of the display device can be turned on.
[0226] In some embodiments of the present application, the display device is equipped with a first wireless communication module and a second wireless communication module, wherein the first wireless communication module can be used for hotspot connection and the second wireless communication module can be used for point-to-point screen transmission. Based on this, in response to the first operation, the display device can enable the first network node corresponding to the first communication mode, so that the first electronic device can initiate hotspot screen projection to the display device through the first network node. In response to the second operation, the display device can obtain the first information and determine whether the display device supports the first communication mode and the second communication mode at the same time based on the first information. When the first information indicates that the display device supports the first communication mode and the second communication mode at the same time, the display device can enable the second network node corresponding to the second communication mode, so that while the first electronic device initiates hotspot screen projection to the display device through the first network node, the second electronic device can initiate point-to-point screen projection to the display device through the second network node. In this way, hotspot screen projection and point-to-point screen projection can be used simultaneously, so that the user can watch the projection data from two different electronic devices on the display device at the same time, thereby providing the user with a richer viewing experience.
[0227] Furthermore, when the user turns on the point-to-point network function of the display device, the framework layer and driver layer of the display device determine whether the display device supports the first communication mode and the second communication mode at the same time. Then, if the display device supports both the first communication mode and the second communication mode, the second network node can be started, so that the electronic device can transmit the screen to the display device point-to-point through the second network node. In other words, the embodiment of the present application does not require modification to the native system of the display device, and can enable the hotspot function and the point-to-point screen transmission function of the display device at the same time without affecting the normal operation of the display device.
[0228] Another data processing method for a display device in some embodiments of the present application is described below with reference to FIG25 . As shown in FIG25 , the at least one processor can be specifically configured to execute computer instructions to cause the display device to perform steps including but not limited to the following: steps S2501 to S2517 .
[0229] Step S2501: In response to a power-on operation, the display device loads a driver corresponding to the first wireless communication module, and creates a first network node ap0, a third network node wlanb0, and a fourth network node p2pb0 through the first wireless communication module.
[0230] Step S2502: The display device loads a driver corresponding to the second wireless communication module, and creates a second network node p2p0, a fifth network node wlan0, and a sixth network node ap1 through the second wireless communication module.
[0231] Step S2503: In response to the first operation, the display device turns on the hotspot function and the WiFi function.
[0232] Step S2504: The driver layer of the display device sets the first network node ap0 to an enabled state.
[0233] Step S2505: In response to the second operation, the display device enables the peer-to-peer network function.
[0234] Step S2506, when the display device turns on the point-to-point network function, the framework layer of the display device determines whether the display device supports the first communication mode and the second communication mode at the same time based on the first information. If so, execute step S2507, otherwise, execute step S2510.
[0235] Step S2507 : The framework layer of the display device sends a first notification to the driver layer of the display device, where the first notification is used to indicate that the display device supports both the first communication mode and the second communication mode.
[0236] In step S2508 , the driver layer of the display device determines whether the display device supports concurrent use of the first communication mode and the second communication mode. If so, step S2509 is executed; otherwise, step S2510 is executed.
[0237] Step S2509: The driver layer of the display device sets the second network node p2p0 to an enabled state.
[0238] Step S2510: Send a prompt message, where the prompt message is used to prompt the user to shut down the first network node.
[0239] Step S2511: Receive a second screen projection connection request sent by a second electronic device, where the second screen projection connection request is used to request point-to-point screen transmission to a display device.
[0240] Step S2512, in response to the second screen projection connection request, establish a point-to-point network connection with the second electronic device through the second network node.
[0241] Step S2513: Based on the point-to-point network connection between the second electronic device and the display device, receive the second screen projection data sent by the second electronic device.
[0242] Step S2514: Receive a first screen projection connection request sent by the first electronic device, where the first screen projection connection request is used to request hotspot screen transmission to the display device.
[0243] Step S2515: In response to the first screen projection connection request, a hotspot connection is established with the first electronic device through the first network node.
[0244] Step S2516: Based on the hotspot connection between the first electronic device and the display device, receive the first screen projection data sent by the first electronic device.
[0245] Step S2517: Display the first projection data and the second projection data in a split-screen manner.
[0246] In some embodiments, the display device is equipped with a first wireless communication module and a second wireless communication module, wherein the first wireless communication module can be used for hotspot connection and the second wireless communication module can be used for point-to-point screen transmission. Based on this, in response to the first operation, the display device can enable the first network node corresponding to the first communication mode, so that the first electronic device can initiate hotspot screen projection to the display device through the first network node. In response to the second operation, the display device can obtain the first information and determine whether the display device supports the first communication mode and the second communication mode at the same time based on the first information. When the first information indicates that the display device supports the first communication mode and the second communication mode at the same time, the display device can enable the second network node corresponding to the second communication mode, so that while the first electronic device initiates hotspot screen projection to the display device through the first network node, the second electronic device can initiate point-to-point screen projection to the display device through the second network node. In this way, hotspot screen projection and point-to-point screen projection can be used simultaneously, so that the user can watch the projection data from two different electronic devices on the display device at the same time, thereby providing the user with a richer viewing experience.
[0247] According to some embodiments of the present application, a computer-readable non-volatile storage medium stores at least one executable instruction that, when executed on a display device / apparatus, causes the display device to execute the method of any of the above-described method embodiments. The executable instruction can specifically be used to cause the display device / apparatus to perform the following operations: if no next control operation is received within a preset time period after receiving a control operation, in response to the control operation, obtain the content to be displayed and the content to be released corresponding to the control operation; control the display to display the content to be displayed, and release the memory corresponding to the content to be released. In some embodiments, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable non-volatile storage media may include, but are not limited to: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0248] The algorithms or displays provided herein are not inherently related to any particular computer, virtual system, or other device. In addition, the embodiments of the present application are not directed to any particular programming language.
[0249] For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion of some embodiments is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The above embodiments are selected and described to better explain the content of this disclosure, thereby enabling those skilled in the art to better use the embodiments.
Claims
1. A display device, comprising: at least one network card capable of networking, the network card capable of networking being connected to a communication module, the communication module being configured to provide a network to the display device through the network card capable of networking; A wired network node is configured to connect to a first device, and the first device accesses a network through the wired network node; A hotspot network node, through which at least one second device accesses the network; a memory configured to store computer instructions and / or data associated with the display device; At least one processor is connected to the at least one networkable network card, the wired network node, the hotspot network node and the memory, and is configured to execute computer instructions to enable the display device to execute: If it is detected that the communication module provides the first network to the network card, and at least one of the second devices is connected to the hotspot network node, the first network is provided to the second device through the hotspot network node, so that the second device accesses the first network; Creating a first route between the network card and the wired network node, and providing the first network to the first device through the first route, so that the first device accesses the first network; A second route is created between the wired network node and the hotspot network node, so that the first device transmits a data packet to the second device based on the second route and the first network, or the second device transmits a data packet to the first device based on the second route and the first network.
2. The display device according to claim 1, wherein the at least one processor is further configured to execute computer instructions to cause the display device to perform: Configuring a first gateway address for the wired network node; If it is detected that a path is established between the wired network node and the first device, a second gateway address is configured for the first device according to the first gateway address, so that data packets are transmitted between the first device and the wired network node using the path according to the first gateway address and the second gateway address.
3. The display device according to claim 2, wherein the wired network node is a USB network card, the path includes the USB network card, a USB to LAN network card and a LAN to USB network card, the USB network card is connected to the USB to LAN network card, the USB to LAN network card is connected to the LAN to USB network card, and the LAN to USB network card is connected to the first device, wherein: The USB network card transmits a first USB signal to the USB to LAN network card, the USB to LAN converts the first USB signal into a network signal and then transmits it to the LAN to USB network card, and the LAN to USB network card converts the network signal into a second USB signal and then transmits it to the first device.
4. The display device according to claim 2, wherein the at least one processor is further configured to execute computer instructions to cause the display device to perform: Registering a monitoring event for at least one of the network-capable network cards, wherein: The monitoring event is used to detect whether the communication module provides a network to the network card.
5. The display device according to claim 1, wherein the display device comprises two network cards capable of networking, and the two network cards capable of networking are respectively a wired network card and a wireless network card, the wired network card is connected to a wired communication module, and the wireless network card is connected to a wireless communication module; The at least one processor is further configured to execute computer instructions to cause the display device to perform: If it is detected that the wired communication module provides a network to the wired network card and at the same time that the wireless communication module provides a network to the wireless network card, the network provided by the wired communication module to the wired network card is determined as the first network, and the first route between the wired network card and the wired network node is created.
6. The display device according to claim 5, wherein the at least one processor is further configured to execute computer instructions to cause the display device to perform: If it is detected that the wireless communication module provides a network to the wireless network card, the wired communication module is not detected. A network is provided to the wired network card, the network provided to the wireless network card by the wireless communication module is determined as the first network, and the first route between the wireless network card and the wired network node is created.
7. The display device according to claim 6, wherein the at least one processor is further configured to execute computer instructions to cause the display device to perform: When the wireless communication module provides a network to the display device through the wireless network card, if it is detected that the wired communication module provides a network to the wired network card, the network provided by the wireless communication module to the wireless network card is canceled as the first network, the network provided by the wired communication module to the wired network card is re-determined as the first network, the first route between the wireless network card and the wired network node is deleted, and the first route between the wired network card and the wired network node is created.
8. The display device according to claim 1, wherein the at least one processor is further configured to execute computer instructions to cause the display device to perform: When the hotspot network node is turned on, configuring a third gateway address for the hotspot network node; When the second device is connected to the hotspot network node, a fourth gateway address is configured for the second device according to the third gateway address, so that the second device accesses the first network using the fourth gateway address.
9. The display device according to claim 1, further comprising a display, wherein if the first network is provided to at least two of the second devices through the hotspot network node, the at least one processor is further configured to execute computer instructions to enable the display device to execute: A device list is displayed on the display, wherein: The device list includes at least two of the second devices; receiving a selection instruction input by a user, wherein the selection instruction represents the second device selected in the device list; According to the selection instruction, the first device is controlled to transmit a data packet to the selected second device based on the second route and the first network, or the selected second device is controlled to transmit a data packet to the first device based on the second route and the first network.
10. The display device according to claim 1, further comprising: A display configured to display projection data; A first wireless communication module is configured to establish a communication connection with the electronic device through a first communication mode; A second wireless communication module is configured to establish a communication connection with the electronic device through a second communication mode; The at least one processor is configured to execute the computer instructions to cause the display device to perform: In response to a first operation, enabling a first network node corresponding to the first communication mode, where the first communication mode is an access point mode and the first network node is a wireless access point; In response to the second operation, obtaining first information; When the first information indicates that the display device supports both the first communication mode and the second communication mode, enabling a second network node corresponding to the second communication mode, the second communication mode is a point-to-point network mode, and the second network node is a node in the point-to-point network; When the first screen projection data is received through the first network node and the second screen projection data is received through the second network node, the display is controlled to display the first screen projection data and the second screen projection data in a split-screen manner.
11. The display device according to claim 10, wherein the at least one processor is further configured to execute the computer instructions to cause the display device to perform: When the display device is started, a driver corresponding to the first wireless communication module is loaded, and the first network node is created through the first wireless communication module; Loading a driver corresponding to the second wireless communication module, and creating the second network node through the second wireless communication module; in, The identification information corresponding to the first network node and the identification information corresponding to the second network node both comply with a first identification rule.
12. The display device according to claim 11, wherein the at least one processor is further configured to execute the computer instructions to cause the display device to perform: A third network node and a fourth network node are created by using the first wireless communication module; wherein, The third network node is a wireless local area network node, the fourth network node is a node in a point-to-point network, the identification information corresponding to the third network node and the identification information corresponding to the fourth network node both comply with a second identification rule, and the second identification rule is different from the first identification rule.
13. The display device according to claim 11, wherein the at least one processor is further configured to execute the computer instructions to cause the display device to perform: A fifth network node and a sixth network node are created by using the first wireless communication module; wherein, The fifth network node is a wireless local area network node, and the identification information corresponding to the fifth network node complies with the first identification rule; the sixth network node is a wireless access point, and the priority of the sixth network node is lower than that of the second network node.
14. The display device according to any one of claims 10 to 13, wherein the at least one processor is further configured to execute the computer instructions to enable the display device to execute: Receiving a first screen projection connection request sent by a first electronic device; In response to the first screen projection connection request, establishing a communication connection with the first electronic device through the first network node; Based on the first network node, a communication connection is established with the first electronic device, and the first screen projection data sent by the first electronic device is received.
15. The display device according to any one of claims 10 to 13, wherein the at least one processor is further configured to execute the computer instructions to enable the display device to execute: Receiving a second screen projection connection request sent by a second electronic device; In response to the second screen projection connection request, establishing a communication connection with the second electronic device through the second network node; Establish a communication connection with the second electronic device based on the second network node, and receive the second screen projection data sent by the second electronic device.
16. The display device according to any one of claims 10 to 13, wherein the at least one processor is further configured to execute the computer instructions to enable the display device to execute: When the first network node is in an enabled state and the first information indicates that the display device cannot support both the first communication mode and the second communication mode, a prompt message is issued, wherein: The prompt information is used to prompt the user to shut down the first network node. 17 . The display device according to claim 10 , wherein the first wireless communication module is a WiFi chip, and the second wireless communication module is a WiFi chip.
18. A data processing method for a display device, the display device comprising at least one network card capable of networking, the network card capable of networking being connected to a communication module, the communication module being configured to provide a network to the display device through the network card capable of networking; A wired network node is configured to connect to a first device, and the first device accesses a network through the wired network node; A hotspot network node, through which at least one second device accesses the network; The method comprises: If it is detected that the communication module provides the first network to the network card, and at least one of the second devices is connected to the hotspot network node, the first network is provided to the second device through the hotspot network node, so that the second device accesses the first network; Creating a first route between the network card and the wired network node, and providing the first network to the first device through the first route, so that the first device accesses the first network; A second route is created between the wired network node and the hotspot network node, so that the first device transmits a data packet to the second device based on the second route and the first network, or the second device transmits a data packet to the first device based on the second route and the first network.
Citation Information
Patent Citations
Method for realizing common networking among multiple devices, storage medium and integrated machine with multiple devices
CN109039849A
Method and device for establishing network connection and electronic equipment
CN111182614A
Hotspot connection result feedback method and device, storage medium and electronic device
CN111465083A
Communication method and device, electronic equipment and storage medium
CN115297528A
Display device and screen projection method thereof
CN117061811A