Display apparatus, mobile terminal and method of adjusting resolution according to signal strength

Abstract

This application provides a display device, a mobile terminal, and a method for adjusting resolution based on signal strength. The method involves obtaining the Internet Protocol address (IPA) of the mobile terminal and detecting the network latency value between the mobile terminal and the IPA using the IPA and a first query command. If the network latency value is greater than a network latency threshold, a signal quality alert is generated and sent to the mobile terminal, causing the mobile terminal to send media data to the display device according to the alert. If the network latency value is less than or equal to the network latency threshold, the current network signal strength value is detected, and a target resolution is determined based on the signal strength value. This target resolution is then sent to the mobile terminal, enabling the mobile terminal to send media data to the display device according to the target resolution. This application dynamically adjusts the resolution of transmitted media data based on network conditions, selecting a resolution that matches the signal strength value, thus avoiding stuttering and screen tearing, and improving the user experience.

Description

Technical Field

[0001] This application relates to the field of display device technology, and more particularly to a display device, a mobile terminal, and a method for adjusting resolution based on signal strength. Background Technology

[0002] Display devices need to connect to a mobile Wi-Fi hotspot when playing online media or casting. Typically, Wi-Fi networks can operate in two modes: wireless router mode and Wi-Fi Direct (Wi-Fi Peer-to-Peer, P2P) mode. Wireless router mode is more common; for example, display devices can connect to a wireless router, access the internet, or perform multi-screen interactive casting through a wireless router. P2P, also known as Wi-Fi Direct, is a protocol released by the Wi-Fi Alliance. This mode allows devices on a wireless network to connect to each other point-to-point without a wireless router. For example, Miracast casting is in P2P mode, allowing mobile phones to directly transmit videos or photos to TVs or other display devices without any cables or a wireless router.

[0003] Wi-Fi networks are susceptible to interference from other devices, which can cause stuttering and screen flickering. To avoid this interference, display devices can adjust the output media resolution based on the network signal strength. For example, the display device can detect the Received Signal Strength Indication (RSSI) of the Wi-Fi network. A strong Wi-Fi signal indicates high transmission capacity and low interference, allowing for the transmission of higher resolution media. Conversely, a weak Wi-Fi signal indicates low transmission capacity and high interference, necessitating the transmission of lower resolution media. This allows the transmitted media resolution to change with signal strength, thus preventing stuttering and screen flickering.

[0004] However, some display devices cannot detect network signal strength. For example, some display devices are based on the Android system, which only provides signal strength detection in wireless router mode and not in P2P mode. Therefore, in P2P mode, these display devices cannot detect the signal strength of the WIFI network and cannot adjust the output media resolution according to the signal strength. This may cause the displayed media to stutter or have a distorted screen, affecting the user experience. Summary of the Invention

[0005] This application provides a display device, a mobile terminal, and a method for adjusting resolution based on signal strength. The method can detect the signal strength of a WIFI network and adjust the resolution of the output media files according to the signal strength, thereby avoiding stuttering and screen tearing of the media files displayed on the display device and improving the user experience.

[0006] In a first aspect, some embodiments of this application provide a display device, including:

[0007] The monitor is configured to display the user interface;

[0008] The communicator is configured to establish a communication connection with the mobile terminal;

[0009] The controller is configured as follows:

[0010] Obtain the Internet Protocol address of the mobile terminal;

[0011] Detect the network latency value with the mobile terminal based on the Internet Protocol address and the first query command;

[0012] If the network latency value is greater than the network latency threshold, a signal quality alert is generated and the signal quality alert is sent to the mobile terminal so that the mobile terminal sends media data to the display device according to the signal quality alert;

[0013] If the network latency value is less than or equal to the network latency threshold, the signal strength value of the current network is detected; the target resolution is determined based on the signal strength value, and the target resolution is sent to the mobile terminal so that the mobile terminal sends media data to the display device according to the target resolution.

[0014] Based on the above-mentioned display device, the first aspect of this application also provides a method for adjusting resolution according to signal strength, the method comprising the following steps:

[0015] Obtain the Internet Protocol address of the mobile terminal;

[0016] Detect the network latency value with the mobile terminal based on the Internet Protocol address and the first query command;

[0017] If the network latency value is greater than the network latency threshold, a signal quality alert is generated and the signal quality alert is sent to the mobile terminal so that the mobile terminal sends media data to the display device according to the signal quality alert;

[0018] If the network latency value is less than or equal to the network latency threshold, the signal strength value of the current network is detected; the target resolution is determined based on the signal strength value, and the target resolution is sent to the mobile terminal so that the mobile terminal sends media data to the display device according to the target resolution.

[0019] As can be seen from the above technical solutions, the display device and the method for adjusting resolution based on signal strength provided in the first aspect of this application obtain the Internet Protocol address of the mobile terminal and detect the network latency value with the mobile terminal based on the Internet Protocol address and a first query command. If the network latency value is greater than a network latency threshold, a signal quality prompt is generated and sent to the mobile terminal, so that the mobile terminal sends media data to the display device according to the prompt; if the network latency value is less than or equal to the network latency threshold, the current network signal strength value is detected; and a target resolution is determined based on the signal strength value, and the target resolution is sent to the mobile terminal, so that the mobile terminal sends media data to the display device according to the target resolution. This application can dynamically adjust the resolution of the transmitted media data according to the network operation status, select a media data resolution that matches the signal strength value, avoid stuttering and screen tearing of the media data, and improve the user experience.

[0020] Secondly, some embodiments of this application also provide a mobile terminal, including:

[0021] The display unit is configured to display the terminal interface;

[0022] The communication unit is configured to establish a communication connection with the display device;

[0023] The processor is configured as follows:

[0024] Receive a signal quality prompt sent by a display device, wherein the signal quality prompt is a prompt message generated by the display device when the network latency value is greater than a network latency threshold;

[0025] Media data is sent to the display device according to the signal quality indication;

[0026] The display device receives a target resolution sent by the display device, wherein the target resolution is a resolution determined by the display device based on the current network signal strength value when the network latency value is less than or equal to the network latency threshold;

[0027] Media data is sent to the display device according to the target resolution.

[0028] Based on the aforementioned mobile terminal, a second aspect of this application also provides a method for adjusting resolution according to signal strength, the method comprising the following steps:

[0029] Receive a signal quality prompt sent by a display device, wherein the signal quality prompt is a prompt message generated by the display device when the network latency value is greater than a network latency threshold;

[0030] Media data is sent to the display device according to the signal quality indication;

[0031] The display device receives a target resolution sent by the display device, wherein the target resolution is a resolution determined by the display device based on the current network signal strength value when the network latency value is less than or equal to the network latency threshold;

[0032] Media data is sent to the display device according to the target resolution.

[0033] As can be seen from the above technical solutions, the mobile terminal and the method for adjusting resolution based on signal strength provided in the second aspect of this application can adjust the resolution of the transmitted media in a timely manner according to the feedback from the display device, select a media resolution that matches the signal strength value, and adjust the output resolution of the media according to the changes in signal strength, so as to avoid the phenomenon of stuttering and screen distortion in the media displayed by the display device, thereby improving the user experience. Attached Figure Description

[0034] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0035] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0036] Figure 2 Hardware configuration block diagrams of display devices provided in some embodiments of this application;

[0037] Figure 3 Hardware configuration block diagrams of control devices provided in some embodiments of this application;

[0038] Figure 4 This is a schematic diagram of the software configuration in a display device provided in some embodiments of this application;

[0039] Figure 5 This application provides a schematic flowchart illustrating a method for adjusting resolution based on signal strength in a display device according to some embodiments.

[0040] Figure 6 A schematic diagram illustrating the process of establishing a network connection channel between a display device and a mobile terminal, provided in some embodiments of this application;

[0041] Figure 7 This application provides schematic diagrams illustrating the effect of a display device generating signal quality prompts in some embodiments of the present application.

[0042] Figure 8 This application provides schematic diagrams illustrating the architecture and interaction of display devices and mobile terminals in some embodiments.

[0043] Figure 9 This application provides a schematic diagram of a process for a display device to detect the signal strength value of the current network, as shown in some embodiments.

[0044] Figure 10 A schematic diagram illustrating the process of creating a signal detection node provided in some embodiments of this application;

[0045] Figure 11 This is a schematic diagram illustrating the signal strength value calculation process of a signal detection node provided in some embodiments of this application;

[0046] Figure 12 A flowchart illustrating the process of determining the target resolution provided for some embodiments of this application;

[0047] Figure 13 This is a schematic flowchart illustrating a method for adjusting resolution based on signal strength performed by a mobile terminal according to some embodiments of this application. Detailed Implementation

[0048] To make the objectives, technical solutions, and advantages of some embodiments of this application clearer, the technical solutions of some embodiments of this application will be clearly and completely described below with reference to specific embodiments and corresponding drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments.

[0049] It should be noted that the brief descriptions of terms in some embodiments of this application are only for the convenience of understanding the implementation methods described below, and are not intended to limit the implementation methods of some embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0050] In some embodiments of this application, the terms "first," "second," "third," etc., in the specification, claims, and accompanying drawings are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms can be used interchangeably where appropriate.

[0051] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0052] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0053] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, the user can operate the display device 200 through the mobile terminal 300 and the control device 100.

[0054] In some embodiments, the mobile terminal 300 may install software applications with the display device 200 to establish a connection and communication via a network communication protocol, thereby achieving one-to-one control operation and data communication. Alternatively, audio and video content displayed on the mobile terminal 300 can be transmitted to the display device 200 to achieve synchronous display.

[0055] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0056] In addition to providing broadcast television reception functions, the display device 200 can also be equipped with intelligent network television functions that provide computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0057] Figure 2 This is a hardware configuration block diagram of a display device 200 provided in some embodiments of this application.

[0058] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0059] In some embodiments, the detector 230 is used to collect signals from the external environment or to interact with the outside world.

[0060] In some embodiments, the display 260 includes a display screen component for presenting an image, a driving component for driving image display, a component for receiving image signals output from a controller, and a user control UI interface, etc.

[0061] In some embodiments, the communicator 220 is a component for communicating with external devices or the server 400 according to various communication protocol types.

[0062] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0063] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0064] In some embodiments, user interface 280 is an interface that can be used to receive control input.

[0065] Figure 3 This is a hardware configuration block diagram of a control device provided in some embodiments of this application. For example... Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0066] The control device 100 is configured to control the display device 200, and to receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0067] In some embodiments, the control device 100 may be an intelligent device. For example, the control device 100 may be equipped with various applications for controlling the display device 200 according to user needs.

[0068] In some embodiments, such as Figure 1 As shown, the mobile terminal 300 or other smart electronic devices can perform similar functions to the control device 100 after installing the application of the control display device 200.

[0069] The controller 110 includes a processor unit 112, RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.

[0070] Under the control of the controller 110, the communication interface 130 enables communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of other near-field communication modules such as WiFi chip 131, Bluetooth module 132, and NFC module 133.

[0071] User input / output interface 140, wherein the input interface includes at least one of other input interfaces such as microphone 141, touchpad 142, sensor 143, button 144, etc.

[0072] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, which can encode user input commands via WiFi, Bluetooth, or NFC protocols and send them to the display device 200.

[0073] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can also store various control signal instructions input by the user.

[0074] The power supply 180 is used to provide operating power support for the various components of the control device 100 under the control of the controller.

[0075] Figure 4 The diagram illustrates the software configuration in a display device according to some embodiments of this application. In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (hereinafter referred to as the "Application Layer"), the Application Framework layer (hereinafter referred to as the "Framework Layer"), the System Library layer (hereinafter referred to as the "System Runtime Library Layer"), and the Kernel Layer.

[0076] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs that come with the operating system, system settings programs, clock programs, camera applications, etc., or they may be applications developed by third-party developers.

[0077] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer.

[0078] like Figure 4As shown, in some embodiments of this application, the application framework layer includes managers, content providers, and a view system. The managers include at least one of the following modules: an Activity Manager for interacting with all activities running in the system; a Location Manager for providing system services or applications with access to system location services; a Package Manager for retrieving various information related to application packages currently installed on the device; a Notification Manager for controlling the display and clearing of notification messages; and a Window Manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0079] In some embodiments, the Activity Manager is used to: manage the lifecycle of individual applications and the usual navigation back functionality.

[0080] In some embodiments, the window manager is used to manage all window programs.

[0081] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is accessed, the operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0082] In some embodiments, the kernel layer is a layer between hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.).

[0083] In some embodiments, the kernel layer also includes a power driver module for power management.

[0084] In some embodiments, Figure 4 The software programs and / or modules corresponding to the software architecture in the document are stored in [the relevant database]. Figure 2 or Figure 3 In the first or second memory shown.

[0085] Based on the aforementioned display device 200, network media can be played or screen mirroring can be performed. Whether playing media or screen mirroring, a Wi-Fi network connection is required. The Wi-Fi network can operate in wireless router mode and P2P mode; regardless of the mode used, communication between the mobile terminal 300 and the display device 200 can be achieved.

[0086] During the communication connection between the mobile terminal 300 and the display device 200, the Wi-Fi network is susceptible to interference from signals from other devices. For example, Wi-Fi networks are easily interfered with by signals from devices operating on the 2.4GHz frequency band, such as microwave ovens, Bluetooth devices, cordless phones, refrigerators, and RF remote controls. If a strong magnetic field exists near the Wi-Fi network, the wireless network will also be interfered with. When multiple wireless devices are present in a wireless network environment, such as a user's own mobile router and a neighbor's mobile router operating simultaneously, channel conflicts may occur. Furthermore, strong signal interference sources such as radio towers, welding machines, trams, or high-voltage power transformers may also cause strong interference to wireless signals or devices. When the Wi-Fi network is interfered with by signals from other devices, the unstable signal can easily lead to stuttering and screen flickering.

[0087] To reduce interference from other signals to the Wi-Fi network, in some embodiments, the display device 200 can adjust the output media resolution based on the network signal strength (RSSI). RSSI refers to the signal strength of the wireless network when receiving data, and it is related to factors such as the transmission power of the wireless module, the design of the RF front-end, and the antenna gain. Signal strength is measured in power and can be expressed in dBm. When the Wi-Fi network is subject to wireless interference, the signal strength of the wireless network will change dynamically. Typically, the signal strength is negative, and the smaller the negative value, the better the signal. Therefore, to some extent, the degree of interference to the Wi-Fi network can be analyzed using signal strength. For example, a high Wi-Fi signal strength indicates high transmission capability and low interference, allowing the transmission of high-resolution media; conversely, a low Wi-Fi signal strength indicates low transmission capability and high interference, allowing the transmission of low-resolution media. This allows the transmitted media resolution to change with the signal strength, thereby avoiding stuttering and screen tearing.

[0088] However, in some embodiments, some display devices 200 cannot detect signal strength in the P2P mode of a Wi-Fi network, and therefore cannot adjust the output media resolution according to the signal strength. For example, Miracast is a wireless display standard based on direct Wi-Fi connection, which supports two Wi-Fi networks directly connecting and communicating with each other without a wireless router. Miracast projection is based on Wi-Fi's P2P mode and typically uses the User Datagram Protocol (UDP). However, although UDP provides connectionless communication, it does not provide reliability guarantees for transmitted data packets, resulting in low reliability and decreased communication quality in poor network signal environments.

[0089] For example, when Miracast transmits data packets based on the User Datagram Protocol (UDP) in scenarios with poor signal, there will be a certain degree of packet loss, and this packet loss is usually permanent and will not be retransmitted. Therefore, when packet loss occurs, a certain frame of image data will be incomplete. When the display device 200 receives the data packet, the player will fill in a color block at the lost packet location. At this time, the user's screen displayed on the display device 200 may exhibit phenomena such as screen tearing and stuttering, thereby affecting the user experience.

[0090] To address issues such as screen tearing and stuttering caused by packet loss, some embodiments can analyze the root cause of these problems. Specifically, when the mobile terminal 300 transmits media data to the display device 200, it typically includes various resolutions, such as 640×480, 720×576, 1280×720, and 1920×1080. The corresponding video frame rates are usually 30 or 60 frames per second. Higher resolutions correspond to higher frame rates and larger data packets, resulting in more information in each frame. Therefore, if packet loss occurs, higher resolutions are more likely to experience screen tearing and stuttering. Thus, the resolution of the media data transmitted by the mobile terminal 300 can be adaptively adjusted based on the strength of the Wi-Fi signal.

[0091] For example, using Miracast as an example, the Miracast protocol provides multiple resolution formats. High resolution transmits more data, while low resolution transmits less. Therefore, to ensure the quality of the user's image displayed on the display device 200, a lower resolution media is selected for transmission at the beginning of the transmission between the mobile terminal 300 and the display device 200, thereby reducing the amount of data transmitted and ensuring smooth initial transmission. Simultaneously, a resolution threshold can be set to determine the resolution. This allows for the transmission of lower resolution media when the signal strength is low, and higher resolution media when the signal strength is high. In summary, before determining the resolution of the media transmitted between the mobile terminal 300 and the display device 200, the signal strength of the Wi-Fi network needs to be determined first.

[0092] This application aims to address situations where signal strength cannot be detected in P2P mode and other Wi-Fi networks. To detect Wi-Fi signal strength and adjust the output media resolution based on the signal strength, thus preventing stuttering and screen tearing on the displayed media, some embodiments of this application provide a display device 200, including a display 260, a communicator 220, and a controller 260. The display 260 is configured to display a user interface; the communicator 220 is configured to establish a communication connection with a mobile terminal 300.

[0093] To facilitate understanding of the technical solutions in some embodiments of this application, the steps are described in detail below with reference to some specific embodiments and accompanying drawings. Figure 5 This application provides a schematic flowchart illustrating a method for adjusting resolution based on signal strength in a display device according to some embodiments, such as... Figure 5 As shown, in some embodiments of this application, the controller 250 is configured to perform the following steps S1-S4:

[0094] Step S1: Display device 200 obtains the Internet Protocol address of mobile terminal 300.

[0095] Figure 6 A schematic diagram illustrating the process of establishing a network connection channel between a display device and a mobile terminal, as provided in some embodiments of this application, is shown below. Figure 6 As shown, in some embodiments, before obtaining the Internet Protocol address of the mobile terminal 300, the display device 200 may also perform the following process: first, receive the network connection request sent by the mobile terminal 300; then, establish a network connection channel according to the network connection request; and finally, allocate Internet Protocol addresses to the mobile terminal 300 and the display device 200 based on the network connection channel.

[0096] For example, before establishing a Wi-Fi connection between the display device 200 and the mobile terminal 300, the mobile terminal 300 sends a network connection request to the display device 200. After sending the request, the mobile terminal 300 can sequentially broadcast the network connection request through its driver layer, system architecture layer, and Wi-Fi connection service layer via a broadcast service, so that the display device 200 can receive the request. After receiving the network connection request, the display device 200 can establish a network connection channel based on the request. This network connection channel can be used for media asset transmission and communication between the display device 200 and the mobile terminal 300. In some embodiments, after the network connection channel is successfully established, a confirmation signal indicating successful establishment can be sent. Finally, Internet Protocol addresses can be assigned to the mobile terminal 300 and the display device 200 based on the successfully established network connection channel. For example, after the network connection channel between the two is successfully established, IP addresses can be assigned to the display device 200 and the mobile terminal 300 respectively. These IP addresses can serve as the data basis for subsequent determination of network transmission quality and the protocol basis for communication between the display device 200 and the mobile terminal 300. After step S1 is completed, step S2 can be executed.

[0097] Step S2: Display device 200 detects the network latency value with mobile terminal 300 based on Internet Protocol address and first query command.

[0098] In step S1, IP addresses have been assigned to the mobile terminal 300 and the display device 200 based on the successfully established network connection channel. On this basis, the display device 200 can detect the network latency value between itself and the mobile terminal 300 according to the Internet Protocol IP address and the first query command, so as to understand the current WIFI network transmission quality through the network latency value.

[0099] In some embodiments, the first query command can be a ping command. After the display device 200 obtains the IP address of the mobile terminal 300, it can use the ping command to detect the latency status with the mobile terminal 300 and obtain the ping value. The ping value can determine the network condition to a certain extent and serve as the data basis for determining the resolution of media transmission. After step S2 is completed, step S3 can be executed.

[0100] Step S3: If the network latency value is greater than the network latency threshold, the display device 200 generates a signal quality prompt and sends the signal quality prompt to the mobile terminal 300, so that the mobile terminal 300 sends media data to the display device 200 according to the signal quality prompt.

[0101] To determine the data basis for media asset transmission resolution, in some embodiments, a network latency threshold can be preset. The network latency threshold can be set based on the actual transmission situation between the display device 200 and the mobile terminal 300, or it can be determined based on practical experience; the specific value is not limited in this application. The unit of the network latency threshold is typically milliseconds. In some embodiments, the network latency threshold can be determined in the following way.

[0102] For example, the correlation between network latency values ​​and actual usage scenarios, as tested, is as follows: When the network latency is 1–30 ms, the network speed is extremely fast, with almost no noticeable latency; playing any game, logging into web pages, and watching videos are all exceptionally smooth. When the network latency is 31–50 ms, the network speed is good; games, web pages, and videos can be played normally without noticeable latency. When the network latency is 51–100 ms, the network speed is average; for competitive games at a certain skill level, latency can be felt, but logging into web pages and watching videos are also possible. Occasional pauses may be felt; when network latency is between 100ms and 200ms, network speed is poor, making it impossible to play competitive games normally, and there is noticeable lag when logging into web pages or watching videos, with occasional packet loss; when network latency is between 200ms and 500ms, network speed is very poor, with noticeable delays and lag when accessing web pages, frequent packet loss or inability to access them; when network latency is >500ms, network speed is extremely poor, with unacceptable latency and packet loss, and even inability to access web pages; when network latency is >1000ms, almost all web pages are inaccessible. Therefore, the network latency threshold can be determined by combining the actual network operation and the corresponding relationship between network latency values.

[0103] In order to determine the resolution of the media assets sent by the mobile terminal 300 to the display device 200, in some embodiments, the following rule can be formulated: if the network latency value is greater than the network latency threshold, the display device 200 generates a signal quality prompt, which is a prompt message generated by the display device 200 when the network latency value is greater than the network latency threshold, and sends the signal quality prompt to the mobile terminal 300 so that the mobile terminal 300 sends the media assets to the display device 200 according to the signal quality prompt.

[0104] In some embodiments, the network latency threshold can be set to 50ms. It is understood that when the network latency threshold is greater than 50ms, it indicates poor network transmission quality, which may result in screen tearing and stuttering. When the network latency threshold is less than 50ms, it indicates good network transmission quality and smooth transmission. Based on this, when the network latency value is greater than the network latency threshold of 50ms, the display device 200 can generate a poor signal quality prompt. Figure 7This application provides schematic diagrams illustrating the effect of a display device generating signal quality indicators in some embodiments, such as... Figure 7 As shown, when the network latency exceeds 50ms, the display device 200 generates a poor signal quality warning, such as "The current Wi-Fi signal is poor; it is recommended to transmit low-resolution media," and transmits this warning to the mobile terminal 300. Upon receiving this warning, the mobile terminal 300 can then select low-resolution media to mitigate packet loss and screen flickering issues caused by poor network signal, thereby improving the user experience.

[0105] To support the selection of different media resolutions, modules that communicate with each other can be deployed within the display device 200 and the mobile terminal 300. Figure 8 This application provides schematic diagrams of display device and mobile terminal architecture and interaction in some embodiments, such as... Figure 8 As shown, in some embodiments, the mobile terminal 300 may be deployed with a device discovery module 301, a networking module 302, an IP allocation module 303, a negotiation module 304, and a media asset transmission module 305. Specifically, the device discovery module 301 is used to discover devices that communicate with it on the network, such as the display device 200; the networking module 302 is used to establish a networking connection channel with the networked devices; the IP allocation module 303 is used to allocate Internet Protocol (IP) addresses; the negotiation module 304 is used to establish a negotiation interface with the networked devices and determine the resolution to be used based on signal strength and quality; and the media asset transmission module 305 is used to send media assets to the display device 200 at the determined resolution.

[0106] In some embodiments, the display device 200 may be deployed with a device discovery module 201, a networking module 202, an IP allocation module 203, a signal quality detection module 204, a negotiation module 205, and a media asset receiving module 206. Specifically, the device discovery module 201 is used to discover devices connected to the network, such as the mobile terminal 300; the networking module 202 is used to establish a networking connection channel with the networked devices; the IP allocation module 203 is used to allocate Internet Protocol (IP) addresses; the signal quality detection module 204 is used to detect the signal strength values ​​between the device and the networked devices, using this as a basis for selecting the resolution; the negotiation module 205 is used to establish a negotiation interface with the networked devices and determine the resolution to be used based on the signal strength quality; and the media asset receiving module 206 is used to receive media assets sent by the mobile terminal 300. After step S3 is completed, step S4 can be executed.

[0107] Step S4: If the network latency value is less than or equal to the network latency threshold, the display device 200 detects the current network signal strength value; determines the target resolution based on the signal strength value, and sends the target resolution to the mobile terminal 300, so that the mobile terminal 300 sends media data to the display device 200 according to the target resolution.

[0108] While network latency can provide some indication of network signal strength, tests have shown that packet loss can still occur even with very low latency. Because packet loss is a fluctuating phenomenon, relying solely on network latency to determine network signal strength is not entirely accurate.

[0109] To further ensure the accuracy of the selected resolution, in some embodiments of this application, network latency and signal strength are combined. The combined approach determines under what circumstances low-resolution media assets should be transmitted and under what circumstances high-resolution media assets should be transmitted, providing a basis for the distinction between high and low resolution. The established rules can be as follows: if the network latency value is less than or equal to a network latency threshold, the display device 200 detects the current network signal strength value; determines a target resolution based on the signal strength value, wherein the target resolution is the resolution of the media assets to be transmitted determined by the display device 200 based on the current network signal strength value when the network latency value is less than or equal to the network latency threshold; and sends the target resolution to the mobile terminal 300, so that the mobile terminal 300 sends the media assets to the display device 200 according to the target resolution.

[0110] For example, still taking a network latency threshold of 50ms as an example, if the network latency value is less than or equal to the network latency threshold of 50ms, it indicates that the network transmission quality is good, and there is a high probability that screen flickering or stuttering will not occur. However, there is still a probability that such phenomena will occur. Therefore, in order to further ensure the quality of the user's image displayed by the display device 200, the display device 200 can continue to detect the current network signal strength value and determine the target resolution based on the signal strength value.

[0111] Figure 9 This is a schematic diagram illustrating the process of a display device detecting the signal strength value of the current network according to some embodiments of this application, such as... Figure 9 As shown, in some embodiments, when the display device 200 detects the signal strength value of the current network, it can send a signal strength acquisition request to the server 400. After receiving the strength acquisition request, the server 400 will send back signal strength information about the request to the display device 200. After receiving the signal strength information fed back by the server 400 based on the signal strength acquisition request, the display device 200 can parse the signal strength information to obtain the signal strength parameters. At the same time, it can read the signal strength parameters according to the second query command to detect the signal strength value of the current network.

[0112] For example, if server 400 can be a media asset provider, then display device 200 can send a signal strength acquisition request to the media asset provider when detecting the signal strength value of the current network. After receiving the strength acquisition request, the media asset provider can provide signal strength information back to display device 200. After receiving the signal strength information from the media asset provider, display device 200 parses the signal strength information to obtain signal strength parameters. The signal strength parameters include at least the signal strength value and may also include other content. Typically, the content of the signal strength parameters varies depending on the media asset provider. After parsing the signal strength parameters, they can be read using a second query command. For example, the second query command can be the iwpriv command. iwpriv is an auxiliary tool for configuring the iwconfig wireless network interface, used to configure various private optional parameters of the wireless network interface. iwpriv can configure or read relevant information of the wireless network card through commands. In this embodiment, the signal strength value provided by the media asset provider can be read using the iwpriv command. For example, the signal strength value can be read using the signal quality detection module 204.

[0113] It should be noted that the display device 200 requires certain prerequisites to read the signal strength value; a signal detection node needs to be established. Only with a signal detection node can the signal strength value fed back by the server 400 be read or detected; otherwise, reading via the iwpriv command will fail. In other words, before executing the command to read the signal strength value, a signal detection node must first be created. The following is a description of the signal detection node.

[0114] Figure 10 This is a flowchart illustrating the creation of a signal detection node provided in some embodiments of this application, such as... Figure 10 As shown, in some embodiments, in response to a confirmation signal indicating successful establishment of the network connection channel, the display device 200 can create a signal detection node based on the network connection channel and detect the node signal strength value of the signal detection node. In some embodiments, by establishing a signal detection node, a preset identifier can be used to determine which nodes are P2P mode nodes and which are other mode nodes. In this way, it is possible to find out which signal detection node the signal strength value to be detected belongs to, facilitating its location.

[0115] Figure 11 This is a schematic diagram illustrating the signal strength value calculation process of a signal detection node provided in some embodiments of this application, such as... Figure 11As shown, when calculating the signal strength value of a certain signal detection node, the node signal strength value can first be acquired periodically at a preset time interval. Then, the node signal strength values ​​are accumulated to obtain the total signal strength value of the signal detection node. Next, the cumulative number of acquisitions of the node signal strength value is obtained. Finally, the average node strength value is calculated based on the total signal strength value and the cumulative number of acquisitions, which is used as the signal strength value of the signal detection node. In this way, the signal strength value of the signal detection node can be calculated.

[0116] For example, the preset time interval can be set to 5 minutes. The signal strength value of signal detection node A is periodically acquired every 5 minutes. Assuming three acquisitions are performed, with results of -50dBm, -55dBm, and -60dBm respectively, the total signal strength value is the sum of these three values, which is -165dBm. The cumulative acquisition count is 3. Therefore, the average node strength value = total signal strength value / cumulative acquisition count = -55dBm. Thus, the signal strength value of node A is -55dBm. By using an average value, errors caused by network anomalies can be avoided, resulting in more accurate calculations.

[0117] To conserve network resources, in some embodiments, in response to an event that the display device 200 and the mobile terminal 300 lose their communication connection, the display device 200 destroys the signal detection node and simultaneously disconnects the network connection channel. That is, in this embodiment, the network connection channel only exists when the display device 200 and the mobile terminal 300 are connected; once they are disconnected, the network connection channel no longer exists.

[0118] In order to determine the target resolution based on the signal strength value, in some embodiments, the display device 200 may perform the following process. Figure 12 This is a schematic diagram of the process for determining the target resolution provided in some embodiments of this application, such as... Figure 12 As shown, a signal strength threshold can be set for the signal strength, and a threshold resolution can be set for the resolution of the transmitted media. Certain judgment rules are then established based on the signal strength threshold and the threshold resolution. The threshold resolution serves as a standard to distinguish between high and low resolution. When the resolution of the media is higher than the threshold resolution, the corresponding resolution of the media is considered high resolution; when the resolution of the media is lower than the threshold resolution, the corresponding resolution of the media is considered low resolution.

[0119] For example, since signal strength is a negative value, and a smaller negative value indicates a better signal, if the current network signal strength is greater than a set signal strength threshold, it indicates poor network transmission quality. In this case, the mobile terminal 300 can be notified to send low-resolution media data. Therefore, when the current network signal strength is greater than the set signal strength threshold, a first set of resolutions supported by the display device 200 can be generated and sent to the mobile terminal 300 so that the mobile terminal 300 can select a target resolution from the first set. Here, the first resolution is less than the threshold resolution; it can be understood that the first resolution is a low resolution. Therefore, when the current network signal strength is greater than the set signal strength threshold, the display device 200 will indicate that the current network transmission quality is poor, which may lead to screen tearing, stuttering, etc., and suggests that the mobile terminal 300 transmit media data at a low resolution.

[0120] If the current network signal strength is less than or equal to the set signal strength threshold, it indicates good network transmission quality. In this case, the mobile terminal 300 can be notified to send high-resolution media data. Therefore, when the current network signal strength is less than or equal to the set signal strength threshold, a second set of resolutions supported by the display device 200 can be generated and sent to the mobile terminal 300 so that the mobile terminal 300 can select the target resolution from the second set. Here, the second resolution being greater than or equal to the threshold resolution can be understood as the second resolution being high resolution. Therefore, when the current network signal strength is less than or equal to the set signal strength threshold, the display device 200 will indicate that the current network transmission quality is good and that screen tearing or stuttering is unlikely, suggesting that the mobile terminal 300 transmit media data at high resolution.

[0121] Understandably, the display device 200 can read signal strength values ​​in real time or periodically, therefore, the signal strength values ​​will change. Correspondingly, the resolution supported by the display device will also change accordingly. This allows for dynamic adjustment of the media transmission resolution based on the actual network operation, selecting a media resolution that matches the signal strength value. Thus, after detecting the Wi-Fi network signal strength, the display device 200 adjusts the output media resolution based on the signal strength, preventing stuttering and screen tearing in the displayed media, thereby improving the user experience.

[0122] As can be seen from the above technical solutions, the display device 200 provided in the above embodiments can obtain the Internet Protocol address of the mobile terminal 300, and detect the network latency value with the mobile terminal 300 based on the Internet Protocol address and the first query command. If the network latency value is greater than the network latency threshold, a signal quality prompt is generated and sent to the mobile terminal 300, so that the mobile terminal 300 sends media data to the display device 200 according to the signal quality prompt; if the network latency value is less than or equal to the network latency threshold, the current network signal strength value is detected; and a target resolution is determined based on the signal strength value, and the target resolution is sent to the mobile terminal 300, so that the mobile terminal 300 sends media data to the display device 200 according to the target resolution. Through the above-mentioned display device 200, the resolution of media data transmission can be dynamically adjusted according to the actual network operation, selecting a media data resolution that matches the signal strength value, and adjusting the output resolution of the media data according to changes in signal strength, avoiding stuttering and screen tearing phenomena in the media data displayed by the display device 200, thereby improving the user experience.

[0123] Based on the display device 200 described above, some embodiments of this application also provide a method for adjusting resolution according to signal strength, which can be applied to the display device 200 in the above embodiments. The method may include the following steps:

[0124] Obtain the Internet Protocol address of the mobile terminal 300;

[0125] Based on the Internet Protocol address and the first query command, the network latency value with mobile terminal 300 is detected;

[0126] If the network latency value is greater than the network latency threshold, a signal quality prompt is generated and sent to the mobile terminal 300, so that the mobile terminal 300 sends media data to the display device 200 according to the signal quality prompt;

[0127] If the network latency value is less than or equal to the network latency threshold, the signal strength value of the current network is detected; the target resolution is determined based on the signal strength value, and the target resolution is sent to the mobile terminal 300 so that the mobile terminal 300 sends media data to the display device 200 according to the target resolution.

[0128] As can be seen from the above technical solutions, the method for adjusting the resolution based on signal strength provided in the above embodiments can dynamically adjust the resolution of media transmission according to the actual network operation, select a media resolution that matches the signal strength value, and adjust the output resolution of the media according to the changes in signal strength, so as to avoid the phenomenon of stuttering and screen distortion of the media displayed on the display device 200, and improve the user experience.

[0129] This application also provides a mobile terminal 300 in some embodiments, including a display unit 310, a communication unit 320, and a processor 330. The display unit 310 is configured to display a terminal interface; the communication unit 320 is configured to establish a communication connection with a display device 200. Figure 13 This application provides a schematic flowchart of a method for adjusting resolution based on signal strength in a mobile terminal, as shown in some embodiments. Figure 13 As shown, in some embodiments, processor 330 is configured to execute the following process:

[0130] In some embodiments, when the network latency value is greater than the network latency threshold, the mobile terminal 300 can receive a signal quality prompt sent by the display device 200. The signal quality prompt is a prompt message generated by the display device 200 when the network latency value is greater than the network latency threshold, and the mobile terminal 300 can send media data to the display device 200 according to the signal quality prompt.

[0131] In other embodiments, when the network latency value is less than or equal to the network latency threshold, the mobile terminal 300 can receive the target resolution sent by the display device 200. The target resolution is the resolution determined by the display device 200 based on the current network signal strength value when the network latency value is less than or equal to the network latency threshold, and the mobile terminal 300 sends media data to the display device 200 according to the target resolution.

[0132] In order to determine the target resolution, in some embodiments, if the signal strength value of the current network is greater than a set signal strength threshold, the mobile terminal 300 can receive a first set of resolutions sent by the display device 200, filter out the target resolution from the first set of resolutions, and send media data to the display device 200 according to the target resolution; if the signal strength value of the current network is less than or equal to the signal strength threshold, the mobile terminal 300 can receive a second set of resolutions sent by the display device 200, filter out the target resolution from the second set of resolutions, and send media data to the display device 200 according to the target resolution.

[0133] As can be seen from the above technical solutions, the mobile terminal 300 provided in the above embodiments can adjust the resolution of the transmitted media in a timely manner according to the feedback of the display device 200, select the media resolution that matches the signal strength value, and adjust the output resolution of the media according to the changes in signal strength, so as to avoid the phenomenon of stuttering and screen distortion of the media displayed by the display device 200, and improve the user experience.

[0134] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0135] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0136] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0137] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the user interface; The communicator is configured to establish a communication connection with the mobile terminal; The controller is configured as follows: Receive network connection requests sent by mobile terminals; Establish a network connection channel according to the network connection request; Based on the network connection channel, Internet Protocol addresses are allocated to the mobile terminal and the display device; In response to the confirmation signal indicating successful establishment of the network connection channel, a signal detection node is created based on the network connection channel; When the signal strength cannot be detected in the P2P mode of the WIFI network, obtain the Internet Protocol address of the mobile terminal; The network latency value with the mobile terminal is detected based on the Internet Protocol address and the first query command, wherein the first query command is a ping command and the network latency value is the ping value; If the network latency value is greater than the network latency threshold, a signal quality prompt is generated and the signal quality prompt is sent to the mobile terminal so that the mobile terminal sends media data to the display device according to the signal quality prompt. The signal quality prompt is used to characterize poor signal quality and suggest that the mobile terminal transmit media data at a low resolution. The low resolution is a media resolution lower than a preset threshold resolution. If the network latency value is less than or equal to the network latency threshold, the signal strength value of the signal detection node is detected; a current network signal strength acquisition request is sent to the server; signal strength information is received from the server based on the signal strength acquisition request; the signal strength information is parsed to obtain signal strength parameters; the signal strength parameters are read according to a second query command to detect the current network signal strength value; a target resolution is determined based on the signal strength value, and the target resolution is sent to the mobile terminal so that the mobile terminal sends media data to the display device according to the target resolution.

2. The display device according to claim 1, characterized in that, The controller is further configured to: The node signal strength value is acquired periodically at preset time intervals; The signal strength values ​​of the nodes are summed to obtain the total signal strength value of the signal detection node; The cumulative number of times the node signal strength value has been acquired is obtained; The average node strength value is calculated based on the total signal strength value and the cumulative number of acquisitions, and is used as the signal strength value of the signal detection node.

3. The display device according to claim 1, characterized in that, The controller is further configured to: In response to an event that the display device and the mobile terminal lose communication connection, the signal detection node is destroyed and the network connection channel is disconnected.

4. The display device according to claim 1, characterized in that, The controller performs the step of determining the target resolution based on the signal strength value, and is further configured to: If the signal strength value of the current network is greater than the set signal strength threshold, a first set of resolutions supported by the display device is generated, and the first set of resolutions is sent to the mobile terminal so that the mobile terminal can filter out the target resolution from the first set of resolutions; The first resolution is less than the threshold resolution; If the signal strength value of the current network is less than or equal to the signal strength threshold, a second set of resolutions supported by the display device is generated, and the second set of resolutions is sent to the mobile terminal so that the mobile terminal can filter out the target resolution from the second set of resolutions; The second resolution is greater than or equal to the threshold resolution.

5. A mobile terminal, characterized in that, include: The display unit is configured to display the terminal interface; The communication unit is configured to establish a communication connection with the display device; The processor is configured as follows: A network connection request is sent to the display device so that the display device establishes a network connection channel according to the network connection request, and allocates Internet Protocol addresses to the mobile terminal and the display device based on the network connection channel; After the network connection channel is successfully established, an acknowledgment signal is sent to the display device so that the display device can create a signal detection node based on the network connection channel. When the signal strength cannot be detected in the P2P mode of the WIFI network, the display device sends a signal quality prompt. The signal quality prompt is a prompt message generated by the display device when the network latency value is greater than the network latency threshold. It is used to characterize the poor signal quality and suggest that the mobile terminal transmit media data at a low resolution. The low resolution is a media resolution lower than a preset threshold resolution. Media data is sent to the display device according to the signal quality indication; The system receives a target resolution sent by the display device. The target resolution is the node signal strength value of the signal detection node detected by the display device when the network latency value is less than or equal to the network latency threshold. The system then sends a current network signal strength acquisition request to the server, receives and parses the signal strength information fed back by the server based on the signal strength acquisition request, determines the signal strength parameters, and then reads the signal strength parameters according to the second query command to determine the current network signal strength value. The resolution is determined based on the current network signal strength value, wherein the network latency value is the ping value. Media data is sent to the display device according to the target resolution.

6. The mobile terminal according to claim 5, characterized in that, The processor is further configured to: If the current network signal strength value is greater than the set signal strength threshold, receive the first set of resolutions sent by the display device; filter out the target resolution from the first set of resolutions, and send media data to the display device according to the target resolution; If the current network signal strength value is less than or equal to the signal strength threshold, the second resolution set sent by the display device is received. Select a target resolution from the second set of resolutions, and send media data to the display device according to the target resolution.

7. A method for adjusting resolution based on signal strength, characterized in that, Applied to a display device, the display device including a display, a communicator, and a controller, the method includes: Receive network connection requests sent by mobile terminals; Establish a network connection channel according to the network connection request; Based on the network connection channel, Internet Protocol addresses are allocated to the mobile terminal and the display device; In response to the confirmation signal indicating successful establishment of the network connection channel, a signal detection node is created based on the network connection channel; When the signal strength cannot be detected in the P2P mode of the WIFI network, obtain the Internet Protocol address of the mobile terminal; The network latency value with the mobile terminal is detected based on the Internet Protocol address and the first query command, wherein the first query command is a ping command and the network latency value is the ping value; If the network latency value is greater than the network latency threshold, a signal quality prompt is generated and the signal quality prompt is sent to the mobile terminal so that the mobile terminal sends media data to the display device according to the signal quality prompt. The signal quality prompt is used to characterize poor signal quality and suggest that the mobile terminal transmit media data at a low resolution. The low resolution is a media resolution lower than a preset threshold resolution. If the network latency value is less than or equal to the network latency threshold, the signal strength value of the signal detection node is detected; a current network signal strength acquisition request is sent to the server; signal strength information is received from the server based on the signal strength acquisition request; the signal strength information is parsed to obtain signal strength parameters; the signal strength parameters are read according to a second query command to detect the current network signal strength value; a target resolution is determined based on the signal strength value, and the target resolution is sent to the mobile terminal so that the mobile terminal sends media data to the display device according to the target resolution.

Images