Display device, control device and operation mode switching method
By detecting the connection status and switching the display device's operating mode, the problem of radar detection consuming resources is solved, and efficient user interaction and system resource management are achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HISENSE VISUAL TECH CO LTD
- Filing Date
- 2024-10-31
- Publication Date
- 2026-05-01
AI Technical Summary
Running the radar detection process simultaneously while the display device responds to remote control interaction commands consumes a lot of system resources and reduces operating efficiency.
The connection status is detected by the communication module, and the operating mode is switched: when connected, the interface radar process is run to obtain location data, and when switched to the interface interaction process to receive device data, the system resource consumption is reduced.
Without affecting user interaction efficiency, it reduces the consumption of system resources and improves the operating efficiency of display devices.
Smart Images
Figure CN121967759A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of display device technology, and in particular to a display device, a control device, and a method for switching operating modes. Background Technology
[0002] Users can control the display device to perform corresponding interactive actions using a remote control. To improve operational accuracy, the remote control can have built-in sensors. Users can shake or move the remote control to allow the built-in sensors to control the cursor position on the display device, enabling users to quickly move the cursor to perform interactive operations such as selection, confirmation, or cancellation, thus improving interaction efficiency.
[0003] While responding to interactive commands sent by the remote control, the display device can also execute a radar detection process to determine the relative position between the user and the display device, thereby adjusting the display effect according to the relative position. However, running the radar detection process simultaneously while responding to interactive commands consumes a significant amount of system resources, reducing the operating efficiency of the display device. Summary of the Invention
[0004] To address the problem that running the interface radar process simultaneously while responding to interactive commands consumes a large amount of system resources and reduces the operating efficiency of the display device, some embodiments of this application provide a display device, a control device, and a method for switching operating modes.
[0005] In a first aspect, some embodiments of this application provide a display device, including: a display configured to display a user interface; a communication component configured to communicate with a control device via a communication module, the communication module being configured to run an interface radar process or an interface interaction process; the communication module being a hardware interface for receiving control commands sent by the control device via a wireless communication connection; and a controller configured to:
[0006] Detect the first connection state of the communication component and the communication module, wherein the first connection state is related to the physical connection state of the communication module and the display device;
[0007] If the first connection state is a connected state, control the display device to operate in a first mode, the first mode being a mode that detects the user's position data relative to the display device through the interface radar process;
[0008] In the first mode, a first device instruction is sent to the communication module to enable the communication module to acquire the location data through the interface radar process, and to detect a second connection state between the control device and the communication module, wherein the second connection state is a communication connection state;
[0009] If the second connection state is a connected state, then a first switching instruction is generated;
[0010] In response to the first switching instruction, a second device instruction is sent to the communication module to control the communication module to close the interface radar process and start the interface interaction process, and to switch the first mode of the display device to the second mode of operation, wherein the second mode is a mode for detecting device data of the control device through the interface interaction process;
[0011] In the second mode, a third device instruction is sent to the communication module to enable the communication module to receive device data uploaded by the control device through the interface interaction process, and to display the device data in the user interface.
[0012] The above technical solution can enable the radar detection process to run even when the control device and the communication module are not connected, thereby replacing the display device to perform radar detection and reducing the consumption of system resources.
[0013] In some embodiments, after the controller performs the step of sending a third device instruction to the communication module, it is further configured to:
[0014] Start the timer program;
[0015] When the timing result recorded by the timing program is greater than or equal to the timing threshold, if no new device data is received from the control device, a second switching command is generated.
[0016] In response to the second switching command, a first device command is sent to the communication module to control the communication module to start the interface radar process and switch the second mode of the display device to the first mode.
[0017] The above technical solution can automatically switch from the second mode back to the first mode when no device data is received for a long time, so as to obtain the user's location data through the communication module, thus avoiding the situation where the communication module is occupied for a long time without receiving new device data, which would prevent the release of system resources.
[0018] In some embodiments, after the controller controls the communication module to shut down the interface radar process, it is further configured to:
[0019] The device radar process is a process by which the display device detects the user's position data relative to the display device.
[0020] During the process of receiving device data uploaded by the control device through the interface interaction process, the location data uploaded by the device radar process is obtained.
[0021] The above technical solution can obtain the user's location data by starting the device radar process when the interface radar process is closed, thus solving the problem of being unable to obtain location data when the interface radar process is closed and improving the accuracy of obtaining location data.
[0022] In some embodiments, the controller is configured to switch the display device from a second mode to a first mode, specifically as follows:
[0023] After the location data acquired by the device radar process is uploaded, the device radar process is closed, and a first device command is sent to the communication module to restart the interface radar process.
[0024] Obtain the location data uploaded by the radar process through the interface.
[0025] The above technical solution allows the interface radar process to run again when the display device switches back from the second mode to the first mode. Therefore, after the location data acquired by the device radar process is uploaded, the interface radar process can continue to acquire location data and the device radar process can be closed to save system resources.
[0026] In some embodiments, if the first connection state is a disconnected state, the controller is further configured to:
[0027] In response to radar detection commands sent by the control equipment, the equipment's radar process is executed;
[0028] The location data uploaded through the radar process of the device is obtained.
[0029] The above technical solution can acquire location data uploaded by the control device through the device radar process when the first connection state is not connected.
[0030] In some embodiments, after the controller performs the step of sending a third device instruction to the communication module, it is further configured to:
[0031] In response to a communication shutdown command sent by the control device, the connected state of the second connection state is switched to the disconnected state;
[0032] After the second connection state changes from connected to disconnected, a second switching command is generated;
[0033] In response to the second switching command, the interface radar process is initiated, and the second mode of the display device is switched to the first mode for operation.
[0034] The above technical solution can respond to a communication shutdown command actively sent by the control device, disconnect the second connection state, and after disconnection, generate a second switching command to switch the operating mode of the display device.
[0035] In some embodiments, the control device includes a first positioning chip and a second positioning chip. The step of the controller sending a third device instruction to the communication module to enable the communication module to receive device data uploaded by the control device through the interface interaction process is specifically configured as follows:
[0036] A calibration command is sent to the control device so that, during movement, the control device acquires first positioning data of the control device through a first positioning chip and second positioning data of the control device through a second positioning chip, and performs calibration on the device data based on the first positioning data and the second positioning data;
[0037] Receive calibrated device data sent by the control device.
[0038] The above technical solution generates first positioning data and second positioning data through a first positioning chip and a second positioning chip, and calibrates the equipment data generated by the control device using the first positioning data and the second positioning data, thereby improving the accuracy of the equipment data.
[0039] In some embodiments, after the controller performs the step of sending a first device instruction to the communication module to enable the communication module to acquire the location data through the interface radar process, it is further configured to:
[0040] The user distance information is calculated based on the location data; the user distance information is the straight-line distance between the user and the display device.
[0041] When the user distance information is less than or equal to the distance threshold, the display brightness of the user interface is reduced according to a preset value.
[0042] The above technical solution can adjust the display brightness of the display device according to the user's distance information. When the user is too close to the display device to view the user interface, the display brightness is reduced to improve the user's viewing experience.
[0043] Secondly, some embodiments of this application provide a control device and a communicator configured to establish a communication connection with a display device via a communication module; the communication module is configured to run an interface radar process or an interface interaction process; the communication module is a hardware interface for receiving control commands sent by the control device via a wireless communication connection.
[0044] The controller is configured as follows:
[0045] When the communication module and the display device are in a first connection state, a control command is sent to the display device to make the display device operate in a first mode. In the first mode, a first device command is sent to the communication module to control the communication module to acquire location data through the interface radar process. The first mode is a process of detecting the user's location data relative to the display device through the interface radar process of the communication module.
[0046] Detect the second connection status between the control device and the communication module;
[0047] The second connection state is sent to the display device, so that when the second connection state is connected, the display device generates a first switching command and, in response to the first switching command, sends a second command to the communication module, so that the communication module closes the interface radar process and switches the first mode of the display device to a second mode of operation, wherein the second mode is a mode for detecting device data of the control device through the interface interaction process.
[0048] When the display device is running in the second mode, device data is generated, and the device data is sent to the display device through the interface interaction process of the communication module, so that the display device displays the device data in the user interface.
[0049] Thirdly, some embodiments of this application provide a method for switching operating modes, applied to the display device described in the first aspect. The display device includes a display configured to display a user interface, a communication component configured to establish a communication connection with the control device via a communication module; the communication module is configured to run an interface radar process or an interface interaction process; the communication module is a hardware interface for receiving control commands sent by the control device via a wireless communication connection; and a controller; the method includes:
[0050] Detect the first connection state of the communication component and the communication module, wherein the first connection state is related to the physical connection state of the communication module and the display device;
[0051] If the first connection state is a connected state, control the display device to operate in a first mode, the first mode being a mode that detects the user's position data relative to the display device through the interface radar process;
[0052] In the first mode, a first device instruction is sent to the communication module to enable the communication module to acquire the location data through the interface radar process, and to detect a second connection state between the control device and the communication module, wherein the second connection state is a communication connection state;
[0053] If the second connection state is a connected state, then a first switching instruction is generated;
[0054] In response to the first switching instruction, a second device instruction is sent to the communication module to control the communication module to close the interface radar process and start the interface interaction process, and to switch the first mode of the display device to the second mode of operation, wherein the second mode is a mode for detecting device data of the control device through the interface interaction process;
[0055] In the second mode, a third device instruction is sent to the communication module to enable the communication module to receive device data uploaded by the control device through the interface interaction process, and to display the device data in the user interface.
[0056] As can be seen from the above technical solutions, this application provides a display device, a control device, and a method for switching operating modes. The method, in response to a control command sent by the control device, detects a first connection state of the communication component and the communication module. If the first connection state is connected, the display device is controlled to operate in a first mode. In the first mode, location data is acquired, and a second connection state between the control device and the communication module is detected. If the second connection state is connected, a first switching command is generated, and in response to the first switching command, the interface radar process is closed, switching the first mode of the display device to the second mode. In the second mode, device data uploaded by the control device is received through the interface interaction process, and the device data is displayed in the user interface. The communication module enables the radar detection process to run even when the control device and the communication module are not connected, thereby replacing the display device in performing radar detection and reducing system resource consumption. Attached Figure Description
[0057] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0058] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;
[0059] Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;
[0060] Figure 3 This is a schematic diagram of the hardware configuration of the control device provided in some embodiments of this application;
[0061] Figure 4 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;
[0062] Figure 5 A flowchart illustrating the operation mode switching of a display device provided in some embodiments of this application;
[0063] Figure 6 Timing diagrams for switching operating modes of a display device provided in some embodiments of this application;
[0064] Figure 7 A flowchart illustrating the switching of interface processes via a communication module in a display device provided in some embodiments of this application;
[0065] Figure 8 Flowcharts illustrating the switching of operating modes of a display device provided in some embodiments of this application;
[0066] Figure 9 A flowchart illustrating how a display device switches operating modes based on timing results, provided in some embodiments of this application;
[0067] Figure 10 A flowchart illustrating how a display device acquires location data via a device radar process, as provided in some embodiments of this application;
[0068] Figure 11 A flowchart illustrating the process of shutting down the interface radar of a display device, provided in some embodiments of this application;
[0069] Figure 12 A flowchart illustrating the process of turning off the device radar in a display device, provided for some embodiments of this application. Detailed Implementation
[0070] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.
[0071] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0072] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.
[0073] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.
[0074] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0075] In this embodiment, the display device 200 generally refers to a device with screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.
[0076] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, users can operate the display device 200 via touch operation, mobile terminal 300, and control device 100. For example, control device 100 can be a remote control, stylus, gamepad, etc.
[0077] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.
[0078] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.
[0079] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.
[0080] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.
[0081] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication component 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.
[0082] In some embodiments, detector 230 is used to acquire signals from the external environment or interactions with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.
[0083] In some embodiments, the display 260 includes display function components for presenting an image and driving components for driving the image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.
[0084] In some embodiments, the communication component 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication components 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication component 220 that includes WiFi functionality. When the display device 200 supports Bluetooth connection communication, it needs to have a communication component 220 that includes Bluetooth functionality.
[0085] The communication component 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections can be established using data cables, interfaces, or other components. Wireless connections can be made via wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.
[0086] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.
[0087] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0088] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).
[0089] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.
[0090] In some embodiments, the user input interface 280 can be used to receive instructions from user input.
[0091] Figure 3 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of the central control device. (Example) Figure 3 As shown, the control device 100 may include: a controller 110, a communication device 130, a user input / output interface, a memory, and a power supply.
[0092] The control device 100 is configured to control the display device 200, and to receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.
[0093] In some embodiments, the control device 100 may be an intelligent device. For example, the control device 100 may be equipped with various applications for controlling the display device 200 according to user needs.
[0094] In some embodiments, such as Figure 1As shown, the mobile terminal 300 or other smart electronic devices can perform similar functions to the control device 100 after installing the application of the control display device 200.
[0095] The controller 110 includes a processor 112, RAM 113, ROM 114, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.
[0096] The controller 110 is connected to the communication device 130. Under the control of the controller 110, the communication device 130 realizes communication of control signals and data signals with the display device 200. The communication device 130 may include at least one of other near-field communication modules such as WiFi chip 131, Bluetooth module 132, and NFC module 133.
[0097] User input / output interface 140, wherein the input interface includes at least one of other input interfaces such as microphone 141, touchpad 142, sensor 143, and button 144.
[0098] In some embodiments, the control device 100 includes at least one of a communication device 130 and an input / output interface 140. The control device 100 is configured with the communication device 130, such as a WiFi, Bluetooth, or NFC module, which can encode user input commands via WiFi, Bluetooth, or NFC protocols and send them to the display device 200.
[0099] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can also store various control signal instructions input by the user.
[0100] The power supply 180 is used to provide operating power support for the various components of the control device 100 under the control of the controller.
[0101] In some embodiments, the control device 100 can also communicate control signals and data signals with the display device 200 via an external communication device. The external communication device is a communication module located outside the control device 100 and possessing communication functionality. The communication module can be physically plugged into the device interface 240 of the display device 200, thereby establishing a communication connection between the communication module and the communication component 220. The communication module can acquire the control signals and data signals sent by the control device 100 through the communication device 130, and, according to the communication connection, upload the control signals and data signals to the controller 250 for response via the communication component 220, thereby enabling wireless control interaction between the control device 100 and the display device 200 through the communication module.
[0102] It should be noted that the communication module is not an internal module of the control device 100 or the display device 200, but an independent communication module separate from the control device 100 and the display device 200. The control device 100 can achieve remote wireless interaction with the display device 200 through the communication module.
[0103] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.
[0104] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.
[0105] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.
[0106] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.
[0107] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.
[0108] like Figure 4As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.
[0109] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.
[0110] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.
[0111] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 4 As shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0112] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.
[0113] In some embodiments, a user can generate a control command by clicking button 144 on control device 100 and send the control command to display device 200. Display device 200 can respond to the control command and execute the corresponding interactive action, thereby realizing the interactive effect between the user and display device 200. For example, control device 100 can be equipped with at least a confirmation button and a cancel button, so that when the focus moves to the corresponding function option or function application in the user interface displayed on display device 200, clicking the confirmation button generates a confirmation command, so that display device 200 starts the corresponding function process in response to the confirmation command; and when the focus moves to the corresponding function option or function application, clicking the cancel button generates a cancel command, so that display device 200 cancels the start of the corresponding function program in response to the cancel command.
[0114] The control device 100 may also be equipped with directional buttons to move the focus in the user interface and select the desired function option. To improve movement accuracy, the control device 100 may also be a sensor-based control device. The control device 100 can generate corresponding movement commands through built-in sensors, allowing users to hold and move or shake the control device 100, and interact by generating movement commands through the sensors. This enables users to quickly move the cursor to perform interactive operations such as selection, confirmation, or cancellation, improving interaction efficiency. It should be understood that the control device 100 can be a wireless mouse, air mouse, VR sensor controller, or other control devices with sensing and positioning functions.
[0115] The control device 100 can transmit control commands wirelessly. Therefore, the control device 100 can communicate with the display device 200 via a communication module. The communication module is an interface hardware used to receive control commands issued by the control device 100. The communication module can be connected to the device interface 240 of the display device 200, i.e., the interface hardware is inserted into the device interface 240, thereby enabling the communication module and the communication component to communicate and achieve remote wireless interaction.
[0116] While responding to interactive commands sent by the control device 100, the display device 200 can also execute a radar detection process. This process uses infrared light to determine the user's position relative to the display device 200, adjusting the display accordingly. For example, when the user is close to the display device 200, to protect their eyesight, the display device 200 can adjust the user interface to an eye-protection mode or reduce its brightness. When the user is at a safe viewing distance, the display can be restored to its normal state. However, running the radar detection process simultaneously while responding to interactive commands consumes significant system resources, reducing the operating efficiency of the display device 200.
[0117] To address the aforementioned problems, some embodiments of this application provide a display device 200, including a display 260 configured to display a user interface. The user interface may include multiple control options, allowing a user to select these options via a control device 100 to control the display device 200 to execute corresponding functional programs. The display device 200 includes a communication component 220 configured to communicate with the control device 100 via a communication module. Since the communication module is a hardware interface independent of both the control device 100 and the display device 200, a physical connection to the display device 200 must be maintained during its application. Therefore, the display device 200 can physically connect to the communication module via a device interface 240.
[0118] The communication component 220 can establish a communication connection with the control device 100 through the communication module connected to the device interface 240, thereby establishing a communication channel between the communication module and the device interface 240. The controller 250 is configured to execute an operating mode switching method.
[0119] Figure 5 This is a flowchart illustrating a method for switching operating modes provided in an embodiment of this application. Figure 6 This is a timing diagram of a method for switching operating modes provided in some embodiments of this application, wherein the controller 250 follows the procedure as follows: Figure 6 The timing relationships shown are used to execute the method, see [link to relevant documentation]. Figure 5 and Figure 6 The method includes the following:
[0120] S100: Detect the first connection status of the communication component and the communication module.
[0121] When the control device 100 sends control commands to the display device 200, it needs to ensure that the device interface 240 and the communication module of the control device 100 remain connected, i.e., the communication module is inserted into the device interface 240. If the communication module is not inserted into the device interface 240, the control commands cannot be transmitted to the display device 200 through the communication channel formed by the communication component 220 and the communication module, causing the display device 200 to fail to respond to the control commands. Therefore, the controller 250 needs to detect the first connection status between the communication component 220 and the communication module. The first connection status is related to the physical connection status between the communication module and the display device 200. If the connection is not tight or the connector is damaged, the first connection status is an unconnected state, and the communication component 220 cannot establish further communication with the communication module.
[0122] If the first connection state is disconnected, it means that the communication module is not inserted into the device interface 240, and the display device 200 cannot receive control commands sent by the control device 100. When the communication module is not inserted into the device interface 240, the controller 250 can control the display 260 to display a prompt icon in the user interface to inform the user that the display device 200 has not established a communication connection with the control device 100.
[0123] like Figure 7 As shown, the communication module includes a UWB positioning chip and a SOC chip. The communication module can perform positioning detection functions through the UWB positioning chip, that is, it runs an interface interaction process to detect device data generated when the control device 100 is moved, shaken, or responds to buttons. The communication module can also execute a radar process through the UWB positioning chip to replace the radar process of the display device 200, thereby saving power consumption of the display device 200. To distinguish between the radar processes of the communication module and the display device 200, this embodiment defines the radar process executed by the UWB positioning chip as the interface radar process, and the radar process executed by the display device 200 as the device radar process. The communication module can switch between the interface interaction process and the interface radar process through the SOC chip.
[0124] In some embodiments, the communication module can achieve the function of wireless command transmission through various communication methods, such as Bluetooth or a wireless network. The following example uses Bluetooth as the transmission method. The communication module can be a Bluetooth dongle interface. After the Bluetooth dongle interface is connected to the device interface 240, the control device 100 and the display device 200 can transmit control commands via Bluetooth when both are in Bluetooth mode.
[0125] S200: If the first connection state is a connected state, control the display device to operate in the first mode.
[0126] The first connection state is the hardware connection state. If the first connection state is "connected," it indicates that the communication module has been inserted into the device interface 240, and the controller 250 can control the display device 200 to operate in the first mode. The first mode is a mode that detects the user's position data relative to the display device 200 through the interface radar process. In the first mode, the controller 250 controls the communication module to execute the interface radar process to detect the user's position data relative to the display device 200. In the first mode, the display device 200 can shut down the device radar process, thereby saving the device radar process's memory consumption on the system.
[0127] While the device is connected, the controller 250 can continue to monitor the first connection status. If the first connection status changes from connected to disconnected, it indicates that the communication module has lost connection with the communication component 220. At this time, the controller 250 can disable the first mode of the display device 200.
[0128] S300: In the first mode, a first device instruction is sent to the communication module to enable the communication module to acquire the location data through the interface radar process, and to detect the second connection status between the control device and the communication module.
[0129] When the display device 200 is in the first mode, the communication module can transmit a positioning signal within a preset range. When the user enters the detection range of the communication module, the positioning signal is reflected back to the communication module when it comes into contact with the user, thereby generating the user's location data in the communication module.
[0130] When the display device 200 is in the first mode, the control device 100 can upload control commands generated by the buttons to the communication module, and then upload them to the display device 200 through the communication connection between the communication module and the communication component 220. At this time, the communication module can only generate user position data, and cannot receive device data generated when the control device 100 moves or shakes.
[0131] Therefore, while acquiring location data through the communication module, the controller 250 can also detect the second connection state between the control device 100 and the communication module. In the second connection state, the control device 100 can send a sensing signal to the communication module, causing both the communication module and the control device 100 to enter the second connection state. Unlike the first connection state, the second connection state is a communication connection state.
[0132] S400: If the second connection state is already connected, then generate the first switching instruction.
[0133] In the second connection state, the communication module can switch the interface radar process to the interface interaction process via the SOC chip to obtain device data generated by the control device 100 through the interface interaction process. If the second connection state is a connected state, the communication module can generate a mode switching event and send the mode switching event to the display device 200. The controller 250 can generate a first switching command based on the mode switching event, which is used to switch the operating mode of the display device 200.
[0134] S500: In response to the first switching command, a second device command is sent to the communication module to control the communication module to shut down the interface radar process and switch the first mode of the display device to the second mode.
[0135] like Figure 8 As shown, after generating the first switching command, the controller 250 can respond to the first switching command by switching the first mode of the display device 200 to the second mode. In the second mode, the controller 250 can send a second device command to the communication module to run the interface interaction process to detect the mode of the device data of the control device 100. Since the communication module needs to execute the radar process through the UWB positioning chip, and the UWB positioning chip can only run one positioning detection process at a time.
[0136] Therefore, the controller 250 can control the communication module to shut down the interface radar process through the second device command, so as to release the operating resources of the UWB positioning chip, and run the interface interaction process through the released operating resources, thereby completing the switching of the operating mode of the display device 200. The control communication module receives device data uploaded from the control device 100 through the interface interaction process.
[0137] S600: In the second mode, a third device instruction is sent to the communication module to enable the communication module to receive device data uploaded by the control device through the interface interaction process, and to display the device data in the user interface.
[0138] In the second mode, the display device 200 can send a third device command to the communication module, causing the communication module to respond to the third device command and collect device data generated by the movement or shaking of the control device 100 through the UWB positioning chip in the communication module. After receiving the device data, the controller 250 can control the display 260 to display the device data in the user interface, thereby realizing the interaction between the control device 100 and the display device 200.
[0139] Since the device data is generated based on the movement or shaking of the control device 100, the corresponding trajectory can be displayed on the monitor 260 while the device data is being displayed. For example, the control device 100 can control the cursor in the user interface. The user can hold the control device 100 and move it to control the cursor position in the user interface, thereby displaying the device data.
[0140] Device data can be in the form of position coordinates and relative displacement data. The controller 250 can display the data in the user interface based on the absolute position coordinates and relative displacement data. The position coordinates are the initial and final coordinates of the cursor during the data generation process. For example, if the initial cursor position is A, and the user moves the cursor laterally to position B using the handheld control device 100, then the position coordinates of the device data are the coordinates between position A and position B in the user interface. The relative displacement data is the displacement data between the initial and final coordinates, such as the displacement parameters, movement speed, and direction between position A and position B. After receiving the device data, the controller 250 can determine the start and end points of the cursor movement based on the position coordinates and render the cursor's movement trajectory based on the relative displacement data, thereby displaying the device data in the user interface.
[0141] As can be seen from the above technical solutions, some embodiments of this application can perform radar detection through the communication module to obtain the user's location data when the first connection state between the communication component 220 and the communication module is connected, thereby reducing the resource consumption of the display device 200. Furthermore, when the second connection state between the control device and the communication module is connected, the first mode of the display device 200 is switched to the second mode to receive device data generated by the control device 100.
[0142] In some embodiments, the controller 250 can continuously receive device data while the display device 200 is in a second mode. However, if the controller 250 does not receive new device data within a preset time period, in order to save power consumption of the display device 200, the second mode of the display device 200 can be switched to the first mode. To this end, after receiving device data, the controller 250 can start a timing program to record the time elapsed since receiving the data. To improve the accuracy of mode switching, the controller 250 can set a timing threshold, such as... Figure 9As shown, when the timing result recorded by the timing program is greater than or equal to the timing threshold, if no new device data is received from the control device 100, it indicates that the user has not moved or shaken the control device 100 for a long period of time. At this time, the controller 250 can generate a second switching command, which is used to switch the second mode of the display device 200 to the first mode. In response to the second switching command, the controller 250 sends a first device command to the communication module to control the communication module to close the interface interaction process, temporarily disconnecting the second connection state, and starts the interface radar process through the communication module to automatically resume the first mode, obtain the user's location data through the communication module, and complete the mode switching.
[0143] During the timing program, if the controller 250 receives device data uploaded by the control device 100, it can refresh the timing result based on the device data. For example, if the timing threshold is 30 seconds and the current timing result is 25 seconds, the controller 250 detects that the communication module has received device data uploaded by the control device 100, and the controller 250 can refresh the timing result from 25 seconds to 0 seconds and restart the timing.
[0144] In some embodiments, after responding to the first switching command, the controller 250 temporarily prevents the display device 200 from acquiring the user's location data via the communication module because the interface radar process is shut down. At this time, if the user moves, the communication module cannot acquire the user's location data. To avoid affecting the display device 200's detection of the user's location, such as... Figure 10 As shown, after the interface radar process of the communication module is closed, the controller 250 can run the device radar process. The device radar process is the process by which the display device 200 detects the user's position data relative to the display device 100. By using the device radar process, the detection of the user's position data can continue even after the interface radar process is closed, thus solving the problem of the display not being updated in a timely manner based on the user's position data when the user moves while the interface radar process is closed.
[0145] In the above embodiments, in order to solve the problem that the communication module closes the interface radar process when the device radar process is not started, resulting in incomplete acquisition of location data, the controller 250 can also generate a first start identifier after the device radar process is started, and close the interface radar process of the communication module according to the first start identifier to ensure the integrity of radar detection.
[0146] In some embodiments, when the controller 250 switches the display device 200 from its second mode to its first mode in response to a second switching command, in order to save the radar detection power consumption of the display device 200, the controller 250 can shut down the device radar process after the location data acquired by the device radar process has been uploaded. For example, when the display device 200 switches back from the second mode to the first mode, the user is in a moving state. At this time, the device radar process of the display device 200 is continuously acquiring user location data. Therefore, the controller 250 needs to finish uploading the location data acquired by the device radar process before shutting down the device radar process.
[0147] Based on the above scenarios, such as Figure 12 As shown, the controller 250 can also control the communication module to switch to the running interface radar process while the device radar process is uploading location data. After the interface radar process starts, the controller 250 generates a second start flag, and based on the second start flag, shuts down the device radar process after the location data acquired by the device radar process has been uploaded, to ensure the integrity of radar detection. The controller 250 can also continue to perform radar detection functions and upload location data through the interface radar process.
[0148] In some embodiments, if the first connection state is a disconnected state, it indicates that the communication module of the control device 100 is not connected to the device interface 240. In this case, the display device 200 cannot obtain instructions and data through the communication module. Based on this, the user can send a radar detection command through the control device 100 to control the display device 200 to run the device radar process. At this time, the device radar process can generate the user's location data based on the user's location using the radar detection function and upload the location data to the display device 200.
[0149] In some embodiments, the user can also actively disconnect the second connection state through the control device 100. For example, the control device 100 can detect a key click event, generate a communication shutdown command based on the click event, and send the communication shutdown command to the display device 200 through the communication channel. After receiving the communication shutdown command, the controller 250 can disconnect the second connection state in response to the communication shutdown command, so as to switch the switched state of the second connection state to the disconnected state. After the second connection state is switched from the connected state to the disconnected state, the controller 250 needs to control the display device 200 to switch the mode operation. To this end, a second switching command is generated, and in response to the second switching command, the interface interaction process of the communication module is closed, and the interface radar process of the communication module is opened, so as to switch the second mode of the display device 200 to the first mode operation. At this time, the communication module can obtain the user's location data through the interface radar process, and since the interface interaction process is closed, the communication module cannot continue to obtain the device data uploaded by the control device 100.
[0150] In the second mode, to accurately acquire the device data uploaded by the control device 100, the control device 100 may further include a first positioning chip and a second positioning chip. The first and second positioning chips can be chips with positioning capabilities; for example, the first positioning chip can be a UWB positioning chip, used to generate first positioning data for the control device 100. The first positioning data is used to calibrate the position coordinates of the device data. The second chip can be an IMU positioning chip, used to generate second positioning data for the control device 100. The second positioning data is used to calibrate the relative displacement data of the device data.
[0151] Based on this, in some embodiments, before receiving device data through the interface interaction process, the controller 250 may send a calibration command to the control device 100. In response to the calibration command, the control device 100 may acquire first positioning data of the control device 100 through a first positioning chip and second positioning data of the control device 100 through a second positioning chip during its movement. It then performs calibration on the device data based on the first and second positioning data to improve the accuracy of the device data and sends the calibrated device data to the display device 200.
[0152] In some embodiments, after the controller 250 receives location data uploaded by the interface radar process, the controller 250 can calculate user distance information based on the location data. The user distance information is the straight-line distance between the user and the display device 200. When the user distance information is less than or equal to a distance threshold, the controller 250 can reduce the display brightness of the user interface according to a preset value to protect the user's eyesight from the brightness of the display device 200. For example, the distance threshold can be 0.5 meters, and the preset display brightness is 20. That is, when the user distance information is less than 0.5 meters, the display brightness of the display device 200 can be adjusted from the current brightness value to 20. If the current brightness value is less than the preset display brightness, the controller 250 will not adjust the brightness of the user interface.
[0153] This application also provides a control device 100 in some embodiments, including a communicator configured to establish a communication connection with a display device 200 via a communication module; the communication module is configured to run an interface radar process or an interface interaction process; the communication module is a hardware interface for receiving control commands sent by the control device 100 via a wireless communication connection; and a controller 110 configured to:
[0154] When the communication module and the display device are in a first connection state, a control command is sent to the display device 200 to cause the display device 200 to detect the first connection state between the communication component 220 and the communication module. While in the first connection state, the display device 200 operates in a first mode and sends a first device command to the communication module to control the communication module through the interface radar process. The first mode is a process that detects the user's position data relative to the display device 200 through the interface radar process of the communication module 240. A second connection state between the control device 100 and the communication module is detected. The second connection state is sent to the display device 200 so that when the second connection state is connected, the display device 200 generates a first switching command and, in response to the first switching command, sends a second command to the communication module to cause the communication module to close the interface radar process and switch to the second mode of operation. The second mode is a mode that detects the device data of the control device 100 through the interface interaction process of the communication module. When the display device 200 is running in the second mode, device data is generated, and the device data is sent to the display device 200 through an interface interaction process so that the display device 200 displays the device data in the user interface.
[0155] This application also provides a method for switching operating modes, applied to the display device 200 in the above embodiments, the method comprising:
[0156] S100: Detect the first connection status of the communication component and the communication module.
[0157] The first connection state is related to the physical connection state between the communication module and the display device.
[0158] S200: If the first connection state is a connected state, control the display device to operate in a first mode, the first mode being a mode that detects the user's position data relative to the display device through the interface radar process.
[0159] S300: In the first mode, a first device instruction is sent to the communication module to enable the communication module to acquire the location data through the interface radar process, and to detect the second connection status between the control device and the communication module.
[0160] The second connection state is the communication connection state;
[0161] S400: If the second connection state is a connected state, then generate a first switching instruction.
[0162] S500: In response to the first switching instruction, a second device instruction is sent to the communication module to control the communication module to shut down the interface radar process and start the interface interaction process, and to switch the first mode of the display device to the second mode.
[0163] The second mode is a mode in which device data of the control device is detected through the interface interaction process.
[0164] S600: In the second mode, a third device instruction is sent to the communication module to enable the communication module to receive device data uploaded by the control device through the interface interaction process, and to display the device data in the user interface.
[0165] As can be seen from the above technical solutions, this application provides a display device, a control device, and a method for switching operating modes. The method, in response to a control command initiated by the control device, detects a first connection state of the communication component and the communication module. If the first connection state is connected, the display device is controlled to operate in a first mode. In the first mode, location data is acquired, and a second connection state between the control device and the communication module is detected. If the second connection state is connected, a first switching command is generated, and in response to the first switching command, the interface radar process is closed, switching the first mode of the display device to the second mode. In the second mode, device data uploaded by the control device is received through the interface interaction process, and the device data is displayed in the user interface. The communication module enables the radar detection process to run even when the control device and the communication module are not connected, thereby replacing the display device in performing radar detection and reducing system resource consumption.
[0166] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
[0167] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.
Claims
1. A display device, characterized in that, include: The monitor is configured to display the user interface; A communication component is configured to communicate with a control device via a communication module, wherein the communication module is configured to run an interface radar process or an interface interaction process; the communication module is a hardware interface for receiving control commands sent by the control device via a wireless communication connection. The controller is configured as follows: Detect the first connection state of the communication component and the communication module, wherein the first connection state is related to the physical connection state of the communication module and the display device; If the first connection state is a connected state, control the display device to operate in a first mode, the first mode being a mode that detects the user's position data relative to the display device through the interface radar process; In the first mode, a first device instruction is sent to the communication module to enable the communication module to acquire the location data through the interface radar process, and to detect a second connection state between the control device and the communication module, wherein the second connection state is a communication connection state; If the second connection state is a connected state, then a first switching instruction is generated; In response to the first switching instruction, a second device instruction is sent to the communication module to control the communication module to close the interface radar process and start the interface interaction process, and to switch the first mode of the display device to the second mode of operation, wherein the second mode is a mode for detecting device data of the control device through the interface interaction process; In the second mode, a third device instruction is sent to the communication module to enable the communication module to receive device data uploaded by the control device through the interface interaction process, and to display the device data in the user interface.
2. The display device according to claim 1, characterized in that, After the controller performs the step of sending a third device instruction to the communication module, it is further configured to: Start the timer program; When the timing result recorded by the timing program is greater than or equal to the timing threshold, if no new device data is received from the control device, a second switching command is generated. In response to the second switching command, a first device command is sent to the communication module to control the communication module to start the interface radar process and switch the second mode of the display device to the first mode.
3. The display device according to claim 2, characterized in that, After executing the step of controlling the communication module to shut down the interface radar process, the controller is further configured to: The device radar process is a process by which the display device detects the user's position data relative to the display device. During the process of receiving device data uploaded by the control device through the interface interaction process, the location data uploaded by the device radar process is obtained.
4. The display device according to claim 3, characterized in that, The controller is configured to switch the display device from its second mode to its first mode. After the location data acquired by the device radar process is uploaded, the device radar process is closed, and a first device command is sent to the communication module to restart the interface radar process. Obtain the location data uploaded by the radar process through the interface.
5. The display device according to claim 3, characterized in that, If the first connection state is a disconnected state, the controller is also configured to: In response to radar detection commands sent by the control equipment, the equipment's radar process is executed; The location data uploaded through the radar process of the device is obtained.
6. The display device according to claim 1, characterized in that, After the controller performs the step of sending a third device instruction to the communication module, it is further configured to: In response to a communication shutdown command sent by the control device, the connected state of the second connection state is switched to the disconnected state; After the second connection state changes from connected to disconnected, a second switching command is generated; In response to the second switching command, a first device command is sent to the communication module to cause the communication module to start the interface radar process and switch the second mode of the display device to the first mode.
7. The display device according to claim 1, characterized in that, The control device includes a first positioning chip and a second positioning chip. The controller executes the step of sending a third device instruction to the communication module, enabling the communication module to receive device data uploaded by the control device through the interface interaction process. Specifically, this step is configured as follows: A calibration command is sent to the control device so that, during movement, the control device acquires first positioning data of the control device through a first positioning chip and second positioning data of the control device through a second positioning chip, and performs calibration on the device data based on the first positioning data and the second positioning data; Receive calibrated device data sent by the control device.
8. The display device according to claim 1, characterized in that, After executing the step of sending a first device instruction to the communication module to enable the communication module to acquire the location data through the interface radar process, the controller is further configured to: The user distance information is calculated based on the location data; the user distance information is the straight-line distance between the user and the display device. When the user distance information is less than or equal to the distance threshold, the display brightness of the user interface is reduced according to a preset value.
9. A control device, characterized in that, include: The communicator is configured to establish a communication connection with the display device via a communication module; the communication module is configured to run an interface radar process or an interface interaction process; the communication module is a hardware interface for receiving control commands sent by the control device via a wireless communication connection. The controller is configured as follows: When the communication module and the display device are in a first connection state, a control command is sent to the display device to make the display device operate in a first mode. In the first mode, a first device command is sent to the communication module to control the communication module to acquire location data through the interface radar process. The first mode is a process of detecting the user's location data relative to the display device through the interface radar process of the communication module. Detect the second connection status between the control device and the communication module; The second connection state is sent to the display device, so that when the second connection state is connected, the display device generates a first switching command and, in response to the first switching command, sends a second command to the communication module, so that the communication module closes the interface radar process and switches the first mode of the display device to a second mode of operation, wherein the second mode is a mode for detecting device data of the control device through the interface interaction process. When the display device is running in the second mode, device data is generated, and the device data is sent to the display device through the interface interaction process of the communication module, so that the display device displays the device data in the user interface.
10. A method for switching operating modes, characterized in that, Applied to the display device according to any one of claims 1-8, the display device includes a display configured to display a user interface, and a communication component configured to establish a communication connection with the control device via a communication module; the communication module is configured to run an interface radar process or an interface interaction process; The communication module is a hardware interface for receiving control commands sent by the control device via a wireless communication connection; the controller; the method includes: Detect the first connection state of the communication component and the communication module, wherein the first connection state is related to the physical connection state of the communication module and the display device; If the first connection state is a connected state, control the display device to operate in a first mode, the first mode being a mode that detects the user's position data relative to the display device through the interface radar process; In the first mode, a first device instruction is sent to the communication module to enable the communication module to acquire the location data through the interface radar process, and to detect a second connection state between the control device and the communication module, wherein the second connection state is a communication connection state; If the second connection state is a connected state, then a first switching instruction is generated; In response to the first switching instruction, a second device instruction is sent to the communication module to control the communication module to close the interface radar process and start the interface interaction process, and to switch the first mode of the display device to the second mode of operation, wherein the second mode is a mode for detecting device data of the control device through the interface interaction process; In the second mode, a third device instruction is sent to the communication module to enable the communication module to receive device data uploaded by the control device through the interface interaction process, and to display the device data in the user interface.