Display device and device control method
Patent Information
- Application Number
- CN202610733459.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-05-25
- Publication Date
- 2026-09-22
AI Technical Summary
[0004]然而,现有技术方案在实际应用中存在明显缺陷与不足
[0037]对象确定模块,用于根据当前按压信息、上一按键时间和OSD弹窗的显示状态,从显示设备和CEC设备中选择当前按压事件的作用对象;
Smart Images

Figure CN122802716A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of image processing technology, and more particularly to a display device and a device control method. Background Technology
[0002] Existing display devices generally support the High Definition Multimedia Interface (HDMI) and Consumer Electronics Control (CEC) protocols. Through the HDMI interface, they can establish linkage control with external CEC devices such as set-top boxes, game consoles, and audio-visual playback devices, enabling remote control buttons to directly control external devices, greatly improving the ease of operation in multi-device interconnection scenarios.
[0003] Currently, the preset function buttons (such as the up arrow key) on the remote control of display devices are usually reused as dual-function buttons. They can be used to trigger the on-screen display (OSD) pop-up window to view signal parameters such as resolution, frame rate, high dynamic range (HDR), and color gamut. They can also forward button commands to external devices through the CEC protocol to realize remote control operation of external CEC devices.
[0004] However, existing technical solutions have significant flaws and shortcomings in practical applications. Traditional display devices have a simplistic logic for recognizing the button behavior of dual-function buttons, failing to intelligently distinguish whether a user is pressing a button to view local signal information or to control an external CEC device. When an HDMI port is connected to a CEC device and the CEC linkage function is enabled, the external device can easily preempt button control, leading to mutual conflict of button functions. This results in a rigid overall interaction logic, a fragmented user experience, and an inability to simultaneously meet the user's dual needs of viewing device signal parameters and continuously controlling external devices. Summary of the Invention
[0005] This application provides a display device and a device control method that can take into account both local information viewing and peripheral device control needs, and significantly improve the control experience when multiple devices are interconnected.
[0006] In a first aspect, some embodiments provide a display device, including:
[0007] The HDMI interface is configured to connect to consumer electronics control (CEC) devices;
[0008] The monitor is configured to display content.
[0009] and at least one controller, configured as follows:
[0010] When the display device is connected to the CEC device via an HDMI interface, after receiving a current press event for a preset function key sent by the remote control, the current press information corresponding to the current press event is obtained; wherein, the preset function key has the function of controlling the CEC device and triggering the display screen menu to display the OSD pop-up window; the current press information includes the current key press duration and the current key press time;
[0011] Based on the current press information, the previous key press time, and the display status of the OSD pop-up, select the target of the current press event from the display device and the CEC device;
[0012] Controls the target object to perform the operation corresponding to the preset function key.
[0013] In the above embodiments, by combining the button press duration, button time interval, and OSD pop-up status to comprehensively determine the operation intent, and matching the corresponding execution subject and operation action based on the determination result, it is possible to avoid external CEC devices preempting button control and eliminate response conflicts of dual-function buttons. At the same time, it can distinguish between valid operations and accidental touches, adapt to the protocol characteristics of different types of external devices, and customize the determination parameters to adapt to diverse usage habits. This effectively improves the accuracy of button intent recognition and the stability of device operation, broadens the scope of scenario adaptation, takes into account both local information viewing and peripheral device control needs, and significantly improves the operation experience when multiple devices are interconnected.
[0014] In one embodiment, when the controller selects the target of the current press event from the display device and the CEC device based on the current press information, the previous key press time, and the display state of the OSD pop-up, it is configured as follows:
[0015] The key press interval is determined based on the difference between the current key press time and the previous key press time. If the key press interval is less than or equal to a preset interval threshold, the target of the current press event is determined to be the CEC device. If the key press interval is greater than the preset interval threshold, the target of the current press event is selected from the display device and the CEC device based on the current key press duration and the display status of the OSD pop-up window.
[0016] In one embodiment, when the controller selects the target of the current press event from the display device and the CEC device based on the current key press duration and the display state of the OSD pop-up, it is configured as follows:
[0017] If the current key press duration is greater than or equal to the first duration threshold, the target of the current press event is determined to be the CEC device; if the current key press duration is less than or equal to the second duration threshold, the target of the current press event is selected from the display device and the CEC device according to the display status of the OSD pop-up window; wherein, the first duration threshold is greater than the second duration threshold.
[0018] In one embodiment, when the controller selects the target of the current press event from the display device and the CEC device based on the current key press duration and the display state of the OSD pop-up, it is configured as follows:
[0019] If the current key press duration is greater than or equal to the first duration threshold, the target of the current press event is determined to be the CEC device; if the current key press duration is less than or equal to the second duration threshold, the target of the current press event is selected from the display device and the CEC device according to the display status of the OSD pop-up window; wherein, the first duration threshold is greater than the second duration threshold.
[0020] In one embodiment, the controller is further configured to:
[0021] Upon receiving a current press event for a preset function button from the remote control, the device type of the CEC device is determined; based on the HDMI CEC protocol corresponding to the device type, the CEC control command corresponding to the preset function button is determined.
[0022] In one embodiment, when the target is a CEC device, the controller is configured to perform the operation corresponding to a preset function key when controlling the target to perform the operation:
[0023] Send CEC control commands to the CEC device; the CEC control commands are used to instruct the CEC device to perform corresponding operations.
[0024] In one embodiment, when the target is a display device, the controller is configured to perform the operation corresponding to a preset function key when controlling the target to perform the operation:
[0025] Intercept CEC control commands and control the display to show OSD pop-ups.
[0026] In one embodiment, after the controller executes the command to control the display to show the OSD pop-up window, it is further configured to:
[0027] Start the timer; if the timer duration is less than the preset duration and a next press event for the preset function key is received from the remote control, send a CEC control command to the CEC device and control the display to keep the OSD pop-up window displayed; if the timer duration exceeds the preset duration and no next press event is received within the timer duration, control the display to hide the OSD pop-up window.
[0028] In one embodiment, the processor is further configured to:
[0029] If the current key press duration is between the second duration threshold and the first duration threshold, stop responding to the current press event.
[0030] Secondly, some embodiments also provide a device control method applied to a display device, including:
[0031] When the display device is connected to the CEC device via an HDMI interface, after receiving a current press event for a preset function key sent by the remote control, the current press information corresponding to the current press event is obtained; wherein, the preset function key has the function of controlling the CEC device and triggering the display of the OSD pop-up window on the display device; the current press information includes the current button press duration and the current button press time;
[0032] Based on the current press information, the previous key press time, and the display status of the OSD pop-up, select the target of the current press event from the display device and the CEC device;
[0033] Controls the target object to perform the operation corresponding to the preset function key.
[0034] In the above embodiments, by combining the button press duration, button time interval, and OSD pop-up status to comprehensively determine the operation intent, and matching the corresponding execution subject and operation action based on the determination result, it is possible to avoid external CEC devices preempting button control and eliminate response conflicts of dual-function buttons. At the same time, it can distinguish between valid operations and accidental touches, adapt to the protocol characteristics of different types of external devices, and customize the determination parameters to adapt to diverse usage habits. This effectively improves the accuracy of button intent recognition and the stability of device operation, broadens the scope of scenario adaptation, takes into account both local information viewing and peripheral device control needs, and significantly improves the operation experience when multiple devices are interconnected.
[0035] Thirdly, some embodiments also provide a device control apparatus, including:
[0036] The information acquisition module is used to receive a current press event for a preset function key sent by the remote control when the display device is connected to the CEC device via an HDMI interface, and then acquire the current press information corresponding to the current press event. The preset function key has the function of controlling the CEC device and triggering the display of the OSD pop-up window on the display device. The current press information includes the current button press duration and the current button press time.
[0037] The object determination module is used to select the target of the current press event from the display device and the CEC device based on the current press information, the previous key press time, and the display status of the OSD pop-up window.
[0038] The event execution module is used to control the target object to perform the operation corresponding to the preset function key.
[0039] In the above embodiments, by combining the button press duration, button time interval, and OSD pop-up status to comprehensively determine the operation intent, and matching the corresponding execution subject and operation action based on the determination result, it is possible to avoid external CEC devices preempting button control and eliminate response conflicts of dual-function buttons. At the same time, it can distinguish between valid operations and accidental touches, adapt to the protocol characteristics of different types of external devices, and customize the determination parameters to adapt to diverse usage habits. This effectively improves the accuracy of button intent recognition and the stability of device operation, broadens the scope of scenario adaptation, takes into account both local information viewing and peripheral device control needs, and significantly improves the operation experience when multiple devices are interconnected.
[0040] Fourthly, some embodiments also provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the methods provided in some embodiments of the first aspect.
[0041] Fifthly, some embodiments also provide a computer program product, including a computer program that, when executed by a processor, implements the steps of the methods provided in some embodiments of the first aspect. Attached Figure Description
[0042] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.
[0043] Figure 1 This is a schematic diagram illustrating the operation scenarios between a display device and a remote control provided in some embodiments of this application;
[0044] Figure 2This is a schematic flowchart of a device control method provided in some embodiments of this application;
[0045] Figure 3 This application provides a flowchart illustrating the process of determining the target of a current press event in some embodiments.
[0046] Figure 4 Schematic flowcharts for determining the target of the current press event provided in other embodiments of this application;
[0047] Figure 5 A flowchart illustrating the process of determining the target of a current press event is provided for some embodiments of this application;
[0048] Figure 6 A schematic diagram illustrating the process of generating CEC control commands provided for some embodiments of this application;
[0049] Figure 7 A flowchart illustrating the process of controlling the display of OSD pop-ups provided in some embodiments of this application;
[0050] Figure 8 A schematic flowchart illustrating a device control method provided in some embodiments of this application;
[0051] Figure 9 This is a schematic diagram of the structure of a device control apparatus provided in some embodiments of this application. Detailed Implementation
[0052] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.
[0053] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0054] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.
[0055] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.
[0056] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0057] In this application embodiment, "display device" generally refers to a device with screen display and data processing capabilities. For example, display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.
[0058] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, the user can operate the display device 200 via the touch remote control 100.
[0059] CEC device 300 is an external terminal equipped with a consumer electronics control protocol, including but not limited to set-top boxes and game consoles, capable of receiving control commands to complete corresponding operations. CEC device 300 is wiredly connected via the HDMI interface of display device 200, forming a hardware interconnect link that can synchronously transmit audio signals and control commands. CEC device 300 and display device 200 interact according to the HDMI CEC protocol; display device 200 can send control commands to CEC device 300, and CEC device 300 returns status data. CEC device 300 and display device 200 share preset function buttons on the same remote control 100 for dual control. Button operations can activate the OSD pop-up window on the display device or perform function operations on the CEC device; the button control permissions of the two are interconnected and can be intelligently switched and allocated.
[0060] HDMI is a digital video / audio interface capable of simultaneously transmitting audio and video signals without the need for additional audio cables, simplifying installation and ensuring high-quality audio and video signal transmission. With the development of HDMI technology, its width has continuously increased, providing higher transmission bandwidth and supporting high-definition, ultra-high-definition, and even higher resolution video transmission, meeting the growing demand for high-definition video. It should be understood that HDMI allows various external CEC devices, such as game consoles, Blu-ray players, and set-top boxes, to be connected to the display device 200, providing users with a richer and more immersive audio-visual entertainment experience. Furthermore, to facilitate differentiation and management of HDMI interfaces, the display device and its controller label the HDMI interfaces using numbers, letters, or specific symbols, such as HDMI 1, HDMI 2, or HDMI A, HDMI B, etc. Simultaneously, each HDMI interface can independently complete CEC protocol handshake, device identification, and link monitoring, supporting simultaneous access of multiple devices and independent management of a single device, avoiding mutual interference between multiple interface devices, and providing a hardware link foundation for subsequent accurate identification of target CEC devices and targeted issuance of control commands.
[0061] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. The display device 200 can communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The display device 200 can provide broadcast television reception functionality and can also be supplemented with intelligent network television functionality that provides computer support, including but not limited to network television, smart television, and Internet Protocol television (IPTV). The display device can complete system firmware upgrades, protocol library updates, user operation behavior data synchronization, and threshold parameter cloud adaptation through the server 400, providing data and version support for subsequent adaptive threshold adjustment, instruction library iteration, and intelligent logic optimization.
[0062] In some embodiments, the controller 100 mainly consists of a battery compartment, a power management module, a main control MCU, a crystal oscillator, a button matrix, a pressure sensor array, an infrared modulation and driving circuit, an infrared emitting LED, a Bluetooth BLE module, and a vibration motor. The battery compartment is powered by two AAA batteries, which, after voltage regulation and filtering by the power management module, supply power to the main control MCU. The main control MCU is externally connected to dual crystal oscillators at 32.768kHz and 455kHz for system timing and generating a 38kHz infrared carrier wave. The button matrix uses a row-column electrode structure, combined with conductive rubber for button input. Each button integrates a pressure sensor array to synchronously collect the pressure intensity signal, which, along with the pressing duration, serves as the hardware basis for determining the operation intention. The main control MCU modulates the button codes onto a 38kHz carrier wave, amplifies it via a transistor, and drives a 940nm infrared LED to emit remote control signals. The remote control also integrates a Bluetooth BLE module as a backup channel for the infrared link, automatically switching the communication link when the infrared signal is blocked or interfered with. Simultaneously, a built-in vibration motor provides tactile feedback when a valid press is detected, improving control reliability and user experience.
[0063] In some embodiments, the display includes display function components for presenting images and driving components for driving image display. The display is used to receive and display content output from the controller. For example, the display can be used to display video content, image content, menu control interface components, and user control UI interfaces. The display supports an OSD layer overlay rendering mechanism, which can display settings pop-ups, parameter prompts, and status icons on the upper layer without destroying the underlying playback screen. It also supports various display forms such as pop-up persistence, instant hiding, and delayed disappearance, adapting to the interaction needs of different button operation scenarios. The display is equipped with an independent OSD hardware driver chip, which is solely responsible for drawing and refreshing the pop-up layer, without occupying the main screen processing hardware resources. The pop-up and hiding actions are faster, and there is no stuttering or tearing during screen transitions.
[0064] In some embodiments, the controller may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and provide input / output interfaces from the first to the nth interface. The controller controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller controls the overall operation of the display device. Internally, the controller integrates an independent key scanning module, a millisecond-level timing module, a CEC protocol parsing module, an OSD rendering control module, an instruction verification and retransmission module, and a user behavior statistics module. It can perform multi-threaded operations in parallel for key acquisition, duration calculation, status determination, protocol matching, instruction generation, interface control, and error correction, ensuring efficient, synchronous, and delay-free execution of the entire control logic. At the hardware level, it is equipped with a dedicated real-time timing chip with microsecond-level timing accuracy, significantly improving the accuracy of press duration and operation window calculation compared to software timing. The peripheral signal receiver is equipped with a hardware filtering circuit to filter out false key signals caused by static electricity and electromagnetic noise, achieving first-level anti-mistouch filtering.
[0065] With the development of display devices (such as televisions), users can use remote controls to flexibly operate them. However, when a display device is connected to a CEC device via an HDMI port and the CEC linkage function is enabled, external devices can easily preempt button control permissions, leading to mutual conflict of button functions. Specifically, when a user needs to view the local OSD signal information, the button command is often directly forwarded to the CEC device, failing to trigger the local OSD pop-up window. Furthermore, when the OSD pop-up window is displayed, the button response logic is easily fixed to local triggering, failing to respond promptly to the control needs of external devices. Simultaneously, traditional solutions use fixed button thresholds and single judgment logic, failing to distinguish between diverse user intentions such as short presses, long presses, accidental touches, and continuous rapid presses. This results in numerous technical defects, including accidental triggering within critical press intervals, device protocol incompatibility, command packet loss and unresponsiveness, long-term pop-up window obstructing the screen, and button conflicts, severely impacting the stability of operation and user experience in multi-device interconnection scenarios.
[0066] Based on this, in some embodiments, a device control method is provided. This video quality determination method can be implemented using a display device, a remote controller, and external devices. For example... Figure 2 As shown, a device control method applied to a controller in a display device may include the following steps:
[0067] S201: When the display device is connected to the CEC device via the HDMI interface, after receiving the current press event for the preset function button sent by the remote control, the current press information corresponding to the current press event is obtained.
[0068] Among them, the preset function keys have the function of controlling the CEC device and triggering the display of the OSD pop-up window on the display device; the current press information includes the current key press duration and the current key press time.
[0069] The preset function keys refer to the buttons on the remote control (such as the up arrow key). These keys have dual core capabilities: firstly, they can remotely control the operating status of external CEC devices; secondly, they can trigger the display of the OSD settings pop-up window on the local device. These keys are customizable multiplexed keys, allowing for pre-defined function logic based on device system requirements, and supporting differentiated triggering of single keys in multiple scenarios.
[0070] The current press event refers to a single button trigger signal sent by the remote control to the infrared receiver module of the display device when the user operates a preset function button on the remote control. Each valid button press corresponds to an independent current press event. The current press information is a set of core parameters generated by the display device after parsing the press event, containing two key dimensions. The first is the current button press duration, which is the duration for which the user holds down the preset button, accurate to the millisecond level; the second is the current button press time, which is the system timestamp that triggered this press event, used to distinguish between multiple consecutive button operations and determine the button trigger sequence.
[0071] Optionally, after the display device and CEC device complete the physical connection and protocol handshake initialization via the HDMI interface, the controller monitors the remote control's button signals in real time. When a preset function button press event is detected, the controller immediately collects and records the complete parameters of this press, generating a standardized current press information dataset. The controller continuously monitors the HDMI link status, enabling multi-dimensional button information collection only when the CEC device is online, the protocol handshake is successful, and the link communication is normal. If the link is abnormal or the device is offline, the collection logic is automatically simplified, and the button press is directly assumed to act on the local device, avoiding invalid calculations and logical misjudgments.
[0072] In one embodiment, after the display device is powered on, it automatically scans all HDMI ports to detect whether the external device is a terminal that supports the CEC protocol, completes HDMI CEC protocol pairing and communication link establishment, and marks the current HDMI port as a valid CEC connection. When a preset function key press event is detected, the system timer counts in real time, recording the start timestamp of the key press and the end timestamp of the key release, and calculates the current key press duration. Simultaneously, the current system time is read as the current key press time, and the previous key press timestamp is retrieved from the controller's cache to complete basic data retention. The press duration and current key press time are encapsulated into structured current press information and stored in the controller's temporary memory to avoid data loss. Simultaneously, auxiliary feature data such as the key level jitter data, infrared signal strength, and key repeat frequency are collected and bound to the basic press information for storage, providing multi-dimensional data support for subsequent accidental touch filtering and accurate intent determination.
[0073] S202, based on the current press information, the previous key press time, and the display status of the OSD pop-up window, select the target of the current press event from the display device and the CEC device.
[0074] Among them, the previous key press time is the system timestamp of the previous preset function key trigger cached by the controller of the display device. It is used to determine whether the current key press is a continuous or repeated press operation. It is the core timing parameter that distinguishes between single trigger and continuous trigger logic.
[0075] The OSD pop-up is a visual pop-up that is overlaid on the screen by the display device. It is used to display parameter settings, device status, function menus, etc. The OSD pop-up has two core states: display state (the pop-up has popped up and is in the foreground) and hidden state (the pop-up is closed and is not in the foreground). These are the core judgment conditions for the differentiated execution of button functions.
[0076] The target of the action is the main device that is ultimately controlled to perform the operation when the key press command takes effect.
[0077] Optionally, based on three core parameters—current press information, historical timing data (previous key press time), and local OSD pop-up display status—a preset judgment logic can be used to differentiate the target of the current key press event, i.e., whether the instruction acts on the local display device or an external CEC device, thus achieving intelligent adaptation for single-key dual-device operation. In one embodiment, a multi-dimensional layered coupled judgment logic can also be adopted to break the limitations of traditional single-state judgment. Through cross-verification of three parameters—timing interval, press duration, and interface status—the problem of permission contention, function mutual exclusion, and intent misjudgment in single-key dual-control scenarios can be completely solved.
[0078] In one embodiment, the controller synchronously retrieves four core parameters: current press duration, current button press time, previous button press time, and the real-time display status of the OSD pop-up. The controller incorporates multi-level judgment thresholds and rules to match the corresponding target object—the execution subject of this press event—based on the collected current press information, previous button press time, and OSD pop-up display status. It further generates a target object identifier, which is then synchronously sent to the instruction execution module. Simultaneously, the controller reads the system load, screen refresh status, and HDMI bus occupancy status in real time. Under heavy device load, it prioritizes judgment stability and shields against transient interference signals to ensure accurate target object determination.
[0079] S203, controls the target object to perform the operation corresponding to the preset function key.
[0080] Optionally, based on the determined target, the preset function instruction set of the corresponding device is invoked to accurately execute the matching operation corresponding to the preset function key, thereby realizing differentiated execution of local OSD control or CEC device remote control and completing a complete key linkage control process.
[0081] In one embodiment, the controller has a built-in button function mapping table that binds preset buttons, target objects, and operation commands one by one. After locking the target object, the corresponding preset operation command is automatically retrieved. If the target object is a display device, the local UI rendering module and parameter adjustment module are invoked to perform local operations such as OSD pop-up window pop-up, pop-up window parameter modification, and pop-up window closure. If the target object is a CEC device, the control command is encapsulated through the HDMI CEC communication protocol and sent to the external CEC device via the HDMI bus to trigger device linkage operation. After the operation is completed, the OSD pop-up window display status is updated in real time, the current button press time is cached as the new "previous button press time", the press information parameters are reset, and the system waits for the next button event to be triggered. At the same time, the operation log is automatically retained, and user behavior statistics are updated to provide data accumulation for subsequent adaptive threshold correction and operation habit adaptation.
[0082] For example, if the target is a display device, a local OSD pop-up window is executed, overlaying the menu settings interface on the display device's screen. If the target is a CEC device, the display device sends a sleep command via the HDMI CEC protocol, controlling the Blu-ray player to enter standby mode, with no changes to the local display interface.
[0083] In the above technical solution, the operation intent is comprehensively determined by combining the button press duration, button time interval, and OSD pop-up status. Based on the determination result, the corresponding execution subject and operation action are matched. This can prevent external CEC devices from preempting button control and eliminate response conflicts of dual-function buttons. At the same time, it can distinguish between valid operations and accidental touches, adapt to the protocol characteristics of different types of external devices, and customize the determination parameters to adapt to diverse usage habits. This effectively improves the accuracy of button intent recognition and the stability of device operation, broadens the scope of scenario adaptation, takes into account the needs of local information viewing and peripheral device control, and significantly improves the operation experience when multiple devices are interconnected.
[0084] Optionally, for scenarios involving collaborative control of display devices and CEC devices under an HDMI link, in order to achieve precise allocation of control subjects for reused buttons, the controller relies on multiple conditions such as button timing interval, press duration, and OSD pop-up status for hierarchical judgment. First, it defines the button trigger interval based on the time difference between consecutive buttons, and preliminarily divides the judgment branches based on the interval threshold. Then, it selects the controlled subject corresponding to the button command based on the differences in the remaining feature parameters. This avoids functional conflicts caused by multiple controls with a single button and improves the rationality of the device control logic and the stability of the interaction.
[0085] Based on this, and building upon the above embodiments, in an exemplary embodiment, the process for determining the target of the current pressing event in S202 is further refined, such as... Figure 3 As shown, the following steps may be included:
[0086] S301 determines the key press interval based on the difference between the current key press time and the previous key press time.
[0087] The key interval refers to the time difference between the current key press and the previous key press, representing the speed of the trigger interval between two key presses.
[0088] Optionally, when the controller detects a key press, it immediately reads the system clock, generates and saves the current key press time, and reads the previously saved key press time from the memory cache. Further, it subtracts the current key press time from the previous key press time to obtain the difference, and uses this difference as the key press time interval. In this embodiment, the controller uses a high-precision system clock with millisecond-level accuracy, which can accurately distinguish between rapid consecutive key presses, interval operations, and single independent operations, providing precise timing basis for the hierarchical judgment logic.
[0089] S302, if the button press interval is less than or equal to a preset interval threshold, determine that the current press event applies to the CEC device.
[0090] The preset time interval is a fixed time value (e.g., 300ms / 500ms) pre-written into the controller, used to distinguish between continuous rapid presses and ordinary independent buttons. Furthermore, the preset interval threshold supports adaptive dynamic adjustment by the system, automatically optimizing based on user history of rapid presses and the aging state of the remote control hardware, improving adaptability to different users and device operating conditions.
[0091] Optionally, the controller compares the calculated key press interval with a preset interval threshold. If the key press interval is less than or equal to the preset interval threshold, it is determined to be continuous rapid key presses. In the scenario of continuous rapid key presses, the target can be directly locked as the CEC device, and no further judgment is required. After execution, the cache is updated, and the current key press time is overwritten with the new previous key press time. This pre-processing rapid judgment logic can shorten the calculation chain, reduce system resource consumption, and achieve millisecond-level fast response in continuous operation scenarios.
[0092] For example, if the preset interval threshold is 300ms and the button time interval is 250ms, then the button time interval is less than the preset time interval, and the action is determined to be a CEC device.
[0093] S303: When the key press interval is greater than a preset interval threshold, select the target of the current press event from the display device and the CEC device based on the current key press duration and the display status of the OSD pop-up window.
[0094] Optionally, if the time interval between key presses exceeds a preset threshold, it is determined as an independent single key press. In this case, the controller simultaneously acquires two parameters: the current key press duration and the OSD pop-up display status, and executes the secondary judgment logic.
[0095] The above technical solution first determines the time interval between key presses to quickly distinguish between continuous key presses and independent key presses, and then performs a second precise determination by combining the press duration and OSD status. This achieves layered, efficient, and conflict-free selection of the key action object, ensuring both rapid response to CEC device control when pressing continuously and flexible switching between controlling the display device or CEC device when pressing independently. This effectively avoids accidental triggering of commands and functional conflicts, improving the accuracy, response speed, and user experience of key control.
[0096] Optionally, based on the completion of the key interval determination, the press operation type is divided according to the graded duration threshold. Combined with the real-time status display of the OSD pop-up window, the control subject is identified in layers. The target is locked differently according to the different duration intervals of long and short presses, so as to achieve precise distribution of key commands, effectively distinguish the device control intention, and avoid the problem of functional confusion under the linkage control of multiple devices.
[0097] Based on this, and building upon the above embodiments, in an exemplary embodiment, the process for determining the target of the current pressing event in S303 is further refined, such as... Figure 4 As shown, the following steps may be included:
[0098] S401, if the current button press duration is greater than or equal to the first duration threshold, determine that the target of the current press event is the CEC device.
[0099] The first duration threshold is a critical time setting for determining a long press operation, used to define prolonged pressing behavior. The first duration threshold supports adaptive dynamic correction by the system, and can be dynamically fine-tuned according to ambient temperature, button aging, and user long press habits, solving the problem of poor adaptability of traditional fixed thresholds.
[0100] Optionally, the controller retrieves the collected button press duration and compares it with a preset first duration threshold. If the press duration is greater than or equal to the first duration threshold, it is determined that the user has performed a long press operation. The target of this press event is directly designated as the CEC device, and corresponding control commands are subsequently sent to the CEC device.
[0101] For example, if the current button press duration is 900ms and the first duration threshold is 500ms, then the current button press duration is determined to be greater than the first duration threshold, and the target is directly determined to be a CEC device.
[0102] S402, if the current key press duration is less than or equal to the second duration threshold, select the target of the current press event from the display device and the CEC device according to the display status of the OSD pop-up window.
[0103] The second duration threshold is a critical time setting for determining a short press operation, and the first duration threshold is greater than the second duration threshold. For example, the first duration threshold can be set to 500ms, and the second duration threshold can be set to 300ms. The second duration threshold also has adaptive adjustment capabilities to adapt to users' short press habits and improve the accuracy of short press recognition.
[0104] Optionally, if the press duration is less than or equal to the second duration threshold, it is identified as a short press operation; the real-time status of the screen OSD pop-up is obtained simultaneously, and the controlled device is determined based on the status branch.
[0105] For example, when the OSD pop-up is displayed, the target is selected as the display device, and local menu operations are responded to; when the OSD pop-up is hidden, the target is selected as the CEC device, and external device control is performed.
[0106] The above technical solution distinguishes between long-press and short-press operation modes through two-level differentiated duration thresholds, and then further determines the control subject by combining the OSD interface status. The layered logic is clear and well-organized, which can accurately identify the user's control intention and reasonably distribute button commands to the corresponding devices. This effectively prevents functional confusion and command mis-sending problems that occur when controlling multiple devices with a single button, and improves the stability and operational accuracy of multi-device linkage control.
[0107] Optionally, the real-time display status of the OSD pop-up window can be used as the basis for judgment. The main body of button control can be selected according to the difference between the two working conditions of the pop-up window being hidden or displayed. This can be used to divide the command response permissions of the local device and the external CEC device, so as to realize the quick differentiation of the button control target and adapt to the control needs under different screen interfaces.
[0108] Based on this, and building upon the above embodiments, in an exemplary embodiment, the process for determining the target of the current pressing event in S402 is further refined, such as... Figure 5 As shown, the following steps may be included:
[0109] S501, when the OSD pop-up window is hidden, determine that the target of the current press event is the display device.
[0110] Understandably, when there is no OSD pop-up, users are more likely to want to operate the display device itself, so the key commands belong to the local device; when the pop-up appears, the user's need to adjust the parameters on the local device has been met, and the intention to operate shifts to the external audio-visual device, so the commands are assigned to the CEC device, which is in line with actual operating habits.
[0111] Optionally, the controller reads the interface identifier bit of the display in real time to determine that the OSD pop-up window is not activated or is in a hidden state; it directly identifies the controlled subject of this key event as the display device, calls the local function module, and executes the local operation logic corresponding to the key.
[0112] For example, with no settings pop-up window on the monitor screen, pressing the function key will direct the command to the TV itself, bringing up the system menu interface. With the OSD pop-up window closed, pressing the adjustment keys will directly control the display device to adjust brightness and picture mode.
[0113] S502, when the OSD pop-up window is in the "display" state, determine that the current press event is applied to the CEC device.
[0114] Optionally, if the controller detects that the OSD pop-up is in the foreground, and determines that there is no need to operate the local interface, it switches the button action to the external CEC device and sends control commands via the HDMI communication link.
[0115] For example, when a parameter settings pop-up window appears on the screen, pressing a button sends a command to the set-top box to complete the signal source switching operation. Pressing a button during the OSD menu interface display will activate an external amplifier to control the volume.
[0116] The above technical solution uses the OSD pop-up state as the judgment criterion, accurately allocates button control permissions according to different scenarios, prioritizes responding to local operations when the interface is hidden, and switches to managing external CEC devices when the interface pops up. The logic judgment is simple and efficient, effectively distinguishes the control requirements under different usage scenarios, avoids command response confusion, and improves the adaptability and smoothness of multi-device linkage control.
[0117] Optionally, after receiving the current press event of the preset function button sent by the remote control, it is necessary to match the corresponding HDMI CEC protocol specification according to the actual type of the external CEC device, and accurately generate a dedicated control command adapted to the device. This avoids the problem of command incompatibility and control failure caused by protocol differences between different types of CEC devices, and ensures that button operation can be executed stably and effectively for all types of CEC devices.
[0118] Based on this, and building upon the above embodiments, in an exemplary embodiment, the process following receiving a current press event of a preset function key from a remote control is further refined, such as... Figure 6 As shown, the following steps may be included:
[0119] S601, after receiving the current press event of the preset function key sent by the remote control, determines the device type of the CEC device.
[0120] Among them, the equipment type is a category that classifies CEC equipment according to its function, such as set-top boxes, power amplifiers, game consoles, Blu-ray players, etc.
[0121] Optionally, after receiving a preset function button press event transmitted by the remote control, the controller immediately initiates an identity query request to the external device via the HDMI communication link to obtain the device's identity identifier and attribute information. It then compares and matches this information with a local preset device feature database to identify and determine the specific type of the currently connected CEC device. The controller supports multi-device differentiation and identification, accurately distinguishing multiple different types of CEC devices on the same link and independently matching their corresponding protocols, avoiding issues of command confusion and mistransmission among multiple devices.
[0122] For example, the controller queries the feedback device identifier to match set-top box characteristics, determining the device type to be a network set-top box. It reads the device hardware attributes and protocol fields to identify the device type as an audio amplifier. Based on the device's reported functional information, it determines the device type to be a home game console.
[0123] S602 determines the CEC control command corresponding to the preset function button based on the HDMI CEC protocol corresponding to the device type.
[0124] The HDMI CEC protocol is a built-in device communication protocol of the HDMI bus, with different device types following corresponding sub-protocol specifications. CEC control commands are control commands encapsulated according to the protocol format and can be parsed and executed by CEC devices.
[0125] Optionally, the controller matches the HDMI CEC dedicated communication protocol corresponding to the identified CEC device type. By querying the system's built-in button function-to-CEC command mapping table, it converts the operation of preset function buttons into CEC control commands that conform to the protocol specifications and can be correctly recognized and executed by the target CEC device. The system has a built-in, iteratively updatable protocol command library, which can be upgraded via the cloud to add device protocol adaptation rules, continuously expanding the types of compatible devices and improving the versatility and scalability of the solution.
[0126] For example, if the device type is determined to be a set-top box, the set-top box-specific CEC protocol is matched to convert button actions into signal source switching commands. If the device type is determined to be a power amplifier, the audio device protocol standard is invoked to generate volume increase / decrease control commands. If the device type is determined to be a Blu-ray player, pause and power on / off control commands are encapsulated according to the audio-visual playback device protocol.
[0127] The above technical solution first identifies the type of external CEC device, then matches a dedicated protocol to generate control commands. It can adapt to the communication differences of different types of external devices, solve the problems of insufficient compatibility of general commands and devices being unable to respond to control, ensure stable and effective cross-device control, broaden the scope of button function adaptation, and improve the universality and reliability of device linkage control under HDMI networking.
[0128] Optionally, after determining that the key action object is an external CEC device, the controller issues a control instruction of the adaptation protocol through the HDMI communication link, so as to drive the target device to respond and complete the corresponding control action, and realize cross-device linkage control. Based on this, the controller sends a CEC control instruction to the CEC device, wherein the CEC control instruction is used to instruct the CEC device to perform the corresponding operation. Specifically, when it is determined that the key action object is a CEC device, the controller sends the matched and generated CEC control instruction to the target CEC device via the HDMI bus link. This instruction can drive the CEC device to parse and identify, and automatically perform the corresponding functional operation corresponding to the key. For example, after receiving the instruction, various CEC devices can correspondingly complete different functional operations such as volume adjustment, device standby, playback start / stop, and signal source switching. Meanwhile, the controller has built-in instruction check, automatic retransmission, and abnormal backup mechanisms. When an instruction is issued, it automatically encapsulates a check code and a serial number, receives the response feedback from the device, automatically retransmits for scenarios such as packet loss, interference, and handshake abnormalities. If multiple attempts fail, it terminates the issuance and records an abnormal log, which greatly improves the control stability under complex working conditions. The above technical solution, by issuing exclusive control instructions through bus transmission, can accurately drive external devices to complete corresponding actions, has stable instruction transmission and interaction, and guarantees the effective implementation of cross-device control instructions.
[0129] Optionally, when it is determined that the key action object is the local display device, the system blocks the transmission of control instructions to the external device, and simultaneously drives the display screen to invoke an OSD popup to complete local interface interaction operations. Based on this, the controller intercepts the CEC control instruction, and controls the display to display the OSD popup. Optionally, when the action object is determined to be a display device, the controller must intercept the CEC control instruction, and simultaneously control the display to display the OSD popup, so as to prevent the key instruction from being mistakenly sent to the external CEC device, avoid wrong control of external devices such as set-top boxes and power amplifiers, prevent functional conflicts and misoperations, and keep the key instruction executed locally on the display device, which is specially used for invoking and operating the local OSD menu, and implementing local functions such as setting, adjustment, and menu display.
[0130] In one embodiment, after the controller determines that the action object of the current pressing event is a display device, first, it intercepts the CEC control instruction. The controller terminates the sending process of the generated CEC control instruction, closes the HDMI CEC instruction output channel, prohibits sending the instruction to the external CEC device through the HDMI interface, clears the instruction sending cache, and blocks the external control link, so as to ensure that the CEC device does not receive any control signal. Further, the controller controls the display to display the OSD popup. The controller sends a local display instruction to the OSD rendering module of the display device, triggers the loading and drawing of the OSD layer, drives the display to overlay and display OSD popups such as menus and setting items on the upper layer of the current picture, and completes the local interface interaction operation corresponding to the key.
[0131] In an optional embodiment, to ensure the CEC device's response time, a command verification, error identification, automatic retransmission, and anomaly fallback mechanism can be added to solve the problem of cross-device control failure in complex electromagnetic environments and significantly improve control stability. Optionally, after the controller generates a CEC control command, it automatically adds a checksum and command sequence number and sends it to the CEC device via the HDMI bus. After receiving the command, the CEC device returns an acknowledgment signal, and the controller compares the checksum to determine whether the command transmission is complete and valid. If command packet loss, verification error, or no acknowledgment signal is detected, the controller automatically triggers a secondary retransmission mechanism, with a preset upper limit on the number of retransmissions. If multiple retransmissions fail, a link anomaly is determined, command issuance is terminated, and the OSD pop-up window is maintained. At the same time, an anomaly log is generated to avoid invalid commands consuming system resources.
[0132] For example, in a home theater environment with electromagnetic interference, the initial CEC volume adjustment command transmission may suffer packet loss. The controller, not receiving a response from the device, will automatically retransmit the command to ensure the amplifier responds normally to volume adjustment operations. In the event of a temporary handshake anomaly on the HDMI link, command verification may fail, causing the system to terminate command transmission while retaining the OSD pop-up to prevent erratic device responses, and simultaneously awaiting the next valid button press.
[0133] The above technical solution effectively avoids the accidental transmission of key commands to peripherals, eliminating the problem of misoperation across devices; at the same time, it quickly brings up the local OSD pop-up window, ensuring normal response of local operation, clearly defining control permissions, and improving control accuracy and user experience.
[0134] Optionally, after the OSD pop-up window is activated, a timer monitoring function is enabled. The operation window is defined based on a preset duration. If multiple keys are pressed consecutively within a short period, control of the external device is switched while the pop-up window remains open. If no further operation occurs within the timeout period, the pop-up window automatically collapses, balancing local interface operation with cross-device control switching needs. It also supports graded recognition of consecutive key presses within the window period, matching different levels of CEC control commands based on the number of consecutive key presses, enabling multi-level fine-grained control with a single key and enriching key reuse functionality.
[0135] Based on this, and building upon the above embodiments, in an exemplary embodiment, the process of the controller controlling the display to show the OSD pop-up window is further refined, as follows: Figure 7 As shown, the following steps may be included:
[0136] S701, start timer.
[0137] The timer is a software timing module built into the controller. It starts automatically after the OSD pop-up window is activated and is used to count the duration of the pop-up window after it is displayed, providing a time reference for subsequent operation logic judgment.
[0138] Optionally, after successfully driving the display device to show the OSD pop-up window, the controller immediately triggers the initialization of the built-in software timer and starts timing. The controller synchronously records the timing start timestamp, continuously updates the current timing duration in real time, and simultaneously starts a button signal listening thread to prepare data and functions for button event judgment and logic execution during the subsequent window period. The entire timing process runs independently and does not affect the normal screen display and signal reception functions of the device.
[0139] In one embodiment, the controller immediately initializes a timer the moment the display device invokes the volume adjustment OSD pop-up, continuously accumulating the timer duration from zero. After the local parameter setting OSD pop-up is rendered, the system automatically starts the timing module, initiating monitoring of the operation window period with a preset duration of 3 seconds.
[0140] S702, if the timer duration is less than the preset duration, and if it receives a next press event for the preset function key sent by the remote control, it sends a CEC control command to the CEC device and controls the display to keep the OSD pop-up window displayed.
[0141] The preset duration is a pre-defined threshold for pop-up window dwell time in the device system (e.g., 2s, 3s), used to distinguish between short-duration continuous operation windows and no-operation timeout states. It is the core time standard for switching control logic. The next button event is a valid button trigger signal generated when the user presses a preset function button on the remote control again after the OSD pop-up window is displayed and the timer is started.
[0142] Optionally, after the timer starts, the controller compares the current timing duration with the system's preset duration threshold in real time and continuously monitors the key input signals. When it detects that the current timing duration has not exceeded the preset operation window period and captures the next press event of the user pressing the preset function key again, the controller immediately switches the key control logic.
[0143] The system terminates the button response logic of the local display device, retrieves the standard CEC control commands adapted to the current CEC device, and sends the commands to the external CEC device via the HDMI communication link, driving the CEC device to perform the corresponding control operation. Simultaneously, it continuously locks the display state of the OSD pop-up window, preventing it from closing and keeping the screen interface unchanged, providing visual feedback for continuous user operation. Furthermore, the system can recognize the number of consecutive presses for the next press event; a single press executes basic level control, while multiple consecutive presses execute advanced rapid adjustment control, achieving tiered and refined control.
[0144] For example, if the preset duration is 3 seconds, when the OSD pop-up window is displayed for 1 second, the user presses the volume button again, the controller sends a volume adjustment command to the power amplifier CEC device, and the screen continues to display the volume OSD pop-up window without closing.
[0145] If the user presses the function button again within 2 seconds of the OSD menu pop-up appearing, the controller will send a playback control command to the set-top box CEC device, and the OSD pop-up will remain permanently displayed.
[0146] Pressing the button repeatedly within the 2-second operation window will cause the system to continuously send control commands to the external game console CEC device, while the OSD pop-up interface remains intact without any automatic hiding action.
[0147] S703: If the timer duration exceeds the preset duration and no next press event is received within the timer duration, the control display will hide the OSD pop-up window.
[0148] Optionally, the controller continuously monitors the timer's running status and key input. If the timer's accumulated duration exceeds the system's preset duration threshold, and no further press event on the preset function key is detected within the entire timing window, the controller determines that the user's local operation has ended. The controller then triggers the OSD pop-up closing logic, closes the OSD layer rendering channel, clears the overlaid pop-up interface on the screen, controls the display to hide the OSD pop-up, and restores the device to normal full-screen display. Simultaneously, the timer is reset, completing the closed-loop reset of a single operation process, and awaits the next key press command.
[0149] For example, if there is no secondary button operation within 3 seconds after the OSD pop-up window is displayed, the system will automatically hide the volume OSD pop-up window after the timer expires, and the screen will return to the normal viewing screen.
[0150] During the parameter setting OSD pop-up display, if no subsequent key input is made within the preset 2-second window period, the pop-up will automatically disappear after the timer expires, and the device will return to its initial display state.
[0151] After the OSD pop-up is activated, the user performs a single operation without continuous pressing. Once the timer expires, the system automatically closes the pop-up and completes the operation.
[0152] Optionally, in one embodiment, a key press count detection mechanism can be added within the OSD pop-up window timer period. Different levels of CEC control commands are matched based on the number of presses, achieving refined hierarchical control, enriching key reuse functions, and improving the control dimensions and intelligence. In one embodiment, within the preset timer operation window period, the controller monitors the pressing frequency and number of presses of preset function keys in real time, and counts the effective pressing count per unit time. The system pre-stores the mapping relationship between the number of presses and hierarchical CEC commands. A single press executes the basic level control command, and multiple presses execute the advanced level control command. Simultaneously, the OSD pop-up window remains continuously displayed until the window period expires and it automatically hides, achieving visual hierarchical control. For example, in a volume adjustment scenario, within the OSD pop-up window display period, a single press of the volume button controls a single level of volume increase or decrease for the amplifier's CEC device; a quick double-click achieves three levels of rapid volume adjustment; and a triple click achieves extreme volume adjustment. In video playback scenarios, a single press of the function key during the window period enables play / pause, a double press enables fast forward, and a triple press enables rewind, achieving multi-dimensional CEC device control based on the same preset button.
[0153] The above technical solution, by adding a time-based monitoring mechanism after the OSD pop-up is activated, constructs a fixed-duration button operation window period, realizing scenario-based logical switching of a single preset function button. During the window period, continuous button presses can control external CEC devices while retaining the local OSD visual interface. If there is no operation after the timeout, the pop-up is automatically hidden and the device's original display state is restored. This fully caters to users' habits of continuous and single-operation, realizing the dual function of a single button for both local interface operation and cross-device linkage control. It effectively simplifies device operation steps, improves ease of operation, and avoids the problem of OSD pop-ups obscuring the screen and ineffectively occupying system resources, ensuring the intelligence, smoothness, and cleanliness of device operation and screen display.
[0154] Optionally, in one embodiment, an adaptive threshold intelligent optimization mechanism is added. The controller has a built-in user behavior statistics module and threshold correction algorithm, which can collect user operation data such as key press duration, press frequency, double-click habits, and release delay over a long period of time to establish a personalized user behavior model. At the same time, it combines hardware and environmental correction factors such as remote control button aging, device operating temperature, and environmental electromagnetic interference to dynamically and adaptively optimize the preset interval threshold, first duration threshold, second duration threshold, and preset pop-up dwell time, replacing the traditional fixed threshold scheme. At the same time, a threshold upper and lower limit protection mechanism is set to prevent excessive parameter deviation from causing functional failure, realizing personalized key recognition logic for each user, greatly reducing the probability of false triggering and false judgment, and adapting to diverse usage scenarios of different users, different devices, and different environments.
[0155] Meanwhile, a device status priority locking mechanism is added. The controller monitors the busy status of the display device signal switching, screen decoding, system load, bus occupancy, etc. in real time. Under high device load conditions, the current control logic is locked first, blocking momentary interference buttons and invalid pressing signals, caching valid operation instructions, avoiding problems such as multiple instruction concurrent conflicts, pop-up window flashing, and device response disorder, and further improving the operational stability and reliability of the entire system.
[0156] In one embodiment, a complete, closed-loop, highly adaptable, and highly stable single-button dual-control intelligent interactive system can be constructed through multiple innovative mechanisms, including multi-dimensional parameter hierarchical judgment, device protocol adaptive matching, instruction error correction and retransmission, invalid interval shielding, window period intelligent switching, adaptive threshold optimization, and state priority protection. This system completely solves the industry pain points of traditional HDMI CEC linkage control, such as button conflicts, false triggering, poor compatibility, low intelligence, and poor user experience, and has extremely high technical innovation and engineering practical value.
[0157] Optionally, for cases where the button press duration falls within the middle of a two-tier threshold range, an event masking mechanism is implemented. Presses within this range are not responded to, preventing invalid operations from triggering abnormal commands and ensuring stable and orderly button judgment logic. Based on this, when the current button press duration falls between the second and first duration thresholds, the controller stops responding to the current press event. The controller compares the button press duration value; if the duration falls within the range of the two thresholds, it is determined as an invalid press, and the button signal is directly masked, without executing any control actions on the local machine or external devices. This technical solution eliminates invalid presses in the critical range, reduces false triggering, clearly defines the boundary between long and short button presses, and ensures accurate and stable output of control commands.
[0158] In an exemplary embodiment, the method of this application is described using a television as the display device and a cable set-top box as the CEC device. Optionally, the user's television HDMI1 interface is connected to the set-top box CEC device. During normal viewing, there is no OSD pop-up window. The user briefly presses a preset function key on the remote control. The device determines that the button interval is greater than a preset threshold and the press duration is less than a second duration threshold. Combined with the pop-up window's hidden state, the target is set to the display device, and the screen immediately pops up a screen brightness OSD adjustment pop-up window. Within the 3-second window period when the pop-up window is lit, the user quickly presses the function key again. The system recognizes the continuous operation and automatically switches the control authority to the set-top box, sequentially completing channel switching and program pause operations. After the timeout period without button press, the pop-up window automatically disappears.
[0159] In another exemplary embodiment, the HDMI link connects to the amplifier device, and the screen is in full-screen video playback mode without any pop-up windows. If the user presses and holds a preset button for a duration exceeding a first threshold, the target is directly identified as the amplifier's CEC device, and volume increase / decrease commands are continuously issued. The TV itself does not display the OSD interface; the volume is adjusted synchronously by the external amplifier.
[0160] In another exemplary embodiment, if a user slightly bumps a button with the remote control and the press duration falls within the invalid range between the second duration threshold and the first duration threshold, the system immediately blocks the press event. This prevents the TV OSD menu from being activated and prevents the system from issuing any control commands to the game console CEC device, effectively avoiding abnormal operations caused by unintentional touches.
[0161] In another exemplary embodiment, after the volume OSD pop-up window appears on the screen, a timer window is entered. A single press of the button finely adjusts the volume of the amplifier device by one level; a quick double press of the button triggers a three-level volume adjustment; a triple press of the button directly switches to mute mode. The hierarchical control command is matched according to the number of consecutive presses, and the same button can achieve multi-level fine control.
[0162] In another exemplary embodiment, when the HDMI interface is switched to connect to a Blu-ray player, the device automatically recognizes the device type and matches the corresponding CEC sub-protocol. Pressing the function key sends a power on / off command, and the player starts and stops normally. When the device is switched to connect to a home game console, the system re-recognizes the device type, switches to the game device-specific protocol, and the button commands are converted into game screen pause and mode switching control commands. Different peripherals can respond stably to the operation.
[0163] In another exemplary embodiment, the buttons on a long-used remote control have a slower rebound. After collecting hardware aging data, the system automatically widens the invalid press range. Normal short presses by the user can be reliably identified as valid short presses to bring up the OSD menu, and will not be judged as invalid mis-touches due to button mechanical delay. In low-temperature indoor environments, the device fine-tunes the duration threshold based on temperature sensor data, and the button recognition effect remains consistent in both hot and cold environments.
[0164] Based on the above embodiments, in an exemplary embodiment, such as Figure 8 As shown, a device control method applied to a display device may include the following steps:
[0165] S801, the remote control sends the current press event of the preset function key to the display device.
[0166] S802: After receiving the current press event sent by the remote control, the display device obtains the current press information corresponding to the current press event, determines the device type of the CEC device, and determines the CEC control command corresponding to the preset function key according to the HDMI CEC protocol corresponding to the device type.
[0167] Among them, the preset function keys have the function of controlling the CEC device and triggering the display of the OSD pop-up window on the display device; the current press information includes the current key press duration and the current key press time.
[0168] S803, the display device determines the key press interval based on the difference between the current key press time and the previous key press time.
[0169] S804, the display device determines whether the key press interval is less than or equal to a preset interval threshold; if yes, then execute S807; if no, then execute S805.
[0170] S805, the display device determines whether the current key press duration is greater than or equal to the first duration threshold; if yes, then execute S807; if no, then execute S806.
[0171] S806, the display device determines whether the OSD pop-up window is hidden; if yes, then execute S808; if no, then execute S807.
[0172] S807, the display device determines that the current press event is applied to the CEC device and executes S809.
[0173] S808, the display device determines that the current press event is applied to the display device and executes S810.
[0174] S809, the display device sends a CEC control command to the CEC device.
[0175] Among them, CEC control commands are used to instruct CEC equipment to perform corresponding operations.
[0176] S810: The display device intercepts the CEC control command, controls the display to show the OSD pop-up window, and executes S811.
[0177] S811, Display device start timer.
[0178] S812, if the timer duration is less than the preset duration, and if it receives a next press event for the preset function key sent by the remote control, it sends a CEC control command to the CEC device and controls the display to keep the OSD pop-up window displayed.
[0179] S813 controls the display to hide the OSD pop-up window if the timer's duration exceeds the preset duration and no next press event is received within the timer duration.
[0180] The specific implementation methods of S801-S813 are the same as those in the above embodiments, and will not be repeated here.
[0181] Based on the same inventive concept, some embodiments also provide a device control apparatus for implementing the device control method described above. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, the specific limitations in one or more device control apparatus embodiments provided below can be found in the limitations of the device control method described above, and will not be repeated here.
[0182] In one alternative embodiment, such as Figure 9 As shown, a device control apparatus 900 is provided, applied to a display device, including an information acquisition module 910, an object determination module 920, and an event execution module 930. Wherein:
[0183] The information acquisition module 910 is used to acquire the current press information corresponding to the current press event after receiving the current press event of the preset function key sent by the remote control when the display device is connected to the CEC device via the HDMI interface; wherein the preset function key has the function of controlling the CEC device and triggering the display of the OSD pop-up window on the display device; the current press information includes the current key press duration and the current key press time;
[0184] The object determination module 920 is used to select the target of the current press event from the display device and the CEC device based on the current press information, the previous key time, and the display status of the OSD pop-up window.
[0185] The event execution module 930 is used to control the target object to perform the operation corresponding to the preset function key.
[0186] In one embodiment, the object determination module 920 includes:
[0187] An interval determination unit is used to determine the key press interval based on the difference between the current key press time and the previous key press time;
[0188] The first determining unit is used to determine that the target of the current pressing event is a CEC device when the key press interval is less than or equal to a preset interval threshold.
[0189] The second determining unit is used to select the target of the current press event from the display device and the CEC device based on the current key press duration and the display status of the OSD pop-up window when the key press time interval is greater than a preset interval threshold.
[0190] In one embodiment, the second determining unit includes:
[0191] The first determining unit is used to determine that the target of the current press event is the CEC device when the current key press duration is greater than or equal to the first duration threshold.
[0192] The second determining unit is used to select the target of the current press event from the display device and the CEC device according to the display state of the OSD pop-up window when the current key press duration is less than or equal to the second duration threshold; wherein the first duration threshold is greater than the second duration threshold.
[0193] In one embodiment, the second determination from the unit is specifically used for:
[0194] When the OSD pop-up is hidden, the target of the current press event is determined to be the display device; when the OSD pop-up is displayed, the target of the current press event is determined to be the CEC device.
[0195] In one embodiment, the device control apparatus 900 further includes an instruction determination module, used for:
[0196] Upon receiving a current press event for a preset function button from the remote control, the device type of the CEC device is determined; based on the HDMI CEC protocol corresponding to the device type, the CEC control command corresponding to the preset function button is determined.
[0197] In one embodiment, when the target is a CEC device, the event execution module 930 is specifically used for:
[0198] Send CEC control commands to the CEC device; the CEC control commands are used to instruct the CEC device to perform corresponding operations.
[0199] In one embodiment, when the target is a display device, the event execution module 930 is specifically used for:
[0200] Intercept CEC control commands and control the display to show OSD pop-ups.
[0201] In one embodiment, the event execution module 930 is further configured to:
[0202] Start the timer; if the timer duration is less than the preset duration and a next press event for the preset function key is received from the remote control, send a CEC control command to the CEC device and control the display to keep the OSD pop-up window displayed; if the timer duration exceeds the preset duration and no next press event is received within the timer duration, control the display to hide the OSD pop-up window.
[0203] In one embodiment, the second determining unit is further configured to:
[0204] If the current key press duration is between the second duration threshold and the first duration threshold, stop responding to the current press event.
[0205] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program being implemented when executed by a processor:
[0206] When the display device is connected to the CEC device via an HDMI interface, after receiving a current press event for a preset function key sent by the remote control, the current press information corresponding to the current press event is obtained; wherein, the preset function key has the function of controlling the CEC device and triggering the display on the display device to display an OSD pop-up window; the current press information includes the current key press duration and the current key press time;
[0207] Based on the current press information, the previous key press time, and the display status of the OSD pop-up window, select the target of the current press event from the display device and the CEC device;
[0208] Control the target object to perform the operation corresponding to the preset function key.
[0209] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements:
[0210] When the display device is connected to the CEC device via an HDMI interface, after receiving a current press event for a preset function key sent by the remote control, the current press information corresponding to the current press event is obtained; wherein, the preset function key has the function of controlling the CEC device and triggering the display on the display device to display an OSD pop-up window; the current press information includes the current key press duration and the current key press time;
[0211] Based on the current press information, the previous key press time, and the display status of the OSD pop-up window, select the target of the current press event from the display device and the CEC device;
[0212] Control the target object to perform the operation corresponding to the preset function key.
[0213] It should be noted that the data involved in this application (including but not limited to data used for analysis, data stored, data displayed, etc.) are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.
[0214] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.
[0215] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.
[0216] The above embodiments are merely illustrative of several implementation methods of this application, and their descriptions are relatively specific and detailed. However, they should not be construed as limiting the scope of this application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. A display device, characterized in that, include: The HDMI interface is configured to connect to consumer electronics control (CEC) devices; The monitor is configured to display content. and at least one controller, configured as follows: When the display device is connected to the CEC device via an HDMI interface, after receiving a current press event for a preset function key sent by the remote control, the current press information corresponding to the current press event is obtained; wherein, the preset function key has the function of controlling the CEC device and triggering the display screen to display an OSD pop-up window; the current press information includes the current key press duration and the current key press time; Based on the current press information, the previous key press time, and the display status of the OSD pop-up window, select the target of the current press event from the display device and the CEC device; Control the target object to perform the operation corresponding to the preset function key.
2. The display device according to claim 1, characterized in that, When the controller selects the target of the current press event from the display device and the CEC device based on the current press information, the previous key press time, and the display state of the OSD pop-up, it is configured as follows: The key press time interval is determined based on the difference between the current key press time and the previous key press time; If the time interval between the key presses is less than or equal to a preset interval threshold, the object of the current press event is determined to be the CEC device. If the key press time interval is greater than a preset interval threshold, the target of the current key press event is selected from the display device and the CEC device based on the current key press duration and the display status of the OSD pop-up.
3. The display device according to claim 2, characterized in that, When the controller selects the target of the current press event from the display device and the CEC device based on the current key press duration and the display state of the OSD pop-up, it is configured as follows: If the current button press duration is greater than or equal to a first duration threshold, the object of the current press event is determined to be the CEC device; If the current key press duration is less than or equal to the second duration threshold, the target of the current press event is selected from the display device and the CEC device according to the display status of the OSD pop-up window; wherein, the first duration threshold is greater than the second duration threshold.
4. The display device according to claim 3, characterized in that, When the controller selects the target of the current press event from the display device and the CEC device based on the display state of the OSD pop-up, it is configured as follows: When the OSD pop-up window is hidden, the target of the current press event is determined to be the display device; When the OSD pop-up window is in the "display" state, it is determined that the target of the current press event is the CEC device.
5. The display device according to any one of claims 1-4, characterized in that, The controller is also configured to: Upon receiving a current press event for a preset function key sent by the remote control, the device type of the CEC device is determined; Based on the HDMI CEC protocol corresponding to the device type, determine the CEC control command corresponding to the preset function button.
6. The display device according to claim 5, characterized in that, When the target of the action is the CEC device, the controller is configured to perform the operation corresponding to the preset function key when controlling the target to perform the action: Send the CEC control command to the CEC device; wherein the CEC control command is used to instruct the CEC device to perform a corresponding operation.
7. The display device according to claim 5, characterized in that, When the target of action is the display device, the controller is configured to perform the operation corresponding to the preset function key when controlling the target of action to perform the operation: Intercept the CEC control command and control the display to show the OSD pop-up window.
8. The display device according to claim 7, characterized in that, After the controller executes the command to control the display to show the OSD pop-up window, it is also configured to: Start the timer; If the timer duration is less than the preset duration, and a next press event for the preset function key is received from the remote control, the CEC control command is sent to the CEC device, and the display is controlled to maintain the display of the OSD pop-up window. If the timer's duration exceeds the preset duration and no next press event is received within the preset duration, the display is controlled to hide the OSD pop-up window.
9. The display device according to claim 3, characterized in that, The processor is also configured to: If the current button press duration is between the second duration threshold and the first duration threshold, the response to the current press event shall be stopped.
10. A device control method, characterized in that, Applied to a display device, the method includes: When the display device is connected to the CEC device via an HDMI interface, after receiving a current press event for a preset function key sent by the remote control, the current press information corresponding to the current press event is obtained; wherein, the preset function key has the function of controlling the CEC device and triggering the display on the display device to display an OSD pop-up window; the current press information includes the current key press duration and the current key press time; Based on the current press information, the previous key press time, and the display status of the OSD pop-up window, select the target of the current press event from the display device and the CEC device; Control the target object to perform the operation corresponding to the preset function key.