Data processing method and display device

Abstract

The application provides a data processing method and a display device; the method is applied to the display device, and the method comprises the following steps: obtaining a control operation; the data format of the control operation is different from the data format of a keyboard and a mouse; the control operation is parsed into control information; cross-device output is performed based on the control information, so that the second electronic device is configured correspondingly; the cross-device output based on the control information comprises the following steps: first output is performed on a first electronic device through a first communication link, the first electronic device is used for configuring the second electronic device; or second output is performed on a second electronic device through a second communication link, the display device is used for configuring the second electronic device.

Description

Technical Field

[0001] This application relates to display device control technology, and more particularly to a data processing method and a display device. Background Technology

[0002] External devices such as cameras often connect to the host computer via a Universal Serial Bus (USB). When users need to adjust the parameters of these external devices, they must do so through the host computer; the display device cannot control the external device. This prevents users from quickly and conveniently using the various functions of the external devices through the display device, negatively impacting the user experience. Summary of the Invention

[0003] This application provides a data processing method and a display device.

[0004] The technical solution of this application embodiment is implemented as follows: This application provides a data processing method applied to a display device, the method comprising: Obtain control operations; the data format of the control operations is different from the keyboard and mouse data format. The control operation is parsed into control information; Based on the control information, cross-device output is performed to configure the second electronic device accordingly; The cross-device output based on the control information includes: A first output is made to a first electronic device through a first communication link, wherein the first electronic device is used to configure the second electronic device; Alternatively, a second output can be made to a second electronic device via a second communication link, wherein the display device is used to configure the second electronic device.

[0005] This application embodiment provides a display device, the device comprising: A first interface is used to connect to a first electronic device to establish a first communication link; The second interface is used to connect to a second electronic device to establish a second communication link; A controller, connected to the first interface and the second interface, is configured to perform the following steps: Obtain control operations; the data format of the control operations is different from the keyboard and mouse data format. The control operation is parsed into control information; Based on the control information, cross-device output is performed to configure the second electronic device accordingly; The cross-device output based on the control information includes: The first electronic device performs a first output to the first electronic device via the first communication link, and the first electronic device is used to configure the second electronic device. Alternatively, a second output may be made to the second electronic device via the second communication link, wherein the display device is used to configure the second electronic device. Attached Figure Description

[0006] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the specification, serve to explain the technical solutions of this application. Obviously, the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0007] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily need to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0008] Figure 1 This is a schematic diagram illustrating the data interaction between the display, the host, and the camera in related technologies; Figure 2 This is one of the flowcharts illustrating a data processing method provided in an embodiment of this application; Figure 3 This is a second schematic flowchart of a data processing method provided in an embodiment of this application; Figure 4 This is a third schematic flowchart of a data processing method provided in an embodiment of this application; Figure 5 This is a fourth flowchart illustrating a data processing method provided in an embodiment of this application; Figure 6 This is a schematic diagram of data interaction between a display, a host, and a camera provided in an embodiment of this application; Figure 7 This is an interactive diagram illustrating how a display device directly controls a camera via an I2C bus, as provided in an embodiment of this application. Figure 8 This is one of the interactive schematic diagrams provided in this application embodiment of a display device controlling a camera via a DDC / CI channel through a host relay; Figure 9 This is the second interactive schematic diagram provided in this application embodiment of a display device controlling a camera via a DDC / CI channel through a host relay; Figure 10This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application; Figure 11 This is a schematic diagram of the structure of a display device provided in an embodiment of this application. Detailed Implementation

[0009] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the specific technical solutions of this application will be further described in detail below with reference to the accompanying drawings of the embodiments of this application. The following embodiments are used to illustrate this application, but are not intended to limit the scope of this application.

[0010] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0011] In the following description, references to "some embodiments," "this embodiment," "this application embodiment," and examples, etc., describe a subset of all possible embodiments. However, it is understood that "some embodiments" may be the same subset or different subset of all possible embodiments and may be combined with each other without conflict.

[0012] The terms "first," "second," and "third" appearing in the embodiments of this application do not have a specific meaning (e.g., there is no order, nor does it indicate a special limitation on the number of devices in the embodiments of this application), but are merely for the purpose of clearly describing the embodiments of this application and do not constitute any limitation on the embodiments of this application. The term "multiple" appearing in the embodiments of this application refers to two or more integers.

[0013] To facilitate understanding of the technical solutions of the embodiments of this application, the relevant technologies or terms of the embodiments of this application are described below. The following related technologies or related terms are optional solutions and can be combined with the technical solutions of the embodiments of this application in any way, and all of them fall within the protection scope of the embodiments of this application.

[0014] Currently, display devices have a designated physical location on the top for external cameras, which connect via a specific USB interface. However, the industry standard is the USB interface, meaning that the display device's OSD (On-Screen Display) menu cannot control the camera after connection. This prevents users from quickly and conveniently using the camera's functions through the display device.

[0015] Figure 1 This is a schematic diagram illustrating the data interaction between the display, host computer, and camera in related technologies. For example... Figure 1As shown, the camera connects to the host (PC / laptop) via a standard USB interface, and the monitor connects to the host via a video signal cable (such as High-Definition Multimedia Interface (HDMI) or DisplayPort (DP)) for video signal transmission. Users must use dedicated control software on the host to adjust camera parameters; the camera cannot be directly controlled through the monitor's OSD menu. The monitor's OSD menu only allows adjustment of basic parameters such as brightness and contrast.

[0016] The inventors of this application discovered during their research and analysis that the related technologies have at least the following interaction paths and inherent limitations: (1) Direct communication between the host and the camera: The camera communicates directly with the host via the standard USB protocol (usually USB Video Class (UVC)) to transmit video streams and respond to advanced control commands; (2) The passive role of the monitor: The monitor is only responsible for receiving and displaying the video signal sent by the host. Its OSD menu system can usually only adjust the basic parameters such as brightness and contrast of the monitor itself. (3) Separation of control paths: If users want to adjust camera parameters (such as resolution, image deflection, special functions, etc.), they must do so through dedicated software on the host (such as video conferencing applications, camera software), and cannot directly control them through the OSD menu of the monitor. This separation architecture means that the advanced functions of the camera itself (such as auto focus (AF), preset high dynamic range (HDR) mode, etc.) cannot be directly and quickly accessed through the OSD menu of the monitor.

[0017] To address at least one of the aforementioned problems in the related technologies, this application provides a data processing method applied to a display device. This method parses non-keyboard and mouse control operations into control information, and then outputs the control information across devices to enable the display to directly or indirectly configure a second electronic device (such as a camera). This improves the convenience of user interaction and the flexibility of configuring external devices, thereby enhancing the user experience.

[0018] It should be noted that the embodiments of this application can be applied to various display devices and their external electronic devices, such as the control of cameras, microphones, projectors, printers, etc. by a monitor. The following will use monitor control of a camera as an example to describe in detail the data processing method provided by the embodiments of this application.

[0019] Figure 2This is one of the flowcharts illustrating a data processing method provided in an embodiment of this application; as shown below. Figure 2 As shown, the method may include the following steps 201 to 203: Step 201: Obtain control operation; the data format of the control operation is different from the keyboard and mouse data format.

[0020] In this embodiment, a control operation refers to an operation command executed by the user through the OSD menu, physical buttons, or touch panel of the display device. This control operation is used to adjust the functional parameters of the second electronic device (i.e., to configure the second electronic device), such as increasing the focal length by 1, enabling background blur, or switching HDR mode. The data format of the control operation is defined by the internal firmware of the display device and can be a specific encoding format, such as a binary data packet based on register addresses and values, or a custom command code (e.g., 0xE1 represents focal length +1). This data format differs from the keyboard and mouse data format (the format of standard keyboard and mouse input events). For example, selecting focal length adjustment in the OSD menu of the display device generates a structured data packet including a control command ID and parameter values, rather than a standard keyboard scan code. Similarly, when a user presses a shortcut button on the side of the display device, triggering a preset control operation, the data format of this control operation can be an interrupt signal or a specific level sequence defined by the microcontroller inside the display, which differs from the keyboard and mouse data format.

[0021] In some embodiments, the entity acquiring the control operations may be a microcontroller or main control chip inside the display device, responsible for listening to operation events from the user interface and converting them into control operations that can be recognized internally. For example, when a user clicks the image rotation option in the OSD menu of the display device, the microcontroller inside the display device captures the event and generates the corresponding control operation.

[0022] In some embodiments, the display device is equipped with input components such as OSD menu buttons, touch screens, or physical buttons; the firmware of the display device monitors the state changes of these input components in real time, and generates corresponding control operations once user operation is detected, so as to achieve accurate capture of control operations that are not in the form of keyboard and mouse.

[0023] Step 202: The control operation is parsed into control information.

[0024] In this embodiment, the control information is formed after the control operation is parsed. The control operation is the original operation command input by the user on the display device, such as the user selecting "focal length +1", "enable HDR", "autofocus" or other operations in the OSD menu. The display device parses these original operations into structured control information, which includes at least one of the following: control object, control action, and control parameters.

[0025] For example, when a user selects the "Focus + 1" control operation on the OSD menu of the display device, the display device interprets the control operation as control information including "the controlled object is the camera, the control action is focus adjustment, the adjustment amount is increase, and the adjustment step is 1".

[0026] Step 203: Based on the control information, perform cross-device output to configure the second electronic device accordingly.

[0027] Step 203 may further include: A first output is made to a first electronic device through a first communication link, wherein the first electronic device is used to configure the second electronic device; Alternatively, a second output can be made to a second electronic device via a second communication link, wherein the display device is used to configure the second electronic device.

[0028] In this application embodiment, cross-device output refers to the process by which a display device sends a control signal to a first electronic device or a second electronic device through a specific communication link based on control information. This application embodiment includes two implementation paths: one is to perform a first output to the first electronic device through the first communication link, so that the first electronic device can configure the second electronic device; the other is to perform a second output to the second electronic device through the second communication link, so that the display device can configure the second electronic device.

[0029] It should be noted that the first communication link can be an existing physical communication link between the display device and the first electronic device, such as the Display Data Channel (DDC) in a video signal cable (e.g., HDMI cable, DisplayPort cable). Control commands are transmitted between the display device and the first electronic device through this channel without the need for additional physical wiring. The second communication link can be a physical communication link established between the display device and the second electronic device, such as an Inter-Integrated Circuit (I2C) bus. The display device sends control commands to the second electronic device through this bus, enabling direct configuration or control of the second electronic device.

[0030] In this embodiment, the display device first obtains control operations with a different data format than keyboard and mouse data, then parses them into control information, and subsequently outputs this control information across devices to configure the second electronic device. Specifically, a first output can be made to the first electronic device via a first communication link to enable the first electronic device to configure the second electronic device, or a second output can be made to the second electronic device via a second communication link to enable the display device to configure the second electronic device. This achieves direct or indirect configuration of the second electronic device by the display device, overcoming the technical bottleneck of traditional display devices being unable to control external devices, improving the convenience of user interaction and the flexibility of controlling external devices, thereby enhancing the user experience.

[0031] In some embodiments, the first output to the first electronic device via the first communication link includes: Based on the control information, an indication signal is generated; the indication signal indicates to the first electronic device configuration information for configuring the second electronic device; The indication signal is encoded into structured data in the target format; Structured data is written into the target field carried by the first communication link so that the first electronic device can read the structured data, parse it into corresponding control signals to configure the second electronic device; the first communication link is built based on the display data channel command interface.

[0032] It should be noted that an indication signal is a digital or coded signal generated by the display device based on control information, used to convey specific operational instructions. Indication signals carry specific configuration information for a second electronic device (such as a camera), such as focus adjustment, image rotation, and background blur on / off. The generation of indication signals relies on the logic processing capabilities of the display device's internal microcontroller or scaler chip firmware, converting the user's control intentions into standardized instruction formats that can be recognized and executed by subsequent systems. For example, when a user selects focus +1 in the OSD menu, the display device generates a corresponding indication signal. The value carried by the indication signal can be a preset code 0xE1, representing a specific control operation. The indication signal can be an 8-bit hexadecimal code, such as 0xE1 representing focus +1, 0xE2 representing background blur on; the indication signal can also be a structured data packet including multiple fields, such as [command type, parameter value, device ID], to support more complex multi-device control.

[0033] In some embodiments, an indication signal may be generated based on a preset mapping relationship between the indication signal and control information.

[0034] In some embodiments, after detecting OSD menu operations, the main control chip of the display can call the instruction conversion module in the internal firmware to convert the control item selected by the user into a corresponding indication signal.

[0035] It should be noted that structured data in the target format refers to a collection of information organized according to a predefined data format, with clearly defined field divisions and semantic meanings. The target format refers to a data structure that conforms to the requirements of a specific communication protocol, such as the Virtual Control Panel (VCP) data format specified in the Display Data Channel Command Interface (DDC / CI) protocol, or a custom proprietary protocol data packet.

[0036] In some embodiments, the display device may automatically select an appropriate encoding strategy based on the type of the first communication link. For example, in a DDC / CI channel, the encoded structured data may be presented in the form of standard VCP commands.

[0037] In this embodiment, the first communication link is constructed using the Display Data Channel Command Interface (DDC / CI). Originally, the first communication link was used by a first electronic device (such as a host) to send control signals to a display device. However, this embodiment utilizes this channel in reverse to enable the display device to send control signals to the first electronic device. The display device can use this first communication link to write structured data into the target field carried by the first communication link, allowing the first electronic device to read the structured data and parse it into corresponding control signals to configure the second electronic device.

[0038] It should be noted that the target field is a specific data area or register location in the first communication link used for storing and transmitting structured data. The target field can be predefined at the protocol level to distinguish between ordinary control instructions and the structured data specific to this application. For example, in the DDC / CI protocol, a manufacturer-defined VCP code (such as 0xE0~0xFF) can be used as the target field address to write structured data into the register corresponding to the target field. The target field has a clear address identifier, ensuring that the first electronic device can accurately identify and read it.

[0039] For example, Figure 3 This is a second schematic flowchart of a data processing method provided in an embodiment of this application; as shown... Figure 3 As shown, the method may include the following steps 301 to 305: Step 301: Obtain control operation; the data format of the control operation is different from the keyboard and mouse data format; Step 302: Parse the control operation into control information; Step 303: Based on the control information, generate an indication signal; the indication signal indicates to the first electronic device the configuration information for configuring the second electronic device; Step 304: Encode the indication signal into structured data in the target format; Step 305: Through the first communication link, structured data is written into the target field carried by the first communication link, so that the first electronic device can read the structured data, parse it into corresponding control signals to configure the second electronic device; the first communication link is built based on the display data channel command interface.

[0040] It should be noted that the descriptions of the same steps and contents as in other embodiments in this embodiment can be found in the descriptions in other embodiments, and will not be repeated here.

[0041] For example, when a user triggers a focus +1 operation in the monitor's OSD menu, the monitor first parses the operation as control information, then generates an indication signal (e.g., 0xE1) based on this control information. This indication signal is then encoded into structured data conforming to the DDC / CI protocol (e.g., VCP code 0xE0, value = 1), and finally written to the focus control field via the first communication link. After the background service (Agent) running on the host detects the change in the focus control field, it parses the information in the focus control field into corresponding control signals to control the camera to complete the focus configuration.

[0042] It is understood that this application embodiment generates an indication signal based on control information to instruct the first electronic device to configure the second electronic device. This indication signal is then encoded into structured data in a target format. The structured data is then written into the target field carried by the first communication link constructed via DDC / CI, thus realizing instruction transmission from the display device to the first electronic device. Since the DDC / CI channel itself supports bidirectional communication and requires no additional hardware, this application embodiment fully utilizes the existing communication capabilities of the DDC / CI channel, avoiding the overhead of adding physical interfaces or dedicated cables. Furthermore, in related technologies, DDC / CI interaction is mainly initiated by the host for reading and writing control of the display device's own parameters. The display device only acts as a passive responder and does not have the ability to actively transmit control semantics to the host. This application embodiment, however, utilizes the storage field of the DDC / CI channel to realize the reverse transmission of control intent from the display device to the host, overcoming the deficiency in related technologies where the display device cannot actively transmit control semantics to the host.

[0043] In some embodiments, writing structured data into the target field carried by the first communication link, so that the first electronic device reads the structured data and parses it into corresponding control signals to configure the second electronic device, includes: Structured data is written into the target field carried by the first communication link so that the first electronic device executes the first processing logic to configure the second electronic device; The first processing logic includes: The read structured data is mapped to corresponding input events, and the input events are converted into control signals through the operating system's input processing mechanism. The control signal is sent to the second electronic device via a third communication link, so that the second electronic device converts the control signal into a control signal that conforms to the control protocol of the second electronic device and then performs the corresponding configuration.

[0044] It should be noted that the first processing logic refers to a series of transformations and operations performed by the first electronic device after reading the structured data. The purpose is to convert the read structured data into control signals that can be understood by the second electronic device. This first processing logic can achieve cross-protocol instruction mapping and input event simulation, allowing the control operations obtained by the display device to indirectly affect the configuration of the second electronic device.

[0045] It should be noted that standard human-computer interaction events (i.e., input events) recognizable by the operating system of the first electronic device (e.g., the host computer) may include mouse clicks, keyboard key presses, cursor movement, etc. In the embodiments of this application, structured data is mapped to input events recognizable by the operating system. For example, a command representing focal length +1 is mapped to a left-click event, or rotating the screen is mapped to a right-click event. This mapping relies on a pre-defined command mapping table to ensure that each command in the structured data has a unique corresponding input event recognizable by the operating system.

[0046] It should be noted that the operating system's input processing mechanism refers to the built-in Human Interface Device (HID) drivers and API interfaces, such as the SendInput function in Windows or the uinput module in Linux. This input processing mechanism is responsible for receiving simulated input events and converting them into corresponding control signals.

[0047] It should be noted that the third communication link refers to the physical or logical channel connecting the first electronic device (such as a host) and the second electronic device (such as a camera), for example, a USB bus connecting the host and the camera. The second electronic device needs to convert the control signals received through the third communication link (such as USB control messages from the host) into internal instructions that the second electronic device can recognize.

[0048] It should be noted that the control protocol of the second electronic device refers to the standard or proprietary control protocol supported by the second electronic device itself, such as the UVC protocol or a manufacturer-defined control register access method. After receiving the control signal sent by the first electronic device, the second electronic device can convert the control signal into internally executable instructions.

[0049] In this embodiment, after the first electronic device (e.g., a host) reads the structured data in the target field carried by the first communication link, it maps the structured data into a corresponding input event (e.g., a left-click event). Subsequently, the operating system of the first electronic device automatically converts the input event into a control signal and sends it to the second electronic device via a third communication link (e.g., a USB bus). After receiving the control signal, the driver of the second electronic device converts the control signal into a control signal conforming to the control protocol of the second electronic device, parses out the specific operation (e.g., focus adjustment), and then executes the corresponding configuration through the internal firmware.

[0050] It is understood that, in this embodiment of the application, structured data is written into a target field carried by a first communication link, enabling a first electronic device to execute a first processing logic. This first processing logic includes mapping the structured data to input events and converting them into control signals via the operating system of the first electronic device. These signals are then sent to a second electronic device via a third communication link, whereby the second electronic device converts the control signals into control signals conforming to its control protocol and performs corresponding configuration. This process, leveraging underlying operating system APIs such as SendInput, simulates real user input behavior, offering strong compatibility and effectively enabling the display device to indirectly control the second electronic device through the first electronic device. This overcomes the limitations of traditional hardware interfaces and improves the convenience of user interaction.

[0051] In some embodiments, writing structured data into the target field carried by the first communication link, so that the first electronic device reads the structured data and parses it into corresponding control signals to configure the second electronic device, includes: Structured data is written into the target field carried by the first communication link so that the first electronic device executes the second processing logic to configure the second electronic device; The second processing logic includes: The target application is run to read structured data, so that the target application generates control signals; The control signal is sent to the second electronic device via a third communication link, so that the second electronic device converts the control signal into a control signal that conforms to the control protocol of the second electronic device and then performs the corresponding configuration.

[0052] It should be noted that the second processing logic refers to a series of transformations and operations performed by the first electronic device after reading the structured data, which are different from the first processing logic. The purpose is to transform the structured data into control signals that can be understood by the second electronic device.

[0053] It should be noted that the target application refers to a specific software program running on the first electronic device. The function of the target application is to receive and parse structured data from the display device and generate corresponding control signals. Control signals are instructions generated by the target application based on the parsed structured data, used to drive the second electronic device to execute corresponding configurations. For example, for structured data of focal length +1, the target application can generate a USB control signal including the FOCUS_STEP_UP command, which is sent to the second electronic device (such as a camera) through a standard interface.

[0054] In this embodiment, the target application can continuously monitor changes in the target field of the DDC / CI channel. Once new structured data is detected, a parsing process is initiated to extract the control command type and parameter values, and then a corresponding control signal is generated. Subsequently, the control signal is sent to the second electronic device via a third communication link, so that the second electronic device converts the control signal into a control signal conforming to the control protocol of the second electronic device and performs corresponding configuration.

[0055] It is understood that, in this embodiment of the application, structured data is written into a target field carried by a first communication link, causing a first electronic device to execute a second processing logic. This second processing logic includes running a target application to read the structured data, causing the target application to generate a control signal, and then sending the control signal to a second electronic device via a third communication link. The second electronic device then converts the control signal into a control signal conforming to its control protocol and performs corresponding configuration. This fully utilizes existing communication channels (such as DDC / CI and USB) without incurring additional hardware costs, thereby enabling intelligent collaborative control across devices and improving the convenience of user interaction.

[0056] It should be noted that the choice between the first processing logic and the second processing logic can be determined by the processing entity of the control semantic information on the first electronic device side. When the control signal can be expressed through a general input mechanism, the first processing logic can be used. When the control signal needs to rely on the device interface or dedicated logic, the second processing logic can be used.

[0057] In some embodiments, the second output to the second electronic device via the second communication link includes: The control information is converted into control signals that conform to the control protocol of the second electronic device. The control signal is sent to the second electronic device via the second communication link, so that the second electronic device can be configured accordingly based on the control signal.

[0058] It should be noted that the control information originates from user selections or button triggers on the display device interface. The control information itself is not directly applicable to the second electronic device because its format is incompatible with the second electronic device's control protocol. The second electronic device's control protocol refers to the standard or proprietary control protocol supported by the second electronic device itself, such as the UVC protocol or a manufacturer-defined control register access method.

[0059] In some embodiments, the microcontroller or dedicated protocol conversion module inside the display device can receive control information from the display's OSD menu system and convert the control information into corresponding control signals according to a preset mapping table. For example, when a user selects to rotate the screen in the display's OSD menu system, the system encodes the user's selection as a specific value (such as 0x01), and then generates an I2C data frame including device address 0x48, register address 0x02, and data value 0x01 as a control signal according to the I2C bus protocol supported by the second electronic device. Subsequently, the control signal is sent to the second electronic device through the second communication link, enabling the second electronic device to perform corresponding configurations based on the control signal.

[0060] It should be noted that the second communication link refers to a physical or logical channel used to transmit control signals between the display device and the second electronic device. For example, the second communication link is a communication link built based on the I2C bus integrated within the display device. The process of sending control signals involves transmitting the converted control signals to the second electronic device through the second communication link.

[0061] In some embodiments, after receiving a control signal, the second electronic device can parse the content of the control signal and perform corresponding configuration operations. For example, after receiving a write command under the I2C bus protocol, the second electronic device will read the register address and data value, and adjust the internal parameters of the second electronic device accordingly, such as changing the image rotation angle or enabling the background blur function.

[0062] For example, Figure 4 This is a third schematic flowchart of a data processing method provided in an embodiment of this application; as shown... Figure 4 As shown, the method may include the following steps 401 to 404: Step 401, obtain control operation; the data format of the control operation is different from the keyboard and mouse data format; Step 402: Parse the control operation into control information; Step 403: Convert the control information into a control signal that conforms to the control protocol of the second electronic device; Step 404: The control signal is sent to the second electronic device via the second communication link so that the second electronic device can be configured accordingly based on the control signal.

[0063] It should be noted that the descriptions of the same steps and contents as in other embodiments in this embodiment can be found in the descriptions in other embodiments, and will not be repeated here.

[0064] For example, when a user selects to enable HDR mode in the monitor's OSD menu, the monitor first parses the user's selection into control information, then converts this control information into control signals conforming to the control protocol of the second electronic device (such as a write command under the I2C bus protocol), and then sends it directly to the second electronic device through the second communication link. Upon receiving the control signal, the second electronic device immediately activates the HDR processing algorithm to enhance the dynamic range of the image.

[0065] It is understood that, in this embodiment of the application, control information is converted into control signals conforming to the control protocol of the second electronic device, and then the control signals are directly sent to the second electronic device through the second communication link. This enables the second electronic device to perform corresponding configurations based on the control signals, thereby realizing direct control of the second electronic device by the display device. This path eliminates the forwarding links of intermediate devices, reduces latency and potential failure points, and improves control efficiency and reliability.

[0066] In some embodiments, the control protocol for the second electronic device is an inter-integrated circuit bus protocol; the step of sending the control signal to the second electronic device through the second communication link includes: A start signal carrying the address of the display device on the inter-integrated circuit bus is sent to the second electronic device via the second communication link; the start signal is used to instruct the second electronic device to start data communication with the display device. In response to the first acknowledgment signal returned by the second electronic device, a register address is sent to the second electronic device via the second communication link to indicate the register to which control data is to be written. In response to the second response signal returned by the second electronic device, the control data is written to the register indicated by the register address via the second communication link; In response to the third response signal returned by the second electronic device, a stop signal is sent to the second electronic device through the second communication link; the stop signal is used to instruct the second electronic device to terminate communication.

[0067] In this embodiment, the control protocol for the second electronic device is the Inter-Integrated Circuit (I2C) bus protocol. I2C is a serial communication bus standard used to connect low-speed peripheral devices. The I2C bus protocol requires only two signal lines: a serial clock line (SCL) and a serial data line (SDA) to achieve bidirectional communication between the display device and the second electronic device. The start signal is the communication initiation condition defined in the I2C bus protocol. While SCL remains high, SDA changes from high to low, marking the start of a data transmission. The start signal carries the address information of the display device on the I2C bus, used to identify the unique address of the display device on the I2C bus, thereby achieving precise addressing in a multi-device environment.

[0068] For example, when a user selects to adjust the camera focus in the monitor's OSD menu, the monitor's microcontroller generates a corresponding control command and encapsulates it into a data frame conforming to the inter-integrated circuit bus protocol. Subsequently, the monitor's microcontroller sends a start signal through the inter-integrated circuit bus interface, simultaneously sending the monitor's address on the inter-integrated circuit bus (e.g., 0x48) to the SDA line, enabling the camera to recognize it and prepare to receive subsequent data. This ensures accurate initiation of communication.

[0069] In this embodiment, the first acknowledgment (ACK) signal is an acknowledgment signal from the second electronic device upon receiving the start signal. When the second electronic device successfully receives the start signal, it pulls SDA low while SCL is high, indicating that it is ready to receive data, i.e., it sends the first acknowledgment signal. The first acknowledgment signal is a key basis for the display device to determine whether the second electronic device is online and accessible. If the first acknowledgment signal is not received, the display device can determine that the second electronic device is not responding or that there is a communication error, thereby triggering a retry or error handling mechanism.

[0070] A register address refers to the location of the register from which control data is to be written. Each register address corresponds to a specific hardware function or configuration item; for example, 0x01 represents the focus control register address, and 0x02 represents the white balance setting register address. By sending the register address, the display device can explicitly tell the second electronic device which register to read control data from subsequently.

[0071] The second acknowledgment signal is an acknowledgment signal from the second electronic device regarding the received register address. Once the second electronic device successfully receives and parses the register address, it will also pull SDA low while SCL is high, indicating that it is ready to receive data.

[0072] Control data refers to specific operation command values, which can be transmitted in byte form. For example, setting the focal length value to +1 can be encoded as the hexadecimal value 0x01, and enabling the background blur function can be encoded as 0x0F. This control data is written byte by byte to the aforementioned register address via the inter-integrated circuit bus, and finally the corresponding configuration operation is executed by the second electronic device.

[0073] The third acknowledgement signal is a confirmation signal from the second electronic device regarding the control data read from the register. After the second electronic device has finished reading the control data, it can send the third acknowledgement signal to indicate that the control data has been completely received. The third acknowledgement signal is an important indicator for the display device to determine the completion of control data transmission.

[0074] The stop signal is a communication termination condition defined in the inter-integrated circuit bus protocol. While SCL is held high, the transition from low to high on SDA marks the official end of the current communication. The stop signal can be used to notify a second electronic device to release the bus and terminate the current communication.

[0075] It is understood that the embodiments of this application use an inter-integrated circuit bus protocol as the control protocol for the second electronic device, and communicate according to the standard timing sequence of start signal, register address frame, control data frame and stop signal, thereby realizing direct and efficient control of the second electronic device by the display device.

[0076] In some embodiments, the method further includes: Display the configuration results; the configuration results include at least one of the following: The configuration result of the second electronic device fed back by the first electronic device through the first communication link; The configuration results of the second electronic device fed back by the second electronic device through the second communication link.

[0077] It should be noted that the configuration result refers to the status information or execution result of the second electronic device (such as a camera) after performing the corresponding configuration. For example, if the camera executes the "focal length + 1" command and returns the current focal length value (such as "current focal length is 45mm"), this focal length value is the configuration result. The configuration result may also include: HDR on / off status, autofocus status, exposure value, white balance settings, etc.

[0078] In some embodiments, the display device makes a first output to the first electronic device through a first communication link, so that after the second electronic device is configured by the first electronic device, the second electronic device sends the configuration result to the first electronic device, and then the first electronic device feeds back the configuration result of the second electronic device to the display device through the first communication link.

[0079] In some embodiments, the display device makes a second output to the second electronic device through a second communication link, so that after configuring the second electronic device through the display device, the second electronic device feeds back the configuration result to the display device through the second communication link.

[0080] For example, Figure 5 This is a fourth flowchart illustrating a data processing method provided in an embodiment of this application; as shown below. Figure 5 As shown, the method may include the following steps 501 to 507: Step 501: Obtain control operation; the data format of the control operation is different from the keyboard and mouse data format; Step 502: Parse the control operation into control information; Step 503: Based on the control information, a first output is made to a first electronic device through a first communication link, wherein the first electronic device is used to configure the second electronic device; Step 504: Receive the configuration results of the second electronic device fed back by the first electronic device through the first communication link; Step 505: Based on the control information, a second output is made to the second electronic device through the second communication link, and the display device is used to configure the second electronic device; Step 506: Receive the configuration results of the second electronic device fed back by the second electronic device through the second communication link; Step 507: Display the configuration result.

[0081] It should be noted that the descriptions of the same steps and content as in other embodiments in this embodiment can be found in the descriptions of other embodiments, and will not be repeated here. Steps 503 and 504, and steps 505 and 506, are two parallel optional implementations, and the display device can choose to execute one of them. When the display device is connected to the first electronic device via the first communication link, steps 503 and 504 are executed; when the display device is directly connected to the second electronic device via the second communication link, steps 505 and 506 are executed. The display device can support both methods simultaneously, or only one of them. In some embodiments, the display device can also dynamically select one of the implementation methods to execute based on the connection status, communication quality, or user settings of the first or second communication link.

[0082] It is understood that this embodiment of the application achieves a closed-loop control system by receiving configuration result feedback from a first electronic device or a second electronic device and displaying it on a display device. This feedback mechanism not only verifies the effective execution of control commands but also provides users with intuitive operation confirmation, enhancing the interactive experience.

[0083] In some embodiments, the method further includes: The system receives multimedia data sent by the first electronic device via a fourth communication link; the multimedia data is collected by the second electronic device and transmitted to the first electronic device via a fifth communication link. Display the multimedia data.

[0084] In this embodiment, the fourth communication link refers to a multimedia data (such as video / audio data) transmission channel connecting the first electronic device and the display device, used to transfer multimedia data from the first electronic device to the display device. The fourth communication link is constructed, for example, via HDMI or DisplayPort. The fifth communication link refers to a data transmission path between the second electronic device and the first electronic device, used to transmit multimedia data acquired by the second electronic device to the first electronic device. The fifth communication link can use a standard USB protocol (such as the UVC protocol) to realize communication between the second electronic device and the first electronic device.

[0085] Multimedia data refers to data collected by a second electronic device and transmitted to a first electronic device via a fifth communication link, including but not limited to video streams, audio streams, image frames, and sensor data. After being collected and encoded by the second electronic device, the multimedia data is uploaded to the first electronic device via the fifth communication link. The first electronic device then processes or stores the data and sends it to a display device via a fourth communication link so that the display device can display the multimedia data.

[0086] It is understood that in this embodiment, the display device receives and displays multimedia data sent by the first electronic device through the fourth communication link. This multimedia data is collected by the second electronic device and transmitted to the first electronic device through the fifth communication link. Thus, the control path and display path are decoupled: the control signal corresponding to the control operation is transmitted through the first or second communication link, while the multimedia data is transmitted through the fourth and fifth communication links. The two are independent and do not affect each other. Therefore, even if the user performs control operations on the second electronic device through the display device, it will not interfere with the normal transmission and display of the multimedia data. Simultaneously, since the control path and display path are independent, the display device does not need to occupy the transmission bandwidth of the multimedia data to transmit control commands, avoiding bandwidth contention and transmission delays caused by control signals and multimedia data competing for the same communication link, further improving the overall system performance and user experience.

[0087] The following examples illustrate possible implementation schemes of the data processing method described in one or more of the above embodiments, with the following scheme being described using a display controlling a camera as an example.

[0088] One approach enhances monitor control capabilities through a USB-to-I2C converter. A USB-to-I2C protocol conversion bridge chip is integrated within the monitor, and a proprietary communication protocol is defined between the monitor and the camera. This allows the monitor to parse and convert control commands from its OSD menu, thereby directly controlling the camera via the I2C bus.

[0089] For example, Figure 6 This is a schematic diagram illustrating data interaction between a display, a host, and a camera, provided in an embodiment of this application; as shown... Figure 6 As shown, the display device includes an enhanced OSD menu system, a protocol conversion module, and a USB-to-I2C bridge chip. Users select camera control functions (such as focus adjustment, HDR on / off, etc.) through the OSD menu, and the display device generates corresponding control commands. The protocol conversion module converts the control commands generated by the OSD menu into USB commands conforming to the Universal Serial Bus (USB) protocol format. The USB-to-I2C bridge chip then generates corresponding I2C control commands, which are sent to the camera via the I2C bus, enabling direct control of the camera. Simultaneously, the video stream captured by the camera is transmitted to the host (PC / laptop) via the USB video stream / UVC protocol. The host then transmits the video signal to the monitor for display via a video signal cable (such as an HDMI cable or DP cable). Thus, control commands are transmitted via the I2C bus, while the video stream is transmitted via USB and video signal cables; the two transmission paths are independent, achieving decoupling.

[0090] It's important to note that the key to this solution lies in the coordinated implementation of hardware modification and protocol design. Regarding hardware modification, a dedicated USB-to-I2C bridge chip can be integrated inside the monitor. This could be achieved by adding an MCU for control, or by avoiding additional hardware by adding a USB channel to the scaler via a USB hub to establish a physical connection. This USB-to-I2C bridge chip acts as the master device, and the camera acts as the slave device, communicating via an I2C bus (including the SCL clock line and SDA data line). In terms of protocol design, control commands generated by the monitor's OSD menu are converted into I2C command frames via the USB-to-I2C bridge chip and sent to the camera.

[0091] Figure 7 This is a schematic diagram illustrating the interaction between a display device and a camera via an I2C bus, as provided in an embodiment of this application. Figure 7 As shown, the user selects the camera function (such as focus) through the monitor's OSD menu. The USB-to-I2C bridge chip integrated inside the monitor converts the OSD commands into I2C command frames, which are then sent directly to the camera via the I2C bus, enabling the display device to directly control the camera. After executing the command, the camera outputs updated video data to the host. Alternatively, the host software can also control the camera simultaneously via the UVC protocol, forming a dual control path. The communication process of the USB-to-I2C bridge chip sending I2C command frames to the camera follows the following standard I2C timing sequence: 1. When the serial clock line (SCL) is high, pull the serial data line (SDA) low to send an I2C start signal to the camera and send the 7-bit I2C slave address of the display; then receive the acknowledgment signal (ACK) returned by the camera. 2. Send the address of the control register to be written to indicate the register to be configured in the camera; then receive the acknowledgment (ACK) signal returned by the camera. 3. Send control data (such as the register value of rotating the screen and the background blur switch) to configure the registers to be configured in the camera; then receive the response signal (ACK) returned by the camera. 4. When the serial clock line (SCL) is high, pull the serial data line (SDA) from low to high to send an I2C stop signal and end the current communication.

[0092] It should be noted that the ACK signal is a standard mechanism in I2C communication. After the USB-to-I2C bridge chip sends each byte, the camera pulls the SDA line low within the SCL clock cycle to indicate successful data reception. If the USB-to-I2C bridge chip does not receive the ACK signal (i.e., receives a NACK signal), it determines that the communication is abnormal and takes corresponding error handling measures (such as retransmission, error reporting, or communication termination). The ACK reception step in this embodiment ensures the reliability of data communication and guarantees the accurate transmission of control commands.

[0093] Understandably, this solution, through hardware bridging and protocol conversion, enables traditional monitors to directly control external USB cameras.

[0094] In another approach, the camera is indirectly controlled via the monitor's DDC / CI channel through the host computer. This creates a reverse "monitor -> host" command feedback path on top of the existing unidirectional "monitor -> host" control path. Without adding hardware, control signals are sent via the monitor's OSD menu, relayed through the host PC to control the camera. The key to this "monitor OSD -> PC -> camera" indirect control path lies in utilizing the existing channel and implementing command conversion. This approach can fully leverage any manufacturer-defined command regions or undefined standard VCP codes that may exist in the DDC / CI protocol.

[0095] The DDC / CI protocol, based on the I2C bus, allows a host to control display parameters (such as brightness and contrast) via specific VCP codes, with the display acting as a slave device. While the protocol itself supports bidirectional communication, it has traditionally been primarily used for host-to-display querying and control of the display. This solution aims to achieve "role switching": designing a proprietary instruction set to map specific input event operations (such as "left click" or "cursor movement") to custom VCP codes or their data values. For example, VCP code 0xE0 (assuming it's an unused manufacturer-defined code) can be defined to carry instructions; when this code is set to 1, it simulates a "left click"; a value of 2 simulates a "right click." For more complex instructions or data (such as the relative coordinates of cursor movement), commands for storage or reporting functions within the protocol can be used to complete the task through multiple data transfers.

[0096] Figure 8 This is one of the interactive schematic diagrams provided in this application embodiment of a display device controlling a camera via a DDC / CI channel through a host relay; as shown... Figure 8As shown, the user selects camera control functions (such as adjusting focus) through the monitor's OSD menu. The monitor's OSD menu generates corresponding custom control commands (encoding) and sends them to the monitor's MCU. The monitor's MCU then writes the command into a specific VCP code register, completing the command encoding and transmission on the monitor side. The PC application periodically polls and reads DDC / CI data, listening for changes in the DDC / CI data. When a change is detected in the VCP code register, it parses it into the corresponding control semantics and directly calls the device control interface (such as UVC or the software development kit (SDK) provided by the camera manufacturer) to send control commands to the camera. After receiving the control command, the camera executes the corresponding operation (such as adjusting focus), completing the control process.

[0097] Figure 9 This is a second interactive schematic diagram provided in this application embodiment of a display device controlling a camera via a DDC / CI channel through a host relay; as shown... Figure 9 As shown, in Phase 1, the user selects camera control functions (such as adjusting focus) through the monitor's OSD menu. The monitor's OSD menu generates corresponding custom control commands (codes) and sends them to the monitor's MCU. The monitor's MCU then writes these commands into a specific VCP code register via the DDC / CI channel. This process can be understood as the monitor "reporting" the user's intentions to the PC. In Phase 2, the PC background service (Agent) continuously polls or listens to specific DDC / CI registers. When it detects a change in the register value (e.g., capturing 0xE1), it initiates the parsing logic. This service internally maintains an "instruction mapping table" that translates the received raw code (0xE1) into commands that the operating system can understand for controlling the device. This is typically achieved by calling APIs provided by the operating system (such as Windows' SendInput function) to simulate a standard HID device command (e.g., simulating a mouse click event). In Phase 3, after receiving this simulated HID command, the PC operating system treats it as a standard UVC control command. The PC operating system then sends this command to the camera via the USB bus. After receiving a standard command, the camera performs the corresponding operation (such as adjusting the focus), thereby indirectly realizing the control of the camera through the monitor's OSD. As needed, after performing the corresponding operation (such as adjusting the focus), the camera can return status information (i.e., configuration results), which is relayed to the monitor via the PC. In other words, the configuration results can be read back and fed back to the monitor through the DDC / CI channel, for example, displaying the current focus value on the OSD.

[0098] In this solution, the display firmware can be modified, such as enhancing the firmware of the microcontroller (main control ICscaler or specific MCU) inside the display, enabling it to respond to specific operations in the OSD menu and generate and encode defined private instructions. These instructions are then written to a specific address of the DDC / CI channel (such as the register corresponding to the custom VCP code) via the display's I2C bus.

[0099] In this solution, the host-side driver / daemon can utilize the monitor's resident LADM software or the camera driver. A background service running on the computer (such as a Windows service or a Linux daemon) continuously monitors changes in specific VCP codes or registers on the DDC / CI channel. This service is responsible for decoding the received instructions and calling APIs provided by the operating system (such as Windows' SendInput or Linux's uinput) to simulate and generate corresponding mouse or keyboard input events.

[0100] Understandably, this solution requires no additional hardware, fully utilizing the DDC / CI channels within existing video cables (such as HDMI and DisplayPort) without incurring any additional costs or requiring hardware modifications. Furthermore, users can directly control the camera via familiar monitor OSD menus or dedicated buttons, without needing to open dedicated software or drivers on the host device, thus achieving a seamless and natural interactive experience.

[0101] It should be noted that although the steps of the method in this application are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and / or one step may be broken down into multiple steps; or steps from different embodiments may be combined into a new technical solution.

[0102] Based on the same inventive concept as the foregoing embodiments, this application provides a data processing apparatus that is applied to a display device.

[0103] Figure 10 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application; as shown... Figure 10 As shown, the data processing device 1000 includes: an acquisition module 1010, a parsing module 1020, and an output module 1030; wherein: The module 1010 is used to obtain control operations; the data format of the control operations is different from the keyboard and mouse data format. The parsing module 1020 is used to parse the control operation into control information; The output module 1030 is used to perform cross-device output based on the control information to configure the second electronic device accordingly; the cross-device output based on the control information includes: performing a first output to a first electronic device through a first communication link, the first electronic device being used to configure the second electronic device; or performing a second output to a second electronic device through a second communication link, the display device being used to configure the second electronic device.

[0104] In some embodiments, the output module 1030 includes: A generation unit is configured to generate an indication signal based on the control information; the indication signal indicates to the first electronic device configuration information for configuring the second electronic device; An encoding unit is used to encode the indication signal into structured data in a target format; The writing unit is used to write structured data into the target field carried by the first communication link through the first communication link, so that the first electronic device can read the structured data, parse it into corresponding control signals to configure the second electronic device; the first communication link is built based on the display data channel command interface.

[0105] In some embodiments, the writing unit is further configured to: write structured data into a target field carried by the first communication link, so that the first electronic device executes first processing logic to configure the second electronic device; the first processing logic includes: mapping the read structured data to a corresponding input event, converting the input event into a control signal through the input processing mechanism of the operating system; and sending the control signal to the second electronic device through a third communication link, so that the second electronic device converts the control signal into a control signal conforming to the control protocol of the second electronic device and performs corresponding configuration.

[0106] In some embodiments, the writing unit is further configured to: write structured data into a target field carried by the first communication link, so that the first electronic device executes second processing logic to configure the second electronic device; the second processing logic includes: running a target application to read structured data, so that the target application generates a control signal; and sending the control signal to the second electronic device through a third communication link, so that the second electronic device converts the control signal into a control signal conforming to the control protocol of the second electronic device and performs corresponding configuration.

[0107] In some embodiments, the output module 1030 further includes: A conversion unit is used to convert the control information into a control signal that conforms to the control protocol of the second electronic device; The transmitting unit is configured to transmit the control signal to the second electronic device via the second communication link, so that the second electronic device can perform corresponding configuration based on the control signal.

[0108] In some embodiments, the control protocol of the second electronic device is an inter-integrated circuit bus protocol; the transmitting unit is further configured to: send a start signal carrying the address of the display device on the inter-integrated circuit bus to the second electronic device via the second communication link; the start signal is used to instruct the second electronic device to start data communication with the display device; in response to a first acknowledgment signal returned by the second electronic device, send a register address to the second electronic device via the second communication link to indicate the register to which control data is to be written; in response to a second acknowledgment signal returned by the second electronic device, write the control data into the register indicated by the register address via the second communication link; in response to a third acknowledgment signal returned by the second electronic device, send a stop signal to the second electronic device via the second communication link; the stop signal is used to instruct the second electronic device to end communication.

[0109] In some embodiments, the data processing apparatus 1000 further includes: A display module is used to display configuration results; the configuration results include at least one of the following: configuration results of the second electronic device fed back by the first electronic device through the first communication link; configuration results of the second electronic device fed back by the second electronic device through the second communication link.

[0110] In some embodiments, the data processing apparatus 1000 further includes: A receiving module is configured to receive multimedia data sent by the first electronic device via a fourth communication link; the multimedia data is collected by the second electronic device and transmitted to the first electronic device via a fifth communication link. The display module is also used to display the multimedia data.

[0111] The descriptions of the above device embodiments are similar to those of the above method embodiments, and have similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0112] Based on the same inventive concept as the foregoing embodiments, this application provides a display device.

[0113] Figure 11 This is a schematic diagram of the structure of a display device provided in an embodiment of this application; Figure 11 The display device 1100 shown includes: The first interface 1101 is used to connect to the first electronic device to establish a first communication link; The second interface 1102 is used to connect to a second electronic device to establish a second communication link; The controller 1103 is connected to the first interface 1101 and the second interface 1102, and the controller 1103 is used to implement the method in the embodiments of this application.

[0114] In some embodiments, the first communication link is a physical communication link built on the display data channel command interface; the second communication link is a physical communication link built on the inter-integrated circuit bus.

[0115] In some embodiments, the display device 1100 further includes: a screen for displaying a screen display menu and / or the configuration result of the second electronic device; the screen display menu includes at least one control option for controlling the second electronic device; The controller 1103 is further configured to: obtain the control operation in response to the triggering of the at least one control option.

[0116] This application also provides a computer-readable storage medium for storing computer programs.

[0117] Optionally, the computer-readable storage medium can be applied to the display device in the embodiments of this application, and the computer program causes the controller or display device to perform the various methods of the embodiments of this application, which will not be described in detail here for the sake of brevity.

[0118] This application also provides a computer program product, including computer program instructions.

[0119] Optionally, the computer program product can be applied to the display device in the embodiments of this application, and the computer program instructions cause the controller or display device to execute the various methods in the embodiments of this application. For the sake of brevity, they will not be described in detail here.

[0120] This application also provides a computer program.

[0121] Optionally, the computer program can be applied to the display device in the embodiments of this application. When the computer program controller or display device is running, the controller or display device executes the various methods of the embodiments of this application. For the sake of brevity, they will not be described in detail here.

[0122] It should be noted that the descriptions of the devices, storage media, computer program products, and computer program embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the device, storage media, computer program products, and computer program embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0123] It should be understood that the processor in the embodiments of this application may be an integrated circuit chip with signal processing capabilities. In implementation, the steps of the above method embodiments can be completed by integrated logic circuits in the processor's hardware or by instructions in software form. The processor described above can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules can be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method.

[0124] It is understood that the memory in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DR RAM). It should be noted that the memory used in the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0125] It should be understood that the above-described memory is exemplary and not a limiting description. For example, the memory in the embodiments of this application may also be static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DR RAM), etc. That is to say, the memory in the embodiments of this application is intended to include, but is not limited to, these and any other suitable types of memory.

[0126] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0127] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0128] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0129] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0130] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0131] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a display device to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0132] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A data processing method applied to a display device, the method comprising: Gain control; The data format for the control operations is different from that for the keyboard and mouse; The control operation is parsed into control information; Based on the control information, cross-device output is performed to configure the second electronic device accordingly; The cross-device output based on the control information includes: A first output is made to a first electronic device through a first communication link, wherein the first electronic device is used to configure the second electronic device; Alternatively, a second output can be made to a second electronic device via a second communication link, wherein the display device is used to configure the second electronic device.

2. The method according to claim 1, wherein the first output to the first electronic device via the first communication link comprises: Based on the control information, an indication signal is generated; The indication signal indicates to the first electronic device the configuration information for configuring the second electronic device; The indication signal is encoded into structured data in the target format; Structured data is written into the target field carried by the first communication link so that the first electronic device can read the structured data, parse it into corresponding control signals to configure the second electronic device; the first communication link is built based on the display data channel command interface.

3. The method according to claim 2, wherein writing structured data into the target field carried by the first communication link, so that the first electronic device reads the structured data and parses it into corresponding control signals to configure the second electronic device, includes: Structured data is written into the target field carried by the first communication link so that the first electronic device executes the first processing logic to configure the second electronic device; The first processing logic includes: The read structured data is mapped to corresponding input events, and the input events are converted into control signals through the operating system's input processing mechanism. The control signal is sent to the second electronic device via a third communication link, so that the second electronic device converts the control signal into a control signal that conforms to the control protocol of the second electronic device and then performs the corresponding configuration.

4. The method according to claim 2, wherein writing structured data into the target field carried by the first communication link so that the first electronic device reads the structured data and parses it into corresponding control signals to configure the second electronic device, includes: Structured data is written into the target field carried by the first communication link so that the first electronic device executes the second processing logic to configure the second electronic device; The second processing logic includes: The target application is run to read structured data, so that the target application generates control signals; The control signal is sent to the second electronic device via a third communication link, so that the second electronic device converts the control signal into a control signal that conforms to the control protocol of the second electronic device and then performs the corresponding configuration.

5. The method according to claim 1, wherein the second output to the second electronic device via the second communication link comprises: The control information is converted into control signals that conform to the control protocol of the second electronic device. The control signal is sent to the second electronic device via the second communication link, so that the second electronic device can be configured accordingly based on the control signal.

6. The method according to claim 5, wherein the second electronic device control protocol is an inter-integrated circuit bus protocol; Sending the control signal to the second electronic device via the second communication link includes: A start signal carrying the address of the display device on the inter-integrated circuit bus is sent to the second electronic device via the second communication link; the start signal is used to instruct the second electronic device to start data communication with the display device. In response to the first acknowledgment signal returned by the second electronic device, a register address is sent to the second electronic device via the second communication link to indicate the register to which control data is to be written. In response to the second response signal returned by the second electronic device, the control data is written to the register indicated by the register address via the second communication link; In response to the third response signal returned by the second electronic device, a stop signal is sent to the second electronic device through the second communication link; the stop signal is used to instruct the second electronic device to terminate communication.

7. The method according to any one of claims 1 to 6, wherein the method further comprises: Display the configuration results; the configuration results include at least one of the following: The configuration result of the second electronic device fed back by the first electronic device through the first communication link; The configuration results of the second electronic device fed back by the second electronic device through the second communication link.

8. The method according to claim 1, further comprising: Receive multimedia data sent by the first electronic device through the fourth communication link; The multimedia data is collected by the second electronic device and transmitted to the first electronic device through the fifth communication link; Display the multimedia data.

9. A display device, the device comprising: A first interface is used to connect to a first electronic device to establish a first communication link; The second interface is used to connect to a second electronic device to establish a second communication link; A controller, connected to the first interface and the second interface, is configured to perform the following steps: Obtain control operations; the data format of the control operations is different from the keyboard and mouse data format. The control operation is parsed into control information; Based on the control information, cross-device output is performed to configure the second electronic device accordingly; The cross-device output based on the control information includes: The first electronic device performs a first output to the first electronic device via the first communication link, and the first electronic device is used to configure the second electronic device. Alternatively, a second output may be made to the second electronic device via the second communication link, wherein the display device is used to configure the second electronic device.

10. The display device according to claim 9, further comprising: A screen for displaying the screen display menu and / or the configuration results of the second electronic device; The screen display menu includes at least one control option for controlling the second electronic device; The controller is also configured to: obtain the control operation in response to the triggering of the at least one control option.

Images