Universal remote control implementation method for embedded display control equipment

Abstract

The invention discloses a universal remote control implementation method for embedded display control equipment. The method comprises the following steps: establishing communication interconnection between a computer end and an equipment end; performing analog display on a control interface of the equipment end in an analog display area of the computer end to obtain an analog display image; the computer end generates a key value data set frame according to key information generated by the simulation key and sends the key value data set frame to the equipment end; the device end extracts first key value data from the key value data set frame and uploads the first key value data to the key value FIFO; the device end reads key value data from the key value FIFO and carries out key pressing event processing; the device side calls a drawing function to generate a drawing information group frame and sends the drawing information group frame to the computer side; and the computer terminal extracts drawing information from the drawing information framing, calls a drawing interface to perform drawing operation in the analog display area, and updates the analog display image. According to the invention, remote control of remote control software at a computer end on low-speed interfaces based on an Ethernet port and the like at an equipment end can be quickly realized, and the development cost is reduced.

Description

Technical Field

[0001] The present application relates to the technical field of remote control of embedded devices, and more specifically, to a universal remote control implementation method for embedded display control devices. Background Art

[0002] Display control devices that use screens and buttons for human-computer interaction often need to undergo high and low temperature environmental testing during the development, production, acceptance and delivery stages, depending on the actual usage scenario. When conducting functional performance tests in a test chamber, direct human-computer interaction is impossible because the screen and buttons are inaccessible. At this time, for high-performance display control platforms, the screen and keyboard can be brought out of the box for interaction using HDMI, USB, etc., while for embedded display control devices with limited hardware resources, there are often only data interfaces such as Ethernet. In order to achieve remote control, it is necessary to customize the remote control message format and control logic on the device side through the data interface based on different functional requirements for different devices, and at the same time design a control interface on the PC side to send control commands and display device feedback information.

[0003] This remote control implementation method for embedded display control devices has the following defects: (1) For different devices, both the device side and the PC side need to be customized for remote control, which increases the research and development cost and time; (2) The interaction logic of display and control is inconsistent with the human-computer interaction logic of the actual device, which affects the effect of experimental verification to a certain extent.

[0004] Therefore, the prior art has defects and is in urgent need of improvement. Summary of the Invention

[0005] In view of the above problems, the purpose of the present invention is to provide a universal remote control implementation method for embedded display control devices, which can quickly realize the remote control of the device side based on low-speed interfaces such as Ethernet ports by the computer-side remote control software, which is more universal and concise, reduces development costs, and shortens the development cycle. Since the remote control principle is simulated at the input and output level and does not intervene in the business logic, the business logic and control flow of remote control and normal operation are completely consistent, ensuring the effectiveness of the environmental test of the display control device in the remote control mode. At the same time, subsequent possible business function expansion, display interface adjustment and other changes on the device side will not affect the remote control function. The computer-side software does not need to be upgraded, and the device-side software does not need to be upgraded for remote control, so it can be done once and for all.

[0006] A first aspect of the present invention provides a universal remote control implementation method for an embedded display control device, comprising: Establish communication between the computer and the device through the control interface; The control interface of the device side is simulated and displayed in the simulated display area of ​​the computer side to obtain a simulated display image; the control interface of the device side includes a display screen interface and physical buttons; the simulated display image includes a simulated display screen image and simulated buttons; The computer generates a key-value data frame according to the key information generated by the simulated key, and sends the key-value data frame to the device; The device performs integrity verification on the received key-value data frame, extracts the first key-value data from the successfully verified key-value data frame, and uploads the first key-value data to the key-value FIFO; The key processing program on the device side reads key value data from the key value FIFO, processes key events according to the key value data, and performs corresponding drawing operations on the display screen; the key value data includes first key value data and second key value data; the second key value data is key value data generated by a physical key on the device side; The device side calls the drawing function during the drawing operation, generates a corresponding drawing information frame according to the drawing information actually generated, and sends the drawing information frame to the computer side; The computer extracts drawing information from the received drawing information frame, and calls a drawing interface to perform a drawing operation in the simulation display area according to the drawing information, thereby updating the simulation display image.

[0007] In this solution, after establishing communication between the computer and the device through the control interface, the following steps are also included: The key input detection interface on the device side is software-inserted through the control interface on the device side to receive the key value data framing sent by the computer side; Perform software instrumentation on the device-side drawing display interface, and frame the generated drawing information and forward it to the device-side control interface.

[0008] In this solution, the control interface of the device side is simulated and displayed in the simulation display area of ​​the computer side to obtain a simulated display image, including: The device generates an initial drawing information frame based on the image information of the display screen interface and the key information of the physical key, and sends the initial drawing information frame to the computer; The computer terminal extracts initial drawing information from the received initial drawing information frame; the initial drawing information includes drawing information corresponding to the image information of the display screen interface and drawing information corresponding to the key information of the physical key; The computer side calls the drawing interface and performs drawing operations in the simulated display area according to the initial drawing information, draws the simulated display screen image corresponding to the display screen interface of the device side and the simulated buttons corresponding to the physical buttons, and obtains a simulated display image.

[0009] In this solution, the device performs integrity verification on the received key-value data framing, including: The computer adds a checksum character at the end of the key-value data frame; The device extracts the check character to be verified from the received key-value data frame; Verifying the check character to be verified; If the verification is successful, the key-value data framing is received completely; Otherwise, an exception is received and appropriate error handling measures are taken according to system requirements.

[0010] This plan also includes: The device side generates second key value data according to the key information generated by the physical key, and uploads the second key value data to the key value FIFO.

[0011] In this solution, the key processing program on the device side reads the key value data from the key value FIFO, including: The key processing program on the device side analyzes the key value FIFO, and when the key value FIFO is not empty, obtains the key value data in the key value FIFO.

[0012] In this solution, the device side calls a drawing function during a drawing operation, generates a corresponding drawing information frame according to the drawing information actually generated, and sends the drawing information frame to the computer side, including: Describe the device-side drawing interface elements based on the system's preset data frame format; When the device calls the drawing API to display screen information, the drawing information generated by the actual drawing is converted into a string data frame in a system preset data frame format through a drawing function to obtain a drawing information frame.

[0013] In this solution, the computer extracts drawing information from the received drawing information frame, performs drawing operations in the simulated display area by calling a drawing interface, and updates the simulated display image, including: The computer side analyzes the received drawing information frames and extracts the drawing function and drawing information; Determine the drawing coordinates within the simulation display area using the drawing information; The drawing interface of the computer is called to perform corresponding drawing operations according to the drawing coordinates of the drawing function in the simulation display area.

[0014] This solution also includes optimizing the display effect of the simulated display image on the computer side by adjusting the transmission frequency of the drawing information on the device side: The device determines a first preset collection time interval according to the preset transmission frequency; The device collects sub-drawing information generated by actual drawing according to the first preset collection time interval, generates corresponding sub-drawing information frames, and sends the sub-drawing information frames to the computer; The computer obtains the data sending time from the received sub-drawing information frame and determines the transmission delay based on the data receiving time; Get the number of sub-drawing information frames to be processed on the computer; Adjusting a preset transmission frequency on the device side according to the transmission delay and the number of sub-drawing information frames to be processed; The method for adjusting the preset transmission frequency on the device side is expressed as follows: ; Wherein, P is the preset transmission frequency, D is the transmission delay, M is the number of sub-drawing information frames to be processed in the computer terminal, and k1 and k2 are adjustment factors; Determining a second preset collection time interval according to the adjusted preset transmission frequency; The first preset collection time interval not performed on the device side is adjusted through the second preset collection time interval.

[0015] In this solution, adjusting the first preset collection time interval of the device end by using the second preset collection time interval includes: Determine the time length t2 according to the time difference between the end time and the start time of the second preset acquisition time interval; According to the current first preset collection time interval Q (n) The start time T0 and the time length t2 determine the end time T1 of the simulation time interval; Calculate the adjustment factor k3 based on the acquisition time T2 of the second preset acquisition time interval obtained by the device, combined with the start time T0 of the current first preset acquisition time interval and the end time T1 of the simulation time interval; ; Comparing the adjustment factor k3 with a preset adjustment threshold k0; When k3≤k0, the current first preset acquisition time interval Q (n) The end time of the simulation time interval is adjusted to the end time T1, and the subsequent first preset collection time interval Q is adjusted according to the second preset collection time interval. (n+m) Adjust the start and end time of When k3>k0, according to the next first preset acquisition time interval Q (n+1) The start time and time length t2 determine the next first preset acquisition time interval Q (n+1) The end time of the first preset collection time interval Q is set according to the second preset collection time interval.(n+m’) Adjust the start and end time.

[0016] The present invention discloses a universal remote control implementation method for an embedded display control device, comprising: establishing a communication interconnection between a computer and a device; simulating the display of a control interface on the device in a simulated display area on the computer to obtain a simulated display image; generating a key-value data frame based on key information generated by the simulated key press and transmitting the frame to the device; extracting first key-value data from the key-value data frame and uploading the frame to a key-value FIFO on the device; reading the key-value data from the key-value FIFO and processing a key event; calling a drawing function on the device to generate a drawing information frame and transmitting the frame to the computer; extracting drawing information from the drawing information frame, calling a drawing interface to perform drawing operations in the simulated display area, and updating the simulated display image. The present invention can rapidly implement remote control of a device based on a low-speed interface such as an Ethernet port by computer-side remote control software, thereby reducing development costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A flowchart showing a universal remote control implementation method for an embedded display control device provided by the present invention is shown; Figure 2 A flow chart showing a method for generating a simulated display image on a computer provided by the present invention is shown; Figure 3 A flow chart of the key-value data framing integrity verification method provided by the present invention is shown; Figure 4 A schematic diagram showing an application scenario of a universal remote control implementation method for an embedded display control device provided by the present invention; Figure 5 The present invention shows a software module and data flow diagram for implementing a remote control method for an embedded display control device; Figure 6 A remote key injection flow chart provided by the present invention is shown; Figure 7 A remote display simulation flow chart provided by the present invention is shown. DETAILED DESCRIPTION

[0018] In order to more clearly understand the above-mentioned objects, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that, in the absence of conflict, the embodiments of the present application and the features therein can be combined with each other.

[0019] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Therefore, the scope of protection of the present invention is not limited to the specific embodiments disclosed below.

[0020] Figure 1 The flowchart of a universal remote control implementation method for an embedded display control device provided by the present invention is shown.

[0021] like Figure 1 As shown, the present invention discloses a universal remote control implementation method for an embedded display control device, comprising: S102, establishing communication interconnection between the computer end and the device end through the control interface; S104, simulating the display of the control interface of the device in the simulated display area of ​​the computer to obtain a simulated display image; the control interface of the device includes a display screen interface and physical buttons; the simulated display image includes a simulated display screen image and simulated buttons; S106, the computer generates a key-value data frame based on the key information generated by the simulated key press, and sends the key-value data frame to the device; S108, the device verifies the integrity of the received key-value data frame, extracts the first key-value data from the successfully verified key-value data frame, and uploads the first key-value data to the key-value FIFO; S110, the key processing program on the device side reads key value data from the key value FIFO, processes the key event according to the key value data, and performs corresponding drawing operations on the display screen; the key value data includes first key value data and second key value data; the second key value data is the key value data generated by the physical key on the device side; S112, the device side calls a drawing function during the drawing operation process, generates a corresponding drawing information frame according to the drawing information actually generated, and sends the drawing information frame to the computer side; S114 , the computer extracts drawing information from the received drawing information frame, and calls a drawing interface to perform a drawing operation in the simulation display area according to the drawing information, thereby updating the simulation display image.

[0022] According to an embodiment of the present invention, the remote control implementation method includes two parts: remote control button simulation and remote display simulation. Figure 5As shown, taking data transmission via Ethernet as an example, remote control button simulation includes the key operation of the computer-side remote control software (i.e., the computer side) forming a key value data frame through the "5. Key Information Sending Module", and sending it through the Ethernet port to the "2. Remote Control Ethernet Port Module" of the embedded display control device application software (i.e., the device side). The key value is extracted and sent to the "1. Key Value FIFO", thereby realizing remote control button simulation. The subsequent process is consistent with the physical button processing on the device side. Remote display simulation includes the device side adding drawing information framing and sending logic to the drawing function in the "3. Drawing Function Set". When the device side calls the drawing API to display screen information, the drawing information generated by the actual drawing is sent to the "4. Display Information Receiving Module" on the computer side through the "2. Remote Control Ethernet Port Module". The computer side draws in the simulated display area based on the drawing information, thereby realizing remote control simulated display.

[0023] First, the computer-side remote control software (i.e., the computer side) and the embedded display control device application software (i.e., the device side) are connected to each other through the Ethernet port and other control interfaces. Data is transmitted between the computer side and the device side through the UDP protocol and other methods. The device side is software-inserted to realize the function of receiving the simulated key value data and drawing information framing and forwarding sent by the computer side. Figure 4 As shown, when the computer and the device are connected, the computer performs corresponding drawing operations in the simulated display area according to the drawing information sent by the device, and obtains a simulated display image. Figure 6 As shown, when the simulated key in the simulated key area is pressed, the corresponding key value data frame is generated and sent to the control interface of the device side to realize remote control key simulation. The device side verifies the integrity of the received key value data frame, extracts the first key value data from the successfully verified key value data frame and uploads it to the key value FIFO to realize remote control key value injection. Among them, the key value FIFO also includes the second key value data generated by the physical key of the device side. Figure 7 As shown, the device's key handler reads key-value data from the key-value FIFO in the order in which it was added, and calls the key handler to process the corresponding key events, such as controlling the drawing interface to perform the corresponding drawing operations. When the device calls the drawing display interface (drawing API function interface) for screen display, it generates a corresponding drawing information frame based on the drawing information generated by the actual drawing. The information framing forwarding function code added to the drawing display interface forwards the drawing information frame to the device's control interface, and then forwards the drawing information frame to the computer through the control interface. The computer extracts the drawing information and drawing functions from the received drawing information frame, and performs the corresponding drawing operations in the simulated display area by calling the drawing port, realizing remote display simulation.

[0024] According to an embodiment of the present invention, after establishing communication interconnection between the computer end and the device end through the control interface, the method further includes: The key input detection interface on the device side is software-inserted through the control interface on the device side to receive the key value data framing sent by the computer side; Perform software instrumentation on the device-side drawing display interface, and frame the generated drawing information and forward it to the device-side control interface.

[0025] It should be noted that the key input detection interface on the device side is used to receive the key value data generated by the physical keys on the device side. After the computer side and the device side are communicated and interconnected through the control interface (such as the Ethernet port), the computer side performs software plug-in on the key input detection interface on the device side through the control interface on the device side, so that the key input detection interface on the device side can receive the key value data generated by the physical keys on the device side while also receiving the key value data framing transmitted by the computer side through the control interface.

[0026] The drawing display interface (drawing API function interface) on the device side is used to process information exchange between the system and the drawing program, including image output and drawing information recording. By performing software plug-in on the drawing display interface on the device side, the drawing information generated by the drawing is synchronously forwarded to the control interface on the device side for transmission to the computer side.

[0027] Figure 2 The flowchart of the computer terminal simulation display image generation method provided by the present invention is shown.

[0028] like Figure 2 As shown, according to an embodiment of the present invention, the control interface of the device side is simulated and displayed in the simulation display area of ​​the computer side to obtain a simulated display image, including: S202, the device generates an initial drawing information frame based on the image information of the display screen interface and the key information of the physical key, and sends the initial drawing information frame to the computer; S204, the computer extracts initial drawing information from the received initial drawing information frame; the initial drawing information includes drawing information corresponding to the image information of the display screen interface and drawing information corresponding to the key information of the physical key; S206, the computer side calls the drawing interface to perform drawing operations in the simulated display area according to the initial drawing information, draws the simulated display screen image corresponding to the display screen interface of the device side and the simulated buttons corresponding to the physical buttons, and obtains a simulated display image.

[0029] It should be noted that when the computer and device are communicating, the device analyzes the image information of the displayed image (image resolution, size, color, etc.) and the key information of the physical keys (including the key function and arrangement order of each key), calls the corresponding drawing function to generate the corresponding string data frame, obtains the initial drawing information framing, and sends it from the control interface of the device to the control interface of the computer via the UDP protocol.

[0030] The computer extracts the drawing function and drawing information from the received initial drawing information frame, and performs corresponding drawing operations in the simulated key area by calling the drawing port of the computer to obtain a simulated display image.

[0031] Figure 3 The flowchart of the key-value data framing integrity verification method provided by the present invention is shown.

[0032] like Figure 3 As shown, according to an embodiment of the present invention, the device side performs integrity verification on the received key-value data framing, including: S302, the computer adds a check character at the end of the key-value data frame; S304, the device extracts the check character to be verified from the received key-value data frame; S306, verifying the check character to be verified; S308, if the verification is successful, the key-value data framing is completely received; S310, otherwise, the reception is abnormal and corresponding error handling measures are taken according to system requirements.

[0033] It should be noted that the check character added to the current key-value data framing is generated based on the partial characters and data transmission sequence number of the previous key-value data framing. After the device receives the key-value data framing, it extracts the check character in the key-value data framing as the check character to be verified, and compares the check character to be verified with the character data in the previous key-value data framing received. When the check character to be verified is the same as the partial characters of the previous key-value data framing, and the data transmission sequence number of the current key-value data framing and the data transmission sequence number of the previous key-value data framing are consecutive sequence numbers, the verification is passed, and it is determined that the current key-value data framing is received completely; conversely, when any of the above two verification conditions is not met, it is determined that the verification has failed. If there is incomplete transmission, data omission, omission of reception, etc., appropriate error handling measures are taken according to system requirements.

[0034] Among them, the error handling measure can be to send a data acquisition request to the control interface of the computer end through the control interface of the device end, and the data acquisition request is an acquisition request for the key-value data frame corresponding to the next data sending sequence number of the data sending sequence number of the previous key-value data frame. The computer end sends the corresponding key-value data frame again according to the received data acquisition request.

[0035] According to an embodiment of the present invention, the further embodiment includes: The device side generates second key value data according to the key information generated by the physical key, and uploads the second key value data to the key value FIFO.

[0036] It should be noted that when the key driver on the device side detects a key operation, it receives the key information generated by the physical key through the key input detection interface, generates second key value data, and uploads it to the key value FIFO to realize real key value collection.

[0037] According to an embodiment of the present invention, a key processing program on the device side reads key value data from a key value FIFO, including: The key processing program on the device side analyzes the key value FIFO, and when the key value FIFO is not empty, obtains the key value data in the key value FIFO.

[0038] It's important to note that a key-value FIFO (First-In, First-Out) is a special data structure that stores key-value data in the order they were inserted and processes each key-value data entry sequentially in that order. Typically, a key-value FIFO is considered empty when the read and write pointers are equal; however, a difference between the read and write pointers indicates that the key-value FIFO is not empty.

[0039] According to an embodiment of the present invention, the device side calls a drawing function during a drawing operation, generates a corresponding drawing information frame based on the drawing information actually generated, and sends the drawing information frame to the computer side, including: Describe the device-side drawing interface elements based on the system's preset data frame format; When the device calls the drawing API to display screen information, the drawing information generated by the actual drawing is converted into a string data frame in a system preset data frame format through a drawing function to obtain a drawing information frame.

[0040] It should be noted that those skilled in the art define the drawing information data frame format (eg, in the form of an ASCII character string) according to actual needs and determine the system preset data frame format for describing the elements of the device-side drawing interface.

[0041] Common embedded display control device-side drawing interfaces include: draw_point()——Draw a point at coordinates (x, y); draw_line()——Draw a line from coordinate A (x, y) to coordinate B (x, y); draw_circle()——Draw a circle with coordinates C (x, y) as the center and radius R; show_text()——Using coordinates T (x, y) as the starting point, font size XX, display the text "TEXT"; … Define the data frame format and describe the elements of the drawing interface, for example in the form of an ASCII string: "Function name, parameter 1, parameter 2, parameter 3...\r\n" (with line feed as the end of the frame) For example, at coordinates (20,10), to display the string "Hello" in 16×16 pixel size, the corresponding drawing function is: show_text(x,y,16,"Hello"); The drawing information group frame converted into ASCII string form is: "show_text,20,10,16,Hello\r\n".

[0042] According to an embodiment of the present invention, the computer extracts drawing information from the received drawing information frame, performs a drawing operation in the simulated display area by calling a drawing interface, and updates the simulated display image, including: The computer side analyzes the received drawing information frames and extracts the drawing function and drawing information; Determine the drawing coordinates within the simulation display area through the drawing information; Call the drawing interface on the computer side and perform corresponding drawing operations according to the drawing coordinates of the drawing function in the simulated display area.

[0043] It should be noted that the computer side analyzes the received drawing information according to the frame format through the remote control software, separates the drawing function and drawing information, calls the drawing interface on the computer side to use the drawing function, executes the corresponding drawing operation at the corresponding coordinate position in the simulated display area, and completes the corresponding drawing display.

[0044] According to an embodiment of the present invention, the display effect of the simulated display image on the computer side is optimized by adjusting the transmission frequency of the drawing information on the device side: The device determines a first preset collection time interval according to the preset transmission frequency; The device collects sub-drawing information generated by the actual drawing according to the first preset collection time interval, generates corresponding sub-drawing information frames, and sends the sub-drawing information frames to the computer; (start action and end action) The computer obtains the data sending time from the received sub-drawing information frame and determines the transmission delay based on the data receiving time; Get the number of sub-drawing information frames to be processed on the computer; Adjusting the preset transmission frequency of the device side according to the transmission delay and the number of sub-drawing information frames to be processed; The method for adjusting the preset transmission frequency on the device side is expressed as follows: ; Wherein, P is the preset transmission frequency, D is the transmission delay, M is the number of sub-drawing information frames to be processed in the computer terminal, and k1 and k2 are adjustment factors; Determining a second preset collection time interval according to the adjusted preset transmission frequency; The first preset collection time interval not performed on the device side is adjusted through the second preset collection time interval.

[0045] It should be noted that, in general, during the drawing process, the device collects complete drawing information (e.g., drawing a line from coordinates A (x, y) to coordinates B (x, y), starting at coordinates T (x, y), using font size XX and displaying the text "TEXT"), generates a corresponding drawing information frame, and transmits it to the computer. Based on the received complete drawing information frame, the computer extracts the corresponding drawing functions and drawing information and performs the corresponding drawing operation on the simulated display area. In this case, due to transmission latency, there is a certain delay between the simulated key operation on the computer and the update of the simulated display image, resulting in users being unable to accurately receive key operation feedback, affecting work efficiency and decision-making accuracy. Therefore, to reduce the display update latency of the simulated display image, the system can determine a preset transmission frequency from the device to the computer based on the processing speed of the computer processor, the processing speed of the device processor, and the transmission latency of the communication link between the computer and the device. The system also determines a first preset time interval for the device to collect drawing information. The start time of the first preset collection time interval is the start time of the device drawing or the end time of the previous first preset collection time interval. The drawing coordinates corresponding to the start and end times of a first preset acquisition time interval are obtained, and sub-drawing information generated by actual drawing during the first preset acquisition time interval is determined. The sub-drawing information generated by the actual drawing during the first preset acquisition time interval is converted into sub-drawing information frames by calling a drawing function. The computer extracts drawing information from the received sub-drawing information frames and also extracts the data transmission time. Based on the corresponding data reception time, the transmission delay of the communication link during each transmission of the sub-drawing information frame is determined. Based on the number of pending sub-drawing information frames on the computer (including those currently being processed and those not yet processed), the preset transmission frequency from the device to the computer is adjusted. The lower the transmission delay, the faster the preset transmission frequency from the device to the computer; and the fewer the number of pending sub-drawing information frames on the computer, the faster the preset transmission frequency from the device to the computer. k1 and k2 are both system-configured adjustment factors.

[0046] According to an embodiment of the present invention, adjusting the first preset collection time interval of the device end by using the second preset collection time interval includes: Determine the time length t2 according to the time difference between the end time and the start time of the second preset acquisition time interval; According to the current first preset collection time interval Q (n) The start time T0 and time length t2 determine the end time T1 of the simulation time interval; Calculate the adjustment factor k3 based on the acquisition time T2 of the second preset acquisition time interval obtained by the device, combined with the start time T0 of the current first preset acquisition time interval and the end time T1 of the simulation time interval; ; Comparing the adjustment factor k3 with a preset adjustment threshold k0; When k3≤k0, the current first preset acquisition time interval Q (n) The end time of the simulation time interval is adjusted to the end time T1, and the subsequent first preset collection time interval Q is adjusted according to the second preset collection time interval. (n+m) Adjust the start and end time of When k3>k0, according to the next first preset acquisition time interval Q (n+1) The start time and time length t2 determine the next first preset acquisition time interval Q (n+1) The end time of the first preset collection time interval Q is set according to the second preset collection time interval. (n+m’) Adjust the start and end time.

[0047] It should be noted that the simulation time interval end time T1 is the time interval from the current first preset acquisition time interval Q (n) The time from the start time T0 to the duration length t2. By comparing the adjustment factor k3 and the preset adjustment threshold k0, it is determined whether the device-side processor can complete the adjustment of the end time of the current first preset acquisition time interval within the remaining time of the current first preset acquisition time interval. Among them, the preset adjustment threshold k0 is determined by the system according to the processing speed and idle occupancy rate of the device-side processor. The faster the processing speed of the device-side processor, the larger the preset adjustment threshold k0; the larger the idle occupancy rate, the larger the preset adjustment threshold k0. When the idle occupancy rate meets the requirements of the first preset acquisition time interval adjustment instruction, the preset adjustment threshold k0 is only affected by the processing speed of the device-side processor. When k3≤k0, the device-side processor satisfies the adjustment of the end time of the current first preset acquisition time interval within the remaining time of the current first preset acquisition time interval; otherwise, it is not satisfied, and the next first preset acquisition time interval Q is directly adjusted. (n+1) The end time of the second preset collection time interval is adjusted. The subsequent first preset collection time interval that has not been performed is adjusted by the time length t2 of the second preset collection time interval, wherein m'=m+1.

[0048] The information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals (including but not limited to signals transmitted between user terminals and other devices, etc.) involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the "key-value data framing" and "drawing information framing" involved in this disclosure are all obtained with full authorization.

[0049] The present invention discloses a universal remote control implementation method for embedded display control devices, comprising: establishing a communication interconnection between a computer and a device; simulating the display of a control interface on the device in a simulated display area on the computer to obtain a simulated display image; generating a key-value data frame based on key information generated by the simulated key press and transmitting the frame to the device; extracting first key-value data from the key-value data frame and uploading the frame to a key-value FIFO on the device; reading the key-value data from the key-value FIFO and processing a key event; calling a drawing function on the device to generate a drawing information frame and transmitting the frame to the computer; extracting drawing information from the drawing information frame, calling a drawing interface on the computer to perform a drawing operation in the simulated display area, and updating the simulated display image. The present invention can rapidly implement remote control of a device based on a low-speed interface such as an Ethernet port by computer-side remote control software, thereby reducing development costs.

[0050] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0051] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed across multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0052] In addition, all functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0053] Those skilled in the art will appreciate that all or part of the steps of the above-mentioned method embodiments may be implemented by hardware associated with program instructions, and the aforementioned program may be stored in a computer-readable storage medium. When the program is executed, the program executes the steps of the above-mentioned method embodiments. The aforementioned storage medium includes various media that can store program codes, such as mobile storage devices, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical disks.

[0054] Alternatively, if the integrated units described above are implemented as software modules and sold or used as standalone products, they can also be stored on a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present invention, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product, stored on a storage medium, includes instructions for enabling a computer device (such as a personal computer, server, or network device) to execute all or part of the methods described in various embodiments of the present invention. The aforementioned storage media include various media capable of storing program code, such as removable storage devices, ROM, RAM, magnetic disks, or optical disks.

Claims

1. A universal remote control implementation method for an embedded display control device, characterized in that: include: Establish communication and interconnection between the computer and the device through the control interface; The control interface of the device side is simulated and displayed in the simulated display area of ​​the computer side to obtain a simulated display image; the control interface of the device side includes a display screen interface and physical buttons; the simulated display image includes a simulated display screen image and simulated buttons; The computer terminal generates a key value data frame according to the key information generated by the simulated key, and sends the key value data frame to the device terminal; The device end verifies the integrity of the received key-value data frame, extracts the first key-value data from the successfully verified key-value data frame, and uploads the first key-value data to the key-value FIFO; The key processing program at the device end reads the key value data from the key value FIFO, performs key event processing according to the key value data, and performs corresponding drawing operations on the display screen; the key value data includes first key value data and second key value data; the second key value data is the key value data generated by the physical key at the device end; The device side calls the drawing function during the drawing operation, generates a corresponding drawing information group frame according to the drawing information generated by the actual drawing, and sends the drawing information group frame to the computer side; The computer terminal extracts drawing information from the received drawing information frame, and calls a drawing interface to perform drawing operations in the simulation display area according to the drawing information, so as to update the simulation display image.

2. The universal remote control implementation method for an embedded display control device according to claim 1, characterized in that: After establishing the communication interconnection between the computer end and the device end through the control interface, it also includes: The key input detection interface of the device side is software-inserted through the control interface of the device side to receive the key value data framing sent by the computer side; The drawing display interface of the device side is software-instrumented, and the generated drawing information is framed and forwarded to the control interface of the device side.

3. The universal remote control implementation method for an embedded display control device according to claim 1, characterized in that: The control interface of the device end is simulated and displayed in the simulated display area of ​​the computer end to obtain a simulated display image, including: The device generates an initial drawing information frame according to the image information of the display screen interface and the key information of the physical key, and sends the initial drawing information frame to the computer; The computer terminal extracts initial drawing information from the received initial drawing information group frame; the initial drawing information includes drawing information corresponding to the image information of the display screen interface and drawing information corresponding to the key information of the physical key; The computer side calls the drawing interface and performs drawing operations in the simulated display area according to the initial drawing information, draws the simulated display screen image corresponding to the display screen interface of the device side and the simulated buttons corresponding to the physical buttons, and obtains the simulated display image.

4. The universal remote control implementation method for an embedded display control device according to claim 1, characterized in that: The device performs integrity verification on the received key-value data framing, including: The computer adds a checksum character at the end of the key-value data frame; The device extracts the check character to be verified from the received key-value data frame; Verifying the verification character to be verified; If the verification is successful, the key-value data framing is received completely; Otherwise, an exception is received and appropriate error handling measures are taken according to system requirements.

5. The universal remote control implementation method for an embedded display control device according to claim 1, characterized in that: Also includes: The device side generates second key value data according to the key information generated by the physical key, and uploads the second key value data to the key value FIFO.

6. The universal remote control implementation method for an embedded display control device according to claim 1, characterized in that: The key processing program of the device end reads the key value data from the key value FIFO, including: The key processing program on the device side analyzes the key value FIFO, and when the key value FIFO is in a non-empty state, obtains the key value data in the key value FIFO.

7. The universal remote control implementation method for an embedded display control device according to claim 1, characterized in that: The device side calls a drawing function during a drawing operation, generates a corresponding drawing information group frame according to drawing information generated by actual drawing, and sends the drawing information group frame to the computer side, including: Describe the device-side drawing interface elements based on the system preset data frame format; When the device calls the drawing API to display screen information, the drawing information generated by the actual drawing is converted into a string data frame in a system preset data frame format through a drawing function to obtain a drawing information group frame.

8. The universal remote control implementation method for an embedded display control device according to claim 1, characterized in that: The computer terminal extracts drawing information from the received drawing information frame, performs drawing operation in the simulated display area by calling a drawing interface, and updates the simulated display image, including: The computer terminal extracts drawing functions and drawing information by analyzing the received drawing information framing; Determine the drawing coordinates in the simulation display area according to the drawing information; The drawing interface of the computer is called, and corresponding drawing operations are performed according to the drawing coordinates of the drawing function in the simulation display area.

9. The universal remote control implementation method for an embedded display control device according to claim 1, characterized in that: It also includes optimizing the display effect of the simulated display image on the computer side by adjusting the transmission frequency of the drawing information on the device side: The device determines a first preset collection time interval according to a preset transmission frequency; The device end collects sub-drawing information generated by actual drawing according to the first preset collection time interval, generates a corresponding sub-drawing information group frame, and sends the sub-drawing information group frame to the computer end; The computer obtains the data sending time from the received sub-drawing information group frame, and determines the transmission delay in combination with the data receiving time; Get the number of sub-drawing information frames to be processed in the computer terminal; Adjusting a preset transmission frequency of the device end according to the transmission delay and the number of sub-drawing information group frames to be processed; The adjustment method of the preset transmission frequency on the device side is expressed by the formula: ； Wherein, P is the preset transmission frequency, D is the transmission delay, M is the number of sub-drawing information frames to be processed in the computer terminal, and k1 and k2 are adjustment factors; Determining a second preset collection time interval according to the adjusted preset transmission frequency; The first preset collection time interval not performed on the device side is adjusted through the second preset collection time interval.

10. The universal remote control implementation method for embedded display control devices according to claim 9, characterized in that: The adjusting the first preset collection time interval of the device end by using the second preset collection time interval includes: Determine the time length t2 according to the time difference between the end time and the start time of the second preset acquisition time interval; According to the current first preset collection time interval Q (n) The start time T0 and the time length t2 determine the end time T1 of the simulation time interval; Calculate the adjustment factor k3 according to the acquisition time T2 of the second preset acquisition time interval acquired by the device, combined with the start time T0 of the current first preset acquisition time interval and the end time T1 of the simulation time interval; ； Comparing the adjustment factor k3 with a preset adjustment threshold k0; When k3≤k0, the current first preset collection time interval Q (n) The end time of the simulation time interval is adjusted to the end time T1 of the simulation time interval, and the subsequent first preset collection time interval Q is adjusted according to the second preset collection time interval (n+m) Adjust the start and end time of When k3>k0, according to the next first preset acquisition time interval Q (n+1) The start time and time length t2 determine the next first preset acquisition time interval Q (n+1) The end time of the first preset collection time interval Q is calculated according to the second preset collection time interval. (n+m’) Adjust the start and end time.

Images