Display OSD menu interface touch implementation method

Abstract

The invention provides a display on screen display (OSD) menu interface touch implementation method, which comprises the following steps of: receiving coordinates of a touch sensor by a display internal controller, and performing filtering and ghost point elimination processing on acquired coordinate values; whether OSD starting conditions are met or not is judged, if not, coordinates are sent to a host, and execution is carried out according to set functions; if yes, starting an OSD menu graphical interface; a display OSD menu interface touches an area distribution mechanism under a single computer or multiple computers. The technical scheme is accurate and effective, touch control of the OSD menu interface of the display can be guaranteed, meanwhile, when the OSD menu interface is touched, the area outside the OSD menu interface of the display can still be normally touched to control a computer, and the rapid man-machine interaction performance and the product experience of the display and the touch adaptability of a domestic operating system are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of display control terminals, and in particular to a touch control implementation method for an OSD menu interface of a display. Background Art

[0002] The OSD menu interface of the monitor is a graphic display generated by the monitor's own SOC controller, while the graphic image normally displayed by the monitor is an image output from the computer. Therefore, the OSD menu interface is independent of the computer image and has a different signal source. The touch sensor is independent of the LCD screen and connected to the computer through a separate USB interface. The computer reads the coordinate values ​​sent by the sensor through the USB interface and performs corresponding operations in conjunction with the touch driver on the computer. However, since the OSD menu interface is independent of the monitor's own image and is independent of the computer, the monitor itself cannot obtain the touch sensor coordinate values, so the monitor's OSD menu interface image cannot be controlled by touch. When it is necessary to adjust the monitor parameters and interact, it can only be operated through the physical OSD buttons. However, with the development of monitor products, the borders are getting narrower and narrower, and the physical OSD buttons are getting smaller and smaller, and are even placed on the back of the monitor. When used, they are limited by the operating space and operation methods, resulting in low interaction efficiency, inconvenience, and poor customer experience. Summary of the invention

[0003] The purpose of the present invention is to address the deficiencies of the above-mentioned prior art and provide a method for implementing touch control on an OSD menu interface of a display, thereby solving the problem that the OSD menu interface of the display cannot be controlled by touch.

[0004] To achieve the above object, the present invention adopts the following technical solutions:

[0005] The present invention provides a method for realizing touch control of an OSD menu interface of a display, comprising the following steps:

[0006] S1, the display internal controller receives the coordinates of the touch sensor, and first filters and eliminates ghost points on the collected coordinate values;

[0007] S2, determine whether the OSD startup conditions are met, if not, send the coordinates to the host and execute according to the established function; if satisfied, start the OSD menu graphical interface;

[0008] The OSD menu starts: long press the touch start area, set the start time threshold, when the touch reaches the long threshold, the touch sensing signal of the touch interface switches to the OSD menu interface;

[0009] The OSD menu exit: directly draw a line from right to left in the non-control area of ​​the OSD menu interface, set the shortest line length threshold, when the line length reaches the threshold, the OSD menu interface quickly exits and maintains the current parameters.

[0010] Furthermore, the touch start area can be set as an area for dragging to change the position, or set as a custom-drawn graphic to start the OSD menu, or a specific custom position as the actual OSD menu start area.

[0011] Furthermore, in order to increase the convenience of moving the touch start area, a control scheme of moving displacement threshold is adopted.

[0012] Furthermore, in order to avoid the long press strategy from being accidentally started, a second start strategy is set, and the second start strategy is based on the first start strategy; specifically:

[0013] S101, long press to implement pre-start of the touch start area;

[0014] S102, when the pre-start is completed, the touch start area enters the pre-start state, and at the same time, the touch start area is used as the starting point to display a verification trajectory line of the area production;

[0015] S103, performing secondary verification on the trajectory line.

[0016] Furthermore, S3 is specifically as follows: the finger touching the touch start area drags the icon in the touch display area to move along the generated verification trajectory line, and when the finger movement process meets the judgment condition of moving to the end along the trajectory, the OSD menu is started.

[0017] Further, in order to enhance the protection against the OSD menu being mistakenly activated by touch, the verification trajectory generated by the second activation strategy is set as a random trajectory.

[0018] Furthermore, the random trajectory is set as a set of trajectories of various difficulty levels, and trajectories in the set of medium and high difficulty trajectories are used preferentially; and a trajectory difficulty adjustment strategy is set, and when multiple errors occur during the verification of the same trajectory, a random trajectory in the set of low difficulty trajectories is switched to be used.

[0019] Furthermore, in order to prevent the long-press OSD menu startup area from causing accidental touches on the computer system application, the OSD menu startup area can be long-pressed to call out the OSD menu, and then the OSD menu startup mode can be selected as a graphic mode or a long-press mode in the OSD menu; if the graphic mode is selected, a custom closed-loop graphic and position can be set;

[0020] In order to prevent the OSD menu from being unable to set the startup area in special applications, retain the physical button to start the OSD menu.

[0021] Furthermore, in order to ensure that the OSD menu can be touched normally, the OSD menu touch strategy is set, specifically:

[0022] S201, when the OSD menu is started, in order to avoid the overlap of the OSD menu interface and the computer system interface layer, which may cause the computer system interface or the application interface to be accidentally touched when operating the OSD menu, the internal controller of the display divides the touch sensor coordinates into two areas: the OSD menu area and the computer application system area, and starts the coordinate area allocation mechanism to calculate the OSD menu area and the computer system application interface area independently. When the OSD menu is triggered, the display will intercept the OSD menu area coordinates for the OSD menu interface displayed by the touch controller, and the coordinates outside the OSD menu area are directly transmitted to the computer through the USB interface or the Ethernet interface for touch control of the computer system application interface;

[0023] S202, to further solve the problem that when the OSD menu is started, the computer system interface is accidentally touched when the OSD edge control is touched, causing the computer system interface to malfunction, the border of the OSD menu interface is blurred and the fault tolerance threshold is increased. When the OSD menu is started, the display automatically extends the OSD menu border;

[0024] S203, in order to further solve the problem that when the OSD menu is started, the computer system interface is accidentally touched when the OSD menu control is touched, resulting in malfunction of the computer system interface, the computer touch function is turned off in the OSD menu, and the computer touch function is automatically turned on after the OSD menu is exited;

[0025] S204, in order to make the touch control of the display OSD menu interface independent of the system and used independently of the display, the touch unit is not directly connected to the computer system, but the touch unit is firstly put into the control unit inside the display, when the OSD menu is started, the controller inside the display intercepts the coordinates of the OSD menu area by starting the touch sensor coordinate area allocation mechanism to control the OSD menu, and the coordinates outside the OSD area are transmitted to the computer system through the USB or Ethernet interface;

[0026] S205, in order to reduce the amount of data processing by the controller of the internal control unit of the display and shorten the touch response time, the internal control unit of the display actively monitors whether it is connected to the computer system. When the computer system is detected and the OSD menu is not started, the display internally opens the connection channel between the touch control unit and the computer, and the touch control unit directly transmits the data to the computing unit;

[0027] When the OSD menu is started, the internal controller of the display takes over the data processing with the touch control unit, and first determines the coordinates according to the principle of the coordinate area allocation mechanism, and then only processes the coordinates within the OSD menu area, and the coordinates outside are transparently transmitted to the computer system through the USB or Ethernet interface;

[0028] When the monitor is not connected to the computer system, the internal controller of the display directly takes over the data processing of the touch control unit and processes all the data for the display performance, touch function testing and touch fault troubleshooting of the display.

[0029] The beneficial effects of the patent of the present invention are: the coordinates of the touch sensor are obtained through the display, and then the coordinates are processed in the area. When the OSD menu of the display is called out, when the coordinates collected by the display are the OSD menu interface area, the display will implement corresponding actions based on the controls at the coordinate position, thereby solving the problem that the OSD menu interface of the display cannot be touched.

[0030] Description The touch display can be set to draw a specific graphic in the specified area of ​​the display to quickly call out the OSD menu, solving the problem that the OSD triggering physical buttons are difficult or impossible to operate due to the small space.

[0031] Introduce boundary control recognition and learning processing. After the OSD menu interface is called out, when the OSD menu boundary is touched, the OSD menu boundary image is blurred, and the user's usage habits are recorded to calculate the ideal boundary blur threshold to avoid accidentally touching the computer system interface or application interface when touching the OSD menu interface. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 A control flow chart of a touch control method for an OSD menu interface of a display;

[0033] Figure 2 This is the touch principle block diagram of the OSD menu interface;

[0034] Figure 3 Quickly trigger the flow chart for the OSD menu graphical interface;

[0035] Figure 4 This is the OSD touch control flow chart;

[0036] Figure 5 This is a flowchart for OSD graphical interface border blur processing and fault tolerance. DETAILED DESCRIPTION

[0037] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0038] See also Figure 1 , a touch control method for a display OSD menu interface, comprising the following steps:

[0039] S1, the display internal controller receives the coordinates of the touch sensor, and first filters and eliminates ghost points on the collected coordinate values;

[0040] S2, determine whether the OSD startup conditions are met, if not, send the coordinates to the host and execute according to the established function; if satisfied, start the OSD menu graphical interface;

[0041] The OSD menu starts: long press the touch start area, set the start time threshold, when the touch reaches the long threshold, the touch sensing signal of the touch interface switches to the OSD menu interface;

[0042] The OSD menu exit: directly draw a line from right to left in the non-control area of ​​the OSD menu interface, set the shortest line length threshold, when the line length reaches the threshold, the OSD menu interface quickly exits and maintains the current parameters.

[0043] The touch start area can be set as an area for dragging to change the position, or set as a custom-drawn graphic to start the OSD menu, or a specific custom position can be used as the actual OSD menu start area.

[0044] In order to increase the convenience of movement of the touch start area, a control scheme of moving displacement threshold is adopted.

[0045] In order to avoid accidental activation of the long press strategy, a second activation strategy is set, which is based on the first activation strategy; specifically:

[0046] S101, long press to implement pre-start of the touch start area;

[0047] S102, when the pre-start is completed, the touch start area enters the pre-start state, and at the same time, the touch start area is used as the starting point to display a verification trajectory line of the area production;

[0048] S103, performing secondary verification on the trajectory line.

[0049] The S3 is specifically: the finger touching the touch start area drags the icon in the touch display area to move along the generated verification trajectory line, and when the finger movement process meets the judgment condition of moving to the end along the trajectory, the OSD menu is started.

[0050] In order to prevent the OSD menu from being accidentally started by touch, the verification trajectory generated by the second startup strategy is set to a random trajectory.

[0051] The random trajectory line is set as a set of trajectory lines of multiple difficulty levels, and the trajectory lines in the medium and high difficulty trajectory line collection are preferentially used; and a trajectory line difficulty adjustment strategy is set. When multiple errors occur during the verification process of the same trajectory line, a random trajectory line in the low difficulty level trajectory line collection is switched to be used.

[0052] In order to avoid accidental touches of the computer system application by the long-press OSD menu startup area, you can long-press the OSD menu startup area, call out the OSD menu, and select the OSD menu startup mode as graphic or long-press in the OSD menu; if you choose graphic, set a custom closed-loop graphic and position;

[0053] In order to prevent the OSD menu from being unable to set the startup area in special applications, retain the physical button to start the OSD menu.

[0054] In order to ensure the normal touch control of OSD menu, the OSD menu touch control strategy is set as follows:

[0055] S201, when the OSD menu is started, in order to avoid the overlap of the OSD menu interface and the computer system interface layer, which may cause the computer system interface or the application interface to be accidentally touched when operating the OSD menu, the internal controller of the display divides the touch sensor coordinates into two areas: the OSD menu area and the computer application system area, and starts the coordinate area allocation mechanism to calculate the OSD menu area and the computer system application interface area independently. When the OSD menu is triggered, the display will intercept the OSD menu area coordinates for the OSD menu interface displayed by the touch controller, and the coordinates outside the OSD menu area are directly transmitted to the computer through the USB interface or the Ethernet interface for touch control of the computer system application interface;

[0056] S202, to further solve the problem that when the OSD menu is started, the computer system interface is accidentally touched when the OSD edge control is touched, causing the computer system interface to malfunction, the border of the OSD menu interface is blurred and the fault tolerance threshold is increased. When the OSD menu is started, the display automatically extends the OSD menu border;

[0057] S203, in order to further solve the problem that when the OSD menu is started, the computer system interface is accidentally touched when the OSD menu control is touched, resulting in malfunction of the computer system interface, the computer touch function (except the touch outside the OSD menu area) is set to be turned off in the OSD menu, and the computer touch function is automatically turned on after the OSD menu is exited;

[0058] S204, in order to make the touch control of the display OSD menu interface independent of the system and used independently of the display, the touch unit is not directly connected to the computer system, but the touch unit is firstly put into the control unit inside the display, when the OSD menu is started, the controller inside the display intercepts the coordinates of the OSD menu area by starting the touch sensor coordinate area allocation mechanism to control the OSD menu, and the coordinates outside the OSD area are transmitted to the computer system through the USB or Ethernet interface;

[0059] S205, in order to reduce the amount of data processing by the controller of the internal control unit of the display and shorten the touch response time, the internal control unit of the display actively monitors whether it is connected to the computer system. When the computer system is detected and the OSD menu is not started, the display internally opens the connection channel between the touch control unit and the computer, and the touch control unit directly transmits the data to the computing unit;

[0060] When the OSD menu is started, the internal controller of the display takes over the data processing with the touch control unit, and first determines the coordinates according to the principle of the coordinate area allocation mechanism, and then only processes the coordinates within the OSD menu area, and the coordinates outside are transparently transmitted to the computer system through the USB or Ethernet interface;

[0061] When the monitor is not connected to the computer system, the internal controller of the display directly takes over the data processing of the touch control unit and processes all the data for the display performance, touch function testing and touch fault troubleshooting of the display.

[0062] The OSD menu touch control process is as follows:

[0063] After the user triggers the OSD menu interface through the OSD physical button, the display will mark the coordinate area of ​​the received touch sensor;

[0064] When the internal controller of the display receives the coordinates of the OSD menu interface area, the controller will send a command to the SOC video processing IC inside the display through the serial port. After receiving the corresponding command, the video processing IC will switch the corresponding OSD function interface and display parameter adjustment, thereby realizing touch control of the OSD menu interface;

[0065] When the internal controller of the display receives coordinates outside the OSD menu interface area, the controller sends the received coordinate values ​​to the computer through the USB interface, and the computer performs corresponding operations and instructions based on the received coordinates;

[0066] Users can customize the OSD graphic boundary blur and error tolerance value according to the actual usage environment and situation to prevent misoperation in the OSD boundary overlap area;

[0067] The user can turn on / off the computer touch screen by selecting the OSD menu graphic trigger in the OSD menu according to usage habits and needs. If the computer touch screen is turned off, the computer touch screen will be automatically turned on after exiting the OSD menu.

[0068] For large screens or ultra-wide screens, when performing multi-host split-screen display and control, the display parameters can be adjusted and the computer system interface or application interface can be operated through the touch OSD menu interface at the same time to achieve multi-person collaborative work.

[0069] Example:

[0070] The internal controller of the display is connected to the USB of the touch sensor through a USB interface. At the same time, the internal controller of the display is connected to the USB of the computer through another USB interface. The principle block diagram is as follows Figure 2 shown.

[0071] OSD menu interface quick call-out mechanism

[0072] In order to solve the problem that the physical OSD menu of the monitor is inconvenient to operate in a small space, this solution proposes a quick call-out mechanism for the OSD menu interface. After the monitor is turned on, the user uses a touch pen or finger to draw a custom closed-loop graphic at the set position of the monitor. When the controller detects that the drawn closed-loop graphic is established, the monitor SOC graphics processor outputs the OSD menu graphic, triggers the OSD menu interface display, and OSD_FLG is set to 1.

[0073] In order to reduce the operating load of the controller and improve the operating speed of the controller and the touch response time, an intersection detection mechanism is proposed. When the user touches the display continuously and uninterruptedly within a certain period of time, a closed-loop graph will be formed, and an intersection point will inevitably be generated. When the touch sensor coordinate values ​​received by the controller overlap after a period of continuous movement, it means that an intersection has appeared in the touch trajectory, and it is therefore determined that a closed-loop graph has been drawn.

[0074] In order to adapt to different application environments, it is proposed that users can set the OSD menu interface trigger graphics by themselves through the OSD menu interface, and save them after setting.

[0075] Touch sensor area allocation and layer processing mechanism

[0076] like Figure 3As shown, after the controller obtains the coordinates sent by the touch sensor, it uses the mean filtering algorithm to process the coordinate values ​​within 50ms, filters out false touches or ghost points caused by interference, and converts the effective touch sensor coordinate values ​​into the physical coordinate values ​​of the LCD screen. Add an OSD menu interface identifier OSD_FLG in the display controller software. When the OSD graphic interface is called out, SOD_FLG is set to 1. When SOD_FLG is set to 1, the controller starts the touch coordinate area allocation mechanism. The controller determines whether the coordinates are within the range of the OSD graphic interface. If the coordinate value is within the range of the OSD menu graphic, the controller converts the coordinate value into a UART function code that can be recognized by the SOC, and the controller sends it to the display SOC graphics processor through the serial port UART. The graphics processor controls and adjusts the OSD menu interface according to the function code received by the serial port UART. After exiting the OSD menu interface, OSD_FLG is set to 0. If the coordinate value is outside the OSD menu graphic, the controller will transmit the received coordinates to the computer via USB, and the computer will perform corresponding operations. This mechanism can effectively solve the problem of the computer being accidentally touched when operating the OSD menu when the computer system interface or application interface overlaps with the OSD menu interface layer.

[0077] OSD graphical interface border blur processing and fault tolerance mechanism:

[0078] See also Figure 4 and Figure 5 In order to solve the problem of touch recognition errors caused by the overlap of the edges of the computer system interface or application interface and the OSD interface, a boundary blur processing and fault tolerance mechanism is proposed. When the OSD menu graphic interface is triggered, the edge of the OSD menu interface is extended outward by 150 pixels, and the boundary of the OSD menu interface is retracted by 50 pixels. The controller does not perform any processing on the pixels in this area, but when more than half of the touch point coordinates are outside the extended area, it is determined to be a valid touch and the coordinates are sent to the computer; when the touch point coordinates are within the OSD touch control, the controller makes corresponding touch actions according to the corresponding control functions.

[0079] To meet the needs of different users, users can set the blur and fault tolerance thresholds through the OSD menu, and the setting value can be from 100 to 500 pixels; users can also set it through the controls on the OSD menu interface. When the OSD menu interface is triggered, OSD_FLG=1 turns off the computer trigger, and when exiting the OSD menu interface, OSD_FLG=0, the computer touch is automatically turned on.

[0080] The above-mentioned embodiments only express the implementation methods of the present invention, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention should be based on the attached claims.

Claims

1. A touch control method for a display OSD menu interface, characterized in that: The following steps are involved: S1, the display internal controller receives the coordinates of the touch sensor, and first filters and eliminates ghost points on the collected coordinate values; S2, determine whether the OSD startup conditions are met, if not, send the coordinates to the host and execute according to the established function; if satisfied, start the OSD menu graphical interface; The OSD menu starts: long press the touch start area, set the start time threshold, when the touch reaches the long threshold, the touch sensing signal of the touch interface switches to the OSD menu interface; The OSD menu exit: directly draw a line from right to left in the non-control area of ​​the OSD menu interface, set the shortest line length threshold, when the line length reaches the threshold, the OSD menu interface quickly exits and maintains the current parameters.

2. A touch control method for a display OSD menu interface according to claim 1, characterized in that: The touch start area can be set as an area for dragging to change the position, or set as a custom-drawn graphic to start the OSD menu, or a specific custom position can be used as the actual OSD menu start area.

3. A method for implementing touch control of a display OSD menu interface according to claim 2, characterized in that: In order to increase the convenience of movement of the touch start area, a control scheme of moving displacement threshold is adopted.

4. A method for implementing touch control of a display OSD menu interface according to claim 3, characterized in that: In order to avoid accidental activation of the long press strategy, a second activation strategy is set, which is based on the first activation strategy; specifically: S101, long press to implement pre-start of the touch start area; S102, when the pre-start is completed, the touch start area enters the pre-start state, and at the same time, the touch start area is used as the starting point to display a verification trajectory line of the area production; S103, performing secondary verification on the trajectory line.

5. A display OSD menu interface touch control implementation method according to claim 4, characterized in that: The S3 is specifically: the finger touching the touch start area drags the icon in the touch display area to move along the generated verification trajectory line, and when the finger movement process meets the judgment condition of moving to the end along the trajectory, the OSD menu is started.

6. A method for implementing touch control of a display OSD menu interface according to claim 5, characterized in that: In order to prevent the OSD menu from being accidentally started by touch, the verification trajectory generated by the second startup strategy is set to a random trajectory.

7. A touch control method for a display OSD menu interface according to claim 6, characterized in that: The random trajectory line is set as a set of trajectory lines of multiple difficulty levels, and the trajectory lines in the medium and high difficulty trajectory line collection are preferentially used; and a trajectory line difficulty adjustment strategy is set. When multiple errors occur during the verification process of the same trajectory line, a random trajectory line in the low difficulty level trajectory line collection is switched to be used.

8. The method for implementing touch control of an OSD menu interface of a display according to claim 7, wherein: In order to avoid accidental touches of the computer system application by the long-press OSD menu startup area, you can long-press the OSD menu startup area, call out the OSD menu, and select the OSD menu startup mode as graphic or long-press in the OSD menu; if you choose graphic, set a custom closed-loop graphic and position; In order to prevent the OSD menu from being unable to set the startup area in special applications, retain the physical button to start the OSD menu.

9. A touch control method for a display OSD menu interface according to claim 8, characterized in that: In order to ensure the normal touch control of OSD menu, the OSD menu touch control strategy is set as follows: S201, when the OSD menu is started, in order to avoid the overlap of the OSD menu interface and the computer system interface layer, which may cause the computer system interface or the application interface to be accidentally touched when operating the OSD menu, the internal controller of the display divides the touch sensor coordinates into two areas: the OSD menu area and the computer application system area, and starts the coordinate area allocation mechanism to calculate the OSD menu area and the computer system application interface area independently. When the OSD menu is triggered, the display will intercept the OSD menu area coordinates for the OSD menu interface displayed by the touch controller, and the coordinates outside the OSD menu area are directly transmitted to the computer through the USB interface or the Ethernet interface for touch control of the computer system application interface; S202, to further solve the problem that when the OSD menu is started, the computer system interface is accidentally touched when the OSD edge control is touched, causing the computer system interface to malfunction, the border of the OSD menu interface is blurred and the fault tolerance threshold is increased. When the OSD menu is started, the display automatically extends the OSD menu border; S203, in order to further solve the problem that when the OSD menu is started, the computer system interface is accidentally touched when the OSD menu control is touched, resulting in malfunction of the computer system interface, the computer touch function is turned off in the OSD menu, and the computer touch function is automatically turned on after the OSD menu is exited; S204, in order to make the touch control of the display OSD menu interface independent of the system and used independently of the display, the touch unit is not directly connected to the computer system, but the touch unit is firstly put into the control unit inside the display, when the OSD menu is started, the controller inside the display intercepts the coordinates of the OSD menu area by starting the touch sensor coordinate area allocation mechanism to control the OSD menu, and the coordinates outside the OSD area are transmitted to the computer system through the USB or Ethernet interface; S205, in order to reduce the amount of data processing by the controller of the internal control unit of the display and shorten the touch response time, the internal control unit of the display actively monitors whether it is connected to the computer system. When the computer system is detected and the OSD menu is not started, the display internally opens the connection channel between the touch control unit and the computer, and the touch control unit directly transmits the data to the computing unit; When the OSD menu is started, the internal controller of the display takes over the data processing with the touch control unit, and first determines the coordinates according to the principle of the coordinate area allocation mechanism, and then only processes the coordinates within the OSD menu area, and the coordinates outside are transparently transmitted to the computer system through the USB or Ethernet interface; When the monitor is not connected to the computer system, the internal controller of the display directly takes over the data processing of the touch control unit and processes all the data for the display performance, touch function testing and touch fault troubleshooting of the display.

Images