Screen refresh positioning method, device, display device and storage medium

Abstract

The present application relates to a screen refresh positioning method, device, display device and storage medium. Among them, the screen refresh positioning method includes: obtaining touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes a control instruction for indicating that the current refresh content of the touch object is the lamp bead position; the lamp bead data includes the actual grayscale of the lamp bead used to express the lamp bead position; the touch position information is parsed to obtain the actual grayscale of the lamp bead, and based on the deviation between the actual grayscale of the lamp bead and the corresponding calibrated call grayscale, the current contact point position of the stylus is determined. The present application can achieve accurate coordinate positioning with a relatively low delay, and at the same time, when refreshing the coordinate content, it will not affect its display effect, thereby ensuring the dynamic range of the touch object within the corresponding time segment.

Description

Technical Field

[0001] The present application relates to the field of touch interaction technology, and in particular to a screen refresh positioning method, device, display device and storage medium. Background Art

[0002] For LED (Light-Emitting Diode) displays that are hundreds of inches in size, the lowest cost way to achieve touch control is to use an infrared touch frame. Including an infrared touch frame and a stylus, the method is to place a series of infrared probes on the edge of the screen. The probes will illuminate the tip of the stylus and produce reflections. By detecting the reflected light from different probes, the exact coordinates of the current landing point are calculated. However, with the infrared touch frame method, when the emitted light is blocked, the touch function will be lost, and the touch sensitivity at the edge of the screen is low. The position of the probe installed at the edge of the screen is also difficult to ignore, and the large black edge of the screen edge cannot be avoided.

[0003] Other display touch solutions, including capacitive, vector pressure sensing, surface acoustic wave, metal mesh, piezoresistive and infrared, are generally limited by the contradiction between cost and full-size control, and it is difficult to achieve full-size touch screen control with low latency at low cost. In other words, during the implementation process, it was found that the traditional technology has at least the following problems: the current touch method has a high latency problem. Summary of the invention

[0004] Based on this, it is necessary to provide a screen refresh positioning method, device, display device and storage medium that can reduce latency in response to the above technical problems.

[0005] In order to achieve the above-mentioned purpose, on the one hand, an embodiment of the present application provides a screen refresh positioning method, including:

[0006] Acquire touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes a control instruction for indicating that the current refresh content of the touch object is the lamp bead position; the lamp bead data includes the actual grayscale of the lamp bead used to express the lamp bead position;

[0007] The touch position information is analyzed to obtain the actual grayscale of the lamp bead, and the current touch point position of the stylus is determined based on the deviation between the actual grayscale of the lamp bead and the corresponding calibrated call grayscale.

[0008] In one embodiment, the lamp bead position includes the precise position of the lamp bead; the deviation is the grayscale difference that satisfies a preset corresponding relationship with the precise position of the lamp bead;

[0009] The steps of determining the current contact point position of the stylus pen based on the deviation between the actual grayscale of the lamp bead and the calibrated grayscale include:

[0010] Get the grayscale difference between the actual grayscale of the lamp bead and the grayscale called by the calibration, query the precise position of the lamp bead corresponding to the grayscale difference in the preset corresponding relationship, and determine the precise position of the lamp bead as the current contact position.

[0011] In one embodiment, the precise position of the lamp bead includes the coordinates of the lamp bead; the refresh strategy includes using a single frame to display the actual grayscale of the lamp bead;

[0012] In the preset corresponding relationship, each grayscale difference value corresponds to a lamp bead coordinate.

[0013] In one embodiment, the precise position of the lamp bead includes the coordinates of the lamp bead; the refresh strategy includes using odd and even frames to alternately display the actual grayscale of the lamp bead;

[0014] In the preset corresponding relationship, the grayscale difference of the odd-numbered frames corresponds to the X-axis coordinate value of the lamp bead coordinates, and the grayscale difference of the even-numbered frames corresponds to the Y-axis coordinate value of the lamp bead coordinates.

[0015] In one of the embodiments, the refresh strategy further includes a current display area confirmed based on the content of the previous refresh; the content of the previous refresh includes the rough position of the lamp beads.

[0016] In one embodiment, the calibration call grayscale is selected from the basic grayscale sequence according to the gamma curve;

[0017] In the preset corresponding relationship, the grayscale difference value includes the difference between the first number of basic grayscales obtained sequentially along the numerical increasing direction of the basic grayscale sequence with the calibrated call grayscale as the reference and the calibrated call grayscale, and the difference between the second number of basic grayscales obtained sequentially along the numerical decreasing direction of the basic grayscale sequence with the calibrated call grayscale and the calibrated call grayscale.

[0018] In one embodiment, the control instruction includes a binary number of preset digits corresponding to the lamp bead data; the binary number of preset digits is determined based on the grayscale level of the touch object;

[0019] The first number is smaller than the second number by 1, and the sum of the first number and the second number is smaller than the value of the gray level of the touch object by 1.

[0020] A screen refresh positioning device, comprising:

[0021] An information acquisition module is used to acquire touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes a control instruction for indicating that the current refresh content of the touch object is the lamp bead position; the lamp bead data includes the actual grayscale of the lamp bead used to express the lamp bead position;

[0022] The position determination module is used to analyze the touch position information to obtain the actual grayscale of the lamp bead, and determine the current touch point position of the stylus based on the deviation between the actual grayscale of the lamp bead and the corresponding calibrated call grayscale.

[0023] A display device, the display device comprising a display screen and a control device;

[0024] Among them, the display screen serves as the touch object of the stylus; and the control device is used to execute the steps of the above method.

[0025] A computer-readable storage medium stores a computer program, which implements the steps of the above method when executed by a processor.

[0026] One of the above technical solutions has the following advantages and beneficial effects:

[0027] The present application obtains touch position information, which is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus, and the refresh strategy includes a control instruction for indicating that the current refresh content of the touch object is the lamp bead position, wherein the lamp bead data includes the actual grayscale of the lamp bead used to express the position of the lamp bead, and then the present application determines the current contact point position of the stylus based on the deviation between the actual grayscale of the lamp bead and the corresponding calibrated call grayscale. That is, the actual display grayscale of the lamp bead obtained by the present application is different from the corresponding call grayscale, and then this difference is used as a carrier to express the precise position coordinates of the lamp bead. The present application can achieve accurate coordinate positioning with a relatively low delay, and at the same time, when refreshing the coordinate content, it will not affect its display effect, thereby ensuring the dynamic range of the touch object within the corresponding time segment. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0029] Figure 1 A diagram showing an application environment of a screen refresh positioning method in an embodiment;

[0030] Figure 2A schematic diagram of a flow chart of a screen refresh positioning method in one embodiment;

[0031] Figure 3 is a schematic diagram of a gamma curve in an embodiment;

[0032] Figure 4 A schematic diagram of a specific flow chart of a screen refresh positioning method in one embodiment;

[0033] Figure 5 A schematic diagram of calibrating and calling the allowable deviation value on the grayscale in one embodiment;

[0034] Figure 6 FIG. 4 is a structural block diagram of a screen refresh positioning device in one embodiment. DETAILED DESCRIPTION

[0035] In order to facilitate understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. Embodiments of the present application are provided in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.

[0036] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.

[0037] It can be understood that the terms "first", "second", etc. used in the present application can be used in this article to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish the first element from another element.

[0038] Spatially relative terms such as "under," "beneath," "below," "under," "above," "above," and the like may be used herein to describe the relationship of an element or feature shown in the figures to other elements or features. It should be understood that, in addition to the orientations shown in the figures, spatially relative terms also include different orientations of the device in use and operation. For example, if the device in the accompanying drawings is flipped, an element or feature described as "under other elements" or "under it" or "under it" will be oriented as being "above" the other elements or features. Thus, the exemplary terms "under" and "under" may include both upper and lower orientations. In addition, the device may also include additional orientations (e.g., rotated 90 degrees or other orientations), and the spatial descriptors used herein are interpreted accordingly.

[0039] It should be noted that when an element is considered to be "connected" to another element, it can be directly connected to the other element, or connected to the other element through an intermediate element. In addition, the "connection" in the following embodiments should be understood as "electrical connection", "communication connection", etc. if there is transmission of electrical signals or data between the connected objects.

[0040] When used herein, the singular forms "a", "an", and "said / the" may also include plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "include / comprise" or "have" and the like specify the presence of stated features, wholes, steps, operations, components, parts, or combinations thereof, but do not exclude the possibility of the presence or addition of one or more other features, wholes, steps, operations, components, parts, or combinations thereof. At the same time, the term "and / or" used in this specification includes any and all combinations of the relevant listed items.

[0041] The screen touch of LED display has always been limited by three major problems. The first is that to achieve screen touch of full-size LED display, it requires a lot of hardware cost, and the control of these hardware occupies a lot of system memory. The second is that the touch of large-size display screens must maintain low latency, that is, the time taken to complete a touch interaction must be extremely low. The third is the layout and hiding of touch sensors to reduce the gaps on the screen surface and the possible impact on the display quality of the display.

[0042] The traditional solution for external infrared borders is to set up infrared dual-tube sensors on the edge of the screen, and use infrared light and reflections to detect the touch input position on the screen surface. However, there are at least the following problems: ① A certain position must be reserved at the edge of the screen for the placement of the infrared dual-tube sensor and its module, and the screen will always have a black border. ② At the edge of the screen, since the difference between the outgoing light and the incident light is small, the touch sensitivity is relatively lower than in the middle, and the sensitivity is not consistent across the entire screen. ③ Under different construction environments, it may happen that after the infrared light is blocked and reflected back, the touch demand behind it is blocked.

[0043] In other traditional solutions, vector pressure sensors, that is, fine strain gauges, are used to provide feedback on the screen touch coordinates, so many strain gauges need to be installed on the entire screen; metal grids are used, and the grids attached to the screen surface will cause screen occlusion; and it is difficult to achieve low-latency interaction using capacitive control. Various screen touch methods have defects on LED display screens. For touch interaction, the core work is to determine the position coordinates of the touch point relative to the screen. The method of determining the touch point coordinates is the primary problem to be solved in touch interaction, and it is also the primary problem for LED display screens to achieve touch interaction. In addition, the processing technology of the packaging structure of high-resolution LED display screens has extremely high requirements for consistency. Easily changing the characteristics of its internal components can easily reduce the display quality of the screen.

[0044] In this regard, a type of touch positioning solution has been proposed, which does not require significant changes to the screen structure. It only needs to follow the corresponding refresh strategy to achieve screen touch interaction under the operation of the stylus, with low cost and low latency. This solution can be based on the existing display screen packaging form, suitable for LED display screens, can achieve display touch, and has extremely low cost and consistent full-size touch sensitivity. This touch positioning solution uses the high-speed dynamic refresh feature of the screen to insert the data required for interaction, such as the reference coordinate position, into the screen to be refreshed, occupying part of the screen refresh time to refresh the reference coordinate position information. At the same time, with a stylus that can collect refresh features, the current touch position information can be collected at a higher sampling frequency, and the collected information is then sent back to the interactive system to realize content interaction on the display screen.

[0045] However, in the above touch positioning scheme, the refresh mode adopted by the touch object is a multi-level refresh, for example, the position coordinates of the lamp beads are refreshed to the stylus step by step from coarse to fine, that is, the rough coordinates of the lamp beads and the precise coordinates of the lamp beads are graded and sorted before being refreshed (positioning grading). Among them, the refresh order of the rough coordinates of the lamp beads is superior to the precise coordinates of the lamp beads, that is, the rough coordinates of the lamp beads are refreshed first, so that the touch object can gradually reduce the display area and gradually locate the lamp bead coordinates where the touch point of the stylus is located. For example, the above scheme for positioning grading of the lamp bead position coordinates can include the following methods: ① module number + precise coordinates of the lamp beads on the module; ② module number + display area number on the module + precise coordinates in the display area.

[0046] However, in the form of graded touch, the screen refresh is divided into rough coordinates and precise coordinates. The rough coordinates are used to express simple content, such as a simple number, the division of left and right ranges, etc. Therefore, the rough coordinates occupy a small amount of data and have a short refresh cycle. However, the refresh of precise coordinates involves the specific position coordinates of each lamp bead in a certain area. As the stylus moves, this position coordinate changes in real time, with a large amount of data and a long refresh cycle, and the reaction time left for each pixel is very small, which can easily cause delayed interaction of the display screen.

[0047] In this regard, a grayscale refresh positioning solution has been proposed, which uses the grayscale refresh of the display screen to store a multi-bit binary number, and then transmits the precise coordinates based on the binary number. However, if this grayscale refresh positioning solution extracts a frame to refresh the precise target of the display screen, it will cause the display content and the refreshed content to be out of sync within this frame, and the screen will not be able to display the content normally. At the same time, the main impact of reading the precise coordinates of the lamp beads in this way on the display quality is that it will reduce the dynamic range of the display.

[0048] The display grayscale of the lamp bead changes in real time. In this frame, as well as 5 frames above and 5 frames below this frame, they are all refreshed at low brightness. If the grayscale of this position is refreshed, from the above binary number, it will refresh a high-brightness back grayscale in the time segment of one frame, which will cause the lamp bead to suddenly change from low brightness to high brightness in a very short time within this time segment, resulting in a shining effect.

[0049] Similarly, in this frame, as well as the 5 frames above and 5 frames below this frame, the display content is refreshed at high brightness. If the grayscale of this position is refreshed, from the binary number used in the above grayscale refresh, it will not be refreshed completely according to the high brightness time frequency within the time segment of one frame, and there will be a slight loss in brightness. However, this effect is not obvious at high brightness. In short, using the above grayscale refresh positioning method, when refreshing the precise position coordinates of the screen, the dynamic range of the lamp bead in this time segment will be reduced, reducing the display effect.

[0050] In view of the disadvantage of grayscale refresh for coordinate position marking, the present application proposes a grayscale deviation refresh method. The grayscale deviation can refer to the actual display grayscale of the lamp bead, which is different from the corresponding call grayscale. This difference is used as a carrier to express the precise position coordinates of the lamp bead. Furthermore, the deviation value of the grayscale of the touch object can be indicated by a control instruction, so that the precise coordinates of the lamp bead can be represented by a grayscale refresh with a deviation. In order to make the purpose, technical solution and advantages of the present application clearer, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application and are not used to limit the present application.

[0051] The screen refresh positioning method provided in this application can be applied to Figure 1 In the application environment shown. Among them, the interactive system is used for touch interaction of the display screen. The screen continuously refreshes the display screen at an extremely high refresh rate, and the stylus obtains the screen information at an extremely high sampling frequency. Specifically, the display screen keeps refreshing at a high speed, and the refreshed content can be divided into two parts of features, one is the display content, and the other is the interactive information. The stylus records the working status of the display screen in each refresh time segment at an extremely high sampling rate, and obtains the information used for interaction through direct or indirect feature recognition, such as lamp bead coordinates, offset distance, moving speed, etc. That is, by utilizing the high-speed refresh capability of the display screen and the low frame rate difference of the video source, low-latency touch interaction of the screen can be achieved.

[0052] Figure 1 The interactive system in can be an independent control system, which is used to configure the corresponding refresh strategy (for example, control instructions) for the display screen and interact with the stylus; in some examples, the interactive system can also be a system including a display device including a screen and a control device and a stylus, and then the stylus interacts with the control device in the display device. In addition, the control device can be independent of the screen setting, or it can belong to the same display device as the screen. The control device can be used to configure the corresponding refresh strategy (for example, control instructions) for the display screen and interact with the stylus. Among them, the screen refresh positioning method of the present application can be applied in the interactive system, in the control device, and in the stylus (the stylus collects and parses the touch position information, feeds back the corresponding refresh strategy, etc., that is, the stylus performs touch operations while interacting with the screen).

[0053] It should be noted that the touch object may include a display screen; the display screen may be a liquid crystal display screen or an electronic ink display screen; in some embodiments, the display screen may be an LED display screen. Furthermore, the display screen may be implemented based on existing miniLED, microLED (micrometer light emitting diode) or SMD (Surface Mounted Devices) packaged LED (i.e., surface mount packaged structure LED) with surface enhancement treatment, without requiring significant changes to the screen structure.

[0054] In one embodiment, Figure 2 As shown, a screen refresh positioning method is provided, which is applied to Figure 1 The interactive system or stylus in the example is used to illustrate, including the following steps:

[0055] Step 202, obtaining touch position information.

[0056] Among them, the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes a control instruction for indicating that the current refresh content of the touch object is the lamp bead position; the lamp bead data includes the actual grayscale of the lamp bead used to express the lamp bead position.

[0057] Specifically, the stylus may refer to a device for performing touch interaction with a touch object. In some examples, the stylus may be a pen-shaped tool used to input instructions to a computer screen, a mobile device, a drawing board, or other device with a touch screen, and a user may select a file or draw a picture by clicking the touch screen with the stylus. It should be noted that the stylus is only for the purpose of illustration, and in actual applications, a high-speed sampling device capable of performing touch interaction with a touch object may also be used to implement the high-speed sampling device, such as a stylus, a lens, or other device.

[0058] The touch object (for example, the display screen) is sampled by the stylus, and the data may be the light of the lamp beads in the display screen. In some examples, the data sampling may be obtained by monitoring the on-off state of the display screen by the stylus at a higher frequency, that is, the screen touch is realized by detecting the on-off state of the lamp beads. It should be noted that, taking the display screen as an LED screen as an example, when the LED screen displays the content of the picture, it does not realize the content display by changing the constant on of the lamp beads, but by the high-frequency on-off change of the lamp beads to reflect the difference of different contents, and this display feature is called dynamic scanning, which is an important display feature of the LED display screen. Under the dynamic scanning drive, for a single lamp bead, it will not remain in a constant on state, but will change at a very high frequency, and realize different content display in the alternation of on and off. The light effect displayed by the lamp beads through high-frequency on-off alternation is from on to off, progressive layer by layer, and the final effect is called grayscale. The grayscale used by the LED lamp beads from on to off usually has 256 levels, and there are 3 lamp beads on a single pixel, namely red, green and blue lights. The three lamp beads achieve different color displays through different brightness ratios. Therefore, when the LED display screen displays the picture, for a single lamp bead, it mainly relies on grayscale refresh.

[0059] In order to ensure the uniform and stable changes in color and brightness, the LED display screen will increase the screen grayscale refresh rate as much as possible. Usually, an LED display screen can achieve a screen refresh rate of 3840HZ, which means that when playing a 60HZ display screen, each frame of the screen will be reflected by 64 refreshes of the LED display screen. And these 64 refreshes are grayscale refreshes. It can be seen that the screen refresh capacity of the LED display screen is much higher than the video source information.

[0060] Among them, the lamp bead data can be obtained in the following way: the lighting component in the stylus collects the touch object, and after obtaining the light of the lamp bead, it can be processed in sequence by the light on and off component, photosensitive module and data processing module in the stylus, and then converted into a readable data stream for the interactive system to handle. For example, the display screen refreshes 3840 times per second, and the stylus achieves at least 3840 data sampling per second. The sampled data is processed and analyzed to obtain accurate coordinates or reference offsets during movement, and fed back to the interactive system to update the display data of the next frame. Among them, the specific values ​​are not limited.

[0061] Furthermore, the lamp bead data can be obtained by sampling a single lamp bead and / or a single pixel through the stylus. The light-on / off component in the stylus can be turned on when there is light, so that the light can enter the photosensitive module; wherein, the light-on / off component can refer to a device used to control the time for light to irradiate the photosensitive element, and the on / off clock of the light-on / off component can be consistent with the refresh clock of the touch object (for example, the display screen). In some examples, the light-collecting component can be implemented by a light-collecting lens, the light-on / off component can be implemented by an exposure valve, and the photosensitive module can be implemented by a photosensitive module, that is, a photosensitive sensor (for example, a photosensor); and when collecting a single pixel, the photosensitive module can include multiple photosensitive sensors, and the stylus can include an optical splitter module connected between the light-on / off component and the photosensitive module, the optical splitter module divides the light into red, green, and blue light, and respectively emits them to the multiple photosensitive modules included in the photosensitive module, so that one exposure detection of the light-on / off component can simultaneously detect the on and off conditions of the three lamp beads on a single pixel, and the lamp bead detection is more efficient. In some examples, the optical splitter module can be implemented by a spectroscopic refractive lens. In addition, the stylus can also include a data sending module for communicating with the interactive system.

[0062] The interactive system realizes touch interaction with the stylus based on the dynamic refresh of the display screen (for example, the LED display screen). Among them, the working status of a single lamp bead in different time slots can specifically include the following two indicators: one is whether the lamp bead is emitting light, and the other is the time of emitting light, both of which can be recorded by the stylus. In addition, the sampling frequency of the stylus can correspond to the refresh frequency of the LED display screen. For the lamp bead, within a frame of time, for example, each time slot refresh will be recorded by the stylus. For the state and time of the lamp bead in this time slot, the corresponding digital signal code is output for processing by the corresponding system, and data content including the coordinates of the lamp bead, which is helpful for realizing screen interaction, is extracted from it.

[0063] It should be noted that the present application does not limit the specific structure of the stylus, and any stylus that can obtain the touch position information of the touch object at a high sampling rate can be used. In some examples, the stylus can be implemented as a lamp bead stylus and / or a pixel stylus.

[0064] The lamp bead stylus is used to sample a single lamp bead, that is, the on and off of a single lamp bead can be judged by the stylus, and then the coordinates of the current lamp bead are collected. The working status of the lamp bead is on and off. When refreshing a frame of the picture, the working cycle of the lamp bead will be divided into 64 time segments, and the on and off status will be refreshed in these 64 time segments. This situation can be seen as the limited accuracy of the stylus in collecting pixels. It is impossible to identify the brightness status of the three lamp beads on a single pixel, but the entire pixel is judged as a whole lamp bead. It can also be seen as a high-quality display screen, the arrangement of the lamp beads on it is very fine, and the concept of pixels is composed of any three lamp beads of different colors. Among them, the data read by the stylus can be the status data of a single lamp bead in these 64 time segments. That is, the information read by the stylus pen at one time is a time segment of a lamp bead within a frame time; and the structural style of the stylus pen can apply the structure of the lamp bead stylus pen exemplified above (including a lighting lens, an exposure valve, a photosensor, a data processing module, and a data sending module, etc.).

[0065] The acquisition range of the pixel stylus is a single pixel, that is, the on and off of the lamp bead on a single pixel is judged by the stylus, and then the coordinates of the current pixel are acquired. There are three lamp beads on a pixel, namely red, green and blue lights. In this way, when the stylus stays directly above a pixel, it can acquire the light of the red, green and blue lamp beads in the pixel. These three lamp beads will be refreshed 64 times when refreshing a frame of video. Here it is not simply 64 times of on and off, but it can be understood that the working time of the lamp bead in this frame, that is, 16.67ms, is divided into 64 working segments. For each working segment, the lamp bead has a corresponding working state (on, off). Three lamp beads have 192 corresponding working segments in the same time. The data read by the stylus is the status data of the three lamp beads in these 64 time segments. Specifically, the information read by the stylus at one time is the combination of the three time segments of the three lamp beads refreshed in the same frame.

[0066] Furthermore, the pixel stylus can sample three lamp beads in a single pixel at a time, and use the light entering along the light path provided by the exposure valve as the incident light. The stylus can use a spectroscopic refractor to refract the red, green, and blue light onto three photosensitive sensors respectively, and divide them into three signals, which are output to the processing system of the stylus respectively. Then, the stylus can read three frames of picture data within one frame of picture information. That is, the structure of the pixel stylus can be based on the aforementioned lamp bead stylus, and a spectroscopic refraction lens is further added. At the same time, three photosensitive sensors can be used.

[0067] The touch position information in this application is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; that is, the touch object adopts the corresponding refresh strategy, and the refresh mode can refer to the touch object sending high-speed data information in the form of lights on and off for corresponding durations through high-speed refresh based on the control instructions provided by the interactive system to transmit the position information. Among them, the lamp bead data includes the actual grayscale of the lamp bead used to express the position of the lamp bead.

[0068] The actual grayscale of the lamp bead may refer to the actual display grayscale of the lamp bead. The present application expresses complete data through simple on and off of the lamp bead; regarding the actual grayscale of the lamp bead, the touch object is an LED display screen as an example for explanation; the grayscale refresh of the LED display screen refers to the content refresh achieved by the display screen through high-frequency on and off changes within the time range of one frame. The intuitive manifestation is the total brightness or total energy of a single lamp bead within one frame. The 256-level grayscale means that the lamp bead has 256 different brightness within one frame. This brightness progresses from full brightness to dark and is divided into 256 levels, that is, the grayscale level of the display screen is 256 levels, and its level value is 256. The human eye's perception of the brightness change of the lamp bead is not linear, but nonlinear. The sensitive change from bright to dark basically follows a curve called the gamma curve (such as Figure 3 To select the appropriate grayscale on this gamma curve, the lamp bead needs to select the appropriate grayscale from a larger grayscale range. That is, the 256-level grayscale of the lamp bead is selected from the 65536-level grayscale.

[0069] The present application proposes to call 65536 grayscale levels as basic grayscale, and select 256 grayscale levels from them as calling grayscale. Furthermore, when refreshing the first level calling grayscale, the basic grayscale that can be selected can be biased, that is, not completely one-to-one corresponding. This is the basic idea of ​​grayscale deviation refresh proposed in the present application.

[0070] In this application, the stylus can detect the actual grayscale of the lamp beads, and the touch object is refreshed according to the control instruction. That is, when the screen refreshes a frame of data, as long as it can accurately express a certain grayscale and be recognized by the stylus, accurate coordinate transmission can be achieved. In some examples, the refresh strategy in this application may include a control instruction output by the interactive system, which is used to indicate that the current refresh content of the touch object is the position of the lamp beads.

[0071] In some embodiments, the lamp bead position may include the exact position of the lamp bead;

[0072] Specifically, the refresh content may include the rough position of the lamp bead and the precise position of the lamp bead. The present application may be applied to the case where the refresh content is the precise position of the lamp bead, that is, the position of the lamp bead may include the precise position of the lamp bead. In some examples, in the scenario where the rough position of the lamp bead and the precise position of the lamp bead are graded and sorted and then refreshed (positioning grading), the refresh order of the rough position of the lamp bead precedes the refresh order of the precise position of the lamp bead; after the rough position of the lamp bead is refreshed first, the touch object may gradually reduce the display area and gradually refresh to the precise position of the lamp bead where the current touch point of the stylus is located, and the present application is applicable to the refresh of the precise position of the lamp bead. In some examples, the precise position of the lamp bead may be the lamp bead coordinates, and the rough position of the lamp bead may include the module number to which the lamp bead belongs and / or the display area number to which the module belongs.

[0073] In one of the embodiments, the refresh strategy further includes a current display area confirmed based on the content of the previous refresh; the content of the previous refresh includes the rough position of the lamp beads.

[0074] Specifically, the refresh strategy in this application may also include the current display area confirmed based on the previous refresh content. As mentioned above, the refresh content of this refresh is the precise position of the lamp bead, while the previous refresh content may be the rough position of the lamp bead, that is, after the previous refresh content, the module number to which the lamp bead coordinates belong and / or the display area number on the module can be determined. That is, the current display area of ​​this refresh is determined.

[0075] Step 204 , analyzing the touch position information to obtain the actual grayscale of the lamp bead, and determining the current touch point position of the stylus pen based on the deviation between the actual grayscale of the lamp bead and the corresponding calibrated grayscale.

[0076] Specifically, the present application parses the touch position information transmitted by the stylus to obtain the actual grayscale of the lamp bead, and then determines the current touch point position of the stylus based on the deviation between the actual grayscale of the lamp bead and the corresponding calibrated call grayscale.

[0077] In one embodiment, the calibration call grayscale is selected from the basic grayscale sequence according to the gamma curve.

[0078] Specifically, the selection and distribution of the call grayscale on the basic grayscale follows the gamma curve, which can take into account the differences in sensitivity of the human eye to different brightness. Take 256 levels of grayscale as an example, that is, the 256 levels of grayscale in this application are not arranged at equal intervals on the 65536 levels of grayscale, but are selected at 65536 levels according to different intervals, with gamma as an important basis. Furthermore, the call grayscale can be used as a reference (i.e., calibrated call grayscale) to make slight grayscale deviations, so that the position information corresponds to the deviation.

[0079] In one embodiment, the lamp bead position may include the precise position of the lamp bead; the deviation is a grayscale difference that satisfies a preset corresponding relationship with the precise position of the lamp bead;

[0080] The steps of determining the current contact point position of the stylus pen based on the deviation between the actual grayscale of the lamp bead and the calibrated grayscale include:

[0081] Get the grayscale difference between the actual grayscale of the lamp bead and the grayscale called by the calibration, query the precise position of the lamp bead corresponding to the grayscale difference in the preset corresponding relationship, and determine the precise position of the lamp bead as the current contact position.

[0082] Specifically, the deviation may refer to a grayscale difference; in the present application, each grayscale difference is respectively related to the precise position of the lamp bead and satisfies a preset corresponding relationship.

[0083] Taking a single lamp bead with 256 levels of grayscale as an example, the grayscale will change differently between different frames, or the same grayscale can be maintained and continuously refreshed between frames. In short, for the current frame, the grayscale of the displayed content is uncertain, but the lamp bead has a certain value compared to the origin on the module, that is, the position of the lamp bead will not change. Based on this, the present application proposes that for each lamp bead, when refreshing an arbitrary grayscale, there will be an identical deviation corresponding to its position, which is used to correspond to the exact position of the current lamp bead. In some embodiments, for the first level of grayscale, there are 255 deviations up and down, and then all of these 255 deviations can be applied to the position correspondence of the lamp bead. In this way, when the lamp bead refreshes the first level of grayscale, it can express at least 255 types of position coordinates.

[0084] For the convenience of calculation and explanation, we will take the example that the lamp bead will have 255 coordinates under a single grayscale. Take the 16384-level grayscale as the calibration call grayscale as an example, that is, when the reference grayscale 16384 is used as the call grayscale of the lamp bead at the nth level for the content display of the lamp bead, if the actual grayscale detected by the stylus is not 16384, but 16383, the distance to the call grayscale is a negative deviation, that is, the deviation is -1. At this time, it can be agreed that it corresponds to the coordinate (1,1), which is the precise coordinate of the lamp bead. Of course, the aforementioned module encoding, identification area, etc. are determined separately.

[0085] Specifically, Figure 4 As shown, 16384 is the calibrated grayscale for the nth grayscale, that is, when the lamp bead expresses this grayscale, it uses the 16384 grayscale as the standard to call the grayscale. When the lamp bead calls this grayscale, it expresses it by being "constantly on" for 16 time slots. However, when the stylus pen detected the lamp bead, it found that the lamp bead was not constantly on for 16 time slots, but was constantly on for 16 and 1 / 1024 time slots, so compared with the calibrated grayscale, the lamp bead produced a deviation of 1 unit. Compared with the constant on of 16 time slots, the minimum grayscale is increased by one unit, which is equivalent to a +1 deviation. It can be agreed that the +1 deviation corresponds to another coordinate.

[0086] Furthermore, Figure 4 The control instruction in the touch object is used to refresh the current content of the 16 and 1 / 1024 time slots. In some embodiments, the control instruction includes a binary number of preset bits corresponding to the lamp bead data, and the binary number of preset bits can be determined based on the grayscale level of the touch object; Figure 4 As shown, the control instruction uses a 16-bit binary number, and the 16-bit binary number is determined based on the 256-level grayscale used by the touch object.

[0087] In one of the embodiments, in the preset corresponding relationship, the grayscale difference value includes the difference between the first number of basic grayscales obtained sequentially along the numerical increasing direction of the basic grayscale sequence with the calibrated call grayscale as the reference and the calibrated call grayscale, and the difference between the second number of basic grayscales obtained sequentially along the numerical decreasing direction of the basic grayscale sequence with the calibrated call grayscale and the calibrated call grayscale.

[0088] Specifically, if Figure 5 As shown, the deviation value (grayscale difference) allowed by the calibration call grayscale in this application is within a certain range. Among them, in the preset corresponding relationship of this application, the grayscale difference value may include the difference between the first number of basic grayscales obtained in sequence along the numerical increasing direction of the basic grayscale sequence with the calibration call grayscale, and the grayscale difference value may also include the difference between the second number of basic grayscales obtained in sequence along the numerical decreasing direction of the basic grayscale sequence with the calibration call grayscale.

[0089] In one embodiment, the first number is 1 less than the second number, and the sum of the first number and the second number is 1 less than the gray level of the touch object.

[0090] Specifically, if Figure 5As shown, the preset correspondence in this application includes the subdivision agreement of grayscale. For example, at the nth grayscale, the allowed deviation reaches a span of 255 levels, with 16384 as the reference (calibrated call grayscale), down to 16128 (first number), up to 16640 (second number), the reference grayscale under this span can be selected as the nth call grayscale, which is used for the content display of the lamp bead at the nth level. Furthermore, at the nth level, there can be a variety of different correspondences that can correspond to the lamp bead coordinates.

[0091] In one embodiment, the precise position of the lamp bead may include the coordinates of the lamp bead; the refresh strategy includes using a single frame to display the actual grayscale of the lamp bead;

[0092] In the preset corresponding relationship, each grayscale difference value corresponds to a lamp bead coordinate.

[0093] Specifically, the present application can use a single-frame display method to transmit the actual grayscale of the lamp beads. Taking 256 grayscale levels as an example, if a reference coordinate is refreshed in a single frame, the precise coordinates of the lamp beads in a 15x15 area can be refreshed. That is, a single-frame refresh can utilize 225 grayscale differences, and each grayscale difference corresponds to a coordinate on the fine coordinates. From (1,1) to (15,15), there are a total of 225 coordinates, and the area range is 15x15 in size. The present application can achieve precise positioning of lamp beads in a range of 15x15.

[0094] In one embodiment, the precise position of the lamp bead may include the coordinates of the lamp bead; the refresh strategy includes using odd and even frames to alternately display the actual grayscale of the lamp bead;

[0095] In the preset corresponding relationship, the grayscale difference of the odd-numbered frames corresponds to the X-axis coordinate value of the lamp bead coordinates, and the grayscale difference of the even-numbered frames corresponds to the Y-axis coordinate value of the lamp bead coordinates.

[0096] Specifically, the present application can use the method of alternating odd and even frames to transmit the actual grayscale of the lamp beads. Taking the 256 grayscale levels as an example, if refreshed according to the odd and even frames, the precise coordinates of the lamp beads in a 255x255 area can be refreshed. In the process of alternating odd and even frames, the present application can use the odd frame as the X-axis coordinate position refresh of the lamp bead, one offset corresponds to one X-axis coordinate, and the even frame as the Y-axis coordinate position refresh of the lamp bead, one offset corresponds to one Y-axis coordinate.

[0097] In some examples, the present application utilizes the process of alternating transformation of odd frames and even frames, and the even frames can also be used as the X-axis coordinate position refresh of the lamp bead, with one offset corresponding to one X-axis coordinate, and the odd frames can be used as the Y-axis coordinate position refresh of the lamp bead, with one offset corresponding to one Y-axis coordinate.

[0098] In the above screen refresh positioning method, since the position of the lamp beads is fixed, no matter what grayscale the lamp beads refresh, there will be the same deviation compared to the basic grayscale, so that when the lamp beads display any grayscale, their position coordinates can be accurately refreshed, and the impact on the displayed content is small. Furthermore, when the screen of the present application refreshes a frame of data, as long as it can accurately express a certain grayscale and be recognized by the stylus, accurate coordinate transmission can be achieved.

[0099] It should be noted that the present application has high data analysis requirements for the display system or stylus, that is, the display system or stylus needs to be able to accurately capture and read the determined grayscale of the lamp beads, based on which accurate coordinate positioning can be achieved. At the same time, when refreshing the displayed content, it will not affect it. As for the need for the stylus to have an extremely high sampling rate, it can be seen from the above examples that the smallest unit of different grayscale deviations is only 1 / 1024 time slots. If the stylus is to be able to distinguish the length of such a time slot, the sampling rate of the stylus needs to be at least 3932160 frequency sampling, that is, nearly four million times per second. The means used to achieve such a high-frequency touch sampling will not be further discussed here. In fact, this sampling accuracy can be simplified. As long as the control instruction is changed from 16 bits to 12 bits or 8 bits, the deviation span of the grayscale can be widened, thereby reducing the sampling frequency of the stylus.

[0100] It should be understood that although Figure 2 , 4 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 2 , 4 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0101] In one embodiment, Figure 6 As shown, a screen refresh positioning device is provided, comprising:

[0102] The information acquisition module 610 is used to acquire touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes a control instruction for indicating that the current refresh content of the touch object is the lamp bead position; the lamp bead data includes the actual grayscale of the lamp bead used to express the lamp bead position;

[0103] The position determination module 620 is used to analyze the touch position information to obtain the actual grayscale of the lamp bead, and determine the current touch point position of the stylus pen based on the deviation between the actual grayscale of the lamp bead and the corresponding calibrated grayscale.

[0104] In one embodiment, the lamp bead position includes the precise position of the lamp bead; the deviation is the grayscale difference that satisfies a preset corresponding relationship with the precise position of the lamp bead;

[0105] The position determination module 620 is used to obtain the grayscale difference between the actual grayscale of the lamp bead and the calibrated grayscale, query the precise position of the lamp bead corresponding to the grayscale difference in the preset corresponding relationship, and determine the precise position of the lamp bead as the current contact position.

[0106] In one of the embodiments, the precise position of the lamp bead includes the coordinates of the lamp bead; the refresh strategy includes using a single frame to display the actual grayscale of the lamp bead; in the preset corresponding relationship, each grayscale difference corresponds to a lamp bead coordinate.

[0107] In one of the embodiments, the precise position of the lamp bead includes the coordinates of the lamp bead; the refresh strategy includes using odd and even frames to alternately display the actual grayscale of the lamp bead; in the preset corresponding relationship, the grayscale difference of the odd frames corresponds to the X-axis coordinate value of the lamp bead coordinates, and the grayscale difference of the even frames corresponds to the Y-axis coordinate value of the lamp bead coordinates.

[0108] In one of the embodiments, the refresh strategy further includes a current display area confirmed based on the content of the previous refresh; the content of the previous refresh includes the rough position of the lamp beads.

[0109] In one of the embodiments, the calibration call grayscale is selected from the basic grayscale sequence based on the gamma curve; in the preset corresponding relationship, the grayscale difference value includes the difference between the calibration call grayscale and the first number of basic grayscales sequentially obtained along the numerical increasing direction of the basic grayscale sequence based on the calibration call grayscale, and the difference between the calibration call grayscale and the second number of basic grayscales sequentially obtained along the numerical decreasing direction of the basic grayscale sequence based on the calibration call grayscale.

[0110] In one embodiment, the control instruction includes a binary number of preset bits corresponding to the lamp bead data; the binary number of preset bits is determined based on the grayscale level of the touch object; the first number is 1 less than the second number, and the sum of the first number and the second number is 1 less than the grayscale level of the touch object.

[0111] For the specific definition of the screen refresh positioning device, please refer to the definition of the screen refresh positioning method above, which will not be repeated here. The various modules in the above-mentioned screen refresh positioning device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0112] In one embodiment, a display device is provided, the display device comprising a display screen and a control device;

[0113] Among them, the display screen serves as the touch object of the stylus; and the control device is used to execute the steps of the above-mentioned screen refresh positioning method.

[0114] In one embodiment, the display screen may be an LED display screen.

[0115] Specifically, in the present application, the stylus pen can interact with the display screen through the control device to achieve low-latency screen refresh positioning. The control device can be independently set up with the display screen, or integrated into a display device.

[0116] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned screen refresh positioning method are implemented.

[0117] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0118] In the description of this specification, the description with reference to the terms "some embodiments", "other embodiments", "ideal embodiments", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic descriptions of the above terms do not necessarily refer to the same embodiment or example.

[0119] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0120] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A screen refresh positioning method, characterized in that: include: Acquire touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; The refresh strategy includes a control instruction for indicating that the current refresh content of the touch object is the position of the lamp bead; the lamp bead data includes the actual grayscale of the lamp bead for expressing the position of the lamp bead; The touch position information is parsed to obtain the actual grayscale of the lamp bead, and the current touch point position of the stylus pen is determined based on the deviation between the actual grayscale of the lamp bead and the corresponding calibrated call grayscale.

2. The screen refresh positioning method according to claim 1, characterized in that: The lamp bead position includes the precise position of the lamp bead; the deviation is the grayscale difference that satisfies a preset corresponding relationship with the precise position of the lamp bead; The step of determining the current contact point position of the stylus pen based on the deviation between the actual grayscale of the lamp bead and the calibrated grayscale includes: The grayscale difference between the actual grayscale of the lamp bead and the calibrated grayscale is obtained, the precise position of the lamp bead corresponding to the grayscale difference in the preset corresponding relationship is queried, and the precise position of the lamp bead is determined as the current contact position.

3. The screen refresh positioning method according to claim 2, characterized in that: The precise position of the lamp bead includes the coordinates of the lamp bead; the refresh strategy includes using a single frame to display the actual grayscale of the lamp bead; In the preset corresponding relationship, each grayscale difference value corresponds to a lamp bead coordinate.

4. The screen refresh positioning method according to claim 2, characterized in that: The precise position of the lamp bead includes the lamp bead coordinates; the refresh strategy includes using odd and even frames to alternately display the actual grayscale of the lamp bead; In the preset corresponding relationship, the grayscale difference of the odd-numbered frames corresponds to the X-axis coordinate value of the lamp bead coordinates, and the grayscale difference of the even-numbered frames corresponds to the Y-axis coordinate value of the lamp bead coordinates.

5. The screen refresh positioning method according to any one of claims 2 to 4, characterized in that: The refresh strategy also includes a current display area confirmed based on the previous refresh content; the previous refresh content includes the rough position of the lamp beads.

6. The screen refresh positioning method according to claim 2, characterized in that: The calibration call grayscale is selected from the basic grayscale sequence according to the gamma curve; In the preset corresponding relationship, the value of the grayscale difference includes the difference between the first number of basic grayscales obtained sequentially along the numerical increasing direction of the basic grayscale sequence with the calibration call grayscale as the reference and the difference between the calibration call grayscale and the second number of basic grayscales obtained sequentially along the numerical decreasing direction of the basic grayscale sequence with the calibration call grayscale as the reference and the difference between the calibration call grayscale.

7. The screen refresh positioning method according to claim 6, characterized in that: The control instruction includes a binary number of preset digits corresponding to the lamp bead data; the binary number of preset digits is determined based on the grayscale level of the touch object; The first number is smaller than the second number by 1, and the sum of the first number and the second number is smaller than the grayscale level of the touch object by 1.

8. A screen refresh positioning device, characterized in that: include: An information acquisition module, used to acquire touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; The refresh strategy includes a control instruction for indicating that the current refresh content of the touch object is the position of the lamp bead; the lamp bead data includes the actual grayscale of the lamp bead for expressing the position of the lamp bead; The position determination module is used to parse the touch position information to obtain the actual grayscale of the lamp bead, and determine the current touch point position of the stylus pen based on the deviation between the actual grayscale of the lamp bead and the corresponding calibrated call grayscale.

9. A display device, characterized in that: The display device comprises a display screen and a control device; Wherein, the display screen serves as a touch object of the stylus; and the control device is used to execute the steps of the method described in any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images