Screen refresh positioning method, device, display device and storage medium

Abstract

The present application relates to a screen refresh positioning method, device, display device and storage medium. The screen refresh positioning method includes: obtaining touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes the current refresh content of the touch object including the lamp bead position; the lamp bead data includes the lamp bead working state used to express the lamp bead position; identifying the touch position information and determining the current contact point position of the stylus. The present application transmits the information of the stylus stop position on the display screen through the dynamic refresh of the screen, which can realize screen touch at a low cost.

Description

Technical Field

[0001] The present application relates to the field of touch interaction technology, and in particular to a screen refresh positioning method, device, display device and storage medium. Background Art

[0002] For LED (Light-Emitting Diode) displays that are hundreds of inches in size, the lowest cost way to achieve touch control is to use an infrared touch frame. Including an infrared touch frame and a stylus, the method is to place a series of infrared probes on the edge of the screen. The probes will illuminate the tip of the stylus and produce reflections. By detecting the reflected light from different probes, the exact coordinates of the current landing point are calculated. However, with the infrared touch frame method, when the emitted light is blocked, the touch function will be lost, and the touch sensitivity at the edge of the screen is low. The position of the probe installed at the edge of the screen is also difficult to ignore, and the large black edge of the screen edge cannot be avoided.

[0003] Other display touch solutions, including capacitive, vector pressure sensing, surface acoustic wave, metal mesh, piezoresistive and infrared, are generally limited by the contradiction between cost and full-size control, and it is difficult to achieve full-size touch screen control with low latency at low cost. In other words, in the implementation process, it is found that there are at least the following problems in traditional technologies: the current touch method has the problem of high cost. Summary of the invention

[0004] Based on this, it is necessary to provide a screen refresh positioning method, device, display device and storage medium that can reduce costs in response to the above technical problems.

[0005] In order to achieve the above-mentioned purpose, on the one hand, an embodiment of the present application provides a screen refresh positioning method, including:

[0006] Acquire touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes the current refresh content of the touch object including the lamp bead position; the lamp bead data includes the lamp bead working status used to express the lamp bead position;

[0007] Identify the touch position information and determine the current touch point position of the stylus.

[0008] In one embodiment, the current refresh content also includes display content; the working state of the lamp beads includes the on and off state of the lamp beads at a preset time slot in a frame;

[0009] The steps of identifying the touch position information and determining the current touch point position of the stylus include:

[0010] Encode the on and off status of the lamp beads in the preset time slots in a frame to obtain binary numbers;

[0011] Process the binary number and use the obtained lamp bead position as the current touch point position of the stylus.

[0012] In one of the embodiments, the remaining time slots in a frame except the preset time slots are used to express display content; wherein each time slot in the preset time slots is inserted into the remaining time slots at equal intervals.

[0013] In one embodiment, the lamp bead position includes a rough lamp bead position and an accurate lamp bead position; the lamp bead data is time slot data of a single lamp bead in a frame; the refresh strategy also includes that the current refresh content of the touch object is a continuous preset number of video frames;

[0014] The first frame of the continuous preset number of video frames is used to express the rough position of the lamp bead; the last two frames of the continuous preset number of video frames are used to express the X-axis coordinates and Y-axis coordinates of the precise position of the lamp bead respectively.

[0015] In one of the embodiments, the precise position of the lamp bead is the lamp bead coordinates; the rough position of the lamp bead includes the module number to which the lamp bead belongs and / or the display area number to which the module belongs; and the number of consecutive preset number of video frames is 3 frames.

[0016] In one embodiment, the lamp bead position includes a rough lamp bead position and a precise lamp bead position; the lamp bead data is time slot data of each lamp bead in a single pixel in the same frame;

[0017] One lamp bead in a single pixel is used to express the rough position of the lamp bead; the other two lamp beads in a single pixel are used to express the X-axis coordinate and Y-axis coordinate of the precise position of the lamp bead respectively.

[0018] In one embodiment, before the step of identifying the touch position information and determining the current touch point position of the stylus, the step further includes:

[0019] If a frame change mark is detected in the frame header of the lamp bead data, it is confirmed that the touch object has completed the frame change at the current touch acquisition moment of the stylus.

[0020] A screen refresh positioning device, comprising:

[0021] The information acquisition module is used to acquire touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes the current refresh content of the touch object including the lamp bead position; the lamp bead data includes the lamp bead working status used to express the lamp bead position;

[0022] The identification and positioning module is used to identify the touch position information and determine the current touch point position of the stylus.

[0023] A display device, the display device comprising a display screen and a control device;

[0024] Among them, the display screen serves as the touch object of the stylus; and the control device is used to execute the steps of the above method.

[0025] A computer-readable storage medium stores a computer program, which implements the steps of the above method when executed by a processor.

[0026] One of the above technical solutions has the following advantages and beneficial effects:

[0027] The touch position information obtained by this application is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes the current refresh content of the touch object including the lamp bead position; the lamp bead data includes the lamp bead working state used to express the lamp bead position; and then by identifying the touch position information, the current contact point position of the stylus can be determined. This application transmits the information of the stylus stop position on the display screen through the dynamic refresh of the screen, so that the current stop position coordinates can be calculated based on the currently intercepted information, and the screen touch can be realized at a low cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0029] Figure 1 A diagram showing an application environment of a screen refresh positioning method in an embodiment;

[0030] Figure 2 A schematic diagram of a flow chart of a screen refresh positioning method in one embodiment;

[0031] Figure 3 A schematic diagram of the principle of a stylus pen in one embodiment;

[0032] Figure 4 A schematic diagram of a touch object refresh feature in one embodiment;

[0033] Figure 5 This is a schematic diagram of lamp bead data of a single lamp bead in one frame in one embodiment;

[0034] Figure 6 This is a schematic diagram of lamp bead data of a single pixel in one frame in one embodiment;

[0035] Figure 7A schematic diagram of a flow chart of a screen refresh positioning method in another embodiment;

[0036] Figure 8 A schematic diagram of frame header marking characteristics of sampling a single lamp bead in one embodiment;

[0037] Fig. 9 A schematic diagram of a frame header marking feature of a single pixel sample in one embodiment;

[0038] Fig.10 FIG. 4 is a structural block diagram of a screen refresh positioning device in one embodiment. DETAILED DESCRIPTION

[0039] In order to facilitate understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. Embodiments of the present application are provided in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.

[0040] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.

[0041] It can be understood that the terms "first", "second", etc. used in the present application can be used in this article to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish the first element from another element.

[0042] Spatially relative terms such as "under," "beneath," "below," "under," "above," "above," and the like may be used herein to describe the relationship of an element or feature shown in the figures to other elements or features. It should be understood that, in addition to the orientations shown in the figures, spatially relative terms also include different orientations of the device in use and operation. For example, if the device in the accompanying drawings is flipped, an element or feature described as "under other elements" or "under it" or "under it" will be oriented as being "above" the other elements or features. Thus, the exemplary terms "under" and "under" may include both upper and lower orientations. In addition, the device may also include additional orientations (e.g., rotated 90 degrees or other orientations), and the spatial descriptors used herein are interpreted accordingly.

[0043] It should be noted that when an element is considered to be "connected" to another element, it can be directly connected to the other element, or connected to the other element through an intermediate element. In addition, the "connection" in the following embodiments should be understood as "electrical connection", "communication connection", etc. if there is transmission of electrical signals or data between the connected objects.

[0044] When used herein, the singular forms "a", "an", and "said / the" may also include plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "include / comprise" or "have" and the like specify the presence of stated features, wholes, steps, operations, components, parts, or combinations thereof, but do not exclude the possibility of the presence or addition of one or more other features, wholes, steps, operations, components, parts, or combinations thereof. At the same time, the term "and / or" used in this specification includes any and all combinations of the relevant listed items.

[0045] The screen touch of LED display has always been limited by three major problems. The first is that to achieve screen touch of full-size LED display, it requires a lot of hardware cost, and the control of these hardware occupies a lot of system memory. The second is that the touch of large-size display screens must maintain low latency, that is, the time taken to complete a touch interaction must be extremely low. The third is the layout and hiding of touch sensors to reduce the gaps on the screen surface and the possible impact on the display quality of the display.

[0046] The traditional solution for external infrared borders is to set up infrared dual-tube sensors on the edge of the screen, and use infrared light and reflections to detect the touch input position on the screen surface. However, there are at least the following problems: ① A certain position must be reserved at the edge of the screen for the placement of the infrared dual-tube sensor and its module, and the screen will always have a black border. ② At the edge of the screen, since the difference between the outgoing light and the incident light is small, the touch sensitivity is relatively lower than in the middle, and the sensitivity is not consistent across the entire screen. ③ Under different construction environments, it may happen that after the infrared light is blocked and reflected back, the touch demand behind it is blocked.

[0047] In other traditional solutions, vector pressure sensors, that is, fine strain gauges, are used to provide feedback on the screen touch coordinates, so many strain gauges need to be installed on the entire screen; metal grids are used, and the grids attached to the screen surface will cause screen occlusion; and it is difficult to achieve low-latency interaction using capacitive control. Various screen touch methods have defects on LED display screens. For touch interaction, the core work is to determine the position coordinates of the touch point relative to the screen. The method of determining the touch point coordinates is the primary problem to be solved in touch interaction, and it is also the primary problem for LED display screens to achieve touch interaction. In addition, the processing technology of the packaging structure of high-resolution LED display screens has extremely high requirements for consistency. Easily changing the characteristics of its internal components can easily reduce the display quality of the screen.

[0048] In this regard, the present application proposes a screen refresh positioning scheme implemented by the interpolation method, which does not require significant changes to the screen structure. It only needs to follow the corresponding refresh strategy to realize screen touch interaction under the operation of the stylus, with low cost and low latency. This scheme can be based on the existing display screen packaging form, suitable for LED display screens, can realize display touch, and has extremely low cost and consistent full-size touch sensitivity. This touch positioning scheme utilizes the high-speed dynamic refresh feature of the screen to insert the data required for the interaction, such as the reference coordinate position, into the screen to be refreshed, occupying part of the screen refresh time to refresh the reference coordinate position information. At the same time, in conjunction with a stylus that can collect refresh features, the current touch position information is collected at a corresponding sampling frequency, and the collected information is then sent back to the interactive system to realize content interaction on the display screen.

[0049] The present application has a low requirement for the sampling frequency of the stylus, and has a relatively small impact on the display of the screen (within a range that is difficult for the human eye to detect), which can reduce screen delay. The basic ideas of the present application include: the lamp beads or pixels refresh N time slots in a frame, and a part of the time slots can be extracted and fixed to refresh the position coordinates of the lamp beads, which can reduce costs while significantly reducing screen delay. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application and are not used to limit the present application.

[0050] The screen refresh positioning method provided in this application can be applied to Figure 1In the application environment shown. Among them, the interactive system is used for touch interaction of the display screen. The screen continuously refreshes the display screen at an extremely high refresh rate, and the stylus obtains the screen information at a corresponding sampling frequency. Specifically, the display screen keeps refreshing at a high speed, and the refreshed content can be divided into two parts of features, one is the display content, and the other is the interactive information. The stylus records the working status of the display screen in each refresh time segment at a certain sampling rate, and obtains the information used for interaction through direct or indirect feature recognition, such as lamp bead coordinates, offset distance, moving speed, etc. That is, by utilizing the high-speed refresh capability of the display screen and the low frame rate difference of the video source, low-latency touch interaction of the screen can be achieved.

[0051] Figure 1 The interactive system in can be an independent control system, which is used to configure the corresponding refresh strategy (for example, control instructions) for the display screen and interact with the stylus; in some examples, the interactive system can also be a system including a display device including a screen and a control device and a stylus, and then the stylus interacts with the control device in the display device. In addition, the control device can be independent of the screen setting, or it can belong to the same display device as the screen. The control device can be used to configure the corresponding refresh strategy (for example, control instructions) for the display screen and interact with the stylus. Among them, the screen refresh positioning method of the present application can be applied in the interactive system, in the control device, and in the stylus (the stylus collects and parses the touch position information, feeds back the corresponding refresh strategy, etc., that is, the stylus performs touch operations while interacting with the screen).

[0052] It should be noted that the touch object may include a display screen; the display screen may be a liquid crystal display screen or an electronic ink display screen; in some embodiments, the display screen may be an LED display screen. Furthermore, the display screen may be implemented based on existing miniLED, microLED (micrometer light emitting diode) or SMD (Surface Mounted Devices) packaged LED (i.e., surface mount packaged structure LED) with surface enhancement treatment, without requiring significant changes to the screen structure.

[0053] In one embodiment, Figure 2 As shown, a screen refresh positioning method is provided, which is applied to Figure 1 The interactive system or stylus in the example is used to illustrate, including the following steps:

[0054] Step 202, obtaining touch position information.

[0055] Among them, the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes the current refresh content of the touch object including the lamp bead position; the lamp bead data includes the lamp bead working status used to express the lamp bead position.

[0056] Specifically, the stylus may refer to a device for performing touch interaction with a touch object. In some examples, the stylus may be a pen-shaped tool used to input instructions to a computer screen, a mobile device, a drawing board, or other device with a touch screen, and a user may select a file or draw a picture by clicking the touch screen with the stylus. It should be noted that the stylus is only for the purpose of illustration, and in actual applications, a high-speed sampling device capable of performing touch interaction with a touch object may also be used to implement the high-speed sampling device, such as a stylus, a lens, or other device.

[0057] The touch object (for example, the display screen) is sampled by the stylus, and the data may be the light of the lamp beads in the display screen. In some examples, the data sampling may be obtained by monitoring the on-off state of the display screen at a higher frequency through the stylus, that is, the screen touch is realized by detecting the on-off state of the lamp beads. It should be noted that, taking the display screen as an LED screen as an example, when the LED screen displays the content of the picture, it does not realize the content display by changing the constant on of the lamp beads, but by the high-frequency on-off change of the lamp beads to reflect the difference of different contents, and this display feature is called dynamic scanning, which is an important display feature of the LED display screen. Under the dynamic scanning drive, for a single lamp bead, it will not remain in a constant on state, but will change at a very high frequency, and realize different content display in the alternation of on and off. The light effect displayed by the lamp beads through high-frequency on-off alternation is from on to off, progressive layer by layer, and the final effect is called grayscale. The grayscale used by the LED lamp beads from on to off usually has 256 levels, and there are 3 lamp beads on a single pixel, namely red, green and blue lights. The three lamp beads achieve different color displays through different brightness ratios. Therefore, when the LED display screen displays the picture, for a single lamp bead, it mainly relies on grayscale refresh.

[0058] In order to ensure the uniform and stable changes in color and brightness, the LED display screen will increase the screen grayscale refresh rate as much as possible. Usually, an LED display screen can achieve a screen refresh rate of 3840HZ, which means that when playing a 60HZ display screen, each frame of the screen will be reflected by 64 refreshes of the LED display screen. And these 64 refreshes are grayscale refreshes. It can be seen that the screen refresh capacity of the LED display screen is much higher than the video source information.

[0059] Among them, the lamp bead data can be obtained in the following way: the lighting component in the stylus collects the touch object, and after obtaining the light of the lamp bead, it can be processed in sequence by the light on and off component, photosensitive module and data processing module in the stylus, and then converted into a readable data stream for the interactive system to handle. For example, the display screen refreshes 3840 times per second, and the stylus achieves at least 3840 data sampling per second. The sampled data is processed and analyzed to obtain accurate coordinates or reference offsets during movement, and fed back to the interactive system to update the display data of the next frame. Among them, the specific values ​​are not limited.

[0060] Furthermore, the lamp bead data can be obtained by sampling a single lamp bead and / or a single pixel through a stylus. The light-on / off component in the stylus can be turned on when there is light, so that the light can enter the photosensitive module; wherein, the light-on / off component can refer to a device for controlling the time of light irradiating the photosensitive element, and the on / off clock of the light-on / off component can be consistent with the refresh clock of the touch object (for example, a display screen). In some examples, the light-collecting component can be implemented by a light-collecting lens, the light-on / off component can be implemented by an exposure valve, and the photosensitive module can be implemented by a photosensitive module, that is, a photosensitive sensor (for example, a photosensor); and when collecting a single pixel, the photosensitive module can include multiple photosensitive sensors, and the stylus can include an optical splitter module connected between the light-on / off component and the photosensitive module, the optical splitter module divides the light into red, green, and blue light, and respectively irradiates the light into multiple photosensitive modules included in the photosensitive module, so that a single exposure detection of the light-on / off component can simultaneously detect the on / off status of the three lamp beads on a single pixel, and the lamp bead detection is more efficient. In some examples, the light splitting module can be implemented by using a light splitting refracting lens. In addition, the stylus pen can also include a data sending module for communicating with the interactive system.

[0061] The interactive system realizes touch interaction with the stylus based on the dynamic refresh of the display screen (for example, the LED display screen). Among them, the working status of a single lamp bead in different time slots can specifically include the following two indicators: one is whether the lamp bead is emitting light, and the other is the time of emitting light, both of which can be recorded by the stylus. In addition, the sampling frequency of the stylus can correspond to the refresh frequency of the LED display screen. For the lamp bead, within a frame of time, for example, each time slot refresh will be recorded by the stylus. For the state and time of the lamp bead in this time slot, the corresponding digital signal code is output for processing by the corresponding system, and data content including the coordinates of the lamp bead, which is helpful for realizing screen interaction, is extracted from it.

[0062] It should be noted that the present application does not limit the specific structure of the stylus, and any stylus that can obtain the touch position information of the touch object at a high sampling rate can be used. In some examples, the stylus can be implemented as a lamp bead stylus and / or a pixel stylus.

[0063] Taking the LED display screen as an example, the lamp bead stylus is used to sample a single lamp bead, that is, the on and off of a single lamp bead can be judged by the stylus, and then the coordinates of the current lamp bead are collected. The working state of the lamp bead is on and off. When refreshing a frame of the picture, the working cycle of the lamp bead will be divided into 64 time segments, and the on and off state will be refreshed in these 64 time segments. This situation can be seen as the limited accuracy of the stylus in collecting pixels. It is impossible to identify the brightness state of the three lamp beads on a single pixel point, but the entire pixel point is judged as a whole lamp bead. It can also be seen as a high-quality display screen, the arrangement of the lamp beads on it is very fine, and the concept of pixels is composed of any three lamp beads of different colors (virtual pixel concept). Among them, the data read by the stylus can be the status data of a single lamp bead in these 64 time segments. That is, the information read by the stylus pen at one time is a time segment of a lamp bead within a frame time; and the structural style of the stylus pen can apply the structure of the lamp bead stylus pen exemplified above (including a lighting lens, an exposure valve, a photosensor, a data processing module, and a data sending module, etc.).

[0064] Taking the LED display screen as an example, the acquisition range of the pixel stylus is a single pixel point, that is, the on and off of the lamp bead on a single pixel point is judged by the stylus, and then the coordinates of the current pixel are collected. There are three lamp beads on a pixel point, namely red, green and blue lights. In this way, when the stylus stays just above a pixel point, it can collect the light of the red, green and blue lamp beads in the pixel. These three lamp beads will be refreshed 64 times when refreshing a frame of video. Here it is not simply 64 times of on and off, but it can be understood that the working time of the lamp bead in this frame, that is, 16.67ms, is divided into 64 working segments. For each working segment, the lamp bead has a corresponding working state (on, off). Three lamp beads have 192 working segments corresponding to the same time. The data read by the stylus is the status data of the three lamp beads in these 64 time segments. Specifically, the information read by the stylus at one time is the combination of the three time segments of the three lamp beads refreshed in the same frame.

[0065] It should be noted that, based on the present application, in these 192 time segments, some of the lamp beads are used to display the screen content, and the other part is used to display the current coordinate information. Moreover, the time segment for displaying the current coordinate information is evenly distributed in the time segment for displaying the screen content.

[0066] Further, such as Figure 3 As shown, the pixel stylus can sample three lamp beads in a single pixel at a time, and use the light entering along the light path provided by the exposure valve as the incident light. The stylus can use a spectroscopic refractor to refract the red, green, and blue light onto three photosensitive sensors, respectively, and divide them into three signals, which are output to the stylus processing system respectively. Then, the stylus can read three frames of picture data within one frame of picture information. That is, the structure of the pixel stylus can be based on the aforementioned lamp bead stylus, and a spectroscopic refraction lens is further added. At the same time, three photosensitive sensors can be used.

[0067] The above two stylus collection methods correspond to different scenarios. From the perspective of time scale, when the screen refreshes a frame of video, it will be refreshed in 64 time segments, which can be as follows Figure 4 In some examples, for a lamp bead stylus, the information read by the stylus at one time is a time segment of a lamp bead within a frame time, and its format can be as follows: Figure 5 In some examples, for a pixel stylus, the information read by the stylus at one time is a combination of three time segments of three lamp beads refreshed in the same frame, and its form can be as shown in 6.

[0068] Furthermore, the touch object in the present application can be displayed according to a corresponding refresh strategy, and the refresh strategy can include the current refresh content of the touch object including the position of the lamp bead. The refresh mode in the present application can refer to the touch object sending high-speed data information in the form of lights on and off for corresponding durations through high-speed refresh to transmit position information based on the refresh strategy (for example, a drive strategy or a control strategy) provided by the interactive system. Furthermore, the position information can be collected by the stylus to obtain the touch position information. In some examples, the refresh mode can also limit the refresh content. For example, the refresh content can include the lamp bead position while including the display content. The lamp bead position can refer to the rough position of the lamp bead and the precise position of the lamp bead.

[0069] In one of the embodiments, the currently refreshed content also includes displayed content.

[0070] Specifically, in the interpolation refresh of the present application, the display screen maintains a high-speed refresh, and the content refreshed in the same period includes two parts: one part is the display content, and the other part is the interactive information. Specifically, taking the touch object as a display screen as an example, assuming that when the screen refreshes a frame of video source information, it is achieved by 64 high-frequency on and off, then 14 of them can be used for the interaction of the display screen, and the 14 times of on and off information are collected by the stylus, and the other 50 times are used to refresh the display content. After the stylus collects the 14 times of on and off information, it can obtain the current coordinate position from it, and feed the coordinates back to the display system. The display system refreshes the next screen information according to the feedback position coordinates, thereby completing the entire interactive process. It should be noted that the 14 times of interactive information are not completely separate from the display content information. Interactive information can be the second function of display information.

[0071] The lamp bead data in the present application includes the lamp bead working status used to express the position of the lamp bead. In some embodiments, the lamp bead working status may refer to the on and off status of the lamp bead. Taking a single lamp bead as an example, it is assumed that it is refreshed 64 times within a time segment of a frame, and its time slot distribution is a time ruler in terms of time length. In each small grid on this ruler, the lamp bead may refresh "always on" or "always off". In some time slots that enable work, the refresh feature is "low gray". Without considering a series of special cases where the low gray is post-order, low gray can be compared to a kind of always on. This application does not consider the enabling feature, but only starts from the "always on" time slot, thereby reducing the sampling frequency requirements of the stylus.

[0072] Step 204: Identify touch position information and determine the current touch point position of the stylus.

[0073] Specifically, after acquiring the touch position information, the lamp bead data in the touch position information can be identified to acquire the lamp bead position transmitted by the lamp bead data through the lamp bead working state, and then determine the current touch point position of the stylus.

[0074] In one of the embodiments, the working state of the lamp bead includes the on and off state of the lamp bead at a preset time slot in a frame;

[0075] The step of identifying the touch position information and determining the current touch point position of the stylus may include:

[0076] Encode the on and off status of the lamp beads in the preset time slots in a frame to obtain binary numbers;

[0077] Process the binary number and use the obtained lamp bead position as the current touch point position of the stylus.

[0078] Specifically, the collected on and off status of the lamp beads can be encoded to obtain a binary number for expressing the position coordinates. Taking the collection and encoding of data by the stylus as an example, when the state of the lamp bead is detected as "always on" or "low gray", the stylus outputs "1", and when the state of the lamp bead is detected as "always off", the stylus outputs "0". After 64 time slots are refreshed, the stylus can output a 64-bit binary number. In this way, as long as the stylus can collect the on and off status of the lamp beads, it can identify the lamp bead data used to express the position of the lamp beads. That is, the present application uses the on and off characteristics of the lamp beads in each time segment as a way to store information on the coordinates of the lamp beads.

[0079] Furthermore, the working state of the lamp bead in the present application may include the on and off state of the lamp bead in a preset time slot in a frame. The preset time slot may refer to a time slot at a fixed position; that is, the present application proposes refreshing N time slots of a single lamp bead or a single pixel in a frame, and a part of the N time slots may be extracted and fixedly used to refresh the position coordinates of the lamp bead.

[0080] In one of the embodiments, the remaining time slots in a frame except the preset time slots are used to express display content; wherein each time slot in the preset time slots is inserted into the remaining time slots at equal intervals.

[0081] Specifically, in a frame of data collected by the stylus pen, the frame of data includes two contents: display content and lamp bead position. A frame of data can specifically refer to the working status of N time segments (i.e., time slots) of the lamp bead within a time segment of a frame. Some fixed time slots in the frame of data are used to express the lamp bead position, and the remaining time slots are used to express the display content.

[0082] Each time slot in the preset time slot can be inserted into the remaining time slots at equal intervals, that is, the coordinate information can be inserted into the display information in a corresponding order or interval, and then the stylus can take out the working status of the lamp bead at the corresponding position as the position coordinate of the touch point according to the size of the interval.

[0083] In one embodiment, the lamp bead position may include a rough lamp bead position and an accurate lamp bead position; the lamp bead data may be time slot data of a single lamp bead in a frame; the refresh strategy may also include that the current refresh content of the touch object is a continuous preset number of video frames;

[0084] The first frame of the continuous preset number of video frames is used to express the rough position of the lamp bead; the last two frames of the continuous preset number of video frames are used to express the X-axis coordinates and Y-axis coordinates of the precise position of the lamp bead respectively.

[0085] Specifically, when the lamp bead data is the time slot data of a single lamp bead in a frame, the stylus can determine whether a lamp bead (or a complete pixel) is on or off with one sampling. Taking the example that the lamp bead has 64 time segments of working status within a frame, in these 64 time segments, the stylus can identify the lamp bead data used to express the position of the lamp bead, and then identify the coordinate information contained in the refresh content in the corresponding order or interval (the coordinate information is inserted into the display information in the corresponding order or interval). For example, the stylus can take out the last lamp bead status as the position coordinate of the touch point in every 6 refreshes thereafter.

[0086] Furthermore, for a frame of picture information, it can be refreshed by arranging in a corresponding order to collect a binary number of corresponding digits (for example, a binary number of ten digits), and the binary number of ten digits can be the position information of the touch point on the screen. The stylus sends the collected binary number of corresponding digits back to the display system to complete a touch feedback. The binary number of corresponding digits is sent to the display system, and its position coordinates can be interpreted in the following way:

[0087] The present application proposes that the current refresh content of the touch object is a continuous preset number of video frames, and the first frame in the continuous preset number of video frames is used to express the rough position of the lamp bead, and the last two frames in the continuous preset number of video frames are respectively used to express the X-axis coordinate and Y-axis coordinate of the precise position of the lamp bead.

[0088] Specifically, taking the touch object as a display screen as an example, the display screen is composed of several display modules, and there are a limited number of lamp beads on the display module. In view of the large number of lamp beads, the present application proposes to refresh the display data according to the strategy of a continuous preset number of video frames, that is, multiple frames of video playback. It should be noted that the multiple frames of video playback are not multiple refreshes on the screen. The video source refreshes the picture at a refresh rate of 60HZ, and the display screen refreshes at a screen display rate of 3840HZ. The relationship between the two is that one frame of the video source needs to be refreshed 64 times by the display screen to be realized.

[0089] The first frame in the continuous preset number of video frames is used to express the rough position of the lamp bead, and the last two frames in the continuous preset number of video frames are respectively used to express the X-axis coordinate and Y-axis coordinate of the precise position of the lamp bead; that is, the present application proposes an optimization of the screen refresh strategy, which can refresh the position of the lamp bead from coarse to fine to the stylus through continuous video frames without affecting the display quality.

[0090] In one embodiment, the precise position of the lamp bead can be the lamp bead coordinates; the rough position of the lamp bead includes the module number to which the lamp bead belongs and / or the display area number to which the module belongs; and the number of consecutive preset number of video frames can be 3 frames.

[0091] Specifically, the position of the lamp beads in this application can include the following coordinate expressions: ① module number + precise coordinates of the lamp beads on the module; ② module number + display area number on the module + precise coordinates in the display area. Specifically, take refreshing the display data according to the 3-frame strategy (i.e. 3 frames of video playback) as an example:

[0092] In the 10-bit data collected in the first frame, the first 8 bits can be used to encode the data, with a total of 255 types of encoding. The 9th bit can be used to distinguish whether it is on the top or bottom of the display. The 10th bit is used to distinguish whether it is on the left or right half based on the top and bottom of the display, thus reducing the number of lamp beads to 1 / 4 of the original.

[0093] In the 10-bit data collected in the second frame, all 10 bits are used to refresh the X coordinate of the lamp bead, and the upper limit of the decimal number is 1023, that is, there can be 1023 lamp beads on the X axis.

[0094] The 10-bit data collected in the third frame are all used to update the Y coordinate of the lamp bead. 1023 lamp beads can also be encoded on the Y axis.

[0095] Then, through the interaction of 3 frames, the present application can determine the exact coordinates of the touch point on the display screen (i.e., the lamp bead coordinates), including which module it belongs to. And it takes 50.01ms to determine the coordinates of this lamp bead. Considering that the screen receives the transmitted position coordinates, and then inserts the feedback display information into the refreshed picture, this picture with the display information is then transmitted to the screen through the transmission channel for refresh. This process also takes about 50ms. This means that the screen controls the pixels on the display screen, refreshes the current position coordinates, and then goes to the display screen for the first recognition and transmission, and then the display screen gives feedback. The time required for the whole process is about 100ms. During this period, the time delay loss caused by the secondary verification caused by the misjudgment of the stylus is not taken into account (the delay increases by 50ms for each misjudgment).

[0096] Furthermore, the present application also proposes a coordinate extraction method based on a single pixel; the aforementioned refresh format of multiple frames of data is used, which is inefficient in transmitting data from the display screen to the stylus; for example, if the screen wants to transmit the coordinates of a lamp bead, it needs to send 3 frames of data. This is because each frame of data can only store very limited position information, and one frame is not enough to mark out all the complete position information; in this regard, the present application also proposes a coordinate extraction method for a single pixel, which can optimize the acquisition of the stylus and improve the acquisition efficiency, so that even if the screen transmits position information to the stylus at a lower efficiency, the position transmission of the coordinate point can be completed within one frame (16.67ms).

[0097] In one embodiment, the lamp bead position includes a rough lamp bead position and a precise lamp bead position; the lamp bead data is time slot data of each lamp bead in a single pixel in the same frame;

[0098] One lamp bead in a single pixel is used to express the rough position of the lamp bead; the other two lamp beads in a single pixel are used to express the X-axis coordinate and Y-axis coordinate of the precise position of the lamp bead respectively.

[0099] Specifically, a single pixel includes three lamp beads (red light, green light, blue light) as an example. When the stylus samples the three lamp beads in a single pixel at a time, this method is used to read the position coordinates of the pixel point, which is simpler than the above-mentioned single lamp bead method. Taking a single pixel in the next 60 time segments, and also taking one lamp bead data collected every 6 time segments as the interactive information of the display screen as an example, this application can read three groups of data of red light, green light, and blue light at a time.

[0100] Furthermore, this application proposes that the data of the red light can be used as the module number and the distribution of pixels in the upper and lower, left and right positions of the module, the green light can be used as the encoding of the X-axis coordinate of the lamp bead, and the blue light data can be used as the encoding of the Y-axis coordinate of the lamp bead. That is, the stylus can return the specific coordinate information of the lamp bead by reading only one frame of data. After the display system receives the coordinate information and updates it to the screen, the delay of the entire process is reduced to 66.67ms. Among them, it only takes 16.67ms to use a single pixel to determine the coordinates.

[0101] In the above screen refresh positioning method, the on-off characteristics of the lamp beads in each time segment are used as the information storage method of the lamp bead coordinates. This application can be based on the existing LED display screen without any changes, just changing the screen refresh strategy, and then with a sampling and encoding stylus, the screen touch can be realized.

[0102] Based on the present application, as a touch-sensitive display screen, there is no need to prepare special coordinate refresh data for the screen. The main change that needs to be made on the screen is to change the order of the display signals passed into the screen during N refreshes (for example, 64 refreshes) to ensure that in the corresponding time segments, that is, those time segments used to express the coordinate positions of the pixels, the screen is refreshed to the required state of the lamp beads (on or off) for the segment. From the perspective of a whole frame of the video signal, the screen still uses these N time segments (for example, 64 time segments) to refresh the required state. Although the order has changed, the total amount is consistent. As long as you pay attention to avoid the long-term lighting or darkness of the lamp beads at the pixel point, it will not have much impact on the display quality of the lamp beads. In the present application, the coordinate data is also the data used for screen display, but in terms of order, it will be called as coordinate data, which has a dual meaning. This coordinate ranking only accounts for 23% of the overall ranking and can be adjusted by properly refreshing the display system.

[0103] The present application proposes to refresh N time slots of lamp beads or pixels in one frame, and a part of the time slots can be extracted and fixedly used to refresh the position coordinates of the lamp beads. However, in actual operation, the stylus can only determine whether the lamp beads are bright or dark, and cooperate with the timer to record the timestamp of data acquisition. For a single lamp bead, the update of a frame of picture is essentially the alternation of light and dark, and there is no substantial data difference (for example, frame header, frame tail). Obviously, when the stylus clicks on the screen, how to extract the accurate corresponding position refresh for expressing the contact position from these N refreshes for the encoding of the touch position becomes a problem. For example, how to synchronize the first handshake process between the stylus and the screen so that the stylus can determine which of the on and off of the screen are for displaying content and which are for feedback of coordinates. In this regard, in one embodiment, Figure 7 As shown, a screen refresh positioning method is provided, which is applied to Figure 1 The interactive system or stylus in the example is used to illustrate, including the following steps:

[0104] Step 702, obtaining touch position information.

[0105] Among them, the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes the current refresh content of the touch object including the lamp bead position; the lamp bead data includes the lamp bead working status used to express the lamp bead position.

[0106] Step 704: if it is detected that there is a frame change mark in the frame header of the lamp bead data, it is confirmed that the touch object has completed the frame change at the current touch acquisition moment of the stylus.

[0107] Step 706: Identify the touch position information and determine the current touch point position of the stylus.

[0108] Specifically, the present application proposes that when the screen refreshes a frame, the stylus can use the marking feature as a reference benchmark, and the stylus can use this to determine which time slots of the next or previous refresh are used to express the position coordinates and which time slots are used to express the display content. The marking feature in the present application can be the brightness of a special lamp bead within a single frame time when the operation is enabled, or the sampling rate of the stylus can be required to be at least twice the refresh rate of the screen, that is, 3840x2=7680. It is also possible to ignore the enabling feature and only start from the "always on" time slot to reduce the sampling frequency requirements of the stylus.

[0109] For example, if the lamp bead is refreshed 64 times in a frame, the stylus can output "1" when the lamp bead is detected as "always on" or "low gray", and output "0" when the lamp bead is detected as "always off". After the 64 time slots are refreshed, the stylus will output a 64-bit binary number. As long as the stylus can recognize the marking feature, it can accurately distinguish between the display content and the coordinate refresh, and then refresh the coordinates.

[0110] Specifically, when low gray is not taken into account, or when the sampling rate of the stylus pen is less than twice the screen refresh rate, the following marking feature scheme can be used: Taking the two acquisition methods of a single lamp bead or a single pixel as an example, different marking features can be used. When the stylus pen can only judge whether the lamp bead is on or off, there will only be two results for the lamp bead in each time state, namely, the lamp bead is on and the lamp bead is off. However, the time when the stylus pen clicks on the screen is random, and it does not click when a frame is switched. That is, when the stylus pen starts to receive the refresh data of the lamp bead, it does not know from which specific time segment to start the frame change of the video information. The time segment refresh of the frame change may occur in any of the above 64 segments.

[0111] In this regard, the present application proposes to mark the start feature of the above sequence, and refresh a mark feature when the screen changes frames. When the stylus recognizes the feature, it is determined that the screen has changed frames. Based on this feature, it can be determined which number of refreshes is the display screen content, and which number of refreshes is the coordinate information.

[0112] In some examples, the present application proposes to detect whether there is a frame change mark in the frame header of the lamp bead data before obtaining the touch point position. If a frame change mark is detected in the frame header of the lamp bead data, it is confirmed that the touch object has completed the frame change at the moment of the touch acquisition of the stylus. It should be noted that the specific implementation method of step 702 and step 706 can refer to the description of step 202 and step 204 in the previous text, which will not be repeated here.

[0113] In order to further explain the solution of the present application, two acquisition methods, a single lamp bead or a single pixel, are used as examples for the stylus pen, and are described in combination with specific examples:

[0114] For the stylus pen, a single lamp bead collection method is adopted, that is, the stylus pen can determine the on and off of a lamp bead (or a complete pixel) with one sampling. For example, within the time segment of a frame, the lamp bead can have 64 time segments of working status. Among these 64 time segments, the first four time segments can be used to execute on and off, representing the binary logic state of 0101, and 0101 can be used as the marking feature of this frame (that is, there is a frame change mark in the frame header). After the stylus recognizes 0101, it will mark the point, and the 60 time segments after 0101 can insert the coordinate information into the display information in a specific order or interval (for example, equal interval). For example, the stylus can take out the last lamp bead state as the position coordinate of the touch point in every 6 refreshes thereafter. Then, for the time segment of a frame, the division of labor for the on and off content can be as follows Figure 8 shown.

[0115] For the stylus, a single pixel acquisition method is used. That is, when the stylus samples three lamp beads in a single pixel at a time, the start mark feature of the frame change can be the red light, green light, and blue light in four time segments (that is, there is a frame change mark in the frame header):

[0116] In the first time segment, red is on, green is off, and blue is on;

[0117] In the second time segment, red turns off, green turns on, and blue turns off;

[0118] The third time segment, red on, green off, blue on;

[0119] In the fourth time segment, red turns off, green turns on, and blue turns off;

[0120] The above features are used as the start mark features of this frame. After the stylus collects the start mark features, it will record the status of the lamp beads in the corresponding time segment. Fig. 9 shown.

[0121] The above screen refresh positioning method, if the screen refresh rate is different, the sampling rate of the stylus is different, the above specific parameters may change, but the internal logic will not be essentially different. The example is only to introduce a screen refresh method for realizing touch control on a display screen (for example, an LED display screen). This application can be based on the existing LED display screen without making any changes, just changing the screen refresh strategy, and then using a sampling and encoding stylus to realize screen touch control.

[0122] It should be understood that although Figure 2 , 7 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 2 , 7 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0123] In one embodiment, Fig.10 As shown, a screen refresh positioning device is provided, comprising:

[0124] The information acquisition module 110 is used to acquire touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; the refresh strategy includes the current refresh content of the touch object including the lamp bead position; the lamp bead data includes the lamp bead working status used to express the lamp bead position;

[0125] The identification and positioning module 120 is used to identify touch position information and determine the current touch point position of the stylus.

[0126] In one embodiment, the current refresh content also includes display content; the working state of the lamp beads includes the on and off state of the lamp beads at a preset time slot in a frame;

[0127] The identification and positioning module 120 is used to encode the on and off states of the lamp beads at the preset time slots in a frame to obtain binary numbers; and process the binary numbers to use the obtained lamp bead positions as the current contact points of the stylus pen.

[0128] In one of the embodiments, the remaining time slots in a frame except the preset time slots are used to express display content; wherein each time slot in the preset time slots is inserted into the remaining time slots at equal intervals.

[0129] In one embodiment, the lamp bead position includes a rough lamp bead position and an accurate lamp bead position; the lamp bead data is time slot data of a single lamp bead in a frame; the refresh strategy also includes that the current refresh content of the touch object is a continuous preset number of video frames;

[0130] The first frame of the continuous preset number of video frames is used to express the rough position of the lamp bead; the last two frames of the continuous preset number of video frames are used to express the X-axis coordinates and Y-axis coordinates of the precise position of the lamp bead respectively.

[0131] In one of the embodiments, the precise position of the lamp bead is the lamp bead coordinates; the rough position of the lamp bead includes the module number to which the lamp bead belongs and / or the display area number to which the module belongs; and the number of consecutive preset number of video frames is 3 frames.

[0132] In one embodiment, the lamp bead position includes a rough lamp bead position and a precise lamp bead position; the lamp bead data is time slot data of each lamp bead in a single pixel in the same frame;

[0133] One lamp bead in a single pixel is used to express the rough position of the lamp bead; the other two lamp beads in a single pixel are used to express the X-axis coordinate and Y-axis coordinate of the precise position of the lamp bead respectively.

[0134] In one embodiment, it also includes:

[0135] The frame change detection module is used to confirm that the touch object has completed the frame change at the touch acquisition moment of the stylus if a frame change mark is detected in the frame header of the lamp bead data.

[0136] For the specific limitations of the screen refresh positioning device, please refer to the limitations of the screen refresh positioning method above, which will not be repeated here. Each module in the above-mentioned screen refresh positioning device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0137] In one embodiment, a display device is provided, the display device comprising a display screen and a control device;

[0138] Among them, the display screen serves as the touch object of the stylus; and the control device is used to execute the steps of the above-mentioned screen refresh positioning method.

[0139] In one embodiment, the display screen may be an LED display screen.

[0140] Specifically, in the present application, the stylus pen can interact with the display screen through the control device to achieve low-latency screen refresh positioning. The control device can be independently set up with the display screen, or integrated into a display device.

[0141] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above-mentioned screen refresh positioning method are implemented. A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0142] In the description of this specification, the description with reference to the terms "some embodiments", "other embodiments", "ideal embodiments", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic descriptions of the above terms do not necessarily refer to the same embodiment or example.

[0143] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0144] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A screen refresh positioning method, characterized in that: include: Acquire touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; The refresh strategy includes that the current refresh content of the touch object includes the lamp bead position; the lamp bead data includes the lamp bead working status used to express the lamp bead position; the current refresh content also includes display content; the lamp bead working status includes the lamp bead on and off status in a preset time slot in a frame; the remaining time slots in the frame except the preset time slot are used to express the display content; wherein each time slot in the preset time slot is inserted into the remaining time slot at equal intervals; the lamp bead position includes the lamp bead rough position and the lamp bead precise position; the lamp bead data is the time slot data of a single lamp bead in a frame; the refresh strategy also includes that the current refresh content of the touch object is a preset number of consecutive video frames; the first frame in the preset number of consecutive video frames is used to express the rough position of the lamp bead; the last two frames in the preset number of consecutive video frames are used to express the X-axis coordinate and Y-axis coordinate of the precise position of the lamp bead respectively; The touch position information is identified to determine the current touch point position of the stylus.

2. The screen refresh positioning method according to claim 1, characterized in that: The step of identifying the touch position information and determining the current touch point position of the stylus comprises: Encode the on / off status of the lamp beads in the preset time slots in the frame to obtain binary numbers; The binary number is processed, and the obtained position of the lamp bead is used as the current contact point position of the stylus pen.

3. The screen refresh positioning method according to claim 2, characterized in that: The precise position of the lamp bead is the lamp bead coordinates; the rough position of the lamp bead includes the module number to which the lamp bead belongs and / or the display area number to which the module belongs; the number of the continuous preset number of video frames is 3 frames.

4. The screen refresh positioning method according to claim 2, characterized in that: The lamp bead data is the time slot data of each lamp bead in a single pixel in the same frame; one lamp bead in the single pixel is used to express the rough position of the lamp bead; the other two lamp beads in the single pixel are respectively used to express the X-axis coordinate and Y-axis coordinate of the precise position of the lamp bead.

5. The screen refresh positioning method according to claim 1 or 2, characterized in that: Before the step of identifying the touch position information and determining the current touch point position of the stylus, the method further includes the following steps: If a frame change mark is detected in the frame header of the lamp bead data, it is confirmed that the touch object has completed the frame change at the current touch acquisition moment of the stylus.

6. A screen refresh positioning device, characterized in that: include: An information acquisition module, used to acquire touch position information; the touch position information is the lamp bead data displayed by the touch object based on the refresh strategy and collected by the stylus; The refresh strategy includes that the current refresh content of the touch object includes the lamp bead position; the lamp bead data includes the lamp bead working status used to express the lamp bead position; the current refresh content also includes display content; the lamp bead working status includes the lamp bead on and off status in a preset time slot in a frame; the remaining time slots in the frame except the preset time slot are used to express the display content; wherein each time slot in the preset time slot is inserted into the remaining time slot at equal intervals; the lamp bead position includes the lamp bead rough position and the lamp bead precise position; the lamp bead data is the time slot data of a single lamp bead in a frame; the refresh strategy also includes that the current refresh content of the touch object is a preset number of consecutive video frames; the first frame in the preset number of consecutive video frames is used to express the rough position of the lamp bead; the last two frames in the preset number of consecutive video frames are used to express the X-axis coordinate and Y-axis coordinate of the precise position of the lamp bead respectively; The identification and positioning module is used to identify the touch position information and determine the current touch point position of the stylus.

7. A display device, characterized in that: The display device comprises a display screen and a control device; Wherein, the display screen serves as a touch object of the stylus; and the control device is used to execute the steps of the method described in any one of claims 1 to 5.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

9. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images