Touch positioning method, device, touch interaction system and storage medium

Abstract

The present application relates to a touch positioning method, device, touch interaction system and storage medium. The touch positioning method includes: receiving touch position information transmitted by a stylus; the touch position information includes lamp bead data obtained by collecting and encoding the touch object in the corresponding refresh mode through the stylus; the lamp bead data includes the working time and working status of the lamp bead; identifying the touch position information and determining the current contact point position of the stylus. The present application can realize display touch based on the existing display screen packaging form, and the cost is extremely low, and the full-size touch sensitivity is consistent.

Description

Technical Field

[0001] The present application relates to the field of touch interaction technology, and in particular to a touch positioning method, device, touch interaction system and storage medium. Background Art

[0002] For LED (Light-Emitting Diode) displays that are hundreds of inches in size, the lowest cost way to achieve touch control is to use an infrared touch frame. Including an infrared touch frame and a stylus, the method is to place a series of infrared probes on the edge of the screen. The probes will illuminate the tip of the stylus and produce reflections. By detecting the reflected light from different probes, the exact coordinates of the current landing point are calculated. However, with the infrared touch frame method, when the emitted light is blocked, the touch function will be lost, and the touch sensitivity at the edge of the screen is low. The position of the probe installed at the edge of the screen is also difficult to ignore, and the large black edge of the screen edge cannot be avoided.

[0003] Other display touch solutions, including capacitive, vector pressure sensing, surface acoustic wave, metal mesh, piezoresistive and infrared, are generally limited by the contradiction between cost and full-size control, and it is difficult to achieve full-size touch screen control with low latency at low cost. During the implementation process, it was found that there are at least the following problems in traditional technologies: the current touch method has the problem of high cost and high latency. Summary of the invention

[0004] Based on this, it is necessary to provide a touch positioning method, device, touch interaction system and storage medium that can realize touch with low cost and low latency to address the above technical problems.

[0005] In order to achieve the above objectives, on the one hand, an embodiment of the present application provides a touch positioning method, including:

[0006] Receive touch position information transmitted by the stylus; the touch position information includes the lamp bead data obtained by the stylus pen through the collection and encoding of the touch object in the corresponding refresh mode; the lamp bead data includes the lamp bead working time and lamp bead working status;

[0007] Identify the touch position information and determine the current touch point position of the stylus.

[0008] In one of the embodiments, the refresh mode includes the current refresh content confirmed by the touch object based on the refresh strategy; the refresh strategy includes the refresh order of the refresh content;

[0009] Also includes the steps:

[0010] If the current contact position does not meet the positioning end condition, a display command is output; the display command is used to instruct the touch object to call the corresponding display area to display the next refresh content in the refresh order; the positioning end condition includes that the current contact position contains the precise position of the lamp bead.

[0011] In one embodiment, before the step of receiving the touch position information transmitted by the stylus, the method further includes the following steps:

[0012] receiving a refresh position coordinate request transmitted by the stylus; the refresh position coordinate request is output by the stylus in the first touch operation on the touch object;

[0013] Based on the refresh position coordinate request, a full-screen display instruction is output; the full-screen display instruction is used to instruct the touch object to display the first refresh content in the refresh order by traversing the entire screen within a preset period of time; the first refresh content includes the rough position of the lamp bead.

[0014] In one embodiment, the lamp bead working time includes the lamp bead lighting time in each time slot in a frame; the lamp bead working state includes the lamp bead on and off state in each time slot in a frame;

[0015] The precise position of the lamp bead is the lamp bead coordinates; the rough position of the lamp bead includes the module number to which the lamp bead belongs.

[0016] In one embodiment, the last refresh content in the refresh order includes the coordinates of the lamp bead; the rough position of the lamp bead also includes the display area number to which the module belongs; the refresh order includes the ranking of the module number to which the lamp bead belongs being greater than the display area number to which the module belongs, and the ranking of the display area number to which the module belongs being greater than the coordinates of the lamp bead.

[0017] In one embodiment, the positioning end condition further includes that the current touch point position includes an increment compared to the reference coordinate; and the last refresh content in the refresh sequence includes the increment;

[0018] The reference coordinates are determined based on the precise position of the lamp beads; the increment includes an offset compared to the reference coordinates; the offset includes an offset angle and an offset distance along the predicted moving direction of the stylus.

[0019] A touch positioning device, comprising:

[0020] A receiving module is used to receive touch position information transmitted by a stylus; the touch position information includes lamp bead data obtained by collecting and encoding the touch object in the corresponding refresh mode through the stylus; the lamp bead data includes the working time and working status of the lamp bead;

[0021] The recognition module is used to recognize the touch position information and determine the current touch point position of the stylus.

[0022] A touch interaction system comprises a display screen, a driving device and a touch pen;

[0023] The touch pen is used to use the display screen as a touch object; and the driving device is used to execute the steps of the above method.

[0024] In one embodiment, the display screen is an LED display screen.

[0025] A computer-readable storage medium stores a computer program, which implements the steps of the above method when executed by a processor.

[0026] One of the above technical solutions has the following advantages and beneficial effects:

[0027] This application uses the touch position information transmitted by the stylus as a feature recognition object to determine the current contact point position of the stylus; wherein the touch position information includes the lamp bead data obtained by the stylus through the collection and encoding of the touch object using the corresponding refresh mode; the lamp bead data includes the lamp bead working time and the lamp bead working status; that is, this application uses the high-speed refresh capability of the display screen to insert the data required for interaction, such as coordinate position, into the screen to be refreshed, occupying part of the screen refresh time to refresh the coordinate position information, and at the same time, with the stylus that collects the refresh feature, the current touch position information is collected at a higher sampling frequency, and then based on the collected information, low-latency touch interaction of the display content is realized. This application can realize display touch based on the existing display screen packaging form, and the cost is extremely low, and the full-size touch sensitivity is consistent. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0029] Figure 1 A diagram showing an application environment of a touch positioning method in an embodiment;

[0030] Figure 2 is a schematic diagram of a flow chart of a touch positioning method in an embodiment;

[0031] Figure 3 is a schematic flow chart of a touch positioning method in another embodiment;

[0032] Figure 4 A schematic diagram of a specific flow chart of a touch positioning method in an embodiment;

[0033] Figure 5 FIG. 4 is a structural block diagram of a touch positioning device in an embodiment. DETAILED DESCRIPTION

[0034] In order to facilitate understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. Embodiments of the present application are provided in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.

[0035] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.

[0036] It can be understood that the terms "first", "second", etc. used in the present application can be used in this article to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish the first element from another element.

[0037] Spatially relative terms such as "under," "beneath," "below," "under," "above," "above," and the like may be used herein to describe the relationship of an element or feature shown in the figures to other elements or features. It should be understood that, in addition to the orientations shown in the figures, spatially relative terms also include different orientations of the device in use and operation. For example, if the device in the accompanying drawings is flipped, an element or feature described as "under other elements" or "under it" or "under it" will be oriented as being "above" the other elements or features. Thus, the exemplary terms "under" and "under" may include both upper and lower orientations. In addition, the device may also include additional orientations (e.g., rotated 90 degrees or other orientations), and the spatial descriptors used herein are interpreted accordingly.

[0038] It should be noted that when an element is considered to be "connected" to another element, it can be directly connected to the other element, or connected to the other element through an intermediate element. In addition, the "connection" in the following embodiments should be understood as "electrical connection", "communication connection", etc. if there is transmission of electrical signals or data between the connected objects.

[0039] When used herein, the singular forms "a", "an", and "said / the" may also include plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "include / comprise" or "have" and the like specify the presence of stated features, wholes, steps, operations, components, parts, or combinations thereof, but do not exclude the possibility of the presence or addition of one or more other features, wholes, steps, operations, components, parts, or combinations thereof. At the same time, the term "and / or" used in this specification includes any and all combinations of the relevant listed items.

[0040] The screen touch of LED display has always been limited by three major problems. The first is that to achieve screen touch of full-size LED display, it requires a lot of hardware cost, and the control of these hardware occupies a lot of system memory. The second is that the touch of large-size display screens must maintain low latency, that is, the time taken to complete a touch interaction must be extremely low. The third is the layout and hiding of touch sensors to reduce the gaps on the screen surface and the possible impact on the display quality of the display.

[0041] At present, the solution for external infrared borders is to set up infrared dual-tube sensors on the edge of the screen, and use infrared light and reflection to detect the touch input position on the screen surface. However, there are at least the following problems: ① A certain position must be reserved at the edge of the screen for the placement of the infrared dual-tube sensor and its module, and the screen will always have a black border. ② At the edge of the screen, since the difference between the outgoing light and the incident light is small, the touch sensitivity is relatively lower than the middle, and the sensitivity is not consistent across the entire screen. ③ Under different construction environments, it may happen that after the infrared light is blocked and reflected back, the touch demand behind it is blocked.

[0042] In other traditional solutions, vector pressure sensors, that is, fine strain gauges, are used to provide feedback on the screen touch coordinates, so many strain gauges need to be installed on the entire screen; metal grids are used, and the grids attached to the screen surface will cause screen occlusion; and it is difficult to achieve low-latency interaction using capacitive control. Various screen touch methods have defects on LED display screens. For touch interaction, the core work is to determine the position coordinates of the touch point relative to the screen. The method of determining the touch point coordinates is the primary problem to be solved in touch interaction, and it is also the primary problem for LED display screens to achieve touch interaction. In addition, the processing technology of the packaging structure of high-resolution LED display screens has extremely high requirements for consistency. Easily changing the characteristics of its internal components can easily reduce the display quality of the screen.

[0043] In this regard, the touch positioning method proposed in this application does not require significant changes to the screen structure. It only needs to follow the corresponding refresh strategy to achieve screen touch interaction under the operation of the stylus, with low cost and low latency. Specifically, this application can be based on the existing display packaging form, suitable for LED display screens, can achieve display touch, and has extremely low cost and consistent touch sensitivity for all sizes.

[0044] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0045] The touch positioning method provided in this application can be applied to Figure 1 In the application environment shown. Among them, the interactive system is used for touch interaction of the display screen. The screen continuously refreshes the display screen at an extremely high refresh rate, and the stylus obtains the screen information at an extremely high sampling frequency. Specifically, the display screen maintains a high-speed refresh, and the refreshed content can be divided into two parts of features, one part is the display content, and the other part is the interactive information. The stylus records the working status of the display screen in each refresh time segment at an extremely high sampling rate, and obtains the information used for interaction through direct or indirect feature recognition, such as lamp bead coordinates, offset distance, moving speed, etc. That is, the present application utilizes the high-speed refresh capability of the display screen and the low frame rate difference of the video source to achieve low-latency touch interaction of the screen.

[0046] Furthermore, by utilizing the high-speed dynamic refresh feature of the screen, the data required for interaction, such as the reference coordinate position, is inserted into the screen to be refreshed, occupying part of the screen refresh time to refresh the reference coordinate position information. At the same time, with a stylus that can collect refresh features, the current touch position information is collected at a higher sampling frequency. The collected information is sent back to the interactive system to realize the content interaction of the display screen.

[0047] Figure 1 The interactive system may be an independent driving system, used to configure a corresponding refresh strategy (e.g., refresh mode) for the display screen and interact with the stylus; in some examples, the interactive system may also be a system including a display device including a screen and a driving device, and a stylus, and the stylus interacts with the driving device in the display device. In addition, the driving device may be independent of the screen setting, or may belong to the same display device as the screen. The driving device may be used to configure a corresponding refresh strategy (e.g., refresh mode) for the display screen and interact with the stylus.

[0048] It should be noted that the touch object in the present application may include a display screen; the display screen may be a liquid crystal display screen or an electronic ink display screen; in some embodiments, the display screen may be an LED display screen. Furthermore, the present application may be based on an existing miniLED, microLED (micrometer light emitting diode) or SMD (Surface Mounted Devices) packaged LED (i.e., surface mount packaged structure LED) that has undergone surface strengthening treatment to implement a touch positioning method, which does not require significant changes to the screen structure, but only requires the corresponding refresh strategy to achieve screen touch interaction under the operation of a stylus, with low cost and low latency.

[0049] In one embodiment, Figure 2 As shown, a touch positioning method is provided, which is applied to Figure 1 The interactive system in is taken as an example to illustrate, including the following steps:

[0050] Step 202, receiving touch position information transmitted by the stylus;

[0051] The touch position information includes the lamp bead data obtained by collecting and encoding the touch object in the corresponding refresh mode through the stylus; the lamp bead data includes the lamp bead working time and the lamp bead working status.

[0052] Specifically, the stylus may refer to a device for performing touch interaction with a touch object. In some examples, the stylus may be a pen-shaped tool used to input instructions to a computer screen, a mobile device, a drawing board, or other device with a touch screen, and a user may select a file or draw a picture by clicking the touch screen with the stylus. It should be noted that the stylus is only for illustrative purposes, and the present application may also be implemented using a high-speed sampling device capable of performing touch interaction with a touch object, such as a stylus, a lens, or other device.

[0053] Furthermore, the touch position information can be acquired via the stylus and transmitted to the interactive system (for example, a driving device in a display device), and the touch position information includes the lamp bead data obtained by collecting and encoding the touch object using the corresponding refresh mode through the stylus; the lamp bead data includes the lamp bead working time and the lamp bead working status.

[0054] Specifically, the touch object (for example, a display screen) is sampled with data by the stylus, and the data may be the light of the lamp beads in the display screen. In some examples, the data sampling may be obtained by monitoring the on and off state of the display screen by the stylus at a relatively high frequency. That is, the present application realizes screen touch by detecting the on and off state of the lamp beads. It should be noted that, taking the display screen as an LED screen as an example, when the LED screen displays the content of the picture, it does not realize the content display by changing the constant brightness of the lamp beads, but reflects the difference of different contents by changing the brightness of the lamp beads at a high frequency. This display feature is called dynamic scanning, which is an important display feature of the LED display screen. Under the dynamic scanning drive, for a single lamp bead, it will not maintain a constant brightness state, but will change at a very high frequency, and realize different content display in the alternation of brightness and extinguishing. The light effect displayed by the lamp beads through the high-frequency alternation of brightness and extinguishing is from brightness to extinguish, and is progressive layer by layer. The final effect is called grayscale. The grayscale used by LED lamp beads from on to off usually has 256 levels. There are 3 lamp beads on a single pixel, namely red, green and blue. The 3 lamp beads achieve different color displays through different brightness ratios. Therefore, when the LED display screen displays the picture, for a single lamp bead, it mainly relies on grayscale refresh to achieve.

[0055] In order to ensure the uniform and stable changes in color and brightness, the LED display screen will increase the screen grayscale refresh rate as much as possible. Usually, an LED display screen can achieve a screen refresh rate of 3840HZ, which means that when playing a 60HZ display screen, each frame of the screen will be reflected by 64 refreshes of the LED display screen. And these 64 refreshes are grayscale refreshes. It can be seen that the screen refresh capacity of the LED display screen is much higher than the video source information.

[0056] In one embodiment, the lamp bead working time may include the lamp bead lighting time in each time slot in a frame; the lamp bead working state may include the lamp bead on and off state in each time slot in a frame.

[0057] Specifically, the interactive system can perform feature recognition on the lamp bead data obtained by the stylus, laying the foundation for the subsequent determination of the current contact point position of the stylus. The aforementioned one frame is only an example, and the present application can use the light-off transformation of the lamp bead within a frame or multiple frames to realize the output of coordinate content.

[0058] Among them, the lamp bead data can be obtained in the following way: the lighting component in the stylus collects the touch object, and after obtaining the light of the lamp bead, it can be processed in sequence by the light on and off component, photosensitive module and data processing module in the stylus, and then converted into a readable data stream for the interactive system to handle. For example, the display screen refreshes 3840 times per second, and the stylus achieves at least 3840 data sampling per second. The sampled data is processed and analyzed to obtain accurate coordinates or reference offsets during movement, and fed back to the interactive system to update the display data of the next frame. Among them, the specific values ​​are not limited.

[0059] Furthermore, the lamp bead data in the present application can be obtained by sampling a single lamp bead and / or a single pixel through the stylus. The light-on / off component in the stylus can be turned on when there is light, so that the light can enter the photosensitive module; wherein, the light-on / off component can refer to a device used to control the time for light to irradiate the photosensitive element, and the on / off clock of the light-on / off component can be consistent with the refresh clock of the touch object (for example, the display screen). In some examples, the light-collecting component can be implemented by a light-collecting lens, the light-on / off component can be implemented by an exposure valve, and the photosensitive module can be implemented by a photosensitive module, that is, a photosensitive sensor (for example, a photosensor); and when collecting a single pixel, the photosensitive module can include multiple photosensitive sensors, and the stylus can include an optical splitter module connected between the light-on / off component and the photosensitive module, the optical splitter module divides the light into red, green, and blue light, and respectively emits them to the multiple photosensitive modules included in the photosensitive module, so that one exposure detection of the light-on / off component can simultaneously detect the on and off conditions of the three lamp beads on a single pixel, and the lamp bead detection is more efficient. In some examples, the optical splitter module can be implemented by a spectroscopic refractive lens. In addition, the stylus can also include a data sending module for communicating with the interactive system.

[0060] The interactive system realizes touch interaction with the stylus based on the dynamic refresh of the display screen (for example, the LED display screen). Among them, the working status of a single lamp bead in different time slots can specifically include the following two indicators: one is whether the lamp bead is emitting light, and the other is the time of emitting light, both of which can be recorded by the stylus. In addition, the sampling frequency of the stylus can correspond to the refresh frequency of the LED display screen. For the lamp bead, within a frame of time, for example, each time slot refresh will be recorded by the stylus. For the state and time of the lamp bead in this time slot, the corresponding digital signal code is output for processing by the corresponding system, and data content including the coordinates of the lamp bead, which is helpful for realizing screen interaction, is extracted from it.

[0061] It should be noted that the present application does not limit the specific structure of the stylus, and any stylus that can obtain the touch position information of the touch object at a high sampling rate can be used. In some examples, the stylus can be implemented as a lamp bead stylus and / or a pixel stylus.

[0062] The lamp bead stylus is used to sample a single lamp bead, that is, the on and off of a single lamp bead can be judged by the stylus, and then the coordinates of the current lamp bead are collected. The working status of the lamp bead is on and off. When refreshing a frame of the picture, the working cycle of the lamp bead will be divided into 64 time segments, and the on and off status will be refreshed in these 64 time segments. This situation can be seen as the limited accuracy of the stylus in collecting pixels. It is impossible to identify the brightness status of the three lamp beads on a single pixel, but the entire pixel is judged as a whole lamp bead. It can also be seen as a high-quality display screen, the arrangement of the lamp beads on it is very fine, and the concept of pixels is composed of any three lamp beads of different colors. Among them, the data read by the stylus can be the status data of a single lamp bead in these 64 time segments. That is, the information read by the stylus pen at one time is a time segment of a lamp bead within a frame time; and the structural style of the stylus pen can apply the structure of the lamp bead stylus pen exemplified above (including a lighting lens, an exposure valve, a photosensor, a data processing module, and a data sending module, etc.).

[0063] The acquisition range of the pixel stylus is a single pixel, that is, the on and off of the lamp bead on a single pixel is judged by the stylus, and then the coordinates of the current pixel are collected. There are 3 lamp beads on a pixel, namely red, green and blue lights. In this way, when the stylus stays just above a pixel, it can collect the light of the red, green and blue lamp beads in the pixel. These 3 lamp beads will be refreshed 64 times when refreshing a frame of video. Here it is not simply 64 times of on and off, but it can be understood that the working time of the lamp bead in this frame, that is, 16.67ms, is divided into 64 working segments. For each working segment, the lamp bead has a corresponding working state (on, off). There are 192 working segments corresponding to the 3 lamp beads in the same time. The data read by the stylus is the status data of the 3 lamp beads in these 64 time segments. Specifically, the information read by the stylus at one time is the combination of the three time segments of the three lamp beads refreshed in the same frame.

[0064] Furthermore, the pixel stylus can sample three lamp beads in a single pixel at a time, and use the light entering along the light path provided by the exposure valve as the incident light. The stylus can use a spectroscopic refractor to refract the red, green, and blue light onto three photosensitive sensors respectively, and divide them into three signals, which are output to the processing system of the stylus respectively. Then, the stylus can read three frames of picture data within one frame of picture information. That is, the structure of the pixel stylus can be based on the aforementioned lamp bead stylus, and a spectroscopic refraction lens is further added. At the same time, three photosensitive sensors can be used.

[0065] In addition, the touch object adopts a corresponding refresh mode, which may refer to the touch object sending high-speed data information in the form of lights on and off for corresponding durations to transmit position information through high-speed refresh based on the refresh strategy (e.g., drive strategy) provided by the interactive system. Furthermore, the position information can be collected by the stylus to obtain touch position information. In some examples, the refresh mode may be a multi-level refresh, that is, the rough position of the lamp beads and the precise position of the lamp beads are graded and sorted before refreshing (positioning grading).

[0066] Step 204: Identify touch position information and determine the current touch point position of the stylus.

[0067] Specifically, after acquiring the touch position information, the interactive system can identify it to determine the current touch point position of the stylus. This identification can refer to feature recognition of the lamp bead data, reading the information to be conveyed by the display screen in the corresponding refresh mode, and then determining the current touch point position of the stylus.

[0068] As mentioned above, this application utilizes the high-speed refresh capability of the display screen to insert the data required for interaction, such as coordinate position, into the screen to be refreshed, occupying part of the screen refresh time to refresh the coordinate position information. At the same time, with the stylus that collects the refresh feature, the current touch position information is collected at a higher sampling frequency, and then based on the collected information, low-latency touch interaction of the display content is achieved. This application can realize display touch based on the existing display screen packaging form, and the cost is extremely low, and the full-size touch sensitivity is consistent.

[0069] In one embodiment, Figure 3 As shown, a touch positioning method is provided, which is applied to Figure 1 The interactive system in is taken as an example to illustrate, including the following steps:

[0070] Step 302, receiving touch position information transmitted by the stylus;

[0071] The touch position information includes the lamp bead data obtained by collecting and encoding the touch object in the corresponding refresh mode through the stylus; the lamp bead data includes the lamp bead working time and the lamp bead working status.

[0072] Step 304, identifying the touch position information and determining the current touch point position of the stylus;

[0073] The refresh mode includes the current refresh content confirmed by the touch object based on the refresh strategy; the refresh strategy includes the refresh order of the refresh content.

[0074] Step 306, if the current contact point position does not meet the positioning end condition, then output a display command; the display command is used to instruct the touch object to call the corresponding display area to display the next refresh content in the refresh order; the positioning end condition includes that the current contact point position contains the precise position of the lamp bead.

[0075] Specifically, take the touch object as an LED display screen as an example; the size of the LED display screen is very large, usually reaching hundreds of inches. On such a large-sized display screen, this application proposes to classify and distinguish the coordinates of the lamp beads to achieve full-size touch control, thereby avoiding the problem of large data redundancy caused by point-by-point calibration, so that this application can express complete data by simply turning the lamp beads on and off.

[0076] For a single lamp bead or a single pixel on an LED display screen, the touch position information collected by the stylus can be the lamp bead position information that is refreshed step by step. The main form of expressing this information is the 64 refreshes of the display screen within one frame time, and these 64 light-off changes can cover the information. On the one hand, in the process of transmitting position data, the impact on the normal display quality of the display screen should be as small as possible. On the other hand, the delay in the process of refreshing the position data, solving the precise coordinates, and then refreshing the next frame of the screen based on the feedback of the precise coordinates by the interactive system and displaying it should be as small as possible.

[0077] Since the position coordinate information of each pixel is fixed, but the content to be displayed is not fixed. That is, when the pixel is displaying content, its on and off state within one frame time is not related to the position coordinate of the current pixel. Therefore, there may be the following situation, that is, the content that the current pixel needs to display, and the time slot that the indicator bead is on in this frame time segment is only one time. If the lamp bead wants to refresh the coordinates, this position coordinate will not only make the lamp bead light up and off only once in one frame time, but at least light up and off multiple times to normally transmit and express a value. Similarly, if the time segment that the display content needs to be on is 50 times within this frame time, the lamp bead needs to refresh the coordinates, and it does not need to light up 50 times, but as few times as possible, alternately light up, and then transmit a meaningful binary number. That is, the data sent cannot have too many 0s or too many 1s, but should be balanced between the two quantities. In short, if the lamp bead wants to refresh the position coordinates of the display screen in this way, it will make the originally dark places brighter and the bright places darker, at least for a certain period of time, it will have the bad effect of reducing the dynamic range of the screen. In this case, if the lamp beads refresh their position coordinates at a fixed time interval, for example, every 10 frames, and ignore the display content of the screen itself when refreshing the position coordinates, this will greatly reduce the dynamic range of the screen and affect the display quality of the screen.

[0078] In this regard, the screen refresh strategy proposed in the present application can refresh the position coordinates of the lamp beads from coarse to fine, step by step, to the stylus with higher efficiency and lower latency without affecting the display quality. The refresh mode in the present application includes the current refresh content confirmed by the touch object based on the refresh strategy; the refresh strategy includes the refresh order of the refresh content. In some examples, the refresh strategy can be a driving strategy output by the interactive system. The refresh content in the present application may include the rough position of the lamp beads and the precise position of the lamp beads. In some examples, the refresh mode can be a multi-level refresh, that is, the rough position of the lamp beads and the precise position of the lamp beads are refreshed after being graded and sorted (positioning grading), wherein the order of the rough position of the lamp beads in the refresh order is greater than the order of the precise position of the lamp beads, that is, the rough position of the lamp beads is refreshed first, so that the touch object can gradually reduce the display area and gradually locate the lamp bead coordinates where the touch point of the stylus is located.

[0079] Furthermore, the present application proposes an optimization of the refresh strategy of the screen, which can refresh the position coordinates of the lamp beads to the stylus pen step by step from coarse to fine with higher efficiency and lower latency without affecting the display quality. In the form of graded touch, the refresh of the screen can be divided into coarse coordinates (rough position of the lamp beads) and precise coordinates (precise position of the lamp beads). The content to be expressed by the coarse coordinates is simple, such as a simple number, the division of left and right ranges, etc., that is, the coarse coordinates occupy a small amount of data and have a short refresh cycle. The refresh of the precise coordinates involves the specific position coordinates of each lamp bead in a certain area. In some examples, the precise position of the lamp bead can be the lamp bead coordinates, and the coarse position of the lamp bead can include the module number to which the lamp bead belongs and / or the display area number to which the module belongs, and the last refresh content in the refresh order can include the lamp bead coordinates.

[0080] In step 306, the present application proposes to confirm whether the current contact position satisfies the positioning end condition after determining the current contact position of the stylus pen, and the positioning end condition includes that the current contact position includes the precise position of the lamp bead. That is, if the current contact position includes the precise position of the lamp bead, it can be confirmed that in the current refresh, the touch object has transmitted the lamp bead coordinates through the lamp bead data (the current refresh content in the refresh order is the precise position of the lamp bead), and then the positioning can be stopped. If the current contact position does not include the precise position of the lamp bead (the current refresh content in the refresh order is the rough position of the lamp bead), it can be confirmed that in the current refresh, the touch object did not transmit the lamp bead coordinates, and the touch object can be informed to display the next refresh content in the refresh order.

[0081] In one embodiment, the last refresh content in the refresh order may include the lamp bead coordinates; and the refresh order includes the module number to which the lamp bead belongs being ranked greater than the display area number to which the module belongs, and the display area number to which the module belongs being ranked greater than the lamp bead coordinates. It should be noted that the specific implementation process of steps 302 to 304 can refer to the description of steps 202 to 204 in the previous text, which will not be repeated here.

[0082] In one embodiment, before the step of receiving the touch position information transmitted by the stylus pen, the following steps may be further included:

[0083] receiving a refresh position coordinate request transmitted by the stylus; the refresh position coordinate request is output by the stylus in the first touch operation on the touch object;

[0084] Based on the refresh position coordinate request, a full-screen display instruction is output; the full-screen display instruction is used to instruct the touch object to display the first refresh content in the refresh order by traversing the entire screen within a preset period of time; the first refresh content includes the rough position of the lamp bead.

[0085] Specifically, the stylus can output touch position information to the interactive system during the first touch operation on the touch object, and then the interactive system outputs the full-screen display instruction to the display screen. That is, when the stylus clicks on the screen, the stylus can tell the screen to "start refreshing the position coordinates."

[0086] The above process cannot obtain accurate coordinates immediately. Since the stylus has not received the first accurate coordinates of the touch object refresh, the stylus cannot determine the position of the body relative to the touch object, and the touch object does not know the exact position of the stylus. At this time, when the touch object receives the "full screen display instruction", it can traverse the position coordinates of the entire screen, that is, display the first refresh content in the refresh order by traversing the entire screen within a preset time period; and the first refresh content can include the rough position of the lamp beads.

[0087] Obviously, if every refresh requires every LED or pixel on the entire screen to refresh the precise coordinates, firstly, there is not enough encoding capacity, secondly, it will take a lot of time and affect the display quality. However, this application proposes a refresh strategy of graded refresh to inform the current position coordinates of the stylus with different precisions.

[0088] For example, the P1 display module has 320 lamp beads horizontally and 160 lamp beads vertically. If there are 100 modules on a screen, with the upper left corner as the coordinate origin, these pixels are encoded one by one, and the coordinates of the lamp bead in the lower right corner are (32000, 16000). When each lamp bead reports its own lamp bead coordinates, it must accurately describe its coordinates. Both its X-axis coordinates and Y-axis coordinates require at least 5 bits of data representation space. It is very difficult to express this data feature without affecting the display quality of the lamp bead. The stylus needs to interact with the screen with extremely low latency, and the processing of this data will take a long time.

[0089] Take the touch object as the display screen, the first refresh content is the rough position of the lamp bead, and the rough position of the lamp bead includes the module number to which the lamp bead belongs; the same P1 display module, there are still 100 modules on the screen, each module is numbered, and when reading the precise coordinates of the pixel points, the module number is first determined, so that it can be distinguished which module the lamp bead is on. The determination of the precise position of the lamp bead is then limited to a single module. At this time, the precise coordinates of a module can be simplified to the module number + the coordinates on the module. The maximum coordinate on the module is only (320,160), and its X-axis coordinate and Y-axis coordinate are both simplified to 3-bit data. Compared with the previous solution, it has been simplified to a certain extent, thereby realizing coordinate grading.

[0090] This application provides at least three ways to classify the positioning of the lamp bead position coordinates: ① module number + precise coordinates of the lamp bead on the module; ② module number + display area number on the module + precise coordinates in the display area; ③ offset direction compared to the benchmark + offset distance compared to the benchmark. Among them, the benchmark can refer to the approximate position (initial position). For example, when the touch position information fed back by the stylus is the module number, the approximate position of the stylus can be determined. The subsequent screen refresh is mainly based on the increment, offset or prediction of the initial position, and there is no need to refresh the lamp bead coordinates on the entire screen.

[0091] In one embodiment, the positioning end condition may further include that the current touch point position includes an increment compared to the reference coordinate; the last refresh content in the refresh sequence includes the increment;

[0092] The reference coordinates are determined based on the precise position of the lamp beads; the increment includes an offset compared to the reference coordinates; the offset includes an offset angle and an offset distance along the predicted moving direction of the stylus.

[0093] Specifically, after obtaining the precise position of the lamp bead (e.g., the lamp bead coordinates), the touch object can be controlled to output an offset along the predicted moving direction of the stylus. The reference coordinates can be determined based on the precise position of the lamp bead, for example, the reference coordinates can be the lamp bead coordinates.

[0094] In some examples, after the stylus determines the precise coordinates of the lamp bead, it can instruct the screen to continue to perform the following events: ① predict the direction of the pen's movement and refresh the precise coordinates in the possible direction; ② predict the direction of the pen's movement and refresh the offset compared to the precise coordinates in the possible direction; ③ predict the direction of the pen's movement and refresh the offset angle and offset distance compared to the reference in the possible direction.

[0095] In order to further explain the solution of this application, a specific example is given below. This application does not limit the complete touch interaction between the screen and the stylus. The following is just one of the multiple implementation methods. The low-latency touch positioning method implemented by this application can have multiple specific interaction forms after confirming the sampling method of the stylus and the refresh method of the screen. One of the touch processes can be as follows Figure 4As shown: When the stylus clicks the screen, the stylus sends a coordinate refresh request (and a start refresh command) to the screen through the interactive system, and then the lamp beads or pixels on the entire screen will refresh their position information within a certain period of time until the next step of the stylus feedback. And this refresh does not refresh the accurate coordinates of every lamp bead on the entire screen in one step, but first refreshes the module number, then refreshes the area, and then refreshes the precise coordinates, thereby reducing the impact on the display quality. Among them, when the stylus feedbacks the module number, the approximate position of the stylus can be determined, and the subsequent screen refresh can be based on the increment, offset or prediction of the initial position, and there is no need to refresh the lamp bead coordinates on the entire screen.

[0096] As mentioned above, the present application combines the touch control of the display screen with the display feature of the dynamic refresh of the display screen, so as to utilize the dynamic refresh of the display screen and utilize the on and off transformation of the lamp beads within a frame or multiple frames of time segments to realize the output of coordinate content. The present application proposes a lamp bead coordinate refresh mode based on high precision and low latency, and proposes a typical interactive application scenario between the stylus and the display screen, including multi-level position positioning, which is suitable for low-latency writing. Taking the LED display screen as an example, the present application is designed for the existing LED display screen, that is, no structural or system changes are required for the existing LED display screen. By optimizing the screen refresh strategy and cooperating with high-speed sampling equipment, such as a stylus, lens, etc., the touch interaction of the screen can be realized. And it is not affected by the size of the screen, and can achieve smooth screen writing with low latency and multi-precision effects.

[0097] It should be understood that although Figure 2-4 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 2-4 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0098] In one embodiment, Figure 5 As shown, a touch positioning device is provided, comprising:

[0099] The receiving module 510 is used to receive the touch position information transmitted by the stylus; the touch position information includes the lamp bead data obtained by the touch object collected and encoded by the stylus using the corresponding refresh mode; the lamp bead data includes the lamp bead working time and the lamp bead working status;

[0100] The identification module 520 is used to identify the touch position information and determine the current touch point position of the stylus.

[0101] In one of the embodiments, the refresh mode includes the current refresh content confirmed by the touch object based on the refresh strategy; the refresh strategy includes the refresh order of the refresh content;

[0102] Also includes:

[0103] The command output module is used to output a display command if the current contact position does not meet the positioning end condition; the display command is used to instruct the touch object to call the corresponding display area to display the next refresh content in the refresh order; the positioning end condition includes that the current contact position contains the precise position of the lamp bead.

[0104] In one embodiment, the receiving module 510 is further configured to receive a refresh position coordinate request transmitted by the stylus; the refresh position coordinate request is output by the stylus in the first touch operation on the touch object;

[0105] The command output module is also used to output a full-screen display instruction based on a refresh position coordinate request; the full-screen display instruction is used to instruct the touch object to display the first refresh content in the refresh order by traversing the entire screen within a preset time period; the first refresh content includes the rough position of the lamp bead.

[0106] In one of the embodiments, the lamp bead working time includes the lamp bead lighting time in each time slot in a frame; the lamp bead working state includes the lamp bead on and off state in each time slot in a frame; the lamp bead precise position is the lamp bead coordinates; the lamp bead rough position includes the module number to which the lamp bead belongs.

[0107] In one embodiment, the last refresh content in the refresh order includes the coordinates of the lamp bead; the rough position of the lamp bead also includes the display area number to which the module belongs; the refresh order includes the ranking of the module number to which the lamp bead belongs being greater than the display area number to which the module belongs, and the ranking of the display area number to which the module belongs being greater than the coordinates of the lamp bead.

[0108] In one of the embodiments, the positioning end condition also includes that the current touch position includes an increment compared to the reference coordinates; the last refresh content in the refresh order includes the increment; the reference coordinates are determined based on the precise position of the lamp beads; the increment includes an offset compared to the reference coordinates; the offset includes an offset angle and an offset distance along the predicted movement direction of the stylus.

[0109] For the specific definition of the touch positioning device, please refer to the definition of the touch positioning method above, which will not be repeated here. Each module in the above-mentioned touch positioning device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0110] In one embodiment, a touch interaction system is provided, including a display screen, a drive device, and a stylus;

[0111] The touch pen is used to use the display screen as a touch object; and the driving device is used to execute the steps of the above touch positioning method.

[0112] Specifically, in the present application, the stylus pen can interact with the driving device to achieve low-latency, low-cost touch interaction of the display screen content. The driving device can be independently set up with the display screen, or integrated into a display device.

[0113] In one embodiment, the display screen may be an LED display screen.

[0114] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above touch positioning method are implemented.

[0115] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0116] In the description of this specification, the description with reference to the terms "some embodiments", "other embodiments", "ideal embodiments", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic descriptions of the above terms do not necessarily refer to the same embodiment or example.

[0117] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0118] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A touch positioning method, characterized in that: include: Receive touch position information transmitted by the stylus; the touch position information includes lamp bead data obtained by the stylus pen through acquisition and encoding of the touch object using the corresponding refresh mode; the lamp bead data includes lamp bead working time and lamp bead working status; the refresh mode includes the current refresh content confirmed by the touch object based on the refresh strategy; the refresh strategy includes the refresh order of the refresh content; Identify the touch position information and determine the current touch point position of the stylus; The method further comprises the steps of: If the current contact position does not meet the positioning end condition, a display command is output; the display command is used to instruct the touch object to call the corresponding display area to display the next refresh content in the refresh order; the positioning end condition includes that the current contact position contains the precise position of the lamp bead.

2. The touch positioning method according to claim 1, characterized in that: Before the step of receiving the touch position information transmitted by the stylus, the method further includes the following steps: receiving a refresh position coordinate request transmitted by the stylus pen; the refresh position coordinate request is output by the stylus pen in the first touch operation on the touch object; Based on the refresh position coordinate request, a full-screen display instruction is output; the full-screen display instruction is used to instruct the touch object to display the first refresh content in the refresh order in a full-screen traversal manner within a preset time period; The first refresh content includes the rough position of the lamp beads.

3. The touch positioning method according to claim 2, characterized in that: The lamp bead working time includes the lamp bead lighting time in each time slot in a frame; the lamp bead working state includes the lamp bead on and off state in each time slot in a frame; The precise position of the lamp bead is the lamp bead coordinates; the rough position of the lamp bead includes the module number to which the lamp bead belongs.

4. The touch positioning method according to claim 2 or 3, characterized in that: The last refresh content in the refresh order includes the coordinates of the lamp beads; the rough position of the lamp beads also includes the display area number to which the module belongs; the refresh order includes the ranking of the module number to which the lamp beads belong is greater than the display area number to which the module belongs, and the ranking of the display area number to which the module belongs is greater than the coordinates of the lamp beads.

5. The touch positioning method according to any one of claims 1 to 3, characterized in that: The positioning end condition also includes that the current contact point position includes an increment compared to the reference coordinates; and the last refresh content in the refresh sequence includes the increment; The reference coordinates are determined based on the precise position of the lamp bead; the increment includes an offset compared to the reference coordinates; and the offset includes an offset angle and an offset distance along a predicted moving direction of the stylus.

6. A touch positioning device, characterized in that: include: A receiving module, used to receive touch position information transmitted by a stylus; the touch position information includes lamp bead data obtained by the touch object using a corresponding refresh mode through collection and encoding by the stylus; the lamp bead data includes lamp bead working time and lamp bead working status; the refresh mode includes the current refresh content confirmed by the touch object based on the refresh strategy; The refresh strategy includes a refresh order for refreshing the content; An identification module, used to identify the touch position information and determine the current touch point position of the stylus; A command output module is used to output a display command if the current contact position does not meet the positioning end condition; the display command is used to instruct the touch object to call the corresponding display area to display the next refresh content in the refresh order; the positioning end condition includes that the current contact position contains the precise position of the lamp bead.

7. A touch interaction system, characterized in that: Including display screen, drive device and stylus; Wherein, the stylus pen is used to use the display screen as a touch object; and the driving device is used to execute the steps of the method described in any one of claims 1 to 5.

8. The touch interaction system according to claim 7, characterized in that: The display screen is an LED display screen.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images