Touch device and control method of touch device

Abstract

The present disclosure relates to a touch device and a control method for the touch device, wherein the touch device comprises: a writing panel, the writing panel comprises a writing screen and a processing unit; a stylus, the stylus comprises at least one image capturing unit and a communication unit; the writing screen can display a plurality of characteristic graphics or be fixedly provided with a plurality of characteristic graphics; the communication unit is communicatively connected with the processing unit, the communication unit is used to transmit the captured image of the image capturing unit to the processing unit, and the processing unit is used to determine the position and / or posture of the stylus relative to the writing screen according to the captured image. The touch device provided by the present disclosure can realize the precise writing operation of the stylus on various writing screens, without adding a touch component to the writing screen, and there is no restriction on the type of stylus.

Description

Technical Field

[0001] The present disclosure relates to the field of touch control technology, and in particular to a touch control device and a control method of the touch control device. Background Art

[0002] With the rapid development of science and technology, various new touch technologies are increasingly being used in display devices, providing great convenience for users. In touch operations, users can perform touch operations with their fingers, such as touching the touch screen and moving the fingers on the touch screen to control the display device. Alternatively, touch operations can be performed with a stylus, such as using a capacitive pen and an electromagnetic pen to perform touch operations on the touch screen, which can achieve better accuracy and resolution and realize some complex touch operations.

[0003] However, many display screens of current display devices do not support touch operations with a stylus. Since there is no touch component supporting the stylus in the display screen, if you want to make it support the stylus, you need to modify the display screen, which has a high overall cost. Alternatively, some display screens have requirements for the type of stylus, such as only being able to use one type of capacitive pen or electromagnetic pen, and not being able to make the two compatible, so there is a possibility that touch operations with high operating accuracy cannot be performed. Therefore, how to design a touch device that can make the display screen support the stylus without adding a touch component or matching the stylus type at a low cost has become a problem that needs to be solved. Summary of the invention

[0004] In order to solve the above technical problem or at least partially solve the above technical problem, the present disclosure provides a touch device and a control method of the touch device.

[0005] In a first aspect, the present disclosure provides a touch control device, comprising:

[0006] A writing panel, the writing panel comprising a writing screen and a processing unit;

[0007] A stylus pen, the stylus pen comprising at least one image capturing unit and a communication unit;

[0008] The writing screen can display multiple characteristic graphics or be fixedly provided with multiple characteristic graphics;

[0009] The communication unit is communicatively connected to the processing unit, and the communication unit is used to transmit the image captured by the image capturing unit to the processing unit, and the processing unit is used to determine the position and / or posture of the stylus relative to the writing screen according to the captured image.

[0010] In some embodiments, the screen border of the writing screen is further provided with a plurality of border marks, wherein the border marks at different positions are different.

[0011] In some embodiments, the writing screen is a rectangle, the boundary marker is a square with one side missing, and the opening formed by the missing side faces the inside of the writing screen; a marking graphic is set in the square.

[0012] In some embodiments, the stylus pen includes a first image acquisition device and a second image acquisition device, the first image acquisition device and the second image acquisition device are arranged sequentially along the length direction of the stylus pen, and the distance between the first image acquisition device and the tip of the stylus pen is smaller than the distance between the second image acquisition device and the tip of the stylus pen.

[0013] In some embodiments, the stylus pen further includes a pressure sensor, and the communication unit is further used to transmit the detection value of the pressure sensor to the processing unit; the processing unit is used to determine the pressure sensitivity value of the stylus pen according to the detection value of the pressure sensor.

[0014] In some embodiments, the processing unit is further configured to determine a pressure sensitivity value of the stylus according to a deformation of a tip of the stylus in the captured image.

[0015] In a second aspect, the present disclosure further provides a control method for a touch control device, which is applicable to the touch control device provided in the first aspect, and the method includes:

[0016] Acquire an image captured by an image capturing unit;

[0017] The position and / or posture of the stylus relative to the writing screen is determined according to the captured image.

[0018] In some embodiments, it also includes:

[0019] Determining the pressure sensitivity value of the stylus pen according to the deformation of the stylus pen tip in the captured image; or,

[0020] The pressure sensitivity value of the stylus pen is determined according to the detection value of the pressure sensor in the stylus pen.

[0021] In some embodiments, determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0022] Determine that the captured image includes a writing screen boundary, a stylus pen tip image and no feature graphics, and determine, based on the captured size of the writing screen boundary and the actual size of the writing screen boundary, a ratio of the captured size of the writing screen boundary to the actual size of the writing screen boundary, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen;

[0023] The position and / or posture of the stylus relative to the writing screen is determined based on the positions of the stylus tip and the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0024] In some embodiments, determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0025] Determining that the captured image includes a writing screen boundary and does not have the characteristic pattern, and determining, according to the captured size of the writing screen boundary and the actual size of the writing screen boundary, a ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen;

[0026] The position and / or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0027] In some embodiments, the screen boundary of the writing screen is further provided with a plurality of boundary markers; wherein the boundary markers at different positions are different; and determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0028] Determining that the captured image includes a boundary mark, a stylus pen tip image and no feature graphics, and determining, according to the captured size of the boundary mark and the actual size of the boundary mark, a ratio of the captured size of the boundary mark to the actual size of the boundary mark, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen;

[0029] The position and / or posture of the stylus relative to the writing screen is determined based on the positions of the stylus tip and the writing screen boundary in the captured image, the ratio of the captured size of the boundary marker and the actual size of the boundary marker, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0030] In some embodiments, the screen boundary of the writing screen is further provided with a plurality of boundary markers; wherein the boundary markers at different positions are different; and determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0031] Determining that the captured image includes a boundary mark and no characteristic pattern, and determining, according to the captured size of the boundary mark and the actual size of the boundary mark, a ratio of the captured size of the boundary mark to the actual size of the boundary mark, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen;

[0032] The position and / or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the writing screen boundary in the captured image, the ratio of the captured size of the boundary marker and the actual size of the boundary marker, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0033] In some embodiments, it also includes:

[0034] Determine that the captured image includes at least a partial image of the writing screen, and control the writing screen to display a characteristic graphic.

[0035] In some embodiments, determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0036] Determine that the captured image includes the characteristic pattern and the image of the stylus pen tip, and determine, according to the captured size of the characteristic pattern and the actual size of the characteristic pattern, the ratio of the captured size of the characteristic pattern to the actual size of the characteristic pattern, the capturing angle of the image capturing unit, and the distance between the image capturing unit and the writing screen;

[0037] The position and / or posture of the stylus relative to the writing screen is determined based on the positions of the stylus tip and the characteristic graphic in the captured image, the ratio of the captured size of the characteristic graphic and the actual size of the characteristic graphic, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0038] In some embodiments, determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0039] Determining that the captured image includes the characteristic pattern, and determining, according to the captured size of the characteristic pattern and the actual size of the characteristic pattern, a ratio of the captured size of the characteristic pattern to the actual size of the characteristic pattern, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen;

[0040] The position and / or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the characteristic pattern in the captured image, the ratio of the captured size of the characteristic pattern and the actual size of the characteristic pattern, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0041] In some embodiments, it also includes:

[0042] It is determined that the pressure sensitivity value of the stylus pen is greater than a pressure sensitivity threshold, and the writing screen is controlled to display handwriting features.

[0043] In some embodiments, after determining that the pressure sensitivity value of the stylus pen is greater than the pressure sensitivity threshold, the method further includes:

[0044] The writing screen is controlled to eliminate the characteristic pattern.

[0045] In some embodiments, it also includes:

[0046] The position and / or posture of the stylus relative to the writing screen is determined according to the handwriting features in the captured image.

[0047] In some embodiments, the stylus comprises a first image acquisition device and a second image acquisition device, the first image acquisition device and the second image acquisition device are sequentially arranged along the length direction of the stylus, and the distance between the first image acquisition device and the tip of the stylus is smaller than the distance between the second image acquisition device and the tip of the stylus; the method further comprises:

[0048] The position of the stylus relative to the writing screen is determined according to the writing screen boundary in the captured image, and the stylus is controlled to display the characteristic pattern in an area within a preset range facing the writing screen.

[0049] In some embodiments, the stylus pen further includes: a multi-axis sensor is provided on the stylus pen; and

[0050] It is determined that within a first preset time, the captured image does not include a writing screen boundary and a characteristic pattern, and the position and / or posture of the stylus relative to the writing screen is determined according to the detection value of the multi-axis sensor.

[0051] In some embodiments, it also includes:

[0052] It is determined that within a second preset time, the captured image does not include a writing screen boundary and a characteristic pattern, and the writing screen is controlled to display the characteristic pattern.

[0053] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:

[0054] The touch device provided by the present disclosure includes: a writing panel, the writing panel includes a writing screen and a processing unit; a stylus, the stylus includes at least one image capturing unit and a communication unit; the writing screen can display multiple characteristic graphics or be fixedly provided with multiple characteristic graphics; the communication unit is connected to the processing unit in communication, the communication unit is used to transmit the captured image of the image capturing unit to the processing unit, and the processing unit is used to determine the position and / or posture of the stylus relative to the writing screen according to the captured image. Therefore, when the stylus is used to write on the writing screen, the writing operation is equivalent to the touch operation, the image capturing unit will capture the writing screen image around the stylus when the writing operation is performed, and transmit the captured image to the processing unit of the writing panel via the communication unit, and the processing unit can determine the position and / or posture of the stylus relative to the writing screen according to the captured image. Compared with the prior art, the touch device provided by the present disclosure can realize the precise writing operation of the stylus on various writing screens, without adding a touch component to the writing screen, and there is no restriction on the type of stylus. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0056] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0057] Figure 1 A schematic diagram of the structure of a touch control device provided by an embodiment of the present disclosure;

[0058] Figure 2 A schematic diagram of a structure with markings on the screen border of a touch device provided by an embodiment of the present disclosure;

[0059] Figure 3 A schematic diagram of the structure of another touch control device provided by an embodiment of the present disclosure;

[0060] Figure 4 A schematic flow chart of a control method for a touch control device provided in an embodiment of the present disclosure.

[0061] Among them, 10, writing panel; 11, writing screen; 12, processing unit; 13, screen boundary; 14, characteristic pattern; 15, boundary mark; 20, stylus; 21, image capturing unit; 22, communication unit; 210, first image acquisition device; 211, second image acquisition device. DETAILED DESCRIPTION

[0062] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0063] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0064] Currently, many display devices do not have touch screen devices in their display screens, so they cannot support touch operations with a stylus. If you want to achieve touch operations, you need to modify the display screen, but the overall cost is high. Some display screens are equipped with touch screen devices, but they have requirements for the type of stylus, such as only one type of capacitive pen or electromagnetic pen can be used. Electromagnetic pens and capacitive pens cannot be used interchangeably, and the display screen cannot be compatible with the two, so there is a possibility that touch operations with high operating accuracy cannot be performed.

[0065] In order to solve the above problems, the present disclosure provides a touch control device. Figure 1 A structural diagram of a touch control device provided by an embodiment of the present disclosure is shown in FIG. Figure 1 As shown, the touch control device includes:

[0066] A writing panel 10, the writing panel 10 comprises a writing screen 11 and a processing unit 12;

[0067] A stylus pen 20, the stylus pen 20 includes at least one image capturing unit 21 and a communication unit 22;

[0068] The writing screen 11 can display a plurality of characteristic graphics 14 or be fixedly provided with a plurality of characteristic graphics 14;

[0069] The communication unit 22 is communicatively connected to the processing unit 12 , and is used to transmit the captured image of the image capturing unit 21 to the processing unit 12 , and the processing unit 12 is used to determine the position and / or posture of the stylus 20 relative to the writing screen 11 according to the captured image.

[0070] See also Figure 1The touch device includes a writing panel 10 and a stylus 20. The writing panel 10 includes a writing screen 11 and a processing unit 12. The edge of the writing screen 11 also includes a screen boundary 13. The stylus 20 can perform writing operations on the writing screen 11. The writing screen 11 can be a display screen with touch control, or a common display screen, or a screen without display function, such as a screen with a silk-screen characteristic pattern. The stylus 20 can perform operations such as writing and clicking on a plane without display function, but the screen will not display, but will control other electronic screens to display. The processing unit 12 has continuous and fast image data processing capabilities, and can extract stylus features, screen boundary features, screen display content features, etc. from each captured image, and can also calculate parameters such as shooting angle and shooting distance, and obtain the position and / or posture of the stylus 20 relative to the writing panel 10 according to various corresponding relationships.

[0071] The stylus pen 20, as a writing tool, includes at least one image capturing unit 21, which is used to capture an image of the writing screen 11 around the stylus pen 20 when the stylus pen 20 is performing a writing operation. The image capturing unit 21 is, for example, a camera, which is installed inside the stylus pen 20 and can capture images continuously, clearly, and at high speed, and the pixels of the captured images of the camera are adjustable. For example, the frame rate of the image capturing unit 21 is not less than 30 frames per second to prevent the shooting frame rate from being too low, resulting in fewer captured images and the inability to accurately identify the writing path of the stylus pen 20. Exemplarily, when the stylus pen 20 is suspended or has not entered the writing screen 11 area, the camera's image pixel can be adjusted to obtain more content on the captured image; when writing continuously, the writing screen 11 has displayed content and rich features, so the camera's image pixel can be reduced to reduce the amount of transmitted data and avoid transmission jams. In addition, by reducing the image pixel, the purpose of increasing the shooting frame rate can also be achieved. For example, the image pixel is reduced, and the shooting frame rate is increased to 120 frames / second, or even higher frame rates, so as to accurately identify the handwriting route of the stylus pen 20. The camera's image pixel can also be adjusted by adjusting the shooting field of view. When the camera's shooting field of view range becomes larger, the image pixel will also increase, and more features can be obtained. When the camera's shooting field of view range becomes smaller, the image pixel will decrease, the amount of data will also decrease, and the transmission will be smoother. It should be noted that in some other embodiments, there are other parameters that affect the pixels of the captured image, which are not limited in the embodiments of the present disclosure. The above is only an example. When identifying whether it is in a continuous writing state, the current frame can be compared with the previous frame by comparing adjacent frames to determine whether there is a change between the images. If there is a change, it is considered that the stylus pen 20 is in a continuous writing state. It should be noted that in some other implementations, there are other ways to determine continuous writing, which are not limited in the embodiments of the present disclosure.

[0072] The writing screen 11 can display multiple characteristic graphics 14 or be fixed with multiple characteristic graphics 14. There are differences between the characteristic graphics 14 at different positions. For example, there are multiple groups of characteristic graphics 14 such as A1, A2, ..., D4, D5, etc. The characteristic graphics 14 corresponding to each position are different. Therefore, when the stylus 20 is used for writing, the image of the writing screen 11 captured by the image capture unit 21 is different when the stylus 20 is in different positions. The stylus 20 also includes a communication unit 22, which is connected to the processing unit 12 of the writing panel 10 in communication, so the communication unit 22 can transmit the captured image of the image capture unit 21 to the processing unit 12. Among them, the communication unit 22 and the processing unit 12 can adopt a wired transmission method or a wireless transmission method, such as the NearLink wireless transmission method, which is mainly used for short-distance data transmission and can achieve a low latency effect. The processing unit 12 can analyze and identify the position of the writing screen 11 corresponding to the characteristic pattern 14 and the shooting angle based on the received captured image, and further can determine the position and / or posture of the stylus 20 relative to the writing screen 11.

[0073] For example, the display background of the writing screen 11 is paper-white, and the screen border may be black. The user picks up the stylus 20 and moves the stylus 20 toward the writing screen until it reaches the writing position. The stylus 20 is provided with an image capturing unit 21. During the above-mentioned movement, the image capturing unit 21 can continuously capture images, and transmit the captured images to the processing unit 12 via the communication unit 22. While the stylus 20 is moving, there may be some images captured by the image capturing unit 21 whose specific positions cannot be identified, such as images without the writing screen 11, which may be caused by the fact that the stylus 20 is far away from the writing screen 11. When the stylus 20 is several tens of centimeters away from the writing screen 11, the writing screen 11 appears in the images captured by the stylus 20 and the writing screen 11, but it is impossible to determine that the stylus has approached the writing screen 11 based on the writing screen 11, and it is impossible to determine the position and / or posture of the stylus 20 relative to the writing screen 11. Therefore, the characteristic graphic 14 can be displayed on the writing screen 11, and the display background of the writing screen 11 becomes a background with the characteristic graphic 14. The processing unit 12 can determine the position and / or posture of the stylus 20 relative to the writing screen 11 according to the different characteristic graphics 14. In some optional embodiments, the display background of the writing screen can initially be a background with the characteristic graphic 14, and the characteristic graphic 14 is displayed throughout the use process. It should be noted that the color of the characteristic graphic 14 should be clear, but the contrast with the background color should not be too obvious. For example, when there is a white background, black text or pattern, the characteristic graphic 14 can be a grayscale graphic.

[0074] In the embodiment of the present disclosure, when a stylus is used to write on a writing screen, the writing operation is equivalent to a touch operation. The image capture unit will capture the writing screen image around the stylus when the writing operation is performed, and transmit the captured image to the processing unit of the writing panel via the communication unit. The processing unit can determine the position and / or posture of the stylus relative to the writing screen based on the captured image. Compared with the prior art, the touch device provided by the present disclosure can realize the precise writing operation of the stylus on various writing screens. For example, it can be a writing screen that only includes a display function, or a writing screen with a touch component, or a writing screen without a display function. For the above-mentioned various writing screens, the stylus can perform precise writing operations. For example, the writing screen is a capacitive screen. In the prior art, it is also necessary to add touch components such as touch electrodes on the writing screen, while in the touch device provided in the embodiment of the present disclosure, precise writing operations can be performed without adding touch components. In addition, the embodiment of the present disclosure determines the position and / or posture of the stylus relative to the writing screen based on the captured image, and there is no need to limit the type of the stylus.

[0075] In some embodiments, Figure 2 A schematic diagram of a touch device with a screen border marked with a marker according to an embodiment of the present disclosure. Figure 1 Based on Figure 2 The screen border 13 of the writing screen 11 is also provided with a plurality of border marks 15; the border marks 15 at different positions are different.

[0076] The screen boundary 13 of the writing screen 11 is also provided with a plurality of boundary markers 15, and the screen boundary 13 is the outer frame of the writing screen 11, and the edge of the writing screen 11. The boundary markers 15 at different positions are different, so the specific position of the screen boundary 13 can be determined according to the boundary markers 15 on the screen boundary 13. When the stylus 20 is at the edge of the writing screen 11, the image captured by the image capturing unit 21 includes the boundary marker 15, and the processing unit 12 can identify the current position range of the stylus 20 according to the boundary marker 15. It should be noted that the embodiment of the present disclosure does not limit the specific shape and number of the screen boundary 13, but the number should not be too small to avoid the situation where the boundary marker 15 is not recognized.

[0077] In some embodiments, continue to refer to Figure 2 The writing screen 11 is a rectangle, the boundary mark 15 is a square with one side missing, and the opening formed by the missing side faces the inside of the writing screen 11; a marking pattern is set in the square.

[0078] Exemplarily, the writing screen 11 is a rectangle, and the screen border 13 has a certain width, and the specific width is set according to actual needs. The four borders are all provided with a border mark 15, and the border mark 15 is a square with one side missing, which is composed of three sides. The opening formed by the missing side faces the writing screen 11, and a marking graphic is set in the square, for example, a marking number is set, and the marking number of each side border starts from 1 and increases along the X direction or the Y direction. To avoid the mirror image from being unable to be positioned, all numbers are facing one direction. When the captured image captured by the image capture unit of the stylus includes the border mark 15, the processing unit can determine the position of the stylus relative to the writing screen according to the position of the border mark 15 in the captured image. Among them, the position of the stylus relative to the writing screen can be understood as a plane coordinate or a space coordinate. In the embodiment of the present disclosure, the border mark 15 is a square with one side missing, so the three sides are equal length lines, and the length of the side can be pre-stored in the processing unit, and the posture and distance of the stylus relative to the writing screen can also be located according to the captured image. For example, if the shape of the boundary marker 15 in the captured image is deformed, the processing unit can calculate the shooting angle of the image capture unit, and the position of the image capture unit in the stylus is fixed, and can further determine the posture of the stylus relative to the writing screen. According to the length of the three sides of the boundary marker 15 in the captured image, combined with the actual side length of the boundary marker 15, and according to the proportional relationship between the two, the processing unit can calculate the distance between the image capture unit and the boundary marker 15, and then locate the suspended position of the stylus relative to the writing screen, and calculate whether the stylus has a rotational movement. When there is a rotational movement, the boundary marker 15 in the captured image captured by the image capture unit will also change accordingly.

[0079] In some other implementations, the boundary marker 15 may also be other types of markers, such as other shapes, numbers, letters, etc., which are not limited in the embodiments of the present disclosure. The above is only an example and may be set according to actual needs.

[0080] In some embodiments, Figure 3 A structural diagram of another touch control device provided by an embodiment of the present disclosure is shown in FIG. Figure 3 As shown, the stylus pen 20 includes a first image acquisition device 210 and a second image acquisition device 211. The first image acquisition device 210 and the second image acquisition device 211 are arranged in sequence along the length direction of the stylus pen 20. The distance between the first image acquisition device 210 and the pen tip of the stylus pen 20 is smaller than the distance between the second image acquisition device 211 and the pen tip of the stylus pen 20.

[0081] In the embodiment of the present disclosure, the stylus pen 20 includes two image capturing units 21, namely a first image capturing device 210 and a second image capturing device 211. Both the first image capturing device 210 and the second image capturing device 211 can capture images. The first image capturing device 210 and the second image capturing device 211 are sequentially arranged along the length direction of the stylus pen 20. There is a certain distance between the first image capturing device 210 and the second image capturing device 211 so as to capture different images. Moreover, the distance between the first image capturing device 210 and the pen tip of the stylus pen 20 is smaller than the distance between the second image capturing device 211 and the pen tip of the stylus pen 20. Exemplarily, the first image acquisition device 210 is set on a side close to the tip of the stylus pen 20, for example, it is a camera, which can shoot continuously, clearly and at high speed. Since it is close to the tip of the stylus pen 20, the captured image includes the tip of the stylus pen 20, which can be understood as a local camera; the second image acquisition device 211 is set on a side away from the tip of the stylus pen 20, for example, it is also set as a camera, which can also shoot continuously, clearly and at high speed. Since it is far away from the tip of the stylus pen 20, the captured image includes more parts of the stylus pen 20, which can be understood as a global camera.

[0082] The first image acquisition device 210 and the second image acquisition device 211 are set to capture the local image and the global image respectively, so as to more quickly and efficiently calculate the position and posture of the stylus 20 from the writing screen 11. For example, when the stylus 20 is close to the writing screen 11, the second image acquisition device 211 can capture the screen boundary 13 of the writing screen 11, while the first image acquisition device 210 can capture the writing area of ​​the stylus 20 on the writing screen 11. The position of the stylus 20 can be roughly located according to the captured image captured by the second image acquisition device 211, and the position of the stylus 20 can be accurately located according to the captured image captured by the first image acquisition device 210.

[0083] It should be noted that, since the embodiment of the present disclosure includes a first image acquisition device and a second image acquisition device, the embodiment of the present disclosure does not restrict whether a boundary mark is set at the screen boundary, and it can be selected according to actual needs.

[0084] In some embodiments, the stylus pen further includes a pressure sensor, and the communication unit is further used to transmit the detection value of the pressure sensor to the processing unit; the processing unit is used to determine the pressure sensitivity value of the stylus pen according to the detection value of the pressure sensor.

[0085] The stylus is provided with a pressure sensor, which can collect the pressure value generated by the pressure on the stylus tip. The communication unit of the stylus transmits the detection value of the pressure sensor to the processing unit, and the processing unit determines the pressure value of the stylus according to the detection value of the pressure sensor. Different pressure values ​​may correspond to different writing operations. The pressure values ​​and corresponding writing operations can be stored in the processing unit in advance, and the processing unit can determine the corresponding writing operation according to the pressure values.

[0086] In some embodiments, the processing unit is further configured to determine the pressure sensitivity value of the stylus according to the deformation of the stylus tip in the captured image.

[0087] The captured image captured by the image capturing unit includes the tip of the stylus. When the tip of the stylus is not in contact with the writing screen, the stylus is not pressed, and the tip of the stylus will not deform. When the tip of the stylus is in contact with the writing screen, the stylus is pressed, and the tip of the stylus will deform to varying degrees. Different degrees of deformation correspond to different pressure values. The specific corresponding relationship can be pre-stored in the processing unit. The processing unit analyzes and processes the captured image to obtain the deformation amount of the stylus tip, and then determines the pressure value of the stylus according to the deformation of the stylus tip. Different pressure values ​​may correspond to different writing operations. The pressure values ​​and corresponding writing operations can be pre-stored in the processing unit, and the processing unit can determine the corresponding writing operation according to the pressure values.

[0088] The present disclosure also provides a control method for a touch device, wherein the touch device is any one of the touch panel embodiments described above. Figure 4 A flow chart of a control method of a touch device provided by an embodiment of the present disclosure is shown in FIG. Figure 4 As shown, the control method includes S100 to S200:

[0089] S100: Acquire an image captured by an image capturing unit.

[0090] When using a stylus pen to write on the writing screen, the user needs to pick up the stylus pen and move it to the writing screen until it reaches the writing position. The stylus pen is provided with an image capturing unit, and during the above movement, the image capturing unit can continuously capture images. The writing screen of the touch device includes a processing unit, which is connected to a communication unit on the stylus pen, and the processing unit obtains the captured image of the image capturing unit via the communication unit.

[0091] S200: Determine the position and / or posture of the stylus relative to the writing screen according to the captured image.

[0092] Each captured image may include multiple image features, such as the image of the stylus tip, the writing screen boundary, and boundary markers, etc. Since the boundary markers at different positions of the writing screen are different, the processing unit analyzes and processes the above image features to obtain the position and / or posture of the stylus relative to the writing screen.

[0093] In the embodiment of the present disclosure, when a stylus is used to write on a writing screen, the writing operation is equivalent to a touch operation. The image capture unit will capture the writing screen image around the stylus when the writing operation is performed, and transmit the captured image to the processing unit of the writing panel via the communication unit. The processing unit can determine the position and / or posture of the stylus relative to the writing screen based on the captured image. Compared with the prior art, the touch device provided by the present disclosure can realize the precise writing operation of the stylus on various writing screens. For example, it can be a writing screen that only includes a display function, or a writing screen with a touch component, or a writing screen without a display function. For the above-mentioned various writing screens, the stylus can perform precise writing operations. For example, the writing screen is a capacitive screen. In the prior art, it is also necessary to add touch components such as touch electrodes on the writing screen, while in the touch device provided in the embodiment of the present disclosure, precise writing operations can be performed without adding touch components. In addition, the embodiment of the present disclosure determines the position and / or posture of the stylus relative to the writing screen based on the captured image, and there is no need to limit the type of the stylus.

[0094] In some embodiments, the control method further includes: determining the pressure sensitivity value of the stylus according to the deformation of the stylus tip in the captured image; or, determining the pressure sensitivity value of the stylus according to the detection value of a pressure sensor in the stylus.

[0095] The captured image includes the tip of the stylus, and the processing unit can determine the pressure value of the stylus according to the deformation of the tip of the stylus. When the tip of the stylus contacts the writing screen, the tip of the stylus will deform to different degrees, and the deformation to different degrees corresponds to different pressure values, wherein the specific corresponding relationship can be pre-stored in the processing unit or in other locations. The processing unit processes the captured image and determines the corresponding pressure value of the stylus according to the deformation of the tip of the stylus in the captured image.

[0096] In some other embodiments, the stylus includes a pressure sensor, and the detection value of the pressure sensor of the stylus determines the pressure sensitivity value of the stylus. When the tip of the stylus touches the writing screen, the tip of the stylus will deform to varying degrees, and the pressure sensor can collect the pressure sensitivity value generated by the pressure on the tip of the stylus and transmit it to the processing unit, which can determine the pressure sensitivity value of the stylus based on the detection value of the pressure sensor of the stylus.

[0097] The pressure value may be formed by handwriting or by clicking the writing screen. Different pressure values ​​may correspond to different writing operations. The pressure values ​​and corresponding writing operations may be stored in the processing unit in advance, and the processing unit may determine the corresponding writing operation according to the pressure values.

[0098] In some embodiments, determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0099] Determine that the captured image includes the writing screen boundary, the image of the stylus tip and no feature graphics, and determine the ratio of the captured size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen based on the captured size of the writing screen boundary and the actual size of the writing screen boundary.

[0100] The position and / or posture of the stylus relative to the writing screen is determined based on the positions of the stylus tip and the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0101] When it is determined that the captured image includes the writing screen boundary, the image of the stylus pen tip, and no characteristic graphics, it can be understood that the stylus pen is located at the writing screen boundary. At this time, it is necessary to determine the position and / or posture of the stylus pen relative to the writing screen through the writing screen boundary and the stylus pen tip image. Exemplarily, the writing screen is rectangular, and the screen boundary of the writing screen has no boundary mark. The writing screen boundary in the captured image needs to include at least three boundaries. If it only includes one or two boundaries, it is impossible to determine the specific position of the writing screen. Compare the captured size of the writing screen boundary with the actual size of the writing screen boundary to determine the ratio of the captured size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image capture unit, and the distance between the image capture unit and the writing screen, wherein the angle can be determined according to the deformation of the captured image, and the distance can be determined according to the size change of the captured image.

[0102] The captured image also includes an image of the stylus pen tip. Based on the positions of the stylus pen tip and the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen, the positional relationship between the stylus pen tip and the screen boundary in the captured image can be determined. Furthermore, based on the positional relationship between the stylus pen tip and the screen boundary, the position and / or posture of the stylus relative to the writing screen can be directly determined.

[0103] In some embodiments, determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0104] Determine that the captured image includes a writing screen boundary and has no characteristic graphics, and determine, according to the captured size of the writing screen boundary and the actual size of the writing screen boundary, the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the capturing angle of the image capturing unit, and the distance between the image capturing unit and the writing screen;

[0105] The position and / or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0106] When it is determined that the captured image includes the writing screen boundary and has no characteristic graphics, it can be understood that the stylus is located at the writing screen boundary. At this time, it is necessary to determine the position and / or posture of the stylus relative to the writing screen through the writing screen boundary. Exemplarily, similar to the above embodiment, the writing screen is rectangular, and the screen boundary of the writing screen has no boundary mark. The writing screen boundary in the captured image needs to include at least three boundaries. If it only includes one or two boundaries, it is impossible to determine the specific position of the writing screen. Compare the captured size of the writing screen boundary with the actual size of the writing screen boundary to determine the ratio of the captured size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen, wherein the angle can be determined according to the deformation of the captured image, and the distance can be determined according to the size change of the captured image.

[0107] However, the captured image provided by the embodiment of the present disclosure only includes the writing screen boundary, and the positional relationship between the pen tip of the stylus and the writing screen needs to be determined based on the positional relationship between the image capturing unit and the pen tip. The image capturing unit and the pen tip are both set at fixed positions of the stylus, so the positional relationship between the pen tip of the stylus and the image capturing unit can be determined. According to the shooting angle and distance between the image capturing unit and the writing screen, the angle of the pen tip and the distance from the writing screen when shooting the image can be determined. According to the position of the pen tip of the stylus and the image capturing unit, the position of the pen tip of the stylus and the writing screen boundary in the captured image can be determined. Therefore, according to the positional relationship between the pen tip of the stylus and the image capturing unit, the position of the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen, the position and / or posture of the stylus relative to the writing screen is determined.

[0108] In some embodiments, the screen border of the writing screen is further provided with a plurality of border identifiers; wherein the border identifiers at different positions are different; and determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0109] Determine that the captured image includes a boundary mark, a stylus pen tip image and no feature graphics, and determine, according to the captured size of the boundary mark and the actual size of the boundary mark, a ratio of the captured size of the boundary mark and the actual size of the boundary mark, a capturing angle of the image capturing unit, and a distance between the image capturing unit and the writing screen;

[0110] The position and / or posture of the stylus relative to the writing screen is determined based on the position of the stylus tip and the writing screen boundary in the captured image, the ratio of the captured size of the boundary marker and the actual size of the boundary marker, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0111] In the touch device provided in the embodiment of the present disclosure, the screen boundary of the writing screen is also provided with a plurality of boundary markers; wherein the boundary markers at different positions are different. Therefore, according to the boundary marker on the screen boundary, the specific position of the screen boundary can be determined. When the stylus is at the writing screen boundary, the captured image captured by the image capturing unit includes the boundary marker, and the processing unit can identify the current position of the stylus according to the boundary marker. It should be noted that the embodiment of the present disclosure does not limit the specific shape and number of the screen boundary, but the number should not be too small to avoid the situation where the boundary marker is not recognized.

[0112] When it is determined that the captured image includes a boundary mark and no characteristic graphics, it can be understood that the stylus is located at the boundary of the writing screen. Exemplarily, the writing screen is rectangular, and a boundary mark is set at the boundary of the writing screen. The boundary marks at different positions are different. The positional relationship between the image capture unit and the writing screen can be roughly determined based on the boundary mark in the captured image, and then the captured size of the writing screen boundary and the actual size of the writing screen boundary are compared to determine the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image capture unit, and the distance between the image capture unit and the writing screen, wherein the angle can be determined based on the deformation of the captured image, and the distance can be determined based on the size change of the captured image.

[0113] The captured image also includes an image of the stylus pen tip. Based on the position of the stylus pen tip image and the writing screen boundary in the captured image, the ratio of the captured size of the boundary marker and the actual size of the boundary marker, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen, the positional relationship between the stylus pen tip and the boundary marker in the captured image can be determined. Furthermore, based on the positional relationship between the stylus pen tip and the boundary marker, the position and / or posture of the stylus relative to the writing screen can be directly determined.

[0114] In some embodiments, the screen border of the writing screen is further provided with a plurality of border identifiers; wherein the border identifiers at different positions are different; and determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0115] Determine that the captured image includes a boundary marker and no feature graphics, and determine the ratio of the captured size of the boundary marker to the actual size of the boundary marker, the capturing angle of the image capturing unit, and the distance between the image capturing unit and the writing screen according to the captured size of the boundary marker and the actual size of the boundary marker.

[0116] The position and / or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the writing screen boundary in the captured image, the ratio of the captured size of the boundary marker and the actual size of the boundary marker, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0117] In the touch device provided in the embodiment of the present disclosure, a plurality of boundary markers are provided on the screen boundary of the writing screen; wherein the boundary markers at different positions are different. Therefore, the specific position of the screen boundary can be determined according to the boundary marker on the screen boundary. When the stylus is at the writing screen boundary, the image captured by the image capturing unit includes the boundary marker, and the processing unit can identify the current position of the stylus according to the boundary marker. It should be noted that the embodiment of the present disclosure does not limit the specific shape and number of the screen boundary, but the number should not be too small to avoid the situation where the boundary marker is not recognized.

[0118] When it is determined that the captured image includes a boundary mark and no characteristic graphics, it can be understood that the stylus is located at the boundary of the writing screen. Exemplarily, the writing screen is rectangular, and a boundary mark is set at the boundary of the writing screen. The boundary marks at different positions are different. The positional relationship between the image capture unit and the writing screen can be roughly determined based on the boundary mark in the captured image, and then the captured size of the writing screen boundary and the actual size of the writing screen boundary are compared to determine the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image capture unit, and the distance between the image capture unit and the writing screen, wherein the angle can be determined based on the deformation of the captured image, and the distance can be determined based on the size change of the captured image.

[0119] However, the captured image provided by the embodiment of the present disclosure only includes the boundary mark, so the positional relationship between the pen tip of the stylus and the writing screen needs to be determined based on the positional relationship between the image capture unit and the pen tip. The image capture unit and the pen tip are both set at fixed positions of the stylus, so the positional relationship between the pen tip of the stylus and the image capture unit can be determined. According to the shooting angle and distance between the image capture unit and the writing screen, the angle of the pen tip and the distance from the writing screen when shooting the image can be determined. According to the position of the pen tip of the stylus and the image capture unit, the position of the pen tip of the stylus and the writing screen boundary in the captured image can be determined. Therefore, according to the positional relationship between the pen tip of the stylus and the image capture unit, the position of the writing screen boundary in the captured image, the ratio of the captured size of the boundary mark and the actual size of the boundary mark, the shooting angle of the image capture unit, and the distance between the image capture unit and the writing screen, the position and / or posture of the stylus relative to the writing screen is determined.

[0120] In some embodiments, the control method further comprises:

[0121] It is determined that the captured image includes at least a partial image of the writing screen, and the writing screen is controlled to display a characteristic pattern.

[0122] During the whole process of using the stylus to write, the user needs to pick up the stylus and move the stylus to the position of the writing screen until it moves to the writing position. The stylus is provided with an image capturing unit. During this process, the image capturing unit can continuously capture images and transmit the captured images to the processing unit via the communication unit. However, during the movement of the stylus, there are some contents in the captured images captured by the image capturing unit that do not include the writing screen image. The specific position cannot be identified based on the partial image. For example, the image without the writing screen may be caused by the stylus being far away from the writing screen, and the writing screen does not display the characteristic graphics at this time. When the stylus is close to the writing screen, it can be determined that at least part of the image of the writing screen is included in the captured image. At this time, the processing unit controls the writing screen to display the characteristic graphics, so that the writing screen image in the captured image includes the characteristic graphics, and the position and / or posture of the stylus relative to the writing screen is quickly determined. By adopting this control method, when the writing screen is a display screen, it can be avoided to the greatest extent that the characteristic graphics interfere with the content displayed on the writing screen.

[0123] In some embodiments, determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0124] Determine that the captured image includes a characteristic pattern and a stylus tip image, and determine, according to the captured size of the characteristic pattern and the actual size of the characteristic pattern, a ratio of the captured size of the characteristic pattern to the actual size of the characteristic pattern, a capturing angle of the image capturing unit, and a distance between the image capturing unit and the writing screen;

[0125] The position and / or posture of the stylus relative to the writing screen is determined based on the position of the stylus tip and the characteristic graphic in the captured image, the ratio of the captured size of the characteristic graphic and the actual size of the characteristic graphic, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0126] A characteristic pattern is provided on the writing screen of the touch device, wherein the characteristic patterns at different positions are different. Therefore, the specific position of the writing screen can be determined based on the characteristic pattern on the writing screen. When the stylus is on the writing screen, the image captured by the image capturing unit includes a characteristic identifier, and the processing unit can identify the current position of the stylus based on the characteristic identifier. It should be noted that the embodiments of the present disclosure do not limit the specific shape and quantity of the characteristic identifiers, but the quantity identifiers are different and the quantity should not be too small to avoid the situation where the characteristic identifier is not recognized.

[0127] When it is determined that the captured image includes a characteristic pattern and an image of the pen tip of the stylus, it can be understood that the stylus is located in the writing area of ​​the writing screen. Exemplarily, the writing screen is rectangular, and a plurality of characteristic patterns are arranged on the writing screen. The characteristic patterns at different positions are different. The positional relationship between the image capturing unit and the writing screen can be determined based on the characteristic identifier in the captured image, and the captured size of the characteristic pattern and the actual size of the characteristic pattern are compared to determine the ratio of the captured size of the characteristic pattern and the actual size of the characteristic pattern, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen. Among them, the angle can be determined based on the deformation of the captured image, and the distance can be determined based on the size change of the captured image.

[0128] The captured image also includes an image of the stylus pen tip. Based on the positions of the stylus pen tip and the feature graphic in the captured image, the ratio of the captured size of the feature graphic and the actual size of the feature graphic, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen, the positional relationship between the stylus pen tip and the feature graphic in the captured image can be determined, and the position and / or posture of the stylus relative to the writing screen can be determined accordingly.

[0129] In some embodiments, determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes:

[0130] Determining that the captured image includes a characteristic pattern, and determining, according to the captured size of the characteristic pattern and the actual size of the characteristic pattern, a ratio of the captured size of the characteristic pattern and the actual size of the characteristic pattern, a capturing angle of the image capturing unit, and a distance between the image capturing unit and the writing screen;

[0131] The position and / or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the characteristic graphic in the captured image, the ratio of the captured size of the characteristic graphic and the actual size of the characteristic graphic, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

[0132] A characteristic pattern is provided on the writing screen of the touch device, wherein the characteristic patterns at different positions are different. Therefore, the specific position of the writing screen can be determined based on the characteristic pattern on the writing screen. When the stylus is on the writing screen, the image captured by the image capturing unit includes a characteristic identifier, and the processing unit can identify the current position of the stylus based on the characteristic identifier. It should be noted that the embodiments of the present disclosure do not limit the specific shape and quantity of the characteristic identifiers, but the quantity identifiers are different and the quantity should not be too small to avoid the situation where the characteristic identifier is not recognized.

[0133] When it is determined that the captured image includes a characteristic pattern, it can be understood that the stylus is located in the writing area of ​​the writing screen. Exemplarily, the writing screen is rectangular, and a plurality of characteristic patterns are arranged on the writing screen. The characteristic patterns at different positions are different. The positional relationship between the image capturing unit and the writing screen can be determined based on the characteristic identifier in the captured image. The captured size of the characteristic pattern and the actual size of the characteristic pattern are compared to determine the ratio of the captured size of the characteristic pattern and the actual size of the characteristic pattern, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen. Among them, the angle can be determined based on the deformation of the captured image, and the distance can be determined based on the size change of the captured image.

[0134] However, the captured image provided by the embodiment of the present disclosure only includes characteristic graphics, so the positional relationship between the pen tip of the stylus and the writing screen needs to be determined based on the positional relationship between the image capturing unit and the pen tip. The image capturing unit and the pen tip are both set at fixed positions of the stylus, so the positional relationship between the pen tip of the stylus and the image capturing unit can be determined. According to the shooting angle and distance between the image capturing unit and the writing screen, the angle of the pen tip and the distance from the writing screen when the image is captured can be determined. According to the position of the pen tip of the stylus and the image capturing unit, the position of the boundary between the pen tip of the stylus and the writing screen in the captured image can be determined. Therefore, according to the position of the pen tip of the stylus and the characteristic graphics in the captured image, the ratio of the captured size of the characteristic graphics and the actual size of the characteristic graphics, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen, the position and / or posture of the stylus relative to the writing screen is determined.

[0135] In some embodiments, the control method further comprises:

[0136] It is determined that the pressure sensitivity value of the stylus pen is greater than the pressure sensitivity threshold, and the writing screen is controlled to display the handwriting characteristics.

[0137] When using a stylus to write, the tip of the stylus is acted upon by force, which will generate a certain pressure value. The communication unit will transmit it to the processing unit. When the pressure value of the stylus is greater than the pressure threshold, the processing unit controls the writing screen to display the handwriting features, which can also be used as feature graphics.

[0138] Exemplarily, the stylus includes a pressure sensor, and the detection value of the pressure sensor of the stylus determines the pressure sensitivity value of the stylus. When the tip of the stylus is in contact with the writing screen, the tip of the stylus will deform to varying degrees. The pressure sensor can collect the pressure sensitivity value generated by the pressure on the tip of the stylus, and transmit it to the processing unit. The processing unit can determine the pressure sensitivity value of the stylus based on the detection value of the pressure sensor of the stylus. Alternatively, the pressure sensitivity value of the stylus is determined based on the deformation of the tip of the stylus. When the tip of the stylus is in contact with the writing screen, the tip of the stylus will deform to varying degrees, and different degrees of deformation correspond to different pressure sensitivity values, wherein the specific corresponding relationship can be pre-stored in the processing unit, or can exist in other locations. The processing unit processes the captured image and determines the corresponding pressure sensitivity value of the stylus based on the deformation amount of the tip of the stylus in the captured image.

[0139] In some embodiments, after determining that the pressure sensitivity value of the stylus pen is greater than the pressure sensitivity threshold, the method further includes: controlling the writing screen to eliminate the characteristic graphics.

[0140] Since the pressure value of the stylus pen is greater than the pressure threshold, the processing unit controls the writing screen to display the handwriting features, and can also control the writing screen to eliminate the feature graphics. The handwriting features displayed on the writing screen are used as new feature graphics. Since the handwriting features are all different, the position and / or posture of the stylus pen relative to the writing screen can also be determined based on the handwriting features in the captured image. Eliminating the original feature graphics can not only prevent the feature graphics from interfering with the display of the display screen, but also reduce the power of the touch device.

[0141] In some embodiments, the method further includes: determining the position and / or posture of the stylus relative to the writing screen based on handwriting features in the captured image.

[0142] When the stylus is writing on the writing screen, such as writing continuously or slightly lifting the stylus, handwriting features will be generated, and these handwriting features are different and are located at different positions on the writing screen. Therefore, the handwriting features can be used as new feature graphics. When the stylus is on the writing screen, the image captured by the image capture unit includes the handwriting features, and the processing unit can identify the current position of the stylus based on the handwriting features. Based on the handwriting features in the captured image and combined with the position of the stylus tip, the position and / or posture of the stylus relative to the writing screen can be corrected to determine a more accurate position and / or posture.

[0143] Exemplarily, the disclosed embodiment sets the pressure threshold to 0, and the background of the writing screen is paper-white, but a characteristic graphic is displayed on it. When the stylus touches the writing screen, a pressure value greater than 0 will be transmitted to the processing unit, and then the handwriting features will be displayed on the writing screen. The displayed handwriting features serve as new characteristic graphics, which can further correct the position and / or posture of the stylus relative to the writing screen. For example, if the handwriting features are not under the tip of the stylus, the position and / or posture of the stylus relative to the writing screen needs to be corrected. At this time, the writing screen is controlled to eliminate the characteristic graphics, and the characteristic graphics on the background of the writing screen disappear, including only the handwriting features. As the stylus writes and moves on the writing screen, new handwriting features will be left behind, and the position and / or posture of the stylus relative to the writing screen will be corrected again. Before the stylus is far away from the writing screen, continuous writing or slight lifting of the stylus, etc., these handwriting features are all new characteristic graphics. When the stylus moves too fast or is far away from the writing screen, for example, the image capture unit of the stylus does not capture a valid pattern and cannot determine the position, the processing unit will control the original characteristic pattern display and continue to repeat the above steps.

[0144] In some embodiments, the stylus includes a first image acquisition device and a second image acquisition device, the first image acquisition device and the second image acquisition device are sequentially arranged along the length direction of the stylus, and the distance between the first image acquisition device and the tip of the stylus is smaller than the distance between the second image acquisition device and the tip of the stylus; the method further includes:

[0145] The position of the stylus relative to the writing screen is determined according to the writing screen boundary in the captured image, and the stylus is controlled to display a characteristic pattern in an area within a preset range facing the writing screen.

[0146] The first image acquisition device and the second image acquisition device are arranged in sequence along the length direction of the stylus, and there is a certain distance between the first image acquisition device and the second image acquisition device, so different images can be captured. Among them, the distance between the first image acquisition device and the pen tip of the stylus is smaller than the distance between the second image acquisition device and the pen tip of the stylus. It can be understood that the first image acquisition device is closer to the pen tip of the stylus, so the first image acquisition device is used to capture local images, while the second image acquisition device is far away from the pen tip of the stylus and farther from the writing screen, and can capture global images. The image captured by the first image acquisition device includes the pen tip part of the stylus, while the image captured by the second image acquisition device includes more parts of the stylus and a larger range of the writing screen.

[0147] Since the image captured by the first image acquisition device is a local image, the image includes fewer valid images and may not be accurately positioned. In this case, the image captured by the second image acquisition device can be combined to obtain a larger shooting range, and the position of the stylus relative to the writing screen can be determined based on the writing screen boundary in the captured image. After the first image acquisition device is combined with the second image acquisition device, the position of the stylus relative to the writing screen can be determined more accurately. Then, when positioning can be performed through the cooperation of characteristic graphics, there is no need to display the characteristic graphics in full screen. The characteristic graphics can be controlled to display the area within the preset range of the position of the writing screen facing the stylus, thereby improving the positioning accuracy. The preset range is obtained based on the images captured by the first image acquisition device and the second image acquisition device. The writing screen area outside the preset range does not need to display the characteristic graphics, thereby reducing the interference of the characteristic graphics on the user.

[0148] In some embodiments, the invention further includes: a multi-axis sensor is provided on the stylus; and:

[0149] It is determined that within the first preset time, the captured image does not include the writing screen boundary and the characteristic pattern, and the position and / or posture of the stylus relative to the writing screen is determined according to the detection value of the multi-axis sensor.

[0150] If the captured images captured by the image capturing unit do not include the writing screen boundary and characteristic graphics within the first preset time, then the processing unit cannot obtain effective information from the captured images, and thus cannot locate the stylus. In order to avoid long-term inability to locate and affect the normal use of the user, the position and / or posture of the stylus relative to the writing screen can be determined by the detection value of the multi-axis sensor. Among them, sensors with more than 3 axes are collectively referred to as multi-axis sensors. Multi-axis sensors are mostly obtained by combining accelerometers (ACCELEROMETER), gyroscopes (GYROSCOPE), and electronic compasses (COMPASS). The accelerometer can sense acceleration in any direction and obtain the result by measuring the force of the component in a certain axis, which is expressed in the form of axial acceleration magnitude and direction (X, Y, Z). The gyroscope determines the current motion state of the device (forward, backward, left, right, up, down) by measuring its own rotational motion state (angular velocity). The electronic compass can measure the angle between the current device and the four directions of east, south, west, and north. Therefore, the position and / or posture of the stylus relative to the writing screen can be determined according to the detection values ​​of various sensors.

[0151] It should be noted that the embodiments of the present disclosure do not limit the specific type of multi-axis sensor, and can be selected according to actual needs. In some other implementations, there are other types of sensors to determine the position and / or posture of the stylus relative to the writing screen, which are not described in detail in the embodiments of the present disclosure.

[0152] In some embodiments, it also includes:

[0153] It is determined that within the second preset time, the captured image does not include the writing screen boundary and the characteristic pattern, and the writing screen is controlled to display the characteristic pattern.

[0154] In order to prevent the characteristic graphics on the writing screen from affecting the user's experience, the characteristic graphics are not directly displayed on the writing screen in the embodiment of the present disclosure, for example, the background of the writing screen is white. If the captured images captured by the image capturing unit do not include the writing screen boundary and there are no characteristic graphics within the second preset time, then the processing unit cannot obtain effective information from the captured images, and thus cannot locate the stylus. In order to avoid long-term inability to locate and affect the normal use of the user, the writing screen is controlled to display characteristic graphics. At this time, the captured image includes characteristic graphics, and the processing unit can determine the position and / or posture of the stylus relative to the writing screen based on the characteristic graphics. In some optional embodiments, after determining the position and / or posture of the stylus relative to the writing screen, the writing screen can also be controlled to stop displaying the characteristic graphics to reduce the interference of the characteristic graphics on the user. And using the handwriting features as new characteristic graphics can not only determine the position and / or posture of the stylus relative to the writing screen, but also will not affect the user's experience.

[0155] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0156] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A touch device, characterized in that: include: A writing panel, the writing panel comprising a writing screen and a processing unit; A stylus pen, the stylus pen comprising at least one image capturing unit and a communication unit; The stylus pen comprises a first image acquisition device and a second image acquisition device, the first image acquisition device and the second image acquisition device are sequentially arranged along the length direction of the stylus pen, and the distance between the first image acquisition device and the pen tip of the stylus pen is smaller than the distance between the second image acquisition device and the pen tip of the stylus pen; The writing screen can display multiple characteristic graphics or be fixedly provided with multiple characteristic graphics; The communication unit is communicatively connected with the processing unit, the communication unit is used to transmit the captured image of the image capturing unit to the processing unit, the processing unit is used to determine the position and / or posture of the stylus relative to the writing screen according to the captured image, the processing unit is further used to determine that the captured image includes the writing screen boundary, the stylus pen tip image and no feature graphics, and according to the captured size of the writing screen boundary and the actual size of the writing screen boundary, determine the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the capturing angle of the image capturing unit, and the distance between the image capturing unit and the writing screen; The position and / or posture of the stylus relative to the writing screen is determined based on the positions of the stylus tip and the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

2. The touch control device according to claim 1, characterized in that: The screen border of the writing screen is also provided with a plurality of border marks, wherein the border marks at different positions are different.

3. The touch control device according to claim 2, characterized in that: The writing screen is rectangular, the boundary mark is a square with one side missing, and the opening formed by the missing side faces the inside of the writing screen; a marking pattern is arranged in the square.

4. The touch control device according to claim 1, wherein: The stylus pen further includes a pressure sensor, and the communication unit is further used to transmit the detection value of the pressure sensor to the processing unit; the processing unit is used to determine the pressure sensitivity value of the stylus pen according to the detection value of the pressure sensor.

5. The touch control device according to claim 1, wherein: The processing unit is further configured to determine a pressure sensitivity value of the stylus pen according to a deformation of a pen tip of the stylus pen in the captured image.

6. A method for controlling a touch device, characterized in that: Applicable to the touch control device according to any one of claims 1 to 5, the method comprising: Acquire an image captured by an image capturing unit; Determining the position and / or posture of the stylus relative to the writing screen according to the captured image; Determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes: Determine that the captured image includes a writing screen boundary, a stylus pen tip image and no feature graphics, and determine, based on the captured size of the writing screen boundary and the actual size of the writing screen boundary, a ratio of the captured size of the writing screen boundary to the actual size of the writing screen boundary, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen; Determine the position and / or posture of the stylus relative to the writing screen according to the positions of the stylus tip and the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen; The stylus pen comprises a first image acquisition device and a second image acquisition device, the first image acquisition device and the second image acquisition device are sequentially arranged along the length direction of the stylus pen, and the distance between the first image acquisition device and the pen tip of the stylus pen is smaller than the distance between the second image acquisition device and the pen tip of the stylus pen; the method further comprises: The position of the stylus relative to the writing screen is determined according to the writing screen boundary in the captured image, and the stylus is controlled to display the characteristic pattern in an area within a preset range facing the writing screen.

7. The control method according to claim 6, characterized in that: Also includes: Determining the pressure sensitivity value of the stylus pen according to the deformation of the stylus pen tip in the captured image; or, The pressure sensitivity value of the stylus pen is determined according to the detection value of the pressure sensor in the stylus pen.

8. The control method according to claim 6, characterized in that: Determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes: Determining that the captured image includes a writing screen boundary and does not have the characteristic pattern, and determining, according to the captured size of the writing screen boundary and the actual size of the writing screen boundary, a ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen; The position and / or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

9. The control method according to claim 6, characterized in that: The screen boundary of the writing screen is also provided with a plurality of boundary marks; wherein the boundary marks at different positions are different; and determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes: Determining that the captured image includes a boundary mark, a stylus pen tip image and no feature graphics, and determining, according to the captured size of the boundary mark and the actual size of the boundary mark, a ratio of the captured size of the boundary mark to the actual size of the boundary mark, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen; The position and / or posture of the stylus relative to the writing screen is determined based on the positions of the stylus tip and the writing screen boundary in the captured image, the ratio of the captured size of the boundary marker and the actual size of the boundary marker, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

10. The control method according to claim 6, characterized in that: The screen boundary of the writing screen is also provided with a plurality of boundary marks; wherein the boundary marks at different positions are different; and determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes: Determining that the captured image includes a boundary mark and no characteristic pattern, and determining, according to the captured size of the boundary mark and the actual size of the boundary mark, a ratio of the captured size of the boundary mark to the actual size of the boundary mark, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen; The position and / or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the writing screen boundary in the captured image, the ratio of the captured size of the boundary marker and the actual size of the boundary marker, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

11. The control method according to claim 6, characterized in that: Also includes: Determine that the captured image includes at least a partial image of the writing screen, and control the writing screen to display a characteristic graphic.

12. The control method according to claim 6, characterized in that: Determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes: Determine that the captured image includes the characteristic pattern and the image of the stylus pen tip, and determine, according to the captured size of the characteristic pattern and the actual size of the characteristic pattern, the ratio of the captured size of the characteristic pattern to the actual size of the characteristic pattern, the capturing angle of the image capturing unit, and the distance between the image capturing unit and the writing screen; The position and / or posture of the stylus relative to the writing screen is determined based on the positions of the stylus tip and the characteristic graphic in the captured image, the ratio of the captured size of the characteristic graphic and the actual size of the characteristic graphic, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

13. The control method according to claim 6, characterized in that: Determining the position and / or posture of the stylus relative to the writing screen according to the captured image includes: Determining that the captured image includes the characteristic pattern, and determining, according to the captured size of the characteristic pattern and the actual size of the characteristic pattern, a ratio of the captured size of the characteristic pattern to the actual size of the characteristic pattern, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen; The position and / or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the characteristic pattern in the captured image, the ratio of the captured size of the characteristic pattern and the actual size of the characteristic pattern, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

14. The control method according to claim 12 or 13, characterized in that: Also includes: It is determined that the pressure sensitivity value of the stylus pen is greater than a pressure sensitivity threshold, and the writing screen is controlled to display handwriting features.

15. The control method according to claim 14, characterized in that: After determining that the pressure sensitivity value of the stylus pen is greater than the pressure sensitivity threshold, the method further includes: The writing screen is controlled to eliminate the characteristic pattern.

16. The control method according to claim 14, characterized in that: Also includes: The position and / or posture of the stylus relative to the writing screen is determined according to the handwriting features in the captured image.

17. The control method according to claim 6, characterized in that: Also includes: The stylus is provided with a multi-axis sensor; and further comprises: It is determined that within a first preset time, the captured image does not include a writing screen boundary and a characteristic pattern, and the position and / or posture of the stylus relative to the writing screen is determined according to the detection value of the multi-axis sensor.

18. The control method according to claim 6, characterized in that: Also includes: It is determined that within a second preset time, the captured image does not include a writing screen boundary and a characteristic pattern, and the writing screen is controlled to display the characteristic pattern.

Images