Display device, touch control device and electronic device
By displaying multiple watermark images on the screen of the electronic device, and using the communication circuit to receive photos of the touch device and determining the touch position, the problem of high production cost of the touch function of the electronic device in the prior art is solved, and a touch function with lower cost and higher compatibility is achieved.
Patent Information
- Application Number
- CN202311137920.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-31
- Publication Date
- 2025-02-28
AI Technical Summary
In the prior art, when electronic devices realize touch control functions, the production cost is high, resulting in higher prices of electronic devices, which makes it difficult for users to accept.
By displaying images of multiple watermarks on the screen and receiving photos taken by the camera of the touch device using a communication circuit, including some images with watermarks, to determine the touch position and realize the touch function.
It reduces production costs, reduces the price of display equipment, and improves product compatibility and aesthetics, making it easier for users to accept.
Smart Images

Figure CN119536541A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of electronic devices, and in particular to a display device, a touch device and an electronic device. Background Art
[0002] Controlling electronic devices such as smartphones and tablets through touch operation is very intuitive and convenient, and the user experience is good. At present, electronic devices with small and medium screens provide users with touch functions by using glass substrates with touch functions. Electronic devices with large screens provide users with touch functions by installing infrared array transmitters and receivers on the edge of the screen.
[0003] However, using a glass substrate with a touch function, or installing an infrared array transmitter and receiver on the edge of the screen, will lead to higher production costs of electronic devices and higher prices for electronic devices, which is difficult for users to accept. Summary of the invention
[0004] The embodiments of the present application provide a display device, a touch device and an electronic device, which solve the problem in the prior art that when electronic devices realize the touch function, the production cost is high, resulting in a high price of the electronic devices.
[0005] In order to achieve the above purpose, the embodiment of the present application adopts the following technical solution:
[0006] In a first aspect of an embodiment of the present application, a display device is provided, the display device comprising a screen and a communication circuit coupled to the screen. The screen is used to display an image including multiple watermarks. The communication circuit is used to receive at least one photo, the at least one photo being a photo generated by a camera in a touch device taking an image displayed on the screen, any one of the at least one photo comprising a partial image of the image displayed on the screen, the partial image comprising at least one watermark.
[0007] Optionally, the above-mentioned communication circuit may be a wired communication circuit, or may be a wireless communication circuit, which is not limited in the embodiments of the present application.
[0008] Optionally, the display device may be any electronic device such as a smart phone, a tablet computer, a large conference screen, a television, etc. The embodiment of the present application does not limit the specific type of the display device.
[0009] Optionally, the touch device may be a stylus, or an electronic device such as a mobile phone including at least one camera. The embodiment of the present application does not limit the specific type of the touch device.
[0010] Optionally, the multiple watermarks may include characters such as numbers and letters, which is not limited in this embodiment of the present application.
[0011] Based on this solution, first, an image including multiple watermarks is displayed on the screen. Then, at least one photo is received through a communication circuit. The at least one photo is a photo generated by a camera in a touch device, and the at least one photo includes a partial image of the image displayed on the screen, and the partial image includes at least one watermark. Thus, the display device can determine the touch position of the touch device in the screen according to the watermark in the at least one photo to realize the touch function. It can be understood that compared with the prior art of using a glass substrate with a touch function to realize the touch function, or installing an infrared array transmitter and receiver on the edge of the screen to realize the touch function, the display device provided by the embodiment of the present application does not need to customize corresponding devices for screens of different sizes when realizing the touch function, so it has better compatibility, can reduce production costs, reduce the price of the display device, and is more conducive to the promotion and application of the product. At the same time, it will not cause a wider frame at the edge of the screen, and a narrow frame design can be realized, and the display device can be more beautiful.
[0012] In combination with the first aspect, in a possible implementation, the image displayed in the above screen also includes an original image, and multiple watermarks are spread over the original image using a preset encoding method. The original image includes multiple areas, and the multiple areas correspond to the multiple watermarks.
[0013] Based on this solution, the image displayed on the screen includes an original image, which includes multiple areas, and the multiple areas correspond to multiple watermarks. Therefore, the display device can first determine the corresponding area according to the watermark in the at least one photo, and then determine the pixel position of the touch operation on the screen through image recognition based on the image of the area and the image displayed on the screen, so as to more accurately determine the touch pixel position of the touch operation on the screen and realize precise touch.
[0014] In combination with the first aspect, in a possible implementation manner, the multiple watermarks are all blind watermarks.
[0015] Based on this solution, by adopting blind watermark, the user's viewing effect will not be affected, and the user experience can be improved.
[0016] In combination with the first aspect, in a possible implementation manner, the communication circuit is specifically used to receive at least one photo within a preset time.
[0017] Based on this solution, at least one photo is received within a preset time through a communication circuit, so that the display device can determine different numbers of positions based on the different numbers of at least one photo received within the preset time, and determine a variety of different touch operations based on the different numbers of photos and the different numbers of positions.
[0018] In conjunction with the first aspect, in a possible implementation, the touch device is a stylus pen, and the at least one photo includes a first group of photos or a second group of photos. The communication circuit is further used to receive the first group of photos, where the first group of photos is photos taken by a first camera disposed at the tip of the stylus pen, or the communication circuit is further used to receive the second group of photos, where the second group of photos is photos taken by a second camera disposed at the end of the stylus pen.
[0019] Optionally, the first group of photos and the second group of photos may be used to implement a writing function, or may be used to implement an erasing function, which is not limited in the embodiments of the present application.
[0020] Based on this solution, a first group of photos is received through a communication circuit, and the first group of photos is photos taken by a first camera set at the tip of the stylus pen, or a second group of photos is received, and the second group of photos is photos taken by a second camera set at the end of the pen holder of the stylus pen. Thus, the display device can implement a writing function based on the first group of photos and an erasing function based on the second group of photos. The tip of the stylus pen can be used to implement a writing function, and the end of the pen holder can be used to implement an erasing function, which is more in line with the user's writing habits and can improve the user experience.
[0021] In combination with the first aspect, in a possible implementation, the communication circuit is also used to receive a first pressure value, which is the pressure value of the pen tip detected by the pressure sensor in the stylus, or the communication circuit is also used to receive a second pressure value, which is the pressure value of the tail of the pen detected by the pressure sensor.
[0022] Based on this solution, the pressure value between the stylus pen and the screen detected by the pressure sensor is received through the communication circuit, and the display device can adjust the parameters of the writing function or the erasing function according to the pressure value, so that the user can realize the drawing and writing functions more flexibly, which can improve the user experience.
[0023] In combination with the first aspect, in a possible implementation manner, the communication circuit is further used to receive acceleration values and angular momentum.
[0024] Based on this solution, the acceleration value and angular momentum are received through the communication circuit, and the acceleration value and angular momentum are used to predict the movement trend of the touch device. The display device predicts the movement trend of the touch device based on the acceleration value and angular momentum, thereby predicting the touch operation between the touch device and the screen, which can achieve low-latency touch operation and improve user experience.
[0025] In a second aspect of an embodiment of the present application, a touch device is provided, the touch device comprising at least one camera and a communication circuit coupled to the at least one camera. The at least one camera is used to capture an image displayed on a screen to generate at least one photo, the image comprising multiple watermarks, and any one of the at least one photo comprises a partial image of the image, the partial image comprising at least one watermark. The communication circuit is used to send the at least one photo.
[0026] Optionally, the above-mentioned communication circuit may be a wired communication circuit, or may be a wireless communication circuit, which is not limited in the embodiments of the present application.
[0027] In combination with the second aspect, in a possible implementation, the image displayed in the above screen also includes an original image, multiple watermarks are spread over the original image using a preset encoding method, the original image includes multiple areas, and the multiple areas correspond to the multiple watermarks.
[0028] In combination with the second aspect, in a possible implementation manner, the multiple watermarks are all blind watermarks.
[0029] In conjunction with the second aspect, in a possible implementation, the touch device is a stylus pen, the stylus pen includes a pen tip and a pen holder connected to the pen tip, the at least one camera includes a first camera and a second camera, the first camera is arranged at the pen tip, and the second camera is arranged at the end of the pen holder, and the at least one photo includes a first group of photos or a second group of photos. The first camera is used to capture images to generate a first group of photos, and the second camera is used to capture images to generate a second group of photos. The communication circuit is also used to send the first group of photos, or to send the second group of photos.
[0030] In conjunction with the second aspect, in a possible implementation, the stylus pen further includes a pressure sensor, which is coupled to the communication circuit. The pressure sensor is used to detect a first pressure value of the pen tip, or to detect a second pressure value of the pen end. The communication circuit is used to send the first pressure value, or to send the second pressure value.
[0031] In conjunction with the second aspect, in a possible implementation, the touch control device further includes an accelerometer coupled to the communication circuit. The accelerometer is used to detect the acceleration value and angular momentum of the touch control device, and the communication circuit is also used to send the acceleration value and angular momentum.
[0032] According to a third aspect of an embodiment of the present application, a method for controlling a display device is provided, the method comprising: displaying an image including multiple watermarks on a screen, receiving at least one photo, wherein at least one photo is a photo generated by taking a photo of the image displayed on the screen by a camera in a touch device, and any one of the at least one photo includes a partial image of the image, and the partial image includes at least one watermark.
[0033] In combination with the third aspect, in a possible embodiment, the image displayed in the above screen also includes an original image, and multiple watermarks are spread over the original image using a preset encoding method. The original image includes multiple areas, and the multiple areas correspond to the multiple watermarks.
[0034] In combination with the third aspect, in a possible embodiment, the multiple watermarks are all blind watermarks.
[0035] In combination with the third aspect, in a possible embodiment, the receiving of at least one photo includes: receiving at least one photo within a preset time.
[0036] In combination with the third aspect, in a possible embodiment, the touch device is a stylus, at least one photo includes a first group of photos or a second group of photos, and receiving at least one photo includes: receiving the first group of photos, the first group of photos being photos taken by a first camera disposed at the tip of the stylus, or receiving the second group of photos, the second group of photos being photos taken by a second camera disposed at the end of the pen shaft of the stylus.
[0037] In combination with the third aspect, in a possible embodiment, the method also includes: receiving a first pressure value, which is the pressure value of the pen tip detected by a pressure sensor in the stylus, or receiving a second pressure value, which is the pressure value of the tail of the pen detected by the pressure sensor.
[0038] In combination with the third aspect, in a possible embodiment, the method further includes: receiving an acceleration value and an angular momentum.
[0039] In a fourth aspect of an embodiment of the present application, an electronic device is provided, comprising a display device and a touch device, wherein the display device is the display device as described in the first aspect or any possible implementation of the first aspect, and the touch device is the touch device as described in the second aspect or any possible implementation of the second aspect.
[0040] In a fifth aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program. When the computer program runs on a display device, the display device executes the steps in the method for controlling the display device as described in the third aspect or any possible implementation of the third aspect.
[0041] In a sixth aspect of the embodiments of the present application, a computer program product is provided. When the computer program product runs on a processor, the processor executes the steps in the method for controlling a display device as described in the third aspect or any possible implementation of the third aspect.
[0042] The descriptions of the second to sixth aspects of the present application can refer to the detailed description of the first aspect; and the beneficial effects described in the second to sixth aspects can refer to the beneficial effect analysis of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] Figure 1 A schematic diagram of the structure of a display device and a touch device provided in an embodiment of the present application;
[0044] Figure 2 A schematic diagram of the structure of another display device provided in an embodiment of the present application;
[0045] Figure 3 A schematic diagram of a process of adding a blind watermark provided in an embodiment of the present application;
[0046] Figure 4 A schematic diagram of the structure of a display device and a stylus pen provided in an embodiment of the present application;
[0047] Figure 5 A schematic diagram of the structure of another display device and a stylus provided in an embodiment of the present application;
[0048] Figure 6 A schematic flow chart of a method for controlling a display device provided in an embodiment of the present application;
[0049] Figure 7 A schematic flow chart of another method for controlling a display device provided in an embodiment of the present application;
[0050] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0051] The following will discuss the making and use of various embodiments in detail. However, it should be understood that many applicable inventive concepts provided by this application can be implemented in a variety of specific environments. The specific embodiments discussed are only illustrative of specific ways to implement and use this description and this technology, and do not limit the scope of this application.
[0052] Unless defined otherwise, all technical and scientific terms used herein have the same meanings as commonly understood by one of ordinary skill in the art.
[0053] Various circuits or other components may be described or referred to as being "configured to" perform one or more tasks. In this case, "configured to" is used to imply structure by indicating that the circuit / component includes structure (e.g., circuitry) that performs the one or more tasks during operation. Thus, even when the specified circuit / component is not currently operational (e.g., not turned on), the circuit / component may be referred to as being configured to perform the task. Circuits / components used with the phrase "configured to" include hardware, such as circuits that perform an operation, etc.
[0054] The technical scheme in the embodiment of the present application will be described below in conjunction with the accompanying drawings in the embodiment of the present application. In the present application, "at least one" refers to one or more, and "multiple" refers to two or more. "And / or" describes the association relationship of the associated objects, indicating that there may be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one of the following" or its similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c or a, b and c, where a, b and c can be single or multiple. In addition, in the embodiment of the present application, the words "first", "second" and the like do not limit the quantity and order.
[0055] It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0056] Before introducing the embodiments of the present application, the technical terms and background technologies involved in the present application are first introduced.
[0057] Stylus: A pen-shaped tool used for touch operations on the screens of electronic devices such as smartphones and tablets, which can replace fingers to touch the screen.
[0058] Blind watermark: refers to a watermark that is invisible to humans, and can also be called a digital blind watermark. An image with a blind watermark can be called a blind watermark image. Methods for adding blind watermarks to images include spatial domain methods and frequency domain methods. Although these two methods add redundant information to the original image, the size of the original image will not change if the encoding and compression methods remain unchanged. Among them, the spatial domain refers to the spatial domain. The images we see in daily life can be regarded as spatial domain representations. The spatial domain method refers to directly operating the image in the spatial domain, such as directly superimposing the watermark on the image. The frequency domain method refers to transforming the image to the frequency domain (wavelet domain) through some transformation means (such as Fourier transform, discrete cosine transform, wavelet transform, etc.), adding a watermark to the image in the frequency domain, and then converting the image to the spatial domain through inverse transformation. Compared with the spatial domain method, the frequency domain method is more concealed and more resistant to attacks.
[0059] Input driver: The input driver is used to read or receive input information from input devices (such as keyboard, mouse, stylus, etc.), then convert the input information into events that the operating system can understand, and finally distribute the events to the operating system or other applications for processing.
[0060] Controlling electronic devices such as smartphones and tablets through touch operation is very intuitive and convenient. Even babies who cannot speak can control electronic devices through touch operation. The user experience is good, so it has been widely used in various fields. At present, electronic devices with small and medium screens, such as smartphones and tablets, provide users with touch functions by adopting glass substrates with touch functions. Electronic devices with large screens, such as large conference screens, provide users with touch functions by installing infrared array transmitters and receivers on the edge of the screen.
[0061] However, for screens of different sizes, a glass substrate with a touch function is used to realize the touch function, and it is necessary to customize the glass substrate with a touch function of the corresponding size, which will lead to high production costs. The infrared array transmitter and receiver are installed on the edge of the screen to realize the touch function, and it is necessary to customize the infrared array transmitter and receiver of the corresponding size, which will also lead to high production costs. Secondly, for large-sized screens, the use of these two methods to realize the touch function will lead to high production costs. In addition, installing the infrared array transmitter and receiver on the edge of the screen will also lead to a wider border on the edge of the screen, and a narrow border design cannot be achieved, resulting in the electronic device not being beautiful enough. In summary, when providing the touch function to users, these two methods have poor compatibility and high costs, resulting in higher prices for electronic equipment, which will make it difficult for users to accept and is not conducive to the promotion and application of the product.
[0062] In order to solve the problem that the above two methods have poor compatibility and high cost when realizing the touch function, resulting in high prices of electronic devices, the embodiment of the present application provides a display device and a touch device, which can realize the touch function, and has good compatibility and low cost, which can reduce the price and is more acceptable to users.
[0063] like Figure 1 As shown in (a), it is a schematic diagram of the structure of a display device 100 and a touch device 200 provided in an embodiment of the present application. The display device 100 includes a screen 110 and a first communication circuit 120 coupled to the screen 110, and the touch device 200 includes at least one camera 210 and a second communication circuit 220 coupled to the at least one camera 210. The embodiment of the present application does not limit the specific number of cameras included in the at least one camera 210.
[0064] Among them, the screen 110 is used to display an image including multiple watermarks. At least one camera 210 is used to capture the image displayed on the screen 110 to generate at least one photo, any one of the at least one photo includes a partial image of the image displayed on the screen 110, and the partial image includes at least one watermark. The embodiment of the present application does not limit the specific number of photos included in the at least one photo and the specific number of watermarks included in the partial image. The second communication circuit 220 is used to send the at least one photo, and the first communication circuit 120 is used to receive the at least one photo. Thereby, the display device 100 can determine the position of the touch operation in the display device 100 according to the watermark in the at least one photo to realize the touch function.
[0065] Optionally, the display device 100 determines the position of the touch operation in the display device 100 according to the watermark in the at least one photo, and the processor in the display device 100 can determine the position of the touch operation in the screen 110 according to the watermark in the at least one photo. Alternatively, the display device 100 can transmit the at least one photo to a server in the cloud, and the server determines the position of the touch operation in the screen 110. The server sends the touch position information to the display device 100, and the display device 100 determines the position of the touch operation in the screen 110 according to the position information. This embodiment of the present application is not limited to this. Figure 1 As shown in (a), the following embodiments of the present application are described by taking as an example that the display device 100 also includes a processor 130 coupled to the first communication circuit 120, and the processor 130 is used to determine the position of the touch operation on the screen 110 according to the watermark in the at least one photo.
[0066] For example, the screen 110 displays Figure 1As an example, the image shown in (a) includes a cylindrical image and 16 watermarks from "1" to "16". At least one camera 210 in the touch device 200 can capture the image to generate Figure 1 The second communication circuit 220 can send the photo shown in (b) in FIG. 1 . The first communication circuit 120 in the display device 100 can receive the photo, so that the processor 130 in the display device 100 can determine the touch position in the screen 110 according to the watermarks "6", "7", "8", "10", "11", "12", "14", "15" and "16" in the photo to implement the touch function.
[0067] In a possible embodiment, the processor 130 in the display device 100 may be a system on chip (SOC), and the embodiment of the present application does not limit the specific type of the processor 130 .
[0068] In a possible embodiment, the touch device 200 may capture an image displayed on the screen 110 in response to a touch operation performed by the user on the screen 110 through the touch device 200 to generate the at least one photo.
[0069] Optionally, the first communication circuit 120 and the second communication circuit 220 may be wired communication circuits, or may be wireless communication circuits. The embodiments of the present application do not limit this. In the following embodiments, the first communication circuit 120 and the second communication circuit 220 are wireless communication circuits for illustrative explanation.
[0070] In a possible embodiment, at least one camera 210 in the above-mentioned touch device 200 can be a miniature wide-angle camera, so that at least one camera 210 can capture more parts of the image displayed on the screen 110, and at least one photo can include more parts of the image. The processor 130 in the display device 100 can determine the touch position in the screen 110 more quickly and accurately based on the at least one photo.
[0071] Optionally, the display device 100 may be any electronic device such as a smart phone, a tablet computer, a large conference screen, a television, etc. The embodiment of the present application does not limit the specific type of the display device 100.
[0072] Optionally, the touch device 200 may be a stylus pen, or an electronic device such as a mobile phone that includes at least one camera. The embodiment of the present application does not limit the specific type of the touch device 200. The following embodiment takes the touch device 200 as a stylus pen for illustrative description.
[0073] Optionally, the multiple watermarks may include characters such as numbers and letters, which is not limited in the embodiment of the present application. The embodiment of the present application is illustrative by taking the multiple watermarks including numbers as an example.
[0074] In a possible embodiment, the above-mentioned multiple watermarks are all blind watermarks. By adopting blind watermarks, the user's viewing effect of the image will not be affected, and the user experience can be improved. In the following embodiments of this application, the multiple watermarks are taken as blind watermarks as an example for illustrative explanation.
[0075] In a possible embodiment, Figure 2 As shown in (a), the image displayed on the screen 110 also includes an original image. The multiple watermarks are distributed in the original image using a preset encoding method. The original image includes multiple areas, and the multiple areas correspond to the multiple watermarks.
[0076] In a possible embodiment, when the multiple watermarks include numbers, the above-mentioned preset encoding method can be encoding in a manner of encoding numbers from small to large, or can be encoding in a manner of encoding numbers from large to small. The embodiment of the present application is not limited to this. The embodiment of the present application takes the preset encoding method of encoding numbers from small to large as an example for illustrative explanation.
[0077] In a possible embodiment, the multiple watermarks may be spread over the original image in the order from left to right and from top to bottom, or may be spread over the original image in other orders. The embodiment of the present application is not limited to this. The embodiment of the present application takes the example of the multiple watermarks being spread over the original image in the order from left to right and from top to bottom as an example for illustrative explanation.
[0078] For example, the screen 110 may display Figure 2 The image shown in (a) in the figure includes an original image and 16 blind watermarks distributed throughout the original image using a preset coding method. The original image includes 16 regions, and the 16 regions correspond to the 16 blind watermarks. The original image includes a cylindrical image, and the 16 blind watermarks are respectively "1" to "16". The 16 blind watermarks are encoded in order from small to large, and the 16 blind watermarks are distributed throughout the original image from left to right and from top to bottom. At this time, the at least one photo can be Figure 2For the photo shown in (b) in FIG. 1 , the processor 130 in the display device 100 can determine that the area touched by the touch operation on the screen 110 is the area corresponding to the blind watermark “11” according to the blind watermarks “6”, “7”, “8”, “10”, “11”, “12”, “14”, “15” and “16” in the photo, and then determine the position of the touch operation on the screen 110 through image recognition according to the image of the area corresponding to the blind watermark “11” and the image displayed on the screen 110, which is Figure 2 The touch pixel position shown in (b) in FIG. 1 can thereby more accurately determine the touch pixel position of the touch operation on the screen 110 , thereby achieving precise touch.
[0079] In a possible embodiment, the processor 130 in the display device 100 may be configured to add a blind watermark to an original image to generate the image displayed on the screen 110 .
[0080] For example, Figure 3 As shown, taking the user interface (UI) displaying the original image, which includes a cylindrical image as an example, the processor 130 can divide the original image into 16 areas, and add the 16 blind watermarks "1" to "16" to the original image to generate the image displayed on the screen 110, and display (display, DISP) on the screen 110.
[0081] Optionally, the processor 130 may use a spatial domain method to add a blind watermark to the original image, or may use a frequency domain method to add a blind watermark to the original image, which is not limited in the embodiments of the present application.
[0082] In a possible embodiment, the first communication circuit 120 in the display device 100 is specifically used to receive at least one photo within a preset time. Therefore, the processor 130 in the display device 100 can determine different numbers of positions according to the different numbers of at least one photo received within the preset time, and determine a variety of different touch operations according to the different numbers of photos and different numbers of positions. The various possible embodiments are described in detail below.
[0083] In a first possible embodiment, the at least one photo may include one photo. The first communication circuit 120 is specifically configured to receive one photo within a preset time. The processor 130 is specifically configured to determine a position according to the one photo and the image displayed on the screen 110, and to determine that the corresponding touch operation is a single-click operation according to the number of the one photo being 1 and the one position.
[0084] For example, the first communication circuit 120 may receive Figure 1The processor 130 may be configured to Figure 1 The photo shown in (b) and the image displayed on the screen 110 determine the position of the touch operation on the screen 110 as Figure 1 Further, the display device 100 may determine that the corresponding touch operation is a single-click operation according to the number of the photo being 1 and the 1 touch position.
[0085] In a second possible embodiment, the at least one photo may include M photos, where M is a positive integer greater than 1, and the embodiment of the present application does not limit the specific value of M. The first communication circuit 120 is specifically configured to receive the M photos within a preset time. The processor 130 is specifically configured to determine a position according to the M photos and an image displayed on the screen 110, and determine that the corresponding touch operation is an M-click operation according to the number M of the M photos and a position.
[0086] For example, the first communication circuit 120 may receive two photos within a preset time, and the processor 130 may determine one touch position of the touch operation on the screen 110 based on the two photos and the image displayed on the screen 110. Further, the processor 130 may determine that the corresponding touch operation is a double-click operation based on the number of the two photos and the one touch position. It is understandable that when the number of M is 3 or 4, the processor 130 may determine that the corresponding touch operation is a triple-click operation or a quadruple-click operation, which is not described in detail in the embodiments of the present application.
[0087] In a third possible embodiment, the at least one photo may include N photos, where N is a positive integer, and N is greater than M. The embodiment of the present application does not limit the specific value of N. The first communication circuit 120 is specifically configured to receive the N photos within a preset time. The processor 130 is specifically configured to determine a position according to the N photos and the image displayed on the screen 110, and determine that the corresponding touch operation is a long press operation according to the number N of the N photos and the one position.
[0088] For example, the first communication circuit 120 may receive 10 photos within a preset time, and the processor 130 may determine a touch position of the touch operation on the screen 110 based on the 10 photos and the image displayed on the screen 110. Further, the processor 130 may determine that the corresponding touch operation is a long press operation based on the number of the photos being 10 and the 1 touch position.
[0089] In a fourth possible embodiment, the at least one photo may include multiple photos, and the embodiment of the present application does not limit the specific number of the multiple photos. The first communication circuit 120 is specifically configured to receive the multiple photos within a preset time. The processor 130 is specifically configured to determine multiple positions based on the multiple photos and the image displayed on the screen 110, and determine that the corresponding touch operation is a drag operation based on the number of the multiple photos and the multiple positions.
[0090] For example, the first communication circuit 120 may receive 15 photos within a preset time, and the processor 130 may determine 15 touch positions of the touch operation on the screen 110 according to the 15 photos and the image displayed on the screen 110. Further, the processor 130 may determine that the corresponding touch operation is a drag operation according to the number of the 15 photos and the 15 touch positions.
[0091] In a possible embodiment, the display device 100 may send a corresponding touch event through an input driver according to a determined touch operation, for example, may send a corresponding touch event to an operating system running on the processor 130 through an input driver, thereby implementing a touch function.
[0092] The display device 100 and the touch device 200 provided in the embodiment of the present application first display an image on the screen 110 of the display device 100. Then, the image displayed on the screen 110 is photographed by the camera in the touch device 200 to generate at least one photo, any one of which includes a partial image of the image, and the partial image includes at least one watermark. Secondly, the at least one photo is sent through the second communication circuit 220 in the touch device 200. Finally, the at least one photo is received through the first communication circuit 120 in the display device 100. Thus, the display device 100 can determine the touch position of the touch device 200 in the screen 110 according to the watermark in the at least one photo to realize the touch function. It can be understood that compared with the prior art that uses a glass substrate with a touch function to realize the touch function, or that uses an infrared array transmitter and a receiver installed on the edge of the screen to realize the touch function, the display device 100 and the touch device 200 provided in the embodiment of the present application do not need to customize corresponding devices for screens 110 of different sizes when realizing the touch function, so the compatibility is better, the production cost can be reduced, the price of the display device 100 can be reduced, and it is more conducive to the promotion and application of the product. At the same time, it will not cause a wider frame at the edge of the screen 110, and a narrow frame design can be realized, and the display device 100 can be more beautiful.
[0093] In a possible embodiment, Figure 4As shown, the touch device 200 is a stylus pen 400, which includes a pen tip 410 and a pen holder 420 connected to the pen tip 410. The stylus pen 400 also includes a third communication circuit 440, and a first camera 431 and a second camera 432 coupled to the third communication circuit 440. The first camera 431 is arranged at the pen tip 410, and the second camera 432 is arranged at the tail of the pen holder 420. The at least one photo includes a first group of photos or a second group of photos. The embodiment of the present application does not limit the specific number of photos included in the first group of photos and the second group of photos.
[0094] The first camera 431 is used to capture the image displayed on the screen 110 to generate a first set of photos, and the second camera 432 is used to capture the image displayed on the screen 110 to generate a second set of photos. The third communication circuit 440 is used to send the first set of photos, or send the second set of photos.
[0095] Optionally, the first group of photos and the second group of photos can be used to implement a writing function, or can be used to implement an erasing function. The embodiments of the present application do not limit this. In the following embodiments of the present application, the first group of photos is used to implement a writing function, and the second group of photos is used to implement an erasing function as an example for illustrative explanation.
[0096] In a possible embodiment, the first communication circuit 120 in the display device 100 is further used to receive the first group of photos, and the processor 130 is further used to determine the first value position of the touch control in the screen 110 according to the first group of photos and the image displayed on the screen 110, and implement the writing function according to the first value position. It can be understood that when the user writes more, the first group of photos includes more photos, and the first value is larger. The embodiment of the present application does not limit the specific value of the first value.
[0097] In a possible embodiment, the first communication circuit 120 in the display device 100 is further used to receive a second group of photos, and the processor 130 is further used to determine a second value number of positions touched on the screen 110 according to the second group of photos and the image displayed on the screen 110, and implement the erasing function according to the second value number of positions. It can be understood that when the user erases more, the second group of photos includes more photos, and the second value is larger. The embodiment of the present application does not limit the specific value of the second value.
[0098] It can be understood that the first group of photos are photos taken by the first camera 431 set at the pen tip 410 of the stylus pen 400, and the second group of photos are photos taken by the second camera set at the tail of the pen shaft 420 of the stylus pen 400. Therefore, the pen tip 410 of the stylus pen 400 can be used to realize the writing function, and the tail of the pen shaft 420 can be used to realize the erasing function, which is more in line with the user's writing habits and can improve the user experience.
[0099] In a possible embodiment, the tip 410 and the pen body 420 of the stylus pen 400 may be made of transparent materials, the first camera 431 may be arranged inside the tip 410, and the second camera 432 may be arranged inside the pen body 420. The embodiment of the present application does not limit the specific materials of the tip 410 and the pen body 420, and does not limit the specific locations of the first camera 431 and the second camera 432. Figure 4 As shown, the embodiment of the present application is exemplified by taking the example that the first camera 431 is arranged inside the pen tip 410 and the second camera 432 is arranged at the tail of the pen shaft 420.
[0100] In a possible embodiment, the first group of photos also includes identification information of the first camera 431, and the second group of photos also includes identification information of the second camera 432. The processor 130 in the display device 100 can distinguish the first group of photos and the second group of photos based on the identification information in the first group of photos or the second group of photos, so that the first group of photos can be used to implement a writing function, and the second group of photos can be used to implement an erasing function.
[0101] The display device 100 and the touch device 200 provided in the embodiment of the present application firstly generate a first set of photos by shooting the image displayed on the screen 110 through the first camera 431, and generate a second set of photos by shooting the image displayed on the screen 110 through the second camera 432. Then, the first set of photos is sent through the third communication circuit 440, or the second set of photos is sent. Finally, the first set of photos is received through the first communication circuit 120, or the second set of photos is received. Thus, the display device 100 can implement the writing function according to the first set of photos, and implement the erasing function according to the second set of photos, so that the pen tip 410 of the stylus 400 can be used to implement the writing function, and the tail of the pen shaft 420 can be used to implement the erasing function, which is more in line with the user's writing habits and can improve the user experience.
[0102] like Figure 4As shown, in a possible embodiment, the stylus pen 400 further includes a pressure sensor 450, and the pressure sensor 450 is coupled to the third communication circuit 440. The pressure sensor 450 is used to detect a first pressure value of the pen tip 410, or to detect a second pressure value of the tail of the pen shaft 420. The third communication circuit 440 is also used to send the first pressure value or the second pressure value.
[0103] Optionally, the first pressure value can be used to adjust the parameters of the above-mentioned writing function, which include the thickness of the handwriting and the depth of the color, and the second pressure value can be used to adjust the parameters of the above-mentioned erasing function, which include the erasing radius. Alternatively, the first pressure value and the second pressure value can also be used to implement touch operations such as zooming in and scrolling. The embodiment of the present application does not limit what functions the first pressure value and the second pressure value are used to implement. The embodiment of the present application takes the first pressure value being used to adjust the parameters of the writing function and the second pressure value being used to adjust the parameters of the erasing function as an example for illustrative description.
[0104] The first communication circuit 120 in the display device 100 is also used to receive the first pressure value or the second pressure value. The processor 130 is also used to adjust the parameters of the writing function according to the first pressure value, or adjust the parameters of the erasing function according to the second pressure value. The specific process of the processor 130 adjusting the parameters of the writing function or adjusting the parameters of the erasing function according to the first pressure value or the second pressure value can refer to the prior art, and the embodiments of the present application are not repeated here.
[0105] In a possible embodiment, the first pressure value and the second pressure value can also be used to distinguish the first group of photos and the second group of photos. The processor 130 in the display device 100 can determine that the received photos are the first group of photos based on the received first pressure value, or the processor 130 can determine that the received photos are the second group of photos based on the received second pressure value, thereby implementing a writing operation based on the first group of photos and implementing an erasing operation based on the second group of photos.
[0106] Optionally, when the pressure sensor 450 is used to detect a first pressure value of the pen tip 410, the pressure sensor 450 can be set inside the pen tip 410; when the pressure sensor is used to detect a second pressure value at the tail of the pen shaft 420, the pressure sensor can be set at the tail of the pen shaft 420. The embodiment of the present application does not limit the specific location of the pressure sensor 450.
[0107] Optionally, the stylus 400 may include one pressure sensor 450, or may include multiple pressure sensors 450. The embodiment of the present application does not limit the specific number of pressure sensors 450 included in the stylus 400. The following embodiment of the present application uses the example of the stylus 400 including two pressure sensors for illustrative description.
[0108] For example, Figure 5 As shown, taking the stylus including the first pressure sensor 451 and the second pressure sensor 452 as an example, the first pressure sensor 451 can be used to detect a first pressure value of the pen tip 410, and the second pressure sensor 452 can be used to detect a second pressure value of the tail of the pen shaft 420.
[0109] In a possible embodiment, Figure 4 As shown, the stylus pen 400 may further include a processor 460 coupled to the pressure sensor 450. The processor 460 is used to determine, based on the first pressure value, to start the first camera 431 to capture the image displayed on the screen 110 to generate the first set of photos, or, based on the second pressure value, to determine to start the second camera 432 to capture the image displayed on the screen 110 to generate the second set of photos.
[0110] Exemplarily, the processor 460 in the stylus 400 can determine to start the first camera 431 when the first pressure value is greater than a preset pressure value, or can determine to start the second camera 432 when the second pressure value is greater than a preset pressure value. The embodiments of the present application do not limit the specific value of the preset pressure value.
[0111] In a possible embodiment, the processor 460 in the stylus pen 400 may be a microcontroller unit (MCU), which may also be called a single-chip microcomputer. The embodiment of the present application does not limit the specific type of the processor 460 .
[0112] The display device 100 provided in the embodiment of the present application receives the pressure value between the stylus 400 and the screen 110 detected by the pressure sensor 450 through the first communication circuit 120, and the processor 130 can adjust the parameters of the writing function or the erasing function according to the pressure value, so that the user can realize the drawing and writing functions more flexibly, which can improve the user experience.
[0113] like Figure 5As shown, in a possible embodiment, the stylus 400 further includes an accelerometer 470, which is coupled to the third communication circuit 440. The accelerometer 470 is used to detect the acceleration value and angular momentum of the stylus 400, and the acceleration value and angular momentum are used to predict the movement trend of the stylus 400. The third communication circuit 440 is also used to send the acceleration value and angular momentum.
[0114] The first communication circuit 120 in the display device 100 is also used to receive the above-mentioned acceleration value and angular momentum, and the processor 130 is also used to predict the movement trend of the stylus 400 based on the acceleration value and angular momentum, thereby predicting the touch operation between the tip 410 or the tail of the pen shaft 420 of the stylus 400 and the screen 110, so as to achieve low-latency touch operation and improve user experience.
[0115] Specifically, the acceleration value is used to indicate the acceleration of the stylus pen 400 when it moves in a certain direction, and the angular momentum is used to indicate the moving direction of the stylus pen 400 .
[0116] For example, when a user uses the stylus 400 to write on the screen 110, the acceleration value and angular momentum of the pen tip 410 can be detected by the accelerometer 470, and the third communication circuit 440 can send the acceleration value and angular momentum. The first communication circuit 120 in the display device 100 can receive the acceleration value and angular momentum, and the processor 130 can predict the movement trend of the pen tip 410 based on the acceleration value and angular momentum, thereby predicting the touch operation between the pen tip 410 and the screen 110, and quickly responding to the touch operation between the pen tip 410 and the screen 110 based on the predicted result, so as to achieve a low-latency writing operation. When the user uses the stylus 400 to erase on the screen, the above description can be referred to, and the embodiments of the present application will not be repeated here.
[0117] In a possible embodiment, since the stylus pen 400 provided in the embodiment of the present application includes an accelerometer 470 , the stylus pen 400 can also be used as a handheld sensor for somatosensory or sports games.
[0118] The display device 100 provided in the embodiment of the present application receives acceleration values and angular momentum through the first communication circuit 120. The acceleration values and angular momentum are used to predict the movement trend of the stylus 400. The processor 130 predicts the movement trend of the stylus 400 based on the acceleration values and angular momentum, thereby predicting the touch operation between the stylus 400 and the screen 110. Therefore, low-latency touch operation can be achieved, which can improve user experience.
[0119] like Figure 5As shown, in a possible embodiment, the stylus pen 400 further includes a first induction coil 480 and a battery 490 disposed inside the pen body 420, the first induction coil 480 is coupled to the battery 490, and the battery 490 is coupled to the first camera 431, the second camera 432, the third communication circuit 440, the first pressure sensor 451, the second pressure sensor 452, the processor 460, and the accelerometer 470. The display device 100 further includes a second induction coil 140 coupled to the processor 130.
[0120] The second induction coil 140 in the display device 100 is used to output an electromagnetic field, and the first induction coil 480 in the stylus 400 is used to obtain the magnetic field energy of the electromagnetic field and provide charging power to the battery 490. The battery 490 is used to provide power to the first camera 431, the second camera 432, the third communication circuit 440, the first pressure sensor 451, the second pressure sensor 452, the processor 460 and the accelerometer 470.
[0121] In a possible embodiment, the first communication circuit 120 in the display device 100 can be used to output an electromagnetic field, and the third communication circuit 440 in the stylus pen can obtain the magnetic field energy in the electromagnetic field to provide charging power to the battery 490. The first induction coil 480 may not be provided in the stylus pen 400, and the second induction coil 140 may not be provided in the display device 100, thereby further reducing the production cost of the display device 100 and the stylus pen 400.
[0122] In a possible embodiment, the first induction coil 480 and the second induction coil 140 may also be used to implement pen-lifting sensing. When the stylus 400 is away from the display device 100, for example, when the user picks up the stylus 400 from the display device 100, the processor 130 may determine that the position of the stylus 400 is away from the display device 100 based on the change of the induced current in the first induction coil 480. The specific process may refer to the prior art, and the embodiments of the present application will not be described in detail herein.
[0123] The stylus pen 400 provided in the embodiment of the present application, by setting a coupled first induction coil 480 and a battery 490 inside the pen body 420, can obtain the electromagnetic field output by the second induction coil 140 in the display device 100 through the first induction coil 480, and can provide charging power to the battery 490, thereby realizing wireless charging, which is more convenient for users to use and provides a better experience.
[0124] like Figure 5 As shown, in a possible embodiment, the stylus pen 400 further includes a first magnet 4100 disposed inside the pen body 420 , and the display device 100 further includes a second magnet 150 , and the first magnet 4100 is used to adsorb with the second magnet 150 to fix the stylus pen 400 .
[0125] The stylus pen 400 provided in the embodiment of the present application has a first magnet 4100 disposed inside the pen shaft 420, which can be adsorbed with the second magnet 150 in the display device 100, so that the stylus pen 400 can be adsorbed on the display device 100, which is more convenient for users to use and has a better experience.
[0126] Based on this, Figure 6 As shown, an embodiment of the present application further provides a method for controlling a display device, which can be applied to the above-mentioned display device 100, and the method includes steps S601-S602.
[0127] S601 . Display an image including multiple watermarks on the screen 110 .
[0128] S602, the first communication circuit 120 receives at least one photo, which is a photo produced by a camera in the touch device 200, taking the image displayed on the screen 110, and any one of the at least one photo includes a partial image of the image displayed on the screen 110, and the partial image includes at least one watermark.
[0129] Thus, the display device 100 can determine the position of the touch operation in the display device 100 according to the watermark in the at least one photo, so as to realize the touch function.
[0130] Optionally, the display device 100 determines the position of the touch operation in the display device 100 according to the watermark in the at least one photo, and the processor in the display device 100 can determine the position of the touch operation in the screen 110 according to the watermark in the at least one photo. Alternatively, the display device 100 can transmit the at least one photo to a server in the cloud, and the server determines the position of the touch operation in the screen 110. The server sends the touch position information to the display device 100, and the display device 100 determines the position of the touch operation in the screen 110 according to the position information. This embodiment of the present application is not limited to this. Figure 1 As shown in (a), the following embodiments of the present application are described by taking as an example that the display device 100 also includes a processor 130 coupled to the first communication circuit 120, and the processor 130 is used to determine the position of the touch operation on the screen 110 according to the watermark in the at least one photo.
[0131] Optionally, the multiple watermarks may include characters such as numbers and letters, which is not limited in the embodiment of the present application. The embodiment of the present application is illustrative by taking the multiple watermarks including numbers as an example.
[0132] In a possible embodiment, the above-mentioned multiple watermarks are all blind watermarks. By adopting blind watermarks, the user's viewing effect of the image will not be affected, and the user experience can be improved. In the following embodiments of this application, the multiple watermarks are taken as blind watermarks as an example for illustrative explanation.
[0133] In a possible embodiment, the image displayed on the screen 110 also includes an original image, the multiple watermarks are spread over the original image using a preset coding method, and the original image includes multiple regions corresponding to the multiple watermarks.
[0134] In a possible embodiment, when the multiple watermarks include numbers, the above-mentioned preset encoding method can be encoding in a manner of numbers from small to large, or can be encoding in a manner of numbers from large to small, and the embodiment of the present application is not limited to this.
[0135] In a possible embodiment, the multiple watermarks may be spread over the original image in an order from left to right and from top to bottom, or may be spread over the original image in other orders, which is not limited in this embodiment of the present application.
[0136] In a possible embodiment, the processor 130 in the display device 100 may be configured to add a blind watermark to an original image to generate the image displayed on the screen 110 .
[0137] Optionally, the processor 130 may use a spatial domain method to add a blind watermark to the original image, or may use a frequency domain method to add a blind watermark to the original image, which is not limited in the embodiments of the present application.
[0138] In a possible embodiment, the first communication circuit 120 receiving at least one photo includes: receiving at least one photo within a preset time. Thus, the processor 130 in the display device 100 can determine different numbers of positions according to the different numbers of at least one photo received within the preset time, and determine a plurality of different touch operations according to the different numbers of photos and different numbers of positions. For the specific process, reference can be made to the relevant description of the display device 100, and the embodiment of the present application will not be repeated here.
[0139] In a possible embodiment, the touch device 200 is a stylus pen 400, the at least one photo includes a first group of photos or a second group of photos, and the first communication circuit 120 receives at least one photo includes: the first communication circuit 120 receives the first group of photos, the first group of photos are photos taken by a first camera 431 disposed at the tip 410 of the stylus pen 400. Alternatively, the first communication circuit 120 receives the second group of photos, the second group of photos are photos taken by a second camera 432 disposed at the rear of the pen body 420 of the stylus pen 400.
[0140] Optionally, the first group of photos and the second group of photos can be used to implement the writing function, or can be used to implement the erasing function. The embodiments of the present application do not limit this. In the following embodiments of the present application, the first group of photos is used to implement the writing function, and the second group of photos is used to implement the erasing function as an example for exemplary description. It can be understood that the first group of photos are photos taken by the first camera 431 set at the tip 410 of the stylus 400, and the second group of photos are photos taken by the second camera set at the tail of the pen body 420 of the stylus 400. The display device 100 can implement the writing function according to the first group of photos and the erasing function according to the second group of photos, so that the tip 410 of the stylus 400 can be used to implement the writing function, and the tail of the pen body 420 can be used to implement the erasing function, which is more in line with the user's writing habits and can improve the user experience.
[0141] The control method of the display device provided in the embodiment of the present application, first, displays an image including multiple watermarks on the screen 110. Then, at least one photo is received through the first communication circuit 120, and the at least one photo is a photo generated by the camera in the touch device 200, and the image displayed on the screen 110 is photographed. Any one of the at least one photo includes a partial image of the image displayed on the screen 110, and the partial image includes at least one watermark. Therefore, the display device 100 can determine the touch position of the touch device 200 in the screen 110 according to the watermark in the at least one photo to realize the touch function. It can be understood that compared with the prior art that uses a glass substrate with a touch function to realize the touch function, or that uses an infrared array transmitter and a receiver installed on the edge of the screen to realize the touch function, the control method of the display device 100 provided in the embodiment of the present application does not need to customize corresponding devices for screens 110 of different sizes when realizing the touch function, so it has better compatibility, can reduce production costs, reduce the price of the display device 100, and is more conducive to the promotion and application of the product. At the same time, it will not cause a wider border to exist at the edge of the screen 110, and a narrow border design can be achieved, making the display device 100 more beautiful.
[0142] like Figure 7 As shown, in a possible embodiment, the method further includes step S603, and there is no need to distinguish the order between step S603 and the above step S602, for example, they can be executed simultaneously.
[0143] S603 , the first communication circuit 120 receives a first pressure value, which is the pressure value of the pen tip 410 detected by the pressure sensor 450 in the stylus 400 , or receives a second pressure value, which is the pressure value of the tail of the pen shaft 420 detected by the pressure sensor 450 .
[0144] Optionally, the first pressure value can be used to adjust the parameters of the above-mentioned writing function, which include the thickness of the handwriting and the depth of the color, and the second pressure value can be used to adjust the parameters of the above-mentioned erasing function, which include the erasing radius. Alternatively, the first pressure value and the second pressure value can also be used to implement touch operations such as zooming in and scrolling. The embodiment of the present application does not limit what functions the first pressure value and the second pressure value are used to implement. The embodiment of the present application takes the first pressure value being used to adjust the parameters of the writing function and the second pressure value being used to adjust the parameters of the erasing function as an example for illustrative description.
[0145] In a possible embodiment, the first pressure value and the second pressure value can also be used to distinguish the first group of photos and the second group of photos. The processor 130 in the display device 100 can determine that the received photos are the first group of photos based on the received first pressure value, or the processor 130 can determine that the received photos are the second group of photos based on the received second pressure value, thereby implementing a writing operation based on the first group of photos and implementing an erasing operation based on the second group of photos.
[0146] The control method of the display device provided in the embodiment of the present application receives the pressure value between the stylus 400 and the screen 110 detected by the pressure sensor 450 through the first communication circuit 120, and the processor 130 can adjust the parameters of the writing function or the erasing function according to the pressure value, so that the user can realize the drawing and writing functions more flexibly, which can improve the user experience.
[0147] like Figure 7 As shown, in a possible embodiment, the method further includes step S604, and there is no need to distinguish the order between step S604 and the above step S603, for example, they can be executed simultaneously.
[0148] S604: The first communication circuit 120 receives the acceleration value and the angular momentum.
[0149] The control method of the display device provided in the embodiment of the present application receives the acceleration value and the angular momentum through the first communication circuit 120, and the acceleration value and the angular momentum are used to predict the movement trend of the stylus 400. The processor 130 predicts the movement trend of the stylus 400 based on the acceleration value and the angular momentum, thereby predicting the touch operation between the stylus 400 and the screen 110, thereby achieving low-latency touch operation and improving user experience.
[0150] Based on this, Figure 8 As shown, the embodiment of the present application further provides an electronic device 800, the electronic device 800 includes a display device 810 and a touch device 820, and the structure of the display device 810 can be as follows Figure 1 , Figure 2 , Figure 4 and Figure 5 The structure of the display device 100 shown in any of the figures, the structure of the touch device 820 can be as follows Figure 1 The structure of the touch control device 200 shown in FIG. 1 may be, or may be, for example, Figure 4 or Figure 5 The structure of the stylus pen 400 shown in any of the accompanying drawings.
[0151] The embodiment of the present application further provides a computer-readable storage medium in which a computer-executable instruction is stored. When at least one processor of a display device executes the computer-executable instruction, the display device executes Figure 6 and Figure 7 The steps in the display device control method shown in any of the accompanying drawings.
[0152] The embodiment of the present application also provides a computer program product. When at least one processor of a display device runs the computer program product, the display device executes Figure 6 and Figure 7 The steps in the display device control method shown in any of the accompanying drawings.
[0153] The above detailed descriptions of the display device 100, the touch device 200 and the stylus 400, as well as the analysis of beneficial effects, can all be correspondingly referred to the control method of the display device 100, the electronic device 800, the computer-readable storage medium and the computer program product, and the embodiments of the present application will not be repeated here.
[0154] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A display device, characterized in that: The display device includes a screen, and a communication circuit coupled to the screen; The screen is used to display an image including a plurality of watermarks; The communication circuit is used to receive at least one photo, where the at least one photo is a photo generated by taking the image by a camera in a touch device, and any one of the at least one photo includes a partial image of the image, and the partial image includes at least one watermark.
2. The display device according to claim 1, characterized in that The image also includes an original image, the multiple watermarks are spread over the original image in a preset encoding manner, the original image includes multiple regions, and the multiple regions correspond to the multiple watermarks.
3. The display device according to claim 1 or 2, characterized in that: The multiple watermarks are all blind watermarks.
4. The display device according to any one of claims 1 to 3, characterized in that: The communication circuit is specifically used to receive the at least one photo within a preset time.
5. The display device according to any one of claims 1 to 4, characterized in that: The touch device is a stylus, and the at least one photo includes the first group of photos or the second group of photos; The communication circuit is further configured to receive the first set of photos, where the first set of photos is photos taken by a first camera disposed at the tip of the stylus pen; or, The communication circuit is further used to receive the second group of photos, where the second group of photos are photos taken by a second camera arranged at the rear of the pen holder of the stylus pen.
6. The display device according to claim 5, characterized in that The communication circuit is further used to receive a first pressure value, where the first pressure value is a pressure value of the pen tip detected by a pressure sensor in the stylus; or, The communication circuit is also used to receive a second pressure value, where the second pressure value is the pressure value of the tail of the pen detected by the pressure sensor.
7. The display device according to any one of claims 1 to 6, characterized in that: The communication circuit is also used to receive acceleration values and angular momentum.
8. A touch device, characterized in that: The touch control device includes at least one camera, and a communication circuit coupled to the at least one camera; The at least one camera is used to capture the image displayed on the screen to generate at least one photo, the image includes a plurality of watermarks, any one of the at least one photo includes a partial image of the image, and the partial image includes at least one of the watermarks; The communication circuit is used to send the at least one photo.
9. The touch control device according to claim 8, characterized in that: The image also includes an original image, the multiple watermarks are spread over the original image in a preset encoding manner, the original image includes multiple regions, and the multiple regions correspond to the multiple watermarks.
10. The touch control device according to claim 8 or 9, characterized in that: The multiple watermarks are all blind watermarks.
11. The touch control device according to any one of claims 8 to 10, characterized in that: The touch device is a stylus pen, the stylus pen comprises a pen tip and a pen holder connected to the pen tip, the at least one camera comprises a first camera and a second camera, the first camera is arranged at the pen tip, the second camera is arranged at the tail of the pen holder, and the at least one photo comprises a first group of photos or a second group of photos; The first camera is used to capture the image and generate the first set of photos; The second camera is used to capture the image and generate the second set of photos; The communication circuit is further used to send the first group of photos, or to send the second group of photos.
12. The touch control device according to claim 11, characterized in that: The stylus pen further includes a pressure sensor coupled to the communication circuit; The pressure sensor is used to detect a first pressure value of the pen tip, or a second pressure value of the pen tail; The communication circuit is used to send the first pressure value, or to send the second pressure value.
13. The touch control device according to any one of claims 8 to 12, characterized in that: The touch control device further comprises an accelerometer, wherein the accelerometer is coupled to the communication circuit; The accelerometer is used to detect the acceleration value and angular momentum of the touch device; The communication circuit is also used to send the acceleration value and the angular momentum.
14. A method for controlling a display device, characterized in that: The method comprises: displaying an image including a plurality of watermarks on a screen; At least one photo is received, where the at least one photo is a photo of the image captured by a camera in a touch device, and any one of the at least one photo includes a partial image of the image, and the partial image includes at least one watermark.
15. The method according to claim 14, characterized in that The image also includes an original image, the multiple watermarks are spread over the original image in a preset encoding manner, the original image includes multiple regions, and the multiple regions correspond to the multiple watermarks.
16. The method according to claim 14 or 15, characterized in that The multiple watermarks are all blind watermarks.
17. The method according to any one of claims 14 to 16, characterized in that: The receiving at least one photo comprises: The at least one photo is received within a preset time.
18. The method according to any one of claims 14 to 17, characterized in that: The touch device is a touch pen, the at least one photo includes the first group of photos or the second group of photos, and the receiving of the at least one photo includes: receiving the first group of photos, where the first group of photos are photos taken by a first camera disposed at a tip of the stylus; or, The second group of photos is received, where the second group of photos is photos taken by a second camera disposed at the end of the pen holder of the stylus pen.
19. The method according to claim 18, characterized in that The method further comprises: receiving a first pressure value, where the first pressure value is a pressure value of the pen tip detected by a pressure sensor in the stylus; or, A second pressure value is received, where the second pressure value is the pressure value of the tail of the pen shaft detected by the pressure sensor.
20. The method according to any one of claims 14 to 19, characterized in that The method further comprises: Receives acceleration values and angular momentum.
21. An electronic device, characterized in that: The electronic device comprises a display device and a touch device, the display device is the display device according to any one of claims 1 to 7, and the stylus is the touch device according to any one of claims 8 to 13.
22. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed on the display device, the display device executes the method for controlling the display device according to any one of claims 14 to 20.