Optical pen, display panel, display device and interaction system

Through the array light source and single pixel detector of the optical pen combined with Hadamard speckle and compression perception algorithm, the problem of specular reflection and self-luminous interference of the display panel is solved, and the accurate contact position acquisition of the optical pen on the display panel is achieved, improving the image Quality and reduce equipment costs.

CN119065514APending Publication Date: 2024-12-03BOE TECHNOLOGY GROUP CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411186755.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-27
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The specular reflection and self-luminescence of the display panel interfere with the contact position acquisition effect of the optical pen on the display panel, resulting in inaccurate image acquisition.

Method used

The optical pen has an array light source and a single pixel detector. By emitting light of preset wavelength when the pen tip comes into contact with the display panel, and reconstructing the image using a single pixel imaging method, combining Hadamard speckle and compression perception algorithm, it overcomes light interference. Accurately get the contact position of the pen tip.

Benefits of technology

It effectively reduces the influence of specular reflection and self-luminescence, ensures the accuracy of the optical pen's contact position acquisition on the display panel, improves image quality, and eliminates the need for a camera, reducing the volume and cost of the optical pen.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119065514A_ABST
    Figure CN119065514A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of optical pens, particularly provides an optical pen, a display panel, a display device and an interaction system, and aims to solve the problem of how to weaken mirror reflection of the display panel and self-illumination of the optical pen. In order to achieve the purpose, the optical pen provided by the invention comprises a pen core, an array light source, a single-pixel detector and a processing module which are arranged in a shell, the array light source is used for emitting light with a preset wavelength to the display panel when the pen point is in contact with the display panel, the display panel comprises a dot matrix layer arranged on the substrate, the dot matrix layer comprises a plurality of dot matrixes, patterns of the dot matrixes are different, the patterns of the dot matrixes are used for representing position information, and the dot matrixes can absorb or reflect the light with the preset wavelength; the single-pixel detector is used for detecting the light intensity of the display panel; and the processing module is used for reconstructing the image according to the light intensity by adopting a single-pixel imaging method and acquiring the contact position of the pen point on the display panel according to the pattern of the dot matrix in the image. According to the method, the contact position of the pen point on the display panel can be accurately obtained.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of optical pens, and in particular to an optical pen, a display panel, a display device and an interactive system. Background Art

[0002] An optical pen is a stylus that uses light as a communication medium. Users can hold the optical pen to record information or perform touch operations on the display panel.

[0003] Specifically, the display panel has a coding pattern layer, which includes a plurality of different coding patterns, and the coding patterns represent position information. The optical pen may include structures such as a fill light, a camera, and a processor. When a user holds the optical pen to record information or perform touch operations on the display panel, the fill light will emit light, and the emitted light reaches the display panel and is reflected by the surface of the display panel to form reflected light. The camera can receive the reflected light and collect the image presented by the reflected light. The processor can identify the contact position of the optical pen on the display panel according to the coding pattern in the image. If the user holds the optical pen to record information on the display panel, the contact track of the optical pen on the display panel can be obtained according to the contact position. The contact track can represent the handwriting of the user when recording information, and the information recorded by the user can be obtained according to the handwriting; if the user holds the optical pen to touch the display panel, the touch area of ​​the optical pen on the display panel can be obtained according to the contact position, and the touch command triggered by the user can be identified according to the touch area, and then the corresponding touch operation can be performed according to the touch command.

[0004] Since the surface of the display panel is relatively smooth, the light emitted by the fill light will produce mirror reflection on the surface of the display panel when it reaches the display panel, resulting in the reflected light received by the camera being relatively weak, thus affecting the image acquisition effect, and ultimately failing to accurately obtain the contact position of the optical pen on the display panel. In addition, the display panel has a light-emitting layer, and the light emitted by the light-emitting layer may also be received by the camera, which will also affect the image acquisition effect, and thus failing to accurately obtain the contact position of the optical pen on the display panel.

[0005] Accordingly, the art needs a new technical solution to solve the above problems. Summary of the invention

[0006] In order to overcome the above-mentioned defects, the present application is proposed to solve or at least partially solve the technical problem of how to reduce the influence of the specular reflection and self-luminescence of the display panel on the optical pen.

[0007] In a first aspect, an optical pen is provided, the optical pen comprising a housing, a pen core, an array light source, a single pixel detector and a processing module arranged in the housing, one end of the pen core extending to the outside of the housing to form a pen tip of the optical pen;

[0008] The array light source is used to emit light of a preset wavelength to the display panel when the pen tip contacts the display panel, the display panel includes a dot matrix layer arranged on a substrate, the dot matrix layer includes a plurality of dot matrices, each dot matrix has a different pattern, the dot matrix pattern is used to represent position information, and the dot matrix can absorb or reflect the light of the preset wavelength;

[0009] The single pixel detector is used to detect the light intensity of the display panel;

[0010] The processing module is used to adopt a single-pixel imaging method to reconstruct an image according to the light intensity, and to obtain a contact position of the pen tip on the display panel according to a pattern of a dot matrix in the image.

[0011] In a technical solution of the above optical pen, the optical pen includes a circuit module disposed in the housing, and the circuit module is used to modulate the light of the preset wavelength emitted by the array light source into structured light according to a preset coding pattern.

[0012] In a technical solution of the above optical pen, the preset coding pattern is Hadamard speckle.

[0013] In a technical solution of the above optical pen, the single-pixel imaging method includes a single-pixel imaging algorithm based on compressed sensing, and the processing module is used to reconstruct the image according to the Hadamard speckle and the light intensity using the single-pixel imaging algorithm based on compressed sensing.

[0014] In a technical solution of the above optical pen, the distance between adjacent light sources in the array light source is smaller than the distance between adjacent dot arrays in the dot array layer.

[0015] In a second aspect, a display panel is provided, comprising a dot matrix layer disposed on a substrate, the dot matrix layer comprising a plurality of dot matrices, each dot matrix having a different pattern, the dot matrix pattern being used to represent position information, the dot matrix being capable of absorbing or reflecting light of a preset wavelength emitted by an optical pen, and the optical pen being the optical pen provided in the first aspect.

[0016] In a technical solution of the above display panel, the display panel includes a pixel layer, the pixel layer includes a plurality of pixels, and the orthographic projection of the dot matrix on the substrate does not overlap with the orthographic projection of the pixels on the substrate.

[0017] In a technical solution of the above display panel, the orthographic projection of the dot matrix on the substrate is a stripe, and the orthographic projection of the dot matrix on the substrate is located between the orthographic projections of adjacent pixels on the substrate;

[0018] Alternatively, the orthographic projection of the dot matrix on the substrate is frame-shaped, and the orthographic projection of the dot matrix on the substrate surrounds the orthographic projection of at least one pixel on the substrate.

[0019] In a technical solution of the above display panel, the display panel includes:

[0020] A polarizer layer is formed on a side of the dot matrix layer away from the substrate, and the dot matrix layer includes a diffuse reflection layer and a plurality of dot matrices arranged on the diffuse reflection layer.

[0021] In a technical solution of the above display panel, the display panel includes:

[0022] A color filter layer, wherein the color filter layer includes a black matrix, and an orthographic projection of the dot matrix on the substrate overlaps with an orthographic projection of the black matrix on the substrate.

[0023] In a third aspect, a display device is provided, comprising the display panel provided in the second aspect.

[0024] In a fourth aspect, an interactive system is provided, the system comprising the optical pen provided in the first aspect and the display device provided in the third aspect;

[0025] The optical pen is communicatively connected to the display device, and is used to obtain a contact position of its pen tip on a display panel of the display device, and transmit the contact position to the display device.

[0026] The above one or more technical solutions of the present application have at least one or more of the following beneficial effects:

[0027] In a technical solution for implementing the optical pen provided in the present application, the optical pen includes a shell and a refill, an array light source, a single-pixel detector and a processing module arranged in the shell, one end of the refill extends to the outside of the shell to form a pen tip of the optical pen; the array light source is used to emit light of a preset wavelength to the display panel when the pen tip contacts the display panel, the display panel includes a dot matrix layer arranged on a substrate, the dot matrix layer includes a plurality of dot matrices, each dot matrix has a different pattern, the dot matrix pattern is used to represent position information, and the dot matrix can absorb or reflect light of a preset wavelength; the single-pixel detector is used to detect the light intensity of the display panel; the processing module is used to adopt a single-pixel imaging method and reconstruct an image based on the light intensity, and obtain the contact position of the pen tip on the display panel based on the pattern of the dot matrix in the reconstructed image.

[0028] The above-mentioned implementation scheme realizes single-pixel imaging based on an array light source, a single-pixel detector and a processing module, which can greatly overcome the light interference in the environment. Even if there is mirror reflection and self-luminescence on the display panel, it will not affect the effect of single-pixel imaging. Therefore, the image can be used to accurately obtain the contact position of the pen tip on the display panel. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The disclosure of the present application will become easier to understand with reference to the accompanying drawings. It is easy for those skilled in the art to understand that these drawings are only for illustrative purposes and are not intended to limit the scope of protection of the present application. Among them:

[0030] Figure 1 is a schematic diagram of the main structure of an optical pen according to an embodiment of the present application;

[0031] Figure 2 This is a schematic diagram of an optical pen according to an embodiment of the present application being used in conjunction with a display panel. Figure 1 ;

[0032] Figure 3 This is a schematic diagram of an optical pen according to an embodiment of the present application being used in conjunction with a display panel. Figure 2 ;

[0033] Figure 4 is a schematic diagram of an optical pen according to an embodiment of the present application that can be used in conjunction with dot matrix paper;

[0034] Figure 5 It is a schematic diagram of the principle of the single pixel imaging method;

[0035] Figure 6 is a schematic diagram of Hadamard speckle according to an embodiment of the present application;

[0036] Figure 7 is a schematic diagram of interaction between an optical pen and a smart terminal according to an embodiment of the present application;

[0037] Figure 8 is a schematic diagram of pixel and dot matrix arrangement according to an embodiment of the present application;

[0038] Fig. 9 is a schematic diagram of a display panel of a polarizer structure according to an embodiment of the present application;

[0039] Fig.10 is a schematic diagram of a display panel with a color film structure according to an embodiment of the present application.

[0040] Reference numerals:

[0041] 100: housing; 110: refill; 120: array light source; 130: single pixel detector; 140: processing module; 150: circuit module; 160: storage module; 170: communication module; 180: pressure sensor module; 190: battery module; 200: display panel; 210: mirror reflection layer; 220: dot matrix layer; 300: dot matrix paper; 310: diffuse reflection layer; 320: dot matrix layer; 410: communication module; 420: processing module; 4 30: display module; 500: substrate; 501: planarization layer; 502: pixel definition layer; 503: cathode electrode; 504: first inorganic encapsulation layer; 505: organic encapsulation layer; 506: second inorganic encapsulation layer; 507: touch function layer; 508: touch metal wire; 509: diffuse reflection layer; 510: dot matrix; 511: photoresist layer; 512: polarizer layer; 513: optical adhesive layer; 514: cover plate; 515: color filter layer; 516: black matrix. DETAILED DESCRIPTION

[0042] Some embodiments of the present application are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present application and are not intended to limit the protection scope of the present application.

[0043] In the description of the present application, "formed on" and "disposed on" may mean that one layer is directly formed or disposed on another layer, or may mean that one layer is indirectly formed or disposed on another layer, that is, there are other layers between the two layers. "Module" may include hardware, software, or a combination of the two. A module may include hardware circuits, various suitable sensors, communication ports, memory, and may also include software parts, such as program codes, or may be a combination of software and hardware.

[0044] The following is a description of an embodiment of the optical pen provided in the present application.

[0045] See attached Figure 1 , Figure 1 FIG. 1 is a schematic diagram of the main structure of an optical pen according to an embodiment of the present application. Figure 1 As shown, the optical pen in the embodiment of the present application mainly includes a housing 100, a pen core 110, an array light source 120, a single pixel detector 130, and a processing module 140 disposed in the housing 100, wherein one end of the pen core 110 extends to the outside of the housing 100 to form a pen tip of the optical pen. The array light source 120, the single pixel detector 130, and the processing module 140 are described below.

[0046] 1. The array light source 120 and the single pixel detector 130 are described.

[0047] The array light source 120 includes a plurality of light sources, which are arranged in an array. The array light source 120 can emit light of a preset wavelength. In some embodiments, the array light source 120 can emit infrared light, that is, the preset wavelength is the wavelength of infrared light. In addition, in some embodiments, the light source in the array light source 120 can be an LED (Light Emitting Diode) light source. By adjusting the intensity of the light emitted by each light source in the array light source 120, the light field intensity distribution of the light emitted by the entire array light source 120 can be changed. Therefore, the array light source 120 in this embodiment can be understood as a modulated light source, and the light field intensity distribution can be flexibly modulated according to actual needs.

[0048] The wavelength of light that can be detected by the single pixel detector 130 can cover the above-mentioned preset wavelength. For example, the light of the preset wavelength emitted by the array light source 120 is infrared light, and the wavelength of light that can be detected by the single pixel detector 130 can be 750nm to 1100nm. The single pixel detector 130 can adopt a conventional single pixel detector with high sensitivity such as a photoelectric bias detector or a micro-biased silicon detector, and this embodiment does not specifically limit the type of the single pixel detector.

[0049] In some embodiments, the optical pen can be used in conjunction with the display panel. Figure 2 and attached Figure 3 , the working process of the array light source 120 and the single pixel detector 130 when the optical pen is used in conjunction with the display panel is described.

[0050] like Figure 2 As shown, the outer surface of the display panel 220 is usually relatively smooth, and a mirror reflection layer 210 can be formed. The display panel 200 includes a dot matrix layer 220 disposed on a substrate, and the dot matrix layer 220 includes a plurality of dot matrices ( Figure 2 (not shown), the patterns of each dot matrix are different, and the patterns of the dot matrix are used to represent the position information. Since the patterns are different, the position information represented by each dot matrix is ​​also different. This embodiment does not specifically limit the content of the dot matrix pattern, but it is necessary to ensure that the position information represented by each pattern is different, and the position information corresponding to the pattern can be obtained by identifying the pattern of the dot matrix.

[0051] like Figure 3 As shown, the user can hold the optical pen to touch or write on the display panel 200. When the tip of the optical pen contacts the display panel 200, the array light source 120 can emit light of a preset wavelength to the display panel 200. When the light of the preset wavelength is incident on the display panel 200, a portion of the light will generate specular reflection on the specular reflection layer 210, and the light incident on the dot matrix in the dot matrix layer 220 will be absorbed or reflected by the dot matrix, and the single pixel detector 130 will detect the light intensity of the display panel 200.

[0052] In some embodiments, the display panel 200 can be replaced with dot matrix paper, that is, the optical pen can also be used in conjunction with the dot matrix paper. Figure 4 , the working process of the array light source 120 and the single pixel detector 130 when the optical pen is used in conjunction with the dot matrix paper is described.

[0053] like Figure 4 As shown, the surface of the dot matrix paper 300 is uneven, so a diffuse reflection layer 310 is formed. The dot matrix paper 300 also includes a dot matrix layer 320, which includes a plurality of dot matrices ( Figure 4 (not shown), the patterns of each dot matrix are different, and the patterns of the dot matrix are used to represent position information. Since the patterns are different, the position information represented by each dot matrix is ​​also different.

[0054] The user can hold the optical pen and write text on the dot paper 300. When the tip of the optical pen contacts the dot paper 300, the array light source 120 can emit light of a preset wavelength to the dot paper 300. When the light enters the dot paper 300, a part of the light will be diffusely reflected on the diffuse reflection layer 310, and the light entering the dot array in the dot layer 320 will be absorbed or reflected by the dot array. The single pixel detector 130 will also detect the light intensity of the dot paper 300.

[0055] 2. The processing module 140 is described.

[0056] The processing module 140 is used to adopt a single-pixel imaging method and reconstruct an image based on the light intensity detected by the single-pixel detector 130, and obtain the contact position of the pen tip on the display panel 200 based on the pattern of the dot matrix in the reconstructed image (hereinafter described as the target image).

[0057] When obtaining the contact position, since the dot matrix can absorb or reflect the light of the above-mentioned preset wavelength, the dot matrix will be darker in the target image to form a dark matrix, or the dot matrix will be brighter to form a bright matrix. By identifying the dark matrix or the bright matrix, the dot matrix in the image can be obtained, and then the position information represented by the pattern of the dot matrix can be obtained, and the contact position of the pen tip can be obtained based on the position information.

[0058] When reconstructing an image, a conventional single-pixel imaging method can be used for image reconstruction. The single-pixel imaging method mainly uses the light field intensity distribution of the light emitted by the light source and the light intensity of the object to be imaged to reconstruct the image. Figure 5 The principle of the single-pixel imaging method is explained, wherein the conventional light source is a broad-spectrum light source.

[0059] like Figure 5As shown in FIG. 1 , since the broadband light source itself does not have a modulation function and cannot change the intensity distribution of the light field emitted by itself, a spatial light modulator is required. Figure 5 (not shown) A pattern for modulating the light field intensity distribution (such as Hadamard speckle) is input into the spatial light modulator. After the light from the wide-spectrum light source is irradiated to the spatial light modulator, the light field intensity distribution of the light is the same as the Hadamard speckle, and becomes structured light with a Hadamard speckle light field. The structured light is then irradiated to the target object through a converging lens. The single-pixel detector detects the light intensity of the target object. The acquisition module (Data Acquisition, DAQ) can acquire the light intensity obtained by the single-pixel detector. The controller reconstructs the image according to the light intensity and Hadamard speckle acquired by the acquisition module. Figure 5 Where d1 represents the distance between the spatial light modulator and the focusing lens, and d2 represents the distance between the focusing lens and the target object.

[0060] In this embodiment, the light source is an array light source 120, which can change the light field intensity distribution of the light it emits. Therefore, the above-mentioned spatial light modulator does not need to be configured.

[0061] When the light emitted by the array light source 120 irradiates the display panel 200, for the reconstructed target image, one light source in the array light source 120 can represent one pixel in the target image, therefore, the distance between adjacent light sources in the array light source 120 can be understood as the distance between adjacent pixels in the target image, and further can be understood as the distance between adjacent pixels in the display panel 200. The distance between adjacent dot matrixes in the dot matrix layer of the display panel 200 needs to be greater than the distance between adjacent pixels, therefore, when determining the distance between adjacent light sources in the array light source 120, it can be determined based on the distance between adjacent dot matrixes in the dot matrix layer, so that the distance between adjacent light sources in the array light source 120 is less than the distance between adjacent dot matrixes in the dot matrix layer. For example, the distance between adjacent dot matrixes is 50um, and the distance between adjacent light sources 120 can be 25um.

[0062] Based on the above array light source 120, single pixel detector 130, and processing module 140, single pixel imaging can be achieved, which can greatly overcome the light interference in the environment. Even if the display panel has mirror reflection and self-luminescence, it will not affect the effect of single pixel imaging, and a high-quality image can be obtained, so that the contact position of the pen tip on the display panel can be accurately obtained by using the high-quality image. In addition, compared with the prior art, the optical pen of the above embodiment does not need to use a camera, which can reduce the size and cost of the optical pen.

[0063] The following is a description of the embodiments of the optical pen provided in the present application.

[0064] See again the attached Figure 1 In some embodiments of the present application, the optical pen may include a circuit module 150 disposed in the housing 100, and the circuit module 150 may be used to modulate the light of a preset wavelength emitted by the array light source 120 into structured light according to a preset coding pattern. Specifically, the circuit module 190 may input the preset coding pattern into the array light source 120, and the array light source 120 may emit light of a preset wavelength according to the coding pattern, so that the light field intensity distribution of the emitted light is the same as the coding pattern.

[0065] The coding pattern is composed of at least one pattern element, and the pattern element represents the light intensity weight, and different pattern elements represent different light intensity weights. For example, the pattern element includes a white frame and a black frame, and the light intensity weight represented by the white frame is 1, and the light intensity weight represented by the black frame is 0.

[0066] The size of the coding pattern is the same as the size of the array light source 120, and the pattern elements (hereinafter described as target elements) at the same position as each light source in the array light source 120 (hereinafter described as target light sources) can be obtained from the coding pattern. The array light source 120 emitting light according to the coding pattern can be understood as: obtaining the target element at the same position as the target light source from the coding pattern, obtaining the light intensity weight represented by the target element, and multiplying this light intensity weight by the original light intensity of the light emitted by the target light intensity to obtain a new light intensity. For example, if the target element is the above-mentioned white box, since the light intensity weight represented by the white box is 1, the original light intensity will not be changed; if the target element is the above-mentioned black box, since the light intensity weight represented by the black box is 0, the original light intensity will be changed.

[0067] In some embodiments, the preset coding pattern is Hadamard speckle. Figure 6 As shown, Figure 6 60 speckle forms of a Hadamard speckle are exemplarily shown. The circuit module 190 can sequentially input each speckle form of the Hadamard speckle to the array light source 120 according to a preset frequency, so that the light field intensity distribution of the light emitted by the array light source 120 changes with the change of the speckle form of the input Hadamard speckle. In this embodiment, a conventional Hadamard speckle acquisition method can be used to acquire the Hadamard speckle, and this embodiment does not specifically limit this.

[0068] In some embodiments, the single-pixel imaging method includes a single-pixel imaging algorithm based on compressed sensing (CS), for example, the algorithm can be a reconstruction algorithm based on total variation regularization. In this embodiment, the processing module 140 can use a single-pixel imaging algorithm based on compressed sensing to reconstruct an image according to the Hadamard speckle and the light intensity detected by the single-pixel detector. It should be noted that the single-pixel imaging algorithm based on compressed sensing is a conventional method in the field of single-pixel imaging technology, and the specific algorithm principle of the single-pixel imaging algorithm based on compressed sensing is not described in detail in this embodiment.

[0069] Inputting a speckle form of Hadamard speckle to the array light source 120 to change the light field intensity distribution of the light emitted by the array light source 120 can be understood as a modulation of the array light source 120. Assuming that the number of Hadamard speckles is N, the array light source 120 will be modulated N times. The single-pixel imaging algorithm based on compressed sensing can sample the N modulations, and for a certain modulation sampled, obtain the light intensity detected by the single-pixel detector 130 in this modulation and the speckle form of the Hadamard speckle used in this modulation, and calculate the pixel value obtained by this modulation based on the above light intensity and the speckle form of the Hadamard speckle. Among them, the pixel value can be expressed by the following formula (1).

[0070] Y i =∫dxdydx 0 dy 0 A i (x,y)×T(x 0 ,y 0 ) (1)

[0071] The meanings of the parameters in formula (1) are as follows:

[0072] i represents the sampling number, that is, the i-th modulation.

[0073] Y i represents a pixel value calculated according to the light intensity detected by the single pixel detector 130 in the i-th modulation and the speckle form of the Hadamard speckle used in the i-th modulation.

[0074] T represents the transmission function of the object to be imaged, x 0 ,y 0 Represents the horizontal and vertical coordinates of each position point on the object to be imaged in the image coordinate system.

[0075] A represents the Hadamard matrix of the Hadamard speckle. Each element in the Hadamard matrix represents the light intensity weight represented by the pattern element at each position in the speckle form of the Hadamard speckle.i (x, y) represents the Hadamard matrix of the Hadamard speckle used for the i-th modulation, and x and y represent the abscissa and ordinate of the Hadamard matrix.

[0076] The following is a description of the embodiments of the optical pen provided in the present application.

[0077] See again the attached Figure 1 In some embodiments according to the present application, the optical pen further includes a storage module 160, a communication module 170, a pressure sensing module 180 and a battery module 190 disposed in the housing 100. These modules are described below.

[0078] The storage module 160 can store relevant data of the processing module 140, which may include the image reconstructed by the processing module 140 and the contact position of the pen tip on the display panel 200 or the dot matrix paper 300. The memory of the storage module 160 can be 256Mb, 512Mb, etc.

[0079] The communication module 170 may communicate with external devices.

[0080] The pressure sensing module 180 can detect pressure, and determine whether the pen tip is in contact with the display panel 200 or the dot paper 300 according to the magnitude of the pressure.

[0081] The battery module 190 can supply power to other modules in the optical pen. The battery module 190 can be a 200 mAH lithium battery or the like.

[0082] See attached Figure 7 In some implementations, the processing module 140 may send the data stored in the storage module 160 to the smart terminal through the communication module 170. The smart terminal may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer, a netbook, a personal digital assistant, etc., which is not specifically limited in this embodiment.

[0083] like Figure 7As shown, the intelligent terminal may include a communication module 310, a processing module 320 and a display module 330. The communication module 310 can be connected to the communication module 170 of the optical pen for communication, and the above-mentioned contact position sent by the optical pen is received through the communication module 310. The processing module 320 can obtain the handwriting position of the optical pen on the display panel 200 or the dot paper 300 according to the contact position, and control the display module 330 to display the handwriting position. The handwriting of the optical pen on the display panel 200 or the dot paper 300 can be obtained by displaying a series of handwriting positions. In addition, the processing module 320 can determine the corresponding touch operation according to the received contact position and perform the touch operation. For example, according to the contact position, it is determined that the optical pen selects a control on the display panel 200, which is equivalent to clicking the control. At this time, the touch operation to be performed when the control is clicked can be determined, and the touch operation can be performed.

[0084] In some embodiments, the display module 330 includes a display panel, which may be the same as the display panel 200. For example, the smart terminal is a mobile phone, and a user may hold an optical pen and write text on the screen of the mobile phone. During the writing process, the mobile phone may synchronously display the handwriting on the screen, that is, display the written text.

[0085] Another aspect of the present application provides a display panel.

[0086] In an embodiment of a display panel according to the present application, the display panel may include a dot matrix layer disposed on a substrate, the dot matrix layer includes a plurality of dot matrices, each dot matrix has a different pattern, the dot matrix pattern is used to represent position information, the dot matrix can absorb or reflect light of a preset wavelength emitted by an optical pen, and the optical pen is the optical pen described in the aforementioned embodiment of the optical pen. The meaning of the dot matrix is ​​the same as the meaning of the dot matrix in the aforementioned embodiment of the optical pen.

[0087] In some embodiments, the display panel includes a pixel layer, the pixel layer includes a plurality of pixels, and the orthographic projection of the dot matrix on the substrate does not overlap with the orthographic projection of the pixel on the substrate. Based on this, the dot matrix does not interfere with the pixel when absorbing or reflecting light. In this embodiment, the dot matrix layer is formed on the side of the pixel layer away from the substrate.

[0088] In some embodiments, the orthographic projection of the dot matrix on the substrate is in the shape of a strip, and the orthographic projection of the dot matrix on the substrate is located between the orthographic projections of adjacent pixels on the substrate.

[0089] like Figure 8 As shown, the pixel layer includes a plurality of pixel units, each of which includes three pixels, namely, R (Red) pixel, G (Green) pixel, and B (Blue) pixel. The positive projection of the dot matrix on the substrate is a stripe, that is, Figure 8 The long rectangle in .

[0090] In some embodiments, the orthographic projection of the dot matrix on the substrate is frame-shaped, and the orthographic projection of the dot matrix on the substrate surrounds the orthographic projection of at least one pixel on the substrate.

[0091] In some embodiments, the display panel is a display panel with a polarizer structure, which includes a polarizer layer formed on a side of a dot matrix layer facing away from the substrate, and the dot matrix layer includes a diffuse reflection layer and a plurality of dot matrices arranged on the diffuse reflection layer.

[0092] See attached Fig. 9 In some embodiments, the display panel may include:

[0093] Substrate (or baseboard) 500 .

[0094] A planarization layer 501 is formed on the substrate 500 , and the planarization layer 501 may be formed of materials such as organic matter.

[0095] The pixel electrode is configured on the planarization layer 501 and the pixel definition layer 502 partially exposes the pixel electrode. The pixel electrode can penetrate the planarization layer 501. The pixel electrode is the anode electrode of the display panel. The pixel electrode can be made of ITO / Ag / ITO material, and the thickness can be 20nm or 15nm. The pixel definition layer 502 can be formed of organic matter.

[0096] The light emitting layer ( Fig. 9 (not shown). The light emitting layer may include one or more of a hole injection layer (HIL), a hole transport layer (HTL), an electron transport layer (ETL), and an electron injection layer (EIL).

[0097] A cathode electrode 503 is disposed on the light-emitting layer. The pixel electrode, the light-emitting layer, and the cathode electrode 503 can form a light-emitting element.

[0098] A thin film encapsulation layer TFE (Thin Film Encapsulation) is configured on the light-emitting element. The thin film encapsulation layer can seal the light-emitting element to prevent moisture and the like from flowing into the light-emitting element from the outside. The thin film encapsulation layer TFE includes a first inorganic encapsulation layer 504, an organic encapsulation layer 505, and a second inorganic encapsulation layer 506. The first inorganic encapsulation layer 504 can prevent moisture, oxygen, and the like from penetrating into the light-emitting element; the organic encapsulation layer 505 is used to improve the flatness of the thin film encapsulation layer TFE, and the organic film can be formed of a liquid organic material; the second inorganic encapsulation layer 506 is made of the same or similar material as the first inorganic encapsulation layer 504, and the second inorganic encapsulation layer 506 can completely cover the organic encapsulation layer 505.

[0099] A touch function layer 507 is formed on the second inorganic encapsulation layer 506 . The touch function layer 507 is configured with a touch metal line 508 .

[0100] A diffuse reflection layer 509 is formed on the touch function layer 507, and a dot matrix 510 is arranged on the diffuse reflection layer 509. The diffuse reflection layer 509 and the dot matrix 510 form a dot matrix layer. The size of the dot matrix 510 can be 1 pitch pixel or 2 pitch pixel, etc. The dot matrix 510 can absorb infrared light. Among them, the diffuse reflection layer 509 is uneven.

[0101] A photoresist layer 511 is formed on the dot matrix layer.

[0102] A polarizer layer 512 is formed on the photoresist layer 511 .

[0103] An optical adhesive layer 513 is formed on the polarizer layer 512 .

[0104] A cover plate 514 is disposed on the optical adhesive layer 513. The material of the cover plate 514 can be colorless transparent polyimide film CPI, ultra-thin glass UTG, or glass cover plate CG.

[0105] In some embodiments, the display panel is a display panel of a color film (Color On Encapsulation, COE) structure, the display panel includes a color film layer, the color film layer includes a black matrix, and the orthographic projection of the dot matrix on the substrate overlaps with the orthographic projection of the black matrix on the substrate.

[0106] See attached Fig.10 In some embodiments, the display panel of the color film structure is Fig. 9The display panel shown has the same substrate (or base plate) 500, planarization layer 501, pixel electrode, pixel definition layer 502, cathode electrode 503, first inorganic encapsulation layer 504, organic encapsulation layer 505 and second inorganic encapsulation layer 506, touch function layer 507, touch metal wire 508, photoresist layer 511, optical adhesive layer 513, cover plate 514. The main difference is that the display panel with color film structure includes:

[0107] A color filter layer 515 is formed on the touch function layer 507 , and the color filter layer 515 includes a black matrix 516 , and a dot matrix 510 is formed on the black matrix 516 , and the dot matrix 510 constitutes a dot matrix layer.

[0108] A photoresist layer 511 is formed on the dot matrix layer.

[0109] An optical adhesive layer 513 is formed on the photoresist layer 511 .

[0110] In addition, the display panel with the color film structure does not have the diffuse reflection layer 509 and the polarizer layer 512 .

[0111] Another aspect of the present application provides a display device.

[0112] In an embodiment of a display device according to the present application, the display device includes the display panel described in the above embodiment. The display device and the smart terminal in the above embodiment of the optical pen can be the same. That is, the display device can be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer, a netbook, a personal digital assistant, etc., and this embodiment does not specifically limit this.

[0113] Another aspect of the present application also provides an interactive system.

[0114] In an embodiment of an interactive system according to the present application, the interactive system includes the optical pen and display device described in the aforementioned embodiment. The optical pen is communicatively connected to the display device, and the optical pen is used to obtain the contact position of its pen tip on the display panel of the display device, and transmit the contact position to the display device. The display device can obtain the handwriting position of the optical pen on the display panel according to the contact position, control the display panel to display the handwriting position, and obtain the handwriting of the optical pen on the display panel by displaying a series of handwriting positions. In addition, the display device can determine the corresponding touch operation according to the received contact position and perform the touch operation. For example, according to the contact position, it is determined that the optical pen has selected a control, which is equivalent to clicking the control. At this time, the touch operation to be performed when the control is clicked can be determined, and the touch operation can be performed.

[0115] So far, the technical solution of the present application has been described in conjunction with an embodiment shown in the accompanying drawings, but it is easy for those skilled in the art to understand that the protection scope of the present application is obviously not limited to these specific embodiments. Without departing from the principles of the present application, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present application.

Claims

1. An optical pen, characterized in that: The optical pen comprises a shell, a pen core, an array light source, a single pixel detector and a processing module arranged in the shell, and one end of the pen core extends to the outside of the shell to form a pen tip of the optical pen; The array light source is used to emit light of a preset wavelength to the display panel when the pen tip contacts the display panel, the display panel includes a dot matrix layer arranged on a substrate, the dot matrix layer includes a plurality of dot matrices, each dot matrix has a different pattern, the dot matrix pattern is used to represent position information, and the dot matrix can absorb or reflect the light of the preset wavelength; The single pixel detector is used to detect the light intensity of the display panel; The processing module is used to adopt a single-pixel imaging method to reconstruct an image according to the light intensity, and to obtain a contact position of the pen tip on the display panel according to a pattern of a dot matrix in the image.

2. The optical pen according to claim 1, characterized in that: The optical pen comprises a circuit module disposed in the housing, and the circuit module is used for modulating the light of the preset wavelength emitted by the array light source into structured light according to a preset coding pattern.

3. The optical pen according to claim 2, characterized in that: The preset coding pattern is Hadamard speckle.

4. The optical pen according to claim 3, characterized in that: The single-pixel imaging method includes a single-pixel imaging algorithm based on compressed sensing, and the processing module is used to adopt the single-pixel imaging algorithm based on compressed sensing to reconstruct the image according to the Hadamard speckle and the light intensity.

5. The optical pen according to claim 1, characterized in that: The distance between adjacent light sources in the array light source is smaller than the distance between adjacent dot arrays in the dot array layer.

6. A display panel, characterized in that: The display panel includes a dot matrix layer arranged on a substrate, the dot matrix layer includes a plurality of dot matrices, each dot matrix has a different pattern, the dot matrix pattern is used to represent position information, the dot matrix can absorb or reflect light of a preset wavelength emitted by an optical pen, and the optical pen is the optical pen according to any one of claims 1 to 5.

7. The display panel according to claim 6, characterized in that: The display panel includes a pixel layer, the pixel layer includes a plurality of pixels, and the orthographic projection of the dot matrix on the substrate does not overlap with the orthographic projection of the pixels on the substrate.

8. The display panel according to claim 7, characterized in that: The orthographic projection of the dot matrix on the substrate is a stripe, and the orthographic projection of the dot matrix on the substrate is located between the orthographic projections of adjacent pixels on the substrate; or, The orthographic projection of the dot matrix on the substrate is frame-shaped, and the orthographic projection of the dot matrix on the substrate surrounds the orthographic projection of at least one pixel on the substrate.

9. The display panel according to any one of claims 6 to 8, characterized in that: The display panel comprises: A polarizer layer is formed on a side of the dot matrix layer away from the substrate, and the dot matrix layer includes a diffuse reflection layer and a plurality of dot matrices arranged on the diffuse reflection layer.

10. The display panel according to any one of claims 6 to 8, characterized in that: The display panel comprises: A color filter layer, wherein the color filter layer comprises a black matrix, and an orthographic projection of the dot matrix on the substrate overlaps with an orthographic projection of the black matrix on the substrate.

11. A display device, characterized in that: The display device comprises the display panel according to any one of claims 6 to 10.

12. An interactive system, characterized in that: The system comprises the optical pen according to any one of claims 1 to 5 and the display device according to claim 11; The optical pen is communicatively connected to the display device, and is used to obtain a contact position of its pen tip on a display panel of the display device, and transmit the contact position to the display device.