Optical pen, display substrate and display device

Abstract

The invention provides an optical pen, a display substrate and a display device. The optical pen comprises a pen body; the pen point is positioned at one end of the pen body and is made of a transparent material; light rays with preset wavelengths emitted by the light source are projected to the coding pattern layer of the display screen through the pen point; the light receiving unit is positioned on the pen body and is close to the pen point; wherein the light receiving unit comprises a first optical element and an image sensor, the first optical element converges the light reflected by the coding pattern layer and projects the converged light to the image sensor, and the image sensor is used for obtaining a target image of the contact between the pen point and the display screen based on the received light.

Description

Technical Field

[0001] This disclosure relates to the field of display technology, and in particular to an optical pen, a display substrate, and a display device. Background Technology

[0002] An optical pen is a tool used to interact with display devices, allowing users to hold the optical pen and write or perform touch operations on the screen.

[0003] Optical pens typically use infrared light as their communication medium, avoiding visible light interference with screen viewing and facilitating filtering and recognition by cameras. An infrared filter is installed in front of the camera to block most visible and ambient light, allowing only the specific wavelength of infrared light emitted by the pen to pass through, significantly improving the signal-to-noise ratio. Based on the target image captured by the camera of the pen's contact with the display screen, the pen's position and movement on the screen can be determined and sent to the display device, enabling it to perform corresponding operations such as writing or touch. Infrared light recognition pens can be widely used in smart education, remote work, virtual reality, and other fields, providing users with a convenient and intuitive interaction method. With the increasing demand for large-size display screens, infrared light recognition pens can provide more accurate recognition results and a more comfortable user experience. However, since infrared optical pens rely on light for recognition, light loss is inevitable during use. Therefore, reducing light loss, improving light energy utilization efficiency, and ensuring recognition accuracy remain pressing issues to be addressed. Summary of the Invention

[0004] The technical problem to be solved by this disclosure is to provide an optical pen, a display substrate and a display device that can reduce light loss of the optical pen, improve the efficiency of light energy use and ensure recognition accuracy.

[0005] To address the aforementioned technical problems, the embodiments of this disclosure provide the following technical solutions:

[0006] On the one hand, an optical pen is provided, comprising:

[0007] Pen body;

[0008] The pen tip, located at one end of the pen body, is made of transparent material;

[0009] A light source located on the pen tip emits light of a preset wavelength, which is projected through the pen tip onto the coded pattern layer of the display screen; and

[0010] A light-receiving unit located on the pen body and near the pen tip;

[0011] The light receiving unit includes a first optical element and an image sensor. The first optical element converges the light reflected by the coded pattern layer and projects the converged light onto the image sensor. The image sensor is used to acquire a target image of the pen tip in contact with the display screen based on the received light.

[0012] On one hand, a display substrate is provided, comprising:

[0013] The substrate has multiple pixel regions;

[0014] The coding pattern layer is disposed on the substrate, and the orthographic projection of the coding pattern layer on the plane of the substrate is located between multiple pixel regions;

[0015] The coded pattern layer includes:

[0016] Multiple first baselines and multiple second baselines are set on the substrate, and the multiple first baselines and multiple second baselines are distributed horizontally and vertically to define multiple coding areas;

[0017] Multiple coded patterns are located within corresponding coded regions, and each coded pattern within a region can represent unique location information.

[0018] On one hand, a display device is provided, including a display screen, which includes the aforementioned OLED display substrate.

[0019] The embodiments disclosed herein have the following beneficial effects:

[0020] In the above solution, optical elements are placed in front of the image sensor to converge the light reflected from the coded pattern layer of the display screen, thereby reducing light source loss, improving light energy utilization efficiency, and ensuring recognition accuracy. Furthermore, by placing the light source at the pen tip, closer to the coded pattern layer of the display screen, more light is projected onto the coded pattern layer, reducing light source loss. Therefore, the coded pattern layer of the display screen does not need to use a material with high diffuse reflectivity; instead, ordinary reflective materials can be used, reducing the material requirements of the coded pattern layer and thus lowering costs. Attached Figure Description

[0021] Figure 1 This is an illustration of the use of the optical pen in some embodiments of this disclosure. Figure 1 ;

[0022] Figure 2 for Figure 1 A schematic diagram of the orthographic projection of the Zhongguang optical pen along the axis of the pen body;

[0023] Figure 3 This is an illustration of the use of the optical pen in some embodiments of this disclosure. Figure 2 ;

[0024] Figure 4 for Figure 3 A schematic diagram of the orthographic projection of the Zhongguang optical pen along the axis of the pen body;

[0025] Figure 5 for Figure 3 A magnified view of the tip of the Zhongguang optical pen;

[0026] Figure 6 This is an illustration of the use of the optical pen in some embodiments of this disclosure. Figure 3 ;

[0027] Figure 7 for Figure 6 A magnified view of the tip of the Zhongguang optical pen;

[0028] Figure 8 This is a partially enlarged schematic diagram of the tip of the optical pen in some embodiments of this disclosure. Figure 1 ;

[0029] Figure 9 This is a partially enlarged schematic diagram of the tip of the optical pen in some embodiments of this disclosure. Figure 2 ;

[0030] Figure 10 This is an illustration of the use of the optical pen in some embodiments of this disclosure. Figure 4 ;

[0031] Figure 11 for Figure 10 A magnified view of the tip of the Zhongguang optical pen;

[0032] Figure 12 This is an illustration of the use of the optical pen in some embodiments of this disclosure. Figure 5 ;

[0033] Figure 13 for Figure 12 A magnified view of the tip of the Zhongguang optical pen;

[0034] Figure 14 This is a schematic diagram of the orthographic projection of the optical pen along the axis of the pen body in some embodiments of this disclosure;

[0035] Figure 15 This is a partial planar schematic diagram of the display substrate in some embodiments of this disclosure;

[0036] Figure 16 This is a schematic diagram of the sub-encoding patterns and their encoding included in the encoding pattern layer in some embodiments of this disclosure;

[0037] Figure 17 This is a schematic diagram of the encoding of a coding region of the coding pattern layer in some embodiments of this disclosure;

[0038] Figure 18 This is a schematic diagram of the structure of the display substrate in some embodiments of this disclosure. Detailed Implementation

[0039] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the described embodiments of this disclosure are within the scope of protection of this disclosure.

[0040] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as “comprising,” “having,” and “including,” and any variations thereof, mean that the element or object preceding the word encompasses the element or object listed following the word and its equivalents, without excluding other elements or objects. Terms such as “connected” or “linked” are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. Terms such as “upper,” “lower,” “left,” and “right” are used only to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship may also change accordingly. In embodiments of this disclosure, unless otherwise specified, “multiple” refers to two or more.

[0041] An infrared optical pen is a tool for interacting with display devices, allowing users to write or touch on the screen. An infrared optical pen includes an infrared light source (such as an infrared LED) positioned close to the pen tip, which is used to contact the display screen for writing or touch operations. A mechanical switch or pressure sensor can be incorporated to detect whether the pen tip is pressing against the display screen. In response to this detection, the infrared light source illuminates, recognizing the writing or touch operation. The pen tip can be a soft plastic or rubber tip to protect the screen and provide a tactile writing experience.

[0042] In related technologies, an coded pattern layer can be set on the display screen. This layer includes multiple different coded patterns, each representing unique positional information. The infrared optical pen may also include a camera and a processor. When a user holds the optical pen and writes or performs touch operations on the display screen, the infrared light emitted by the pen is projected onto the coded pattern layer and reflected by it. The camera receives the reflected light to obtain an image of the contact between the infrared optical pen and the display screen. The processor can identify the positional information of the contact between the infrared optical pen and the display screen based on the coded pattern in the image. The infrared optical pen can send this identified positional information to the display device. Based on this information, the display device can obtain the writing or touch position of the pen on the screen and perform the corresponding writing or touch operation. If a user holds the infrared optical pen and writes on the screen, the contact trajectory can be obtained based on the contact position information. This trajectory represents the user's handwriting, and the written information can be obtained and displayed. If a user holds an infrared optical pen and performs a touch operation on the display screen, the touch position of the infrared optical pen on the display screen can be obtained based on the contact position information. Based on the touch position, the touch command triggered by the user can be identified, and then the corresponding touch operation can be executed according to the touch command.

[0043] In the above solution, by embedding a camera in the optical pen, only an additional coded pattern layer needs to be added to the display screen. This ensures that each reading is of a unique "address code" representing the absolute position of the optical pen. Therefore, each stroke and each point is independently located, eliminating drift and error accumulation issues. The pen tip returns to the same point, reading the same coordinates, resulting in extremely high accuracy and low cost. As long as the small area touched by the pen tip is clean and visible to the camera, it will work normally. Even if other parts of the pen body or the user's palm are completely pressed against the screen, they will not create any "obstruction" because the "eye" (camera) is at the pen tip. Optical pens typically have a built-in infrared light source (LED) to illuminate the coded pattern layer, and most ambient light can be filtered out by an infrared filter. Therefore, it can work stably in both bright and dark environments, with extremely strong anti-interference capabilities.

[0044] Because the surface of the display screen is relatively smooth, the infrared light emitted by the infrared light source will produce specular reflection on the surface of the display screen, resulting in a relatively weak light projected onto the coding pattern layer. Consequently, the light reflected from the coding pattern layer received by the camera will also be relatively weak, affecting the image acquisition effect and potentially leading to an inability to accurately identify the contact position information of the infrared optical pen on the display screen.

[0045] In related technologies, a coding pattern layer can be formed using materials with high infrared diffuse reflectivity to increase the light reflection efficiency of the coding pattern layer and ensure accurate identification of the contact position information of the infrared optical pen on the display screen. However, the special requirements for the material of the coding pattern layer increase the manufacturing cost. Therefore, how to reduce the light loss of the infrared optical pen and improve the light energy utilization efficiency to ensure recognition accuracy remains an urgent problem to be solved.

[0046] Based on this, this embodiment of the disclosure provides an optical pen that uses optical elements positioned in front of a camera to converge light reflected from the coded pattern layer of the display screen. This increases the efficiency of light utilization from the coded pattern layer, thereby reducing light loss and improving light energy efficiency, ensuring recognition accuracy. Furthermore, by placing the light source at the pen tip, closer to the coded pattern layer of the display screen, more light is projected onto the coded pattern layer, reducing light loss. Therefore, the coded pattern layer of the display screen does not need to use a material with high diffuse reflectivity to increase reflection efficiency; instead, ordinary reflective materials can be used, reducing the material requirements of the coded pattern layer and thus lowering costs.

[0047] The optical pen in this embodiment may be, but is not limited to, an infrared optical pen, or may be an optical pen using other invisible light; no limitation is made here.

[0048] The technical solution of this disclosure will now be described in detail with reference to the accompanying drawings and specific embodiments.

[0049] According to some embodiments of this disclosure, an optical pen is provided. See also Figure 1 and Figure 2 As shown, the optical pen includes:

[0050] Pen body 90;

[0051] The pen tip 20 is located at one end of the pen body 90 and is made of transparent material;

[0052] A light source 30 located on the pen tip 20 emits light of a preset wavelength, which is projected onto the coded pattern layer of the display screen 10 via the pen tip 20; and

[0053] A light receiving unit 40 is located on the pen body 90 and near the pen tip 20.

[0054] The light receiving unit 40 includes a first optical element 401 and an image sensor 402. The first optical element 401 converges the light reflected by the coded pattern layer and projects the converged light onto the image sensor 402. The image sensor 402 is used to acquire a target image of the pen tip 20 in contact with the display screen 10 based on the received light.

[0055] Therefore, by placing the light source at the pen tip, closer to the coded pattern layer of the display screen, more light is projected onto the coded pattern layer. The light reflected from the coded pattern layer is then converged before being projected onto the image sensor, increasing the efficiency of light utilization from the coded pattern layer. This reduces light loss, improves light energy efficiency, and ensures accurate recognition. Furthermore, the coded pattern layer of the display screen does not need to use materials with high diffuse reflectivity to increase reflection efficiency; ordinary reflective materials can be used, reducing the material requirements of the coded pattern layer and achieving cost reduction.

[0056] The pen body 90 of the optical pen can be hollow, allowing some components (such as the battery 80 that powers the light source 30, the processing unit 60, and the storage unit 50) to be installed inside, resulting in a more aesthetically pleasing design. The shape of the pen body 90 can resemble that of a conventional writing pen, as long as it is easy to grip and use; there are no specific limitations.

[0057] The pen tip 20 can be a soft plastic or rubber tip to protect the screen and provide a tactile writing experience. Alternatively, the writing end (the end that contacts the display screen 10) can be made of soft plastic or rubber, while the remainder is made of a rigid material.

[0058] In this embodiment, the pen tip 20 is made of a transparent material (such as transparent plastic) so that it does not block light, allowing light emitted from the light source 30 disposed on the pen tip 20 to be projected through the pen tip 20 onto the coded pattern layer of the display screen 10.

[0059] In this embodiment, the light receiving unit 40 receives light reflected from the coded pattern layer of the display screen 10, converges the reflected light, and then acquires a target image of the pen tip 20 in contact with the display screen 10 based on the converged reflected light. The added first optical element 401 enables the convergence of light reflected from the coded pattern layer, increasing the efficiency of using the reflected light.

[0060] In some embodiments, the first optical element 401 may be a lens unit, which can converge the light reflected from the coded pattern layer through a single lens or a lens group. The first optical element 401 may be, for example, a single concave lens or a lens group consisting of multiple concave lenses.

[0061] The image sensor 402 can be, for example, a camera, and the first optical element 401 can be mounted in front of the camera lens. An infrared filter can also be mounted in front of the camera lens to filter out most of the ambient light, thus enabling stable operation and strong anti-interference capabilities in both bright and dark environments.

[0062] According to some embodiments of this disclosure, the first optical element 401 and the image sensor 402 can be arranged at intervals along the extension direction of the axis of the pen body 90, which is beneficial to realize that the light reflected by the coding pattern layer can be converged by the first optical element 401 and then projected onto the image sensor 402.

[0063] In some embodiments, the first optical element 401 and the image sensor 402 may be arranged at intervals along the extending direction of the axis of the pen body 90. The optical receiving unit may include a plurality of first optical elements 401 and a plurality of image sensors 402. The plurality of image sensors 402 may be distributed at intervals on a ring line centered on the axis of the pen body 90, and along the extending direction of the axis of the pen body 90, the positions of the plurality of first optical elements 401 and the plurality of image sensors 402 correspond one-to-one. The first sub-projection of the first optical element 401 and the second sub-projection of the corresponding image sensor 402 at least partially overlap. The first sub-projection is the orthographic projection of the first optical element 401 on a cross-section perpendicular to the axis of the pen body 90, and the second sub-projection is the orthographic projection of the image sensor 402 on the same cross-section. Figure 2 In the illustrative example, the first sub-projection of the first optical element 401 and the second sub-projection of the corresponding image sensor 402 completely overlap. For ease of understanding, Figure 2 The first sub-projection of the first optical element 401 and the second sub-projection of the image sensor 402 are illustrated using reference numerals from the light receiving unit 40.

[0064] In other words, multiple first optical elements 401 cooperate with image sensors 402 at corresponding positions to ensure that the light projected onto each image sensor 402 is the light reflected from the coded pattern layer and converged by the corresponding first optical element 401, thereby guaranteeing the recognition accuracy of each image sensor 402. Furthermore, when the user holds the optical pen, the angle between the optical pen and the display screen 10 is typically less than 90°. By setting multiple image sensors 402 spaced out along a ring centered on the axis of the pen body 90, regardless of whether the user holds the optical pen and rotates it at any angle around the axis of the pen body 90, the image sensor 402 located on the lower side of the display screen 10 along the axis of the pen body 90 can receive the light reflected from the coded pattern layer to identify the contact position information between the optical pen and the display screen 10. Therefore, the optical pen can be used in any direction and can receive the light reflected from the coded pattern layer to obtain the target image of the contact between the pen tip 20 and the display screen 10, so as to identify the contact position information between the optical pen and the display screen 10, which is more in line with the usage habits of traditional writing pens and improves the user experience.

[0065] The distribution angle of the multiple image sensors 402 relative to the axis of the pen body 90 can be set according to actual needs. For example, the multiple image sensors 402 can be distributed at intervals along the entire semi-circle centered on the axis of the pen body 90, that is, the distribution angle of the multiple image sensors 402 relative to the axis of the pen body 90 is 360°. See [link / reference]. Figure 1 and Figure 2 As shown. Multiple image sensors 402 can also be spaced out along a semi-circle centered on the axis of the pen body 90; that is, the multiple image sensors 402 are distributed at an angle of 180° relative to the axis of the pen body 90. See [reference needed]. Figures 3-5 As shown, Figure 3 and Figure 5 The line segment with the arrowhead indicates the direction of light propagation.

[0066] by Figure 1 Taking the illustrated pen-holding direction as an example, the first optical element 401 and image sensor 402, located on the axis of the pen body 90 near the lower side of the display screen 10 and corresponding to that position, can receive the light reflected from the coded pattern layer. It can be understood that when the optical pen is rotated about the axis of the pen body 90, another first optical element 401 and another image sensor 402, also located on the axis of the pen body 90 near the lower side of the display screen 10 and corresponding to that position, can also receive the light reflected from the coded pattern layer, thus enabling the optical pen to be used in any direction.

[0067] According to some embodiments of this disclosure, the light source 30 has a first orthographic projection on a cross-section perpendicular to the axis of the pen body 90, and the light receiving unit 40 has a second orthographic projection on the cross-section. The first and second orthographic projections are staggered. See [reference needed]. Figure 2 and Figure 4 As shown. That is, the light source 30 and the light receiving unit 40 are staggered in a direction perpendicular to the axis of the pen body 90, so as to avoid the light source 30 possibly blocking the light reflected from the coding pattern layer from being projected onto the light receiving unit 40, thereby reducing light loss.

[0068] The second orthographic projection may include a first sub-projection and a second sub-projection. The first sub-projection is the orthographic projection of the first optical element 401 on a cross-section perpendicular to the axis of the pen body 90, and the second sub-projection is the orthographic projection of the image sensor 402 on the same cross-section. In some embodiments, the first and second sub-projections may be offset from the first orthographic projection. That is, along the direction perpendicular to the axis of the pen body 90, the first optical element 401 and the image sensor 402 are offset from the light source 30 to avoid the light source 30 potentially blocking the light reflected from the coded pattern layer from being projected onto the first optical element 401, thereby reducing light loss. Along the extension direction of the axis of the pen body 90, the positions of the plurality of first optical elements 401 and the plurality of image sensors 402 correspond one-to-one, that is, the plurality of first sub-projections and the one-to-one corresponding second sub-projections at least partially overlap. Figure 2 and Figure 4 In the illustrative example, the first sub-projection of the first optical element 401 and the second sub-projection of the corresponding image sensor 402 completely overlap, corresponding to the second orthographic projection of the light receiving unit 40. For ease of understanding, Figure 2 and Figure 4 The second orthographic projection of the light receiving unit 40 is illustrated using the reference numerals of the light receiving unit 40, and the first orthographic projection of the light source 30 is illustrated using the reference numerals of the light source 30.

[0069] In some embodiments, a plurality of first sub-projections and a plurality of second sub-projections may be arranged around the periphery of the first orthographic projection. That is, along a cross-section perpendicular to the axis of the pen body 90, the first optical element 401 and the image sensor 402 may be arranged around the periphery of the light source 30. The plurality of first sub-projections may completely overlap with their corresponding second sub-projections.

[0070] In other embodiments, a plurality of first sub-projections and a plurality of second sub-projections are distributed on a first side of the aforementioned cross-section (perpendicular to the axis of the pen body 90) centered on a first orthographic projection (the orthographic projection of the light source 30 on this cross-section). That is, along the cross-section perpendicular to the axis of the pen body 90, the first optical element 401 and the image sensor 402 are located on the first side of the cross-section centered on the light source 30.

[0071] It should be noted that the first optical element 401 and the image sensor 402 being located on the first side of the cross-section centered on the light source 30 can mean that the first optical element 401 and the image sensor 402 are located on the first side of the cross-section along a straight line passing through the light source 30 (first orthographic projection). Alternatively, the first optical element 401 and the image sensor 402 being located on the first side of the cross-section along a straight line passing through the light source 30 (first orthographic projection).

[0072] During the use of the optical pen, the optical pen is usually tilted, that is, the axis of the pen body 90 forms an angle of less than 90° with the display screen 10. This will cause only part of the light from the light source 30 to be projected onto the coded pattern layer of the display screen 10.

[0073] Based on this, and according to some embodiments of this disclosure, see [link to relevant documentation]. Figures 3-5 As shown, the optical pen may further include a reflective optical element 25 disposed on the pen tip 20, located on the side from which light from the light source 30 is emitted. Furthermore, along a direction perpendicular to the axis of the pen body 90, the reflective optical element 25 is located on one side of the light source 30, used to reflect the light emitted from the light source 30 toward that side to the opposite side for projection onto the coded pattern layer. Thus, as much of the light emitted by the light source 30 as possible can be projected onto the display screen 10 located on one side of the optical pen, reducing light loss from the light source 30 and improving the efficiency of light energy utilization.

[0074] like Figure 5 As shown, during the use of the optical pen, along the direction perpendicular to the axis of the pen body 90, the reflective optical element 25 is located on the upper side of the light source 30 away from the display screen 10. A portion of the light from the light source 30 is emitted to the reflective optical element 25, and the reflective optical element 25 reflects this portion of the light to the lower side where the display screen 10 is located, thereby reducing the light loss of the light source 30.

[0075] The reflective optical element 25 can utilize the principle of total internal reflection to reflect the light emitted onto it to the opposite side and project it onto the coded pattern layer of the display screen 10, thereby further reducing the loss of the light source 30 and improving the efficiency of light energy utilization.

[0076] The reflective optical element 25 may be, for example, but is not limited to, a total internal reflection prism.

[0077] In some embodiments, see Figure 6 and Figure 7 As shown, the reflective surface of the reflective optical element 25 can be a curved surface, which is a concave surface that is recessed in the direction away from the axis of the pen body 90, so that the reflected light is projected more evenly onto the side where the display screen 10 is located, thereby improving the quality of the target image acquired by the image sensor 402.

[0078] In some embodiments, see Figure 8 As shown, the reflective surface of the reflective optical element 25 can have multiple protruding structures, so that the reflected light is projected more evenly onto the side where the display screen 10 is located.

[0079] In some embodiments, see Figure 8As shown, the reflective surface of the reflective optical element 25 can be a curved surface, which is a concave surface that is recessed in the direction away from the axis of the pen body 90, and the curved surface can have multiple protruding structures to make the reflected light project more evenly onto the side where the display screen 10 is located.

[0080] In some embodiments, see Figure 9 As shown, the reflective optical element 25 can be a flat plate structure. A reflective film layer can be formed on the reflective surface of the reflective optical element 25, for example, by bonding or film-forming processes (such as chemical deposition, coating, etc.). The reflective film layer can be made of a material with high reflectivity, such as metallic silver. Through the high reflectivity of the reflective surface, a portion of the light emitted from the light source 30 to the side where the reflective optical element 25 is located is reflected to the opposite side, so as to be projected onto the coded pattern layer. Thus, by changing the direction of the light, this portion of the light can also reach the image sensor 402 after being reflected by the coded pattern, reducing the light loss of the light source 30 and improving the light energy utilization efficiency. Understandably, the entire reflective optical element 25 can also be made of a reflective material with high reflectivity, for example, the entire reflective optical element 25 can be made of metal.

[0081] In some embodiments, the reflective surface of the reflective optical element 25 can be a curved surface, which is a concave surface recessed in the direction away from the axis of the pen body 90, and a reflective film layer is provided on the curved surface, thereby improving the light reflection efficiency of the reflective optical element 25 and making the reflected light more uniformly projected onto the side where the display screen 10 is located.

[0082] In some embodiments, the reflective surface of the reflective optical element 25 can be a curved surface, which is a concave surface recessed in the direction away from the axis of the pen body 90, and the curved surface can have multiple protruding structures, and a reflective film layer is provided on the curved surface, thereby improving the light reflection efficiency of the reflective optical element 25 and making the reflected light more uniformly projected onto the side where the display screen 10 is located.

[0083] According to some embodiments of this disclosure, see Figure 10 , Figure 11 and Figure 14As shown, a ring-shaped guide rail 35 can be provided on the tip 20 of the optical pen. The guide rail 35 rotates around the axis of the pen body 90. The reflective optical element 25 is slidably mounted on the guide rail 35, and can slide along the guide rail 35 by inertia around the axis of the pen body 90. A counterweight 31 can also be slidably mounted on the guide rail 35. Both the guide rail 35 and the counterweight 31 are made of transparent material to avoid blocking the light from the light source 30 from being projected onto the coding pattern layer of the display screen 10. The weight of the counterweight 31 is greater than the weight of the reflective optical element 25. The counterweight 31 and the reflective optical element 25 are configured to be located on opposite sides of the guide rail 35. Through the counterweight relationship, when the optical pen is used at an angle, the lighter reflective optical element 25 is always on the side of the light source 30 that is slightly above the display screen 10, which can reflect some of the light projected onto the reflective optical element 25 back to the side of the display screen 10. This design allows for pen use from any orientation, while also improving light energy efficiency in any orientation. "Any orientation" means that the user can rotate the optical pen freely around its 90-degree axis.

[0084] According to other embodiments of this disclosure, see Figure 12 , Figure 13 and Figure 14 As shown, a ring-shaped guide rail 35 can be provided on the tip 20 of the optical pen. The guide rail 35 rotates around the axis of the pen body 90. The reflective optical element 25 is slidably disposed on the guide rail 35, and the reflective optical element 25 can slide on the guide rail 35 by inertia around the axis of the pen body 90. The guide rail 35 is made of transparent material to avoid blocking the light from the light source 30 from being projected onto the coding pattern layer of the display screen 10. A second optical element 32 can also be slidably disposed on the guide rail 35. The weight of the second optical element 32 is greater than that of the reflective optical element 25. The second optical element 32 and the reflective optical element 25 are configured to be located on opposite sides of the guide rail 35. The second optical element 32 diffuses the light emitted by the light source 30 and projects the diffused light onto the coding pattern layer of the display screen 10. Since the second optical element 32 can expand the divergence angle of the light, the light from the light source 30 can be effectively diffused to the coding pattern layer. Meanwhile, the weight distribution ensures that when the optical pen is tilted, the lighter reflective optical element 25 is always positioned on the side of the light source 30 slightly above the display screen 10, allowing some of the light projected onto the reflective optical element 25 to be reflected back to the side where the display screen 10 is located. This design allows the pen to be used in any orientation and improves light energy utilization efficiency in any grip orientation.

[0085] The second optical element 32 may be, for example, but is not limited to, a plano-concave lens.

[0086] As an example, an annular guide rail 35 can be provided on the tip 20 of the optical pen. The guide rail 35 rotates about the axis of the pen body 90. A reflective optical element 25 is slidably disposed on the guide rail 35, and the reflective optical element 25 can slide on the guide rail 35 by inertia, oriented around the axis of the pen body 90. The guide rail 35 is made of a transparent material to avoid obstructing the light from the light source 30 from being projected onto the coded pattern layer of the display screen 10. A second optical element 32 can also be slidably disposed on the guide rail 35. The weight of the second optical element 32 is greater than that of the reflective optical element 25, and the second optical element 32 and the reflective optical element 25 are configured to be located on opposite sides of the guide rail 35. The second optical element 32 diffuses the light emitted by the light source 30 and projects the diffused light onto the coded pattern layer of the display screen 10. This design allows the pen to be used in any direction and improves light energy utilization efficiency in any pen-holding direction. Simultaneously, the optical pen may include multiple light-receiving units 40. The light source 30 has a first orthographic projection on a cross-section perpendicular to the axis of the pen body 90, and the light receiving unit 40 has a second orthographic projection on the same cross-section. Multiple second orthographic projections can be arranged around the first orthographic projection. In other words, along a direction perpendicular to the axis of the pen body 90, multiple light receiving units 40 and the light source 30 can be arranged around the light source 30 to prevent the light source 30 from potentially blocking light reflected from the coded pattern layer from reaching the light receiving unit 40, thus reducing light loss. Therefore, by effectively diffusing more light from the light source 30 to the coded pattern layer of the display screen 10 and effectively projecting light reflected from the coded pattern layer to the light receiving unit 40, the light loss of the light source 30 can be further reduced, improving light energy utilization.

[0087] According to some embodiments of this disclosure, the optical pen may further include:

[0088] The processing unit 60, which is connected to the image sensor 402, is configured to acquire position information of the pen tip 20 on the display screen 10 based on the target image;

[0089] The first communication unit 70, which is connected to the processing unit 60, is configured to send the position information of the pen tip 20 to the display device.

[0090] Therefore, the optical pen, through its built-in processing unit 60, can determine its position information based on the target image acquired by the built-in image sensor 402. The display screen 10 itself does not need to integrate a complex sensor grid (such as the grid of a capacitive or electromagnetic screen), but only needs to add a layer of coded pattern, which greatly reduces the complexity and cost of the display. All the computational burden is concentrated in the optical pen, which makes the system easy to deploy and expand, requiring only one optical pen and one receiver (such as a Bluetooth receiver).

[0091] The processing unit 60 can determine unique position information by recognizing the coded pattern in the area where the optical pen and the display screen 10 contact in the target image. In other words, different areas on the display screen 10 have different coded patterns, and each coded pattern can uniquely represent the position information of its area. For example, a mapping table of coded patterns and position coordinates on the display screen 10 can be stored. The processing unit 60 can, for example, perform feature comparison and matching between the target image and the coded patterns in the mapping table, and look up the position coordinate data of the contact between the optical pen and the display screen 10 based on the corresponding feature information.

[0092] The first communication unit 70 can be, for example, a Bluetooth communication unit, a Wi-Fi communication unit, an NFC communication unit, etc.

[0093] According to some embodiments of this disclosure, a display substrate is also provided. See also Figure 15 As shown, the display substrate may include:

[0094] The substrate has multiple pixel regions 100;

[0095] An encoding pattern layer is disposed on the substrate, and the orthographic projection of the encoding pattern layer on the plane of the substrate is located between the plurality of pixel regions 100.

[0096] The coded pattern layer includes:

[0097] Multiple first reference lines 101 and multiple second reference lines 102 are set on the substrate, and the multiple first reference lines 101 and multiple second reference lines 102 are distributed horizontally and vertically to define multiple coding regions 200.

[0098] Multiple coded patterns are located in corresponding coded regions 200, and each coded pattern in a coded region 200 can represent unique location information.

[0099] Therefore, by adding a coding pattern layer on the display substrate, the optical pen can identify the coding pattern in the coding area 200 where the optical pen and the display screen 10 are in contact by acquiring the target image of the contact between the optical pen and the display screen 10, and determine the unique position information of the contact between the optical pen and the display screen 10 based on the coding pattern, which greatly reduces the complexity and cost of the screen.

[0100] The material of the coding pattern layer 105 can be a polymer, metal oxide, or silicon-based material that reflects light of a specific wavelength (e.g., infrared light), and can be formed into sub-coding patterns of different shapes by etching or exposure.

[0101] In some embodiments, the encoding pattern layer may include multiple sub-encoding patterns of different shapes, and each sub-encoding pattern may be assigned a unique code, such as 00, 01, 10, or 11. The specific encoding method can be set according to requirements. The encoding pattern within the encoding region 200 is composed of multiple sub-encoding patterns arranged according to a preset rule, and the arrangement of multiple sub-encoding patterns in different encoding regions 200 is different. Therefore, by using the sorting of multiple sub-encoding patterns of different shapes to represent different positional information, the structure of the encoding pattern layer can be simplified, and the design difficulty of the encoding pattern can be reduced.

[0102] For example, multiple sub-encoding patterns within the encoding region 200 can be arranged in a matrix, with different matrix arrangements of the sub-encoding patterns representing different positional information. For instance, the encoding pattern layer can include five sub-encoding patterns of different shapes, and the encoding region 200 can be a 4x4 matrix structure. Each position in the matrix can be formed from any one of the five different shaped sub-encoding patterns, creating a unique encoding combination corresponding to the positional information. Thus, these five different shaped sub-encoding patterns can represent five... 16 Different location information. Figure 17 It indicated Figure 15 The corresponding coding combination of the sub-coding pattern within a coding region 200 of the coding pattern layer is used to indicate a unique location information.

[0103] In some embodiments, see Figure 16 and Figure 17 As shown, at least some of the sub-encoding patterns can be composed of one or more line segments, and different sub-encoding patterns are composed of different numbers of line segments. The line segment structure is easily positioned within the pixel areas 100 of the display screen 10 without affecting normal display. Representing different sub-encoding patterns by varying the number of line segments simplifies identification and reduces the requirements for the optical pen system. For example, the encoding pattern layer can include five sub-encoding patterns of different shapes, where one sub-encoding pattern contains no line segments and is encoded as null, and the remaining four sub-encoding patterns can be composed of one, two, three, and four line segments respectively, encoded as 00, 01, 10, and 11. Figure 15 In the illustrated example, after identification, the sub-coded patterns and their arrangement within the coded area 200 are encoded as follows: Figure 17 As shown, for example, it can be stored using an encoded number table.

[0104] Understandable. Figure 17 The illustrated example only represents one combination of different line segments within a sub-encoding pattern; it does not limit the combination of different line segments to only one method. Figure 17One illustration. Furthermore, the number of line segments included in a sub-encoding pattern is not limited. Figure 17 One example is that the five sub-code patterns can also be composed of 1 line segment, 2 line segments, 3 line segments, 4 line segments, and 5 line segments respectively. They will not be listed one by one here, and can be designed according to specific needs.

[0105] See Figure 18 As shown, taking an active-matrix (AMOLED) display substrate as an example, the display area may further include a buffer layer 202, a thin-film transistor layer 203, a pixel defining layer 204, an OLED, a thin-film encapsulation layer 205, a first planarization layer 206, a color filter layer 207, a second planarization layer 208, and a module material layer 209, etc., sequentially disposed on the substrate 201. The coding pattern layer 105 is located between the color filter layer 207 and the second planarization layer 208.

[0106] The buffer layer 202 can be a single inorganic layer or multiple inorganic layers, used to block substrate impurities or ions from diffusing to the active layer above, thus ensuring TFT performance.

[0107] The thin-film transistor layer 203 includes an active layer, a gate insulating layer, a gate electrode, an interlayer dielectric layer, and source and drain electrodes. The first planarization layer 206 and the second planarization layer 208 can be organic layers to provide a flat bearing surface. The pixel defining layer 204 is made of an insulating material and has multiple pixel openings, each corresponding to one pixel. The multiple pixels are arranged in a matrix, including multiple rows and multiple columns of pixels.

[0108] Each pixel includes an organic light-emitting diode (OLED). The OLED includes a cathode and an organic light-emitting layer located within a pixel opening in the pixel defining layer 204, and an anode disposed on the organic light-emitting layer. The anode of the OLED can be made of a transparent conductive material with a high work function, such as indium tin oxide (ITO), indium zinc oxide (IZO), or indium gallium zinc oxide (IGZO). The cathode can be made of an active metal with a low work function, such as calcium or barium. The cathode of the OLED is electrically connected to the drain electrode of the thin-film transistor through a via penetrating the first planarization layer.

[0109] The thin film encapsulation layer 205 can be a composite multilayer structure comprising a first inorganic encapsulation layer, an organic encapsulation layer, and a second inorganic encapsulation layer sequentially disposed on the substrate 201.

[0110] The color filter layer 207 may include a black matrix 21 with an opening and a filter layer 22 disposed within the opening of the black matrix 21. The opening of the black matrix 21 corresponds to the position of the pixel opening of the pixel defining layer 204.

[0111] The display substrate may also include multiple gate lines fabricated on the same layer as the gate electrode and multiple data lines fabricated on the same layer as the source and drain electrodes. The data lines may extend along the column direction, and the multiple data lines may be arranged along the row direction. The gate lines may extend along the row direction, and the multiple gate lines may be arranged along the column direction. The module material layer 209 may include other functional film layers such as a polarizer (located on the display side of the color filter layer) and a cover plate.

[0112] It is understood that the above description uses an AMOLED display substrate as an example to illustrate the functional film layers included in the display area, and does not limit the display area of ​​the OLED display substrate in this embodiment to necessarily including the aforementioned functional film layers. For example, the display area of ​​a passive OLED (PMOLED) display substrate does not include a thin-film transistor (TFT) layer. OLED display substrates employing integrated touch technology may also include a touch electrode layer.

[0113] According to some embodiments of this disclosure, a display device is also provided, including a display screen, the display screen including the display substrate described above.

[0114] The display device in the embodiments of this disclosure can be an LCD display device, an OLED display device, a Micro-LED display device, etc.

[0115] In some embodiments, the display device further includes:

[0116] The second communication unit is configured to receive the position information of the pen tip sent by the optical pen;

[0117] The control chip connected to the second communication unit is configured to perform corresponding operations based on the position information of the pen tip.

[0118] Therefore, the optical pen can determine its position information based on the image obtained by the built-in image sensor through the built-in processing unit. The display device itself does not need to integrate a complex sensor grid (such as the grid of a capacitive screen or an electromagnetic screen), but only needs to add a layer of coded pattern, which greatly reduces the complexity and cost of the display.

[0119] The second communication unit can be, for example, a Bluetooth communication unit, a Wi-Fi communication unit, an NFC communication unit, etc.

[0120] The display device includes, but is not limited to, components such as a display panel, a radio frequency unit, a network module, an audio output unit, an input unit, a sensor, a display unit, a user input unit, an interface unit, a memory, a processor, and a power supply. Those skilled in the art will understand that the structure of the display device described above does not constitute a limitation on the display device; the display device may include more or fewer of the aforementioned components, or combine certain components, or arrange different components. In the embodiments of this disclosure, the display device includes, but is not limited to, a monitor, a mobile phone, a tablet computer, a television set, a wearable electronic device, a navigation display device, etc.

[0121] The display device can be any product or component with display function, such as an LCD TV, LCD monitor, digital photo frame, mobile phone, or tablet computer. The display device also includes a flexible circuit board, a printed circuit board, and a backplate.

[0122] In the description of the above embodiments, specific features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.

[0123] The above description is merely a specific embodiment of this disclosure, but the scope of protection of this disclosure is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this disclosure should be included within the scope of protection of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope of the claims.

Claims

1. An optical pen, comprising: Pen body; The pen tip is located at one end of the pen body and is made of a transparent material; A light source located on the pen tip emits light of a preset wavelength, which is then projected onto the coded pattern layer of the display screen via the pen tip. as well as A light receiving unit located on the pen body and near the pen tip; The light receiving unit includes a first optical element and an image sensor. The first optical element converges the light reflected by the coded pattern layer and projects the converged light onto the image sensor. The image sensor is used to acquire a target image of the pen tip in contact with the display screen based on the received light.

2. The optical pen according to claim 1, further comprising: A reflective optical element is disposed on the pen tip, and the reflective optical element is located on the side from which the light source is emitted; Furthermore, along a direction perpendicular to the axis of the pen body, the reflective optical element is located on one side of the light source, used to reflect the light emitted by the light source toward that side to the opposite side, so as to project it onto the coded pattern layer.

3. The optical pen according to claim 2, wherein, The reflective surface of the reflective optical element is a curved surface, which is a concave surface that is recessed in a direction away from the axis of the pen body.

4. The optical pen according to claim 2, wherein, The reflective surface of the reflective optical element has multiple protruding structures.

5. The optical pen according to claim 2, wherein, The reflective surface of the reflective optical element is provided with a reflective film layer, or the reflective optical element is made of reflective material.

6. The optical pen according to claim 2, wherein, The pen tip is provided with an annular guide rail, the guide rail is rotated about the axis of the pen body, the reflective optical element is slidably disposed on the guide rail, and a counterweight is also slidably disposed on the guide rail. Both the guide rail and the counterweight are made of transparent material. The counterweight has a weight greater than the reflective optical element, and the counterweight and the reflective optical element are configured to be located on opposite sides of the guide rail.

7. The optical pen according to claim 2, wherein, The pen tip is provided with an annular guide rail, which rotates about the axis of the pen body and is made of transparent material. The reflective optical element is slidably disposed on the guide rail; a second optical element is also slidably disposed on the guide rail, the second optical element being heavier than the reflective optical element, the second optical element and the reflective optical element being configured to be located on opposite sides of the guide rail, the second optical element diffusing the light emitted by the light source and projecting the diffused light onto the coded pattern layer.

8. The optical pen according to any one of claims 1-7, wherein, The light source has a first orthographic projection on a cross-section perpendicular to the axis of the pen body, and the light receiving unit has a second orthographic projection on the same cross-section. The first and second orthographic projections are staggered.

9. The optical pen according to claim 8, wherein, The second orthographic projection includes a plurality of first sub-projections and a plurality of second sub-projections, wherein the first sub-projection is the orthographic projection of the first optical element on the cross-section, and the second sub-projection is the orthographic projection of the image sensor on the cross-section; The plurality of first sub-projections and the plurality of second sub-projections are arranged around the periphery of the first orthographic projection.

10. The optical pen according to claim 8, wherein, The second orthographic projection includes a plurality of first sub-projections and a plurality of second sub-projections, wherein the first sub-projection is the orthographic projection of the first optical element on the cross-section, and the second sub-projection is the orthographic projection of the image sensor on the cross-section; The plurality of first sub-projections and the plurality of second sub-projections are distributed on a first side of the cross-section centered on the first orthographic projection.

11. The optical pen according to claim 10, wherein, In the case where the optical pen includes a reflective optical element, the reflective optical element has a third orthographic projection on the cross-section, the third orthographic projection being distributed on a second side of the cross-section opposite to the first side.

12. The optical pen according to any one of claims 1-7, wherein, The first optical element and the image sensor are arranged at intervals along the extension direction of the axis of the pen body; In the case where the optical receiving unit includes a plurality of first optical elements and a plurality of image sensors, the plurality of image sensors may be spaced apart on a ring centered on the axis of the pen body, and along the extension direction of the axis of the pen body, the positions of the plurality of first optical elements and the plurality of image sensors correspond one-to-one, and the first sub-projection of the first optical element and the second sub-projection of the corresponding image sensor at least partially overlap, wherein the first sub-projection is the orthographic projection of the first optical element on a cross section perpendicular to the axis of the pen body, and the second sub-projection is the orthographic projection of the image sensor on the cross section.

13. The optical pen according to any one of claims 1-7, further comprising: The processing unit connected to the image sensor is configured to acquire the position information of the pen tip on the display screen based on the target image; A first communication unit connected to the processing unit is configured to send the position information of the pen tip to a display device.

14. A display substrate, comprising: The substrate has multiple pixel regions; An encoding pattern layer disposed on the substrate, wherein the orthographic projection of the encoding pattern layer onto the plane of the substrate is located between the plurality of pixel regions; The encoded pattern layer includes: Multiple first reference lines and multiple second reference lines are set on the substrate, and the multiple first reference lines and multiple second reference lines are distributed horizontally and vertically to define multiple coding areas; Multiple coded patterns are located within corresponding coded regions, and each coded pattern within a coded region can represent unique location information.

15. The display substrate according to claim 14, wherein, The encoding pattern layer includes multiple sub-encoding patterns of different shapes. The encoding pattern in the encoding area is formed by arranging the multiple sub-encoding patterns according to a preset rule, and the arrangement of the multiple sub-encoding patterns in different encoding areas is different.

16. The display substrate according to claim 15, wherein, The multiple sub-encoding patterns within the encoding area are arranged in a matrix.

17. The display substrate according to claim 15, wherein, At least some of the sub-coding patterns are composed of one or more line segments, and different sub-coding patterns are composed of different numbers of line segments.

18. A display device comprising a display screen, the display screen comprising a display substrate according to any one of claims 14-17.

19. The display device according to claim 18, further comprising: The second communication unit is configured to receive the position information of the pen tip sent by the optical pen; The control chip connected to the second communication unit is configured to perform corresponding operations based on the position information of the pen tip.

Images