Intelligent interactive display panel with laser color recognition function and interactive method thereof
By using a thin-film transistor array on an intelligent interactive display panel to identify laser colors, combined with wireless transmission technology, the problem of limited interactive functionality in large-scale applications of existing laser pointers has been solved, enabling efficient and convenient laser color recognition and interactive operation.
Patent Information
- Application Number
- CN202210997889.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-19
- Publication Date
- 2026-03-03
- Estimated Expiration
- 2042-08-19
AI Technical Summary
Existing laser pointer interactive devices have limited interactive functions in large venues, are greatly affected by environmental factors, have high costs, and cannot effectively identify laser colors, resulting in inconvenient interactive operation.
Design an intelligent interactive display panel, comprising a laser sensing unit, an acquisition unit, a storage unit, and a processing unit. It identifies laser color through a thin-film transistor array, filters lasers of different wavelengths using a selective light-transmitting layer, and adjusts the laser color using wireless transmission technology to achieve precise interaction.
It enables laser color recognition in large settings without the need for a camera, saving costs, improving interaction accuracy and convenience, supporting multiple interaction methods, and is suitable for large-scale scenarios such as LCD video walls.
Smart Images

Figure CN115344144B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of display technology, and in particular to an intelligent interactive display panel with laser color recognition function and its interaction method. Background Technology
[0002] With the continuous innovation and widespread application of interactive systems, contactless interactive operations have become particularly important. Currently, remote interaction with screens mainly consists of voice interaction and gesture interaction. However, voice interaction has a short control distance, making it unsuitable for large venues, and is easily affected by environmental factors, leading to reduced recognition accuracy. Gesture interaction mainly involves capturing and analyzing gesture images through an external camera, which is costly and also easily affected by factors such as ambient lighting, impacting gesture recognition accuracy.
[0003] Lasers offer advantages over ordinary light sources, including superior directionality, high brightness, and less susceptibility to environmental influences. Laser-emitting devices, such as laser pointers, are now widely used in teaching and office settings. Currently, several common laser pointers on the market offer limited functionality: ordinary laser pointers provide basic page turning and pointing functions, but are too restrictive; page-turning laser pointers offer page turning, zooming, and annotation functions, but are limited to PowerPoint presentations, and their gyroscopes cannot detect translational motion. Furthermore, the annotation function requires interaction with the computer screen, not the large presentation screen, resulting in a dual-screen operation and inconvenience. In summary, current laser pointers suffer from limitations such as limited interactive functions and cumbersome operation.
[0004] Chinese patent application CN108279838A discloses a remote interaction method for a laser pointer. It captures projected images via a camera and analyzes the position and color of laser points frame by frame, determining mouse gestures based on the color changes of the laser points. This allows for a one-to-one mapping of coordinates between the projection screen and the computer screen. However, this method requires image processing of each frame to determine the laser point's position and color. While maintaining image quality and frame rate, this extensive image processing consumes significant resources, increasing power consumption. This invention proposes a novel method for obtaining laser point color. By using a display panel, the laser sensing unit, acquisition unit, processing unit, and storage unit can directly determine the laser point's position and color. This eliminates the need for an external camera, significantly reducing costs and improving presentation quality.
[0005] Thin-film transistors (TFTs) possess advantages such as photosensitivity, high mobility, and low power consumption. Currently, many functions are integrated into TFT displays, expanding their application scenarios. However, many processes and related designs still require further refinement to achieve more interactive functions. Therefore, a display panel needs to be designed that can recognize laser colors and achieve better demonstration effects through various interactive methods. Summary of the Invention
[0006] This invention proposes an intelligent interactive display panel and its interaction method with laser color recognition function. It can recognize laser color and support better demonstration effects through multiple interaction methods.
[0007] The present invention adopts the following technical solution.
[0008] An intelligent interactive display panel with laser color recognition capability includes:
[0009] Laser sensing unit (101): The laser sensing unit includes a substrate and a sensing layer composed of a thin film transistor (2081) for sensing the color of laser light; a selective light-transmitting layer (2087) is provided on the surface of the sensing layer away from the substrate, and the spectral range of light allowed to be transmitted by the selective light-transmitting layer includes the spectral range of laser light emitted by the laser emitting device.
[0010] Acquisition unit (102): The acquisition unit is connected to the laser sensing unit (101) to acquire photosensitive data and determine the coordinates of the external laser light source illuminating the display panel;
[0011] Storage unit (104): The storage unit is used to store the interactive program and the coordinate values of the thin-film transistor that senses the laser color;
[0012] Processing unit (103): The processing unit calls the interactive program stored in the storage unit; matches the acquired photosensitive coordinates with the coordinate values of the thin film transistor to determine the laser color; and processes and calculates the specific coordinates of the external laser light source illuminating the display panel.
[0013] The selective light-transmitting layer comprises an array of first sub-selective light-transmitting layers (2082), second sub-selective light-transmitting layers (2083), and third sub-selective light-transmitting layers (2084), with different sub-selective light-transmitting layers selectively transmitting different ranges of laser wavelengths.
[0014] The first sub-selective light-transmitting layer allows red laser light to pass through in the wavelength range of 635 nm to 660 nm, with a transmittance of 70% to 75%; the second sub-selective light-transmitting layer allows green laser light to pass through in the wavelength range of 532 nm to 556 nm, with a transmittance of 75% to 80%; and the third sub-selective light-transmitting layer allows blue laser light to pass through in the wavelength range of 430 nm to 480 nm, with a transmittance of 60% to 70%.
[0015] Thin-film transistors covered by a first selective light-transmitting layer are used to sense red laser light; thin-film transistors covered by a second selective light-transmitting layer are used to sense green laser light; and thin-film transistors covered by the first selective light-transmitting layer are used to sense blue laser light.
[0016] The first sub-selective light-transmitting layer, the second sub-selective light-transmitting layer, and the third sub-selective light-transmitting layer are arranged according to a preset layout. Thin film transistors for sensing red laser, thin film transistors for sensing green laser, and thin film transistors for sensing blue laser form multiple light color recognition units with an area smaller than the laser spot. The multiple light color recognition units are distributed in an array on the surface of the sensing layer away from the substrate.
[0017] The intelligent interactive display panel is used in a liquid crystal display (LCD) with a panel size ranging from 32 inches to 55 inches. The pixel pitch of the LCD panel is 0.36mm to 0.63mm. When the intelligent interactive display panel is 1 to 10m away from the laser emitting device, the laser emitting device (210) emits a laser, and the diameter of the light spot formed on the intelligent interactive display panel is approximately 1.87mm to 8.38mm, completely covering the three sub-selective light-transmitting layers. This allows the acquisition unit to obtain at least one set of vertical and horizontal coordinates of the thin-film transistors. The processing unit matches the coordinates of the thin-film transistors with the coordinate value data in the memory to determine the color of the laser emitted by the laser emitting device.
[0018] The method for setting the vertical and horizontal coordinates of all thin-film transistors is as follows: the coordinates of the thin-film transistor located at the lower left corner of the display panel are set as (1, 1). The first sub-selective light-transmitting layer, the second sub-selective light-transmitting layer, and the third sub-selective light-transmitting layer are arranged in an array according to a preset pattern on the side of the sensing layer away from the substrate. Then, based on the distribution of the three sub-selective light-transmitting layers, the coordinate values of all thin-film transistors that can sense red laser, green laser, and blue laser are obtained, and all coordinate values are stored in the memory.
[0019] The liquid crystal display includes a first polarizer (202), an array substrate (203), a liquid crystal layer (204), a color filter substrate (205), a second polarizer (206), adhesive (207), a display panel (208), and a cover plate (209);
[0020] The display panel (208) includes a thin film transistor (2081), a first sub-selective light-transmitting layer (2082), a second sub-selective light-transmitting layer (2083), a third sub-selective light-transmitting layer (2084), an adhesive layer (2085), and a substrate (2086);
[0021] The array substrate is disposed on the first polarizer; the liquid crystal layer is disposed on the array substrate; the color filter substrate is disposed on the liquid crystal layer; the second polarizer is disposed on the color filter substrate; the display panel and the second polarizer are bonded together by the adhesive; and the cover plate is disposed on the display panel.
[0022] In the display panel, thin-film transistors are arrayed on a substrate; the first sub-selective light-transmitting layer, the second sub-selective light-transmitting layer, and the third sub-selective light-transmitting layer are arrayed and covered on the surface of the sensing layer composed of multiple thin-film transistors according to a preset pattern; the first sub-selective light-transmitting layer, the second sub-selective light-transmitting layer, the third sub-selective light-transmitting layer, and the substrate are bonded to the cover plate through the bonding layer.
[0023] The acquisition unit includes: multiple parallel data lines (301), parallel scan lines (302) each perpendicular to the data lines, a scan driver (303), and a data driver (304).
[0024] The thin-film transistor is located in the region formed by the perpendicular intersection of the data line and the scan line; the gate and drain of the thin-film transistor are connected to the scan line, and the source is connected to the data line.
[0025] The scan driver and the data driver are equipped with current detection devices. The current detection devices are connected to the thin film transistors through the scan line and the data line, respectively. When the laser emitting device emits laser light, the thin film transistors absorb the laser light on their surface and perform photoelectric conversion to convert the light signal into a current signal. The current detection devices are used to detect the current changes of the thin film transistors along the scan line direction and the data line direction.
[0026] The acquisition unit of the display panel includes m rows of scan lines and n columns of data lines. The coordinates of the thin-film transistor at the intersection of the first row of the scan line and the first column of the data line in the lower left corner are set to (1,1), and the coordinates of the thin-film transistor at the intersection of the m row of the scan line and the n column of the data line are set to (m,n). The coordinates of the remaining thin-film transistors of the display panel are calculated in the same way.
[0027] When the laser emitting device emits a laser, the area of the light spot formed when the laser shines on the display panel can cover the three sub-selective light-transmitting layers. Based on the number of rows of the scan lines and the number of columns of the data lines where a group of thin-film transistors are located at the light spot position, the coordinates of this group of thin-film transistors are obtained. The average coordinates of the thin-film transistors are further obtained according to the following formula, and the distance between the average coordinates of the thin-film transistors and the coordinates of each thin-film transistor is determined.
[0028]
[0029]
[0030] Where, x A The average abscissa of the thin-film transistor is represented by y. A This is represented by the average ordinate of the thin-film transistor. i The x-coordinates y are represented by the values obtained when the laser shines on the display panel. i This represents a set of ordinates obtained when a laser beam illuminates the display panel, d min This indicates the distance between the average coordinate of the thin-film transistor and the coordinates of each individual thin-film transistor.
[0031] The LCD screen is a large-size LCD screen or an LCD splicing screen; the substrate of the LCD screen is made of a transparent material; the selective light-transmitting layer is made of polycarbonate material with added visible light penetrating agent. The selective light-transmitting layer absorbs or reflects the ambient light and backlight light at the location of the thin film transistor, thereby reducing the interference of ambient light and backlight light on the operation of the thin film transistor.
[0032] When the laser emitting device emits a red laser, only the thin-film transistors covered by the first sub-selective light-transmitting layer can absorb the red laser light onto their surface for photoelectric conversion, converting the optical signal into a current signal; when the laser emitting device emits a green laser, only the thin-film transistors covered by the second sub-selective light-transmitting layer can absorb the green laser light onto their surface for photoelectric conversion, converting the optical signal into a current signal; when the laser emitting device emits a blue laser, only the thin-film transistors covered by the third sub-selective light-transmitting layer can absorb the blue laser light onto their surface for photoelectric conversion, converting the optical signal into a current signal.
[0033] An interactive method for an intelligent interactive display panel with laser color recognition function, using the display panel described above, is characterized by including the following steps;
[0034] Step S1: Set the first preset matching color for the interactive area and the second preset matching color for the non-interactive area. Specifically, the interactive area and the non-interactive area are divided according to the content of the display interface. The interactive area includes menus, buttons, or icons used for interaction. The area other than the set interactive area is the non-interactive area. The first preset matching color means that only lasers of this color can perform the corresponding operation in the interactive area. The second preset matching color means that only lasers of this color can perform the corresponding operation in the non-interactive area.
[0035] Step S2: The display panel receives the laser signal from the laser emitting device, that is, the sensed laser signal is converted into an electrical signal through the thin film transistor of the sensing layer;
[0036] Step S3: Obtain the position information and color of the laser signal;
[0037] Step S4: Determine whether the laser spot is located in the interactive area or the non-interactive area;
[0038] Step S5: If the laser spot is in the interaction area, determine whether the laser color is the first preset matching color;
[0039] Step S6: If the laser color is not the first preset matching color, the display panel will wirelessly transmit the color change command to the laser emitting device, and the laser emitting device will change the laser color to the first preset matching color, so that the light spot color in the interactive area is the first preset matching color. The operator can know the current location of the light spot from the light spot color and can perform interactive operations.
[0040] Step S7: If the laser spot is in a non-interactive area, determine whether the laser color is the second preset matching color;
[0041] Step S8: If the laser color is not the second preset matching color, the display panel will wirelessly transmit the color change command to the laser emitting device. The laser emitting device will change the laser color to the second preset matching color, so that the light spot color in the interactive area is the second preset matching color. The operator can know from the light spot color that the current light spot location cannot be interactively operated.
[0042] This invention discloses an intelligent interactive display panel with laser color recognition function and its interaction method. The display panel includes a laser sensing unit, an acquisition unit, a processing unit, and a storage unit. The laser sensing unit includes a substrate, a thin-film transistor array, and a selective light-transmitting layer. By setting three selective light-transmitting layers on the thin-film transistors according to a certain pattern, the light transmitted is selected as laser light. The coordinates of the thin-film transistors with the three selective light-transmitting layers are stored in the memory. After the acquisition unit obtains the coordinates of the laser point, the processing unit is responsible for matching the coordinates of the laser point with the coordinates in the storage unit to determine the color of the external laser. This invention can recognize laser color without the need for a camera, which not only saves costs but also provides more possibilities for interaction. This invention also discloses an interaction method designed to help users complete convenient, accurate, and efficient interactions with the display area from a distance, and can be flexibly applied to large-scale scenarios, such as LCD video walls.
[0043] Compared with the prior art, the beneficial effects of the present invention are:
[0044] 1. No other equipment such as cameras is needed to identify the laser color. The display panel of this invention can automatically identify and locate the laser point color, saving costs and being unaffected by the environment.
[0045] 2. Compared to page turners on the market, the laser emitter can directly operate the display panel of this invention. Through settings, it can be used for more than just PPT, making it more convenient for users.
[0046] 3. This invention does not require a gyroscope, buttons, or other excessive features from the laser emitting device. It only needs to be able to emit three colors of laser light. Furthermore, the laser emitting device is not limited to a laser pen and can be a wearable device such as a finger sleeve.
[0047] 4. In large-scale scenarios, the interaction method of this invention uses laser dots to switch to different colors in different areas, which can help users to more intuitively perform remote and precise interaction on smaller interactive areas (such as menu bars, icons, etc.). Attached Figure Description
[0048] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments:
[0049] Appendix Figure 1 This is a schematic diagram of the display panel structure of the present invention;
[0050] Appendix Figure 2 A schematic diagram showing the display panel setup in a liquid crystal display;
[0051] Appendix Figure 3 This is a schematic diagram of the first structure of the acquisition unit for the display panel;
[0052] Appendix Figure 4 This is a schematic diagram of the second structure of the acquisition unit for the display panel;
[0053] Appendix Figure 5 This is a schematic diagram of the third structure of the acquisition unit for the display panel;
[0054] Appendix Figure 6 This is a schematic diagram of the interaction method logic flow;
[0055] Appendix Figure 7 This is a diagram illustrating the application of interactive methods in a shooting game.
[0056] In the diagram: 101 - Laser sensing unit; 102 - Acquisition unit; 103 - Processing unit; 104 - Storage unit;
[0057] 201-Backlight; 202-First polarizer; 203-Array substrate; 204-Liquid crystal layer; 205-Color filter substrate; 206-Second polarizer; 207-Adhesive; 208-Display panel; 209-Cover plate; 210-Laser emitting device;
[0058] 2081 - Thin film transistor; 2082 - First sub-selective light-transmitting layer; 2083 - Second sub-selective light-transmitting layer; 2084 - Third sub-selective light-transmitting layer; 2085 - Adhesive layer; 2086 - Substrate; 2087 - Selective light-transmitting layer; 301 - Data line; 302 - Scan line; 303 - Scan driver; 304 - Data driver. Detailed Implementation
[0059] As shown in the figure, the intelligent interactive display panel with laser color recognition function includes:
[0060] Laser sensing unit 101: The laser sensing unit includes a substrate and a sensing layer composed of a thin film transistor 2081 for sensing the color of the laser; a selective light-transmitting layer 2087 is provided on the surface of the sensing layer away from the substrate, and the spectral range of light allowed to be transmitted by the selective light-transmitting layer includes the spectral range of the laser emitted by the laser emitting device.
[0061] Acquisition unit 102: The acquisition unit is connected to the laser sensing unit 101, acquires photosensitive data and determines the coordinates of the external laser light source illuminating the display panel;
[0062] Storage unit 104: The storage unit is used to store the interactive program and the coordinate values of the thin-film transistor that senses the laser color;
[0063] Processing unit 103: The processing unit calls the interactive program stored in the storage unit; matches the acquired photosensitive coordinates with the coordinate values of the thin-film transistor to determine the laser color; and processes and calculates the specific coordinates of the external laser light source illuminating the display panel.
[0064] The selective light-transmitting layer includes an array of first sub-selective light-transmitting layers 2082, second sub-selective light-transmitting layers 2083, and third sub-selective light-transmitting layers 2084, with different sub-selective light-transmitting layers selectively transmitting different ranges of laser wavelengths.
[0065] The first sub-selective light-transmitting layer allows red laser light to pass through in the wavelength range of 635 nm to 660 nm, with a transmittance of 70% to 75%; the second sub-selective light-transmitting layer allows green laser light to pass through in the wavelength range of 532 nm to 556 nm, with a transmittance of 75% to 80%; and the third sub-selective light-transmitting layer allows blue laser light to pass through in the wavelength range of 430 nm to 480 nm, with a transmittance of 60% to 70%.
[0066] Thin-film transistors covered by a first selective light-transmitting layer are used to sense red laser light; thin-film transistors covered by a second selective light-transmitting layer are used to sense green laser light; and thin-film transistors covered by the first selective light-transmitting layer are used to sense blue laser light.
[0067] The first sub-selective light-transmitting layer, the second sub-selective light-transmitting layer, and the third sub-selective light-transmitting layer are arranged according to a preset layout. Thin film transistors for sensing red laser, thin film transistors for sensing green laser, and thin film transistors for sensing blue laser form multiple light color recognition units with an area smaller than the laser spot. The multiple light color recognition units are distributed in an array on the surface of the sensing layer away from the substrate.
[0068] The intelligent interactive display panel is used in a liquid crystal display (LCD) with a panel size ranging from 32 inches to 55 inches. The pixel pitch of the LCD panel is 0.36mm to 0.63mm. When the intelligent interactive display panel is 1 to 10m away from the laser emitting device, the laser emitting device (210) emits a laser, and the diameter of the light spot formed on the intelligent interactive display panel is approximately 1.87mm to 8.38mm, completely covering the three sub-selective light-transmitting layers. This allows the acquisition unit to obtain at least one set of vertical and horizontal coordinates of the thin-film transistors. The processing unit matches the coordinates of the thin-film transistors with the coordinate value data in the memory to determine the color of the laser emitted by the laser emitting device.
[0069] The method for setting the vertical and horizontal coordinates of all thin-film transistors is as follows: the coordinates of the thin-film transistor located at the lower left corner of the display panel are set as (1, 1). The first sub-selective light-transmitting layer, the second sub-selective light-transmitting layer, and the third sub-selective light-transmitting layer are arranged in an array according to a preset pattern on the side of the sensing layer away from the substrate. Then, based on the distribution of the three sub-selective light-transmitting layers, the coordinate values of all thin-film transistors that can sense red laser, green laser, and blue laser are obtained, and all coordinate values are stored in the memory.
[0070] The liquid crystal display includes a first polarizer 202, an array substrate 203, a liquid crystal layer 204, a color filter substrate 205, a second polarizer 206, adhesive 207, a display panel 208, and a cover plate 209.
[0071] The display panel 208 includes a thin film transistor 2081, a first sub-selective light-transmitting layer 2082, a second sub-selective light-transmitting layer 2083, a third sub-selective light-transmitting layer 2084, an adhesive layer 2085, and a substrate 2086.
[0072] The array substrate is disposed on the first polarizer; the liquid crystal layer is disposed on the array substrate; the color filter substrate is disposed on the liquid crystal layer; the second polarizer is disposed on the color filter substrate; the display panel and the second polarizer are bonded together by the adhesive; and the cover plate is disposed on the display panel.
[0073] In the display panel, thin-film transistors are arrayed on a substrate; the first sub-selective light-transmitting layer, the second sub-selective light-transmitting layer, and the third sub-selective light-transmitting layer are arrayed and covered on the surface of the sensing layer composed of multiple thin-film transistors according to a preset pattern; the first sub-selective light-transmitting layer, the second sub-selective light-transmitting layer, the third sub-selective light-transmitting layer, and the substrate are bonded to the cover plate through the bonding layer.
[0074] The acquisition unit includes: multiple parallel data lines 301, parallel scan lines 302, each perpendicular to the data lines, a scan driver 303, and a data driver 304.
[0075] The thin-film transistor is located in the region formed by the perpendicular intersection of the data line and the scan line; the gate and drain of the thin-film transistor are connected to the scan line, and the source is connected to the data line.
[0076] The scan driver and the data driver are equipped with current detection devices. The current detection devices are connected to the thin film transistors through the scan line and the data line, respectively. When the laser emitting device emits laser light, the thin film transistors absorb the laser light on their surface and perform photoelectric conversion to convert the light signal into a current signal. The current detection devices are used to detect the current changes of the thin film transistors along the scan line direction and the data line direction.
[0077] The acquisition unit of the display panel includes m rows of scan lines and n columns of data lines. The coordinates of the thin-film transistor at the intersection of the first row of the scan line and the first column of the data line in the lower left corner are set to (1,1), and the coordinates of the thin-film transistor at the intersection of the m row of the scan line and the n column of the data line are set to (m,n). The coordinates of the remaining thin-film transistors of the display panel are calculated in the same way.
[0078] When the laser emitting device emits a laser, the area of the light spot formed when the laser shines on the display panel can cover the three sub-selective light-transmitting layers. Based on the number of rows of the scan lines and the number of columns of the data lines where a group of thin-film transistors are located at the light spot position, the coordinates of this group of thin-film transistors are obtained. The average coordinates of the thin-film transistors are further obtained according to the following formula, and the distance between the average coordinates of the thin-film transistors and the coordinates of each thin-film transistor is determined.
[0079]
[0080] Where, x A The average abscissa of the thin-film transistor is represented by y. A This is represented by the average ordinate of the thin-film transistor. i The x-coordinates y are represented by the values obtained when the laser shines on the display panel. i This represents a set of ordinates obtained when a laser beam illuminates the display panel, d min This indicates the distance between the average coordinate of the thin-film transistor and the coordinates of each individual thin-film transistor.
[0081] The LCD screen is a large-size LCD screen or an LCD splicing screen; the substrate of the LCD screen is made of a transparent material; the selective light-transmitting layer is made of polycarbonate material with added visible light penetrating agent, and the selective light-transmitting layer absorbs or reflects the ambient light and backlight 201 light at the location of the thin film transistor, thereby reducing the interference of ambient light and backlight on the operation of the thin film transistor.
[0082] When the laser emitting device emits a red laser, only the thin-film transistors covered by the first sub-selective light-transmitting layer can absorb the red laser light onto their surface for photoelectric conversion, converting the optical signal into a current signal; when the laser emitting device emits a green laser, only the thin-film transistors covered by the second sub-selective light-transmitting layer can absorb the green laser light onto their surface for photoelectric conversion, converting the optical signal into a current signal; when the laser emitting device emits a blue laser, only the thin-film transistors covered by the third sub-selective light-transmitting layer can absorb the blue laser light onto their surface for photoelectric conversion, converting the optical signal into a current signal.
[0083] An interactive method for an intelligent interactive display panel with laser color recognition function, using the display panel described above, is characterized by including the following steps;
[0084] Step S1: Set the first preset matching color for the interactive area and the second preset matching color for the non-interactive area. Specifically, the interactive area and the non-interactive area are divided according to the content of the display interface. The interactive area includes menus, buttons, or icons used for interaction. The area other than the set interactive area is the non-interactive area. The first preset matching color means that only lasers of this color can perform the corresponding operation in the interactive area. The second preset matching color means that only lasers of this color can perform the corresponding operation in the non-interactive area.
[0085] Step S2: The display panel receives the laser signal from the laser emitting device, that is, the sensed laser signal is converted into an electrical signal through the thin film transistor of the sensing layer;
[0086] Step S3: Obtain the position information and color of the laser signal;
[0087] Step S4: Determine whether the laser spot is located in the interactive area or the non-interactive area;
[0088] Step S5: If the laser spot is in the interaction area, determine whether the laser color is the first preset matching color;
[0089] Step S6: If the laser color is not the first preset matching color, the display panel will wirelessly transmit the color change command to the laser emitting device, and the laser emitting device will change the laser color to the first preset matching color, so that the light spot color in the interactive area is the first preset matching color. The operator can know the current location of the light spot from the light spot color and can perform interactive operations.
[0090] Step S7: If the laser spot is in a non-interactive area, determine whether the laser color is the second preset matching color;
[0091] Step S8: If the laser color is not the second preset matching color, the display panel will wirelessly transmit the color change command to the laser emitting device. The laser emitting device will change the laser color to the second preset matching color, so that the light spot color in the interactive area is the second preset matching color. The operator can know from the light spot color that the current light spot location cannot be interactively operated.
[0092] Example 1:
[0093] In this example, the substrate 2086 is made of a transparent material, which can be an inorganic material, such as silicon wafer, quartz, or glass; or an organic material, such as polycarbonate (PC), polymethyl methacrylate (PMMA), etc.
[0094] In this example, the selective light-transmitting layer 2087 can be a polycarbonate material with added visible light transmitting agents, such as anthraquinone-type visible light transmitting agents or azo-type weakly acidic visible light transmitting agents.
[0095] When the laser emitting device 210 emits a red laser, only the thin-film transistor 2081 covered by the first sub-selective light-transmitting layer 2082 can absorb the red laser light onto its surface for photoelectric conversion, converting the light signal into a current signal. When the laser emitting device 210 emits a green laser, only the thin-film transistor 2081 covered by the second sub-selective light-transmitting layer 2083 can absorb the green laser light onto its surface for photoelectric conversion, converting the light signal into a current signal. Similarly, when the laser emitting device 210 emits a blue laser, only the thin-film transistor 2081 covered by the third sub-selective light-transmitting layer 2084 can absorb the blue laser light onto its surface for photoelectric conversion, converting the light signal into a current signal.
[0096] Furthermore, the acquisition unit 101 of the display panel 208 may include m rows of scan lines and n columns of data lines. By setting the coordinates of the thin-film transistor at the point where the first row of scan lines 201 and the first column of data lines 302 intersect perpendicularly at the lower left corner to (1,1), the coordinate values of all the thin-film transistors 2081 of the display panel 208 can be obtained. For example, the coordinates of the thin-film transistor at the point where the m-th row of scan lines 301 and the n-th column of data lines 302 intersect perpendicularly are (m,n).
[0097] By covering the side of the thin-film transistor 2081 away from the substrate with the three types of sub-selective light-transmitting layers in a certain pattern and array, please refer to the appendix for details. Figure 3The thin-film transistors 2081 located in the first column of the data lines 301 are all provided with a first sub-selective light-transmitting layer 2082 that allows red laser light to pass through; the thin-film transistors 2081 located in the second column of the data lines 301 are all provided with a second sub-selective light-transmitting layer 2083 that allows green laser light to pass through; and the thin-film transistors 2081 located in the third column of the data lines 301 are all provided with a third sub-selective light-transmitting layer 2084 that allows blue laser light to pass through. By sequentially setting the selective light-transmitting layers in this manner, all coordinate values of all thin-film transistors that can sense red laser light, green laser light, and blue laser light can be obtained and stored in the storage unit 104.
[0098] This example is used in large-scale scenarios, primarily employing LCD video walls. The size of the conference LCD video wall can range from 32 inches to 55 inches, with a resolution of 1920 (RGB) x 1080. The pixel pitch of the display panel ranges from 0.36mm to 0.63mm, specifically: 0.36mm for a 32-inch LCD screen, 0.54mm for a 47-inch LCD screen, 0.56mm for a 49-inch LCD screen, and 0.63mm for a 55-inch LCD screen. When the display panel 208 is 1m to 10m away from the laser emitting device 210, the laser spot diameter is approximately 1.87mm to 8.38mm. When the laser emitting device 210 emits a red laser, the laser can cover the three sub-selective light-transmitting layers when it irradiates the display panel 108. Based on the number of rows of the scan lines 302 and the number of columns of the data lines 301 where a group of thin film transistors 2081 are located, the coordinates of this group of thin film transistors 2081 are obtained.
[0099] Further, the coordinates of this group of thin-film transistors 2081 obtained by the acquisition unit 101 are sent to the processing unit 103. The processing unit 103 matches the coordinates of this group of thin-film transistors 2081 with the coordinate values of the thin-film transistors that sense the three laser colors in the storage unit to determine the laser color.
[0100] Example 2:
[0101] In this example, when the laser emitting device 210 emits a laser beam to the display panel, the coordinates obtained by the display panel are (94, 95), (94, 96), (97, 94), (97, 95), (97, 96), (100, 95), (100, 96). By matching the obtained coordinate values with the coordinate values of the thin-film transistors (TFTs) representing different laser colors in the storage unit 104, it can be determined that the laser is red. After calculation, the average coordinates are (97, 95.3), and the coordinates of the TFT closest to the average coordinates are (97, 95). Ultimately, the display panel can sense the laser color and detect the position of the laser point.
[0102] In this example, the thin-film transistor 2081 and the three selective light-transmitting layers can be configured in other ways. Please refer to the appendix. Figure 4 .
[0103] Appendix Figure 4 This is another structural diagram of the acquisition unit provided in an embodiment of the present invention. In this display panel, the thin-film transistor 2081 is not disposed at each vertical intersection point of the data line 301 and the scan line 302, but rather arranged in rows and columns at intervals. (See attached diagram) Figure 4 This setup can reduce the use of selective light transmission layers, further reducing costs.
[0104] Furthermore, the three selective light-transmitting layers can be configured in various ways; please refer to the appendix for details. Figure 5 Different settings for the selective light-transmitting layer can yield different coordinates of the thin-film transistor that can sense red laser, green laser, and blue laser.
[0105] Example 3:
[0106] In this example, when the laser emitting device 210 changes the laser signal, the acquisition unit 101 of the display panel can obtain the specific coordinate position of the laser point. At the same time, the processing unit 103 is connected to the acquisition unit 101 and can be used to call the coordinate values of the thin-film transistors that sense the three laser colors stored in the storage unit 104 and match them with the specific coordinate values of the laser point to determine the laser color.
[0107] In this embodiment, the position information of the laser point projected onto the display panel will vary depending on the position of the laser emitting device, the angle of the emitted laser signal, and the color of the laser signal. When the coordinates of the laser point change, it is further determined whether the laser point is within the interactive area. The interactive area can be a display area such as a menu bar or icons. The determination of whether the laser point is within the interactive area can be made by obtaining the coordinate values of the interactive area and the coordinate values of the laser point.
[0108] Example 4:
[0109] To facilitate understanding of the interaction method provided by this invention, this example provides a schematic diagram illustrating the application of the interaction method in a shooting game, as shown below. Figure 7 As shown, the interface of the shooting game consists of a non-interactive area 703 and an interactive area. The interactive area consists of a bullseye area 701 and the remaining scoring areas 702. Before the game, a first preset laser color is set to match the bullseye area 701, a second preset laser color is set to match the remaining scoring areas 702, and a third preset laser color is set to match the non-interactive area 703.
[0110] In this example, the first preset laser color of the bullseye area 701 can be set to red, the second preset color of the remaining scoring areas 702 can be set to green, and the third preset color of the non-interactive areas can be set to blue. For example, when the red laser point emitted by the laser emitter falls on the non-interactive area 703, since the laser color is different from the second matching color set for the non-interactive area 703, the display panel will wirelessly transmit a color change command to the laser emitter, and the laser color will change to blue. This interactive method can more intuitively remind the player that the laser point is located in the non-interactive area and needs to be moved to the interactive area.
[0111] The interaction method provided in this embodiment allows users to determine the matching colors of interactive and non-interactive areas based on different scenarios and display content. When the user moves a laser dot on the display panel, the laser color changes according to the laser dot's position. When the interactive area is small, such as an icon, this interaction method helps the user accurately move the laser dot towards the interactive area, improving the accuracy of long-distance interaction. This interaction method can be applied to shooting games to help players achieve better results.
[0112] Matters not covered in this invention are common knowledge.
[0113] The above embodiments are only for illustrating the technical concept and features of the present invention, and are intended to enable those skilled in the art to understand the content of the present invention and implement it accordingly. They should not be construed as limiting the scope of protection of the present invention. All equivalent changes or modifications made in accordance with the spirit and essence of the present invention should be covered within the scope of protection of the present invention.
Claims
1. A smart interactive display panel with the function of identifying laser color, characterized in that: The application relates to a laser sensing unit (101) comprising a substrate, an induction layer of thin-film transistors (2081) for sensing laser colors, and a selective light-transmitting layer (2087) provided on the surface of the substrate away from the induction layer, wherein the light spectrum range allowed to be transmitted by the selective light-transmitting layer comprises the light spectrum range of laser emission equipment. An acquisition unit (102) is connected with the laser sensing unit (101), acquires photosensitive data, and determines the coordinates of an external laser light source irradiated on a display panel. A storage unit (104) is used for storing an interaction program and the coordinate values of the thin-film transistors for sensing laser colors. A processing unit (103) calls the interaction program stored in the storage unit, matches the acquired photosensitive coordinates with the coordinate values of the thin-film transistors respectively, determines the laser colors, and processes and calculates the specific coordinates of the external laser light source irradiated on the display panel. The selective light-transmitting layer comprises array-distributed first, second and third sub-selective light-transmitting layers (2082, 2083 and 2084), and the laser wavelength ranges allowed to be transmitted by the different sub-selective light-transmitting layers are different. The thin-film transistors covered by the first selective light-transmitting layer are used for sensing red laser; the thin-film transistors covered by the second selective light-transmitting layer are used for sensing green laser; and the thin-film transistors covered by the first selective light-transmitting layer are used for sensing blue laser. The acquisition unit comprises a plurality of data lines (301) parallel to each other, a plurality of scanning lines (302) parallel to each other and perpendicular to the data lines, a scanning driver (303) and a data driver (304). The thin-film transistors are located in the region formed by the vertical intersection of the data lines and the scanning lines; the gate and the drain of the thin-film transistors are connected to the scanning lines, and the source is connected to the data lines. The scanning driver and the data driver are internally provided with current detection devices connected to the thin-film transistors through the scanning lines and the data lines; when the laser emission device emits laser, the thin-film transistors absorb the laser on the surface and perform photoelectric conversion to convert the optical signal into an electric current signal; and the current detection devices are used for detecting the current change of the thin-film transistors in the scanning line direction and the data line direction. The wavelength range of the red laser allowed to be transmitted by the first sub-selective light-transmitting layer is 635-660 nm, and the transmittance is 70-75%; the wavelength range of the green laser allowed to be transmitted by the second sub-selective light-transmitting layer is 532-556 nm, and the transmittance is 75-80%; and the wavelength range of the blue laser allowed to be transmitted by the third sub-selective light-transmitting layer is 430-480 nm, and the transmittance is 60-70%. 2.The smart interactive display panel with the function of identifying laser color according to claim 1, characterized in that: The acquisition unit comprises a plurality of data lines (301) parallel to each other, a plurality of scanning lines (302) parallel to each other and perpendicular to the data lines, a scanning driver (303) and a data driver (304). The thin film transistor is located in a region where the data line and the scan line are perpendicular to each other; the gate and the drain of the thin film transistor are connected to the scan line, and the source is connected to the data line; The scanning driver and the data driver are internally provided with current detection devices, which are connected to the thin film transistor through the scan line and the data line respectively. When the laser emitting device emits laser, the thin film transistor absorbs the laser on its surface and performs photoelectric conversion to convert the optical signal into an electric current signal. The current detection device is used to detect the current change of the thin film transistor in the scan line direction and the data line direction. 3.The smart interactive display panel with the function of identifying laser color according to claim 1, characterized in that: The first, second and third sub-selective light transmission layers are arranged according to a preset layout setting. The thin film transistors for sensing red laser, the thin film transistors for sensing green laser and the thin film transistors for sensing blue laser form a plurality of light color recognition units with an area smaller than that of a laser spot. The plurality of light color recognition units are distributed in an array manner on the surface of the sensing layer away from the substrate. 4.The smart interactive display panel with the function of identifying laser color according to claim 3, characterized in that: The smart interactive display panel is used for a liquid crystal display with a panel size ranging from 32 inches to 55 inches. The pixel pitch of the display panel of the liquid crystal display is 0.36mm0.36mm to 0.63mm0.63mm. When the smart interactive display panel is 1 to 10 m away from the laser emitting device, the laser spot diameter formed by the laser emitted by the laser emitting device (210) on the smart interactive display panel is 1.87mm to 8.38mm, which has completely covered the first, second and third sub-selective light transmission layers, so that the acquisition unit obtains at least one set of the y-coordinate and x-coordinate of the thin film transistors. The processing unit matches the coordinates of the thin film transistors with the coordinate value data in the storage unit to determine the color of the laser emitted by the laser emitting device. 5.The smart interactive display panel with the function of identifying laser color according to claim 4, characterized in that: The setting method of the y-coordinate and x-coordinate of all the thin film transistors is as follows: the coordinates of the thin film transistor arranged at the lower left corner of the display panel are (1, 1). The first, second and third sub-selective light transmission layers are arranged in an array manner on the side of the sensing layer away from the substrate according to a preset rule. The coordinates of all the thin film transistors capable of sensing red laser, the thin film transistors capable of sensing green laser and the thin film transistors capable of sensing blue laser are obtained from the three sub-selective light transmission layer distribution modes, and all the coordinate values are stored in the storage unit. 6.The smart interactive display panel with the function of identifying laser color according to claim 5, characterized in that: When the laser emitting device emits laser, the laser spot formed when the laser irradiates on the display panel can cover the three sub-selective light transmission layers. Based on the number of rows of the scan line and the number of columns of the data line of the group of thin film transistors at the laser spot position, the coordinates of the group of thin film transistors are obtained. Further, the average coordinates of the thin film transistors are obtained according to the following formula, and the distance between the average coordinates of the thin film transistors and the coordinates of each thin film transistor is determined. Formula 1; Formula 2; Formula Three; wherein, representing an average abscissa of the thin film transistors, representing an average ordinate of the thin film transistors; representing a set of abscissae acquired when a laser is irradiated on the display panel, representing a set of ordinates acquired when a laser is irradiated on the display panel, representing a distance between the average coordinates of the thin film transistors and each of the thin film transistor coordinates. 7.The smart interactive display panel with the function of identifying laser color according to claim 4, characterized in that: The liquid crystal display is a large-size liquid crystal screen or a liquid crystal spliced screen; the substrate of the liquid crystal screen is made of a transparent material; the selective light transmission layer is made of polycarbonate material added with a visible light transmission agent, and the selective light transmission layer absorbs or reflects ambient light and backlight light at positions where the thin film transistors are located, thereby reducing the working interference of the ambient light and the backlight on the thin film transistors; When the laser emitting device emits red laser light, only the thin film transistors covered by the first sub-selective light transmission layer can absorb the red laser light on the surface thereof to perform photoelectric conversion, thereby converting the light signal into an electric current signal; when the laser emitting device emits green laser light, only the thin film transistors covered by the second sub-selective light transmission layer can absorb the green laser light on the surface thereof to perform photoelectric conversion, thereby converting the light signal into an electric current signal; when the laser emitting device emits blue laser light, only the thin film transistors covered by the third sub-selective light transmission layer can absorb the blue laser light on the surface thereof to perform photoelectric conversion, thereby converting the light signal into an electric current signal.
8. An interactive method of a smart interactive display panel with the function of identifying laser color, using the display panel of claim 5, characterized in that: The method comprises the following steps: Step S1, setting a first preset matching color of an interactive region and a second preset matching color of a non-interactive region, specifically: dividing the interactive region and the non-interactive region according to the content of the display interface, wherein the interactive region comprises interactive menus, buttons or icons; the region other than the set interactive region is the non-interactive region; the first preset matching color means that only laser light of this color can perform corresponding operations in the interactive region; the second preset matching color means that only laser light of this color can perform corresponding operations in the non-interactive region; Step S2, the display panel receives the laser signal of the laser emitting device, that is, the thin film transistor of the sensing layer converts the sensed laser signal into an electric signal; Step S3, obtaining the position information and the laser color of the laser signal; Step S4, judging whether the position of the laser spot is in the interactive region or the non-interactive region; Step S5, if the laser spot is in the interactive region, judging whether the laser color is the first preset matching color; Step S6, if the laser color is not the first preset matching color, the display panel transmits a color changing instruction to the laser emitting device through wireless transmission, the laser emitting device changes the laser color to the first preset matching color, so that the spot color of the interactive region is the first preset matching color, and the operator knows the current position of the spot from the spot color to perform interactive operation; Step S7, if the laser spot is in the non-interactive region, judging whether the laser color is the second preset matching color; Step S8, if the laser color is not the second preset matching color, the display panel transmits a color changing instruction to the laser emitting device through wireless transmission, the laser emitting device changes the laser color to the second preset matching color, so that the spot color of the interactive region is the second preset matching color, and the operator knows the current position of the spot from the spot color to perform interactive operation.
Citation Information
Patent Citations
Laser pen remote interaction method
CN108279838A
Display panel capable of recognizing external light
CN111176038A