Photonic bidirectional control system for tiles

The tile photonic bidirectional operation screen with unique photoluminescent marks on tiles addresses the challenge of large display interaction by providing a simple and cost-effective solution for user interaction on displays of any size.

JP7837336B2Active Publication Date: 2026-03-30NANOGA SA
View PDF 10 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-12-18
Publication Date
2026-03-30

AI Technical Summary

Technical Problem

Existing large flat-panel displays are too large to be built on a single circuit board, and there is a need for a simple, inexpensive, bidirectional control screen that can be manufactured in any size and facilitate interaction between users and large displays.

Method used

A tile photonic bidirectional operation screen comprising a mounting surface with tiles, each having unique photoluminescent marks that encode position information, and an optical stylus or camera system to detect and interpret these marks for interaction.

Benefits of technology

Enables bidirectional operation on large displays of any size with a simple and cost-effective solution, allowing users to interact with inaccessible areas using a photoluminescent mark system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007837336000001
    Figure 0007837336000001
  • Figure 0007837336000002
    Figure 0007837336000002
  • Figure 0007837336000003
    Figure 0007837336000003
Patent Text Reader

Abstract

Provides an interactive screen. [Solution] A tile interactive screen includes a mounting surface and a plurality of tiles mounted on the mounting surface. Each tile includes a tile substrate having photoluminescent indicia arranged in a pattern on or within the tile substrate. Each photoluminescent indicia is unique with respect to all other photoluminescent indicia on any tile, each photoluminescent indicia has pattern-encoded information specifying the location of the photoluminescent indicia on the tile, and each tile substrate is at least partially transparent to light absorbed by the photoluminescent indicia and at least partially transparent to light emitted by the photoluminescent indicia. The photoluminescent indicia respond to stimulating electromagnetic radiation by emitting electromagnetic radiation. A tile photonic interactive system includes the tile photonic interactive screen and an optical stylus operable to emit stimulating radiation to one or more photoluminescent indicia and to respond to electromagnetic radiation emitted by the stimulated photoluminescent indicia.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application is related to International Publication No. WO 2019 / 087038, filed on October 29, 2018, under the title of "Device for Digital Writing Instruments". International Publication No. WO 2019 / 087038 is invented by Hefyene, and its content is incorporated herein by reference.

[0002] The present disclosure relates to a user-interactive (two-way operating) screen within a computer system, which includes a plurality of tiles and is combined with, for example, a large-format display device.

Background Art

[0003] Flat panel displays are widely used as a user's visual computer interface. In many applications, a touch screen is combined with a flat panel display to enable two-way operation between the user and the computer. Such touch screens are typically placed directly on the surface of a two-way operating flat panel display of a computer system or are a layer within it. Modern touch screens usually detect contact through changes in capacitance or resistance at a position on the touch screen. The location of the change is detected electronically and transmitted to the computer system. Two-way operating screens that rely on cameras to detect touches, two-way operating screens that use infrared cross beams, and optical touch screens that respond to light hitting a specific location on the two-way operating screen are also known.

[0004] Patent Document 1, titled "Optical Digitizer System with Position-Unique Photoluminescent Indicia" by Geaghan et al., describes a bidirectional optical "digitizer system" comprising a substrate with a position-unique photoluminescent index pattern. A stylus component receives an optical signal indicating the pattern of the indicia, from which the position of the stylus relative to the substrate is determined. However, such a system is limited in size by the size of the substrate. A tile touch system using multiple digital cameras is disclosed in Patent Document 2, and a tile touch system using an infrared emitter and receiver is exemplified in Patent Document 3. However, such systems may be complex or difficult to construct or use. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] U.S. Patent No. 9,068,845 [Patent Document 2] U.S. Patent No. 8,120,596 [Patent Document 3] U.S. Patent No. 10,255,017 [Patent Document 4] International Publication No. 2019 / 087038 [Overview of the Initiative] [Problems that the invention aims to solve]

[0006] Many large flat-panel displays are too large to be built on a single circuit board. Furthermore, there is a need for bidirectional operation between such large flat-panel displays and users. A simple, inexpensive, bidirectional control screen that can be manufactured in any size is still required. [Means for solving the problem]

[0007] In various embodiments, the present invention provides a tile photonic bidirectional operation screen comprising a mounting surface and tiles mounted on the mounting surface. Each tile comprises a tile substrate having multiple photoluminescent marks arranged in a pattern on or within the tile substrate, Each photoluminescent mark is unique in relation to all other photoluminescent marks on any given tile, and each photoluminescent mark comprises pattern code information that encodes information to uniquely identify or specify the location of the photoluminescent mark on the tile. Each tile substrate is at least partially transparent to light absorbed by the photoluminescent mark and at least partially transparent to light emitted by the photoluminescent mark.

[0008] According to some embodiments, a photoluminescent mark responds to a stimulating electromagnetic radiation that emits electromagnetic radiation. The stimulating electromagnetic radiation may be partially visible to the human visual system and may include light in the near-infrared spectrum with wavelengths in the range of 650 to 800 nm. The stimulating electromagnetic radiation may be invisible to the human visual system and may include light in the infrared spectrum with wavelengths greater than 800 nm. The stimulating electromagnetic radiation may be invisible to the human visual system and may include ultraviolet radiation. The emitted electromagnetic radiation may be infrared or near-infrared. The stimulating electromagnetic radiation may have a different frequency from the emitted electromagnetic radiation.

[0009] According to embodiments of the present disclosure, a photoluminescent mark may comprise a laminate of materials. Each laminate of materials may comprise at least one pair of consecutive layers, each pair of layers may alternately comprise a first layer of a first material having a thickness of 1 micron (micrometer) or less with a second layer of a second material having a thickness of 10 nm or less. The interface between the first and second layers of the pair of layers may comprise a quantum nanostructure, such as a photoluminescent quantum nanostructure.

[0010] According to embodiments of the present disclosure, a photonic bidirectional operating system for a tile comprises a photonic bidirectional operating screen for the tile and an optical stylus that emits a stimulating radiation to one or more photoluminescent marks and is operable to respond to electromagnetic radiation emitted by the stimulated photoluminescent marks. The optical stylus may comprise a light source that emits a stimulating radiation onto the photoluminescent marks, or the optical stylus may comprise a camera that responds to electromagnetic radiation emitted by the photoluminescent marks, or both. The digital camera may have a field of view that includes all tiles. The digital camera may have a field of view that includes fewer than all tiles.

[0011] The tiles can be placed on a display device equipped with a display control unit.

[0012] According to embodiments of this disclosure, a method for operating a photonic bidirectional operation system for tiles is: To provide a photonic bidirectional operation system for tiles, Record the tile position of each tile relative to other tiles, and at least one photoluminescent mark placed on the tile, Exposing at least one tile's photoluminescent mark to stimulating electromagnetic radiation, Recording encoded information, Determining positional information derived from the encoded information and the tile position of the corresponding tile. The system includes recording the tile position of each tile relative to other tiles using at least one photoluminescent mark, which may include recording a tile identifier that identifies the position of a tile within the array. Recording the tile position of each tile within the array with respect to a photoluminescent mark may include exposing at least one unique photoluminescent mark of each tile to stimulating radiation and recording the position of the electromagnetic radiation emitted with respect to the tile's tile position.

[0013] According to embodiments of this disclosure, a tile photonic bidirectional operating screen comprises a mounting surface and tiles mounted on the mounting surface. Each tile may comprise a tile substrate having unique photoluminescent marks arranged in an array-like manner on the tile substrate. The information encoded in the photoluminescent marks on the tile can incorporate tile identification or tile position relative to the tiles mounted on the mounting surface. The tile substrate may comprise two or more layers. The photoluminescent marks can be positioned between the tile substrate and the mounting surface, or between the two or more layers. The two or more layers can be bonded to each other or to the mounting substrate with an index-matched (same refractive index) optically transparent adhesive. According to some embodiments, the tile substrates are bonded together with a light-absorbing adhesive, for example, at the joints between adjacent tile substrates.

[0014] In some embodiments, the mounting surface is a tile mounting surface and comprises mounting tiles. One tile is mounted on each mounting tile, multiple tiles are mounted on each mounting tile, or one tile is mounted on multiple mounting tiles.

[0015] In some embodiments of this disclosure, a method for fabricating a tile photonic bidirectional control screen is described. To provide a tile substrate, Placing a photoluminescent layer with quantum nanostructures on a tile substrate, The photoluminescent layer is masked to form masked and unmasked areas, Inactivating the unmasked portion of the photoluminescent layer, Removing the mask and It is equipped with. In some embodiments, inactivating the unmasked portion of the photoluminescent layer may comprise exposing the unmasked portion to energy particles and leaving the inactivated portion of the photoluminescent layer at a predetermined position. In some embodiments, inactivating the unmasked portion of the photoluminescent layer comprises etching the unmasked portion to remove the unmasked portion and exposing the corresponding unmasked portion of the tile substrate.

[0016] Some optional methods of the present disclosure comprise planarizing the photoluminescent layer.

[0017] Embodiments of the present disclosure provide a simple, inexpensive, optically bidirectional operating screen that can be fabricated in any size.

[0018] The foregoing and other objects, aspects, features, and advantages of the present disclosure will become more apparent and better understood by referring to the following description taken in conjunction with the accompanying drawings.

Brief Description of the Drawings

[0019] [Figure 1A] FIG. 1A is an exploded perspective view and detailed view of a photonic bidirectional operating screen of a tile according to an exemplary embodiment of the present disclosure. [Figure 1B] FIG. 1B is a plan view and detailed view of a photonic bidirectional operating screen of the tile of FIG. 1A according to an exemplary embodiment of the present disclosure. [Figure 1C] FIG. 1C is a cross-sectional view of a photonic bidirectional operating screen of the tile of FIG. 1B taken along cross-sectional line A together with an optical stylus according to an exemplary embodiment of the present disclosure. [Figure 1D] FIG. 1D is an exploded perspective view of a photonic bidirectional operating screen of a tile mounted on a display device of the tile according to an exemplary embodiment of the present disclosure. [Figure 1E]Figure 1E is an exploded perspective view of a tile photonic bidirectional control screen mounted on a tile display device, according to an exemplary embodiment of the present disclosure. [Figure 1F] Figure 1F is a cross-section of a tile photonic bidirectional control screen mounted on a tile display device, according to an exemplary embodiment of the present disclosure. [Figure 1G] Figure 1G is a cross-section of a tile photonic bidirectional control screen mounted on a tile display device, according to an exemplary embodiment of the present disclosure. [Figure 1H] Figure 1H is a cross-section of a tile photonic bidirectional control screen mounted on a tile display device, according to an exemplary embodiment of the present disclosure. [Figure 2A] Figure 2A is a schematic cross-sectional view of an optical stylus useful in an exemplary embodiment of the present disclosure. [Figure 2B] Figure 2B is a schematic cross-sectional view of an optical camera useful in an exemplary embodiment of the present disclosure. [Figure 2C] Figure 2C is a schematic cross-sectional view of an optical stylus incorporating a useful light source and camera in an exemplary embodiment of the present disclosure. [Figure 3A] Figure 3A is a perspective view of a tiled photonic bidirectional control screen mounted on a display device and camera according to an exemplary embodiment of the present disclosure. [Figure 3B] Figure 3B is a perspective view of a tile display device and a photonic bidirectional control screen for tiles mounted on a camera, according to an exemplary embodiment of the present disclosure. [Figure 3C] Figure 3C is a perspective view of a tile display device and a photonic bidirectional control screen for tiles mounted on a camera, according to an exemplary embodiment of the present disclosure. [Figure 3D] Figure 3D is a perspective view of a tile display device and a photonic bidirectional control screen for tiles mounted on a camera, according to an exemplary embodiment of the present disclosure. [Figure 4] Figure 4 is a flowchart illustrating a method for calibrating a tiled photonic bidirectional operating screen according to an exemplary embodiment of the present disclosure. [Figure 5] Figure 5 is a flowchart illustrating a method for calibrating a tile photonic bidirectional operation screen according to an exemplary embodiment of the present disclosure. [Figure 6] Figure 6 is a flowchart illustrating a method for decoding a tiled photonic bidirectional operation screen according to an exemplary embodiment of the present disclosure. [Figure 7A] Figure 7A is an exploded perspective view of a multi-layered tile substrate according to an exemplary embodiment of the present disclosure. [Figure 7B] Figure 7B is an exploded perspective view of a multi-layered tile substrate according to an exemplary embodiment of the present disclosure. [Figure 7C] Figure 7C is an exploded perspective view of a multi-layered tile substrate according to an exemplary embodiment of the present disclosure. [Figure 8A] Figure 8A is an exploded perspective view of tile substrates bonded with a light-absorbing adhesive, paint, or film coating and a light-transmitting adhesive, paint, or film coating according to exemplary embodiments of the present disclosure. [Figure 8B] Figure 8B shows a cross-section of a tile substrate bonded with a light-absorbing adhesive, paint, or film coating and a light-transmitting adhesive, paint, or film coating according to an exemplary embodiment of the present disclosure. [Figure 9A] Figure 9A is a flowchart illustrating a construction method according to an exemplary embodiment of the present disclosure. [Figure 9B] Figure 9B is a flowchart illustrating a construction method according to an exemplary embodiment of the present disclosure. [Figure 10A] Figure 10A shows a sequential structure formed according to the exemplary method of this disclosure. [Figure 10B] Figure 10B shows a sequential structure formed according to the exemplary method of this disclosure. [Figure 10C] Figure 10C shows a sequential structure formed according to the exemplary method of this disclosure. [Figure 10D] Figure 10D shows a sequential structure formed according to the exemplary method of this disclosure. [Figure 11A] Figure 11A shows a sequential structure formed according to the exemplary method of this disclosure. [Figure 11B]Figure 11B shows a sequential structure formed according to the exemplary method of this disclosure. [Figure 12A] Figure 12A shows a sequential structure formed according to the exemplary method of this disclosure. [Figure 12B] Figure 12B shows a sequential structure formed according to the exemplary method of this disclosure. [Figure 12C] Figure 12C shows a sequential structure formed according to the exemplary method of this disclosure. [Figure 12D] Figure 12D shows a sequential structure formed according to the exemplary method of this disclosure. [Modes for carrying out the invention]

[0020] The features and advantages of this disclosure will become more apparent from the detailed description below when taken in conjunction with the drawings, and similar reference letters throughout identify corresponding elements. In the drawings, generally, similar reference numbers indicate at least one of the following: identical elements, functionally similar elements, or structurally similar elements. The drawings are not drawn to scale because the size variation of the various elements in the drawings is too large to be scaled.

[0021] Embodiments of the present disclosure provide, in particular, a simple, inexpensive, and interactive screen that can be manufactured in any size. The interactive screen can be mounted on a display or the surface of a display device under the control of a computer to provide a user interface to the computer, and the user can interact with the computer bidirectionally through the interactive screen.

[0022] According to some embodiments of the present disclosure, as illustrated in Figures 1A to 1C, a tile photonic bidirectional operating screen 10 is mounted on a mounting surface 20 and a tile 30 (e.g., screen tile 30) mounted on the mounting surface 20. Each tile 30 comprises a tile substrate 32 having photoluminescent marks 50 arranged in a pattern on or within the tile substrate 32. Each photoluminescent mark 50 is unique to all other photoluminescent marks 50 on any of the tiles 30. Each photoluminescent mark 50 comprises a pattern of individual marks 55 that encode information to uniquely identify or specify the location of the photoluminescent mark 50 on the tile 30. Each tile substrate 32 is at least partially transparent to stimulating light 70 (stimulating electromagnetic radiation) absorbed by the photoluminescent marks 50 and at least partially transparent to emitted light 80 (emitted electromagnetic radiation) emitted by the photoluminescent marks 50. The mounting surface 20 allows the surface of the display device 22 to be controlled by the display control unit 24, with or without a mechanical frame. As shown in Figure 1C, the optical stylus 60 emits a stimulating light 70 and can receive emitted light 80 from the tile's photonic bidirectional operation screen 10.

[0023] Figures 1A to 1C and 3A show embodiments in which multiple tiles 30 are arranged on a display device 22. As shown in Figures 1D to 1H and 3B to 3D, the display device 22 may be a tile display device 22 (e.g., a display device frame 26) arranged in or on a machine frame 26, and may comprise display tiles 23 having a tile mounting surface 21 on which the tiles 30 are mounted. In some embodiments, and in the perspective view of Figure 1D, the cross-sectional view of Figure 1F, and the perspective view of Figure 3B, an individual tile 30 is placed on the tile mounting surface 21 (e.g., a cover glass) of each display tile 23. In some embodiments, and in the perspective view of Figure 1E, the cross-sectional view of Figure 1G, and the perspective view of Figure 3D, each tile 30 is placed on the tile mounting surface 21 of multiple display tiles 23. Figure 1E shows only one tile 30 of a tile photonic bidirectional operation screen 10. Figures 1G and 3D show multiple tiles 30. In some embodiments, the cross-sectional view is shown in Figure 1H and the perspective view of Figure 1. In Figure 3C, multiple tiles 30 are placed on the tile-mounting surface 21 of each display tile 23, so that the display device 22 has multiple display tiles 23, and multiple tiles 30 are placed on each display tile 23. The display device 22 may be, but is not limited to, a liquid crystal display device 22, an organic light-emitting diode display device 22, or an inorganic light-emitting diode display device 22. The display device 22 may be a large display device 22, for example, a display device 22 with a diagonal of 3 meters, 5 meters, 10 meters, 15 meters, 20 meters, or 50 meters or more.

[0024] The mounting surface 20 may be any suitable surface on which the tile 30 can be placed (e.g., the display device 22 or the cover glass of the display device). The mounting surface 20 may be substantially or effectively transparent to visible light and may be substantially planar, for example, within the limits of manufacturing. The mounting surface 20 may be, for example, the surface of a glass or polymer substrate. The tile 30 may comprise any suitable tile substrate 32 that can be placed on the mounting surface 20 and on which the photoluminescent mark 50 can be placed or on which it can be placed. For example, each tile 30 may comprise a glass or polymer tile substrate 32 and may be substantially or effectively transparent to visible display light, for example, light emitted by the display device 22. The tiles 30 may, but not necessarily, be arranged on the mounting surface 20 in regular rectangular arrangements 40.

[0025] According to embodiments of the present disclosure, each photoluminescent mark 50 may comprise an array of individual marks 55 (e.g., indicators or dots) arranged on or within the tile substrate 32. Each individual mark 55 of the photoluminescent mark 50 on the tile 30 can collectively encode (e.g., uniquely identify or specify) the location of the photoluminescent mark 50 on the tile 30 and within the photonic bidirectional operation screen 10 of the tile. Each individual mark 55 may, for example, be an arrangement of 2D barcodes or dots in a pattern that encodes or identifies the location of the corresponding photoluminescent mark 50. The pattern of the individual marks 55 may comprise a series of N (points) distributed in a two-dimensional array on or within the surface of the tile substrate 32. The N points can define an active region of the photoluminescent mark 50, and an inactive region can be defined by the region between the N points. In some embodiments, the N points can define an inactive region, and the active region can be defined by the area between the N points. The distribution of N points within the pattern can be encoded with the positional information of the pattern (photoluminescent marks 50) to determine a unique value representing identification or position, depending on the radiation emitted by the photoluminescent material (either from the N points or in the space between the N points).

[0026] For example, the 4x4 array portion of individual marks 55 within the photoluminescent mark 50 can encode one of 2 to the power of 16 (equal to 65,536) binary marks or 256 locations in each dimension of the two-dimensional display device 22 on which the tiled photonic bidirectional operation screen 10 is mounted.

[0027] Each photoluminescent mark 50 is arranged on a tile substrate 32 and comprises a plurality of individual marks 55 arranged in a pattern, for example, an array, that encodes the position or identification of the photoluminescent mark 50 on the tile substrate 32. Each individual mark 55 of the photoluminescent mark 50 can absorb light and emit light accordingly. As used herein, light refers to all frequencies of electromagnetic radiation that are visible to the human visual system, absorbed by the individual marks 55, or emitted by the individual marks 55. Visible light is electromagnetic radiation that is visible to the human visual system. Thus, the photoluminescent mark 50 can emit electromagnetic radiation (emitted light 80) in response to a stimulus of electromagnetic radiation (stimulating light 70). In embodiments of this disclosure, the stimulating light 70 includes light in the near-infrared spectrum having wavelengths in the range of 650 to 800 nm, which is partially visible to the human visual system. In some embodiments, the stimulating light 70 includes light in the infrared spectrum having wavelengths greater than 800 nm, which is not visible to the human visual system. In some embodiments, the stimulating light 70 is invisible to the human visual system and includes ultraviolet light. Ultraviolet light can be electromagnetic waves with a wavelength of less than 400 nm. In some embodiments, the emitted light 80 is infrared, near-infrared, ultraviolet, or visible light. The stimulating light 70 may have a different frequency from the emitted light 80.

[0028] The photoluminescent mark 50 and individual marks 55 may comprise a laminate of materials arranged on the tile substrate 32. Each laminate of materials may comprise one or more consecutive pairs of layers, each pair comprising alternating first layers of a first material having a thickness of 1 micron or less and a second layer of a second material having a thickness of 10 nm or less, where the interface between the first and second layers of the pair comprises a quantum nanostructure. The quantum nanostructure may be photoluminescent and capable of absorbing light (e.g., stimulation light 70) and emitting light in response (e.g., emitted light 80). The laminate may comprise at least one layer of a metal nitride and an oxide that generate a photoluminescent quantum nanostructure at the layer interface. In some embodiments, at least one of the first and second layers contains an alloy, such as a metal oxide alloy or a nitride oxide alloy. The metal oxide / nitride alloy exhibits a different bandgap energy level than the metal oxide / nitride layer. When at least one of the first and second layers is replaced with an alloy, it forms a different laminate with a quantum structure that exhibits modified photoluminescent properties, for example, showing a different range of luminescence. In one embodiment, the metal oxide is selected from SiOx, ZnO, or an alloy of metal oxides. In one embodiment, the metal nitride is selected from AIN, GaN, InN, or an alloy of metal nitrides.

[0029] In some embodiments, the laminate further comprises at least one third layer between a first layer and a second layer, or between two first layers, or between two second layers, for example, between one third layer, or between two third layers, or between three third layers. The additional layer, for example, the third layer, can alter the quantum structure present at the interface, and therefore the photoluminescent properties, such as the emission range. The third layer can form an alloy with the first or second layer. In some embodiments, the additional layer preferably contains a metal sulfide selected from ZnS, CdS, or an alloy of metal sulfides. In some embodiments, the additional layer contains cadmium telluride or cadmium selenide, preferably selected from an alloy of cadmium telluride and cadmium selenide. In some embodiments, the additional layer preferably contains metallic arsenic selected from an alloy of AlAs, GaAs, or metallic arsenic.

[0030] Upon receiving the stimulating light 70, the laminate emits visible light, infrared light, or ultraviolet light (e.g., electromagnetic radiation) at a determined wavelength (e.g., emitted light 80). The wavelength of the emitted light 80 depends on the composition of at least one of the metal nitride and oxide layers and the thickness of the laminate. In some embodiments, the photoluminescent laminate is treated to provide a non-photoluminescent portion of the laminate. This facilitates the fabrication of patterns for individual marks 55. Thus, the laminate may be uniformly fabricated on the tile substrate 32, and then the individual marks 55 may be patterned to distinguish between working and non-working regions within the pattern. For example, the treatment can alter (e.g., deactivate) the quantum structure present within the laminate, significantly weakening its photoluminescent properties so that the light-receiving unit 64 (e.g., camera 64) can easily distinguish between photoluminescent and deactivated non-photoluminescent materials. In embodiments of this disclosure, at least one of the composition and thickness of the first and second layers is adjustable according to at least one of the excitation wavelength (stimulation light 70) and the emission wavelength (emitted light 80). In some embodiments, the excitation wavelength of the laminate is between about 360 nm and 375 nm, preferably between 360 nm and 370 nm, and particularly between 365 nm. In some embodiments, the emission wavelength of the laminate is between about 600 nm and 850 nm, preferably between 650 nm and 700 nm, and particularly between 670 ± 20 nm.

[0031] In some embodiments, each of the N points (individual marks 55) has dimensions between 2 μm and 400 μm, preferably between 20 μm and 200 μm, and particularly between 50 μm. The smaller the dimensions of the points (individual marks 55), the denser the distribution of N points in the pattern, and the higher the resolution of the tiled photonic bidirectional operating screen 10. For example, for small devices (typically smartphones and tablets) with sizes from 5 to 12 inches, point dimensions in the range of 5 to 15 μm are recommended to ensure good resolution. For larger devices (typically laptops and desktop computers) with sizes from 15 to 30 inches, point dimensions in the range of 15 to 30 μm provide adequate resolution. For much larger devices (typically televisions and digital whiteboards) with sizes exceeding 40 inches, point dimensions in the range of 50 to 200 μm are useful. Patent document 4, referenced above, describes a suitable layer structure that can be used to construct the individual marks 55, the contents of which are incorporated herein by reference. The laminated portions of the material may be substantially transparent, for example, 50%, 60%, 70%, or 80% or more transparent to light or visible light.

[0032] In some embodiments of this disclosure, as shown in Figure 1C, the tile photonic bidirectional operation system 15 comprises a tile photonic bidirectional operation screen 10 and an optical stylus 60 that emits a stimulating light 70 onto a photoluminescent mark 50 and is operable to respond to emitted light 80 emitted by the photoluminescent mark 50. As shown in Figures 2A and 2C, the optical stylus 60 may be a handheld battery-powered electro-optical device comprising a light source 62 that emits a stimulating light 70 (electromagnetic radiation) onto at least one of the photoluminescent marks 50, causing the stimulated photoluminescent mark 50 to emit emitted light 80. The light source 62 may be, for example, a laser or an LED (e.g., an infrared or UV light source 62). In some embodiments, the optical stylus 60 includes a synchrotron radiation receiver 64, which is a camera 64, such as a digital camera 64, and responds to emitted light 80 emitted by a photoluminescent mark 50 (e.g., individual marks 55 of the photoluminescent mark 50). Thus, the camera 64 may be an infrared camera 64 or an ultraviolet camera 64. The optical stylus 60 may include optical elements 66, such as a mirror, a partial reflection mirror, and a lens that appropriately focuses, disperses, directs, or otherwise manipulates the stimulated light 70 emitted from a light source 62 or the emitted light 80 received from the photoluminescent mark 50. The optical stylus 60 may include one or more control switches 68 (e.g., rotary switches, slide switches, or push-button switches) that control the operation of the optical stylus 60, and a communication circuit 69 that communicates with a system control unit (e.g., a display control unit 24 shown in Figure 1A) that controls the display device 22 in response to the optical stylus 60, or processes images received from the camera 64 and decodes patterns in the images. The communication circuit 69 may be one or more integrated circuits and may include a processor, memory, network and wireless circuit, e.g., a computer, random access memory and a Bluetooth® or WiFi device. A Bluetooth device is preferred in some embodiments where a computer network is not required or available.The camera 64 can be separated from the optical stylus 60 (as shown in Figure 2B) or integrated into the optical stylus 60, for example, in the body or torso of the optical stylus 60 (as shown in Figure 2C). The camera 64 may be a digital camera 64 having a CCD sensor or a CMOS sensor and one or more optical filters that respond to light of a desired wavelength. In some embodiments, a CMOS sensor may be preferred.

[0033] In some embodiments, the camera 64 may have a field of view that includes all of the tiles 30, as shown in Figure 3B, for example. In some embodiments, the camera 64 may have a field of view that includes fewer than all of the tiles 30, as shown in Figure 3A, for example. For example, the camera 64 may have a field of view with a diameter of approximately 3 mm and be able to receive emitted light 80 from a 2x2 array of photoluminescent marks 50. In some embodiments, the camera 64 may have a field of view that can receive emitted light 80 from, for example (but not limited to), 2x3 or 3x3 array portions of the photoluminescent marks 50.

[0034] The tile photonic bidirectional operation screen 10 can be configured by providing a tile substrate 32 having photoluminescent marks 50 placed on each tile 30. Here, each photoluminescent mark 50 is unique and associated with the position of the photoluminescent mark 50 on the corresponding tile 30 on which it is located. One or more photoluminescent marks 50 on each tile 30 can be recorded, for example, in memory. For example, each tile 30 may have an associated identification (ID), such as a serial number or number, that is associated with the photoluminescent marks 50 on that tile 30 and represents the position of the tile 30 in the array section 40 of the tile 30, which is encoded. Thus, in some embodiments, recording the tile position of each tile 30 in the array section 40 of the tile 30 with respect to the photoluminescent marks 50 may include recording a tile identifier that identifies the position of the tile 30 in the array section 40. In some embodiments of the present disclosure, when the tiles 30 are assembled, the position of each tile 30 in the arrangement section 40 of the tiles 30, along with its ID (or a record of its unique photoluminescent mark 50), can be stored in a memory, such as the display control unit 24 or the communication circuit 69. Thus, in some embodiments, the photoluminescent mark 50 encodes the position of the photoluminescent mark 50. In some embodiments, the photoluminescent mark 50 encodes a unique identifier associated with the position of the photoluminescent mark 50 (for example, in a lookup table recorded in memory).

[0035] The tile photonic bidirectional operation screen 10 and the tile photonic bidirectional operation system 15 provide a method for a user of a computer system to interact with a large display device 22, for example, a large display device 22 that has an area that is too large or too far away for the user to touch in all places. The optical stylus 60 enables the user to interact with the display device 22 that is inaccessible to the user's finger and to point to any part of the display device 22 with a ray of light. The ray stimulates a photoluminescent mark 50, which emits a pattern of emitted light 80 corresponding to the pattern of individual marks 55 in the photoluminescent mark 50. The pattern of emitted light 80 is received by a camera 64 and communicates to a display control unit 24 an image of the photoluminescent mark 50 stored in memory, for example, in a communication circuit 69, and a pattern that has been detected and decoded to indicate the position of the photoluminescent mark 50. Next, the display control unit 24 associates the decoded photoluminescent mark 50 with the recorded association with the corresponding tile 30, determines the position of the corresponding tile 30 in the tile arrangement section 40, combines the position of the photoluminescent mark 50 with the position of the corresponding tile 30, and calculates the position of the photoluminescent mark 50 in the tile arrangement section 40. Next, the display control unit 24 either performs an appropriate action according to the position of the photoluminescent mark 50 or communicates the position information to the computer.

[0036] In the methods of the present disclosure, as illustrated in Figure 4, a method for constructing and operating a tile photonic bidirectional operation system 15 may include providing the tile photonic bidirectional operation system 15 in step 100, recording the tile position of each tile 30 relative to other tiles 30 in step 110, and recording at least one photoluminescent mark 50 placed on the tile 30 in step 140. Recording at least one photoluminescent mark 50 placed on the tile 30 is possible when the tile 30 is constructed. The tile 30 can be marked with a serial number, the serial number can be encoded in the photoluminescent mark 50 placed on the corresponding tile 30. The tile 30 is assembled in step 120. The position record of the tile 30 can be produced after the tile 30 is assembled (for example, by reversing the order of steps 120 and 140 in Figure 4), or the record can be produced after the tile 30 is assembled and before the tile 30 is assembled according to the record (as shown in Figure 4). In some embodiments, each unique photoluminescent mark 50 directly encodes unique information (e.g., serial number) of the tile 30. In some embodiments, the photoluminescent mark 50 directly encodes the position of the tile 30 within the array 40 of tiles 30 so that the tiles 30 are assembled according to the encoded information. Each serial number can be unique within the array 40 of tiles 30 to avoid conflicting information. However, if the tiles 30 are placed on a photonic interaction screen 10 of multiple different tiles, the tiles 30 may have a common serial number.

[0037] Once the tile photonic bidirectional operation screen 10 is constructed (for example, in steps 100 to 120), the screen can be put into use. In step 130, a photoluminescent mark 50 on at least one tile 30 is exposed to stimulating electromagnetic radiation, and encoded information from the photoluminescent mark 50 is received in step 150, for example, by a camera 64. The encoded information is then decoded in step 155, for example, by a communication circuit 69, and transmitted to, for example, a display control unit 24. In step 160, the decoded information is compared with the record of the photoluminescent mark 50 and the tile 30, and in step 170, the position of the photoluminescent mark 50 on the tile 30, the identification information of the tile 30 on which the encoded information is placed, and the position of the identified tile 30 in the tile arrangement section 40 are determined and set as the position of the photoluminescent mark 50 in the tile arrangement section 40. One or more of these steps can be performed with the optical stylus 60 and transmitted to the display control unit 24, or information can be transmitted to the display control unit 24, and one or more of the steps can be performed by the display control unit 24. The process of operating the tile photonic bidirectional operation system 15 can then be repeated by the user as desired.

[0038] As shown in Figure 5, and in some embodiments of the present disclosure, when the tiles 30 are assembled into the array 40, no record of the position of each tile 30 is created. Instead, after the tile photonic bidirectional operation screen 10 and the tile photonic bidirectional operation system 15 are assembled and before they are used, the photoluminescent marks 50 on each tile 30 are stimulated, and the response is recorded (e.g., by a camera 64) along with the position of the stimulated photoluminescent marks 50 in the tile array 40 (for example, by creating an image of the entire tile array 40 and performing image processing to determine the position of the stimulated photoluminescent marks 50 in the tile array 40). This record can then be used to determine the position of the stimulated photoluminescent marks 50 in the tile array 40, even if the optical stylus 60 records only the pattern of individual marks 55 in one or a few adjacent photoluminescent marks 50.

[0039] As shown in Figure 5, the tile photonic bidirectional operation screen 10 is constructed by building the tiles 30 in step 100, and then assembling the tiles 30 into an array section 40 on the mounting surface 20 by attaching the tiles 30 to the surface of the display device 22, for example in step 120. In step 131, the photoluminescent mark 50 in each tile 30 is stimulated by a stimulating light 70, in step 140 the photoluminescent mark 50 is recorded in association with the tile 30, in step 180 the position of the tile 30 in the array section 40 is recorded, and in step 110 the tile ID is recorded. Steps 140, 180, and 110 can be performed simultaneously, sequentially, or in any desired order. For example, Figure 3A shows a camera 64 that records the photoluminescent mark 50 on each tile 30 after stimulating the photoluminescent mark 50. Figure 3B shows each tile 30 placed on the tile 23 of an individual display device of a tile display device 22 mounted on a mechanical frame 26. Figure 3C shows multiple tiles 30 placed on the tile 23 of each display device of a tile display device 22 mounted on a mechanical frame 26. Figure 3D shows each tile 30 placed on the tile 23 of multiple display devices of a tile display device 22 mounted on a mechanical frame 26. In any of these embodiments, stimulation can be performed sequentially, for example, by tracing a narrow-ray optical stylus 60 in any desired order across the arrangement 40 of tiles 30, and the decision made in step 190 determines whether to continue stimulating the tiles 30 after each tile 30 has been stimulated. According to some embodiments, all tiles 30 can be stimulated simultaneously with a broad-ray stimulation light 70 that stimulates (excites) all tiles 30 in a single exposure (e.g., a flash). In such cases, the camera 64 must have sufficient resolution to simultaneously record the light emitted 80 from all photoluminescent marks 50 on all tiles 30. Tile identification, tile position, and photoluminescent mark 50 information are associated with the calibration process. A different camera 64 from the camera 64 in the optical stylus 60 can be used for calibration.

[0040] After recording of the tile positions and associated photoluminescent marks 50 for all tiles 30 in the tile arrangement section 40 is complete, the tile's photonic bidirectional operation screen 10 is performed. In step 130, the photoluminescent mark 50 can be activated in the tile's photonic bidirectional operation system 15 by stimulating it with, for example, a light source 62 in an optical stylus 60. In step 150, the stimulated photoluminescent mark 50 is received, for example, by an optical stylus 60 using a camera 64. In step 155, for example, the photoluminescent mark 50 received by the optical stylus 60 or the display control unit 24 in the communication circuit 69 is decoded for providing location information. In step 160, for example, the optical stylus 60 or the communication circuit 69 in the display control unit 24 is used to compare the position information of the photoluminescent mark 50 with the record in the tile 30. In step 170, the position of the photoluminescent mark 50 is determined using, for example, an optical stylus 60 or a communication circuit 69 in the display control unit 24. The location information can then be provided to the display control unit 24 if the location information is not yet present in the display control unit 24 and is acted upon by any user-interactive system, of which the display device 22 and the tile photonic bidirectional operation system 15 are part.

[0041] In some embodiments of the present disclosure, the photoluminescent mark 50 encodes the position of the corresponding tile 30 in the array 40 of tiles 30 on which the photoluminescent mark 50 is located, and the position of the photoluminescent mark 50 within the corresponding tile 30. In such embodiments, as illustrated in Figure 6, a reference to a record (e.g., step 160) is not required, and therefore the decoded photoluminescent mark 50 is all that is needed to determine the position of the photoluminescent mark 50. Therefore, no recording is required where the tile's photonic bidirectional operation screen 10 is constructed with such photoluminescent marks 50. Thus, during scanning, the photoluminescent marks 50 are stimulated in step 130, received in step 150, decoded in step 155, and their position is determined in step 170. The position information may then be acted upon by the display device 22 and the user bidirectional operation system, which are part of the tile's photonic bidirectional operation system 15, if the position information is not yet present in the display control unit 24.

[0042] According to some embodiments of the present disclosure, the tile substrate 32 may have a thickness of 0.1 mm to 3 mm, for example substantially 0.05 mm, 0.1 mm, 0.2 mm, 0.5 mm, 0.7 mm, or 1 mm, and may contain borosilicate glass or boroaluminosilicate glass. In some embodiments, the tile substrate 32 contains a polymer and is flexible. In some embodiments, as illustrated in Figure 7A, the tile substrate 32 may contain layers of two relatively thin tile substrate layers 32A, 32B bonded together, for example, glass or plastic. The tile substrate layers 32A, 32B may be substantially transparent to light. In some embodiments, the tile substrate 32 comprises two glass sheets (e.g., tile-substrate layers 32A, 32B), each glass sheet having a thickness of less than 0.7 mm (e.g., 0.5 mm) bonded together. In some embodiments, the tile substrate 32 includes two polymer or plastic sheets (e.g., tile substrate layers 32A, 32B) bonded together. The plastic sheet may be thinner than the glass sheet, for example, with a thickness of 20 microns (micrometers), 50 microns, or 100 microns. In some embodiments, as illustrated in Figure 7B, a tile substrate 32 comprising a plastic sheet (tile substrate layer 32A) is bonded onto a glass sheet (tile substrate layer 32B). The plastic sheet may be thinner than the glass sheet.

[0043] A tile substrate 32 comprising multiple layers may be stronger and more resistant to damage from mechanical impacts due to improper handling, for example. A polymer tile substrate 32 may be flexible and highly resistant to shattering upon impact. A tile substrate 32 consisting of a first polymer layer and a second glass layer can combine strength and rigidity with safety. If the glass layer falls and shatters, the plastic layer can hold the glass in place within the tile substrate 32. In some embodiments, as shown in Figure 7C, the tile substrate 32 includes glass tile substrate layers 32B sandwiched between plastic tile substrate layers 32A and 32C on both sides (above and below) of the glass tile substrate layer 32B to protect the user in the event that the glass tile substrate layer 32B shatters.

[0044] In embodiments of this disclosure, the photoluminescent mark 50 may be placed on one surface of the tile substrate layers 32A, 32B facing the other of the tile substrate layers 32A, 32B (for example, on the inner surface of any of the tile substrate layers 32A, 32B, or 32C) so that the photoluminescent mark 50 is not exposed to environmental hazards or user hazards. As shown in Figures 1C, 1F to 1H, the photoluminescent mark 50 and individual marks 55 can be placed on the surface of the tile substrate 32 adjacent to the mounting surface 20 (for example, on the surface of the display device 22), thereby protecting the photoluminescent mark 50 and individual marks 55 from handling or other environmental hazards.

[0045] In embodiments of this disclosure, as shown in Figure 7C, the tile substrate layers 32A, 32B, 32C are bonded to the surface of the tile substrate layers 32A, 32B, 32C or the mounting surface 20 by an adhesive 34 coated in a layer on the surface of the tile substrate layers 32A, 32B, 32C or the mounting surface 20, for example, an optically transparent adhesive 34. In some embodiments, the adhesive 34 has an optical index that matches the tile substrate 32 or the tile substrate layers 32A, 32B, 32C or the mounting surface 20 (for example, the cover glass of the display device 22). By using an index-matched (same refractive index) adhesive 34, the reflection or refraction of light in the tile photonic bidirectional operation screen 10 is reduced or eliminated between the tile substrates 32 where they are joined together, between the tile substrate layers 32A, 32B, or 32C, or where the tile substrates 32 are attached to the mounting surface 20.

[0046] In some embodiments of this disclosure, the tile substrate 32 is coated, for example, on the opposite side of the tile substrate 32 furthest from the mounting surface 20, with an anti-reflective coating portion 36 or an anti-glare coating portion 36 to reduce light reflection from the tile 30. Reducing light reflection from the tile's photonic bidirectional operation screen 10 improves the contrast of the photoluminescent markings 50 and the display device 22 arranged in conjunction with the tile's photonic bidirectional operation screen 10, thereby improving the appearance of the tile's photonic bidirectional operation screen 10 and the display device 22, making the photoluminescent markings 50 and display pixels more visible or easier to detect by the camera 64. In some embodiments, since such a coating portion 36 is provided on the tile 30, it is not necessary to coat the mounting surface 20 with an anti-reflective coating portion 36 or an anti-glare coating portion 36 (as is commonly done on the display device 22 cover glass). If the tile substrate 32 comprises multiple layers (for example, multiple tile substrate layers 32A, 32B), in some embodiments, the layer furthest from the mounting surface 20 (for example, tile substrate layer 32A) may be coated with an anti-reflective coating portion 36 or an anti-glare coating portion 36, and photoluminescent markings 50 can be incorporated into different layers (for example, tile substrate layer 32B). By providing different tile substrate layers 32A, 32B with different functions and structures produced by different processing steps, the processing of each tile substrate layer 32A, 32B is simplified, and manufacturing costs are reduced.

[0047] In some embodiments of the present disclosure, optical or physical structures are provided between the tile substrates 32 (e.g., at the joints or edges between the tiles 30) to control light that may diffract, refract, or reflect from the surface of the tile substrates 32 or from the gaps between the tile substrates 32.

[0048] According to some embodiments (as shown in Figure 7C), a black matrix 38 is applied to the surface of a tile substrate 32 to absorb ambient light incident on the tile 30, improving the contrast of the tile's photonic bidirectional operation screen 10, thereby improving the appearance of the tile's photonic bidirectional operation screen 10 and display device 22, making the photoluminescent marks 50 and display pixels more visible or easier to detect by the camera 64. The black matrix 38 can be patterned to create openings around individual marks 55 or photoluminescent marks 50 so that the individual marks 55 or photoluminescent marks 50 are not obscured by the black matrix 38 when exposed to or emitting light (e.g., stimulation light 70 or emitted light 80).

[0049] In some embodiments, the black matrix 38 may be patterned to create openings around the pixels of the display device 22 so that the light emitted from the pixels of the display device 22 is not obscured by the black matrix 38 when displaying an image. In some embodiments, if the black matrix 38 is provided on the tile's photonic bidirectional operation screen 10, it is not necessary to provide the black matrix 38 on the display device 22 (as is commonly done with the display device 22 cover glass). If the tile substrate 32 includes multiple layers (e.g., tile substrate layers 32A, 32B, 32C), in some embodiments, the layer furthest from the mounting surface 20 (e.g., tile substrate layer 32A) can be covered with the black matrix 38, and a different layer (e.g., tile substrate layer 32B) can incorporate a photoluminescent mark 50. By providing different tile substrate layers 32A, 32B with different functions and structures produced by different processing steps, the processing of each tile substrate layer 32A, 32B is simplified, and manufacturing costs are reduced. In some embodiments, as shown in Figures 8A and 8B, a light-absorbing adhesive 34B is placed between the tiles 30 (e.g., between tile substrates 32) to absorb incident ambient light, particularly when the tiles 30 are relatively thin compared to the pixel pitch of the display device 22 or the pitch of the photoluminescent mark 50, in order to avoid parallax display problems and improve user contrast. The tile substrate layers 32A, 32B, and 32C can be bonded to each other using a light-transmitting adhesive 34T. The light-transmitting adhesive 34T can also be used in Figures 7A to 7C where adhesive 34 is referenced.

[0050] In embodiments of the present disclosure, a method for constructing a tile photonic bidirectional operation screen 10 is as described above, comprising providing a tile substrate 32 (e.g., a glass tile) in step 200 as shown in Figure 10A, and forming a photoluminescent layer 52 in step 210 as shown in Figure 10B, as illustrated by the flowcharts in Figures 9A and 9B and the sequential structures in Figures 10A to 10D, 11A to 11B, and 12A to 12D. In step 220, the photoluminescent layer 52 is formed by, for example, coating the photoluminescent layer 52 with a photoresist layer, exposing the photoresist layer through an optical mask using a photolithography method and materials, and etching the exposed photoresist layer to form a patterned mask 54 on the photoluminescent layer 52 as shown in Figure 10C. In step 230, as shown in Figure 10D, the photoluminescent layer 52 is patterned using an inactive exposure 56 in which the patterned photoresist mask 54 is absent, forming photoluminescent marks 55 of the photoluminescent layer 52 and individual marks 55 of the patterned photoluminescent layer 52.

[0051] In some embodiments, the deactivation exposure 56 of step 230 may be a shower of energy particles (e.g., ions) that alter the photoluminescent properties of the photoluminescent layer 52 by disabling any photoluminescent quantum nanostructure (e.g., by incorporating ions into the deactivation layer to patternwise reduce or alter the photoluminescent quantum structure) and removing material that does not remove the photoluminescent layer 52, leaving the deactivation portion 53 of the photoluminescent layer 52 in place, resulting in a structure as illustrated in Figure 11A. Suitable ions may include at least one ion from oxygen, nitrogen, hydrogen, helium, neon, argon, magnesium, lithium, beryllium, boron, phosphorus, aluminum, zinc, arsenic, gallium, silicon, cadmium, and any other element capable of decomposing the photoluminescent stack. Ions can create non-radiative defects in the unmasked portions of the photoluminescent layer 52, thus locally deactivating its photoluminescent properties. Exposing the photoluminescent layer 52 to high-energy particles such as ions can be a relatively low-cost method for inactivating portions 53 of the photoluminescent layer 52 and forming individual marks 55. In some embodiments, laminates comprising an AlN / GaN layer can be pattern-deactivated with Ar or N2, and laminates comprising a ZnO / SiO2 layer can be pattern-deactivated with Ar, N2, or O2. The remaining mask 54 of the photoresist can be removed in step 240 using photolithography and materials as shown in Figure 11B, leaving individual marks 55 that form the photoluminescent marks 50. Therefore, in some such embodiments, the material of the deactivated photoluminescent layer 52 (inactivated portion 53) remains in a predetermined position to provide a planar surface useful for subsequent layers or coatings, such as an anti-reflective layer, by spray, spin, or slot coating, or by lamination, or for application to the mounting surface 20.Embodiments comprising an inactivated portion 53 of the photoluminescent layer 52 may be useful in display devices 22 that do not use large tiles, for example, in a large liquid crystal display device 22, because the inactivated portion 53 can have the same optical refractive index as the active portion of the photoluminescent layer 52 (e.g., individual marks 55), so that the photoluminescent layer 52 does not have a distracting structure.

[0052] As shown in the flowchart of Figure 9B and the sequential structures of Figures 12A to 12D, and in some embodiments of this disclosure, After the photoluminescent layer 52 is masked with the mask 54 in step 220, In step 235, the photoluminescent layer 52 is etched (for example, by dry etching such as argon plasma etching or oxygen plasma etching) to pattern the photoluminescent layer 52, and a portion of the photoluminescent layer 52 is physically removed by rinsing and exposing the corresponding portion of the tile substrate 32, as shown in Figure 12A. The remaining mask 54 of the photoresist can be removed in step 240 using photolithography and materials, leaving individual marks 55 that form the photoluminescent marks 50, as shown in Figure 12B. Optionally and as desired, the patterned photoluminescent layer 52 (e.g., the layer with the individual marks 55) can be planarized by coating (e.g., spray, spin, or curtain coating) a planarization layer 58 (e.g., containing a curable liquid resin), as shown in step 250 and Figure 12C. In some embodiments, the tile substrate 32, the tile 30, or both, comprises a planarization layer 58. The planarization layer 58 can be deposited to a desired thickness (e.g., coplanar with or slightly above the individual marks 55) or etched to a desired thickness by exposure to, for example, energy particles, dry etching solution, or liquid etching solution. The planarized surface may be useful for applying subsequent layers or coatings, such as anti-reflective layers, by spray, spin, or slot coating, or by lamination, or for application to the mounting surface 20. Embodiments including a portion of the photoluminescent layer 52 removed may be useful for tile display devices 22, such as inorganic LED tiles used in large display devices 22, because any planarization layer 58 can complement adhesives and coatings used with the tiles 23 of the display device.

[0053] As will be understood by those skilled in the art, the terms “across,” “below,” “upper,” “downward,” “underside,” and “on top” are relative terms and are interchangeable in reference to different orientations of layers, elements, and substrates as contained in this disclosure. As will also be understood by those skilled in the art, the terms “horizontal” and “vertical,” and “x” and “y” are interchangeable arbitrary indicators.

[0054] Although one embodiment has been described, it will now become clear to those skilled in the art that other embodiments incorporating the concepts of this disclosure can be used. Therefore, the present invention should not be limited to the embodiments described, but rather should be limited only by the spirit and scope of the following claims.

[0055] Throughout the description, where it is stated that apparatus and systems have, include, or comprise certain components, or that processes and methods have, include, or comprise certain steps, it is intended that there are apparatus and systems of the disclosed technology that are essentially composed of or comprise the enumerated components, and that there are processes and methods of the disclosed technology that are essentially composed of or comprise the enumerated steps.

[0056] It should be understood that the order of the steps or the order in which a particular action is performed is not important as long as the disclosed technology remains operational. Furthermore, in some circumstances, two steps or two actions, or more steps or actions, can be performed simultaneously. Although the present invention has been described in detail with particular reference to its specific embodiments, it should be understood that variations and modifications can be carried out within the spirit and scope of the invention. This application offers, for example, the following perspectives. [Perspective 1] Mounting surface (20) and A plurality of tiles (30) placed on the mounting surface (20), wherein each tile (30) comprises a tile substrate (32) having a plurality of photoluminescent marks (50) arranged in a pattern on the tile substrate (32) or arranged within the tile substrate (32), and In a tiled photonic bidirectional operation screen (10) equipped with, Each of the aforementioned photoluminescent marks (50) is unique with respect to all other photoluminescent marks (50) on any given tile (30), Each of the photoluminescent marks (50) includes pattern code information that encodes information to uniquely identify or specify the position of the photoluminescent mark (50) on the tile (30), Each tile substrate (32) is at least partially transparent to light absorbed by the photoluminescent mark (50) and at least partially transparent to light emitted by the photoluminescent mark (50). A tiled photonic two-way interactive screen (10). [Perspective 2] A photonic bidirectional tile operation screen (10) according to viewpoint 1, wherein the plurality of tiles (30) are arranged in a regular rectangular arrangement. [Perspective 3] A photonic bidirectional operation screen (10) for a tile according to viewpoint 1 or 2, wherein the mounting surface (20) is a display device. [Perspective 4] The aforementioned photoluminescent mark (50) is a photonic bidirectional operating screen (10) of a tile according to any one of views 1 to 3, which responds to stimulating electromagnetic radiation that emits electromagnetic radiation. [Perspective 5] (i) The stimulating electromagnetic radiation is partially visible to the human visual system and includes light in the near-infrared spectrum with wavelengths in the range of 650 to 800 nm. (ii) The stimulating electromagnetic radiation is invisible to the human visual system and includes light within the infrared light spectrum with wavelengths exceeding 800 nm. (iii) The stimulating electromagnetic radiation is invisible to the human visual system and includes ultraviolet light. (iv) The electromagnetic radiation emitted shall be infrared or near-infrared. (v) The stimulated electromagnetic radiation has a different frequency from the emitted electromagnetic radiation. A photonic bidirectional operation screen (10) of the tile described in perspective 4, which is one of the following. [Perspective 6] The photoluminescent mark (50) comprises a laminated portion of a material, each laminated portion of the material comprises at least one set of consecutive layers, each set of layers alternately comprises a first layer of a first material having a thickness of 1 micrometer or less and a second layer of a second material having a thickness of 10 nm or less, wherein the interface between the first and second layers of the set of layers comprises a quantum nanostructure, the bidirectional operating screen (10) according to any one of viewpoints 1 to 5. [perspective 7] A photonic bidirectional control screen (10) of a tile as described in any one of viewpoints 1 to 6, wherein the photoluminescent mark (50) responds to stimulated electromagnetic radiation by emitting electromagnetic radiation, An optical stylus (60) that emits stimulating radiation to one or more photoluminescent marks (50) and is operable to respond to electromagnetic radiation emitted by the stimulated photoluminescent marks (50) A photonic bidirectional operation system for tiles (15) comprising the above. [Perspective 8] The optical stylus (60) is equipped with a light source that emits stimulating radiation onto the photoluminescent mark (50), or The optical stylus (60) includes a camera that responds to electromagnetic radiation emitted by the photoluminescent mark (50). A photonic bidirectional operation system for tiles as described in perspective 7 (15). [Perspective 9] A photonic bidirectional tile operation system (15) according to view 7 or 8, wherein the digital camera has a field of view encompassing all of the tiles (30). [Perspective 10] A photonic bidirectional tile operation system (15) according to any one of views 7 to 9, wherein the digital camera has a field of view that includes fewer tiles (30) than all of the tiles (30). [Perspective 11] A photonic bidirectional tile operation system (15) according to any one of viewpoints 7 to 10, wherein the tile (30) is arranged on a display device equipped with a display control unit. [Perspective 12] A photonic bidirectional tile operation screen (10) according to any one of views 1 to 11, wherein the information encoded within the photoluminescent mark (50) on one tile incorporates either identification information of the tile (30) or the position of the tile (30) relative to the tile placed on the aforementioned surface (20). [Perspective 13] A tile photonic bidirectional operation screen (10) according to any one of views 1 to 12, wherein the tile substrate (32) comprises two or more layers. [Perspective 14] A photonic bidirectional operation screen (10) of a tile according to view 13, wherein the photoluminescent mark (50) is positioned between the tile substrate (32) and the aforementioned surface (20), or between two layers of the two or more layers. [Perspective 15] The photonic bidirectional operating screen (10) of tiles according to view 13, wherein the two or more layers are bonded to each other or to the aforementioned substrate using an adhesive that has the same refractive index and is optically transparent. [Perspective 16] A tile photonic bidirectional operation screen (10) according to any one of viewpoints 1 to 15, wherein multiple tile substrates (32) are bonded together using a light-absorbing adhesive. [Perspective 17] The aforementioned mounting surface (20) is a tile mounting surface (21) comprising a plurality of mounting tiles (30), (i) One tile (30) is placed on each mounting tile (30), (ii) Multiple tiles (30) are placed on each mounting tile (30), or (iii) One tile is placed on multiple mounting tiles (30), A photonic bidirectional control screen (10) of a tile as described in any one of viewpoints 1 to 16. [Perspective 18] To provide a photonic bidirectional operation system (15) for tiles as described in any one of viewpoints 7 to 11, The tile position of each tile (30) relative to other multiple tiles (30), and the at least one photoluminescent mark (50) placed on the tile (30) are recorded. Recording the encoded information by exposing at least one photoluminescent mark (50) on one tile to stimulating electromagnetic radiation, Determining the encoded information of the corresponding tile (30) and the position information derived from the tile position. A method for operating a tile photonic bidirectional operation system (15) comprising the following. [Perspective 19] A method for operating a tile photonic bidirectional operation system (15) according to viewpoint 18, comprising recording the tile position of each tile (30) relative to a plurality of other tiles (30) and at least one photoluminescent mark (50) placed on the tile (30), thereby recording tile identification information that identifies the position of the tile (30) in the arrangement section. [perspective 20] A method for operating a tile photonic bidirectional operation system (15) according to viewpoint 18, comprising: recording the position of each tile (30) in the array portion relative to a plurality of photoluminescent marks (50); exposing at least one unique photoluminescent mark (50) of each tile to stimulating radiation; and recording the position of the emitted electromagnetic radiation relative to the tile position of the tile (30). [Perspective 21] Mounting surface (20) and A plurality of tiles placed on the mounting surface (20), wherein each tile (30) comprises a tile substrate (32) having a plurality of unique photoluminescent marks (50) arranged within an arrangement portion on the tile substrate (32), and the plurality of tiles A tiled photonic bidirectional control screen (10) is provided. [Perspective 22] A photonic bidirectional tile operation screen (10) according to viewpoint 15, wherein the information encoded within the photoluminescent mark (50) on one tile incorporates identification information of the tile (30) or the position of the tile (30) relative to a plurality of tiles placed on the aforementioned surface (20). [Perspective 23] The tile photonic bidirectional operating screen according to view 21 or 22, wherein the tile substrate (32) comprises two or more layers. [Perspective 24] A photonic bidirectional operation screen (10) of a tile according to view 23, wherein the photoluminescent mark (50) is positioned between the tile substrate (32) and the aforementioned surface (20), or between two layers of the two or more layers. [Perspective 25] The photonic bidirectional operating screen (10) of tiles according to viewpoint 23, wherein the two or more layers are bonded to each other or to the aforementioned substrate using an adhesive that has the same refractive index and is optically transparent. [Perspective 26] A tile photonic bidirectional operation screen (10) according to any one of views 21 to 25, wherein multiple tile substrates (32) are bonded together using a light-absorbing adhesive. [perspective 27] The aforementioned mounting surface (20) is a tile mounting surface (21) comprising a plurality of mounting tiles (30), (i) One tile (30) is placed on each mounting tile (30), (ii) Multiple tiles (30) are placed on each mounting tile (30), or (iii) One tile is placed on multiple mounting tiles (30), A photonic bidirectional operation screen (10) of a tile as described in any one of viewpoints 21 to 26. [Perspective 28] To provide a tile substrate (32), The photoluminescent layer (52) comprising quantum nanostructures is placed on the tile substrate (32), The photoluminescent layer (52) is masked in order to form masked and unmasked portions, The method comprises inactivating the unmasked portion of the photoluminescent layer (52) and removing the mask. How to create a tiled photonic bidirectional interactive screen (10). [Perspective 29] The method according to viewpoint 28, wherein inactivating the unmasked portion of the photoluminescent layer (52) is to expose the unmasked portion to energy particles. [Perspective 30] The method according to viewpoint 22, wherein the unmasked portion of the photoluminescent layer (52) is etched to expose the corresponding unmasked portion of the tile substrate (32). [Perspective 31] The method according to viewpoint 30, further comprising smoothing the photoluminescent layer (52). [Explanation of Symbols]

[0057] A Section line 10-tile photonic two-way interactive screen 15-tile photonic bidirectional control system 20 Mounting surface 21 Tile mounting surface 22 Display device 23 Display Tiles 24 Display control device 26 Frame of a machine or display device 30 tiles or screen tiles 32 Tile substrate 32A, 32B, 32C Tile substrate layer 34 Adhesives 34B Light-absorbing adhesive 34T Light-Transmitting Adhesive 36 Anti-reflective coating or anti-glare coating 38 Black Matrix 40 Arrangement section 50 Photoluminescent Mark 52 Photoluminescent layer 53 Inactive part 54 masks 55 individual seals 56 Inactivation Exposure 58 Planarization layer 60 Optical Styluses 62 Light source 64 Light receiving unit or camera 66 Optical elements 68 Control switches 69 Communication Circuits 70 Stimulating light 80 Emitted light 100-tile construction process 110-tile ID recording process 120 Tile Assembly Process 130 The process of stimulating the mark 131 The process of stimulating the mark 140. The process of recording a mark. 150 Steps to receive the stamp 155 The process of decrypting the mark 160. The process of comparing records. 170 Process for determining position The process of creating an image of an array of 180 tiles. 190 The process of stimulating all tiles Process to provide 200 substrates 210 Photoluminescent layer formation process 220 Process of masking the photoluminescent layer 230 Step to deactivate the exposed photoluminescent layer 235 Etching process of the exposed photoluminescent layer 240. Process to remove the mask 250 Flattening process

Claims

1. Mounting surface (20) and A plurality of screen tiles (30) placed on the mounting surface (20), wherein each screen tile (30) comprises a tile substrate (32) having a plurality of photoluminescent marks (50) arranged in a pattern on the tile substrate (32) or arranged within the tile substrate (32), and In a tiled photonic bidirectional operation screen (10) equipped with, Each of the aforementioned photoluminescent marks (50) is unique with respect to all other photoluminescent marks (50) on any screen tile (30), Each of the photoluminescent marks (50) includes pattern code information that encodes information to uniquely identify or specify the position of the photoluminescent mark (50) on the screen tile (30), Each tile substrate (32) is at least partially transparent to light absorbed by the photoluminescent mark (50) and at least partially transparent to light emitted by the photoluminescent mark (50), and the tile has a photonic bidirectional operating screen (10) in which the photoluminescent mark (50) responds by emitting electromagnetic radiation to stimulated electromagnetic radiation. An optical stylus (60) that emits stimulating radiation to one or more photoluminescent marks (50) and is operable to respond to electromagnetic radiation emitted by the stimulated photoluminescent marks (50) A photonic bidirectional tile operation system (15) comprising: The optical stylus (60) is equipped with a digital camera that responds to electromagnetic radiation emitted by the photoluminescent mark (50), The digital camera has a field of view that encompasses all of the screen tiles (30), A photonic bidirectional operation system for tiles (15).

2. The photonic bidirectional tile operation system (15) according to claim 1, wherein the plurality of screen tiles (30) are arranged in a regular rectangular arrangement.

3. The photonic bidirectional operation system (15) for tiles according to claim 1 or 2, wherein the mounting surface (20) is a display device.

4. The photoluminescent mark (50) responds to stimulated electromagnetic radiation, the photonic bidirectional operation system (15) for the tile according to claim 1.

5. (i) The stimulating electromagnetic radiation includes light in the near-infrared spectrum that is partially visible to the human visual system and has wavelengths in the range of 650 to 800 nm. (ii) The stimulating electromagnetic radiation is invisible to the human visual system and includes light within the infrared light spectrum with wavelengths exceeding 800 nm. (iii) The aforementioned stimulating electromagnetic radiation is invisible to the human visual system and includes ultraviolet light. (iv) The electromagnetic radiation emitted is infrared or near-infrared. (v) The stimulated electromagnetic radiation has a different frequency from the emitted electromagnetic radiation. A photonic bidirectional operation system for tiles according to claim 4 (15), which is one of the following:

6. The photoluminescent mark (50) comprises a laminated portion of a material, each laminated portion of the material comprises at least one set of continuous layers, each set of layers alternately comprises a first layer of a first material having a thickness of 1 micrometer or less and a second layer of a second material having a thickness of 10 nm or less, wherein the interface between the first layer and the second layer of the set of layers comprises a quantum nanostructure, the photonic bidirectional operation system (15) of a tile according to claim 1.

7. The optical stylus (60) is equipped with a light source that emits stimulating radiation onto the photoluminescent mark (50), or The optical stylus (60) includes a camera that responds to electromagnetic radiation emitted by the photoluminescent mark (50). The photonic bidirectional operation system (15) for tiles according to claim 1.

8. The optical stylus (60) is equipped with a digital camera that responds to electromagnetic radiation emitted by the photoluminescent mark (50), The tile photonic bidirectional operation system (15) according to claim 1, wherein the digital camera has a field of view that includes fewer screen tiles (30) than all of the screen tiles (30).

9. The photonic bidirectional operation system (15) for a tile according to claim 1, wherein the screen tile (30) is arranged on a display device equipped with a display control unit.

10. The photonic bidirectional operation system (15) for a tile according to claim 1, wherein the information encoded within the photoluminescent mark (50) on a screen tile (30) incorporates identification information of the screen tile (30) or the position of the screen tile (30) relative to the screen tile (30) placed on the aforementioned surface (20).

11. The tile photonic bidirectional operation system (15) according to claim 1, wherein the tile substrate (32) comprises two or more layers.

12. The photonic bidirectional operation system (15) for a tile according to claim 11, wherein the photoluminescent mark (50) is positioned between the tile substrate (32) and the aforementioned surface (20), or between two layers of the two or more layers.

13. The photonic bidirectional tile operation system (15) according to claim 11, wherein the two or more layers are bonded to each other or to the aforementioned surface (20) using an adhesive having the same refractive index and being optically transparent.

14. A photonic bidirectional tile operation system (15) according to claim 1, wherein a plurality of the tile substrates (32) are bonded together using a light-absorbing adhesive.

15. The aforementioned mounting surface (20) is a mounting surface (21) of a tile that has a plurality of display tiles (23), (i) One screen tile (30) is placed on each display tile (23), (ii) Multiple screen tiles (30) are placed on each display tile (23), or (iii) One screen tile (30) is placed on multiple display tiles (23), The photonic bidirectional operation system (15) for tiles according to claim 1.

16. To provide a photonic bidirectional operation system (15) for tiles as described in claim 1, Record the screen tile position of each screen tile (30) relative to other multiple screen tiles (30), and at least one photoluminescent mark (50) placed on the screen tile (30), Record encoded information by exposing at least one photoluminescent mark (50) of one screen tile (30) to stimulate electromagnetic radiation, Determining the encoded information of the corresponding screen tile (30) and the position information derived from the screen tile position. A method for operating a tile photonic bidirectional operation system (15) comprising the above.

17. The plurality of screen tiles (30) are arranged in the screen tile (30) arrangement section (40), A method for operating a tile photonic bidirectional operation system (15) according to claim 16, comprising recording the screen tile position of each screen tile (30) relative to a plurality of other screen tiles (30) and at least one photoluminescent mark (50) placed on the screen tile (30), thereby recording screen tile identification information that identifies the screen tile position of the screen tile (30) in the arrangement section (40).

18. A method for operating a tile photonic bidirectional operation system (15) according to claim 17, wherein recording the screen tile position of each screen tile (30) in the array portion with respect to a plurality of photoluminescent marks (50) comprises exposing at least one unique photoluminescent mark (50) of each screen tile (30) to stimulating radiation and recording the position of emitted electromagnetic radiation with respect to the screen tile position of the screen tile (30).

Citation Information

Patent Citations

  • Multi-mode stylus and digitizer system

    CN104813259A

  • Device and method for detecting position

    JP2001325069A

  • Multimode stylus and digitizer system

    JP2015535641A

  • US10,255,017

  • Near-field and far-field encoding of microbeads for bioassays

    US20040175842A1