Display device, method for operating the same, and electronic device
By embedding an antenna in the non-display area of the display panel and using radar to detect user touch input, the problem of inaccurate user touch detection in existing 3D image display devices is solved, achieving high-precision 3D touch coordinate setting and improving the realism of the 3D experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-09-09
- Publication Date
- 2026-03-10
AI Technical Summary
Existing 3D image display devices struggle to accurately detect user touch or gesture input in three-dimensional space, lacking effective interface methods to provide a realistic 3D experience.
By embedding an antenna in the non-display area of the display panel, the user's touch input is detected using radar methods. The user is guided to touch multiple objects in sequence by specifying a guide image. The processor records and sets the 3D touch coordinates to establish a precise 3D coordinate system.
It enables precise detection of user touch or gesture input in 3D space, provides high-precision 3D touch coordinate settings, and supports a more realistic 3D experience.
Smart Images

Figure CN121635709A_ABST
Abstract
Description
[0001] Cross-references to related applications
[0002] This application relates to and claims priority to Korean Patent Application No. 10-2024-0122657, filed on September 9, 2024, the disclosure of which is incorporated herein by reference in its entirety. Technical Field
[0003] This disclosure generally relates to display devices, and more specifically, to display devices for displaying three-dimensional (3D) images, methods for operating the display device, and electronic devices. Background Technology
[0004] With the development of the information society, increasing demands are being placed on display devices used to display images in various ways. Some examples of display devices include flat panel displays such as liquid crystal displays (LCDs), field emission displays, and light-emitting diode (LED) displays. An example of an LED display is an OLED display device that uses organic light-emitting diode (OLED) elements as light-emitting elements. Another type of LED display uses inorganic LEDs as light-emitting elements.
[0005] Recently, display devices for creating three-dimensional (3D) images have been developed. For creating 3D images, both spectacle-type and non-spectacle-type methods have been developed and commercialized. Spectacle-type methods include polarized spectacle-type methods and shutter spectacle-type methods. Non-spectacle-type methods include lens methods and parallax barrier methods. These methods allow users to view 3D images using the principle of binocular parallax. A 3D image display device intended to transmit 3D images to users should ideally deliver a realistic 3D experience indistinguishable from the 3D experience encountered by users in natural environments.
[0006] For display devices that create 3D images, a new interface method for detecting user touch or gestures relative to 3D space is desirable, unlike the screen touch interface provided to the user by a flat panel display device. Summary of the Invention
[0007] Embodiments of this disclosure provide a display device capable of detecting a user's touch or gesture relative to 3D space using an antenna built into the display panel, a method for operating the display device, and an electronic device.
[0008] According to embodiments of this disclosure, the display device includes a display panel and a processor. The processor controls the display panel to display a specified guide image for setting 3D touch coordinates in three-dimensional (3D) space. The processor controls the display panel to display a guide message instructing a user to sequentially touch multiple objects included in the specified guide image. When the user sequentially touches the multiple objects, the processor records reference coordinates in 3D space corresponding to the user's touches. Based on the recorded reference coordinates, the processor completes the setting of the 3D touch coordinates.
[0009] The specified guide image may include at least a portion of a cube-shaped image.
[0010] The specified guide image may include: a first object corresponding to a first vertex of a cube shape and representing the origin in 3D space; a second object corresponding to a second vertex of a cube shape and representing the X coordinate of the cube from the origin in 3D space; a third object corresponding to a third vertex of a cube shape and representing the Y coordinate of the cube from the origin in 3D space; and a fourth object corresponding to a fourth vertex of a cube shape and representing the Z coordinate of the cube from the origin in 3D space.
[0011] The specified guide image may include a guide message instructing the user to touch the first object, the second object, the third object, and the fourth object in a predetermined order.
[0012] The processor can set the origin of the 3D space based on the detection that the user has touched the first object using an antenna in the non-display area of the display panel.
[0013] The processor can set an X reference coordinate based on the fact that the user has touched a second object using the antenna.
[0014] The processor can set a Y reference coordinate based on the detection that the user has touched a third object using the antenna.
[0015] The processor can set a Z reference coordinate based on the detection that the user has touched a fourth object using the antenna.
[0016] The display device can be an eyeglasses-type display.
[0017] The display device can be a non-spectral light field display (LFD).
[0018] The display device can be a holographic display.
[0019] The display device can be a variable focal length stereoscopic display.
[0020] According to embodiments of the present disclosure, a method for operating a display device including a display panel includes: a processor controlling the display panel to display a specified guide image for setting 3D touch coordinates in 3D space; a processor controlling the display panel to display a guide message instructing a user to sequentially touch a plurality of objects included in the specified guide image; when the user sequentially touches the plurality of objects, the processor recording reference coordinates in 3D space corresponding to the user's touches into a memory; and the processor completing the setting of the 3D touch coordinates based on the recorded reference coordinates.
[0021] According to embodiments of this disclosure, a display device includes: a display panel having a display area and a non-display area outside the display area, the non-display area including an antenna; an antenna circuit board connected to the antenna; and a processor connected to the antenna circuit board. The processor is configured to: control the display panel to display a specified guide image for setting 3D touch coordinates in 3D space; control the display panel to display a guide message instructing a user to sequentially touch multiple objects included in the specified guide image; and control the antenna circuit board to transmit radio frequency (RF) signals through the antenna. When the user sequentially touches multiple objects, the processor receives signal information from the antenna circuit board corresponding to the transmitted RF signals reflected from the user and received by the antenna, and records reference coordinates in 3D space corresponding to the user's touch in a memory based on the signal information.
[0022] According to embodiments of this disclosure, an electronic device includes a processor, a memory having stored applications for execution by the processor, and a display device including a display panel. The processor controls the display panel to display a specified guide image for setting 3D touch coordinates in 3D space. The processor controls the display panel to display a guide message instructing a user to sequentially touch multiple objects included in the specified guide image. When the user sequentially touches the multiple objects, the processor records reference coordinates in 3D space corresponding to the user's touches. Based on the recorded reference coordinates, the processor completes the setting of the 3D touch coordinates. The electronic device further includes a user interface configured to sense user input via touch or cursor selection of icons presented on the display panel or touch input detection in 3D space. Upon receiving user input, the processor executes one or more applications.
[0023] In electronic devices, stored applications may include one or more of camera applications, audio-visual streaming applications, and telephone applications.
[0024] In an electronic device, the user interface may be a touchscreen embedded in a display panel, wherein the touchscreen includes touch sensors for sensing touches or taps made by the user. The user interface may further include an audio sensor embedded in the display panel, wherein the audio sensor can receive voice commands to establish access to one or more applications.
[0025] Using the display device, electronic device, and method for operating the display device according to the embodiments, an antenna built into the display panel can be used to detect a user's touch or gesture relative to 3D space. Attached Figure Description
[0026] The above and other features of this disclosure will become more apparent from the detailed description of embodiments thereof with reference to the accompanying drawings, in which:
[0027] Figure 1 and Figure 2 This is a plan view of a display device according to an embodiment;
[0028] Figure 3 and Figure 4 This is a side view of a display device according to an embodiment;
[0029] Figure 5 and Figure 6 This is a plan view of a display device according to other embodiments;
[0030] Figure 7 It is a diagram. Figure 1 A plan view of an example antenna region;
[0031] Figure 8 This is a cross-sectional view of a portion of the display area of the display device according to an embodiment;
[0032] Figure 9 This is a cross-sectional view of the boundary between the antenna region and the adjacent non-display region of the display device according to an embodiment;
[0033] Figure 10 This is a diagram illustrating an example in which the display device according to an embodiment is implemented as a non-glasses light field display (LFD);
[0034] Figure 11 This is a diagram illustrating an example in which the display device according to an embodiment is implemented as a stereoscopic display;
[0035] Figure 12 This is a perspective view of a head-mounted display according to an embodiment;
[0036] Figure 13 It is a diagram. Figure 12 An exploded perspective view of an example of a head-mounted display;
[0037] Figure 14 This is a perspective view of a head-mounted display according to an embodiment;
[0038] Figure 15 This is an illustration showing an example in which the display device according to an embodiment is a holographic display;
[0039] Figure 16 This is an illustration showing an example of a glasses-type display device according to an embodiment;
[0040] Figure 17 This is a flowchart illustrating a method for driving a display device according to an embodiment;
[0041] Figure 18 This is a conceptual diagram illustrating a method for setting reference coordinates for 3D touch detection using a display device according to an embodiment.
[0042] Figure 19 This is an example of the coordinate system in which the display device performs 3D touch detection according to the embodiment; and
[0043] Figure 20 This is a block diagram of an electronic device according to an embodiment. Detailed Implementation
[0044] In the following description, embodiments of the present disclosure will be described more fully with reference to the accompanying drawings. Throughout the specification and drawings, the same reference numerals may refer to the same elements.
[0045] Embodiments of this disclosure propose a user interface for a 3D image display device that allows a user to precisely select icons in 3D space. Precise touch input is detectable in 3D space by using a calibration procedure that guides the user to touch a point in space corresponding to a specific point in a guide image. An antenna may be included in a non-display area of the display device to detect the user's touch input using a radar-based method during the calibration procedure and subsequently during application execution.
[0046] Accordingly, embodiments of the inventive concept described herein are provided including a display panel (e.g., 300, see below). Figure 1 ) and processor (e.g., 410, see Figure 4 ) display device (e.g., 10, see Figure 1 The processor can control the display panel to display a specified guide image for setting 3D touch coordinates in three-dimensional (3D) space (e.g., 2000, see...). Figure 16 The processor can control the display panel to show instructions for the user to sequentially touch multiple objects included in the guide image (e.g., 2001–2004, see...). Figure 18The guiding message (e.g., 2016, see...) Figure 16 When a user sequentially touches an object, the processor can record the reference coordinates corresponding to the user's touch in 3D space in memory. Based on the recorded reference coordinates, the processor can set the 3D touch coordinates. Therefore, a precise coordinate system in 3D space can be established for the display device in association with a specific user. Then, subsequently running applications can use the established 3D coordinate system to set user-selectable icons in 3D space with high precision.
[0047] In this document, when two or more elements or values are described as substantially the same or approximately equal to each other, it should be understood that the elements or values are the same, the elements or values are equal to each other within measurement error, or, if not equal in measurement, are sufficiently close in value to be functionally equal, as will be understood by those skilled in the art. For example, taking into account the measurement in question and the error associated with the measurement of a particular quantity (e.g., limitations of the measurement system), the term “approximately” as used herein includes the stated value and means within an acceptable deviation range of that particular value as determined by those skilled in the art. For example, as will be understood by those skilled in the art, “approximately” can mean within one or more standard deviations. Furthermore, it should be understood that although a parameter may be described herein as having a “approximately” specific value, as will be understood by those skilled in the art, according to embodiments, the parameter may be exactly that specific value or be approximately that specific value within measurement error. Other uses of these terms and similar terms to describe relationships between components should be interpreted in the same manner.
[0048] It will be understood that when a component, such as a membrane, region, layer, or element, is referred to as being "on" another component, "connected to," "attached to" another component, or "adjacent to" another component, it can be directly on, directly connected to, directly attached to, or immediately adjacent to that other component, or there may be intervening components. It will also be understood that when a component is referred to as "covering" another component, it can be the only component covering that other component, or one or more intervening components may also cover that other component. Other terms used to describe relationships between components can be interpreted in the same way.
[0049] It will be further understood that, unless the context explicitly indicates otherwise, the description of a feature or aspect within each embodiment can be used for other similar features or aspects in other embodiments. Accordingly, all features and structures described herein can be mixed and matched in any desired manner.
[0050] As used herein, unless the context explicitly indicates otherwise, the singular forms “a” and “the (said)” are intended to include the plural forms as well.
[0051] When a feature is described as extending, emphasizing, or otherwise following a particular direction, it will be understood that the feature may follow the stated direction in a negative direction (i.e., the opposite direction). Accordingly, unless the context clearly indicates otherwise, the feature is not limited to following a direction precisely, but may follow along an axis formed by that direction.
[0052] In the following, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.
[0053] Figure 1 and Figure 2 This is a plan view of the display device 10 according to an embodiment.
[0054] Reference Figure 1 and Figure 2 The display device 10 according to the embodiments can be applied to portable electronic devices such as mobile phones, smartphones, tablet computers, mobile communication terminals, electronic notebooks, e-books, portable multimedia players (PMPs), navigation systems, or ultra-mobile PCs (UMPCs). Alternatively, the display device 10 can be applied as a display unit of a television, laptop computer, monitor, billboard, or Internet of Things (IoT) terminal. Alternatively, the display device 10 according to the embodiments can be applied to wearable devices such as smartwatches, smartwatch phones, glasses-type displays, or head-mounted displays (HMDs). Alternatively, the display device 10 can be applied to a vehicle's dashboard, a vehicle's central dashboard, a central information display (CID) mounted on a vehicle's dashboard, an interior rearview mirror display replacing a vehicle's side mirrors, or a display mounted on the rear surface of the front seats for rear-seat entertainment in a vehicle.
[0055] In this disclosure, the first direction (X-axis direction) can be the direction of the long side of the display device 10 (e.g., the vertical direction of the display device 10). The second direction (Y-axis direction) can be the direction of the short side of the display device 10 (e.g., the horizontal direction of the display device 10). The third direction (Z-axis direction) can be the thickness direction of the display device 10. The corner where the long side in the first direction (X-axis direction) intersects the short side in the second direction (Y-axis direction) can be rounded to have a selected curvature or can be a right angle.
[0056] The display device 10 includes a display panel 300, a display circuit board 310, a display driving circuit 320, a touch driving circuit 330, and an antenna circuit board 340. A connector 341 may be formed on one side of the antenna circuit board 340.
[0057] Display panel 300 may be a light-emitting display panel that includes light-emitting elements. For example, display panel 300 may be an organic light-emitting display panel that uses organic light-emitting diodes that include organic light-emitting layers, a micro light-emitting diode display panel that uses micro LEDs, a quantum dot light-emitting display panel that uses quantum dot light-emitting diodes that include quantum dot light-emitting layers, or an inorganic light-emitting display panel that uses inorganic light-emitting elements that include inorganic semiconductors.
[0058] The display panel 300 can be a flexible display panel that can be easily bent, folded, or rolled up. For example, the display panel 300 can be a foldable display panel that can be folded and unfolded, a curved display panel with a curved display surface, a bendable display panel with a bending area other than the display surface, a rollable display panel that can be rolled up and unfolded, or a stretchable display panel that can be stretched.
[0059] The display panel 300 may include a main region MA, a sub-region SBA protruding from one side of the main region MA, and an antenna region AA protruding from the other side of the main region MA. The antenna region AA may be referred to as the "protrusion region".
[0060] The main area MA may include a display area DA for displaying the image and a non-display area NDA that is the outer region of the display area DA. The display area DA may occupy most of the main area MA. The display area DA may be located at the center of the main area MA. The non-display area NDA may be the area outside the display area DA. The non-display area NDA may be defined as the edge region of the display panel 300. The non-display area NDA may be referred to as the invalid space area DS (see...). Figure 7 ).
[0061] The secondary region SBA can protrude from one side of the primary region MA in the first direction (X-axis direction). For example, one side of the primary region MA can be the lower side of the primary region MA. Figure 1 As illustrated, the length of the sub-region SBA in the first direction (X-axis direction) can be less than the length of the primary region MA in the first direction (X-axis direction), and the length of the sub-region SBA in the second direction (Y-axis direction) can be less than the length of the primary region MA in the second direction (Y-axis direction), but the embodiments of this disclosure are not limited thereto.
[0062] Reference Figure 2 The sub-area SBA can be bent, and at least a portion of the bent sub-area SBA can be positioned below the display panel 300. In this case, at least a portion of the sub-area SBA can overlap with the main area MA of the display panel 300 in the third direction (Z-axis direction).
[0063] The display pad DPD can be located at one side edge of the sub-region SBA. One side edge of the sub-region SBA can be the lower edge of the sub-region SBA. The display circuit board 310 can be attached to the display pad DPD of the sub-region SBA. The display circuit board 310 can be attached to the display pad DPD of the sub-region SBA using a conductive adhesive member such as an anisotropic conductive film or anisotropic conductive adhesive. The display circuit board 310 can be a flexible printed circuit board (FPCB), a rigid printed circuit board (PCB) that is virtually inflexible, or a composite printed circuit board combining both rigid and flexible printed circuit boards.
[0064] The display driving circuit 320 can be disposed on the sub-area SBA of the display panel 300. The display driving circuit 320 can receive control signals and power voltage, and generate and output signals and voltages for driving the display panel 300. The display driving circuit 320 can be formed as an integrated circuit (IC).
[0065] The touch driving circuit 330 can be disposed on the display circuit board 310. The touch driving circuit 330 can be formed as an integrated circuit. The touch driving circuit 330 can be attached to the display circuit board 310.
[0066] The touch driving circuit 330 can be electrically connected to the sensor electrodes of the sensor electrode layer of the display panel 300 via the display circuit board 310. The touch driving circuit 330 can output a touch driving signal to each of the sensor electrodes and can sense voltage changes based on the mutual capacitance of the sensor electrodes.
[0067] The sensor electrode layer of the display panel 300 can sense proximity touch and / or contact touch. Contact touch means that an object such as a human finger or pen is in direct contact with the overlay window positioned above the sensor electrode layer. Proximity touch means that an object such as a human finger or pen is positioned above the overlay window but is close to it (such as hovering).
[0068] A power supply unit for supplying driving voltage to the display pixels of the display panel 300 and the display driving circuit 320 can be separately disposed on the display circuit board 310. Alternatively, the power supply unit can be integrated with the display driving circuit 320, and in this case, the display driving circuit 320 and the power supply unit can be formed as a single integrated circuit.
[0069] Antenna region AA can be a region including at least one of the following components: antenna electrodes, feed line, and ground line of an antenna module for wireless communication. Antenna region AA can protrude from the opposite side of main region MA in a first direction (X-axis direction). For example, the opposite side of main region MA can be the upper side of main region MA. Figure 1As illustrated, the length of antenna region AA in the first direction (X-axis direction) may be less than the length of main region MA in the first direction (X-axis direction), and the length of antenna region AA in the second direction (Y-axis direction) may be less than the length of main region MA in the second direction (Y-axis direction), but the embodiments of this disclosure are not limited thereto.
[0070] like Figure 2 As illustrated, at least a portion of the antenna region AA can be bent, and at least a portion of the bent antenna region AA can be positioned below the display panel 300. In this case, at least a portion of the antenna region AA can overlap with the main area MA of the display panel 300 in the third direction (Z-axis direction).
[0071] Antenna pad APD can be disposed at one side edge of antenna region AA. Antenna circuit board 340 can be attached to antenna pad APD of antenna region AA. Antenna circuit board 340 can be attached to antenna pad APD of antenna region AA by using conductive adhesive members such as anisotropic conductive film and anisotropic conductive adhesive. One side of antenna circuit board 340 may include antenna drive circuitry 350 connected thereto (see...). Figure 4 The main circuit board 400 has a connector 341. The antenna circuit board 340 may be a flexible printed circuit board (FPCB) that can be bent.
[0072] Figure 3 and Figure 4 This is a side view of the display device 10 according to an embodiment.
[0073] Reference Figure 3 and Figure 4 The display device 10 according to the embodiment may include a display panel 300, a polarizing film PF, a cover window CW, and a lower panel cover PB. The display panel 300 may include a substrate SUB and a display layer DISL (see Figure 8 ).
[0074] The substrate SUB can be formed from an insulating material such as a polymer resin. The substrate SUB can be a flexible substrate that can be bent, folded, or rolled.
[0075] The display layer DISL can be disposed in the main region MA of the substrate SUB. The display layer DISL can be a layer that displays images by including an emission region. The display layer DISL may include a thin film transistor layer in which thin film transistors are formed, a light-emitting element layer in which light-emitting elements are disposed in the emission region, an encapsulation layer ENC, and a sensor electrode layer SENL.
[0076] In the display area DA of the display layer DISL, not only can the emission area be set, but also scan lines, data lines, and power lines for driving the light-emitting elements in the emission area can be set. In the non-display area NDA of the display layer DISL, scan drivers that output scan signals to the scan lines and fan-out lines that connect the data lines and the display driver circuit 320 can be set.
[0077] An encapsulation layer (ENC) can be disposed on the light-emitting element layer of the display layer (DISL). The encapsulation layer (ENC) can be a layer used to encapsulate the light-emitting element layer of the display layer (DISL) to prevent oxygen or moisture from penetrating into the light-emitting element layer of the display layer (DISL). The encapsulation layer (ENC) can be disposed on the top and side surfaces of the light-emitting element layer of the display layer (DISL).
[0078] The sensor electrode layer (SENL) can be disposed on the encapsulation layer (ENC). The sensor electrode layer (SENL) can include sensor electrodes. The sensor electrode layer (SENL) can use the sensor electrodes to sense touch.
[0079] A polarizing film PF can be disposed on the sensor electrode layer SENL. The polarizing film PF may include a first substrate member, a linear polarizer, a phase retardation film such as a quarter-wave plate (λ / 4 plate), and a second substrate member. The first substrate member, the phase retardation film, the linear polarizer, and the second substrate member may be sequentially stacked on the sensor electrode layer SENL.
[0080] The cover window (CW) can be placed on the polarizing film (PF). The cover window (CW) can be attached to the polarizing film (PF) using a transparent adhesive component such as an optically clear adhesive (OCA) film.
[0081] The bottom cover PB can be disposed below the display panel 300. The bottom cover PB can be attached to the bottom surface of the display panel 300 by an adhesive member. The adhesive member can be a pressure-sensitive adhesive (PSA). The bottom cover PB can include at least one of a light-blocking member for absorbing light incident from the outside, a cushioning member for absorbing impacts from the outside, and a heat dissipation member for effectively dissipating heat from the display panel 300.
[0082] A light-blocking component may be disposed below the display panel 300. The light-blocking component blocks light transmission, thereby preventing components disposed below the light-blocking component (e.g., display circuit board 310, etc.) from being viewed from the top of the display panel 300. The light-blocking component may include a light-absorbing material such as black pigment or black dye.
[0083] A buffer member can be disposed below the light-blocking member. The buffer member absorbs external impacts to prevent damage to the display panel 300. The buffer member can be formed of a single layer or multiple layers. For example, the buffer member can be formed of a polymer resin such as polyurethane (PU), polycarbonate (PC), polypropylene (PP), or polyethylene (PE), or can include an elastic material such as foam sponge obtained from rubber, urethane materials, or acrylic materials.
[0084] The heat dissipation component can be disposed below the buffer component. Some examples of the heat dissipation component may include a first heat dissipation layer comprising graphite or carbon nanotubes, and a second heat dissipation layer formed of a thin metal film comprising, for example, copper, nickel, ferrite, or silver, which can shield electromagnetic waves and has excellent thermal conductivity.
[0085] like Figure 4 As illustrated, the sub-region SBA of the substrate SUB can be bent and positioned below the display panel 300. The sub-region SBA of the substrate SUB can be attached to the bottom surface of the panel cover PB via a first adhesive member 391. The first adhesive member 391 can be a pressure-sensitive adhesive.
[0086] like Figure 4 As illustrated, the antenna region AA of the substrate SUB can be bent and positioned below the display panel 300. The antenna region AA of the substrate SUB can be attached to the bottom surface of the lower cover PB of the panel via a second adhesive member 392. The second adhesive member 392 can be a pressure-sensitive adhesive.
[0087] Display circuit board 310 can be attached to the display pads DPD of the sub-area SBA of substrate SUB using conductive adhesive members such as anisotropic conductive film or anisotropic conductive adhesive. Display circuit board 310 may include connector 311 connected to flexible printed circuit board 312. Display circuit board 310 can be connected to connector 352 of main circuit board 400 via flexible printed circuit board 312.
[0088] The touch driving circuit 330 can be disposed on the display circuit board 310. The touch driving circuit 330 can generate touch data based on the change of each sensed electrical signal in the sensor electrode of the sensor electrode layer SENL of the display panel 300 and transmit the touch data to the processor 410 on the main circuit board 400. The processor 410 can calculate the touch coordinates where the touch occurred by analyzing the touch data.
[0089] Antenna circuit board 340 can be attached to antenna pad APD of antenna region AA of substrate SUB using conductive adhesive components such as anisotropic conductive film or anisotropic conductive adhesive. Connector 341 of antenna circuit board 340 can be connected to connector 352 of main circuit board 400. Antenna region AA can be connected to main circuit board 400 through antenna circuit board 340.
[0090] The main circuit board 400 can be a rigid printed circuit board (PCB) that is rigid and not easily bent. The processor 410 and the antenna drive circuit 350 can be disposed on the main circuit board 400. The antenna circuit board 340 can be connected to the processor 410.
[0091] Antenna drive circuit 350 can be electrically connected to display panel 300 via antenna circuit board 340 and may include antennas ANT1 and ANT2 (see antenna drive circuit board 340). Figure 7 ) antenna ANT (see Figure 7 In some embodiments, antennas ANT1 and ANT2 are antenna elements of a multi-element antenna array, and each is at least used to receive reflected RF signals. In other embodiments, one of antennas ANT1 and ANT2 is used to transmit signals toward the user, and the other is used to receive reflected signals from the user.
[0092] To determine the coordinates of a user's touch input in 3D space, radar operation can be combined with beamforming and beam control (e.g., simultaneously with beamforming and beam control). In radar operation, RF signals can be transmitted from antennas ANT1 and / or ANT2 toward the user in free space, and the timing of the reflected signal from the user can be compared with the timing of the transmitted signal to determine the distance from the user's touch input (an image of an object in 3D space touched) to antennas ANT1 and ANT2. Here, "touch input" can be the user's fingertip reflecting RF energy or an object held by the user. Furthermore, using beamforming and beam control, the direction of the touch input with respect to antennas ANT1 and ANT2 can be determined to complete the determination of the touch input's coordinates. For this purpose, the phase (and / or amplitude) of the signal transmitted from antenna ANT1 can be adjusted with respect to the phase (and / or amplitude) of the same signal transmitted from antenna ANT2 to form a beam and direct the beam in the desired direction. Phase / amplitude adjustment can be performed by processor 410 by controlling antenna drive circuit 350 or mobile communication circuit (or module) 360 (in... Figure 20The phase shifter and / or amplitude adjuster (not shown) within the antenna are used for control. Therefore, when processor 410 controls the phase shifter and / or amplitude adjuster for beamforming and beam control, processor 410 can be described as “controlling the antenna.” Reflections at different beam positions can then be analyzed by processor 410. Among the reflections, those corresponding to reflections expected from a user with an extended finger or holding a signal reflection object (e.g., based on previous experiments) can then be detected to determine the orientation of the touch input in 3D space with respect to antennas ANT1 and ANT2. Thus, the touch coordinates can be ultimately determined based on the distance and orientation of the touch input with respect to antennas ANT1 and ANT2.
[0093] Accordingly, in the receiving path, the antenna driving circuit 350 can receive RF signals (interchangeably, electromagnetic wave signals) through antennas ANT1 and ANT2, and in the transmitting path, the antenna driving circuit 350 can output RF signals to be transmitted to free space through antennas ANT1 and ANT2. The antenna driving circuit 350 can be formed by an integrated circuit (IC).
[0094] Antenna drive circuit 350 can process RF signals transmitted and received through antennas ANT1 and ANT2. For example, antenna drive circuit 350 can use a low-noise amplifier and / or attenuator to change the amplitude of the RF signals received by antennas ANT1 and ANT2. Alternatively or additionally, in addition to the amplitude of the RF signals received by antennas ANT1 and ANT2, antenna drive circuit 350 can change the phase of the RF signals received by antennas ANT1 and ANT2. In the receiving path, antenna drive circuit 350 can route the processed RF signals to a mobile communication circuit (or module) 360 that can be connected to processor 410. Figure 20 (As shown in the diagram). The mobile communication circuit 360 may be disposed on the main circuit board 400 and may include, for example, circuitry in the transmission path for modulating and up-converting the baseband signal to an RF signal and in the reception path for demodulating and down-converting the RF signal to a baseband signal (an example of "signal information"). The mobile communication circuit 360 may further include an analog-to-digital (A / D) converter in the reception path to convert the baseband signal into digital data provided to the processor 410 for signal processing analysis (another example of "signal information").
[0095] In the transmission path, the antenna drive circuit 350 can use either of the power amplifiers controlled by the processor 410 and optionally a variable attenuator to change the amplitude of the RF signal transmitted from the mobile communication circuit 360. Alternatively or additionally, as described above, the antenna drive circuit 350 can change the phase of the RF signal transmitted from the mobile communication circuit 360. The antenna drive circuit 350 can send the processed RF signal to antennas ANT1 and ANT2. The antenna drive circuit 350 can be an RF front end that may further include filters, transmit / receive (T / R) switches, impedance matching circuitry, etc. Here, it should be noted that in some embodiments, another antenna (not shown) within the display device 10 can be used for transmission operations, instead of using antennas ANT1 and ANT2 for both transmission and reception.
[0096] Figure 5 This is a plan view of a display device 10 according to another embodiment. Figure 6 This is a plan view of a display device 10 according to yet another embodiment.
[0097] Figure 5 Implementation examples and Figure 1 and Figure 2 The difference in the embodiment is that the antenna region AA protrudes from the left side of the main region MA in the second direction (Y-axis direction). Figure 6 Implementation examples and Figure 1 and Figure 2 The difference in this embodiment is that the antenna region AA protrudes from the right side of the main region MA in a second direction (Y-axis direction). Figure 5 and Figure 6 In the middle, it will be omitted in Figure 1 and Figure 2 Redundant descriptions of parts already described in the embodiments.
[0098] like Figure 5 and Figure 6 As shown in the diagram, the antenna region AA can protrude from one side of the main region MA, and one side of the main region MA can be one of the upper side, lower side, left side, and right side of the main region MA.
[0099] In some embodiments, antenna region AA may protrude from the lower side of main region MA in a first direction (X-axis direction), and antenna region AA may be configured to be spaced apart from sub-region SBA in a second direction (Y-axis direction). In this case, the length of antenna region AA in the first direction (X-axis direction) may be less than the length of sub-region SBA in the first direction (X-axis direction), and the length of antenna region AA in the second direction (Y-axis direction) may be less than the length of sub-region SBA in the second direction (Y-axis direction), but the embodiments are not limited to this.
[0100] Figure 7 It is a diagram. Figure 1 A plan view of an example antenna region AA.
[0101] exist Figure 7 In the diagram, the dashed line 700 is an imaginary boundary line dividing the antenna region AA and the invalid space region DS, which is at least a part of the non-display region NDA. In the illustrated example, the area above the dashed line 700 represents a part of the antenna region AA, and the area below the dashed line 700 represents a part of the invalid space region DS.
[0102] According to an embodiment, the display device 10 includes an antenna ANT comprising a first antenna ANT1 and a second antenna ANT2. As previously described, the first antenna ANT1 and the second antenna ANT2 may be antenna elements of a binary or higher-element array that can be driven by variable correlation phase / amplitude to generate a controllable beam. The controllable beam can be used to more accurately detect the coordinates of a user's touch input in 3D space.
[0103] The first antenna ANT1 can be positioned on the boundary between the antenna region AA and the invalid space region DS, and can be connected to the first feed line FL1, the first ground line GND1, and the second ground line GND2 formed in the antenna region AA. The first feed line FL1 can be positioned between the first ground line GND1 and the second ground line GND2, and therefore can have a grounded coplanar waveguide (GCPW) structure. Alternatively, the first feed line FL1 can have a coplanar waveguide (CPW) structure.
[0104] The extension direction of each of the first feed line FL1, the first ground line GND1, and the second ground line GND2 may be the same as the extension direction of the antenna region AA, and they may be electrically connected to the antenna pad APD (see...). Figure 1 For example, each of the first feed line FL1, the first ground line GND1, and the second ground line GND2 can extend in a first direction (X-axis direction), and their respective ends can be connected to the first antenna ANT1.
[0105] Reference Figure 7 The first antenna ANT1 can be configured to extend from a portion of the invalid space region DS to a portion of the antenna region AA. For example, a portion of the first antenna ANT1 can be located in the antenna region AA adjacent to the invalid space region DS, and the remaining portion of the first antenna ANT1 can be located in the invalid space region DS adjacent to the antenna region AA. However, the area where the first antenna ANT1 is configured is not limited to... Figure 7Examples. For instance, the first antenna ANT1 can be positioned in the inactive space region DS adjacent to the antenna region AA. Alternatively, although not shown, the first antenna ANT1 can be positioned in the portion of the antenna region AA adjacent to the inactive space region DS.
[0106] The width of the first antenna ANT1 can be designed to be equal to or less than half a wavelength length (e.g., equal to or less than approximately 4.8 mm) for approximately 28 GHz, and the optimization of the resonant point for the structure at approximately 28 GHz can be achieved by tuning the antenna electrode AE of the first antenna ANT1 (see...). Figure 9 Adjust the width or length of the instrument.
[0107] The first antenna ANT1 can have a half-wavelength slot antenna structure, and can generate a field parallel to the first direction (X-axis direction) through an LC parallel structure or a ring structure at its two ends in the second direction (Y-axis direction). The first antenna ANT1 can have an antenna structure symmetrical with respect to the first feed line FL1.
[0108] The second antenna ANT2 can be located in the inactive space region DS adjacent to the antenna region AA, and can be connected to the second feed line FL2, the third ground line GND3, and the fourth ground line GND4 formed in the antenna region AA. The second feed line FL2 can be located between the third ground line GND3 and the fourth ground line GND4, and therefore can have a grounded coplanar waveguide (GCPW) structure. Alternatively, the second feed line FL2 can have a coplanar waveguide (CPW) structure.
[0109] The extension direction of each of the second feed line FL2, the third ground line GND3, and the fourth ground line GND4 can be the same as the extension direction of the antenna region AA, and they can be electrically connected to the antenna pad APD (see...). Figure 1 For example, each of the second feeder FL2, the third grounding wire GND3, and the fourth grounding wire GND4 can extend in the first direction (X-axis direction), and their respective ends can be connected to the second feeder ANT2.
[0110] Reference Figure 7 The second antenna ANT2 can be located in the invalid space region DS adjacent to the antenna region AA, but the region where the second antenna ANT2 is located is not limited to the example shown in the figure. For example, the second antenna ANT2 can be located in the part of the antenna region AA adjacent to the invalid space region DS.
[0111] The second antenna ANT2 may have a modified dipole antenna structure folded within the same length as the polarization structure of the first antenna ANT1. The second antenna ANT2 may have an asymmetrical antenna structure relative to the second feed line FL2 to generate a field in a second direction (Y-axis direction) perpendicular to the first direction (X-axis direction).
[0112] This disclosure refers to Figure 7 The description describes a first antenna ANT1 and a second antenna ANT2 disposed in the non-display area NDA of the display panel 300, but the antennas of the display panel 300 are not limited thereto. For example, the shape of the antennas of the display panel 300 is not limited, and it is configured to sense RF signals reflected by an object (body). The antennas of the display panel 300 are configured to sense information such as the distance to the object (body) and its speed and direction of movement. For example, the antennas can be used to realize radar-based measurements of the position of a user's finger or a signal-reflecting object held by the user, wherein radar signals are transmitted from the antenna ANT and signals reflected from the user's finger or object are received by the antenna ANT and provided to the processor 410.
[0113] Figure 8 This is a cross-sectional view of a portion of the display area DA of the display device 10 according to an embodiment. For example, Figure 8 It can be a reference Figure 1 to Figure 6 A cross-sectional view of a portion of the described display panel 300.
[0114] Reference Figure 8 The display panel 300 may include a substrate SUB. A display layer DISL having a thin-film transistor layer (TFTL), a light-emitting element layer (EML), an encapsulation layer (ENC), and a sensor electrode layer (SENL) may be disposed on one surface of the substrate SUB. The encapsulation layer (ENC) may be disposed on the light-emitting element layer (EML) of the display layer DISL, and the sensor electrode layer (SENL) having sensor electrodes (SE) may be disposed on the encapsulation layer (ENC). A polarizing film (PF) may be disposed on the sensor electrode layer (SENL), and a cover window (CW) may be disposed on the polarizing film (PF).
[0115] The substrate SUB may include a support substrate SSUB, a first substrate SUB1, a first buffer film BF1, a second substrate SUB2, and a second buffer film BF2. The first substrate SUB1 may be disposed on the support substrate SSUB, the first buffer film BF1 may be disposed on the first substrate SUB1, the second substrate SUB2 may be disposed on the first buffer film BF1, and the second buffer film BF2 may be disposed on the second substrate SUB2.
[0116] The support substrate SSUB can be a rigid substrate used to support the flexible first substrate SUB1 and second substrate SUB2. The support substrate SSUB can be formed of glass or plastic materials such as polycarbonate (PC) and polyethylene terephthalate (PET).
[0117] The first substrate SUB1 and the second substrate SUB2 can be formed from organic materials such as acryloyl resin, epoxy resin, phenolic resin, polyamide resin, and polyimide resin. The first substrate SUB1 and the second substrate SUB2 can be formed from the same organic material or different organic materials.
[0118] Each of the first buffer film BF1 and the second buffer film BF2 may be formed of an inorganic material such as a silicon nitride layer, a silicon oxynitride layer, a silicon oxide layer, a titanium oxide layer, and an aluminum oxide layer. Alternatively, each of the first buffer film BF1 and the second buffer film BF2 may be formed of a multilayer wherein multiple layers of silicon nitride, silicon oxynitride, silicon oxide, titanium oxide, and aluminum oxide layers are alternately stacked. The first buffer film BF1 and the second buffer film BF2 may be formed of the same inorganic material or different inorganic materials.
[0119] An active layer ACT comprising the channel region TCH, source region TS, and drain region TD of a thin-film transistor (TFT) can be disposed on a second buffer film BF2. The active layer ACT can comprise polycrystalline silicon (e.g., low-temperature polycrystalline silicon), monocrystalline silicon, amorphous silicon, or oxide semiconductor materials. When the active layer ACT comprises polycrystalline silicon or oxide semiconductor materials, the source region TS and drain region TD of the active layer ACT can be conductive regions doped with ions and possessing conductivity.
[0120] The gate insulating film 130 can be formed on the active layer ACT of the thin-film transistor TFT. The gate insulating film 130 can be formed from an inorganic film, such as a silicon nitride layer, a silicon oxynitride layer, a silicon oxide layer, a titanium oxide layer, or an aluminum oxide layer.
[0121] The first capacitor electrode CAE1 and the gate electrode TG of the thin-film transistor (TFT) can be disposed on the gate insulating film 130. The gate electrode TG of the TFT can overlap with the channel region TCH in the third direction (Z-axis direction). The gate electrode TG and the first capacitor electrode CAE1 can be formed from a single layer or multiple layers made of any one of molybdenum (Mo), aluminum (Al), chromium (Cr), gold (Au), titanium (Ti), nickel (Ni), neodymium (Nd), and copper (Cu) or their alloys.
[0122] The first interlayer insulating film 141 can be disposed on the gate electrode TG and the first capacitor electrode CAE1. The first interlayer insulating film 141 can be formed of an inorganic film, such as a silicon nitride layer, a silicon oxynitride layer, a silicon oxide layer, a titanium oxide layer, or an aluminum oxide layer. The first interlayer insulating film 141 may include multiple inorganic films.
[0123] The second capacitor electrode CAE2 can be disposed on the first interlayer insulating film 141. The second capacitor electrode CAE2 can overlap with the first capacitor electrode CAE1 in the third direction (Z-axis direction). Therefore, the capacitor Cst can be formed by the first capacitor electrode CAE1 and the second capacitor electrode CAE2. An inorganic insulating dielectric layer is disposed between the first capacitor electrode CAE1 and the second capacitor electrode CAE2 to act as a dielectric layer. The second capacitor electrode CAE2 can be formed from a single layer or multiple layers made of any one of molybdenum (Mo), aluminum (Al), chromium (Cr), gold (Au), titanium (Ti), nickel (Ni), neodymium (Nd), and copper (Cu) or their alloys.
[0124] The second interlayer insulating film 142 can be disposed on the second capacitor electrode CAE2. The second interlayer insulating film 142 can be formed of an inorganic film, such as a silicon nitride layer, a silicon oxynitride layer, a silicon oxide layer, a titanium oxide layer, or an aluminum oxide layer. The second interlayer insulating film 142 may include multiple inorganic films.
[0125] The first connecting electrode CE1 can be disposed on the second interlayer insulating film 142. The first connecting electrode CE1 can be connected to the drain region TD through the first contact hole CT1 penetrating the gate insulating film 130, the first interlayer insulating film 141, and the second interlayer insulating film 142. The first connecting electrode CE1 can be formed from a single layer or multiple layers made of any one of molybdenum (Mo), aluminum (Al), chromium (Cr), gold (Au), titanium (Ti), nickel (Ni), neodymium (Nd), and copper (Cu) or their alloys.
[0126] The first organic film 160 can be disposed on the first connection electrode CE1 to flatten the stepped portion formed by the thin-film transistor TFT. The first organic film 160 can be formed of an organic film such as acrylic resin, epoxy resin, phenolic resin, polyamide resin, and polyimide resin.
[0127] The second connecting electrode CE2 can be disposed on the first organic film 160. The second connecting electrode CE2 can be connected to the first connecting electrode CE1 through the second contact hole CT2 penetrating the first organic film 160. The second connecting electrode CE2 can be formed of a single layer or multiple layers made of any one of molybdenum (Mo), aluminum (Al), chromium (Cr), gold (Au), titanium (Ti), nickel (Ni), neodymium (Nd) and copper (Cu) or their alloys.
[0128] The second organic film 180 can be disposed on the second connecting electrode CE2. The second organic film 180 can be formed of an organic film such as acryloyl resin, epoxy resin, phenolic resin, polyamide resin and polyimide resin.
[0129] The light-emitting element layer (EML) is disposed on the thin-film transistor layer (TFTL). The light-emitting element layer (EML) may include a light-emitting element (LEL) and a diaphragm (190).
[0130] Each of the light-emitting elements (LELs) may include a pixel electrode 171, a light-emitting layer 172, and a common electrode 173. Each of the emitting regions represents a region in which the pixel electrode 171, the light-emitting layer 172, and the common electrode 173 are sequentially stacked, and holes from the pixel electrode 171 and electrons from the common electrode 173 recombine with each other in the light-emitting layer 172 to emit light. In this case, the pixel electrode 171 may be an anode electrode, and the common electrode 173 may be a cathode electrode.
[0131] Pixel electrode 171 can be formed on the second organic film 180. Pixel electrode 171 can be connected to the second connection electrode CE2 through a third contact hole CT3 penetrating the second organic film 180.
[0132] In the top-emitting structure that emits light toward the common electrode 173 relative to the light-emitting layer 172, the pixel electrode 171 can be formed as a single layer of molybdenum (Mo), titanium (Ti), copper (Cu), or aluminum (Al), or it can be formed as a stacked structure of aluminum and titanium (Ti / Al / Ti), a stacked structure of aluminum and ITO (ITO / Al / ITO), an APC alloy, or a stacked structure of APC alloy and ITO (ITO / APC / ITO) to increase reflectivity. The APC alloy is an alloy of silver (Ag), palladium (Pd), and copper (Cu).
[0133] The dam 190 is used to define the emission area of the display pixel. For this purpose, the dam 190 can be formed as a portion exposing the pixel electrode 171 on the second organic film 180. The dam 190 can cover the edge of the pixel electrode 171. The dam 190 can be disposed in a contact hole penetrating the second organic film 180. Therefore, the third contact hole CT3 penetrating the second organic film 180 can be filled with the dam 190. The dam 190 can be formed of an organic film such as acrylic resin, epoxy resin, phenolic resin, polyamide resin, and polyimide resin.
[0134] Spacer 191 may be disposed on dam 190. Spacer 191 may be used to support the mask during the process of manufacturing the light-emitting layer 172. Spacer 191 may be formed of an organic film such as acrylic resin, epoxy resin, phenolic resin, polyamide resin, and polyimide resin.
[0135] A light-emitting layer 172 is formed on the pixel electrode 171. The light-emitting layer 172 may include an organic material for emitting light of a selected color. For example, the light-emitting layer 172 may include a hole transport layer, an organic material layer, and an electron transport layer. The organic material layer may include a host and a dopant. The organic material layer may include a material that emits selected light and may be formed using phosphorescent or fluorescent materials.
[0136] For example, the organic material layer of the luminescent layer 172 in the first emitting region emitting light of the first color can be a phosphorescent material comprising a host material and a dopant. The host material includes carbazole biphenyl (CBP) or mCP (1,3-bis(carbazole-9-yl)benzene), and the dopant includes at least one selected from the group consisting of PIQIr(acac) (bis(1-phenylisoquinoline)acetylacetone iridium), PQIr(acac) (bis(1-phenylquinoline)acetylacetone iridium), PQIr (tris(1-phenylquinoline)iridium), and PtOEP (octaethylporphyrin platinum). Alternatively, the organic material layer of the luminescent layer 172 in the first emitting region can be a fluorescent material comprising PBD:Eu(DBM)3(Phen) or perylene, but this disclosure is not limited thereto.
[0137] The organic material layer of the luminescent layer 172 in the fourth and second emission regions emitting the second color light can be a phosphorescent material comprising a host material containing CBP or mCP and a dopant material containing Ir(ppy)3 (planar tris(2-phenylpyridine)iridium). Alternatively, the organic material layer of the luminescent layer 172 in the fourth and second emission regions emitting the second color light can be a fluorescent material comprising tris(8-hydroxyquinoline)aluminum (Alq3), but this disclosure is not limited thereto.
[0138] The organic material layer of the luminescent layer 172 in the third emitting region that emits light of the third color can be a phosphorescent material comprising a host material containing CBP or mCP and a dopant material containing (4,6-F2ppy)2Irpic or L2BD111, but this disclosure is not limited thereto.
[0139] A common electrode 173 is formed on the light-emitting layer 172. The common electrode 173 may be formed to cover the light-emitting layer 172. The common electrode 173 may be a common layer formed in the emission region. A capping layer may be formed on the common electrode 173.
[0140] In the top-emitting structure, the common electrode 173 can be formed of a transparent conductive material (TCO) such as ITO or IZO, or a semi-transparent conductive material such as magnesium (Mg), silver (Ag), or an alloy of magnesium (Mg) and silver (Ag). When the common electrode 173 is formed of a semi-transparent conductive material, the luminous efficiency can be increased due to the microcavity effect.
[0141] An encapsulation layer ENC can be formed on the light-emitting element layer EML. The encapsulation layer ENC may include at least one inorganic film for preventing oxygen or moisture from penetrating into the light-emitting element layer EML. Additionally, the encapsulation layer ENC may include at least one organic film for protecting the light-emitting element layer EML from foreign matter such as dust. For example, the encapsulation layer ENC may include a first encapsulation inorganic film TFE1, an encapsulation organic film TFE2, and a second encapsulation inorganic film TFE3.
[0142] A first encapsulating inorganic film TFE1 can be disposed on the common electrode 173, an encapsulating organic film TFE2 can be disposed on the first encapsulating inorganic film TFE1, and a second encapsulating inorganic film TFE3 can be disposed on the encapsulating organic film TFE2. The first encapsulating inorganic film TFE1 and the second encapsulating inorganic film TFE3 can be formed from a single inorganic film including one of a silicon nitride layer, a silicon oxynitride layer, a silicon oxide layer, a titanium oxide layer, and an aluminum oxide layer, or from a multi-film structure in which multiple inorganic films of the silicon nitride layer, silicon oxynitride layer, silicon oxide layer, titanium oxide layer, and aluminum oxide layer are alternately stacked. The encapsulating organic film TFE2 can be an organic film such as an acrylamide resin, epoxy resin, phenolic resin, polyamide resin, or polyimide resin.
[0143] The sensor electrode layer SENL is disposed on the encapsulation layer ENC. The sensor electrode layer SENL may include sensor electrodes SE.
[0144] The third buffer film BF3 can be disposed on the encapsulation layer ENC. The third buffer film BF3 can be a layer with both insulating and optical functions. The third buffer film BF3 may include at least one inorganic film. For example, the third buffer film BF3 can be formed as a single layer of an inorganic film including one of a silicon nitride layer, a silicon oxynitride layer, a silicon oxide layer, a titanium oxide layer, and an aluminum oxide layer, or as a multilayer wherein multiple inorganic films of the silicon nitride layer, silicon oxynitride layer, silicon oxide layer, titanium oxide layer, and aluminum oxide layer are alternately stacked. The third buffer film BF3 can be formed by lamination using flexible materials, spin coating using solution-based materials, die coating, or deposition. The third buffer film BF3 can be omitted.
[0145] The first connecting portion BE1 can be disposed on the third buffer film BF3. The first connecting portion BE1 can be formed from a single layer containing molybdenum (Mo), titanium (Ti), copper (Cu) or aluminum (Al), or it can be formed as a stacked structure of aluminum and titanium (Ti / Al / Ti), a stacked structure of aluminum and indium tin oxide (ITO) (ITO / Al / ITO), an Ag-Pd-Cu (APC) alloy, or a stacked structure of APC alloy and ITO (ITO / APC / ITO).
[0146] The first sensor insulating film TINS1 can be disposed on the first connection portion BE1. The first sensor insulating film TINS1 can be a layer with insulating and optical functions. The first sensor insulating film TINS1 can be formed from an inorganic film, such as a silicon nitride layer, a silicon oxynitride layer, a silicon oxide layer, a titanium oxide layer, or an aluminum oxide layer. The first sensor insulating film TINS1 can be formed by a lamination process using flexible materials, a spin coating process using solution-based materials, a die coating process, or a deposition process.
[0147] The sensor electrode SE (i.e., the driving electrode TE and the sensing electrode RE) can be disposed on the first sensor insulating film TINS1. Additionally, a dummy pattern (not shown) can be disposed on the first sensor insulating film TINS1. The driving electrode TE, the sensing electrode RE, and the dummy pattern (not shown) do not overlap with the emission region. The driving electrode TE, the sensing electrode RE, and the dummy pattern (not shown) can be formed from a single layer comprising molybdenum (Mo), titanium (Ti), copper (Cu), or aluminum (Al), or can be formed as a stacked structure of aluminum and titanium (Ti / Al / Ti), a stacked structure of aluminum and indium tin oxide (ITO) (ITO / Al / ITO), an Ag-Pd-Cu (APC) alloy, or a stacked structure of APC alloy and ITO (ITO / APC / ITO).
[0148] The second sensor insulating film TINS2 can be disposed on the driving electrode TE, the sensing electrode RE, and the dummy pattern (not shown). The second sensor insulating film TINS2 can be a layer with both insulating and optical functions. The second sensor insulating film TINS2 can include at least one of inorganic and organic films. The inorganic film can be a silicon nitride layer, a silicon oxynitride layer, a silicon oxide layer, a titanium oxide layer, or an aluminum oxide layer. The organic film can include an acrylamide resin, an epoxy resin, a phenolic resin, a polyamide resin, or a polyimide resin. The second sensor insulating film TINS2 can be formed by a lamination process using flexible materials, a spin coating process using solution-based materials, a die-casting process, or a deposition process.
[0149] Panel bottom cover PB (see) Figure 3 The heat dissipation layer HSL can be disposed on the bottom surface of the support substrate SSUB of the substrate SUB. The heat dissipation layer HSL can be formed of a thin metal film such as copper, nickel, ferrite or silver that can shield electromagnetic waves and has excellent thermal conductivity.
[0150] Figure 9 This is a cross-sectional view of the boundary between the antenna region AA and the adjacent non-display region NDA of the display device 10 according to an embodiment.
[0151] Reference Figure 9The dam DAM surrounding the display area DA can be disposed in the non-display area NDA of the display panel 300. The dam DAM may include a first dam DAM1 and a second dam DAM2 disposed outward from the first dam DAM1. The first dam DAM1 and the second dam DAM2 can be disposed on the second interlayer insulating film 142.
[0152] The first dam DAM1 may include a first sub-dam SDAM1, a second sub-dam SDAM2, and a third sub-dam SDAM3 stacked sequentially. The first sub-dam SDAM1 may be formed of the same material as the first organic membrane 160, the second sub-dam SDAM2 may be formed of the same material as the second organic membrane 180, and the third sub-dam SDAM3 may be formed of the same material as the dike 190.
[0153] The second dam DAM2 may comprise a first sub-dam SDAM1, a second sub-dam SDAM2, a third sub-dam SDAM3, and a fourth sub-dam SDAM4, stacked sequentially. The first sub-dam SDAM1 may be formed of the same material as the first organic membrane 160, and the second sub-dam SDAM2 may be formed of the same material as the second organic membrane 180. The third sub-dam SDAM3 may be formed of the same material as the dike 190, and the fourth sub-dam SDAM4 may be formed of the same material as the spacer 191 (see...). Figure 8 They are formed from the same material.
[0154] Reference Figure 9 The antenna electrode AE may include the first antenna electrode layers AEL1 to the eighth antenna electrode layers AEL8. However, embodiments of this disclosure are not limited thereto, and the antenna electrode AE may include only some of the antenna electrode layers from the first antenna electrode layers AEL1 to the eighth antenna electrode layers AEL8.
[0155] The first antenna electrode layer AEL1 can be connected to a thin-film transistor TFT (see...). Figure 8 The gate electrode TG (see) Figure 8 ) and the first capacitor electrode CAE1 (see Figure 8 They are made of the same materials and formed using the same process.
[0156] The second antenna electrode layer AEL2 can be disposed on the first antenna electrode layer AEL1 that is exposed and not covered by the first interlayer insulating film 141. The second antenna electrode layer AEL2 can be disposed on the second capacitor electrode CAE2 (see Figure 8 They are made of the same materials and formed using the same process.
[0157] The third antenna electrode layer AEL3 can be disposed on the exposed second antenna electrode layer AEL2 that is not covered by the second interlayer insulating film 142. The third antenna electrode layer AEL3 can be connected to the first connecting electrode CE1 (see... Figure 8They are made of the same materials and formed using the same process.
[0158] The fourth antenna electrode layer AEL4 can be disposed on the third antenna electrode layer AEL3. The fourth antenna electrode layer AEL4 can be connected to the second connecting electrode CE2 (see...). Figure 8 They are made of the same materials and formed using the same process.
[0159] The fifth antenna electrode layer AEL5 can be disposed on the fourth antenna electrode layer AEL4. The fifth antenna electrode layer AEL5 can be connected to the pixel electrode 171 (see...). Figure 8 They are made of the same materials and formed using the same process.
[0160] The sixth antenna electrode layer AEL6 can be disposed on the fifth antenna electrode layer AEL5. The sixth antenna electrode layer AEL6 can be connected to the common electrode 173 (see...). Figure 8 They are made of the same materials and formed using the same process.
[0161] The seventh antenna electrode layer AEL7 can be disposed on the sixth antenna electrode layer AEL6. The seventh antenna electrode layer AEL7 can be connected to the first connection portion BE1 of the sensor electrode layer SENL (see...). Figure 8 They are made of the same materials and formed using the same process.
[0162] The eighth antenna electrode layer AEL8 can be disposed on the seventh antenna electrode layer AEL7. The eighth antenna electrode layer AEL8 can be connected to the driving electrode TE of the sensor electrode layer SENL (see...). Figure 8 ), sensing electrode RE (see Figure 8 The dummy pattern (not shown) and / or the dummy pattern are made of the same material and formed by the same process.
[0163] The through-hole CT can pass through the first substrate SUB1, the first buffer film BF1, the second substrate SUB2, and the second buffer film BF2 of the substrate SUB. In addition, the through-hole CT can pass through the gate insulating film 130.
[0164] The antenna electrode AE can contact the feed line FL through the through-hole CT. Here, the feed line FL can mean the reference line. Figure 7 The first feeder FL1 or the second feeder FL2 is described.
[0165] The antenna pad APD, electrically connected to the feed line FL, can be located at the end of the feed line FL. The feed line FL and the antenna pad APD can be located on the bottom surface of the first substrate SUB1 of the substrate SUB. Since the antenna region AA is bent and located below the main region MA, the supporting substrate SSUB of the substrate SUB can be removed from the antenna region AA where the feed line FL is located.
[0166] The antenna pad APD can be attached to the antenna circuit board 340 using an anisotropic conductive film (ACF) that includes conductive balls CB and conductive adhesive components CAM such as anisotropic conductive adhesive.
[0167] Figure 10 This is a diagram illustrating an example in which the display device 800 according to an embodiment is implemented as a non-glasses light field display (LFD).
[0168] LFD creates 3D images 801 on a three-dimensional (3D) display by generating a light field, represented as the vector distribution (intensity and direction) of light in space, using a flat panel display and optical elements. In this context, the light field refers to the five dimensions (x, y, z, θ, and y) representing the direction and intensity of light at all points in 3D space: vector functions, electric field, magnetic field, and the direction and intensity of light at all points in 3D space. It is a kind of light field similar to the concept of light.
[0169] Unlike two-dimensional (2D) displays, light field displays represent different information depending on the viewing direction. Light field displays allow users to view the depth (i.e., the depth position within a 3D image) and sides of an object, resulting in more natural 3D images and enabling applications such as augmented reality (AR) technology.
[0170] Light fields can be realized in various ways. For example, light fields can be generated in multiple directions using multiple projectors, controlled by using diffraction gratings, controlled by using two or more panels to control the direction and intensity (brightness) of light based on a combination of pixels, controlled by using pinholes or barriers, and controlled by using microlens arrays to control the direction of light refraction.
[0171] According to an embodiment, the display device 800 implemented as a non-glasses type LFD may include, for example, antennas ANT1 and ANT2 as previously described (see... Figure 7 The antenna ANT in the non-display area NDA (see) Figure 1 The antenna ANT within the object (body) senses RF signals reflected by the object (body). Here, the antenna ANT can be configured to use radar techniques, including beamforming and beam control as described above, to sense information such as the distance to the object (body) and its speed and direction of movement.
[0172] Figure 11 This is a diagram illustrating an example in which the display device 900 according to an embodiment is implemented as a stereoscopic display.
[0173] Reference Figure 11 The display device 900 according to the embodiment can be implemented as a variable focal length stereoscopic display.
[0174] Stereoscopic displays are a technology that uses stereo pixels (voxels) to create images directly in 3D space. A stereo pixel (voxel) is a spatially located pixel used to create 3D images in physical 3D space. Stereoscopic displays include screen motion type, plasma emission type, variable focal length type, and particle trap type, among others.
[0175] The screen motion type rotates or reciprocates the screen at high speed and continuously projects cross-sectional images of 3D objects synchronized with the movement speed, thereby allowing users to view 3D images through the resulting afterimage effect.
[0176] Plasma emission focuses a high-power laser onto a point in space, ionizing the surrounding air to generate light, and creates a 3D image by scanning multiple emitting points in the tissue space at high speed.
[0177] Variable focal length lenses create 3D images by rapidly changing the focal length of the image through a variable focal length lens to form voxels focused at different locations in space.
[0178] Particle traps are based on the photophoretic trapping effect of lasers, which use lasers to capture and move very light and small particles. External light is then irradiated according to the movement of the particles to scatter the light, and a 3D image is created in space through the afterimage effect of the scattered light.
[0179] Display device 900 is a stereoscopic display that uses a 3D holographic method to project light into space. The 3D holographic method creates a three-dimensional light flow by projecting light into real space. The stereoscopic display allows user 904 (or viewer) to observe objects from any viewpoint regardless of user 904's (or viewer's) movement.
[0180] Holography creates 3D images through the interference of light, and these images can be created digitally. Digital methods reproduce 3D images by creating interference patterns through mathematical calculations and processing and recording them as data.
[0181] Digital holographic displays use coherent light sources to create 3D images of images recorded in real time on the display. Coherence is the property of light to travel like long lines. Fluorescent lamps, incandescent lamps, and LED lamps do not have coherence; they have the property that light travels like short lines in all directions.
[0182] Holography performed by display device 900 creates images based on the principle of light rays intersecting and "interfering" with each other. Bright light "points" are created at the locations where the light rays "constructively interfere." When thousands of these "points" are arranged into the desired image pattern, a 3D image floating in space is created. The points of light created by such "interference" can be considered to function as pixels.
[0183] In order for the display device 900 to create a 3D image 903 (or a reconstructed image in 3D space), a specified pattern is displayed on the panel 901 (or display panel), and light from the backlight 902 is allowed to pass through the pattern. The specified pattern can be created by first determining the 3D image to be created by the display device 900 and then calculating the 3D image in reverse based on mathematical principles.
[0184] According to an embodiment, the display device 900, implemented as a variable focal length stereoscopic display, includes an antenna ANT (not in the image) for sensing RF signals reflected by an object (body). Figure 11 As shown in the image, see Figure 7 Here, the antenna ANT is configured to sense information such as the distance to an object (body) and its speed and direction of movement. The antenna ANT may include the previously described antennas ANT1 and ANT2 (see...). Figure 7 ).
[0185] Figure 12 This is a perspective view of a head-mounted display 1000 according to an embodiment. Figure 13 It is a diagram. Figure 12 An exploded perspective view of an example of a head-mounted display 1000.
[0186] Reference Figure 12 and Figure 13 According to an embodiment, the head-mounted display 1000 includes a first display device 10_1, a second display device 10_2, a display device housing 1100, a housing cover 1200, a first eyepiece 1210, a second eyepiece 1220, a head mounting strap 1300, a middle frame 1400, a first optical component 1510, a second optical component 1520, and a control circuit board 1600.
[0187] The first display device 10_1 provides an image to the user's left eye, and the second display device 10_2 provides an image to the user's right eye. Each of the first display device 10_1 and the second display device 10_2 can be combined with... Figure 1 to Figure 6 The descriptions of the display devices 10 are substantially the same, and the descriptions of the first display device 10_1 and the second display device 10_2 will be omitted.
[0188] The first optical component 1510 may be disposed between the first display device 10_1 and the first eyepiece 1210. The second optical component 1520 may be disposed between the second display device 10_2 and the second eyepiece 1220. Each of the first optical component 1510 and the second optical component 1520 may include at least one convex lens.
[0189] The intermediate frame 1400 can be disposed between the first display device 10_1 and the control circuit board 1600, and between the second display device 10_2 and the control circuit board 1600. The intermediate frame 1400 is used to support and fix the first display device 10_1, the second display device 10_2, and the control circuit board 1600.
[0190] The control circuit board 1600 can be disposed between the intermediate frame 1400 and the display device housing 1100. The control circuit board 1600 can be connected to the first display device 10_1 and the second display device 10_2 via connectors. The control circuit board 1600 can convert externally input image sources into digital video data and transmit the digital video data to the first display device 10_1 and the second display device 10_2 via connectors.
[0191] The control circuit board 1600 can transmit digital video data corresponding to a left-eye image optimized for the user's left eye to the first display device 10_1, and can transmit digital video data corresponding to a right-eye image optimized for the user's right eye to the second display device 10_2. Alternatively, the control circuit board 1600 can transmit the same digital video data to both the first display device 10_1 and the second display device 10_2.
[0192] The display device housing 1100 is used to house the first display device 10_1, the second display device 10_2, the intermediate frame 1400, the first optical component 1510, the second optical component 1520, and the control circuit board 1600. The housing cover 1200 is configured to cover an open surface of the display device housing 1100. The housing cover 1200 may include a first eyepiece 1210 for the user's left eye and a second eyepiece 1220 for the user's right eye. Figure 12 and Figure 13 The illustration shows the first eyepiece 1210 and the second eyepiece 1220 being configured separately, but the embodiments of this disclosure are not limited thereto. The first eyepiece 1210 and the second eyepiece 1220 may be combined into one.
[0193] The first eyepiece 1210 can be aligned with the first display device 10_1 and the first optical component 1510, and the second eyepiece 1220 can be aligned with the second display device 10_2 and the second optical component 1520. Therefore, the user can view the image of the first display device 10_1 magnified into a virtual image by the first optical component 1510 through the first eyepiece 1210, and view the image of the second display device 10_2 magnified into a virtual image by the second optical component 1520 through the second eyepiece 1220.
[0194] A head-mounted strap 1300 is used to secure the display device housing 1100 to the user's head, such that the first eyepiece 1210 and the second eyepiece 1220 of the housing cover 1200 are positioned over the user's left and right eyes, respectively. When the display device housing 1100 is made lightweight and compact, the head-mounted display 1000 can provide, for example, a lightweight and compact design. Figure 14 The eyeglasses frame shown is not the headband 1300.
[0195] Additionally, the head-mounted display 1000 may further include a battery for power supply, an external memory slot for accommodating external memory, and an external connection port and a wireless communication module for receiving image sources. The external connection port may be a Universal Serial Bus (USB) terminal, a display port, or a High Definition Multimedia Interface (HDMI) terminal, and the wireless communication module may be a 5G communication module, a 4G communication module, a Wi-Fi module, or a Bluetooth module.
[0196] Figure 14 This is a perspective view of a head-mounted display 1000_1 according to an embodiment.
[0197] Reference Figure 14 The head-mounted display 1000_1 according to an embodiment may be an eyeglass-type display in which the display device housing 1200_1 is implemented in a lightweight and compact manner. The head-mounted display 1000_1 according to an embodiment may include a display device 10_3, a left eye lens 1010, a right eye lens 1020, a support frame 1030, temples 1040 and 1050, an optical component 1060, an optical path changing component 1070, and a display device housing 1200_1.
[0198] The display device housing 1200_1 may include a display device 10_3, an optical component 1060, and a light path changing component 1070. The image displayed on the display device 10_3 can be magnified by the optical component 1060 and, after its light path is changed by the light path changing component 1070, provided to the user's right eye via the right eye lens 1020. As a result, the user can view an augmented reality image through their right eye, which combines a virtual image displayed on the display device 10_3 with a real image viewed through the right eye lens 1020.
[0199] Figure 14The illustration shows the display device housing 1200_1 located at the right end of the support frame 1030, but this disclosure is not limited thereto. For example, the display device housing 1200_1 may be located at the left end of the support frame 1030, and in this case, the image displayed on the display device 10_3 can be provided to the user's left eye. Alternatively, the display device housing 1200_1 may be located at both the left and right ends of the support frame 1030, and in this case, the user can view the image displayed on the display device 10_3 through both the left and right eyes.
[0200] According to an embodiment, as indicated by reference numeral 1801, the head-mounted display 1000_1 may have an antenna disposed on a portion of the eyeglass frame surrounding lenses 1010 and 1020 (e.g., one side of the support frame 1030).
[0201] According to an embodiment, as indicated by reference numeral 1802, the head-mounted display 1000_1 may have an antenna disposed on a portion of lenses 1010 and 1020.
[0202] According to an embodiment, as indicated by reference numeral 1803, the head-mounted display 1000_1 may have an antenna disposed near the center of the support frame 1030.
[0203] According to an embodiment, as indicated by reference numeral 1804, the head-mounted display 1000_1 may have an antenna inside the display device housing 1200_1.
[0204] According to an embodiment, the head-mounted display 1000_1 may have an antenna disposed at a location indicated by reference numerals 1801, 1802, 1803, and 1804, and the antenna is allowed to sense RF signals reflected by an object (body). The antenna of the head-mounted display 1000_1 is configured to sense information such as the distance to the object (body) and its speed and direction of movement.
[0205] Although not shown, the antenna may be an attachable antenna built into the display device 10_3. In this case, the antenna may be made of general metal and transparent metal, or it may be constructed as a transparent printed circuit board (PCB) for performing antenna operation.
[0206] According to an embodiment, the antenna can be implemented as a printed part on a lens. In this case, the antenna can be made of transparent metal as well as general metal.
[0207] Figure 15 This is an illustration showing an example of a holographic display in which the display device 1900 according to an embodiment is an example.
[0208] Reference Figure 15The display device 1900 according to the embodiment can be implemented as a holographic display.
[0209] Holography is a technique that creates images by reproducing wavefronts using the diffraction effect of light, and it can be divided into analog holography and digital holography.
[0210] Analog holography splits light into two paths and then records the pattern generated by the interference between the object light, which is directly incident on and reflected from the object, and the reference light, reflected from a mirror, onto a photographic plate with a photosensitive material. When the same reference light is incident on the photographic plate on which the interference pattern is recorded, an image of the object is reconstructed, allowing the user to view the holographic image. Since the light used in analog holography needs to cause interference, it can be a laser beam with coherence (the property that interference can occur at the same frequency and with a constant phase difference).
[0211] Because digital holography uses computers to recreate images, it can also be called computer-generated holography (CGH). Digital holography creates 3D images using a spatial light modulator (SLM) that can control the amplitude or phase of light, instead of a photographic plate. Digital holography uses a computer to create an interference pattern image of the 3D object to be displayed through mathematical calculations, records it in the SLM, and then displays the holographic image by emitting coherent light.
[0212] According to an embodiment, the display device 1900, implemented as a holographic display, includes an antenna for sensing RF signals reflected by an object (body). Here, the antenna is configured to sense information such as the distance to the object (body) and its speed and direction of movement.
[0213] According to an embodiment, the display device 1900 can set 3D touch coordinates to detect user touches or gestures relative to 3D space. To set the 3D touch coordinates, the display device 1900 can display a designated guide image 2000 for setting the 3D touch coordinates in 3D space.
[0214] In the following, a detailed description will be given of the operation performed by the display device 1900 according to the embodiment, which displays a designated guide image 2000 for setting 3D touch coordinates in 3D space so as to set 3D touch coordinates and detect user touch or user gesture operation relative to 3D space by using 3D touch coordinates.
[0215] Figure 16 This is a diagram illustrating an example of a glasses-type display device, wherein the display device 2100 according to an embodiment is an example of such a device. Figure 17 This is a flowchart illustrating a method for driving a display device 2100 according to an embodiment. Figure 18This is a conceptual diagram illustrating a method for setting reference coordinates for 3D touch detection using a display device 2100 according to an embodiment. Although Figure 16 The display device 2100 shown is an eyeglass type display device, but this disclosure is not limited thereto. For example, the display device 2100 may be a reference... Figure 1 to Figure 15 This describes various types of display devices. These can be light field displays (LFDs), stereoscopic displays, or holographic displays.
[0216] In the following text, reference will be made to Figure 16 to Figure 18 A method for driving a display device 2100 according to an embodiment is described.
[0217] Reference Figure 16 and Figure 17 In operation 1710, the processor 410 of the display device 2100 according to the embodiment (see...) Figure 4 Control display panel 300 (see) Figure 1 To display a specified guide image 2000 used to set touch coordinates in 3D space.
[0218] According to an embodiment, the designated guide image 2000 includes at least a portion of a cube-shaped image.
[0219] According to the embodiments, such as Figure 18 As shown, the designated guide image 2000 includes a first object 2001 that corresponds to the first vertex of the cube shape (or cube) and represents the origin in 3D space (in the XYZ Cartesian coordinate system), a second object 2002 that corresponds to the second vertex of the cube and represents the X coordinate of the cube from the origin in 3D space, a third object 2003 that corresponds to the third vertex of the cube and represents the Y coordinate of the cube from the origin in 3D space, and a fourth object 2004 that corresponds to the fourth vertex of the cube and represents the Z coordinate of the cube from the origin in 3D space.
[0220] Reference Figure 16 and Figure 17 In operation 1720, the processor 410 of the display device 2100 according to the embodiment (see...) Figure 4 Control display panel 300 (see) Figure 1 A boot message 2016 is displayed to guide the user to sequentially touch multiple objects included in a specified boot image 2000.
[0221] The guidance message 2016 includes guidance messages 2016 that instruct the user to touch the first object 2001, the second object 2002, the third object 2003 and the fourth object 2004 in a predetermined order (e.g., "Touch objects ①, ②, ③, ④ in sequence").
[0222] Users can touch the first object 2001, the second object 2002, the third object 2003, and the fourth object 2004 in the 3D space according to the guidance sequence of the guidance message 2016.
[0223] Reference Figure 16 and Figure 17 In operation 1730, when a user sequentially touches multiple objects, the processor 410 of the display device 2100 according to the embodiment (see...) Figure 4 The reference coordinates in 3D space corresponding to the user's touch are recorded in memory (e.g., Figure 20 In 1120).
[0224] According to an embodiment, the processor 410 is based on the use of an antenna ANT (see...). Figure 7 The system detects that the user has touched the first object 2001 to set the origin of the 3D space.
[0225] According to an embodiment, the processor is based on the use of an antenna ANT (see...). Figure 7 The system detects that the user has touched the second object 2002 to set the X reference coordinate on the X coordinate.
[0226] According to an embodiment, the processor is based on the use of an antenna ANT (see...). Figure 7 The system detects that the user has touched the third object 2003 to set the Y reference coordinate on the Y coordinate.
[0227] According to an embodiment, the processor is based on the use of an antenna ANT (see...). Figure 7 The system detects that the user has touched the fourth object 2004 to set the Z reference coordinate in the Z coordinate.
[0228] Reference Figure 16 and Figure 17 In operation 1740, the processor 410 of the display device 2100 according to the embodiment (see...) Figure 4 The 3D touch coordinates are set based on the recorded reference coordinates.
[0229] After setting the reference coordinates, the display device 2100 can detect the user's touch or gesture relative to the 3D space based on the set reference coordinates.
[0230] Figure 19 This is an example of the coordinate system in which the display device 2100 performs 3D touch detection according to an embodiment.
[0231] According to an embodiment, after setting reference coordinates, the display device 2100 can detect the user's touch or gesture relative to 3D space based on the set reference coordinates.
[0232] For example, when a user touches a specific location 2200 in 3D space, the display device 2100 can calculate the X, Y, and Z coordinates, r value, and θ value of the specific location 2200 corresponding to the user's touch based on a set reference coordinate system. value.
[0233] Although the above description of the display panel 300 includes an antenna ANT for detecting touch input coordinates in 3D space based on reflected RF signals (see... Figure 7 However, alternatively, the display panel 300 may include a non-display area NDA (see [link to NDA]) for capturing images of the user's touch input (e.g., the user's finger or a held object). Figure 7 The front-facing camera (not shown) is used to detect touch input coordinates. In this case, the processor 410 can communicatively connect to the front-facing camera and analyze the captured image to detect touch input coordinates corresponding to a specified guide image. The front-facing camera can be a stereo camera that measures the depth of objects in the image field.
[0234] Figure 20 This is a block diagram illustrating an electronic device 3000 according to an embodiment of the present invention. (Refer to...) Figure 20 Electronic device 3000 can, for example, be connected with Figure 1 The display module 1140 corresponding to the display device 10 shown outputs various information (e.g., images, text, music, etc.). When (e.g., with...) Figure 4 When processor 1110 (corresponding to processor 410) executes an application stored in memory 1120, display module 1140 can (e.g., with) Figure 1 The corresponding display panel 1141 provides application information to the user.
[0235] In some embodiments, the electronic device 3000 may be configured as a smartphone, camera, smart TV, monitor, smartwatch, tablet, automotive display, or AR / VR headset. For example, the electronic device 3000 may include a touch-sensitive display area DA for interaction (see...). Figure 1 ) and the non-display area NDA, which includes sensors and circuitry for enhanced functionality (see Figure 1 Smartphones. For example, electronic device 3000 may include a large display area DA for high-resolution video playback (see Smartphone 3000). Figure 1 And merge the non-display area NDA (see) of the drive circuitry or connection module used for external input. Figure 1 A television or monitor. For example, electronic device 3000 may include a display area DA optimized for compact and high-definition visuals (see...). Figure 1And integrates the non-display area NDA of biometric sensors for health monitoring (see...) Figure 1 (A smartwatch.) In some cases, the electronic device 3000 is an AR / VR headset.
[0236] In some embodiments, memory 1120 may store information such as software code for operating application 1123. Application 1123 may include software designed to perform specific tasks or provide functionality to a user. Application 1123 may operate under the control of processor 1110 and utilize data stored in memory 1120 to deliver a wide range of features such as productivity tools, multimedia streaming and playback, file or mail transfer, or communication services. Application 1123 interacts seamlessly with user interface 1161 or touchscreen 1142, allowing users to launch, navigate, and utilize the program via user input such as touch, tap, gestures, or voice interaction. Touch input and gestures may be based on a combination of the above. Figure 16 to Figure 19 The 3D input described is for 3D reference coordinate detection.
[0237] When a user selects an application via touchscreen 1142 or user interface 1161, processor 1110 can execute application program 1123 corresponding to the selected application retrieved from memory 1120 to perform the application's functions. For example, when a user selects a camera application by tapping an icon (or camera application icon) presented on display panel 1141, processor 1110 activates the camera module. Processor 1110 can then transfer image data corresponding to a captured image obtained by the camera module to display module 1140. Display module 1140 can then display the image corresponding to the captured image via display panel 1141.
[0238] As another example, when a user wishes to make a phone call, the user taps the phone icon displayed on the display module 1140 or touches the phone icon in 3D space, and the processor 1110 can execute a phone application stored in the memory 1120. The phone keypad can be displayed on the display panel 1141 or in 3D space for the user to enter a phone number to make the call.
[0239] As another example, the display module 1140 can be integrated into an electronic device 3000 such as a laptop computer, smart TV, or tablet computer. A user wishing to access a multimedia streaming application (e.g., watching a music video or movie) can do so by tapping the corresponding icon or touching the corresponding icon in 3D space. This action activates the application, allowing the user to watch the streaming content. The processor 1110 may include a main processor 1111 and an auxiliary or coprocessor 1112. The main processor 1111 may include a central processing unit (CPU). The main processor 1111 may further include one or more of a graphics processing unit (GPU), a communication processor (CP), and an image signal processor (ISP).
[0240] The coprocessor 1112 may include a controller 1112-1. The controller 1112-1 may include interface conversion circuitry and timing control circuitry. The controller 1112-1 may receive image signals from the main processor 1111, convert the data format of the image signals to match the interface specifications of the display module 1140, and output image data. The controller 1112-1 may output various control signals for driving the display module 1140. For example, the controller 1112-1 may drive the display module 1140 to display icons on the screen, or to form icons in a 3D space suitable for user selection to trigger the execution of the application 1123.
[0241] Memory 1120 may store one or more applications 1123 used by at least one component of electronic device 3000 (e.g., processor 1110 or user interface 1161) and various data, as well as input or output data of commands associated therewith. For example, camera applications, GPS applications, augmented reality and virtual reality applications, and other applications that can be executed by processor 1110 when a user selects a corresponding icon presented on the display screen (or in 3D space) via touch input on touchscreen 1142 or in 3D space, may be stored in memory 1120. Additionally, various setting data corresponding to user settings may be stored in memory 1120. Memory 1120 may include volatile memory 1121 and non-volatile memory 1122.
[0242] Display module 1140 can output visual information (images) to a user. Display module 1140 may include a display panel 1141, a gate driver, a source driver, a voltage generation circuit, and a touchscreen 1142. Display module 1140 may further include a window, a base, and a support for protecting the display panel 1141. Display module 1140 may include... Figure 1 At least a portion of the structure of the display device 10 shown in the figure.
[0243] User interface 1161 acts as an interaction medium between the user and electronic device 3000. User interface 1161 can detect input made by a part of the user's body (e.g., a finger) or by a pen or mouse, and generate electrical signals or data values corresponding to the input. User interface 1161 includes a fingerprint sensor 1162, an input sensor 1163, and a digitizer 1164.
[0244] The fingerprint sensor 1162 can sense fingerprints used for biometric identification of a user, and can also measure one or more biometric signals such as blood pressure, humidity or weight.
[0245] The input sensor 1163 can sense user interactions including touch on a touchscreen, touch input in 3D space, taps, gestures, motion, verbal commands, and eye movements. Although in Figure 20 Shown separately, however, the input sensor 1163 may include the aforementioned mobile communication circuitry 360, antenna drive circuitry 350, and antennas ANT1 and ANT2 for detecting 3D touch input under the control of the processor 1110. The input sensor 1163 may further include optical sensors for image capture, eye tracking, or motion and gesture detection. The optical sensors may be infrared photodetectors or semiconductor photodetectors. The input sensor 1163 includes audio sensors and acoustic sensors, which may be MEMS microphones for voice recognition or voice-based interaction. The audio sensors and acoustic sensors may be mounted or embedded in the display panel 1141 as part of the user interface 1161.
[0246] The digitizer 1164 can generate data values corresponding to coordinate information from input via a pen or mouse, or user gestures in 3D space, to control a cursor on the screen or the movement of the cursor in 3D space. The digitizer 1164 can also generate data values from changes in electromagnetic field energy caused by input. The digitizer 1164 can detect input via a passive pen or send and receive data using an active pen or remote control.
[0247] At least one of the fingerprint sensor 1162, input sensor 1163, and digitizer 1164 can be implemented as a sensor layer, which is formed on the top layer of the display panel 1141 by a process that is continuous with the process of forming elements (e.g., light-emitting elements and transistors) included in the display panel 1141. Additionally, the user interface 1161 may further include, for example, a gesture sensor, a gyroscope sensor for sensing rotational movement, an accelerometer for tracking translational movement, a grip sensor, a pressure sensor, a proximity sensor, a color sensor, an infrared (IR) emitter and camera sensor for tracking gaze direction and eye movement, a temperature sensor, or a light sensor. For example, the gyroscope sensor, accelerometer, and infrared emitter and camera sensor may be particularly suitable for AR / VR headset functionality.
[0248] Touchscreen 1142 includes a touch sensor embedded in a semiconductor layer of display panel 1141 for sensing pressure applied to the top layer (screen) of display panel 1141. The touch sensor can be capacitive or resistive. Touchscreen 1142 can serve as a primary interface for users to select and navigate applications, control electronic device 3000, and interact with electronic device 3000.
[0249] Examples of display panel 1141 (or display) may include liquid crystal display panel, organic light-emitting display panel, or inorganic light-emitting display panel, but the type of display panel 1141 is not particularly limited. Display panel 1141 may be of a rigid type or a flexible type that can be rolled or folded. Display module 1140 may further include supports, brackets, and heat dissipation components, etc., for supporting display panel 1141.
[0250] Power module 1150 supplies power to components of electronic device 3000. Power module 1150 may include a battery charged with a power supply voltage. The battery may include a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell. Power module 1150 may include a power management integrated circuit (PMIC). The PMIC can supply optimized power to each of the aforementioned components, including display module 1140.
[0251] In concluding this detailed description, those skilled in the art will understand that variations and modifications may be made to the disclosed embodiments without departing from the principles of this disclosure. Therefore, the disclosed embodiments of the inventive concept are used only in a general and descriptive sense and not for limiting purposes.
Claims
1. A display apparatus comprising: a display panel; and a processor configured to: control the display panel to display a designated guide image for setting a three-dimensional touch coordinate in a three-dimensional space; control the display panel to display a guide message instructing a user to sequentially touch a plurality of objects included in the designated guide image; record, in a memory, a reference coordinate in the three-dimensional space corresponding to a touch of the user when the user sequentially touches the plurality of objects; and complete the setting of the three-dimensional touch coordinate based on the recorded reference coordinate. The designated guide image includes at least a portion of a cubical-shaped image. The designated guide image includes:
2. The display device according to claim 1, wherein a first object corresponding to a first vertex of the cubical-shaped image and representing an origin in the three-dimensional space in an XYZ Cartesian coordinate system; 3. The display device according to claim 2, wherein a second object corresponding to a second vertex of the cubical-shaped image and representing an X coordinate from the origin in the three-dimensional space; a third object corresponding to a third vertex of the cubical-shaped image and representing a Y coordinate from the origin in the three-dimensional space; and a fourth object corresponding to a fourth vertex of the cubical-shaped image and representing a Z coordinate from the origin in the three-dimensional space. The guide message includes an instruction for the user to touch the first object, the second object, the third object, and the fourth object in a predetermined order. an antenna circuit board coupled to the processor, wherein:
4. The display device according to claim 3, wherein the display panel includes a display area and a non-display area including an antenna connected to the antenna circuit board; and 5. The display device of claim 4, further comprising: the processor sets the origin of the three-dimensional space based on detecting that the user has touched the first object according to a signal reflected from the user and received by the antenna. the processor sets an X reference coordinate on the X coordinate based on detecting that the user has touched the second object according to a signal reflected from the user and received by the antenna. the processor sets a Y reference coordinate on the Y coordinate based on detecting that the user has touched the third object according to a further signal reflected from the user and received by the antenna.
6. The display device of claim 5, wherein, the processor sets a Z reference coordinate on the Z coordinate based on detecting that the user has touched the fourth object according to another signal reflected from the user and received by the antenna.
7. The display device of claim 6, wherein, The display apparatus is a glasses-type display.
8. The display device of claim 7, wherein, The display apparatus is a non-glasses-type light field display.
9. The display device according to any one of claims 1 to 8, wherein, The display apparatus is a holographic display.
10. The display device according to any one of claims 1 to 8, wherein, The display apparatus is a variable focal length type stereoscopic display.
11. The display device according to any one of claims 1 to 8, wherein, 13.A method for operating a display apparatus including a display panel, the method comprising:
12. The display device according to any one of claims 1 to 8, wherein, controlling, by a processor, the display panel to display a designated guide image for setting a three-dimensional touch coordinate in a three-dimensional space; controlling, by the processor, the display panel to display a guide message instructing a user to sequentially touch a plurality of objects included in the designated guide image; when the user sequentially touches the plurality of objects, recording, by the processor, reference coordinates in the three-dimensional space corresponding to the user's touches to a memory; and completing, by the processor, the setting of the three-dimensional touch coordinates based on the recorded reference coordinates.
14. The method of claim 13, wherein, The specified guide image includes at least a portion of a cube-shaped image.
15. The method of claim 14, wherein, The specified guide image includes: a first object corresponding to a first vertex of the cube-shaped image and representing an origin in the three-dimensional space in an XYZ Cartesian coordinate system; a second object corresponding to a second vertex of the cube-shaped image and representing an X coordinate from the origin in the three-dimensional space; a third object corresponding to a third vertex of the cube-shaped image and representing a Y coordinate from the origin in the three-dimensional space; and a fourth object corresponding to a fourth vertex of the cube-shaped image and representing a Z coordinate from the origin in the three-dimensional space.
16. The method of claim 15, wherein, The guide message includes instructions for the user to touch the first object, the second object, the third object, and the fourth object in a predetermined order.
17. The method of claim 16, further comprising: setting, by the processor, the origin of the three-dimensional space based on detecting, using an antenna within the display panel, that the user has touched the first object.
18. The method of claim 17, further comprising: setting, by the processor, an X reference coordinate on the X coordinate based on detecting, using an antenna within the display panel, that the user has touched the second object. 19.An electronic device comprising: a display device configured to display an image, wherein the display device comprises: a display panel including a display area and a non-display area outside the display area, the non-display area including an antenna; an antenna circuit board connected to the antenna; and a processor connected to the antenna circuit board and configured to: control the display panel to display a specified guide image for setting three-dimensional touch coordinates in a three-dimensional space; control the display panel to display a guide message instructing a user to sequentially touch a plurality of objects included in the specified guide image; control the antenna circuit board to transmit a radio frequency signal through the antenna; and when the user sequentially touches the plurality of objects, receive, from the antenna circuit board, signal information corresponding to the transmitted radio frequency signal that is reflected from the user and received by the antenna, and record, in a memory, reference coordinates in the three-dimensional space corresponding to the user's touches based on the signal information. 20.The electronic device of claim 19, wherein, The antenna is a multi-element array antenna that forms a controllable beam controllable by the processor.
Citation Information
Patent Citations
Systems generating electricity and hydrogen
KR1020240122657A