Display device and control method thereof
By identifying the color of the touch pen by the light emitting element and the light receiving element, the problem of not being able to automatically recognize the color of the ordinary pen in the prior art is solved, and automatic recognition and high accuracy are achieved without the need for special equipment.
Patent Information
- Application Number
- CN201980064444.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-10-17
- Filing Date
- 2019-10-11
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2039-10-11
AI Technical Summary
Existing display devices cannot automatically recognize the color of ordinary stylus pens, require a special pen or camera, and the recognition accuracy is insufficient in different environments.
Using multiple light emitting elements and light receiving elements, by emitting light of different wavelengths and detecting the intensity of reflected light, the processor recognizes the color of the pen and controls the display to draw marks of the corresponding color.
Users can automatically recognize the color of the touch pen using input devices of various pen shapes, without the need for a special pen or camera, and accurately identify it in different environments.
Smart Images

Figure CN112789583B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a display device and a control method thereof, and more particularly, to a display device using a touch pen and a control method thereof. Background Art
[0002] The development of electronic technology has led to the development of various types of electronic products. In particular, according to the process of e-learning systems using electronic devices in the field of education or teaching, electronic blackboard devices combining the functions of a display device and a blackboard have been widely used.
[0003] The electronic blackboard is mainly equipped with a touch screen, and a user can touch the touch screen using the user's body (for example, a finger, etc.) or an input device such as a touch pen.
[0004] However, the display device of the related art has the inconvenience that the display device cannot automatically recognize the color of the touch pen, and thus requires user setting.
[0005] The display device of the related art can automatically recognize the color of the pen only when a special pen embedded with a specific module is used. In this case, the user may need to purchase the special pen, and there is a limitation that the pen color of the touch pen other than the special pen cannot be automatically recognized. In addition, even when the display device is equipped with a separate camera and recognizes the color of the pen, there is a limitation that the color of the pen cannot be accurately recognized depending on the surrounding environment of the display device (for example, the brightness of the lighting, etc.).
[0006] Thus, a method for a display device to recognize the pen color of a touch pen without using a camera or a dedicated pen is required. Summary of the invention
[0007] [Technical issues]
[0008] According to an embodiment, the display device may recognize the color of the pen using the light emitting element and the light receiving element.
[0009] [Technical solution]
[0010] Embodiments of the present disclosure may overcome the above disadvantages and other disadvantages not described above. Additionally, embodiments are not required to overcome the above disadvantages, and embodiments may not overcome any of the above problems.
[0011] A display device for digital drawing based on a touch pen, according to an embodiment of the present invention, comprises a display, a plurality of light emitting elements emitting light of different wavelengths, a plurality of light receiving elements, and a processor. The processor is configured to: a first light emitting element among the plurality of light emitting elements emits a first light of a first wavelength, and a second light emitting element among the plurality of light emitting elements emits a second light of a second wavelength different from the first wavelength, recognize a first intensity of the first light received by at least one light receiving element among the plurality of light receiving elements, recognize a second intensity of the second light received by at least one light receiving element, recognize a color based on the first intensity and the second intensity, and control the display to draw a mark corresponding to a touch position of the touch pen on the display on the display with the color.
[0012] The processor may sequentially control the first light emitting element to emit first light of a first wavelength at a first light emitting timing, and the second light emitting element to emit second light of a second wavelength at a second light emitting timing subsequent to the first light emitting timing.
[0013] The processor may identify the color based on a signal intensity distribution of the first intensity and the second intensity.
[0014] The processor may detect a touch of the touch pen on the display, control at least one of the plurality of light emitting elements to emit light, and identify a touch position of the touch pen on the display based on the intensity of light emitted by the at least one light emitting element received by the plurality of light receiving elements.
[0015] The outer region of the display may include four boundary regions, and the plurality of light emitting elements may be disposed at two adjacent boundary regions among the four boundary regions, and the plurality of light receiving elements may be disposed at two remaining boundary regions.
[0016] Each of the plurality of light receiving elements may be disposed between groups of the plurality of light emitting element groups, or may be disposed alternately with each of the plurality of light emitting elements.
[0017] The processor may select a first light emitting element from among the plurality of light emitting elements to emit first light of a first wavelength, and select a second light emitting element from among the plurality of light emitting elements to emit second light of a second wavelength, based on a touch position of the touch pen.
[0018] The processor may control the touch track displayed by the touch pen to be the recognized color.
[0019] The display device may further include: a frame disposed at an outer area of the display; a guide member formed to protrude at an area of the frame; and a plurality of light receiving elements that may be supported by the guide member and disposed to be inclined toward a direction of the screen of the display.
[0020] According to an embodiment, a method for controlling a display device for digital drawing based on a touch pen includes: controlling a first light emitting element among multiple light emitting elements of the display device to emit a first light of a first wavelength, and controlling a second light emitting element among the multiple light emitting elements of the display device to emit a second light of a second wavelength different from the first wavelength; determining a first intensity of the first light received by at least one light receiving element among multiple light receiving elements of the display device, and determining a second intensity of the second light received by at least one light receiving element of the display device; identifying a color based on the first intensity and the second intensity; and controlling the display of the display device to draw a mark on the display corresponding to a touch position of the touch pen on the display with the color.
[0021] Controlling the first light emitting element and the second light emitting element may include controlling the first light emitting element to emit first light of a first wavelength at a first light emitting timing, and controlling the second light emitting element to emit second light of a second wavelength at a second light emitting timing after the first light emitting timing.
[0022] Identifying the color may include identifying the color based on a signal intensity distribution of the first intensity and the second intensity.
[0023] The method may include detecting a touch of a touch pen on a display, controlling at least one of a plurality of light emitting elements to emit light, and identifying a touch position of the touch pen on the display based on the intensity of light emitted by the at least one light emitting element received by a plurality of light receiving elements.
[0024] The outer region of the display may include four boundary regions, and the plurality of light emitting elements may be disposed at two adjacent boundary regions among the four boundary regions, and the plurality of light receiving elements may be disposed at two remaining boundary regions.
[0025] Each of the plurality of light receiving elements may be disposed between the groups of the plurality of light emitting element groups, or may be disposed alternately with each of the plurality of light emitting elements.
[0026] The method may include selecting a first light emitting element from a plurality of light emitting elements to emit first light of a first wavelength, and selecting a second light emitting element from the plurality of light emitting elements to emit second light of a second wavelength based on a touch position of the touch pen.
[0027] The control method may further include displaying the touch trace as the recognized color by the touch pen.
[0028] The display device may further include: a bezel disposed at an outer region of the display; a guide member formed to protrude at an area of the bezel; and a plurality of light receiving elements that may be supported by the guide member and disposed to be inclined toward a direction of the screen of the display.
[0029] [Beneficial Effects]
[0030] According to various embodiments, a user may perform a touch operation using various pen-shaped input devices, and a pen color of a touch pen may be automatically recognized without a separate user setting. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] The above and / or other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description in conjunction with the accompanying drawings, in which:
[0032] Figure 1 is a block diagram showing a configuration of a display device according to an embodiment;
[0033] Figure 2 are views provided to describe a sensor according to an embodiment;
[0034] Figure 3 are views provided to describe the color of a pen according to an embodiment;
[0035] Figure 4 are views provided to describe light of different wavelengths according to an embodiment;
[0036] Figure 5 are views provided to describe a sensor arrangement according to an embodiment;
[0037] Figure 6 are views provided to describe a sensor arrangement according to an embodiment;
[0038] Figure 7 are views provided to describe a light emitting element according to an embodiment;
[0039] Figure 8 is a graph provided to describe signal strength according to an embodiment; and
[0040] Fig. 9 is a flowchart provided to describe a control method of a display device according to an embodiment. DETAILED DESCRIPTION
[0041] Before describing the present disclosure in detail, a method for explaining the present specification and the accompanying drawings will be described.
[0042] The terms used in the present disclosure and claims are general terms determined in consideration of the functions of various embodiments of the present disclosure. However, these terms may vary according to the intentions of those skilled in the art, legal or technical interpretations, the emergence of new technologies, etc. In addition, there may be some arbitrarily identified terms. Unless there is a specific definition of a term, the term may be interpreted based on the overall context and technical common sense of those skilled in the art.
[0043] Terms such as "first", "second", etc. may be used to describe various elements, but these elements should not be limited by these terms. These terms are used only for the purpose of distinguishing one element from another element.
[0044] The expression “at least one of A or / and B” should be understood to mean any one of “A” or “B” or “A and B”.
[0045] In addition, in the present disclosure, the description that one element (e.g., a first element) is “(operably or communicatively) coupled” to another element (e.g., a second element), or that one element (e.g., a first element) is “(operably or communicatively) coupled to” or “connected to” another element (e.g., a second element) should be interpreted to include the case where one element is directly coupled to another element, and the case where one element is coupled to another element via yet another element (e.g., a third element).
[0046] Unless otherwise specified, singular forms include plural forms. It will be understood that terms such as "comprising" or "consisting of" are used herein to indicate the presence of features, numbers, steps, operations, elements, parts or combinations thereof, and do not exclude the presence or possibility of adding one or more other features, numbers, steps, operations, elements, parts or combinations thereof.
[0047] Terms such as "module", "unit", "part", etc. are used to refer to an element that performs at least one function or operation, and such an element may be implemented as hardware or software, or a combination of hardware and software. In addition, except when each of a plurality of "modules", "units", "parts", etc. needs to be implemented in a single hardware, the components may be integrated in at least one module or chip and implemented in at least one processor.
[0048] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily practice the present disclosure. However, the present disclosure can be implemented in various forms and is not limited to the embodiments described herein. In addition, in the accompanying drawings, parts that are not related to the description will be omitted to avoid confusing the present disclosure, and similar parts will be represented by similar reference numerals throughout the specification.
[0049] Figure 1 is a block diagram showing a configuration of a display device according to an embodiment.
[0050] The display device 100 may be implemented as various types of devices equipped with a display function. For example, the display device 100 may be implemented as a device having a display function, such as a TV, a smart phone, a tablet personal computer (PC), a portable multimedia player (PMP), a personal digital assistant (PDA), a laptop computer, a smart watch, a head mounted display (HMD), a near eye display (NED), etc.
[0051] refer to Figure 1 , the display device 100 includes a display 110 , a sensor 120 and a processor 130 .
[0052] The display 110 may provide various content screens. Here, the content screen may include various contents such as images, moving images, text, music, etc., an application execution screen, a Graphic User Interface (GUI) screen, etc.
[0053] The display 110 according to the embodiment may be implemented as a liquid crystal display (LCD), an organic light emitting diode (OLED), a liquid crystal on silicon (LCoS), a digital light processing (DLP), a micro LED, a quantum dot (QD) display panel, etc., but the display 110 is not limited thereto. The display 110 may also be implemented as a flexible display, a transparent display, etc.
[0054] The display 110 according to an embodiment may be integrated with a touch panel and implemented as a touch screen to receive a user's touch input or a touch input through various types of input devices (e.g., a touch pen). Hereinafter, for ease of description, the display 110 is described as being implemented as a touch screen and receiving a touch input.
[0055] The sensor 120 may be disposed in an outer area of the display 110. In particular, the sensor 120 may include a plurality of light emitting elements (eg, light emitting diodes (LEDs)) arranged in various forms, and a plurality of light receiving elements (eg, photodiodes or photodetectors (PDs)). Figure 2 Give a detailed description.
[0056] Figure 2 are views provided to describe a sensor according to an embodiment.
[0057] refer to Figure 2 , the sensor 120 may be disposed at an outer region of the display 110 (or an edge region or a peripheral region adjacent to a display region of the display 110). Here, the sensor 120 may include a plurality of light emitting element groups 10, and each of the plurality of light emitting element groups 10 may include a plurality of light emitting elements 10-1, 10-2, and 10-3. Here, the outer region may be a frame region, but the outer region is not limited thereto.
[0058] A plurality of light emitting elements 10-1, 10-2, and 10-3 may emit light of different wavelengths. For example, the light emitting element group 10 may include first to third light emitting elements 10-1, 10-2, and 10-3, and the first light emitting element 10-1 may emit light of a first wavelength, the second light emitting element 10-2 may emit light of a second wavelength, and the third light emitting element 10-3 may emit light of a third wavelength. The light emitting element group 10 may include various numbers of light emitting elements. For example, the light emitting element group 10 may include first to fifth light emitting elements, and the first to fifth light emitting elements may emit light of different wavelengths.
[0059] Here, the light-emitting element may emit light of various intensities according to the amplitude of the applied current. In addition, depending on the manufacturing method and material, the light-emitting element may emit light included in various wavelength regions, such as ultraviolet rays, visible light, and infrared rays. For example, the light-emitting element may be implemented as an infrared emitting diode (IRED). The first to third light-emitting elements may have different peak wavelengths. For example, the first light-emitting element may have a peak wavelength of 800nm and a bandwidth of 50nm. In this case, the first light-emitting element may emit infrared rays in the 750nm to 850nm band. Each of the second and third light-emitting elements may have a different peak wavelength and emit light of different wavelengths. This is only an embodiment, and the embodiment is not necessarily limited thereto. In addition, the first to third light-emitting elements 10-1, 10-2, and 10-3 may emit light in the ultraviolet or visible light range. For ease of description, the light-emitting element group 10 is described as a device including a plurality of light-emitting elements 10-1, 10-2, and 10-3 that emit light having respective different wavelengths, but this configuration is only exemplary, and the configuration of the light-emitting element 10 is not limited thereto. For example, the sensor 120 may include only a plurality of light emitting elements that emit light of the same wavelength or a plurality of light emitting elements of the same specification.
[0060] Each of the plurality of light receiving elements 20 according to the embodiment may receive light. In one example, the light receiving element 20 may receive light emitted by a light emitting element. In addition, the light receiving element 20 may receive reflected light emitted by the light emitting element and reflected from an object. Here, the light receiving element 20 may be any element that converts a light signal, light energy, etc. into an electrical signal or electrical energy. The light receiving element 20 may be a light detector, a light receiving sensor, an infrared light receiving module, etc., but will be referred to as the light receiving element 20.
[0061] The light receiving element 20 according to the embodiment may output a signal intensity of the received light. For example, the light receiving element 20 may provide the processor 130 with an intensity signal of the detected light.
[0062] According to an embodiment, each of the plurality of light receiving elements 20 may be between two of the plurality of light emitting elements 10-1, 10-2, and 10-3. For example, the light receiving element 20 may be disposed between the first light emitting element 10-1 and the second light emitting element 10-2, and the light receiving element 20 may be disposed between the second light emitting element 10-2 and the third light emitting element 10-3. Thus, the light emitting element 10 and the light receiving element 20 may be arranged in an alternating manner. This is only an embodiment, and the sensor 120 may include a plurality of light emitting element groups 10 and a plurality of light receiving elements 20 arranged in various forms.
[0063] The processor 130 according to the embodiment may be implemented with a digital signal processor (DSP), a microprocessor, and a time controller (TCON) for processing a digital image signal, but the processor 130 is not limited thereto. The processor 130 may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a communication processor (CP), and an advanced reduced instruction set computing (RISC) machine (ARM) processor, or may be defined as a corresponding term. The processor 130 may be implemented in a system on chip (SoC) type or a large scale integration (LSI) type, or a field programmable gate array (FPGA) type in which a processing algorithm is programmed. The processor 130 may perform various functions by executing computer executable instructions stored in a memory of the display device.
[0064] In particular, when a touch of the touch pen on the display 110 is sensed, the processor 130 may recognize a touch position of the touch pen according to a signal received from the sensor 120 .
[0065] refer to Figure 2 , a lattice structure is formed by light emitted by a plurality of light emitting elements 10-1, 10-2, and 10-3 disposed in an outer region of the display 110. Before the touch pen contacts the display 110, each of the plurality of light receiving elements 20 may receive light of the same intensity emitted by the plurality of light emitting elements 10-1, 10-2, and 10-3.
[0066] According to an embodiment, if the touch pen contacts the display 110, a portion of the light emitted by the plurality of light emitting elements 10-1, 10-2, and 10-3 may be absorbed by the touch pen, and the remaining light emitted by the plurality of light emitting elements 10-1, 10-2, and 10-3 may be refracted or reflected by the touch pen and received by the light receiving element 20.
[0067] The processor 130 according to the embodiment may identify the touch position of the touch pen based on the position of one or more light receiving elements 20 among the plurality of light receiving elements 20 (the intensity of the light received by which is less than a predetermined threshold). The predetermined threshold may be the intensity of the light received when the touch pen is not present. For example, when the light emitted by the light emitting element is reflected and absorbed by the touch pen, the intensity of the light received by a specific light receiving element among the plurality of light receiving elements 20 may be reduced or close to zero. The processor 130 may identify the touch position based on the position corresponding to the light receiving element receiving the reduced light intensity. As another example, if the light intensity received by a specific light receiving element among the plurality of light receiving elements 20 is identified as being a predetermined percentage less than the light intensity received by the light receiving element adjacent to the light receiving element, the processor 130 may identify the position corresponding to the receiving element as the touch position.
[0068] This is only an embodiment, and the display 110 may sense the touch of the touch pen and identify the touch position instead of the sensor 120. For example, the display 110 may include a pen sensing unit (e.g., a pen recognition panel). The pen sensing unit may sense the touch and identify the touch position according to the change in the electromagnetic field strength of the touch pen (e.g., a stylus pen, a digital pen). The pen sensing unit may include a resistance sensor, a surface capacitance sensor, a projection capacitance sensor, a surface acoustic wave sensor, an infrared sensor, or a pressure sensor. Thus, the touch position of the touch pen may be sensed according to any of the various sensing methods of the pen sensing unit. At the same time, the touch pen is not limited to a dedicated pen for the display device 100. The touch pen according to the embodiment may be an object of various types (resistance type, electrostatic type, etc.) that can be recognized by the display device 100 by touch. In addition, the touch pen is not necessarily limited to a pen, but may be a part of the user's body (e.g., a finger, etc.).
[0069] As another example, the processor 130 may measure the distance between the touch pen and the outer area of the display 110 based on the signal strength of the light received by the light receiving element 20. For example, the processor 130 may calculate the distance by measuring the time between the light emitted from the plurality of light emitting elements 10-1, 10-2, and 10-3 being reflected on the touch pen and the emitted light being received by the light receiving element 20. Then, the processor 130 may recognize the touch position of the touch pen based on the measured distance or the travel time of the signal.
[0070] return Figure 1, according to the embodiment, the processor 130 may control at least one of the plurality of light emitting element groups 10 to emit light based on the touch position when the touch position is identified. For example, the processor 130 may control, based on the identified touch position, the plurality of light emitting elements 10-1, 10-2, and 10-3 included in a particular light emitting element group 10 to emit light of different wavelengths. Then, when the plurality of light receiving elements 20 receive light of different wavelengths, the processor 130 may identify the pen color of the touch pen based on the signal strength of the received light. This will refer to Figure 3 Further description.
[0071] Figure 3 is a view provided to describe the color of a pen according to an embodiment.
[0072] refer to Figure 3 According to the embodiment, the processor 130 may control at least one light emitting element group 10 among the plurality of light emitting element groups 10 to emit light based on the recognized touch position 200 .
[0073] For example, the processor 130 may control the plurality of light emitting elements 10-1, 10-2, and 10-3 included in the light emitting element group 10 closest to the recognized touch position 200 among the plurality of light emitting element groups to emit light of different wavelengths. This is an embodiment and is not necessarily limited thereto. For example, the processor 130 may control the plurality of light emitting element groups 10 disposed in the boundary region closest to the recognized touch position 200 among the four boundary regions to emit light relative to the display 110.
[0074] As another example, the processor 130 may control the light emitting element group 10 closest to the recognized touch position and the light emitting element groups 10 disposed on both sides of the light emitting element group to emit light.
[0075] The processor 130 according to the embodiment may control the plurality of light emitting elements 10 - 1 , 10 - 2 , and 10 - 3 included in at least one light emitting group 10 to emit light of different wavelengths.
[0076] The processor 130 according to another embodiment may control the plurality of light emitting elements 10-1, 10-2 and 10-3 to sequentially emit light of different wavelengths. When the plurality of light emitting elements 10-1, 10-2 and 10-3 sequentially emit light, interference between the light emitted from the plurality of light emitting elements may be reduced.
[0077] According to another embodiment, the processor 130 may control the plurality of light emitting elements 10-1, 10-2, and 10-3 to emit light of different frequencies. If the frequency changes, interference between the lights can be avoided. Hereinafter, for ease of description, the plurality of light emitting elements 10-1, 10-2, and 10-3 are described as emitting light of different wavelengths.
[0078] refer to Figure 3 , the processor 130 may control the plurality of light emitting elements 10-1, 10-2, and 10-3 included in the light emitting group closest to the identified touch position to emit light sequentially. For example, after the first light emitting element emits light of a first wavelength, the second light emitting element may emit light of a second wavelength, and then the third light emitting element may emit light of a third wavelength. This is merely an embodiment and is not limited thereto. For example, the processor 130 may activate each of the first to third light emitting elements 10-1, 10-2, and 10-3 in a non-overlapping cycle. The processor 130 may activate any one of the light emitting elements, and while emitting light, the processor 130 may keep the remaining light emitting elements in an inactive state that does not emit light.
[0079] When lights of different wavelengths emitted by a plurality of light emitting elements included in the light emitting element group are received by a plurality of light receiving elements, the processor 130 according to an embodiment may identify a pen color of the touch pen based on a signal intensity of the received light.
[0080] For example, each of the first to third light emitting elements 10-1, 10-2, and 10-3 included in the light emitting element group 10 may sequentially emit light of the first to third wavelengths at different light emission timings. Then, when the plurality of light receiving elements 20 receive light reflected by the touch pen, the processor 130 may identify the color of the pen based on the signal intensity of the reflected light. However, in some cases, the light of the first to third wavelengths may be emitted at the same emission timing.
[0081] refer to Figure 4 , lights of different wavelengths emitted by the plurality of light emitting elements 10 - 1 , 10 - 2 , and 10 - 3 will be described.
[0082] Figure 4 1 is a view provided to describe lights of different wavelengths according to an embodiment. According to an embodiment, when lights of different wavelengths emitted by a plurality of light emitting elements 10-1, 10-2, and 10-3 are reflected by a pen tip provided in the touch pen and received by each of a plurality of light receiving elements, the processor 130 may identify the pen color of the touch pen based on a signal intensity distribution of the reflected light.
[0083] For example, when the touch position 200 is recognized, the processor 130 may control the light emitting element group 10 based on the recognized touch position so that the plurality of light emitting elements 10-1, 10-2, and 10-3 included in at least one light emitting element group 10 emit light of different wavelengths.
[0084] According to the embodiment, the light receiving element 20 can accumulate information about the intensity of reflected light emitted from the first light emitting element 10-1 and reflected from the touch pen, information about the intensity of reflected light emitted from the second light emitting element 10-2 and reflected from the touch pen, and information about the intensity of reflected light emitted from the third light emitting element 10-3 and reflected from the touch pen, and send the accumulated information about the intensity of the reflected light to the processor 130.
[0085] The processor 130 may recognize information about the intensity of the reflected light received by the plurality of light receiving elements 20 .
[0086] The processor 130 according to an embodiment may identify the pen color of the touch pen based on the signal intensity distribution of the reflected light. Here, the pen color may refer to the color of the pen tip in the touch pen that directly contacts the display 110.
[0087] The plurality of light emitting elements 10 - 1 , 10 - 2 , and 10 - 3 may be implemented as infrared light emitting diodes that emit light in an infrared light region.
[0088] According to one embodiment, the first light emitting element 10-1 may emit light of a first wavelength in the 800nm band, the second light emitting element 10-2 may emit light of a second wavelength in the 870nm band, and the third light emitting element 10-3 may emit light of a third wavelength in the 940nm band, but the emitted wavelengths are not necessarily limited thereto. In addition, the first to third light emitting elements 10-1, 10-2, and 10-3 may emit light in the ultraviolet or visible light region.
[0089] return Figure 1 , according to an embodiment, the processor 130 can display the touch track as the recognized pen color through the touch pen. For example, when the recognized pen color is "blue", the processor 130 can display the touch area through the touch pen, that is, the touch track is "blue". In other words, when determining the color of the touch pen, the processor 130 can control the display 110 to digitally draw a line, mark or other indication corresponding to the pen track on the display 110 with a specific color of the touch pen. Thus, by changing the color of the tip of the touch pen, the display 110 can be controlled to draw a line of a color corresponding to the color of the touch pen.
[0090] The processor 130 according to an embodiment may include a central processing unit (CPU), a read-only memory (ROM or non-volatile memory) having a control program stored therein to control the display device 100, and a random access memory (RAM or volatile memory). The random access memory stores data input from a source outside the display device 100 or is used as a storage area for data or applications corresponding to various operations performed by the display device 100.
[0091] The processor 130 is a configuration that controls the overall operation of the display device 100. For example, the processor 130 may drive an operating system (OS) to control a plurality of hardware or software elements connected to the processor 130, and perform data processing and operations.
[0092] Specifically, the processor 130 includes a random access memory (RAM), a read only memory (ROM), a main CPU, one or more interfaces, and a bus.
[0093] RAM, ROM, main CPU, one or more interfaces, etc. can be interconnected by a bus.
[0094] The ROM stores a command set for booting the system, etc. When a power-on command is input and power is supplied, the CPU copies the OS stored in the memory to the RAM according to the instructions stored in the ROM, executes the OS to boot the system. When the booting is completed, the CPU can copy various programs stored in the memory to the RAM, execute the programs copied to the RAM, and perform various operations.
[0095] The main CPU accesses the memory and performs booting using the OS stored in the memory. The main CPU performs various operations using various programs and content data, etc. stored in the memory.
[0096] One or more interfaces are connected to various elements as described above. One of the interfaces may be a network interface connected to an external device through a network.
[0097] The processor 130 may perform a graphic processing function (video processing function). For example, the processor 130 may generate a screen including various objects such as icons, images, texts, etc. using an operator and a renderer.
[0098] The processor 130 may perform processing on the audio data. Specifically, the processor 130 may perform various processing on the audio data, such as decoding or amplification, noise filtering, etc.
[0099] The display apparatus 100 according to the embodiment may include a communication interface.
[0100] The communication interface is an interface for performing communication with various types of external devices according to various types of communication methods or protocols. The communication interface includes a Wi-Fi chip, a Bluetooth chip, an infrared communication chip, a wireless communication chip, etc. The processor 130 can communicate with various external devices using the communication interface.
[0101] The display device 100 can communicate with other external devices. In this case, the external device can be an electronic device capable of outputting image content. For example, if the external device is a TV, the type of the external device is an imaging device, and the output data information on the TV may include but is not limited to the model name of the TV, the audio characteristics of the output content of the TV, and the frequency characteristics of the output audio in the output content of the TV. In addition, in addition to devices capable of outputting image content, the external devices with which the display device 100 communicates via a communication interface may include remote controllers, Bluetooth speakers, lighting equipment, smart cleaners, smart refrigerators, and Internet of Things (IOT) home managers, etc.
[0102] The Wi-Fi chip and the Bluetooth chip communicate with each other using the Wi-Fi method and the Bluetooth method respectively. When using the Wi-Fi chip or the Bluetooth chip, various connection information such as a service set identifier (SSID) and a session key may be sent and received first, and communication information may be sent and received.
[0103] The infrared communication chip performs communication according to the Infrared Data Association (IrDA) technology for wirelessly transmitting data over a short distance using infrared rays between visible light and millimeter waves.
[0104] A wireless communication chip refers to a chip that performs communication according to various communication standards (such as Zigbee, third generation (3G), third generation partnership project (3GPP), long term evolution (LTE), advanced LTE (LTE-A), fourth generation (4G), fifth generation (5G), etc.), in addition to the above-mentioned Wi-Fi chip and Bluetooth chip.
[0105] According to an example, the electronic device may additionally include a tuner and a demodulator.
[0106] The tuner may receive a radio (RF) broadcast signal by tuning a channel selected by a user or all channels from among RF broadcast signals received through an antenna.
[0107] The demodulator receives and demodulates the digital intermediate frequency (DIF) signal converted by the tuner and performs channel decoding, etc.
[0108] According to an embodiment, the communication interface may communicate with external devices such as a remote controller and an external server using a Wi-Fi module. Alternatively, when the communication interface is implemented as a plurality of communicators, the communication interface may use a communicator including at least one of an Ethernet modem or a Wi-Fi modem to communicate with an external server, and use a communicator including a Bluetooth (BT) module to communicate with an external device such as a remote controller. This is exemplary only and is not limited thereto.
[0109] In particular, the communicator can receive information about the intensity of reflected light of a specific color wavelength by communicating with the server. The information about the intensity of reflected light of a specific color wavelength will be in Figure 8 Described in detail.
[0110] The display device 100 according to the embodiment may include a memory. The memory may store various data such as an OS software module to drive the display device 100 and various multimedia contents.
[0111] For example, the memory may be implemented as an internal memory such as a read-only memory (ROM) (e.g., an electrically erasable programmable read-only memory (EEPROM)) and a random access memory (RAM), or may be implemented as a memory separate from the processor 130. In this case, according to the data use purpose, the memory may be implemented as a memory implemented in the display device 100, or may be implemented as a detachable memory in the image display device 100. For example, data for driving the display device 100 may be stored in a memory implemented in the display device 100, and data for additional functions of the display device 100 may be stored in a memory detachable to the image processing device. The memory implemented in the display device 100 may be a volatile memory such as a dynamic random access memory (DRAM), a static random access memory (SRAM), a synchronous dynamic random access memory (SDRAM), or a non-volatile memory such as a one-time programmable ROM (OTPROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a shielded ROM, a flash ROM, a flash memory (e.g., a NAND flash memory or a NOR flash memory), a hard disk drive, or a solid state drive (SSD). The memory detachably mounted to the image processing device may be implemented as a memory card (e.g., a compact flash (CF), a secure digital (SD), a micro secure digital (micro-SD), a mini secure digital (mini-SD), an extreme digital (xD), a multimedia card (MMC), etc.), an external memory connectable to a USB port (e.g., a universal serial bus (USB) memory), etc.
[0112] The display apparatus 100 according to the embodiment may include a user interface.
[0113] The user interface may be implemented as a device such as a key, a touch panel, a mouse, and a keyboard, or a touch screen or a remote control receiver capable of performing the above-mentioned display function and operation input function. The key may be various types of keys (such as a mechanical key, a touch panel, a scroll wheel, etc.) formed in any area (such as the front part, the side part, and the back part of the main body of the display device 100).
[0114] The display device 100 according to the embodiment may include input and output interfaces.
[0115] The input and output interfaces may be any of High-Definition Multimedia Interface (HDMI), Mobile High-Definition Link (MHL), Universal Serial Bus (USB), Display Port (DP), Thunderbolt, Video Graphics Array (VGA) port, RGB port, D-Sub (D-SUB), Digital Visual Interface (DVI), etc.
[0116] HDMI is an interface capable of transmitting high-performance data for audio-video (AV) devices that output audio and video. DP can achieve full HD level in 1920 × 1080 format as well as ultra-high-resolution screens (such as 2560 × 1600 or 3840 × 2160 format) and 3D stereoscopic images, as well as a digital voice transmittable interface. Thunderbolt is an input / output interface for high-speed data transmission and connection, and can connect all PCs, displays, and storage in parallel to a single port.
[0117] The input and output interface may input and output at least one of an audio signal and a video signal.
[0118] According to an embodiment, the input and output interface may include a port for inputting and outputting only an audio signal, or a port for inputting and outputting only a video signal as a separate port, or a single port for inputting and outputting an audio signal and a video signal.
[0119] The display apparatus 100 may transmit an image signal to a separate external display device.
[0120] Figure 5 2 is a view provided to describe a sensor arrangement according to an embodiment.
[0121] The sensor 120 according to the embodiment may be arranged in various forms in an outer area of the display 110. The sensor 120 may be implemented as a light receiving element 20. Figure 5 , the outer area of the rectangular display 110 includes four boundary areas, and a plurality of light emitting element groups 10 may be arranged in two adjacent boundary areas of the four boundary areas. In addition, a plurality of light receiving elements 20 may be arranged in the remaining two boundary areas. Alternatively, the display 110 may be configured to have a shape other than a rectangle, and the light emitting elements 10 and the light receiving elements 20 may be arranged on any boundary area of the display 110. In addition, the light emitting elements 10 and the light receiving elements 20 may not be arranged on every boundary area of the display 110, and may be arranged only on some boundary areas of the display 110.
[0122] When the touch position 200 is recognized, the processor 130 according to the embodiment may control light emission from the light emitting element group 10 closest to the recognized touch position 200 among the plurality of light emitting element groups 20 disposed in the two boundary regions.
[0123] As another embodiment, when the touch position 200 is recognized, the processor 130 may control a plurality of light emitting element groups 10 disposed on any one boundary region between two boundary regions to emit light.
[0124] When light emitted by the plurality of light emitting elements 10-1, 10-2, and 10-3 included in the light emitting element group 10 is reflected by the touch pen and received by one or more light receiving elements 20, the processor 130 according to the embodiment may identify the pen color of the touch pen based on the signal intensity of the light received by the light receiving element 20. Figure 5 , a solid line indicates a path of light emitted by each of the plurality of light emitting elements 10 - 1 , 10 - 2 , and 10 - 3 , and a dotted line indicates a path of light reflected by the touch pen.
[0125] Figure 6 is a view provided to describe a sensor arrangement according to still another embodiment.
[0126] refer to Figure 6 , each of the plurality of light receiving elements 20 may be disposed between the plurality of light emitting element groups 10. For example, the first to third light emitting elements 10-1, 10-2, and 10-3 of the first light emitting element group 10 may be disposed continuously, the first to third light emitting elements 10-1, 10-2, and 10-3 of the second light emitting element group 10 may be disposed continuously, and the light receiving element 20 may be interposed between the first light emitting element group and the second light emitting element group.
[0127] like Figure 2 , 5 The position of the sensor 120 shown in FIG. 6 is only an embodiment and is not necessarily limited thereto. For example, the first to third light emitting elements 10-1, 10-2, and 10-3 may be disposed continuously, and two light receiving elements 20 may be disposed continuously. As another example, two light emitting element groups 10 may be disposed continuously, and a light receiving element 20 may be disposed. The display device 100 may include the sensor 120, and the light emitting elements and the light receiving elements in the sensor 120 are arranged in various forms.
[0128] Figure 7 are views provided to describe a light emitting element according to an embodiment.
[0129] refer to Figure 7 , the light receiving element 20 according to the embodiment may be disposed to be inclined toward a direction of the screen of the display 110 .
[0130] The display device 100 according to one embodiment may include a bezel accommodating the display 110. The bezel according to one embodiment may be provided to surround an outer region of the display 110. The display device 100 may include a guide member 30 configured to protrude into one region of the front cover.
[0131] The light receiving element 20 according to the embodiment may be supported by the guide member 30 , and disposed to be inclined toward a direction of the screen of the display 110 .
[0132] According to one embodiment, when the light receiving element 20 is arranged to be tilted at a certain angle, the area for receiving the light emitted from the light emitting element 10 can be set in a relatively wider manner than the light receiving element 20 is arranged to be non-tilted. In addition, since the light receiving element 20 is arranged to be tilted, the light receiving element 20 can basically receive only the light emitted from the light emitting element 10, and does not receive external light such as sunlight. For example, the light receiving element 20 may be arranged to be tilted 90 degrees to 45 degrees relative to the front of the screen of the display 110. However, this is only exemplary, and the light receiving element 20 may be arranged to be tilted at various angles according to the manufacturing method, purpose, etc. of the manufacturer.
[0133] Figure 8 is a graph provided to describe signal strength according to an embodiment.
[0134] The processor 130 according to an embodiment may recognize the color of the pen based on the intensity of a signal received from the light receiving element 20 .
[0135] According to an embodiment, a portion of light of different wavelengths emitted from a plurality of light emitting elements 10-1, 10-2, and 10-3 may be partially absorbed by the touch pen, and the remaining portion may be reflected. For example, light of a first wavelength emitted from the first light emitting element 10-1 may be partially absorbed by the touch pen, and the remaining portion may be reflected. In addition, light of a second wavelength emitted from the second light emitting element 10-2 may be partially absorbed by the touch pen, and the remaining portion may be reflected. Here, depending on the pen color of the touch pen, the intensity at which the light of the first wavelength is reflected and the intensity at which the light of the second wavelength is reflected may be different from each other. For example, if the tip color of the touch pen is red, light of a first wavelength (e.g., red light of about 635nm to 700nm) may be reflected with a relatively strong intensity compared to light of a second wavelength (e.g., orange light of about 590nm to 635nm, yellow light of 560nm to 590nm, green light of 520nm to 560nm, cyan light of 490nm to 520nm, blue light of 450nm to 490nm, or violet light of 400nm to 450nm). In another example, if the tip color is blue, light of a second wavelength (e.g., blue light of 450nm to 490nm) may be reflected with a relatively strong intensity compared to light of the first wavelength excluding the blue light.
[0136] The display device 100 according to the embodiment may include reflected light intensity information of different wavelengths for different colors. For example, reflected light intensity information of the first to third wavelengths of a red object may be included. Figure 8 The illustrated graph is merely an example of reflected light intensity information of first to third wavelengths for red, green, and blue wavelength band objects, but is not limited thereto.
[0137] When the light of the first to third wavelengths emitted by each of the first to third light emitting elements 10-1, 10-2, and 10-3 is reflected by the tip of the touch pen and received by the plurality of light receiving elements 20, the processor 130 according to the embodiment may identify the color of the touch pen based on the intensity of the reflected light of the first to third wavelengths. Figure 8 As shown in the figure, the signal intensity of the reflected light of the first to third wavelengths is similar to green, and the processor 130 can recognize the pen color of the touch pen as green. The display device 100 according to the embodiment may include reflected light intensity information corresponding to each of the various colors.
[0138] Fig. 9 is a flowchart provided to describe a control method of a display device according to an embodiment.
[0139] According to the control method of the display device of the embodiment, in S910, when a touch of the touch pen is sensed on the display, a touch position of the touch pen may be recognized.
[0140] Subsequently, in S920, based on the recognized touch position, a plurality of light emitting elements included in at least one light emitting element group among the plurality of light emitting element groups emit light of different wavelengths.
[0141] In S930 , when lights of different wavelengths are received by the plurality of light receiving elements, the pen color of the touch pen is identified based on the signal intensity of the received light.
[0142] Here, the step S920 of controlling the light of different wavelengths may control so that a plurality of light emitting elements included in at least one light emitting element group sequentially emit light of different wavelengths at different light emitting timings.
[0143] In S930 of identifying the pen color, when sequentially emitted lights of different wavelengths are reflected by a pen tip disposed on the touch pen and received by each of a plurality of light receiving elements, the pen color of the touch pen may be identified based on distribution of signal intensity of the reflected light.
[0144] In step S910, a plurality of light emitting elements included in each of the plurality of light emitting element groups may be controlled to emit light. When the emitted light is received by a plurality of light receiving elements, a touch position may be identified based on the position of the light receiving element whose intensity of received light is less than a predetermined threshold.
[0145] The outer region of the display according to the embodiment may include four boundary regions, the plurality of light emitting element groups may be in two adjacent boundary regions of the four boundary regions, and the plurality of light receiving elements may be disposed in the remaining two boundary regions.
[0146] Each of the plurality of light receiving elements may be disposed between the plurality of light emitting groups, or between the plurality of light emitting elements included in each of the plurality of light emitting element groups.
[0147] In step S920, a plurality of light emitting element groups included in at least one light emitting element group closest to the touch position among the plurality of light emitting element groups may be controlled to emit light.
[0148] The control method according to the embodiment may include displaying a touch track by a touch pen having an identification color.
[0149] The display device according to the embodiment further includes: a bezel provided at an outer region of the display; a guide member formed to protrude from one region of the bezel; and a plurality of light receiving elements that may be supported by the guide member and disposed to be inclined toward a direction of the display screen.
[0150] The method according to various embodiments may be implemented as an application installable in an electronic device.
[0151] The methods according to various embodiments may be implemented only by software upgrade or hardware upgrade for the related art electronic device.
[0152] The various embodiments described above may be executed by an embedded server disposed in the electronic device or at least one external server in the electronic device or the display apparatus.
[0153] At the same time, various embodiments of the present disclosure may be implemented using software, including instructions stored on a machine-readable storage medium that is readable by a machine (e.g., a computer). A device that can call instructions from a storage medium and execute the called instructions includes an electronic device (e.g., electronic device A) according to an embodiment of the present disclosure. When the instruction is executed by a processor, the processor may directly execute the function corresponding to the instruction, or use other components to execute it under the control of the processor. The instruction may include code generated by a compiler or executable code by an interpreter. The machine-readable storage medium may be provided in the form of a non-temporary storage medium. Here, the term "non-temporary" only means that the storage medium does not include a signal but is tangible, and does not distinguish between the case where data is semi-permanently stored in the storage medium and the case where data is temporarily stored in the storage medium.
[0154] In addition, according to one embodiment of the present disclosure, the method according to the above various embodiments may be provided in a computer program product. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may be published in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)) or downloaded through an application store (e.g., Play Store TM ) online (e.g., downloading or uploading). In the case of online distribution, at least part of the computer program product may be temporarily stored, or at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a relay server).
[0155] According to an embodiment, each element (e.g., module or program) of the above-mentioned elements may include a single entity or multiple entities. According to an embodiment, at least one element or operation in the above-mentioned corresponding elements may be omitted, or at least one other element or operation may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be combined to form a single entity. In this case, the integrated entity may perform at least one function of each of the multiple elements in the same or similar manner as performed by the corresponding elements in the multiple elements before integration. According to various embodiments, modules, program modules, or operations performed by other elements may be performed continuously, in parallel, repeatedly, or heuristically, or one or more of the at least some operations may be performed or omitted according to different orders, or one or more other operations may be added thereto.
[0156] In the above, although the embodiments of the present disclosure have been shown and described, it should be understood that the present disclosure is not limited to the disclosed embodiments, and various modifications can be made without departing from the spirit and scope of the present disclosure. Therefore, modifications should not be understood independently of the technical spirit or scope of the present disclosure.
Claims
1. A display device, include: monitor; A frame, disposed at an outer area of the display; a guide member formed to protrude at an area of the frame; a plurality of light emitting elements; a plurality of light receiving elements supported by the guide member and arranged to be inclined in a direction toward a screen of the display; as well as Processor, configured as: Based on sensing the touch of the touch pen on the display, identifying a touch position of the touch pen, Based on the identified touch position, controlling a first light emitting element among the plurality of light emitting elements to emit a first light of a first wavelength, and controlling a second light emitting element among the plurality of light emitting elements to emit a second light of a second wavelength different from the first wavelength, and identifying a first intensity of the first light received by at least one light receiving element among the plurality of light receiving elements, identifying a second intensity of the second light received by the at least one light receiving element, identifying a pen color of the touch pen based on the first intensity and the second intensity, and Based on the sensed touch of the touch pen on the display, the display is controlled to display a touch track in the recognized pen color of the touch pen.
2. The display device according to claim 1, in, The processor is further configured to: The first light emitting element is sequentially controlled to emit first light of the first wavelength at a first light emitting timing, and the second light emitting element is sequentially controlled to emit second light of the second wavelength at a second light emitting timing after the first light emitting timing.
3. The display device according to claim 2, in, The processor is further configured to: The pen color is identified based on a signal intensity distribution of the first intensity and the second intensity.
4. The display device according to claim 1, in, The processor is further configured to: detecting a touch of the touch pen on the display, controlling at least one of the plurality of light emitting elements to emit light, and A touch position of the touch pen on the display is recognized based on the intensity of the light emitted by the at least one light emitting element received by the plurality of light receiving elements.
5. The display device according to claim 1, further comprising: include: an outer area of the display, the outer area comprising four border areas, The plurality of light emitting elements are disposed at two adjacent boundary regions among the four boundary regions, and the plurality of light receiving elements are disposed at two remaining boundary regions among the four boundary regions.
6. The display device according to claim 1, in, Each of the plurality of light receiving elements is disposed between the groups of the plurality of light emitting elements, or is disposed alternately with each of the plurality of light emitting elements.
7. The display device according to claim 1, in, The processor is further configured to: Based on a touch position of the touch pen, the first light emitting element is selected from the plurality of light emitting elements to emit first light of the first wavelength, and the second light emitting element is selected from the plurality of light emitting elements to emit second light of the second wavelength.
8. A method for controlling a display device, the method include: Based on sensing the touch of the touch pen on the display device, identifying a touch position of the touch pen; Based on the identified touch position, controlling a first light emitting element among the plurality of light emitting elements of the display device to emit a first light of a first wavelength, and controlling a second light emitting element among the plurality of light emitting elements of the display device to emit a second light of a second wavelength different from the first wavelength; identifying a first intensity of the first light received by at least one light receiving element among a plurality of light receiving elements of the display device, identifying a second intensity of the second light received by at least one light receiving element of the display device; identifying a pen color of the touch pen based on the first intensity and the second intensity; as well as Based on the sensed touch of the touch pen on the display of the display device, controlling the display to display a touch track in the recognized pen color of the touch pen, The display device further includes: a frame disposed at an outer area of the display; and a guide member formed to protrude at an area of the frame, The plurality of light receiving elements are supported by the guide member and arranged to be inclined toward a screen of the display.
9. The method according to claim 8, in, The controlling the first light emitting element and the second light emitting element comprises: controlling the first light emitting element to emit the first light of the first wavelength at a first light emission timing; and The second light emitting element is controlled to emit second light of the second wavelength at a second light emitting timing after the first light emitting timing.
10. The method according to claim 9, in, The identification includes: The pen color is identified based on a signal intensity distribution of the first intensity and the second intensity.
11. The method according to claim 8, further comprising: include: Detecting a touch of the touch pen on the display; Controlling at least one light emitting element among the plurality of light emitting elements to emit light; as well as A touch position of the touch pen on the display is recognized based on the intensity of the light emitted by the at least one light emitting element received by the plurality of light receiving elements.
12. The method according to claim 8, in: The display device includes an outer region, the outer region includes four border regions, and The plurality of light emitting elements are disposed at two adjacent boundary areas among the four boundary areas, and the plurality of light receiving elements are disposed at two remaining boundary areas among the four boundary areas.
13. The method according to claim 8, in, Each of the plurality of light receiving elements is disposed between the groups of the plurality of light emitting element groups, or is disposed alternately with each of the plurality of light emitting elements.
14. The method according to claim 8, further comprising: include: Based on a touch position of the touch pen, the first light emitting element is selected from the plurality of light emitting elements to emit first light of the first wavelength, and the second light emitting element is selected from the plurality of light emitting elements to emit second light of the second wavelength.
