Electronic whiteboard with improved handwriting recognition performance

Abstract

The present invention relates to an electronic whiteboard with improved handwriting recognition for an optical touch panel, and an operation method thereof. An objective of the present invention is to provide an optical electronic whiteboard and an operation method thereof, in which an object and a touch position of the object can be precisely identified by overcoming physical limitations, such as a size of a light-emitting element in a touch screen using an optical ray touch panel. To this end, according to the present invention, in the electronic whiteboard which recognizes coordinates of an object from sensing data sensed through an optical processing unit, and comprises a screen for visually displaying content generated on the basis of the recognized coordinates of the object: the optical processing unit comprises an optical transmission unit including a plurality of light-emitting elements installed on the screen, and an optical reception unit including a plurality of light detection sensors installed at positions corresponding to the optical transmission unit so as to receive optical rays emitted from the light-emitting elements; the optical transmission unit includes the light-emitting elements for emitting optical rays, and an optical path converter installed on the front portion of the light-emitting elements so as to convert the direction of the optical rays emitted from the light-emitting elements; and the optical path converter is a prism sheet having a trapezoidal prism pattern formed thereon, and converts the direction of the optical rays emitted from the light-emitting elements into a plurality of directions.

Description

Electronic whiteboard with improved handwriting recognition performance

[0001] The present invention relates to an electronic whiteboard with improved handwriting recognition performance of an optical touch panel and a method of operation thereof. More specifically, the invention relates to an electronic whiteboard with improved handwriting recognition performance and a method of operation thereof by providing infrared emitting / receiving sensors on the top / bottom and left / right sides of the touch panel, differentiating the wavelength and phase of each infrared, and determining touch coordinates by processing the paths and changes in light intensity of two or more identified different infrareds.

[0002] An electronic whiteboard refers to a device that allows users to directly input content they wish to display on a screen by touching an object, such as a stylus or finger, on a touch panel combined with a screen; recently, there has been a trend toward gradually increasing the size of such devices.

[0003] The touch panels of electronic whiteboards are equipped with sensors to recognize object-based touches; to address the issues of recognition rate and writing feel, which are pointed out as drawbacks of resistive touch panels, electronic whiteboards employing capacitive or optical touch panels are primarily used.

[0004] Generally, in the case of an optical touch panel, the method for determining the writing position involves detecting the light emitting element of the light transmission unit in a one-to-one correspondence with the light receiving sensor of the light receiving unit to determine the writing position, and means a method of detecting the XY coordinates of a contacted object by densely arranging the light transmission unit and the receiving sensor on the top, bottom, left, and right sides of the display to form a matrix with light rays. In the case of electronic whiteboards that have recently adopted a touch method utilizing light rays, multi-point input is possible, and thus support swipe control or pinch zoom.

[0005] In this technology, light radiated from a light-emitting element is detected in a one-to-one correspondence with a light detection sensor of a light receiver to determine the writing position. However, the area in which the light radiated from the light-emitting element can be detected by the light detection sensor is limited by the physical size of the light-emitting element and the light detection sensor. Therefore, there is a problem in that the writing position cannot be determined in the area where light is not transmitted from the light-emitting element to the light detection sensor, i.e., the area where the writing position cannot be determined.

[0006] As a method to solve these problems, Korean Registered Patent Publication No. 10-1890695 discloses a technology that improves the handwriting recognition rate by reducing the unrecognized portion of the handwriting through an increase in the number of light receiving sensors that receive and process light rays emitted from a single light-emitting element; however, there are still limitations in accurately recognizing objects or accurately displaying the handwriting content of objects.

[0007] In addition, there is Korean Registered Patent No. 10-2446679, which enables multi-touch input while recognizing touch based on light rays. In this technology, light sensing data is checked in which the amount of light ray is measured in an initial state where no object is detected, through a plurality of sensing light sensors configured to identify two types of light rays and including at least two types of light-emitting elements. If a change in the amount of light ray is confirmed in at least a portion of the light ray amount in the initial state, two or more sensing light sensors that detected the change in the amount of light are checked.

[0008] However, this invention also has limitations in increasing precision because the spacing of light rays cannot be finely configured due to the structure of the light-emitting element, and there is a problem in that a large amount of computation is required to determine the touch coordinates due to interfering light rays.

[0009] (Prior Art Literature)

[0010] (Patent Literature)

[0011] (Patent Document 1) Registered Patent Publication 10-1890695 B1 (Published Aug. 16, 2018)

[0012] (Patent Document 2) Registered Patent Publication 10-2446679 B1 (Published Sep. 20, 2022)

[0013] The present invention aims to solve the aforementioned problems by providing an optical electronic whiteboard and a method of operation thereof that can precisely identify objects and their touch locations by overcoming physical limitations, such as the size of light-emitting elements, in a touchscreen using a light touch panel.

[0014] In addition, the purpose is to provide an optical electronic whiteboard and a method of operation thereof that improves the accuracy of touch recognition by overcoming physical limitations, such as the size of light-emitting and receiving elements, through processing the respective paths and changes in light intensity of two or more different infrared rays.

[0015] In addition, the present invention aims to provide an electronic whiteboard and a method of operation thereof that can accurately determine the touch coordinates of an object and precisely and accurately identify the touch location according to the movement of an object by determining the position of an object using multiple light rays emitted from a single light-emitting element or a group of two or more light-emitting elements, rather than determining the position of an object using a single light-emitting element and a single sensing light sensor.

[0016] The problems to be solved through the various embodiments of the present invention are not limited to those mentioned, and other unmentioned problems will be clearly understood by those skilled in the art from the description below.

[0017] An electronic whiteboard with improved writing recognition performance according to the present invention, which performs the task of achieving the above-mentioned purpose and eliminating conventional defects, comprises a screen that recognizes the coordinates of an object from sensing data sensed through a light processing unit and visually displays content generated based on the recognized object coordinates. The light processing unit comprises a light transmission unit including a plurality of light-emitting elements installed on the screen and a light reception unit including a plurality of sensing light sensors installed at a position corresponding to the light transmission unit to receive light rays emitted from the light-emitting elements. The light transmission unit comprises a light-emitting element that emits light rays and a light path converter installed on the front of the light-emitting element to convert the direction of the light rays emitted from the light-emitting element. The light path converter is characterized by being a prism sheet having a trapezoidal prism pattern formed thereon, which converts the direction of the light rays emitted from the light-emitting element into a plurality of directions.

[0018] The above prism pattern includes a support film, wherein the wider side of the trapezoid is positioned toward the light-emitting element and the narrow side is positioned toward the outside.

[0019] It is preferable that the pitch of the above prism pattern is 0.5 times or less the length of the light-emitting element, and the inclined surface of the trapezoid of the above prism pattern is 45° to 60°.

[0020] The above-mentioned optical path converter is attached to the surface of a transparent support, and it is preferable that a thin light-absorbing film is formed on the inclined surface of the trapezoidal side of the prism pattern.

[0021] The above optical path converter is preferably a laminated prism sheet having a double-layer laminated structure in which an upper prism sheet having a first pattern in a first direction on one side and a lower prism sheet having a second pattern in a second direction on one side are combined with an adhesive layer in between.

[0022] The above-described optical path converter is a composite prism sheet having a composite structure in which a prism sheet having a first pattern in a first direction on one side and a lower prism sheet having a second pattern in a second direction on one side are overlapped to form a plurality of square-shaped patterns with each side being trapezoidal, and it is preferable that the first direction and the second direction are different directions and that the two directions are perpendicular to each other.

[0023] The above prism pattern is preferably formed by applying a UV-curable resin solution to one surface of a support film made of at least one of polyethylene terephthalate or polyethylene naphthalate, which is a transparent material capable of transmitting light, and curing it by irradiating it with light.

[0024] It is preferable that the above-mentioned optical transmission unit includes an optical filter that filters the direction of the light beam.

[0025] According to various embodiments of the present invention, by setting the wavelength, phase, etc. of the light rays emitted by light-emitting elements constituting a light touch panel differently from each other, the judgment error caused by interference of light rays can be reduced and the accuracy of the operation for determining touch coordinates can be improved when determining the touch coordinates of an object touching the touch panel.

[0026] According to various embodiments of the present invention, by changing the wavelength and phase of the light rays, even if a problem occurs in a light-emitting element of some wavelengths, it is compensated for through a light-emitting element of other wavelengths, thereby preventing a rapid decline in performance in the operation of determining the touch coordinates of an object and thus improving user satisfaction.

[0027] According to various embodiments of the present invention, the performance of character implementation can be improved by accurately determining the touch coordinates of an object through light rays of various wavelengths and phases, and thus natural handwriting by the user can be induced.

[0028] FIG. 1 is a drawing showing the configuration of an electronic whiteboard according to one embodiment of the present invention.

[0029] FIG. 2 is a drawing for explaining the configuration of a touch panel and the operation of a light processing unit constituting the touch panel according to an embodiment of the present invention.

[0030] FIG. 3 is a diagram schematically showing the side configuration of a touch panel according to one embodiment of the present invention.

[0031] FIG. 4 is a schematic diagram showing a light beam that is changed by an optical path converter in a touch panel according to one embodiment of the present invention.

[0032] FIG. 5 is a diagram showing the configuration of an optical path converter according to one embodiment of the present invention.

[0033] FIG. 6 is a diagram showing the configuration of an optical path converter according to another embodiment of the present invention.

[0034] FIG. 7 is a flowchart of the operation of recognizing writing on an electronic whiteboard and displaying it on a screen according to one embodiment of the present invention.

[0035] (Explanation of symbols)

[0036] 1 : Electronic Whiteboard 10 : Touch Panel

[0037] 20 : Control unit 30 : Storage unit

[0038] 40: Communication Unit 11, 12: Optical Transmission Unit

[0039] 13, 14 : Photoreceiver 320 : Light-emitting element

[0040] 340 : Optical path converter 420 : Detecting optical sensor

[0041] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. However, since the drawings attached to this specification serve to facilitate understanding of the technical concept of the present invention together with the detailed description of the invention, the present invention should not be interpreted as being limited only to the matters described in the drawings.

[0042] Furthermore, the terms used in the embodiments are for illustrative purposes only and should not be interpreted as intended to limit the scope of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "comprising," "having," "connecting," "combining," and "connected" are intended to indicate the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0043] FIG. 1 is a drawing showing the configuration of an electronic whiteboard according to one embodiment of the present invention.

[0044] Referring to FIG. 1, the electronic whiteboard (1) includes a touch panel (10), a control unit (20), a storage unit (30), and a communication unit (40).

[0045] The control unit (20) recognizes the coordinates of an object from the sensing data sensed through the light processing unit of the touch panel (10), and displays the content generated based on the recognized object coordinates on the screen (250).

[0046] In addition, when a user writes characters through an object, the control unit (20) can generate content as characters and display it on the screen by implementing the user's handwriting, such as the shape, thickness, and texture of the characters, in response to the movement of the object.

[0047] The control unit (20) may apply an artificial intelligence algorithm to identify touch coordinates corresponding to the user's handwriting and to generate content based on the identified coordinates. For example, the control unit (20) may generate the shape of content that matches the handwriting by applying the identified touch coordinates to a regression analysis algorithm learned as input values.

[0048] The control unit (20) can determine a deletion area of ​​the content for distinguishing characters by applying a regression analysis algorithm learned with the identified touch coordinates and / or the determined characters as input values ​​when the content determined based on the identified touch coordinates is two or more connected characters.

[0049] As described above, the control unit (20) can improve the accuracy of content implementation for the user's handwriting by identifying the touch coordinates of an object input through the touch panel (10) through an artificial intelligence algorithm and generating content based on the identified touch coordinates.

[0050] In addition, the control unit (20) can recognize the user's voice input through a microphone (not shown) using artificial intelligence technology (e.g., STT (speak to text), natural language processing technology, etc.).

[0051] The control unit (20) can improve the accuracy of content implementation for the user's handwriting by applying input user voice when implementing content corresponding to the coordinates based on touch coordinates identified through the touch panel (10).

[0052] Additionally, the electronic whiteboard (1) may control peripheral devices (e.g., lighting, beam projector, speaker, etc.) of the electronic whiteboard (1) based on the user's handwriting (or content implemented based on handwriting) and / or voice recognized through artificial intelligence technology, etc. For example, identified touch coordinates, content implemented based thereon, and / or identified voice may include control commands for controlling the electronic whiteboard (1) or related peripheral devices.

[0053] When the control unit (20) confirms a control command, it can perform an operation of the electronic whiteboard (1) corresponding to the control command through a program for processing the control command (app, application, tool, plugin, etc., hereinafter referred to as a data processing program), or transmit data to control the operation of a peripheral device connected to the electronic whiteboard (1) through the communication unit (40).

[0054] In the following various embodiments, the electronic whiteboard (1) performing or providing data processing (or events) related to control commands can be understood as performing an operation specified through at least one data processing related program of the electronic whiteboard (1).

[0055] The storage unit (30) can store various data processed by the control unit (20) or the communication unit (40), which is at least one component of the electronic whiteboard (1). The data may include, for example, a program (or software) for processing data input through the touch panel (10), data, input data or output data regarding various writings generated based on the data and related commands.

[0056] The storage unit (30) may include at least some of the following information as light information: coordinate information set on the screen (250), identification codes of detection light sensors, identification codes of light-emitting elements, identification codes for light-emitting elements designated to identify each detection light sensor, light paths between them, and coordinates included in each of the light paths.

[0057] In addition, the storage unit (30) may store at least some of the information as light information, including a light having a specific coordinate as a path for at least some of the coordinates of the screen (250), an identification code of a light-emitting element transmitting a light that includes the specific coordinate in the path, an identification code of a detection light sensor receiving a light that includes the specific coordinate in the path, a type of light (e.g., wavelength, phase, etc.) and amount of light emitted from each light-emitting element, the amount of light measured by a detection light sensor receiving the light when there is no object on the screen (250) (initial state), and the amount of light measured by a detection light sensor receiving the light when an object is located at a specific coordinate on the screen (250).

[0058] Additionally, the storage unit (30) may store at least some of the light information as a mapping table. For example, it may store as a mapping table for determining coordinates that match information such as sensing data measured according to the state in which an object is positioned on the screen (250), that is, a detection light sensor that detects a change in the amount of light received at a specific location where the object is positioned, a light-emitting element that emits the light with a change in amount of light, a change in the amount of light for each light with a change in amount of light, the position of the object, and the measured amount of light.

[0059] The storage unit (30) can store information such as at least one character shape and a pattern in which the character is written. For example, it stores information about the shape of each character, character, symbol, etc. (hereinafter referred to as character) of various languages, including Hangul and the alphabet, and also includes information about the writing pattern, such as the order in which the character is written and / or curvature.

[0060] For example, the storage unit (30) contains information regarding the morphological characteristics of the character 'ga' in the case of Hangul, and also stores information regarding the order in which the character 'ga' is written. In addition, the storage unit (30) can store information regarding the morphological characteristics of a word as well as information regarding the order in which the word is written.

[0061] The storage unit (30) may include an artificial intelligence algorithm that includes at least some of an artificial neural network algorithm, a blockchain algorithm, a deep learning algorithm, a regression analysis algorithm and related mechanisms, operators, language models, and big data for providing data processing.

[0062] For example, the storage unit (30) may include an algorithm for generating implemented content based on touch coordinates input through the touch panel (10) and / or an algorithm for performing a specified action in relation thereto. Additionally, the storage unit (30) may include an algorithm for identifying a user through touch coordinates input through the touch panel (10) and implemented content and / or an algorithm for performing a specified action in relation thereto.

[0063] The storage unit (30) can store various information related to voice processing input through the microphone. For example, the storage unit (30) may include at least one algorithm for processing voice from audio input through the microphone, such as a voice recognition algorithm, a speaker recognition algorithm, and a natural language processing algorithm.

[0064] Additionally, the storage unit (30) may include at least one algorithm for processing touch input through the touch panel (10), such as a touch pattern recognition algorithm, a voice linkage algorithm, and a touch user distinction algorithm.

[0065] The storage unit (30) may include data for determining and processing designated control and operation through signals confirmed through each device included in the touch panel (10). The data stored in the storage unit (30) is processed by the control unit (20), and data for processing related operations, data being processed, processed data, pre-set data, etc., may be stored in the storage unit (30) as a database.

[0066] Data stored in the storage unit (30) can be changed, modified, deleted, or created through the control unit (20) based on the administrator input of the electronic whiteboard (1) or the user input of the user device.

[0067] The communication unit (40) can support the establishment of a wired communication channel between the electronic whiteboard (1) and at least one other electronic device (e.g., user device, or server), the establishment of a wireless communication channel, and the performance of communication through the established communication channel.

[0068] The communication unit (40) may include one or more communication processors that support wireless communication and operate dependently or independently of the control unit (20). According to one embodiment, the communication unit (40) may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) or a wired communication module (e.g., a LAN (local area network) communication module, or a power line communication module).

[0069] The touch panel (10) may be configured to include a touch input capable screen. The touch panel (10) may be configured to include a light processing unit for recognizing an object approaching the touch panel and an object in contact with the screen through a light beam, and a screen (250) for visually displaying content generated based on the recognized object.

[0070] The touch panel (10) may be configured as a touch screen including a light processing unit as an input unit and a screen (250) that visually displays processed information as an output unit. Hereinafter, according to various embodiments of the present invention, the touch panel (10) is described as referring to a touch screen unless specifically mentioned otherwise.

[0071] The electronic whiteboard (1) can recognize the user's writing by processing the sensing data of an object that approaches, contacts, and / or moves to the touch panel (10) through the user via the control unit (20).

[0072] The control unit (20) receives light rays emitted from a light-emitting element constituting the light processing unit of the touch panel (10) at a detection light sensor, and can determine the touch coordinates where the object is located on the screen (250) and / or the distance the object is from the screen (250) based on the light rays that are blocked by the object being located between them.

[0073] To this end, the touch panel (10) is configured such that two or more light paths intersect, and can determine the touch coordinates of an object and / or the distance from the screen (250) to the object based on the light information and light intensity of the intersecting light and the light information and light intensity of the light that is blocked by the object.

[0074] Additionally, the control unit (20) can identify an object when it is within a specified distance from the screen (250) without the object directly contacting the screen (250) through the operation of the light processing unit constituting the touch panel (10), and can process the object to perform a specified action while not in contact with the screen (250). According to various embodiments, a touch input that processes a specified action while the object is not in contact with the screen (250) can be defined as an air touch.

[0075] The object used for writing on the touch panel (10) may be configured to include at least one of a part of the user's body, such as a finger or palm, for performing touch input, or a means for touch (e.g., a stylus, a touch pen).

[0076] In addition, the electronic whiteboard (1) may further include at least some of an input unit (not shown) for inputting data such as a keyboard and mouse, and an output unit (not shown) for outputting data such as a speaker, a driving unit, and a separate screen.

[0077] According to various embodiments, the electronic whiteboard (1) or user device may include at least some of the functions of all information and communication devices, including mobile communication terminals, multimedia terminals, wired terminals, fixed terminals, and internet protocol (IP) terminals.

[0078] The electronic whiteboard (1) may be configured to include at least some functions of a workstation or a large-capacity database as a device for data processing, or to be connected via communication.

[0079] Referring to FIG. 2, the touch panel (10) may be configured to include a light processing unit and a screen (250) that visually displays content generated based on a recognized object.

[0080] The screen (250) may be configured to include a screen panel (251) on which writing content is displayed and a protective layer (252) composed of a glass film, synthetic resin, etc., that protects the screen panel (251).

[0081] The light processing unit is formed inside the bezel (210, 220, 230, 240), which is the border area of ​​the screen (250), and the light processing unit may include a light transmission unit (11, 12) configured to include a light emitting element that generates and emits light to detect an object, and a light receiving unit (13, 14) configured to include a detection light sensor that receives light.

[0082] The light processing unit may be composed of multiple sets based on the shape of the screen, and as shown in FIG. 2, the touch panel (10) configured in a rectangular shape may be configured to include a light processing unit composed of a total of two sets, one upper and lower set (12, 13) and one left and right set (11, 14).

[0083] The first set of light processing units (hereinafter, the first light processing units) configured on the upper and lower sides of the touch panel (10) may be configured with a first light transmission unit (12) on the lower bezel of the screen (250) and a first light reception unit (13) on the upper bezel of the screen (250).

[0084] Additionally, the second set of light processing units (hereinafter, second light processing units) configured on the left and right sides of the touch panel (10) may have a second light transmission unit (11) configured on the left bezel of the screen (250) and a second light reception unit (14) configured on the right bezel of the screen (250).

[0085] FIG. 3 is a diagram showing the touch panel (10) of FIG. 2 cut from top to bottom and schematically illustrating the left cut surface.

[0086] The first light transmission unit (12) of the touch panel (10) may be configured to include a PCB (310) and at least one light-emitting element mounted on the PCB (310).

[0087] Here, the PCB (310) is positioned perpendicular to the screen (250) inside the first bezel (210). Additionally, the first bezel (210) may be positioned in contact with the side of the screen (250), with a portion protruding above the upper surface of the screen (250). Furthermore, the light-emitting element may be attached to the portion of the light-transmitting PCB (310) that is positioned higher than the screen (250) so as to be horizontal with respect to the screen (250).

[0088] A light filter (330) for filtering the wavelength of light rays may be installed on the front surface of the light-emitting element. The light filter (330) can filter the wavelength of light rays emitted from the light-emitting element and incident on the light filter (330). For example, the light filter (330) can remove a portion of light corresponding to wavelengths other than the infrared region among the light rays incident on the light filter (330). For example, the light rays passing through the light filter (330) may have a higher infrared ratio compared to the light rays incident on the light filter (330).

[0089] A light path converter (340) that converts the direction of a light ray emitted from a light-emitting element or a light filter (330) is installed on the front portion of the light filter (330).

[0090] As shown in Fig. 4, the optical path converter (340) is a prism sheet formed with a support film (341) and a trapezoidal prism pattern (342) formed on the support film (341), and is attached to the surface of a transparent support (350) formed of transparent glass to seal the light transmission unit and convert the direction of the light radiated from the light-emitting element into a certain direction.

[0091] As shown in FIG. 6, the optical path converter (340) may be a laminated prism sheet having a double-layer laminated structure in which an upper prism sheet having a first pattern in a first direction on one side and a lower prism sheet having a second pattern in a second direction on one side are combined with an adhesive layer in between.

[0092] In addition, as shown in FIG. 6, a composite prism sheet having a composite structure in which a prism sheet having a first pattern in a first direction on one side and a lower prism sheet having a second pattern in a second direction on one side are overlapped to form a plurality of square-shaped patterns with each side being trapezoidal, wherein the first direction and the second direction are different directions and the two directions may be perpendicular.

[0093] This prism pattern (342) can be manufactured by applying a UV-curable resin solution to one side of a support film made of at least one of polyethylene terephthalate or polyethylene naphthalate, which is a transparent material capable of transmitting light, and curing it by irradiating it with light.

[0094] The prism sheet configured in this way has a trapezoidal wide side (346) positioned toward the light-emitting element and a narrow side (345) positioned toward the outside, and the pitch of the prism pattern (342) is formed to be 0.5 times or less the length of the light-emitting element, thereby decomposing the light radiated from one light-emitting element into a set of multiple light rays, and the decomposed light rays are divided into a set of light rays similar to the direction perpendicular to the prism, a set of light rays similar to the direction reflected by the left side of the prism, and a set of light rays similar to the direction reflected by the right side of the prism.

[0095] Meanwhile, the light energy of a set of rays similar to the direction of reflection by the trapezoidal side of the prism pattern is less than the light energy of a set of rays similar to the direction perpendicular to the prism. Additionally, a thin light-absorbing film can be formed on the inclined surface of the trapezoidal side of the prism pattern. When the light-absorbing film is formed, the light energy of a set of rays similar to the direction of reflection by the trapezoidal side of the prism pattern becomes even less, thereby enabling the light receiver to detect the position of an object more accurately, as described below.

[0096] As shown in FIG. 3, the first light receiver (400) may be configured to include at least one sensing light sensor (420) mounted on the light receiver PCB (410) and the light receiver PCB (323).

[0097] Here, the light receiver PCB (410) may be positioned vertically to the screen (250) inside the second bezel (303). Additionally, the second bezel (303) may be positioned in contact with the side of the screen (250), with a portion protruding above the upper surface of the screen (250). Furthermore, the detection light sensor (420) may be attached horizontally to the screen (250) at a portion of the light receiver PCB (410) that is positioned higher than the screen (250).

[0098] Here, the sensing light sensor (420) for identifying various directions may be configured to identify a range of light directions in a single sensing light sensor, or it may be configured to include a plurality of sensing light sensors capable of identifying different or partially overlapping ranges of light directions, for example, a sensing light sensor for a first direction range, a sensing light sensor for a second direction range, and a sensing light sensor for a third direction range. In this case, when including a plurality of sensing light sensors, the plurality of sensing light sensors may be configured as a single module.

[0099] The electronic whiteboard (1) configured as described above operates as described below.

[0100] First, referring to the illustration in FIG. 4, a light ray emitted from a single light-emitting element and incident on the wider side (346) of the lower trapezoid of the optical path converter (340) can be divided into a light ray set A (5A, 6A) that passes through the narrow side (345) of the upper trapezoid without reflection, a light ray set B (5B, 6B) that passes through the narrow side (345) after being reflected by the right slope of the trapezoid, and a light ray set C (5C, 6C) that passes through the narrow side (345) after being reflected by the left slope of the trapezoid. Here, since line set A travels in a straight line without being reflected from the reflective surface, it has a higher energy level and a phase difference compared to light ray sets B and C, which have a reflection path.

[0101] Meanwhile, light beam sets A, B, and C are configured to receive and identify from multiple detection light sensors.

[0102] Referring to FIG. 2, the light emitted from the 6th light-emitting element of the first light transmission unit (12) can be configured to be identified by the 5th, 6th, and 7th detection light sensors of the light reception unit (13).

[0103] In addition, there is a difference in the amount of light received by each light sensor depending on the position (R, S, T) of the object. For example, when the object is at position R, light sensor 5 receives light 5A, when the object is at position S, light sensor 5 receives light 5A and 6B, and when the object is at position S, light sensor 5 receives light 5A and 6B.

[0104] Also, when the object is at position R, the 6th detection light sensor receives rays 6A and 7B, when the object is at position S, the 6th detection light sensor receives 7BA and 6C, and when the object is at position T, the 6th detection light sensor receives rays 5C and 7B.

[0105] The control unit (20) calculates the amount of light received by each of the multiple light detection sensors relative to the amount of light emitted from each light-emitting element according to the type and location of the object by means of artificial intelligence, stores it in the storage unit, and can determine the touch coordinates of the object and / or the distance the object is from the screen (250) based on this.

[0106] Referring to FIG. 2, for example, in an initial state (a state without an object), the amount of light emitted from light-emitting element 6 is compared with the amount of light received by each of detection light sensors 5, 6, 7, and 8 after conversion by the light-converter, and in a state where an object is present, the change in the amount of light emitted from light-emitting element 6 is compared with the amount of light received by each of detection light sensors 5, 6, 7, and 8 after conversion by the light-converter according to the type and location of the object, and the touch coordinates of the object and / or the distance the object is separated from the screen (250) can be determined.

[0107] In addition, when two or more light-emitting elements are formed as a group, the change in light intensity can be calculated using two or more light-emitting elements and a plurality of corresponding light sensors to determine the touch coordinates of the object and / or the distance the object is from the screen (250).

[0108] Thus, the touch panel (10) determines the position of an object using multiple light rays emitted from one light-emitting element or a group of two or more light-emitting elements, rather than using one light-emitting element and one detection light sensor to determine the position of the object, thereby not only accurately determining the touch coordinates of the object but also finely and accurately identifying the touch position according to the movement of the object.

[0109] Referring to the second light processing unit, a light ray emitted from a single light-emitting element can be configured in a 1:1 manner so that it is received and identified by a single detection light sensor. Accordingly, in various embodiments, the light path between the first light-emitting element of the second light processing unit and the first detection light sensor can be defined as the first light path, and the light path between the second light-emitting element of the second light processing unit and the second detection light sensor can be defined as the second light path.

[0110] However, not limited to this, the second light processing unit may also be configured to receive and identify light emitted from a single light-emitting element at a plurality of detection light sensors, just like the first light processing unit.

[0111] As described above, one sensing light sensor constituting the first light processing unit can identify light emitted from a plurality of light-emitting elements based on configuration and setting information.

[0112] The control unit (20) can determine the coordinates where an object is located based on the ray information of the coordinates where an object is located on the screen (250) and the object sensing data of the light processing unit, and can determine the distance of the object from the screen (250).

[0113] Here, with respect to the ray information of the coordinates where an object is located on the screen (250), the storage unit (30) of the electronic whiteboard (1) may include at least some of the following information as ray information: coordinate information set on the screen (250), identification code for each detection light sensor and identification code for a light-emitting element designated to identify each detection light sensor, the ray path between them, and coordinates included in each of the ray paths.

[0114] Here, the ray path can be determined as an area including multiple coordinates based on the ray wavelength and ray intensity, as shown in FIG. 2, and a weight for position accuracy can be applied based on the distance from the centerline of the path.

[0115] Additionally, the light information may further include at least some information among a light having a path to the coordinates for each of the coordinates set on the screen (250), an identification code of a light-emitting element transmitting a light having a path to the coordinates and an identification code of a receiving light sensor, a type of light (e.g., wavelength, phase, etc.) and amount of light emitted from each of the light-emitting elements, a light amount of light measured by a light sensor receiving a light when there is no object on the screen (250) (initial state), and a light amount of light measured by a light sensor receiving a light when an object is located at a specific coordinate on the screen (250).

[0116] Additionally, the light information can be stored as a mapping table, which includes sensing data measured according to the state in which an object is positioned on the screen (250), namely, a detection light sensor that detects a change in the amount of light received at a specific location where the object is positioned, a light-emitting element that emits the light with a change in amount of light, a change in the amount of light for each light with a change in amount of light, and information such as the amount of light measured before and after the object's position.

[0117] The object sensing data of the light processing unit includes light measurement data measured at each of the detection light sensors of the touch panel (10) while the object is positioned at a specific location on the screen (250), and the light measurement data may include information related to light rays having multiple wavelengths and light quantities measured at each detection light sensor.

[0118] The control unit (20) can identify the change in wavelength and amount of light of a light that has changed in the amount of light of light based on light information and object sensing data, identify the light-emitting element that emitted the changed light, and extract coordinates based on the identified information and mapping table.

[0119] The control unit (20) can accurately determine the position of an object by finely varying the ratio of various wavelengths of light that have changed in response to the fine movement of an object occurring on the screen (250), additionally confirming a new wavelength of light that has changed, and / or confirming that a specific wavelength of light that has changed returns to its initial state.

[0120] If the position of the coordinates is determined based on the ratio of various rays that are detected to the coordinates where the object is located on the screen (250), the control unit (20) can determine the distance the object is from the screen (250) based on the amount of light (or the amount of change in light) of the various rays that are detected to the change.

[0121] When writing is written on the screen of the touch panel (10) through an object based on the above-described configuration, the control unit (20) identifies the coordinates where the object is located and the coordinates where it moves, and can determine what kind of character the written character is by recognizing the shape of the written character and the order in which the character is written based on the identified coordinates and the movement of the coordinates. The control unit (20) can display the determined character on the screen (250) by implementing it identically or similarly as the written character.

[0122] The purpose of implementing the user's handwriting delicately and accurately through the touch panel (10) of the electronic whiteboard (1) according to various embodiments is to display the user's handwriting characteristics, such as the shape of letters and / or figures, changes in the writing feel according to the user's strength and pressure, and characteristics of the handwriting, on the screen (250).

[0123] Additionally, the control unit (20) can implement the user's handwriting and analyze the shape of the current character and neighboring characters among the characters of the content displayed on the screen (250), and if the identification of at least some of the characters and neighboring characters is unclear, it can refer to the character shape and handwriting pattern stored in the database to adjust the thickness of the characters displayed on the screen (250) and delete parts that are unnecessarily connected between neighboring characters to clearly display each neighboring character.

[0124] Additionally, the control unit (20) determines that the user has started writing with the object at a specified distance from the screen (250) while not in contact with the screen of the touch panel (10), and when implementing the written characters through this air touch, the characters may be implemented with unnecessary parts connected between the characters.

[0125] At this time, the control unit (20) can remove unnecessary parts connected between characters based on the characters confirmed in the database based on the implemented characters and the shape of the implemented characters.

[0126] The control unit (20) can determine and delete unnecessary parts of a character by comparing at least some conditions of the character shape, strokes, and ratios of strokes confirmed through the database with the implemented characters, and then output the result to the screen (250).

[0127] Additionally, the control unit (20) can adjust the height (d) (or thickness) of the air touch layer based on the initial state light intensity emitted through the light transmission unit of the touch panel (10), for example, the light intensity emitted by each of the light-emitting elements included in the light transmission unit, and / or the light reception sensitivity of the light receiver for determining the air touch and writing of the object.

[0128] According to one embodiment, the control unit (20) determines the user's handwriting at the time when the air touch starts and can control the thickness (or thickness) of the points and / or lines implemented, i.e., characters, to be thick depending on the degree to which the object is close to the screen (250).

[0129] That is, when a user writes characters by touching an object to the screen (250), the maximum thickness of the characters can be implemented as the thickness confirmed at the time the object touches the screen (250). At this time, the control unit (20) can adjust the maximum thickness of the characters (or stroke thickness) when implementing the written characters by adjusting the height (d) of the air touch layer.

[0130] According to one embodiment, the light reception sensitivity of the light receiver is determined according to the numerical value (or value) of the light reception sensitivity, as it relates to the amount of change in the amount of light to determine when an air touch of an object begins relative to the amount of light in the initial state, and the control unit (20) can determine the starting point of the air touch according to the light reception sensitivity by processing the amount of light measured by the detection light sensor.

[0131] For example, if the light reception sensitivity is set to 10%, the control unit (20) can determine that the initial state light intensity measured by the light sensors is reduced as the object approaches the screen (250), and if it is confirmed that the initial state light intensity has been reduced by 10%, it can determine that the air touch has started.

[0132] At this time, the area from the location where the air touch starts in the space on the screen to the surface of the screen (250) can be defined as the air touch layer. The control unit (20) can control the height (d) of the air touch layer by controlling the amount of light emitted by the light-emitting elements and / or the light reception sensitivity of the detection light sensor in the initial state.

[0133] The control unit (20) can control the thickness of the content implemented as shown in FIG. 4b or FIG. 4c by controlling the height (d) of the air touch layer. In controlling the height (d) of the air touch layer and the thickness of the written content, the control unit (20) may also control the thickness of the already implemented content.

[0134] FIG. 5 is a flowchart of the operation of recognizing writing on an electronic whiteboard and displaying it on a screen according to one embodiment of the present invention.

[0135] The light transmission unit for light touch of the touch panel (10) of the electronic whiteboard (1) is configured to emit two or more light directions with different paths, and the light receiving unit receives light rays having different directions and can determine the position and movement of an object more accurately and delicately using the identified light rays.

[0136] Hereinafter, the operation of implementing the position of an object and the content of writing on the electronic whiteboard (1) through a light beam and displaying them on the screen (250) through the steps of FIG. 7 is described in detail.

[0137] In step 501, the electronic whiteboard (1) checks the light sensing data in which the amount of light is measured as an initial state in which no object is detected through a plurality of light sensing sensors configured to identify at least two types of light rays.

[0138] Multiple light-emitting elements included in the light transmission unit may all be set to emit light of a specified brightness, or may be set to emit light of different brightness depending on the characteristics of the light-emitting elements.

[0139] The database of the electronic whiteboard (1) may include information regarding the identification code of each light-emitting element, the type of light emitted by each light-emitting element, and the identification code of a detection light sensor designated to receive the light emitted by each light-emitting element.

[0140] The electronic whiteboard (1) can identify the type of light received by each of the detection light sensors, identify the light-emitting element that emitted the light based on the database, record the brightness set to be emitted by each light-emitting element and the brightness received by the detection light sensor, and generate sensing data of the initial state of the touch panel (10) based on these.

[0141] The electronic whiteboard (1) can be set to update the initial state sensing data at the time when it is confirmed that an object recognized by the touch panel (10) has been removed, or at specified time intervals.

[0142] For example, when the electronic whiteboard (1) confirms that the amount of light emitted by a specific light-emitting element has decreased during the operation of updating the initial state sensing data, it can control the light reception sensitivity of the detection light sensor that receives the light based on this. At this time, the electronic whiteboard (1) can adjust the light reception sensitivity for the light-emitting element that emits the light.

[0143] In step 503, the electronic whiteboard (1) detects two or more light sensors that detect a change in light intensity when a change in light intensity is detected in at least a portion of the light intensity in the initial state based on the value of the light sensing data.

[0144] When a change in the amount of light is detected while the electronic whiteboard (1) maintains the initial state sensing data, it checks the sensing light sensors that detect the change in the amount of light, determines the air touch of the object based on the change in the amount of light, and can determine that the user's writing begins.

[0145] For example, the electronic whiteboard (1) can determine that an object has approached the screen (250) and that the user's writing has started when the amount of light received by the detection light sensor decreases to a specified amount based on the set light reception sensitivity.

[0146] For example, the electronic whiteboard (1) can determine that the user's writing has started when the average light intensity of the light rays with changed light intensity among the light rays received from each of at least one light detection sensor decreases to a specified value, or when the ratio of light rays with changed light intensity among the light rays received from each of at least one light detection sensor satisfies a specific value.

[0147] In step 504, the electronic whiteboard (1) identifies two or more different types of light rays and paths of light rays identified by each of two or more detection light sensors.

[0148] The electronic whiteboard (1) can identify the type of each light ray whose light intensity has changed at each of the detection light sensors that have confirmed the change in light intensity, and can identify the light-emitting element that emitted the corresponding light ray based on the identified light ray type.

[0149] The electronic whiteboard (1) can verify the light path between the identified light-emitting elements and the detection light sensors. The electronic whiteboard (1) can verify the light path of the light with changed light intensity for all of the multiple detection light sensors that have verified the change in light intensity.

[0150] In step 507, the electronic whiteboard (1) determines the touch coordinates that an object touches among the coordinates within the path intersection area based on the area where the paths of two or more different types of rays intersect and the amount of change in the light intensity of the rays.

[0151] The electronic whiteboard (1) can determine the coordinates of the area where the paths of the light rays that have been confirmed to have changed light intensity intersect. At this time, if the size of the area where the paths of the light rays intersect or the coordinates included in the area are greater than the specified number, the light rays with changed light intensity are arranged in order of the greatest change in light intensity, and the touch coordinates of the object are determined by prioritizing the coordinates of the area where the paths of the light rays with the greatest change in light intensity intersect. The touch coordinates can be determined as multiple coordinates included in the area of ​​the specified size or within the specified number.

[0152] For example, if the size of the area where the paths of the rays intersect is larger than the size of the unit area (e.g., dot, or thickness of the character) for the thickness of the character implemented for the touch coordinates of the electronic whiteboard (1), the size of the area where the paths of the rays intersect can be controlled by resetting the area for determining the touch coordinates of the object based on the area where the paths of the rays intersect with the higher priority as described above.

[0153] In determining the touch coordinates of an object, the electronic whiteboard (1) can compare confirmed information, such as the identification code of a light sensor that receives a light with a changed amount of light and the identification code of a light-emitting element that emits it, the light path between them, the area where the light paths intersect, the amount of change in light of each light with the amount of change in light, and the priority of the light according to the amount of change in light, with a mapping table in a database and determine the matching touch coordinates as the touch coordinates of the object.

[0154] The electronic whiteboard (1) can complete the operation of Fig. 5 by performing the operation of step 507.

[0155] According to the detailed description of the present invention, the functions of various embodiments described as being performed by the electronic whiteboard (1) can be performed by being organically connected with the components of the electronic whiteboard (1) through operations processed through the control unit (20) of the electronic whiteboard (1).

[0156] Although the embodiments described above have been explained by the limited drawings, other implementations, other embodiments, and equivalents to the claims shall be considered to fall within the scope of the claims set forth below.

Claims

1. An electronic whiteboard comprising a screen that recognizes the coordinates of an object from sensing data sensed through a light processing unit and visually displays content generated based on the recognized object coordinates; The above light processing unit includes a light transmission unit comprising a plurality of light-emitting elements installed on a screen, and a light reception unit comprising a plurality of detection light sensors installed at a position corresponding to the light transmission unit to receive light rays emitted from the light-emitting elements; The above-mentioned optical transmission unit includes a light-emitting element that emits light rays and an optical path converter installed on the front of the light-emitting element to change the direction of the light rays emitted from the light-emitting element; The above-described optical path converter is a prism sheet having a trapezoidal prism pattern formed thereon, characterized by converting the direction of light rays emitted from a light-emitting element into multiple directions, thereby improving the writing recognition performance of the electronic whiteboard.

2. In Claim 1 An electronic whiteboard with improved writing recognition performance, characterized in that the above prism pattern includes a support film, wherein the wider side of the trapezoid is positioned toward the light-emitting element and the narrow side is positioned toward the outside.

3. In Claim 2 An electronic whiteboard with improved writing recognition performance, characterized in that the pitch of the above prism pattern is 0.5 times or less the length of the above light-emitting element.

4. In Claim 2 An electronic whiteboard with improved writing recognition performance, characterized in that the inclined surface of the trapezoid of the above-mentioned prism pattern is 45° to 60°.

5. In Claim 1 An electronic whiteboard with improved writing recognition performance, characterized in that the above-mentioned optical path converter is attached to the surface of a transparent support.

6. In Claim 2 An electronic whiteboard with improved writing recognition performance, characterized by a thin light-absorbing film formed on the inclined surface of the trapezoidal side of the prism pattern.

7. In Claim 1 An electronic whiteboard with improved writing recognition performance, characterized in that the above-mentioned optical path converter is a laminated prism sheet having a double-layer laminated structure in which an upper prism sheet having a first pattern in a first direction on one surface and a lower prism sheet having a second pattern in a second direction on one surface are combined with an adhesive layer in between.

8. In Claim 1 The above-mentioned optical path converter is a composite prism sheet having a composite structure in which a prism sheet having a first pattern in a first direction on one side and a lower prism sheet having a second pattern in a second direction on one side are overlapped to form a plurality of square-shaped patterns with each side being trapezoidal, thereby improving the writing recognition performance of the electronic whiteboard.

9. In claim 7 or claim 8 An electronic whiteboard with improved writing recognition performance, characterized in that the first direction and the second direction are different directions and the two directions are perpendicular.

10. In Claim 1 The electronic whiteboard with improved writing recognition performance is characterized by forming the above prism pattern by applying a UV-curable resin solution to one surface of a support film made of at least one of polyethylene terephthalate or polyethylene naphthalate, which is a transparent material capable of transmitting light, and curing it by irradiating it with light.

11. In Claim 1 An electronic whiteboard with improved writing recognition performance, characterized in that the above-mentioned light transmission unit includes a light filter that filters the direction of light rays.

Images