Apparatus for providing alphabet input using symbol combination and method thereof

Abstract

The present invention discloses an alphabet input device and a method using a combination of symbols. That is, the present invention inputs an alphabet of English letters by using a sequential combination of a first key to a ninth key corresponding to a plurality of preset symbols, and by configuring a separate uppercase key for uppercase and lowercase letters, it is not necessary to create an unintuitive shape to distinguish between uppercase and lowercase letters, and characters can be input using a minimum number of keys and an intuitive interface within a small screen such as a smartwatch.

Description

Technology Field

[0001] The present invention relates to an alphabet input device and method using a symbol combination, and in particular, to provide an alphabet input device and method using a symbol combination for inputting an English alphabet using a sequential combination of a first key to a ninth key corresponding to a plurality of preset symbols. Background Technology

[0002] With the use of wireless communication devices in various fields, various methods are being attempted to receive messages.

[0003] In the case of this method for message input, there is a problem where the message input tool, which should be intuitive, becomes complex, and resources are required to handle it. Prior art literature

[0004] Korean Published Patent No. 10-2008-0024844 [Title: Small Keyboard English Input Method] The problem to be solved

[0005] The objective of the present invention is to provide an alphabet input device using a symbol combination and a method thereof for inputting an English alphabet using a sequential combination of a first key to a ninth key corresponding to a plurality of preset symbols. means of solving the problem

[0006] An alphabet input device using a symbol combination according to an embodiment of the present invention may include: a display unit that displays a keyboard including first to ninth keys corresponding to a plurality of preset symbols; and a control unit that processes the input of an alphabet according to the type and order of at least one key input among the first to ninth keys when a key input is input according to user input.

[0007] An alphabet input method using a symbol combination according to an embodiment of the present invention may include: a step of displaying a keyboard including first to ninth keys corresponding to a plurality of preset symbols by a display unit; and a step of processing an alphabet input according to the type and order of at least one key input entered by a control unit when at least one of the first to ninth keys is entered according to user input.

[0008] As an example related to the present invention, the step of processing an alphabet according to the type and order of at least one key input is such that when at least one of the first to ninth keys is input according to user input and a key input corresponding to the point where the user's gaze stops for a preset time is input, the alphabet can be processed according to the type and order of the at least one key input and the key corresponding to the point where the user's gaze stops for a preset time.

[0009] As an example related to the present invention, the step of processing alphabet input according to the type and order of at least one key input may perform any one of the following functions: a preset lowercase / uppercase alphabet input processing function, a line break function after alphabet input processing, and a blank space addition function after alphabet input processing, when a user flick occurs while at least one of the first to ninth keys is input according to user input and the last key input is maintained.

[0010] As an example related to the present invention, the step of processing alphabet input according to the type and order of at least one key input is such that, when at least one of the first to ninth keys is input according to user input and the user's gaze movement moves in a preset clockwise / counterclockwise direction or in a diagonal / upward / downward direction, any one of the following functions may be performed: a preset lowercase / uppercase alphabet input processing function according to the type and order of at least one key input and the user's gaze movement, a line break function after alphabet input processing, and a blank space addition function after alphabet input processing.

[0011] As an example related to the present invention, the step of processing an alphabet according to the type and order of at least one key input may include: a process of displaying one or more alphabets that can be input by the first key when the first key of any one of the first to ninth keys is touched according to user input, while the touch state of the first key is maintained; and a process of processing an alphabet located in the direction of a specific alphabet when a flick occurs in the direction of a specific alphabet among the one or more alphabets displayed around the first key.

[0012] As an example related to the present invention, the step of processing alphabet input according to the type and order of at least one key input may be such that, according to user input, when the first key of any one of the first to ninth keys is touched and then moved to the second key, and the touch state is released from the second key, alphabet input may be processed according to the type and order of the first key and the second key.

[0013] As an example related to the present invention, the step of processing alphabet input according to the type and order of at least one key input is such that, according to user input, the first key of any one of the first to ninth keys is touched and the touch state is maintained for a preset time, and after moving from the touch state of the first key to the second key, when the touch state is released from the second key, the alphabet can be processed according to the type and order of the first key that is touched, the first key that is touched for more than a time, and the second key that is touched after moving.

[0014] As an example related to the present invention, the step of processing alphabet input according to the type and order of at least one key inputted above may involve, when a plurality of keys among the first to ninth keys are input according to user input, identifying the meaning corresponding to the input plurality of keys among the meanings of a plurality of abbreviations stored in advance in a storage unit, and processing the input of the meaning corresponding to the identified plurality of keys.

[0015] As an example related to the present invention, the method may further include: a step of monitoring an alphabet input process according to the type and order of at least one key according to user input by the control unit; a step of changing the keyboard layout on the keyboard or changing the size of the first to ninth keys displayed on the keyboard to different sizes by crowdsourcing information on frequently occurring typos based on the monitoring results by the control unit; a step of reconstructing a keyboard in which the first to ninth keys are rearranged and resized to be customized for the user based on the machine learning results by performing artificial intelligence-based machine learning based on the probability of typos occurring per key according to the monitoring results and the keyboard layout information of the current state of the keyboard by the control unit; and a step of displaying the reconstructed keyboard by the display unit. Effects of the invention

[0016] The present invention inputs English alphabet characters using a sequential combination of first to ninth keys corresponding to a plurality of preset symbols, and by configuring a separate uppercase key for uppercase and lowercase letters, it is not necessary to create an unintuitive shape to distinguish between uppercase and lowercase letters, and has the effect of inputting characters using a minimal number of keys and an intuitive interface within a small screen such as a smartwatch. Brief explanation of the drawing

[0017] FIG. 1 is a block diagram showing the configuration of an alphabet input device using a symbol combination according to an embodiment of the present invention. FIGS. 2 to 5 are figures showing examples of alphabets according to symbol combinations according to embodiments of the present invention. FIG. 6 is a flowchart illustrating an alphabet input method using a symbol combination according to an embodiment of the present invention. FIGS. 7 and 8 are drawings showing examples of a keyboard composed of a plurality of keys according to an embodiment of the present invention. Specific details for implementing the invention

[0018] It should be noted that the technical terms used in this invention are used merely to describe specific embodiments and are not intended to limit the invention. Furthermore, unless specifically defined otherwise in this invention, the technical terms used in this invention should be interpreted in the sense generally understood by those skilled in the art to which this invention pertains, and should not be interpreted in an overly broad or overly narrow sense. Additionally, if a technical term used in this invention is an incorrect technical term that fails to accurately express the concept of the invention, it should be replaced with a technical term that can be correctly understood by those skilled in the art. Moreover, general terms used in this invention should be interpreted according to their prior definitions or the context, and should not be interpreted in an overly narrow sense.

[0019] Furthermore, singular expressions used in the present invention include plural expressions unless the context clearly indicates otherwise. Terms such as "composed of" or "comprising" in the present invention should not be interpreted as necessarily including all of the various components or steps described in the invention, and should be interpreted as meaning that some of the components or steps may not be included, or that additional components or steps may be included.

[0020] Additionally, terms including ordinal numbers, such as first, second, etc., used in the present invention may be used to describe components, but the components should not be limited by the terms. The terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component.

[0021] Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the attached drawings. Identical or similar components are given the same reference number regardless of the drawing symbols, and redundant descriptions thereof will be omitted.

[0022] Furthermore, in describing the present invention, detailed descriptions of related prior art are omitted if it is determined that such descriptions could obscure the essence of the invention. Additionally, it should be noted that the attached drawings are intended only to facilitate an understanding of the concept of the present invention and should not be interpreted as limiting the concept of the invention.

[0023] FIG. 1 is a block diagram showing the configuration of an alphabet input device (100) using a symbol combination according to an embodiment of the present invention.

[0024] As illustrated in FIG. 1, the alphabet input device (100) using a symbol combination is composed of a communication unit (110), a storage unit (120), a display unit (130), a voice output unit (140), and a control unit (150). Not all components of the alphabet input device (100) using a symbol combination illustrated in FIG. 1 are essential components, and the alphabet input device (100) using a symbol combination may be implemented with more components than those illustrated in FIG. 1, or with fewer components.

[0025] The alphabet input device (100) using the above symbol combination is used with a smart watch, smartphone, portable terminal, mobile terminal, foldable terminal, personal digital assistant (PDA), portable multimedia player (PMP) terminal, telematics terminal, navigation terminal, personal computer, laptop computer, slate PC, tablet PC, ultrabook, wearable device (e.g., including smartwatch, smart glass, head-mounted display, etc.), Wibro terminal, IPTV terminal, smart TV, digital broadcasting terminal, AVN terminal, audio / video system, flexible terminal, digital signage device, artificial intelligence speaker, etc. It can be applied to various devices.

[0026] The communication unit (110) communicates with any internal component or any at least one external terminal through a wired / wireless communication network. At this time, the any external terminal may include a server (not shown), a terminal (not shown), etc. Here, wireless internet technologies include Wireless LAN (WLAN), DLNA (Digital Living Network Alliance), Wibro (Wireless Broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), IEEE 802.16, Long Term Evolution (LTE), LTE-A (Long Term Evolution-Advanced), and Wireless Mobile Broadband Service (WMBS), and the communication unit (110) transmits and receives data according to at least one wireless internet technology within a range that includes internet technologies not listed above. In addition, short-range communication technologies may include Bluetooth, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, and Wi-Fi Direct.In addition, wired communication technologies may include Power Line Communication (PLC), USB communication, Ethernet, serial communication, and optical / coaxial cables.

[0027] In addition, the communication unit (110) can mutually transmit information with any terminal via a Universal Serial Bus (USB).

[0028] In addition, the communication unit (110) transmits and receives wireless signals to and from a base station, the server, the terminal, etc. on a mobile communication network built according to technical standards or communication methods for mobile communication (e.g., GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), CDMA2000 (Code Division Multi Access 2000), EV-DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.).

[0029] In addition, the communication unit (110) transmits (or shares) a keyboard (or keypad / tentatively named Lee Seung-gon Alphabet) including a first key to a ninth key corresponding to a plurality of preset symbols under the control of the control unit (150), to the server, the terminal, etc.

[0030] The above storage unit (120) stores various user interfaces (UI), graphic user interfaces (GUI), etc.

[0031] In addition, the storage unit (120) stores data and programs, etc., necessary for the operation of the alphabet input device (100) using the symbol combination.

[0032] That is, the storage unit (120) can store a plurality of application programs (or applications) that run on the alphabet input device (100) using the symbol combination, data for the operation of the alphabet input device (100) using the symbol combination, and commands. At least some of these application programs may be downloaded from an external server via wireless communication. In addition, at least some of these application programs may exist on the alphabet input device (100) using the symbol combination from the time of shipment for the basic functions of the alphabet input device (100) using the symbol combination. Meanwhile, the application program may be stored in the storage unit (120), installed on the alphabet input device (100) using the symbol combination, and driven by the control unit (150) to perform the operation (or function) of the alphabet input device (100) using the symbol combination.

[0033] Additionally, the storage unit (120) may include at least one storage medium among Flash Memory Type, Hard Disk Type, Multimedia Card Micro Type, Card Type Memory (e.g., SD or XD memory, etc.), Magnetic Memory, Magnetic Disk, Optical Disk, RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), and PROM (Programmable Read-Only Memory). Additionally, the alphabet input device (100) using a symbol combination may operate a web storage that performs the storage function of the storage unit (120) on the internet, or may operate in relation to said web storage.

[0034] Additionally, the storage unit (120) stores a keyboard (or keypad) including first to ninth keys corresponding to a plurality of preset symbols under the control of the control unit (150).

[0035] That is, the storage unit (120) maps and stores an alphabet corresponding to a combination of the first to ninth keys. The first key may be ○, the second key may be ∩, the third key may be │, the fourth key may be ⊂, the fifth key may be ´, the sixth key may be ⊃, the seventh key may be ∫, the eighth key may be ∨, and the ninth key may be ─. At this time, the fifth key is the Unicode (Modifier Letter Acute Accent) character code 02CA.

[0036] As illustrated in FIGS. 2 to 5, the alphabet a can be entered as a sequential combination of the first key ○ and the third key │ or as a sequential combination of the first key ○ and the ninth key ─. The alphabet b can be entered as a sequential combination of the third key │, the third key │, and the sixth key ⊃. The alphabet c can be entered as the fourth key ⊂. The alphabet d can be entered as a sequential combination of the third key │, the third key │, and the fourth key ⊂. The alphabet e can be entered as a sequential combination of the fourth key ⊂ and the ninth key ─. The alphabet f can be entered as a sequential combination of the seventh key ∫ and the ninth key ─. The alphabet g can be entered as a sequential combination of the 1st key ○ and the 8th key ∨. The alphabet h can be entered as a sequential combination of the 3rd key │ and the 2nd key ∩. The alphabet i can be entered as a sequential combination of the 5th key ´ and the 3rd key │. The alphabet j can be entered as a sequential combination of the 5th key ´ and the 8th key ∨. The alphabet k can be entered as a sequential combination of the 3rd key │ and the 4th key ⊂. The alphabet l can be entered as the 3rd key │. The alphabet m can be entered as a sequential combination of the 2nd key ∩ and the 2nd key ∩. The alphabet n can be entered as the 2nd key ∩. The alphabet o can be entered as the 1st key ○. The alphabet p can be entered as a sequential combination of the 3rd key │ and the 6th key ⊃. The alphabet q can be entered as a sequential combination of the 4th key ⊂ and the 3rd key │. The alphabet r can be entered as a sequential combination of the 3rd key │ and the 5th key ´. The alphabet s can be entered with the 7th key ∫. The alphabet t can be entered as a sequential combination of the 9th key ─ and the 3rd key │. The alphabet u can be entered as a sequential combination of the 8th key ∨ and the 3rd key │. The alphabet v can be entered with the 8th key ∨.The alphabet w can be entered as a sequential combination of the 8th key ∨ and the 8th key ∨. The alphabet x can be entered as a sequential combination of the 6th key ⊃ and the 4th key ⊂. The alphabet y can be entered as a sequential combination of the 8th key ∨ and the 5th key ´. The alphabet z can be entered as a sequential combination of the 6th key ⊃ and the 9th key ─. In this case, the alphabets b, d and p, q are similar in shape, so b and d can be distinguished from other characters by pressing the 3rd key twice. Input keys consist of one to three keys, and the expected appearance when handwritten is presented in the formative structure section.

[0037] The above display unit (or display unit) (130) can display various content, such as various menu screens, using a user interface and / or a graphic user interface stored in the storage unit (120) under the control of the control unit (150). Here, the content displayed on the display unit (130) includes various text or image data (including various information data) and menu screens, etc., including data such as icons, list menus, and combo boxes. Additionally, the above display unit (130) may be a touch screen.

[0038] Additionally, the display unit (130) may include at least one of a Liquid Crystal Display (LCD), a Thin Film Transistor-Liquid Crystal Display (TFT LCD), an Organic Light-Emitting Diode (OLED), a Flexible Display, a 3D Display, an e-ink Display, and an LED (Light Emitting Diode).

[0039] In addition, the display unit (130) displays a keyboard (or keypad), etc., including a first key to a ninth key corresponding to a plurality of preset symbols, under the control of the control unit (150).

[0040] The voice output unit (140) outputs voice information included in a signal processed by the control unit (150). Here, the voice output unit (140) may include a receiver, a speaker, a buzzer, etc.

[0041] In addition, the voice output unit (140) outputs guidance voice generated by the control unit (150).

[0042] In addition, the voice output unit (140) outputs voice information (or sound information) corresponding to a keyboard (or keypad), etc., including a first key to a ninth key corresponding to a plurality of preset symbols, under the control of the control unit (150).

[0043] The above-mentioned controller (or MCU (microcontroller unit)) (150) performs the overall control function of the alphabet input device (100) using the symbol combination.

[0044] Additionally, the control unit (150) executes the overall control function of the alphabet input device (100) using symbol combinations by utilizing the program and data stored in the storage unit (120). The control unit (150) may include RAM, ROM, CPU, GPU, and a bus, and the RAM, ROM, CPU, GPU, etc. may be connected to each other via a bus. The CPU can access the storage unit (120) and perform booting using the O / S stored in the storage unit (120), and can perform various operations using various programs, content, data, etc. stored in the storage unit (120).

[0045] In addition, the control unit (150) utilizes the previously collected multiple key-specific error occurrence probabilities (or multiple key-specific error occurrence frequencies), keyboard layout information, etc. as data for continuous machine learning (or deep learning). Here, the input dataset for machine learning can perform training and testing functions by dividing the multiple key-specific error occurrence probabilities (or multiple key-specific error occurrence frequencies), keyboard layout information, etc. into a training set and a test set at a preset ratio (e.g., including 7:3, 8:2, etc.). Additionally, the input dataset for machine learning includes the multiple key-specific error occurrence probabilities (or multiple key-specific error occurrence frequencies), keyboard layout information, etc., that are collected later. In addition, the output dataset for the machine learning described above is a part to be predicted, which is learned based on the probability of a typo occurring per multiple key (or the frequency of a typo occurring per multiple key), keyboard layout information, etc., and subsequently predicts the result to rearrange the corresponding multiple keys (e.g., including the first to ninth keys, etc.) and includes a keyboard (or a user-customized keyboard) in which the size of the corresponding multiple keys is readjusted.

[0046] That is, the control unit (150) performs a learning function to configure a new keyboard with respect to specific raw data, specifically regarding the probability of a specific number of keys being an error (or the frequency of a specific number of keys being an error), and keyboard layout information on a specific keyboard, etc., for a keyboard configuration model, etc. At this time, the control unit (150) stores raw data (including the probability of a specific number of keys being an error (or the frequency of a specific number of keys being an error), keyboard layout information on a specific keyboard, etc.) in parallel and distributed, refines unstructured data, structured data, and semi-structured data included in the stored raw data (or learning data, etc.), performs preprocessing including classification into metadata, performs analysis including data mining on the preprocessed data, and builds big data by conducting learning, training, and testing based on at least one type of machine learning. At this time, at least one type of machine learning may be composed of any one of supervised learning, semi-supervised learning, unsupervised learning, reinforcement learning, and deep reinforcement learning, or a combination of at least one of these. And data mining may include classification, which predicts the class of new data by learning a training dataset with known classes by exploring inherent relationships between preprocessed data, or clustering, which groups data based on similarity without class information.

[0047] In this way, the control unit (150) performs a learning function on the keyboard configuration model in the form of a neural network through the learning data, etc.

[0048] Additionally, the control unit (150) displays a keyboard (or keypad / tentatively named Lee Seung-gon Alphabet) on the display unit (130), which includes first to ninth keys corresponding to a plurality of preset symbols. At this time, the display unit (130) can perform a display function on a smartwatch such as a Galaxy Watch (not shown) or an Apple Watch (not shown). In addition, the keyboard includes, in addition to the first to ninth keys, an input window (or input area / item) for displaying input characters (or alphabets / English uppercase and lowercase letters) and a plurality of preset function keys. Here, the plurality of function keys include a delete key, a case switching key / conversion key, an input key / line break key, a space key, an emoticon key, a number key, a special character key, etc.

[0049] At this time, the keyboard including the first to ninth keys may be formed in a 4×4 configuration, excluding the input window at the top. The first key may be placed in a cell corresponding to (1,1), the second key in a cell corresponding to (1,2), the third key in a cell corresponding to (1,3), the fourth key in a cell corresponding to (2,1), the fifth key in a cell corresponding to (2,2), the sixth key in a cell corresponding to (2,3), the seventh key in a cell corresponding to (3,1), the eighth key in a cell corresponding to (3,2), and the ninth key in a cell corresponding to (3,3). A delete key may be placed in the cell corresponding to (1,4), a case switching key / conversion key in the cell corresponding to (2,4), an input key / newline key / enter key in the cell corresponding to (3,4), a blank key (or space key) in the cell corresponding to (4,1), an emoticon key in the cell corresponding to (4,2), a number key in the cell corresponding to (4,3), and a special character key in the cell corresponding to (4,4). At this time, the arrangement of the first to ninth keys may be changed or configured to be customized.

[0050] Additionally, when at least one of the first to ninth keys is input (or received) according to user input (or user touch / selection / control), the control unit (150) processes the input of an alphabet (or lowercase / uppercase English letter) according to the type and order of the input at least one key, and displays the processed alphabet in an input window included on one side of the keyboard displayed on the corresponding display unit (130).

[0051] That is, the control unit (150) processes the input of an alphabet according to the type and order of the keys by inputting at least one of the first to ninth keys according to user input.

[0052] Additionally, when at least one of the first to ninth keys is input (or received) according to user input (or user touch / selection / control) and a key input corresponding to the point where the user's gaze stops for a preset time is input, the control unit (150) processes the input of an alphabet according to the type and order of the at least one input key and the key corresponding to the point where the user's gaze stops for a preset time.

[0053] Additionally, when at least one of the first to ninth keys is input (or received) according to user input (or user touch / selection / control) and a user flick (or touch gesture) occurs while the last key input is maintained, the control unit (150) performs a preset lowercase / uppercase alphabet input processing function, a line break function after alphabet input processing, a blank space addition function after alphabet input processing, etc., according to the type and order of at least one input key and the flick direction (or touch gesture direction). Here, the user's touch gesture may include a tap, touch & hold, double tap, drag, panning, flick, drag and drop, swipe, etc.

[0054] "Tap" refers to the action of a user touching the screen with a finger or a touch tool (e.g., an electronic pen) and then immediately lifting it from the screen without moving it.

[0055] "Touch & hold" refers to an action in which a user touches the screen using a finger or a touch tool (e.g., an electronic pen) and maintains the touch input for a threshold time (e.g., 2 seconds) or longer. In other words, it refers to a case where the time difference between the touch-in point and the touch-out point is greater than or equal to the threshold time (e.g., 2 seconds). To allow the user to recognize whether the touch input is a tap or a touch & hold, a visual, auditory, or tactile feedback signal may be provided when the touch input is maintained for longer than the threshold time. The threshold time may be changed depending on the implementation example.

[0056] "Double tap" refers to the action of a user touching the screen twice using a finger or a touch tool (stylus).

[0057] "Drag" refers to the action of a user touching the screen with a finger or touch tool and then moving the finger or touch tool to another location within the screen while maintaining the touch. As a result of the drag action, an object is moved or the panning action described later is performed.

[0058] "Panning" refers to the case where a user performs a drag operation without selecting an object. Since no specific object is selected, in panning, the object does not move within the page; instead, the page itself moves within the screen, or a group of objects moves within the page.

[0059] "Flick" refers to a motion in which a user drags using a finger or touch tool at a threshold speed (e.g., 100 pixels / s) or higher. Drag (or panning) and flick can be distinguished based on whether the movement speed of the finger or touch tool is at or above the threshold speed (e.g., 100 pixels / s).

[0060] "Drag and drop" refers to the action of a user dragging an object to a designated location on the screen using a finger or touch tool and then releasing it.

[0061] "Pinch" refers to the action of a user touching the screen with two fingers and moving them in different directions. It is a gesture used to zoom in (Pinch Open) or zoom out (Pinch Close) on an object or page, and the zoom level is determined by the distance between the two fingers.

[0062] "Swipe" is an action of moving a certain distance in a horizontal or vertical direction while touching an object on the screen with a finger or touch tool. Movement in a diagonal direction may not be recognized as a swipe event.

[0063] Additionally, when at least one of the first to ninth keys is input (or received) according to user input (or user touch / selection / control) and the user's gaze movement (or pupil movement) moves in a preset clockwise / counterclockwise direction or the user's gaze movement moves in a diagonal / up / down direction, the control unit (150) performs the preset lowercase / uppercase alphabet input processing function, line break function after alphabet input processing, and blank space addition function after alphabet input processing, according to the type and order of at least one input key and the user's gaze movement.

[0064] Additionally, when the first key of any one of the first to ninth keys is touched (or selected / input / received) according to user input (or user touch / selection / control), the control unit (150) displays one or more alphabets that can be input (or combined with) the first key by placing them around the first key while the touch state of the first key is maintained. Additionally, when a flick occurs in the direction of a specific alphabet among the one or more alphabets placed around the first key displayed, the control unit (150) processes the input of a specific alphabet located in that specific alphabet direction.

[0065] Here, the alphabet that can be entered with the first key (○) (or combined with the first key / entered using the first key) includes a, g, and o; the alphabet that can be entered with the second key (∩) includes m and n; the alphabet that can be entered with the third key (│) includes b, d, h, k, l, p, and r; the alphabet that can be entered with the fourth key (⊂) includes c, e, and g; the alphabet that can be entered with the fifth key (´) includes i and j; the alphabet that can be entered with the sixth key (⊃) includes x and z; the alphabet that can be entered with the seventh key (∫) includes f and s; the alphabet that can be entered with the eighth key (∨) includes u, v, w, and y; and the alphabet that can be entered with the ninth key (─) includes t.

[0066] Additionally, when the first key of any one of the first to ninth keys is touched (or selected / input / received) according to user input (or user touch / selection / control) and moves to the second key, and the touch state is released from the second key, the control unit (150) processes the input of an alphabet according to the type and order of the first key and the second key.

[0067] Additionally, when the first key of any one of the first to ninth keys is touched (or selected / input / received) according to user input (or user touch / selection / control) and the touch state is maintained for the first key for a preset time, and after moving from the touch state of the first key to the second key, the touch state is released from the second key, the control unit (150) processes the input of an alphabet according to the type and order of the first key and the second key (or the first key according to the touch, the first key according to the touch state maintained for more than a time, and the second key according to the touch after moving).

[0068] Additionally, when a plurality of keys among the first to ninth keys are input (or received) according to user input (or user touch / selection / control), the control unit (150) checks the meaning corresponding to the input plurality of keys (or abbreviations corresponding to the corresponding plurality of keys) among the meanings of abbreviations that are pre-stored (or set / registered) in the storage unit (120), and processes the input of the confirmed meaning corresponding to the corresponding plurality of keys. Here, the control unit (150) replaces the plurality of keys and displays (or processes input) the meaning corresponding to the corresponding plurality of keys on the display unit (130), or displays the plurality of keys and the meaning corresponding to the corresponding plurality of keys together on the display unit (130) (e.g., displayed separated by ',', '()', ':', etc.). At this time, the control unit (150) may identify the meaning corresponding to the abbreviation of the input multiple keys among the pre-stored multiple abbreviations based on the content displayed in the input window before the multiple keys are input and the relationship between the user and the conversation partner (e.g., family, friends, colleagues, etc.), and may process the input of the meaning corresponding to the identified multiple keys.

[0069] Additionally, the control unit (150) monitors the alphabet input process according to the type and order of at least one key based on user input (or user touch / selection / control). The reason for monitoring is that the concept of intuitiveness for each key combination may differ for each individual, so cases where combinations or orders differ are collected using crowdsourcing with collective intelligence, and updates are made to add or delete key selections, key combinations, and key order. Another reason is to personalize the keyboard, so that even if a keyboard has keys of the same size arranged, if a person moves their finger to touch A but does not touch A and continues to press S next to it or Z below it, the touchable area is increased, and a method is applied to increase the size of the keys within the keyboard to the range where typos occur according to the probability of typos.

[0070] In addition, the control unit (150) crowdsources information on frequently occurring typos based on monitoring results to change (or modify) the keyboard layout on the keyboard or to change the size of the first to ninth keys displayed on the keyboard to different sizes.

[0071] Additionally, the control unit (150) changes (or modifies) the keyboard layout based on the probability of a typo occurring per key (or the frequency of a typo occurring) according to the monitoring result, or changes the size of the first to ninth keys displayed on the keyboard to different sizes (for example, the size of the keys that frequently cause typos is increased by a certain ratio relative to a preset standard size, and the size of the keys that do not frequently cause typos is reduced by a different certain ratio relative to a preset standard size), and displays a keyboard including the changed keyboard layout or a keyboard with changed sizes, etc.

[0072] Additionally, the control unit (150) reconfigures the keyboard by placing the key with the highest probability of an error (or frequency of an error) in the center of the keyboard (or input screen) based on the probability of an error (or frequency of an error) per key according to the monitoring result, and displays the reconfigured keyboard.

[0073] Additionally, the control unit (150) performs artificial intelligence-based machine learning (artificial neural network / deep learning) based on the probability of typos occurring per key (or frequency of typos occurring) and the keyboard layout information of the current state of the keyboard according to the monitoring results, and reconstructs (or regenerates / reclassifies) a keyboard in which the first to ninth keys are rearranged (or rearranged) and / or resized to suit the user based on the machine learning results, and displays the reconstructed keyboard (or user-customized keyboard) on the display unit (130). At this time, the user-customized keyboard may be configured such that the position, size, etc. of each key are different from one another.

[0074] That is, the control unit (150) performs machine learning (or artificial intelligence / deep learning) using the probability of a typo per key (or frequency of a typo) based on the monitoring result, the keyboard layout information of the current state of the keyboard, etc., as input values ​​for a preset artificial intelligence-based keyboard configuration model, reconstructs (or regenerates / reclassifies) the user-customized keyboard based on the machine learning result (or artificial intelligence result / deep learning result), and displays the reconstructed keyboard (or user-customized keyboard) on the display unit (130).

[0075] The most common performance metric used in text input research is Words Per Minute (WPM). The average input speed of a physical QWERTY keyboard on a desktop PC is between 40 and 60 WPM, and even general users can reach speeds of over 70 WPM with sufficient practice. However, when inputting text using a virtual QWERTY keyboard on a smartphone or tablet, the lack of haptic feedback prevents users from utilizing muscle memory—a natural function that remembers and accurately repeats hand muscle movements. Consequently, text input on a virtual keyboard using finger touch on a small screen is limited to only 10 WPM for novice users and 20 WPM even for expert users. While muscle memory tends to function to some extent if the virtual keyboard is similar in size to a standard physical keyboard, input speed slows significantly when the keyboard is small, leading to more errors than with a physical keyboard.

[0076] Accordingly, by learning the user's touch input patterns to optimize the size of the touch area for each key on the virtual keyboard or highlighting the color of the next key likely to be entered through prediction,

[0077] Further optimization features can be provided to reduce or enlarge the size. For example, the size of a key's touch area can be dynamically optimized based on the likelihood of the next input using a language model. Additionally, the touch area can be optimized by learning the user's touch input and typo patterns. Alternatively, the shape of certain keys can be changed to be larger and easier to touch based on the learned prediction results of user input patterns. Furthermore, based on machine learning, keys with a high probability of appearing next can be displayed with different sizes and colors. Alternatively, the width of the key itself can be increased or the color changed based on predictions, or the size of the touch area for each key can be increased or moved to reduce errors between adjacent keys.

[0078] Dynamic Adaptive Keyboard

[0079] According to information processing models in cognitive science, the process of a user pressing a key is divided into three stages: stimulus recognition, cognitive processing, and response execution. The first, stimulus recognition, is the stage where the state of the sentence currently being entered is recognized through visual functions; the second, cognitive processing, is the stage where a user selects which character key to press based on the recognized information; and the third, response execution, is the stage of executing the action of pressing the area of ​​the selected key with a finger. Typos can occur in each stage for different reasons. In the stimulus recognition stage, a user may neglect their attention and miss the current input location or look at the wrong location, thereby misinterpreting the information of the text entered so far; in the cognitive processing stage, a user may incorrectly remember the spelling of a word and choose to input the wrong character.

[0080] Finally, during the response execution stage, errors may occur where an adjacent key is touched instead of the intended key due to anatomical factors of the fingers. While typos resulting from errors in the stimulus recognition and cognitive processing stages are not issues that can be improved by adaptive keyboard techniques, typos resulting from errors in the response execution stage can have their probability of occurrence reduced by adjusting the size of the key's touch area. A dynamic adaptation method for a keyboard according to an embodiment of the present invention may be composed of a step of monitoring a user's key input to automatically extract typos, distinguishing typos that occurred during the response execution stage, and performing an adaptation that adjusts the position of the keyboard using that information.

[0081] Typo Extraction

[0082] When looking at the typical user experience of inputting characters on a keyboard, if a typo occurs during input, the BS (Backspace) key is pressed to delete the typo and input the character to be corrected. Therefore, by monitoring the key input sequence and analyzing the location where the BS key was pressed, it is possible to identify the key pressed due to the typo and the key corresponding to the character originally intended to be entered, as shown in [Table 1] below.

[0083] Typo extraction method: There is a key input sequence k0, … , k(i-2), k(i-1), Ki, k(i+1), k(i+2), … , km, and let Ki to k(i+n-1) be n consecutive BS key inputs. Then the typo key KTypo = k(in) and the correct key KCorrect = k(i+n) entered to correct the typo.

[0084] For example, if the BS key is pressed once at k3, i=3 and n=1, so KTypo = k(3-1) = k2 = '1st key' and KCorrect = k(3+1) = k4 = '2nd key'. In other words, '1st key' was pressed incorrectly due to a typo instead of '2nd key'.

[0085] <Distinguishing Adjacent-Typo>

[0086] Typos caused by the response execution stage occur when a location other than the one the user intended to press with their finger is pressed. Therefore, it is highly likely that the location of the key that should have been pressed and the location of the key pressed by typo are within the size of a finger. Accordingly, by comparing the positions on the keyboard of the typo key KTypo and the correction key KCorrect found in the typo extraction stage, if they are adjacent to each other, it can be considered an error of the response execution stage; this is defined as an Adjacent-Typo. For example, if the positions on the keyboard are far apart, such as KTypo = 'Key 1' and KCorrect = 'Key 9', it is highly likely that the typo was caused by an error in the stimulus recognition or information interpretation stage. However, if the adjacent typos are adjacent to each other on the keyboard, such as KTypo = 'Key 1' and KCorrect = 'Key 2', it can be considered a typo caused by an error in the response execution stage.

[0087] Adjacent typos can occur even when keys are vertically adjacent, but since the key layout of a soft keyboard is staggered by row, the distance between vertically adjacent keys is greater than the distance between horizontally adjacent keys, and input errors are greatly reduced when the key size is designed to be longer in the vertical direction, adjacent typos in the case of vertical proximity are not considered.

[0088] <Keyboard Dynamic Adaptation>

[0089] When adjacent typos are distinguished, a dynamic adaptation operation is performed to adjust the size of the key's touch area by moving the position of the adjacent boundary where the typo key KTypo and the correction key KCorrect face each other. To perform dynamic adaptation, the coordinates of the location where the typo occurred are required; when monitoring the key input sequence, the screen touch location Xi is stored along with the entered key Ki. The basic idea of ​​dynamic adaptation using adjacent typos is to extend the touch area (Key-Target Area) of KCorrect to the typo location Xtypo, which is located within the touch area of ​​KTypo. For example, in the dynamic adaptation executed when KTypo = '1st Key' and KCorrect = '2nd Key', the area of ​​each key within the keyboard can be divided into three types.

[0090] One is the Key-Target Area for each key, and another is the Anchor Area. If the location of the typo, Xtypo, is identified the moment an adjacent typo occurs, performing dynamic adaptation in this state immediately extends the left boundary of KCorrect's touch area to Xtypo. This simultaneously means that KTypo's touch area shrinks by that amount. Furthermore, the extension range of KCorrect's touch area cannot exceed KTypo's Anchor Area. Additionally, if dynamic adaptation is performed when Xtypo is located within or to the left of KTypo's Anchor Area, the extension range of KCorrect's touch area is limited to the right boundary of KTypo's Anchor Area. The size of the Anchor Area can be determined arbitrarily.

[0091] Dynamic Adaptation Method

[0092] The dynamic adaptation method can be composed of three types. These may be CorrectAdapt, Typo-Adapt, and All-Adapt. Correct-adapt is a general dynamic adaptation method that performs adaptation only on correct typing, and the Typo-Adapt of the present invention is a dynamic adaptation method using adjacent typos. Finally, All-Adapt may include a dynamic adaptation method that uses both of the above two methods. The three types can be used on a user terminal (100) and customized to minimize the user's typos.

[0093] Crowdsourcing

[0094] In one embodiment of the present invention, a crowdsourcing technique, which is one of the methods for humans and machines to collaborate to produce results, may be utilized. This may include a multi-task annotation technique that effectively generates machine learning data for entity linking, entity clustering (cross-reference resolution), and relationship extraction necessary for knowledge extraction. There are factors to consider when collecting training data required for machine learning using the crowdsourcing method. First, training must be conducted so that workers can have a sufficient understanding of the task; next, a device to filter out malicious workers is required; and finally, a device to continuously manage data quality while the task is in progress is required.

[0095] In one embodiment of the present invention, the above problem can be solved by introducing devices such as online tutorials, sample tests, and mine planting. Additionally, taking into account that the knowledge extraction system is designed in the order of entity linking, cross-reference resolution, and relationship extraction, a work framework is designed in which the results of a previous task enter as input for the next task. Through this, work efficiency can be improved by reducing the amount of annotation required by workers in each task. These design methods enable the generation of more data at a lower cost when generating crowdsourced data, and allow for the design and evaluation of various models that constitute the knowledge extraction system.

[0096] In this way, through FIGS. 2 to 5, it is possible to verify how the alphabet was entered, and since it can be mounted on a smartwatch in the form shown in FIGS. 7 and 8 below, it becomes possible to not only reply to messages or send texts on messengers such as KakaoTalk or select emojis on Facebook or Instagram, but also to make simple comments or mentions in English on the smartwatch. A keyboard (tentatively named Lee Seung-gon Alphabet) according to one embodiment of the present invention analyzes the representative morphological characteristics of the 26 lowercase alphabets, summarizes the characteristics of each of the 26 lowercase alphabets into 9 forms, and takes into account the fact that finger touch is very difficult if the number of keys exceeds 9 because the screen of a wearable device such as an Apple Watch or Galaxy Watch is very narrow.

[0097] The typing method is as follows. By drawing the alphabet using the nine basic characters as if writing by hand, the characters are converted into the alphabet based on pre-stored conditions and typed. This method is similar to how Hangul is composed of combinations of various consonants and vowels, unlike the alphabet. If a minimum of one and a maximum of three basic characters are typed according to their shapes as if drawing the alphabet, the alphabet is typed. If a specific alphabet is created by hand-writing using the existing nine characters, it is immediately converted into an alphabet character. The nine basic characters of the Lee Seung-gon Alphabet (tentative name) are shown in Fig. 7, and the process of typing becoming a character is shown in Figs. 2 through 5. It is a method where drawing the shape of the alphabet to be written based on the nine existing characters results in an alphabet with a similar shape. It can be said to be almost identical to the process of handwriting. The process of creating characters is not limited to a single case but has up to two to three cases where similar shapes can be produced. Through this, the possibility of typos can be reduced.

[0098] Since the 26 letters of the alphabet have been reduced to 9, the screen utilization of the smartwatch is greatly improved. Therefore, the keyboard layout of the smartwatch can be changed. With this, while document work is difficult on the smartwatch, basic conversation is sufficient. Since a smartwatch with a built-in SIM card can be regarded as an independent smartphone, utilizing this effectively eliminates the need to carry a heavy smartphone during hiking or exercise. Based on this, a new keyboard for the Apple Watch or Galaxy Watch can be created as shown in Fig. 7. 26 letters of the alphabet can be typed using 9 letters (1st to 9th keys). Since the number of character fields has been drastically reduced to 9, there is more room in the keyboard, and new buttons (or keys / menus) such as delete, uppercase / lowercase switching, input, blank space, emoticons, numbers, and special characters can be formed.

[0099] In this way, English alphabets can be entered using a sequential combination of the first to ninth keys corresponding to a plurality of preset symbols, and uppercase and lowercase letters can be entered using a separate uppercase key.

[0100] Hereinafter, a method for preventing alphabet input using a symbol combination according to the present invention will be described in detail with reference to FIGS. 1 to 8.

[0101] FIG. 6 is a flowchart illustrating an alphabet input method using a symbol combination according to an embodiment of the present invention.

[0102] First, the display unit (130), under the control of the control unit (150), displays a keyboard (or keypad / tentatively named Lee Seung-gon Alphabet) that includes first to ninth keys corresponding to a plurality of preset symbols. At this time, the display unit (130) can perform a display function on a smartwatch such as a Galaxy Watch (not shown) or an Apple Watch (not shown). In addition, the keyboard includes, in addition to the first to ninth keys, an input window (or input area / item) for displaying input characters (or alphabets / English uppercase and lowercase letters) and a plurality of preset function keys. Here, the plurality of function keys include a delete key, a case switching key / conversion key, an input key / line break key, a blank key, an emoticon key, a number key, a special character key, etc.

[0103] For example, as illustrated in FIG. 7, the first display unit (130) displays a first keyboard (700) including two lines of input windows, first to ninth keys, and a plurality of function keys, under the control of the first control unit (150) (S610).

[0104] Subsequently, when at least one of the first to ninth keys is input (or received) according to user input (or user touch / selection / control), the control unit (150) processes the input of an alphabet (or lowercase / uppercase English letter) according to the type and order of the at least one key input, and displays the processed alphabet in an input window included on one side of the keyboard displayed on the corresponding display unit (130).

[0105] That is, the control unit (150) processes the input of an alphabet according to the type and order of the keys by inputting at least one of the first to ninth keys according to user input.

[0106] Additionally, when at least one of the first to ninth keys is input (or received) according to user input (or user touch / selection / control) and a key input corresponding to the point where the user's gaze stops for a preset time is input, the control unit (150) processes the input of an alphabet according to the type and order of the at least one input key and the key corresponding to the point where the user's gaze stops for a preset time.

[0107] Additionally, when at least one of the first to ninth keys is input (or received) according to user input (or user touch / selection / control) and a user flick (or touch gesture) occurs while the last key input is maintained, the control unit (150) performs a preset lowercase / uppercase alphabet input processing function, a line break function after alphabet input processing, and a blank space addition function after alphabet input processing, according to the type and order of at least one input key and the flick direction (or touch gesture direction).

[0108] Additionally, when at least one of the first to ninth keys is input (or received) according to user input (or user touch / selection / control) and the user's gaze movement (or pupil movement) moves in a preset clockwise / counterclockwise direction or the user's gaze movement moves in a diagonal / up / down direction, the control unit (150) performs the preset lowercase / uppercase alphabet input processing function, line break function after alphabet input processing, and blank space addition function after alphabet input processing, according to the type and order of at least one input key and the user's gaze movement.

[0109] Additionally, when the first key of any one of the first to ninth keys is touched (or selected / input / received) according to user input (or user touch / selection / control), the control unit (150) displays one or more alphabets that can be input (or combined with) the first key by placing them around the first key while the touch state of the first key is maintained. Additionally, when a flick occurs in the direction of a specific alphabet among the one or more alphabets placed around the first key displayed, the control unit (150) processes the input of a specific alphabet located in that specific alphabet direction.

[0110] Additionally, when the first key of any one of the first to ninth keys is touched (or selected / input / received) according to user input (or user touch / selection / control) and moves to the second key, and the touch state is released from the second key, the control unit (150) processes the input of an alphabet according to the type and order of the first key and the second key.

[0111] Additionally, when the first key of any one of the first to ninth keys is touched (or selected / input / received) according to user input (or user touch / selection / control) and the touch state is maintained for the first key for a preset time, and after moving from the touch state of the first key to the second key, the touch state is released from the second key, the control unit (150) processes the input of an alphabet according to the type and order of the first key and the second key (or the first key according to the touch, the first key according to the touch state maintained for more than a time, and the second key according to the touch after moving).

[0112] Additionally, when a plurality of keys among the first to ninth keys are input (or received) according to user input (or user touch / selection / control), the control unit (150) checks the meaning corresponding to the input plurality of keys (or abbreviations corresponding to the corresponding plurality of keys) among the meanings of abbreviations that are pre-stored (or set / registered) in the storage unit (120), and processes the input of the confirmed meaning corresponding to the corresponding plurality of keys. Here, the control unit (150) replaces the plurality of keys and displays (or processes input) the meaning corresponding to the corresponding plurality of keys on the display unit (130), or displays the plurality of keys and the meaning corresponding to the corresponding plurality of keys together on the display unit (130) (e.g., displayed separated by ',', '()', ':', etc.). At this time, the control unit (150) may identify the meaning corresponding to the abbreviation of the input multiple keys among the pre-stored multiple abbreviations based on the content displayed in the input window before the multiple keys are input and the relationship between the user and the conversation partner (e.g., family, friends, colleagues, etc.), and may process the input of the meaning corresponding to the identified multiple keys.

[0113] For example, when the 7th key and the 9th key among the 1st to 9th keys are sequentially entered according to user input on the 1st keyboard (700) displayed on the 1st display unit, the 1st control unit processes the input of 'f' according to the sequential combination of the entered 7th key (∫) and the 9th key (─), and displays the 'f' in the input window.

[0114] As another example, when the third key among the first to ninth keys is input according to user input on the first keyboard (700) displayed on the first display unit, and the gaze of the first user is stopped at the second key for a preset time (e.g., 2 seconds or more) without blinking, the first control unit processes the input of 'h' according to the sequential combination of the input third key (│) and the second key (∩) corresponding to the point where the first user's gaze stopped for the said time, and displays the 'h' in the input window.

[0115] As another example, when the 5th key and the 3rd key among the 1st to 9th keys are input according to user input on the 1st keyboard (700) displayed on the 1st display unit, and the touch state of the 3rd key, which is the last key, is maintained, and the user's flick occurs in the upward direction (or 12 o'clock direction), the 1st control unit processes the lowercase 'i' according to the sequential combination of the input 5th key (´) and the 3rd key (│) as an uppercase 'I' and displays the 'I' in the input window.

[0116] As another example, when the 5th key and the 3rd key among the 1st to 9th keys are input according to user input on the 1st keyboard (700) displayed on the 1st display unit, and the touch state of the last key, the 3rd key, is maintained, and the user flicks downward (or 6 o'clock direction), the 1st control unit processes the input of 'i' according to the sequential combination of the input 5th key (´) and the 3rd key (│), displays the 'i' in the input window, and then displays the cursor position in the input window by a line break function.

[0117] As another example, when the 5th key and the 3rd key among the 1st to 9th keys are input according to user input on the 1st keyboard (700) displayed on the 1st display unit, and the touch state of the 3rd key, which is the last key, is maintained, and the user flicks in the right direction (or 3 o'clock direction), the 1st control unit processes the input of 'i' according to the sequential combination of the input 5th key (´) and the 3rd key (│), displays the 'i' in the input window, and then displays the position of the cursor with a blank space added after the displayed 'i' in the input window by means of the blank space addition function.

[0118] As another example, among the first keyboard (700) displayed on the first display unit, the third and fourth keys among the first to ninth keys are entered according to user input, and after the last key, the fourth key, is entered, the user's gaze movement (or eye movement) moves in a preset clockwise direction, the first control unit processes the input of 'k' according to the sequential combination of the entered third key (│) and fourth key (⊂), displays the 'k' in the input window, and then, according to the user's clockwise gaze movement, displays the cursor position in the input window by processing a line break using a line break function.

[0119] As another example, when the touch state of the third key among the first keys to the ninth keys is maintained according to user input among the first keyboard (700) displayed on the first display unit, the first control unit displays 'a' ('a' according to the sequential combination of the first key ○ and the third key │) and 'g' ('g' according to the sequential combination of the first key ○ and the eighth key ∨) which can be input with the first key (○), and 'o' ('o' according to the first key ○) around the first key, and when a flick occurs in the direction of 'g' among the three alphabets (a, g and o) placed around the first key, the input processing of 'g' located in the direction of 'g' is performed, and the 'g' is displayed in the input window.

[0120] As another example, among the first keyboard (700) displayed on the first display unit, when the first key, the 5th key, which is the first of the 1st to 9th keys, is touched according to user input and then moves to the second key, the 8th key, and when the touch state of the 8th key is released, the first control unit processes the input of 'j' according to the sequential combination of the 5th key (´) and the 8th key (∨), and displays the 'j' in the input window.

[0121] As another example, among the first keyboard (700) displayed on the first display unit, the third key, which is the first key among the first to ninth keys, is touched according to user input, and the touch state for the third key is maintained for a preset time (e.g., 2 seconds). After the touch state is maintained for that time, the user moves from the state where the third key, which is the first key, is touched to the sixth key, which is the second key, and when the touch state of the sixth key is released, the first control unit processes the input of 'b' according to the sequential combination of the third key (│) and the sixth key (⊃) maintained for a certain period of time, and displays the 'b' in the input window.

[0122] As another example, when the 3rd key, 2nd key, 2nd key, 2nd key, 8th key, and 3rd key are sequentially input according to user input among the 1st keys to 9th keys on the 1st keyboard (700) displayed on the 1st display unit, the 1st control unit processes the input of 'h' according to the sequential combination of the input 3rd key (│) and the 2nd key (∩), processes the input of 'm' according to the sequential combination of the input 2nd key (∩) and the 2nd key (∩), and processes the input of 'u' according to the sequential combination of the input 8th (∨) key and the 3rd key (│), then checks the 1st meaning (e.g., hit me up: let's meet, contact me, see you again) corresponding to the 1st abbreviation (hmu) which is the input multiple key among the multiple abbreviations pre-stored in the 1st storage unit (120), and the The first meaning (hit me up) corresponding to the confirmed first abbreviation (hmu) is displayed by replacing the first abbreviation currently displayed in the input window, or the first abbreviation and the first meaning are displayed together (hmu: hit me up) instead of the first abbreviation (hmu) displayed (S620).

[0123] In addition, the control unit (150) monitors the alphabet input process according to the type and order of at least one key based on user input (or user touch / selection / control).

[0124] In addition, the control unit (150) crowdsources information on frequently occurring typos based on monitoring results to change (or modify) the keyboard layout on the keyboard or to change the size of the first to ninth keys displayed on the keyboard to different sizes.

[0125] Additionally, the control unit (150) changes (or modifies) the keyboard layout based on the probability of a typo occurring per key (or the frequency of a typo occurring) according to the monitoring result, or changes the size of the first to ninth keys displayed on the keyboard to different sizes (for example, the size of the keys that frequently cause typos is increased by a certain ratio relative to a preset standard size, and the size of the keys that do not frequently cause typos is reduced by a different certain ratio relative to a preset standard size), and displays a keyboard including the changed keyboard layout or a keyboard with changed sizes, etc.

[0126] Additionally, the control unit (150) reconfigures the keyboard by placing the key with the highest probability of an error (or frequency of an error) in the center of the keyboard (or input screen) based on the probability of an error (or frequency of an error) per key according to the monitoring result, and displays the reconfigured keyboard.

[0127] Additionally, the control unit (150) performs artificial intelligence-based machine learning (artificial neural network / deep learning) based on the probability of typos occurring per key (or frequency of typos occurring) and the keyboard layout information of the current state of the keyboard according to the monitoring results, and reconstructs (or regenerates / reclassifies) a keyboard in which the first to ninth keys are rearranged (or rearranged) and / or resized to suit the user based on the machine learning results, and displays the reconstructed keyboard (or user-customized keyboard) on the display unit (130). At this time, the user-customized keyboard may be configured such that the position, size, etc. of each key are different from one another.

[0128] That is, the control unit (150) performs machine learning (or artificial intelligence / deep learning) using the probability of a typo per key (or frequency of a typo) based on the monitoring result, the keyboard layout information of the current state of the keyboard, etc., as input values ​​for a preset artificial intelligence-based keyboard configuration model, reconstructs (or regenerates / reclassifies) the user-customized keyboard based on the machine learning result (or artificial intelligence result / deep learning result), and displays the reconstructed keyboard (or user-customized keyboard) on the display unit (130).

[0129] For example, the first control unit monitors the alphabet input process according to the type and order of at least one key based on user input.

[0130] Additionally, the first control unit performs machine learning using the key-specific typo probability (or typo frequency) based on the monitoring result and the keyboard layout information of the current state of the keyboard (e.g., the first keyboard (700), etc.) as input values ​​for the keyboard configuration model, and based on the machine learning result, configures a second keyboard in which the size of the third key with a high typo probability is enlarged and the size of the second key with a low typo probability is reduced, and displays the configured second keyboard (800) on the first display unit as shown in FIG. 8 (S630).

[0131] As described above, an embodiment of the present invention inputs English alphabet characters by using a sequential combination of a first key to a ninth key corresponding to a plurality of preset symbols, and for uppercase and lowercase letters, a separate uppercase key is configured so that there is no need to create an unintuitive shape to distinguish between uppercase and lowercase letters, and characters can be input using a minimum number of keys and an intuitive interface within a small screen such as a smartwatch.

[0132] A person skilled in the art to which the present invention pertains will be able to make modifications and variations to the foregoing without departing from the essential characteristics of the present invention. Accordingly, the embodiments disclosed in the present invention are intended to explain, not limit, the technical concept of the present invention, and the scope of the technical concept of the present invention is not limited by these embodiments. The scope of protection of the present invention shall be interpreted by the claims below, and all technical concepts within an equivalent scope shall be interpreted as being included within the scope of rights of the present invention. Explanation of the symbols

[0133] 100: Alphabet input device using symbol combinations 110: Communication unit 120: Storage unit 130: Display unit 140: Voice output unit 150: Control unit

Claims

Claim 1 A display unit for displaying a keyboard including first to ninth keys corresponding to a plurality of preset symbols; The control unit includes a control unit that processes an alphabet input according to the type and order of at least one of the first to ninth keys when at least one of the first to ninth keys is input according to user input, wherein the control unit processes an alphabet input according to the type and order of the at least one input key and the key corresponding to the point where the user's gaze stops for a preset time when at least one of the first to ninth keys is input according to user input and a key input corresponding to the point where the user's gaze stops for a preset time is input, and the control unit processes an alphabet input according to the type and order of the at least one input key and the key corresponding to the point where the user's gaze stops for a preset time; wherein when at least one of the first to ninth keys is input according to user input and a user flick occurs while the last key input is maintained, the control unit performs any one of a preset lowercase / uppercase alphabet input processing function, a line break function after alphabet input processing, and a blank space addition function after alphabet input processing, according to the type and order of at least one input key and the flick direction; and when at least one of the first to ninth keys is input according to user input and the user's gaze movement is pre When moving in a set clockwise / counterclockwise direction or when the user's gaze movement moves diagonally / up / down, one of the following functions is performed according to the type and order of at least one input key and the user's gaze movement: a pre-set lowercase / uppercase alphabet input processing function, a line break function after alphabet input processing, and a blank space addition function after alphabet input processing; and when the first key of any one of the first to ninth keys is touched according to user input, while the touch state of the first key is maintained, one or more alphabets that can be input with the first key are arranged and displayed around the first key.An alphabet input device using a symbol combination, characterized by: when a flick occurs in the direction of a specific alphabet among one or more alphabets arranged around the first key displayed above, processing the input of a specific alphabet located in the direction of the specific alphabet; when the first key of any one of the first to ninth keys is touched according to user input and moves to the second key, and the touch state is released from the second key, processing the input of an alphabet according to the type and order of the first key and the second key; and when multiple keys among the first to ninth keys are input according to user input, checking the meaning corresponding to the input multiple keys among the meanings of multiple abbreviations pre-stored in a storage unit based on the relationship between the user and the conversation partner, and processing the input of the meaning corresponding to the checked multiple keys. Claim 2 A step of displaying a keyboard comprising first to ninth keys corresponding to a plurality of preset symbols by means of a display unit; The method comprises a step of processing an alphabet input according to the type and order of at least one key input among the first key to the ninth key when the input is received by the control unit according to user input, wherein the step of processing an alphabet input according to the type and order of the input at least one key input comprises, when the input is received by the user and a key input corresponding to the point where the user's gaze stops for a preset time is received, processing an alphabet input according to the type and order of the input at least one key and the key corresponding to the point where the user's gaze stops for a preset time, and wherein the step of processing an alphabet input according to the type and order of the input at least one key input comprises, when the input is received by the user and a flick by the user occurs while the last key input is maintained, a preset lowercase / uppercase alphabet input processing function, a line break function after alphabet input processing, and a blank space addition function after alphabet input processing. The step of performing any one of the functions and processing alphabet input according to the type and order of at least one key input is, when at least one of the first to ninth keys is input according to user input and the user's gaze movement moves in a preset clockwise / counterclockwise direction or in a diagonal / up / down direction, performing any one of the following functions according to the type and order of at least one key input and the user's gaze movement: a preset lowercase / uppercase alphabet input processing function, a line break function after alphabet input processing, and a blank space addition function after alphabet input processing.The step of processing alphabet input according to the type and order of at least one key entered above comprises: a process of displaying one or more alphabets that can be entered with the first key by arranging them around the first key while the touch state of the first key is maintained when the first key of any one of the first to ninth keys is touched according to user input; The method for inputting an alphabet using a symbol combination includes a process of inputting a specific alphabet located in the direction of a specific alphabet when a flick occurs in the direction of a specific alphabet among one or more alphabets arranged around the first key displayed above, wherein the step of inputting an alphabet according to the type and order of at least one key input is characterized by inputting an alphabet according to the type and order of the first key and the second key when the first key of any one of the first to ninth keys is touched according to user input, and then moving to the second key, and the touch state is released from the second key, and the step of inputting an alphabet according to the type and order of at least one key input is characterized by inputting an alphabet according to the type and order of the first key and the second key when a plurality of keys among the first to ninth keys are input according to user input, checking the meaning corresponding to the plurality of input keys among the meanings of a plurality of abbreviations pre-stored in a storage unit based on the relationship between the user and the conversation partner, and inputting the meaning corresponding to the confirmed plurality of keys. Claim 3 delete Claim 4 delete Claim 5 delete Claim 6 delete Claim 7 delete Claim 8 In claim 2, the step of processing alphabet input according to the type and order of at least one input key is characterized by: maintaining a touch state for the first key for a preset time while the first key among any one of the first to ninth keys is touched according to user input; moving from the touch state of the first key to the second key; and when the touch state is released from the second key, processing alphabet input according to the type and order of the first key corresponding to the touch, the first key corresponding to the touch state maintained for more than the time, and the second key corresponding to the touch after moving. Claim 9 delete Claim 10 The method of alphabet input using a symbol combination according to claim 2 further comprises: a step of monitoring an alphabet input process according to the type and order of at least one key according to user input by the control unit; a step of changing the keyboard layout on the keyboard or changing the size of the first to ninth keys displayed on the keyboard to different sizes by crowdsourcing information on frequently occurring typos based on the monitoring results by the control unit; a step of reconstructing a keyboard by rearranging and resizing the first to ninth keys in a user-customized manner based on the machine learning results by performing AI-based machine learning based on the probability of typos occurring per key according to the monitoring results and the keyboard layout information of the current state of the keyboard by the control unit; and a step of displaying the reconstructed keyboard by the display unit.

Images