Electronic device having a composite human interface and method of operating same - Patents.com

Abstract

An electronic device having a multi-function human interface is presented, comprising: a plurality of keycaps, where the plurality of keycaps comprises a first keycap; a plurality of elastic units, where the plurality of elastic units comprises a first elastic unit; a plurality of conductive materials, where the plurality of conductive materials comprises a first conductive material; and an electrode layer configured to generate a key input signal and a touch input signal.

Description

[Technical field]

[0001] The present disclosure relates to an electronic device having a multi-functional human interface. More specifically, the present disclosure relates to an electronic device having an interface and a method of operation thereof, which is for connecting to an electronic device such as a computer, a laptop computer, a tablet PC, a mobile phone, a TV, or a beam projector, and for transferring text information or pointer position related information to the electronic device such as a computer.

[0002] [Background technology]

[0003] Electronic devices such as computers, laptop computers, tablet PCs, mobile phones, TVs, and beam projectors need to be provided with at least one interface for operations such as generating at least one data, storing at least one data, and executing at least one command.

[0004] In the case of a computer, a text input device such as a keyboard may be provided as an interface, or a pointing device such as a mouse may be provided as an interface. Text information may be obtained from a keyboard connected to the computer, or pointer position related information or pointer execution commands may be obtained from a mouse connected to the computer.

[0005] Furthermore, in the case of a tablet PC or a mobile phone, a touch sensor may be provided as an interface, and movement / change information on the displayed screen, at least one function execution command, or text information via a virtual keyboard may be obtained through the provided touch interface.

[0006] However, interfaces for electronic devices such as computers, laptop computers, tablet PCs, mobile phones, TVs and beam projectors are not limited to the examples described above, and various interfaces may be provided.

[0007] Summary of the Invention [Problem to be solved by the invention]

[0008] The present disclosure is directed to providing an electronic device having a multi-functional human interface with integrated key input and touch input sensors.

[0009] The present disclosure is further directed to providing an electronic device having a multi-function human interface that includes an electrode layer with integrated key input sensors and touch input sensors.

[0010] Further, the present disclosure is directed to providing an electronic device having a multi-function human interface and reduced volume.

[0011] Furthermore, the present disclosure is directed to providing a method of operating an electronic device having a multi-functional human interface for enhancing user convenience.

[0012] The technical problems solved by the present disclosure are not limited to the above-mentioned technical problems, and other technical problems not mentioned will be clearly understood by a person skilled in the art from this specification and the accompanying drawings.

[0013] [Means for solving the problem]

[0014] According to an embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, comprising: a plurality of keycaps, where the plurality of keycaps comprises a first keycap; a plurality of elastic units, where the plurality of elastic units comprises a first elastic unit, the first elastic unit having a first conductive material; and an electrode layer configured to generate a key input signal and a touch input signal, where the first elastic units are positioned corresponding to the first keycaps, the electrode layer has a first type electrode configured to generate a touch input signal and a second type electrode configured to generate at least a key input signal, a first electrode included in the first type electrode and a second electrode included in the second type electrode are positioned to be at least partially overlapped by the first keycap, the second electrode is positioned to be at least partially overlapped by the first conductive material of the first elastic unit, and the first electrode is positioned to not be overlapped by the first conductive material of the first elastic unit.

[0015] Furthermore, according to another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device comprising: a plurality of keycaps, where the plurality of keycaps comprises a first keycap; and an electrode layer configured to generate a key input signal and a touch input signal, where the electrode layer has a first type of electrode configured to generate a touch input signal and a second type of electrode configured to generate at least the key input signal, the electrode layer having first through fourth holes associated with the first keycap, and a first electrode included in the second type of electrode is positioned within a first region defined by the first through fourth holes.

[0016] Further, according to yet another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device comprising: a plurality of key caps, the plurality of key caps having a first key cap, a second key cap adjacent to the first key cap in a width direction of the keyboard array, and a third key cap adjacent to the first key cap in a width direction of the keyboard array and spaced apart from the second key cap in the width direction of the keyboard array; and an electrode layer configured to generate key input signals and touch input signals, the electrode layer having a first type of electrode configured to generate the touch input signal and a second type of electrode configured to generate at least the key input signal, the electrode layer having a first type of wire consisting of electrodes electrically connected in a longitudinal direction of the keyboard array and a second type of wire consisting of electrodes electrically connected in a width direction of the keyboard array, and for generating the key input signals and the touch input signals, the first type of wire functions as either a transmitter or a receiver, and the second type of wire functions as either a transmitter or a receiver, The keyboard functions as the other of the transmitter and the receiver, and the second type of lines include a first line, a second line adjacent to the first line in the longitudinal direction of the keyboard arrangement, and a third line adjacent to the second line in the longitudinal direction of the keyboard arrangement, and the first electrode, which is a second type electrode included in the first line, is positioned so as to be overlapped by a second key cap, the second electrode, which is a first type electrode included in the first line, is positioned so as to be overlapped by a first key cap, and the third electrode, which is a second type electrode included in the second line, is positioned so as to be overlapped by a first key cap. a fourth electrode which is an electrode of the first type included in the second line is positioned to be overlapped by the second keycap, a fifth electrode which is an electrode of the first type included in the second line is positioned to be overlapped by the third keycap, a sixth electrode which is an electrode of the second type included in the third line is positioned to be overlapped by the third keycap, and a seventh electrode which is an electrode of the first type included in the third line is positioned to be overlapped by the first keycap.

[0017] Further, according to yet another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device comprising: a plurality of keycaps; and an electrode layer configured to generate key input signals and touch input signals, the electrode layer having a first type of electrode configured to generate the touch input signals and a second type of electrode configured to generate at least the key input signals, the electrode layer having a first type of line of electrodes electrically connected in a longitudinal direction of a keyboard arrangement and a second type of line of electrodes electrically connected in a width direction of the keyboard arrangement, for generating the key input signals and the touch input signals. The first type of lines function as either a transmitter or a receiver, and the second type of lines function as the other of the transmitter or receiver, the second type of lines including a first line, a second line adjacent to the first line in the longitudinal direction of the keyboard array, and a third line adjacent to the second line in the longitudinal direction of the keyboard array, the first type of lines including a fourth line, a fifth line adjacent to the fourth line in the width direction of the keyboard array, and a sixth line adjacent to the fourth line in the width direction of the keyboard array, the first line, the second line, and the third line including at least one second type electrode, the fourth line including a plurality of second type electrodes, and the fifth line and the sixth line including no second type electrodes.

[0018] Further, according to yet another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device comprising: a plurality of keycaps, the plurality of keycaps including a first keycap and a second keycap adjacent to the first keycap in a width direction of a keyboard arrangement; and an electrode layer configured to generate a key input signal and a touch input signal, the electrode layer including a first electrode configured to generate a first key input signal according to a user's key input on the first keycap, and a second electrode configured to generate a first touch input signal according to a user's touch input on a portion of the first keycap. a second electrode, a third electrode configured to generate a second key input signal in accordance with a user's key input on the second keycap, and a fourth electrode configured to generate a second touch input signal in accordance with a user's touch input on a portion of the second keycap, wherein the first electrode and the second electrode are positioned to be overlapped by the first keycap, the third electrode and the fourth electrode are positioned to be overlapped by the second keycap, the first electrode is electrically connected to the fourth electrode but not electrically connected to the third electrode, and the third electrode is electrically connected to the second electrode but not electrically connected to the first electrode.

[0019] Further, according to yet another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device comprising: a plurality of keycaps, the plurality of keycaps including a first keycap and a second keycap adjacent to the first keycap in a width direction of a keyboard array; and an electrode layer configured to generate a key input signal and a touch input signal, the electrode layer including a first type electrode configured to generate a touch input signal and a second type electrode configured to generate at least a key input signal, the electrode layer including a first electrode being a first type electrode overlaid by the first keycap, a second electrode being a second type electrode overlaid by the first keycap, a third electrode being a first type electrode overlaid by the second keycap, and a fourth electrode being a second type electrode overlaid by the second keycap, the first electrode and the fourth electrode being electrically connected to each other, the second electrode and the third electrode being electrically connected to each other, and the second electrode and the fourth electrode being not electrically connected to each other.

[0020] Further, according to yet another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device including a plurality of keycaps, the plurality of keycaps including a first keycap, a second keycap, a third keycap, and a fourth keycap, the first keycap and the second keycap being adjacent to each other in a width direction of a keyboard array, and the third keycap and the fourth keycap being adjacent to each other in a width direction of the keyboard array; and an electrode layer configured to generate a key input signal and a touch input signal, the electrode layer including a first electrode configured to generate a first key input signal in accordance with a user's input on the first keycap, a second electrode configured to generate a second key input signal in accordance with a user's input on the second keycap, and a fourth electrode configured to generate a first key input signal in accordance with a user's input on the third keycap. a third electrode configured to generate a third key input signal according to a user's input on a fourth keycap, and a fourth electrode configured to generate a fourth key input signal according to a user's input on a fourth keycap, wherein the electronic device having a multifunction human interface comprises a key input area corresponding to a predetermined keyboard arrangement and configured to generate a key input signal, a touch input area corresponding to at least a portion of the predetermined keyboard arrangement and configured to generate a touch input signal, and a multi-function area positioned in an area where the key input area and the touch input area overlap, wherein the first keycap and the second keycap are positioned to be included in the multi-function area, and the third keycap and the fourth keycap are positioned not to be included in the multi-function area, the first electrode is not electrically connected to the second electrode, and the third electrode is electrically connected to the fourth electrode.

[0021] According to yet another embodiment of the present disclosure, there is provided a method for operating an electronic device having a multifunctional human interface and including a touch input area corresponding to at least a portion of a keyboard arrangement, the method comprising: operating the electronic device having the multifunctional human interface in a first operating mode in which a first touch input area corresponding to a portion of the touch input area is active; and generating pointer position-related information based on the acquired touch input when a touch input is acquired from a user to the touch input area, wherein if the touch input acquired from the user is included in the first touch input area, the pointer position-related information is generated based on the acquired touch input, or if the touch input acquired from the user is included in an external area, which is an external area that is included in the touch input area but not included in the first touch input area, the pointer position-related information is not generated, and if a touch start point of the touch input acquired from the user is included in the first touch input area, the pointer position-related information is generated based on the touch input acquired from the user even if a touch end point or at least a portion of a touch path of the touch input acquired from the user is included in the external area.

[0022]

[0023] However, the solutions to the problems of the present disclosure are not limited to the solutions described above, and other solutions not mentioned will be clearly understood by those skilled in the art from this specification and the accompanying drawings.

[0024] Effect of the Invention

[0025] According to an embodiment of the present disclosure, an electronic device having a multi-function human interface with an integrated key input sensor and touch input sensor may be provided.

[0026] According to an embodiment of the present disclosure, an electronic device having a multi-function human interface may be provided, which includes an electrode layer with integrated key input sensors and touch input sensors.

[0027] According to an embodiment of the present disclosure, an electronic device having a multi-function human interface and a reduced volume may be provided.

[0028] According to an embodiment of the present disclosure, a method for operating an electronic device having a multi-functional human interface for enhancing user convenience may be provided.

[0029] The effects of the present disclosure are not limited to the effects described above, and other effects not mentioned will be clearly understood by those skilled in the art from the present specification and the accompanying drawings.

[0030] [Brief description of the drawings]

[0031] [Figure 1] FIG. 1 is a block diagram illustrating an electronic device having a multi-function human interface, according to an embodiment.

[0032] [Diagram 2] FIG. 2 illustrates a keyboard arrangement for an electronic device having a multifunction human interface, according to an embodiment.

[0033] [Diagram 3] FIG. 2 illustrates layers of an electronic device having a multi-function human interface, according to an embodiment.

[0034] [Figure 4] FIG. 2 illustrates the operation of an electronic device having a multifunctional human interface according to an embodiment.

[0035] [Diagram 5] FIG. 1 illustrates an electrode layer included in an electronic device having a multi-function human interface, according to an embodiment.

[0036] [Figure 6]FIG. 2 illustrates a portion of an electrode layer for explaining an electrode layer included in an electronic device having a multifunctional human interface according to an embodiment.

[0037] [Figure 7] 11A-11C illustrate various embodiments of a second type of electrode, according to an embodiment.

[0038] [Figure 8] 11A-11C show various embodiments of protrusions of a second type of electrode, according to an embodiment.

[0039] [Figure 9] 1A-1C are diagrams illustrating a portion of an electrode layer according to an embodiment for explaining an electrode layer included in an electronic device having a multifunctional human interface according to an embodiment.

[0040] [Figure 10] FIG. 2 is a diagram showing a portion of an electronic device having a multifunctional human interface according to an embodiment, for explaining the electronic device having a multifunctional human interface according to an embodiment.

[0041] [Figure 11] FIG. 2 is a diagram showing a portion of an electronic device having a multifunctional human interface according to an embodiment, for explaining the electronic device having a multifunctional human interface according to an embodiment.

[0042] [Figure 12] FIG. 1 illustrates an electrode layer included in an electronic device having a multi-function human interface, according to an embodiment.

[0043] [Figure 13] FIG. 1 illustrates an electronic device having a multi-function human interface according to an embodiment.

[0044] [Figure 14]FIG. 1 illustrates an electronic device having a multi-function human interface according to an embodiment.

[0045] [Figure 15] FIG. 1 illustrates an electronic device having a multi-function human interface according to an embodiment.

[0046] [Figure 16] 1 illustrates the operation modes of an electronic device having a multifunctional human interface and the corresponding operation of the interface device according to an embodiment;

[0047] [Figure 17] 1 illustrates the operation modes of an electronic device having a multifunctional human interface and the corresponding operation of the interface device according to an embodiment;

[0048] [Figure 18] 4 is a flow chart illustrating a method of operating an electronic device having a multifunctional human interface, according to an embodiment.

[0049] [Figure 19] 4 is a flow chart illustrating a method of operating an electronic device having a multifunctional human interface, according to an embodiment.

[0050] [Figure 20] 4 is a flow chart illustrating a method of operating an electronic device having a multifunctional human interface, according to an embodiment.

[0051] [Figure 21] FIG. 2 illustrates a scenario of use of an electronic device with a multifunctional human interface according to an embodiment.

[0052] [Figure 22] 1 illustrates a screen displayed through a virtual reality device according to a user's input, according to an embodiment. [Figure 23] 1 illustrates a screen displayed through a virtual reality device according to a user's input, according to an embodiment.

[0053] [Figure 24] A diagram showing a screen displayed through a virtual reality device according to an operation mode of an electronic device having a multifunctional human interface according to an embodiment. [Diagram 25] A diagram showing a screen displayed through a virtual reality device according to an operation mode of an electronic device having a multifunctional human interface according to an embodiment. [Figure 26] A diagram showing a screen displayed through a virtual reality device according to an operation mode of an electronic device having a multifunctional human interface according to an embodiment. [Figure 27] A diagram showing a screen displayed through a virtual reality device according to an operation mode of an electronic device having a multifunctional human interface according to an embodiment. [Figure 28] A diagram showing a screen displayed through a virtual reality device according to an operation mode of an electronic device having a multifunctional human interface according to an embodiment.

[0054] [Figure 29] 1 illustrates a screen displayed through a virtual reality device according to an embodiment of an application running on the virtual reality device. [Diagram 30] 1 illustrates a screen displayed through a virtual reality device according to an embodiment of an application running on the virtual reality device.

[0055] [Diagram 31] 1 illustrates a screen displayed through a virtual reality device according to an application running on the virtual reality device, according to an embodiment. [Diagram 32]1 illustrates a screen displayed through a virtual reality device according to an application running on the virtual reality device, according to an embodiment.

[0056] [Diagram 33] 1A-1C are diagrams illustrating screens displayed through a virtual reality device according to power modes of an electronic device having a multifunction human interface according to an embodiment.

[0057] [Diagram 34] FIG. 1 illustrates an image included on a screen displayed through a virtual reality device and corresponding to an electronic device having a multi-function human interface, according to an embodiment.

[0058] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0059] The embodiments described in this specification are intended to clearly explain the concept of the present disclosure to those skilled in the art to which the present disclosure pertains, and therefore the present disclosure is not limited to the embodiments described in this specification, and the scope of the present disclosure should be interpreted as including modifications or variations within the concept of the present disclosure.

[0060] As terms used in this specification, common terms currently widely used in consideration of the function in this disclosure are used. However, terms may change according to the intention of those skilled in the art, precedent, or the emergence of new technology. However, unlike this, when a specific term is defined and used as having an optional meaning, the meaning of the term is explained. Therefore, the terms used in this specification should be interpreted based on the actual meaning and details of the term throughout the specification, not simply the name of the term.

[0061] The drawings attached to this specification are intended to easily explain the present disclosure, and the shapes shown in the drawings may be exaggerated to facilitate understanding of the present disclosure, and therefore the present disclosure is not limited by the drawings.

[0062] When an element or layer described herein is referred to as being on another element or layer, it can be directly on the other element or layer, or there may be intervening layers or elements.

[0063] Throughout this specification, the same reference numbers generally refer to the same elements.

[0064] Numbers used in the description herein (eg, first, second, etc.) may be understood as identifiers to distinguish one element from another element.

[0065] The terms "module" and "part" used in the description of this specification are used solely for ease of description of this specification. They are not intended to have different special meanings or functions, and therefore may be used individually or interchangeably.

[0066] In this specification, if a detailed description of a known configuration or function related to the present disclosure is deemed to make the subject matter of the present disclosure unclear, such detailed description will be omitted.

[0067]

[0068] 1. An electronic device having a multi-function human interface, the electronic device comprising: a plurality of keycaps, where the plurality of keycaps comprises a first keycap; a plurality of elastic units, where the plurality of elastic units comprises a first elastic unit; a plurality of conductive materials, where the plurality of conductive materials comprises a first conductive material; and an electrode layer configured to generate a key input signal and a touch input signal, the electrode layer having a first type of electrode configured to generate a touch input signal; and a second type of electrode configured to generate at least a key input signal; where a first electrode included in the first type of electrode and a second electrode included in the second type of electrode are arranged to at least partially overlap the first keycap, where the second electrode is arranged to at least partially overlap the first conductive material, and where the first electrode is arranged to not overlap the first conductive material.

[0069] The electrode layer has a first type of lines made of electrodes electrically connected in a longitudinal direction of a keyboard arrangement and a second type of lines made of electrodes electrically connected in a width direction of the keyboard arrangement, the first type of lines being configured to function as one of a transmitter or a receiver and the second type of lines being configured to function as the other of the transmitters or the receivers.

[0070] The first electrode and the second electrode are included in the first type of line.

[0071] The first electrode and the second electrode are included in the second type of line.

[0072] The first electrodes are included in either the first type of lines or the second type of lines, and the second electrodes are included in the other of the first type of lines or the second type of lines.

[0073] The electrode layer further includes a third electrode included in the first type of electrode and a fourth electrode included in the second type of electrode, the third electrode and the fourth electrode being arranged to at least partially overlap the first keycap, the fourth electrode being arranged to at least partially overlap the first conductive material, and the third electrode being arranged to at least partially not overlap the first conductive material.

[0074] The second electrode and the fourth electrode are disposed adjacent to each other.

[0075] The second type of electrodes includes protrusions.

[0076] The second type of electrodes include protrusions, and the shape of the protrusions of the second electrodes is the same as the shape of the protrusions of the fourth electrodes.

[0077] The second type of electrodes include protrusions, and the shape of the protrusions of the second electrodes is different from the shape of the protrusions of the fourth electrodes.

[0078] The second type of electrode includes a protrusion, and the protrusion of the second electrode and the protrusion of the fourth electrode are disposed to overlap the first conductive material.

[0079] The size of the area where the protrusion of the second electrode overlaps with the first conductive material is the same as the size of the area where the protrusion of the fourth electrode overlaps with the first conductive material.

[0080] The first conductive material is arranged to move in response to movement of the first keycap.

[0081] The first conductive material is configured to be contained within the first keycap.

[0082] The first conductive material is configured to be contained within the first keycap.

[0083] The first conductive material is formed to be contained in the first elastic unit.

[0084]

[0085] Furthermore, according to another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device comprising: a plurality of keycaps, where the plurality of keycaps comprises a first keycap; and an electrode layer configured to generate a key input signal and a touch input signal, the electrode layer having a first type electrode configured to generate a touch input signal and a second type electrode configured to generate at least the key input signal, the electrode layer including first through fourth holes associated with the first keycap, and a first electrode included in the second type electrode is positioned within a first region defined by the first through fourth holes.

[0086] In this specification, the second hole may be adjacent to the first hole in the longitudinal direction of the keyboard arrangement, the third hole may be adjacent to the first hole in the width direction of the keyboard arrangement, and the fourth hole may be adjacent to the third hole in the longitudinal direction of the keyboard arrangement and adjacent to the second hole in the width direction of the keyboard arrangement.

[0087] In this specification, the electrode layer may further have a fifth hole adjacent to the second hole in the longitudinal direction of the keyboard arrangement and a sixth hole adjacent to the fourth hole in the longitudinal direction of the keyboard arrangement, and the second type of electrode may not be included in the second area defined by the second hole, the fourth hole, the fifth hole, and the sixth hole.

[0088] In this specification, the multiple keycaps may further include a second keycap adjacent to the first keycap in the longitudinal direction of the keyboard array, and the second region may be overlapped by a portion of the first keycap and a portion of the second keycap.

[0089] In this specification, the electrode layer may further include a second electrode included in the second type of electrode, and the second electrode may be positioned within a first region defined by the first hole to the fourth hole.

[0090] Herein, when a first electrode functions as part of a transmitter, a second electrode may function as part of a receiver.

[0091] Herein, the first electrode may include a first protrusion, the second electrode may include a second protrusion, and the first protrusion and the second protrusion may be positioned adjacent to one another.

[0092] In this specification, the electronic device with a multi-function human interface may further include a lower plate and a keyboard mechanism layer. The keyboard mechanism layer may have a first keyboard mechanism unit. The first keyboard mechanism unit may be positioned corresponding to the first keycap. The lower plate may have a first coupling member to a fourth coupling member. The first coupling member to the fourth coupling member may pass through the first hole to the fourth hole and may be coupled to the first keyboard mechanism.

[0093]

[0094] Further, according to yet another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device comprising: a plurality of key caps, the plurality of key caps having a first key cap, a second key cap adjacent to the first key cap in a width direction of the keyboard array, and a third key cap adjacent to the first key cap in a width direction of the keyboard array and spaced apart from the second key cap in the width direction of the keyboard array; and an electrode layer configured to generate key input signals and touch input signals, the electrode layer having a first type of electrode configured to generate the touch input signals and a second type of electrode configured to generate at least the key input signals, the electrode layer having a first type of wire consisting of electrodes electrically connected in a length direction of the keyboard array and a second type of wire consisting of electrodes electrically connected in a width direction of the keyboard array, and for generating the key input signals and the touch input signals, the first type of wire functions as either a transmitter or a receiver, and the second type of wire functions as either a transmitter or a receiver. , functioning as the other of a transmitter or a receiver, the second type lines including a first line, a second line adjacent to the first line in a longitudinal direction of the keyboard arrangement, and a third line adjacent to the second line in a longitudinal direction of the keyboard arrangement, the first electrode being a second type electrode included in the first line is positioned so as to be overlapped by a second key cap, the second electrode being a first type electrode included in the first line is positioned so as to be overlapped by a first key cap, and the third electrode being a second type electrode included in the second line is positioned so as to be overlapped by a first key cap. a fourth electrode which is an electrode of the first type included in the second line is positioned to be overlapped by the second keycap, a fifth electrode which is an electrode of the first type included in the second line is positioned to be overlapped by the third keycap, a sixth electrode which is an electrode of the second type included in the third line is positioned to be overlapped by the third keycap, and a seventh electrode which is a first electrode included in the third line is positioned to be overlapped by the first keycap.

[0095] In this specification, the first electrode and the fourth electrode may be positioned adjacent to each other in the longitudinal direction of the keyboard arrangement, the second electrode and the third electrode may be positioned adjacent to each other in the longitudinal direction of the keyboard arrangement, the third electrode and the seventh electrode may be positioned adjacent to each other in the longitudinal direction of the keyboard arrangement, and the fifth electrode and the sixth electrode may be positioned adjacent to each other in the longitudinal direction of the keyboard arrangement.

[0096]

[0097] Further, according to yet another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device comprising: a plurality of keycaps; and an electrode layer configured to generate key input signals and touch input signals, the electrode layer having a first type of electrode configured to generate the touch input signals and a second type of electrode configured to generate at least the key input signals, the electrode layer having a first type of line of electrodes electrically connected in a longitudinal direction of a keyboard arrangement and a second type of line of electrodes electrically connected in a width direction of the keyboard arrangement, for generating the key input signals and the touch input signals. The first type of lines function as either a transmitter or a receiver, and the second type of lines function as the other of the transmitter or receiver, the second type of lines including a first line, a second line adjacent to the first line in the longitudinal direction of the keyboard array, and a third line adjacent to the second line in the longitudinal direction of the keyboard array, the first type of lines including a fourth line, a fifth line adjacent to the fourth line in the width direction of the keyboard array, and a sixth line adjacent to the fourth line in the width direction of the keyboard array, the first line, the second line, and the third line including at least one second type electrode, the fourth line including a plurality of second type electrodes, and the fifth line and the sixth line including no second type electrodes.

[0098]

[0099] Further, according to yet another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device comprising: a plurality of keycaps, the plurality of keycaps including a first keycap and a second keycap adjacent to the first keycap in a width direction of a keyboard arrangement; and an electrode layer configured to generate a key input signal and a touch input signal, the electrode layer including a first electrode configured to generate a first key input signal according to a user's key input on the first keycap, and a second electrode configured to generate a first touch input signal according to a user's touch input on a portion of the first keycap. a second electrode, a third electrode configured to generate a second key input signal in accordance with a user's key input on the second keycap, and a fourth electrode configured to generate a second touch input signal in accordance with a user's touch input on a portion of the second keycap, wherein the first electrode and the second electrode are positioned to be overlapped by the first keycap, the third electrode and the fourth electrode are positioned to be overlapped by the second keycap, the first electrode is electrically connected to the fourth electrode but not electrically connected to the third electrode, and the third electrode is electrically connected to the second electrode but not electrically connected to the first electrode.

[0100]

[0101] Further, according to yet another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device comprising: a plurality of keycaps, the plurality of keycaps including a first keycap and a second keycap adjacent to the first keycap in a width direction of a keyboard array; and an electrode layer configured to generate a key input signal and a touch input signal, the electrode layer including a first type electrode configured to generate a touch input signal and a second type electrode configured to generate at least a key input signal, the electrode layer including a first electrode being a first type electrode overlaid by the first keycap, a second electrode being a second type electrode overlaid by the first keycap, a third electrode being a first type electrode overlaid by the second keycap, and a fourth electrode being a second type electrode overlaid by the second keycap, the first electrode and the fourth electrode being electrically connected to each other, the second electrode and the third electrode being electrically connected to each other, and the second electrode and the fourth electrode being not electrically connected to each other.

[0102]

[0103] Further, according to yet another embodiment of the present disclosure, there is provided an electronic device having a multi-function human interface, the electronic device including a plurality of keycaps, the plurality of keycaps including a first keycap, a second keycap, a third keycap, and a fourth keycap, the first keycap and the second keycap being adjacent to each other in a width direction of a keyboard array, and the third keycap and the fourth keycap being adjacent to each other in a width direction of the keyboard array; and an electrode layer configured to generate a key input signal and a touch input signal, the electrode layer including a first electrode configured to generate a first key input signal in accordance with a user's input on the first keycap, a second electrode configured to generate a second key input signal in accordance with a user's input on the second keycap, and a fourth electrode configured to generate a first key input signal in accordance with a user's input on the third keycap. a third electrode configured to generate a third key input signal according to a user's input on a fourth keycap, and a fourth electrode configured to generate a fourth key input signal according to a user's input on a fourth keycap, wherein the electronic device having a multifunction human interface comprises a key input area corresponding to a predetermined keyboard arrangement and configured to generate a key input signal, a touch input area corresponding to at least a portion of the predetermined keyboard arrangement and configured to generate a touch input signal, and a multi-function area positioned in an area where the key input area and the touch input area overlap, wherein the first keycap and the second keycap are positioned to be included in the multi-function area, and the third keycap and the fourth keycap are positioned not to be included in the multi-function area, the first electrode is not electrically connected to the second electrode, and the third electrode is electrically connected to the fourth electrode.

[0104]

[0105] According to yet another embodiment of the present disclosure, there is provided a method for operating an electronic device having a multifunctional human interface and including a touch input area corresponding to at least a portion of a keyboard arrangement, the method comprising: operating the electronic device having the multifunctional human interface in a first operating mode in which a first touch input area corresponding to a portion of the touch input area is active; and generating pointer position-related information based on the acquired touch input when a touch input is acquired from a user to the touch input area, wherein if the touch input acquired from the user is included in the first touch input area, the pointer position-related information is generated based on the acquired touch input, or if the touch input acquired from the user is included in an external area, which is an external area that is included in the touch input area but not included in the first touch input area, the pointer position-related information is not generated, and if a touch start point of the touch input acquired from the user is included in the first touch input area, the pointer position-related information is generated based on the touch input acquired from the user even if a touch end point or at least a portion of a touch path of the touch input acquired from the user is included in the external area.

[0106] Herein, the center of the first touch input area may be positioned to the left or right of the center of the touch input area.

[0107] In this specification, an electronic device with a multi-function human interface may include a plurality of keycaps, and the touch input obtained from a user may be touch input on the plurality of keycaps.

[0108] In this specification, an electronic device having a multi-functional human interface may include an electrode layer for recognizing a touch input area, and touch input obtained from a user may be input to generate a touch input signal in at least a portion of the electrode layer.

[0109]

[0110] In this specification, the operating method may further include a step of operating the electronic device having a multifunction human interface in a second operating mode in which a second touch input area different from the first touch input area is active when touch input is obtained from a user to a predetermined area.

[0111] In this specification, at least a part of the predetermined area may be included in the first touch input area.

[0112] In this specification, the direction from the center of the first touch input area to the center of the predetermined area may be different from the direction from the center of the touch input area to the center of the first touch input area.

[0113] In this specification, when a touch starting point of a touch input to a predetermined area acquired from a user is included in a first touch input area, the electronic device having a multifunctional human interface may operate in a second operation mode, and when a touch starting point of a touch input to a predetermined area acquired from a user is included in an external area, the operation mode of the electronic device having a multifunctional human interface may remain in a first operation mode.

[0114] In this specification, an electronic device having a multi-function human interface may be provided with a plurality of keycaps, and the predetermined area may at least partially overlap at least one of the keycaps corresponding to key G or the keycap corresponding to key H among the plurality of keycaps.

[0115] In this specification, the second touch input area may be the same as the touch input area.

[0116] In this specification, the operating method may further include a step of operating the electronic device having the multi-function human interface in the first operating mode if the electronic device having the multi-function human interface does not receive touch input from a user for a certain period of time or longer while operating in the second operating mode.

[0117] In this specification, even if an electronic device having a multi-function human interface acquires touch input from a user in which the touch starting point is included in an external area while the electronic device is operating in a second operating mode, pointer position related information may be generated based on the touch input acquired from the user.

[0118] In this specification, a touch path may be a path of a user's touch input from a touch start point to a touch end point.

[0119] In this specification, the operating method may further include a step of operating the electronic device having a multifunction human interface in a second operating mode in which a second touch input area different from the first touch input area is active when a touch input obtained from a user is included in the first touch input area.

[0120] In the present specification, in an operating method, when a touch starting point of a touch input obtained from a user is included in an external area, even if a touch ending point of the touch input obtained from a user or at least a part of a touch path is included in a predetermined area, an operating mode of an electronic device having a multi-function human interface may not be changed.

[0121] Herein, the operating method may further comprise changing an operating mode of the electronic device having a multifunctional human interface from the second operating mode to the first operating mode if at least one revocation condition is met.

[0122] In this specification, at least one cancellation condition may include a time-related condition, and if the electronic device having a multi-functional human interface does not receive touch input from a user for a certain period of time or longer while operating in the second operating mode, the operating mode of the electronic device having a multi-functional human interface may be changed from the second operating mode to the first operating mode.

[0123] In this specification, the electronic device with a multi-function human interface may include a plurality of key caps, and the at least one cancellation condition may include a condition related to a key input, and if the electronic device with a multi-function human interface acquires a key input signal corresponding to a first key cap included in the plurality of key caps while operating in the second operating mode, the second operating mode of the electronic device with a multi-function human interface may be deactivated.

[0124] In this specification, when an electronic device having a multi-function human interface acquires a key input signal corresponding to a second key cap included in the plurality of key caps while operating in a second operating mode, the operating mode of the electronic device having a multi-function human interface may remain in the second operating mode.

[0125] In this specification, while operating in a second operating mode, the electronic device having a multi-function human interface obtains a key input signal corresponding to a first keycap included in the plurality of keycaps, and the operating mode of the electronic device having a multi-function human interface is changed from the second operating mode to a key input operating mode, and then, when a touch input is obtained from a user, the operating mode of the electronic device having a multi-function human interface may be changed from the key input operating mode to the first operating mode.

[0126] In this specification, the at least one cancellation condition may include a condition related to touch input, and if the electronic device having a multi-function human interface obtains touch input from a user for a predetermined number of touch points while operating in the second operating mode, the operating mode of the electronic device having a multi-function human interface may be changed from the second operating mode to the first operating mode.

[0127] In this specification, touch input to a predetermined number of touch points may include touch input to four touch points.

[0128] In this specification, the at least one cancellation condition may include a condition related to touch input, and when the electronic device having a multi-function human interface obtains touch input to a specific area from a user while operating in the second operating mode, the operating mode of the electronic device having a multi-function human interface may be changed from the second operating mode to the first operating mode.

[0129] In this specification, when the electronic device having a multi-function human interface obtains touch input from a user for four touch points for a specific area while operating in a second operating mode, the operating mode of the electronic device having a multi-function human interface may be changed from the second operating mode to the first operating mode.

[0130] In this specification, the at least one cancellation condition may include a condition related to a power mode, and if the electronic device having a multi-function human interface is powered off while operating in the second operating mode and then powered on again, the electronic device having a multi-function human interface may operate in the first operating mode.

[0131] In this specification, when a touch input in which a touch starting point is included in a first touch input area and a touch ending point or at least a portion of a touch path is included in an external area is obtained from a user, and then an additional touch input in which the touch starting point is included in the external area is obtained, pointer position related information may be generated based on the additional touch input obtained from the user.

[0132] In this specification, when the touch input obtained from the user is included in the external region, the pointer position related information may not be generated, but at least one function related to the touch may be performed.

[0133] In this specification, when a touch input acquired from a user is included in an external area and is a touch input related to a predetermined gesture, a function related to the predetermined gesture may be executed.

[0134] In this specification, the function associated with the predetermined gesture may include at least one of the functions of scrolling, zooming, and screen swapping.

[0135] In this specification, when the touch path of the touch input acquired from the user is included in the external area after the touch starting point of the touch input acquired from the user is included in the first touch input area, a second touch input area different from the first touch input area may be activated. When at least a part of the touch path of the touch input acquired from the user is included in the first touch input area again, the first touch input area may be activated.

[0136] In this specification, an electronic device having a multifunctional human interface may include a second touch input area. When a touch start point of a touch input acquired from a user is included in the second touch input area, information related to adjustment of an attribute value of an adjustment target attribute may be generated. When a touch start point of a touch input acquired from a user is included in the first touch input area, and a touch end point or at least a part of a touch path is included in the second touch input area, pointer position related information is generated. When a touch start point of a touch input acquired from a user is included in an external area, and a touch end point or at least a part of a touch path is included in the second touch input area, information related to adjustment of an attribute value of an adjustment target attribute may be generated.

[0137]

[0138] The multi-functional human interface according to the present disclosure may refer to an interface that is connected to an electronic device such as a computer, a laptop computer, a tablet PC, a mobile phone, a TV, or a beam projector, for transferring text information or pointer position related information to the electronic device such as a computer.

[0139] In particular, an electronic device with a multi-functional human interface according to the present disclosure is an electronic device with a multi-functional human interface that provides a physical configuration that enables keystrokes so that a user can more accurately and conveniently input key inputs, and also enables touch input within the areas where keystrokes are possible, thereby enabling a user to more easily and quickly switch between interfaces.

[0140]

[0141] FIG. 1 is a block diagram illustrating an electronic device having a multifunctional human interface, according to an embodiment.

[0142] Referring to FIG. 1, an electronic device 1000 having a multi-function human interface according to an embodiment may include a plurality of key caps 1010, a plurality of elastic units 1020, a touch input sensor 1030, a key input sensor 1040, and a controller 1050.

[0143] The plurality of key caps 1010 according to the embodiment may be generally understood as a plurality of key caps or key covers included in a keyboard.

[0144] In this specification, the multiple key caps 1010 according to the embodiment may be provided with the same shape as each other, but is not limited thereto. The multiple key caps may be provided with different shapes, or some of the key caps may be provided with the same shape and some of the key caps may be provided with different shapes.

[0145] Furthermore, multiple keycaps 1010 according to embodiments may be provided so as to be physically distinct from one another.

[0146] For example, the first keycap and the second keycap included in the plurality of keycaps 1010 according to the embodiment may be provided so as to be physically distinct from each other, but are not limited thereto.

[0147] Further, the keycaps 1010 according to an embodiment may be implemented to move in a distinguishable manner according to a user's press input.

[0148] For example, but not limited to, the first keycap and the second keycap included in the plurality of keycaps 1010 according to the embodiment may be realized to move in a distinguishable manner according to a user's press input.

[0149]

[0150] The elastic units 1020 according to the embodiment can be understood as elements for providing a restoring force to the keycaps.

[0151] For example, the multiple elastic units 1020 according to the embodiment may be elements that provide a restoring force to each of the multiple keycaps 1010 so that each of the multiple keycaps 1010 moves in accordance with a user's press input and then returns to their original positions.

[0152] Furthermore, the elastic units 1020 according to the embodiment may be provided as or in a shape having elasticity.

[0153] For example, the plurality of elastic units 1020 according to the embodiment may be provided as or in the shape of an elastic material, such as, but not limited to, a rubber dome or a spring.

[0154] Furthermore, a plurality of elastic units 1020 according to the embodiment may be positioned corresponding to a plurality of key caps 1010, respectively.

[0155] For example, a first elastic unit included in the plurality of elastic units 1020 according to the embodiment may be positioned corresponding to a first key cap included in the plurality of key caps 1010 according to the embodiment, and a second elastic unit included in the plurality of elastic units 1020 according to the embodiment may be positioned corresponding to a second key cap included in the plurality of key caps 1010 according to the embodiment. However, no limitation is imposed thereon.

[0156] In this specification, positioning the multiple elastic units 1020 according to the embodiment in correspondence with the multiple keycaps 1010 may mean positioning the multiple elastic units respectively to provide a restoring force to the multiple keycaps 1010, and may mean positioning the multiple elastic units respectively to at least partially directly / indirectly contact the multiple keycaps 1010.

[0157]

[0158] According to an embodiment, the touch input sensor 1030 may be an element for obtaining touch input from a user and generating a touch input signal.

[0159] In this specification, touch input from a user may refer to, but is not limited to, contact of the user with the plurality of keycaps 1010. Touch input from a user may be understood to include input based on the proximity of a part of the user's body to the plurality of keycaps 1010.

[0160] Furthermore, a touch input signal may refer to, but is not limited to, an electrical signal generated in accordance with touch input from a user.

[0161] Furthermore, the touch input sensor 1030 according to the embodiment may be implemented as various touch interfaces, such as, but not limited to, a resistive touch panel, a pressure-sensitive touch panel, a capacitive touch panel, an optical touch panel, and an ultrasonic touch panel.

[0162] Further, the touch input sensor 1030 according to an embodiment may be positioned to form a touch area in an area that at least partially overlaps the plurality of keycaps 1010.

[0163] For example, when the touch input sensor 1030 according to the embodiment includes an electrode layer for implementing a capacitive touch panel, the electrode layer may be positioned corresponding to at least a portion of the plurality of keycaps 1010 such that a touch area is formed within an area at least partially overlapping with the plurality of keycaps 1010. However, no limitation is imposed thereon.

[0164] In this specification, positioning an electrode layer corresponding to at least a portion of the plurality of keycaps 1010 may mean, but is not limited to, positioning the electrode layer so that it is overlapped by at least a portion of the plurality of keycaps 1010.

[0165]

[0166] The key input sensor 1040 according to the embodiment may be an element for obtaining a key input from a user and generating a key input signal.

[0167] In this specification, a key input from a user may mean, but is not limited to, a press input on a plurality of key caps 1010. The key input may be understood to include various types of inputs for generating key input signals corresponding to pre-specified positions.

[0168] Furthermore, the key input signal may refer to, but is not limited to, an electrical signal generated in accordance with a key input from a user.

[0169] Furthermore, the key input sensor 1040 according to the embodiment may be implemented using a switch system.

[0170] For example, but not limited to, the key input sensor 1040 according to an embodiment may include a plurality of switches and may be implemented to generate a key input signal corresponding to a phase shift of each of the plurality of switches.

[0171] In this specification, a plurality of switches may be positioned corresponding to a plurality of keycaps 1010, respectively.

[0172] For example, a first switch included in the plurality of switches may be positioned corresponding to a first keycap included in the plurality of keycaps 1010, and a second switch included in the plurality of switches may be positioned corresponding to a second keycap included in the plurality of keycaps 1010, although no limitation is imposed thereto.

[0173] As used herein, positioning the switches in correspondence with the keycaps 1010 may mean, but is not limited to, positioning the switches in direct / indirect contact with the keycaps 1010 at least at one time such that the phase of each of the switches shifts as the keycaps 1010 move.

[0174] Furthermore, the key input sensor 1040 according to the embodiment may be realized using a capacitive method.

[0175] For example, the key input sensor 1040 according to the embodiment may include a plurality of electrodes, and may be implemented to generate a corresponding key input signal based on an electrical signal generated by a change in capacitance of the plurality of electrodes caused by the respective positional movements of the plurality of key caps 1010. However, no limitation is imposed thereon.

[0176] In this specification, in order to amplify the change in capacitance of the electrodes caused by the positional movement of each of the keycaps 1010, the elastic units 1020 may include, but are not limited to, a conductive material.

[0177] Furthermore, at least some of the multiple electrodes may be positioned corresponding to the multiple keycaps 1010, respectively.

[0178] For example, a first electrode and a second electrode included in the plurality of electrodes may be positioned corresponding to a first keycap included in the plurality of keycaps 1010, and a third electrode and a fourth electrode included in the plurality of electrodes may be positioned corresponding to a second keycap included in the plurality of keycaps 1010. However, no limitation is imposed thereon.

[0179] In this specification, positioning at least a portion of each of the electrodes in correspondence with the key caps 1010 may mean positioning at least a portion of each of the electrodes so that they are overlapped by the key caps 1010 such that the capacitance of the electrodes changes as the key caps 1010 move, but no limitation is imposed thereon.

[0180]

[0181] Furthermore, according to an embodiment, the touch input sensor 1030 and the key input sensor 1040 may be provided in an integrated layer. When the touch input sensor 1030 and the key input sensor 1040 are provided in an integrated layer, the electronic device having a multi-function human interface 1000 may have a reduced overall volume, improved durability, and reduced manufacturing costs.

[0182] This is explained in more detail below.

[0183]

[0184] According to an embodiment, the controller 1050 may generate pointer position related information based on the touch input signals obtained from the touch input sensor 1030 .

[0185] For example, but not limited to, an embodiment of the controller 1050 may generate at least one coordinate value based on the touch input signal obtained from the touch input sensor 1030 .

[0186] Further, for example, but not limited to, the controller 1050 according to the embodiment may generate pointer movement information based on the coordinate values ​​of the touch input signal acquired from the touch input sensor 1030 .

[0187] Further, the controller 1050 according to an embodiment may generate pointer execution command related information based on the touch input signal obtained from the touch input sensor 1030 .

[0188] For example, but not limited to, the controller 1050 according to an embodiment may generate information corresponding to a left click of a mouse based on the touch input signal obtained from the touch input sensor 1030 .

[0189] Further, for example, but not limited to, the controller 1050 according to an embodiment may generate information corresponding to a right click of a mouse based on the touch input signal obtained from the touch input sensor 1030 .

[0190] Further, the controller 1050 according to an embodiment may generate at least one key value based on the key input signal obtained from the key input sensor 1040 .

[0191] For example, but not limited to, the controller 1050 according to the embodiment may generate at least one key code value based on the key input signal obtained from the key input sensor 1040 .

[0192] In this specification, the at least one key code value may be, but is not limited to, a key code value corresponding to a common keyboard layout.

[0193] Furthermore, the controller 1050 according to the embodiment may generate pointer execution command related information based on the key input signal obtained from the key input sensor 1040 .

[0194] For example, the controller 1050 according to the embodiment may generate information corresponding to a left click of a mouse based on a key input signal obtained from the key input sensor 1040, but is not limited to this.

[0195] As a more specific example, the controller 1050 according to the embodiment may generate information corresponding to a left click of a mouse based on a key input signal obtained from a specific key input sensor among the key input sensors 1040, but is not limited to this.

[0196] Furthermore, for example, the controller 1050 according to the embodiment may generate information corresponding to a right click of a mouse based on a key input signal obtained from the key input sensor 1040, but is not limited to this.

[0197] As a more specific example, the controller 1050 according to the embodiment may generate information corresponding to a right click of a mouse based on a key input signal obtained from a specific key input sensor among the key input sensors 1040, but is not limited to this.

[0198] Additionally, the controller 1050 may determine a power-related mode of the electronic device with multifunction human interface 1000 .

[0199] For example, the controller 1050 may determine that the mode of the electronic device with multifunction human interface 1000 is a power off mode, a standby mode, or an active mode.

[0200] In this specification, in the power off mode, user key input or user touch input may be ignored or not recognized, but no restriction is imposed thereon.

[0201] Furthermore, in the standby mode, if a user key input or a user touch input is acquired, the mode of the electronic device 1000 having a multi-function human interface may be switched to the active mode, but no restriction is imposed thereon.

[0202] Furthermore, in the active mode, at least one key value or pointer position related information may be generated according to a user's key input or a user's touch input, but there is no limitation thereto.

[0203] Additionally, the controller 1050 may determine an associated mode of operation of the electronic device with multifunction human interface 1000 .

[0204] For example, the controller 1050 may determine that the operation mode of the electronic device with a multifunction human interface 1000 is a key input mode or a touch input mode.

[0205] In this specification, in the key input mode, at least one key value may be generated based on a key input signal generated according to a user's key input, but no limitation is imposed thereon.

[0206] Furthermore, in the touch input mode, the pointer position related information may be generated based on a touch input signal generated according to a user's touch input, but there is no limitation thereto.

[0207] Additionally, the controller 1050 may determine a mode associated with a touch area of ​​the electronic device with multifunction human interface 1000 .

[0208] For example, but not limited to, the controller 1050 may determine that the mode of the electronic device with a multifunction human interface 1000 is a first mode in which a first area of ​​the keyboard arrangement is a touch area, or a second mode in which a second area of ​​the keyboard arrangement is a touch area.

[0209] In this specification, the first mode may refer to a right-handed mode and the second mode may refer to a left-handed mode, but is not limited thereto.

[0210] Additionally, if the first mode is set to a right-handed mode and the second mode is set to a left-handed mode, the first region of the keyboard arrangement may be positioned closer to the right side than the second region of the keyboard arrangement is closer to the right side, although no limitation is imposed thereto.

[0211] Additionally, the controller 1050 may determine a mode associated with the connection of the electronic device with multifunctional human interface 1000 .

[0212] For example, but not limited to, the controller 1050 may determine that the mode of the electronic device with a multi-function human interface 1000 is a first connection mode for connecting to a first electronic device, a second connection mode for connecting to a second electronic device, or a third connection mode for connecting to a third electronic device.

[0213] Furthermore, the controller 1050 may load different configuration values ​​depending on the connection mode of the electronic device with multifunctional human interface 1000 .

[0214] For example, the controller 1050 may load a first setting value when the connection mode of the electronic device with a multi-functional human interface 1000 is a first connection mode. The controller 1050 may load a second setting value when the connection mode of the electronic device with a multi-functional human interface 1000 is a second connection mode. The controller 1050 may load a third setting value when the connection mode of the electronic device with a multi-functional human interface 1000 is a third connection mode. However, no limitation is imposed thereon.

[0215] In this specification, the setting values ​​of the electronic device 1000 having a multi-functional human interface may include various setting values ​​such as matching values ​​for key input sensors and key code values, setting values ​​for the OS of the connected electronic device, touch sensitivity values, pointer position movement sensitivity values, setting values ​​for the operating mode of the electronic device 1000 having a multi-functional human interface, and setting values ​​for touch areas, but are not limited to the examples described above.

[0216] Furthermore, the electronic device 1000 with a multifunctional human interface may further include elements such as a memory unit for storing at least one data, a battery unit for supplying power, and a transmitting unit for transmitting at least one data to a connected electronic device.

[0217]

[0218] FIG. 2 is a diagram illustrating a keyboard arrangement of an electronic device having a multifunctional human interface according to an embodiment.

[0219] Referring to FIG. 2, an electronic device 1100 having a multifunctional human interface according to an embodiment may include a key input area 1110 and a touch input area 1120.

[0220] In this specification, the key input area 1110 may be an area for generating at least one key input signal according to a user's key input.

[0221] For example, the key input area 1110 may be an area in which, when a user presses a first keycap, a key input signal is generated from a key input sensor positioned corresponding to the first keycap, or, when a user presses a second keycap, a key input signal is generated from a key input sensor positioned corresponding to the second keycap, but is not limited to these.

[0222] Furthermore, the user's key input may include, but is not limited to, a press input and a pressure input on at least one keycap included in the electronic device with multifunction human interface 1100. The user's key input may include various types of input concepts that may be generally understood as key input.

[0223] Furthermore, the key input signal generated in the key input area 1110 may be processed by a controller included in the electronic device with multi-function human interface 1100 .

[0224] For example, but not limited to, the controller included in the electronic device with multi-function human interface 1100 may generate at least one key value based on a key input signal generated in the key input area 1110 .

[0225] Further, for example, but not limited to, a controller included in the electronic device with a multi-function human interface 1100 may generate at least one pointer execution command information based on a key input signal generated in the key input area 1110.

[0226] In this specification, the at least one key value may mean a key code corresponding to a key input signal, and may also mean, but is not limited to, a text value and a function value corresponding to the key code. The at least one key value may include what is commonly understood as a key value.

[0227] Furthermore, in this specification, a key code may mean, but is not limited to, a value used to identify a user's key input, a key input signal generated from a user's key input, a text value, or a function value. A key code may include what may be commonly understood as a key code.

[0228]

[0229] Further, touch input area 1120 may be an area for generating at least one touch input signal according to a user's touch input.

[0230] For example, touch input area 1120 may be an area in which, when a user touches a first area included in touch input area 1120, a touch input signal is generated from a touch input sensor positioned corresponding to the first area, or, when a user touches a second area included in touch input area 1120, a touch input signal is generated from a touch input sensor positioned corresponding to the second area, but is not limited to this.

[0231] Furthermore, the user's touch input may include various types of inputs for generating touch input signals from touch input sensors included in the electronic device with multifunctional human interface 1100 .

[0232] For example, the user's touch input may include, but is not limited to, touching a keycap included in the electronic device with multifunction human interface 1100 .

[0233] Furthermore, touch input signals generated in touch input area 1120 may be processed by a controller included in electronic device with multifunction human interface 1100 .

[0234] For example, but not by way of limitation, a controller included in the electronic device with multifunctional human interface 1100 may generate pointer position related information based on touch input signals generated in the touch input area 1120 .

[0235] Further, for example, but not limited to, a controller included in the electronic device with multifunctional human interface 1100 may generate at least one pointer execution command information based on a touch input signal generated in the touch input area 1120.

[0236]

[0237] Furthermore, as shown in FIG. 2, the key input area 1110 and the touch input area 1120 may at least partially overlap.

[0238] For example, the key input area 1110 may be formed to correspond to a keyboard arrangement of the electronic device with a multifunctional human interface 1100, and the touch input area 1120 may be formed to correspond to a part of the keyboard arrangement of the electronic device with a multifunctional human interface 1100. However, no limitation is imposed thereon.

[0239] Furthermore, for example, the touch input area 1120 may be formed so as to be included in the key input area 1110, but is not limited thereto.

[0240] Furthermore, for example, the touch input area 1120 may be formed so as to overlap at least a portion of the key input area 1110, or may be formed so as not to overlap at least a portion of the key input area 1110, but is not limited thereto.

[0241] Furthermore, according to an embodiment, the size of the key input area 1110 and the size of the touch input area 1120 may be the same, but is not limited thereto.

[0242] Furthermore, according to an embodiment, the size of the key input area 1110 and the size of the touch input area 1120 may be different from each other, but is not limited thereto.

[0243]

[0244] Furthermore, according to an embodiment, the area where the key input area 1110 and the touch input area 1120 overlap may be defined as a multi-function area.

[0245] For example, as shown in Fig. 2, when the touch input area 1120 is formed so as to be included in the key input area 1110, the area corresponding to the touch input area 1120 may be defined as a multi-function area. However, there is no restriction imposed thereon.

[0246] Furthermore, the multi-function area according to the embodiment may be an area for generating at least one key input signal according to a user's key input, and may be an area for generating at least one touch input signal according to a user's touch input.

[0247] In this specification, the details described above may apply to key input signals generated in accordance with a user's key input and touch input signals generated in accordance with a user's touch input, and therefore redundant descriptions will be omitted.

[0248]

[0249] Further, referring to FIG. 2, the electronic device 1100 having a multifunctional human interface according to an embodiment may include a pointer execution command unit 1130.

[0250] In this specification, the pointer execution command unit 1130 may be an element for generating at least one pointer execution command.

[0251] Furthermore, in this specification, a pointer execution command may include, but is not limited to, one of the execution commands corresponding to a left click or a right click of a mouse.

[0252] The pointer execution command unit 1130 according to an embodiment may be positioned to be included in the keyboard arrangement of the electronic device 1100 having a multi-function human interface.

[0253] For example, but not limited to, the pointer execution command unit 1130 according to an embodiment may be positioned between two space bars of the electronic device with multi-function human interface 1100 .

[0254] Furthermore, a pointer execution command unit 1130 according to an embodiment may be positioned so as to be included in the key input area 1110 .

[0255]

[0256] For example, the pointer execution command unit 1130 according to the embodiment may include the key input sensor described above. The key input sensor included in the pointer execution command unit 1130 may generate a key input signal according to a user's input to the pointer execution command unit 1130, and the controller included in the electronic device with multi-function human interface 1100 may generate at least one pointer execution command based on the key input signal, but is not limited thereto.

[0257] Furthermore, the pointer execution command unit 1130 according to an embodiment may be located outside the touch input area 1120 as shown in FIG. 2, but is not limited thereto.

[0258] Furthermore, the pointer execution command unit 1130 according to the embodiment may be positioned inside the touch input area 1120, different from that in FIG. 2, but is not limited thereto.

[0259]

[0260] Further, referring to FIG. 2 , the touch input area 1120 according to the embodiment may include a first touch input area 1121 and a second touch input area 1122 .

[0261] In this specification, the details described above for the touch input area 1120 may apply to the first touch input area 1121 and the second touch input area 1122, and therefore redundant descriptions will be omitted.

[0262] According to an embodiment, the first touch input area 1121 and the second touch input area 1122 may be set to at least partially overlap.

[0263] 2, the first touch input area 1121 may be set to at least partially overlap the key cap of J, and the second touch input area 1122 may be set to at least partially overlap the key cap of G. The first touch input area 1121 and the second touch input area 1122 may be set to overlap in areas corresponding to a part of the key cap of G, a part of the key cap of J, and the key cap of H, but are not limited thereto.

[0264] Furthermore, according to an embodiment, the first touch input area 1121 and the second touch input area 1122 may be set so as not to overlap.

[0265] For example, unlike Fig. 2, the first touch input area 1121 may be set to be an area closer to the left side than the second touch input area 1122 is closer to the left side, and may be set to overlap with a part of the cap of the H key. The second touch input area 1122 may be set to be an area closer to the right side than the first touch input area 1121 is closer to the right side, and may be set to overlap with another part of the cap of the H key. However, no limitation is imposed thereon.

[0266] Furthermore, according to an embodiment, the electronic device with multifunctional human interface 1100 may be operated such that different touch input areas are active depending on the operating mode.

[0267] In this specification, the touch input area being active may mean, but is not limited to, that pointer position related information is generated based on a touch input signal about the touch input area being active. The touch input area being active may include a concept that is generally understood to mean that the touch input area is active.

[0268] More specifically, according to an embodiment, the electronic device with multifunction human interface 1100 may operate in a first operating mode in which the touch input area 1120 is active, a second operating mode in which the first touch input area 1121 is active, and a third operating mode in which the second touch input area 1122 is active.

[0269] In this specification, the first operational mode may be a mode for generating pointer position related information based on touch input signals generated in touch input area 1120.

[0270] According to an embodiment, in a first operating mode, when a user's touch input to the touch input area 1120 is obtained, a touch input signal is generated, and the electronic device with a multifunction human interface 1100 may generate pointer position-related information based on the touch input signal.

[0271] For example, in the first operation mode, when the touch starting point is positioned within the touch input area 1120, the electronic device with multifunctional human interface 1100 may generate pointer position related information, although no limitation is imposed thereon.

[0272] Furthermore, the second operation mode may be a mode for generating pointer position related information based on touch input signals generated in the first touch input area 1121 .

[0273] According to an embodiment, in the second operating mode, when a user's touch input to the first touch input area 1121 is obtained, a touch input signal is generated, and the electronic device with a multifunction human interface 1100 may generate pointer position-related information based on the touch input signal.

[0274] For example, in the second operation mode, when the touch starting point is positioned within the first touch input area 1121, the electronic device with multifunctional human interface 1100 may generate pointer position related information, although no limitation is imposed thereon.

[0275] Furthermore, according to an embodiment, in the second operation mode, when a user's touch input is obtained in a touch input area outside the first touch input area 1121, the electronic device with multifunctional human interface 1100 may not generate pointer position-related information, although no limitation is imposed thereon.

[0276] Further, according to an embodiment, in the second operating mode, when the touch starting point is positioned within the first touch input area 1121, the electronic device with multifunctional human interface 1100 may generate pointer position related information despite the touch path to the touch ending point and touch input areas outside the first touch input area 1121 at least partially overlapping.

[0277] Furthermore, the third operational mode may be a mode for generating pointer position related information based on touch input signals generated in the second touch input area 1122 .

[0278] According to an embodiment, in the third operating mode, when a user's touch input to the second touch input area 1122 is obtained, a touch input signal is generated, and the electronic device with a multifunction human interface 1100 may generate pointer position-related information based on the touch input signal.

[0279] For example, in the third operation mode, when the touch starting point is positioned within the second touch input area 1122, the electronic device with multifunctional human interface 1100 may generate pointer position related information, although no limitation is imposed thereon.

[0280] Furthermore, according to an embodiment, in the third operation mode, when a user's touch input is acquired in a touch input area outside the second touch input area 1122, the electronic device with multifunctional human interface 1100 may not generate pointer position-related information, although no limitation is imposed thereon.

[0281] Further, according to an embodiment, in the third operating mode, when the touch starting point is positioned within the second touch input area 1122, the electronic device with multifunctional human interface 1100 may generate pointer position-related information despite the touch path to the touch ending point and touch input areas outside the second touch input area 1122 at least partially overlapping.

[0282] Furthermore, according to an embodiment, the second mode may correspond to a left-handed mode and the third mode may correspond to a right-handed mode, but is not limited thereto.

[0283] Further, according to an embodiment, the touch input areas that are active according to the operational mode may be specified by the user.

[0284] For example, the electronic device with a multifunction human interface 1100 may include a fourth operation mode that is a user custom operation mode. The active touch input area in the fourth operation mode may be set by the user, but no limitation is imposed thereon.

[0285] In this specification, the active touch input area in the fourth operation mode may be set in various ways, such as by a user's gesture, motion, or touch input, or by obtaining a user's setting value from outside.

[0286]

[0287] In the following, an electronic device having a multifunctional human interface in which key input sensors and touch input sensors are provided in an integrated layer as described above will be described in more detail.

[0288]

[0289] FIG. 3 is a diagram illustrating layers of an electronic device having a multifunctional human interface, according to an embodiment.

[0290] Referring to FIG. 3, an electronic device 1200 having a multi-function human interface according to an embodiment may include at least one of the following layers: a keycap layer 1210, a keyboard mechanism layer 1220, an elastic unit layer 1230, an electrode layer 1240, and a lower plate layer 1250.

[0291] According to an embodiment, the keycap layer 1210 may include multiple keycaps.

[0292] In this specification, the details described above may apply to multiple keycaps, so redundant descriptions will be omitted.

[0293] The multiple keycaps included in the keycap layer 1210 according to the embodiment may represent, but are not limited to, the topmost elements of the electronic device with multi-function human interface 1200 that come into contact with a user.

[0294] Further, a number of keycaps included in keycap layer 1210 according to an embodiment may obtain at least one input from a user.

[0295] For example, the multiple keycaps included in the keycap layer 1210 according to an embodiment may obtain key input, text input, press input, pressure input, descending input, touch input, and slide input from a user, but are not limited to these.

[0296] According to an embodiment, the keycaps included in the keycap layer 1210 may have corresponding characters printed on their surfaces, but no limitation is imposed thereon.

[0297]

[0298] According to an embodiment, the keyboard mechanism layer 1220 may include multiple keyboard mechanism units.

[0299] In this specification, the multiple keyboard mechanism units included in the keyboard mechanism layer 1220 may be respectively connected to the multiple keycaps and may guide the movement of each of the multiple keycaps.

[0300] Furthermore, the keyboard mechanism layer 1220 according to the embodiment may have multiple scissor mechanism units.

[0301] In this specification, the scissor mechanism unit may refer to, but is not limited to, a mechanism unit provided as a two-part assembly formed by two support units that cross in an X-shape and are respectively coupled to different parts of the corresponding key caps to guide the movement of the corresponding key caps. The scissor mechanism unit may include the concept of a commonly understood scissor mechanism.

[0302] Furthermore, the keyboard mechanism layer 1220 according to the embodiment may have multiple butterfly mechanism units.

[0303] In this specification, the butterfly mechanism unit may refer to, but is not limited to, a mechanism unit provided as a single-part assembly in which both ends of one support unit are connected to different parts of a corresponding key cap and are deformed at a hinge positioned at the center between the two ends to guide the movement of the corresponding key cap. The butterfly mechanism unit may include the concept of a butterfly mechanism as commonly understood.

[0304] Furthermore, the keyboard mechanism layer 1220 according to an embodiment may include various keyboard mechanism units for guiding the movement of corresponding keycaps in addition to the examples described above.

[0305]

[0306] Furthermore, the elastic unit layer 1230 according to the embodiment may include multiple elastic units.

[0307] In this specification, the details described above may be applied to multiple elastic units, so redundant descriptions will be omitted.

[0308] The multiple elastic units included in the elastic unit layer 1230 according to the embodiment may be positioned corresponding to the multiple keycaps, respectively, to provide a restoring force to each of the multiple keycaps.

[0309]

[0310] Furthermore, the electrode layer 1240 according to an embodiment may include a number of electrodes for generating key input signals or touch input signals according to a user's input.

[0311] For example, the electrode layer 1240 according to the embodiment may generate a touch input signal according to a user's touch input, and may generate a key input signal according to a user's key input.

[0312] In this specification, the user's touch input or the user's key input may be obtained through, but is not limited to, the keycap layer 1210. The details of the touch input or the key input described above with reference to FIG. 1 may be applied thereto, and therefore redundant description will be omitted.

[0313] Furthermore, the electrodes included in the electrode layer 1240 according to the embodiment may be positioned corresponding to the keycap layer 1210 .

[0314] For example, the multiple electrodes included in the electrode layer 1240 according to the embodiment and functioning at least to generate a key input signal may be positioned corresponding to the multiple keycaps included in the keycap layer 1210, but are not limited to this.

[0315] Further, for example, but not limited to, a plurality of electrodes included in the electrode layer 1240 according to an embodiment and functioning at least to generate a touch input signal may be positioned so as to be overlapped by at least a portion of a plurality of keycaps included in the keycap layer 1210.

[0316] Additionally, the electrode layer 1240 according to an embodiment may include multiple layers.

[0317] For example, the electrode layer 1240 according to the embodiment may include a first layer on which the electrodes are positioned, a second layer for electrical connection to at least a portion of the electrodes, a cover layer for protecting at least a portion of the first layer or the second layer, and a conductive layer for blocking external noise signals. The first layer, the second layer, and the cover layer may be formed in combination, but are not limited thereto.

[0318] Herein, the electrode layer 1240 may be provided with an adhesive layer to provide adhesion between at least some of the layers included in the electrode layer described above.

[0319] Furthermore, the cover layer herein may be used as a light guide plate of a backlight unit of an electronic device with a multi-function human interface.

[0320] For example, but not limited to, the cover layer may include a light diffusing region that receives light from a light source and allows the light to be diffused over a predetermined area.

[0321] In this specification, the light diffusion area may be formed by using, but is not limited to, a laser or a pigment. The light diffusion area may be formed by various methods and materials to function as a backlight unit of an electronic device with a multi-function human interface.

[0322] Furthermore, the electrode layer 1240 according to the embodiment may be formed as a flexible printed circuit board (FPCB), or may be formed by evaporating conductive pigments onto a plastic film, but is not limited thereto.

[0323] Additionally, the electrode layer 1240 according to an embodiment may include a plurality of holes.

[0324] In this specification, a plurality of holes may be formed to allow a connecting member included in the lower plate to pass through in order to connect a plurality of keyboard mechanism units included in the keyboard mechanism layer 1220 described above to the lower plate layer described below.

[0325] Furthermore, a plurality of holes may be formed to allow a coupling member included in the keyboard mechanism layer 1220 to pass through in order to couple the keyboard mechanism layer 1220 to the lower board layer as described above.

[0326] Additionally, at least one of the plurality of holes may not allow a coupling member to pass through to couple the keyboard mechanism layer 1220 to the bottom board layer as described above.

[0327] As used herein, at least one of the plurality of holes may function, but is not limited to, to allow a backlight source to pass through.

[0328] Furthermore, depending on the positional state of the keyboard mechanism layer 1220 described above, at least a portion of the keyboard mechanism layer 1220 described above may or may not be positioned within at least one of the multiple holes.

[0329] Furthermore, at least one of the plurality of holes may be formed in at least one of the plurality of layers included in the electrode layer 1240.

[0330] For example, at least one of the plurality of holes may be formed in a cover layer included in the electrode layer 1240, and not in the first layer or the second layer, although no limitation is imposed thereto.

[0331] Furthermore, when at least one of the holes is formed in a cover layer included in the electrode layer 1240 and not in the first layer and the second layer, the cover layer may be manufactured to have a transmissive or semi-transmissive property, although no limitation is imposed thereto.

[0332] Furthermore, the at least one hole formed in the cover layer but not in the first layer and not in the second layer may be embodied in, but is not limited to, a circular, rectangular, linear, or intersecting shape.

[0333] Additionally, at least one hole formed in the cover layer but not in the first layer or the second layer may be positioned so as to be at least partially overlapped by at least one electrode included in the first layer.

[0334] For example, but not limited to, at least one hole formed in the cover layer but not in the first layer and the second layer may be positioned so as to be at least partially overlapped by a first electrode and a second electrode included in the first layer.

[0335] Furthermore, the at least one hole described above that is formed in the cover layer but not in the first layer and / or the second layer may not only mean a physical hole, but may include the concept of a hole through which at least one substance such as light can pass. For example, the at least one hole described above may include, but is not limited to, the concept of a light-transmitting region that is provided as a transparent or semi-transparent material having a higher light transmittance than the surroundings of the hole.

[0336]

[0337] The lower board layer 1250 according to an embodiment may be provided to allow multiple keyboard mechanism units included in the keyboard mechanism layer 1220 to be mounted on the lower board layer.

[0338] Furthermore, the lower plate layer 1250 according to the embodiment may include a plurality of coupling members for attaching a plurality of keyboard mechanism units included in the keyboard mechanism layer 1220 .

[0339] In this specification, the multiple connecting members included in the lower plate layer 1250 according to the embodiment may be respectively connected to multiple keyboard mechanism units so as to enable each of the multiple keyboard mechanism units to be mounted on the lower plate layer 1250.

[0340] For example, the lower board layer 1250 according to the embodiment may include a first connecting member to a fourth connecting member. The first connecting member to the fourth connecting member may be respectively connected to four parts of a first keyboard mechanism unit included in the keyboard mechanism layer 1220. The first keyboard mechanism unit may be mounted on the lower board layer 1250, but is not limited thereto.

[0341] Furthermore, the keyboard mechanism layer 1220 according to the embodiment may include at least one connecting member to be mounted on the bottom board layer 1250 .

[0342] For example, a coupling member included in the keyboard mechanism layer 1220 according to an embodiment may pass through a plurality of holes in the electrode layer 1240 and be coupled to the lower plate layer 1250.

[0343] In this specification, at least one connecting member included in the keyboard mechanism layer 1220 may be a separate unit (not shown) for attaching multiple keyboard mechanism units (seesaws) included in the keyboard mechanism layer 1220, and may include, but is not limited to, multiple holes.

[0344] Furthermore, the electronic device with a multi-function human interface 1200 according to the embodiment may be configured such that a lower plate layer 1250, an electrode layer 1240, an elastic unit layer 1230, a keyboard mechanism layer 1220, and a keycap layer 1210 are stacked in that order.

[0345] FIG. 4 is a diagram illustrating the operation of an electronic device having a multifunctional human interface according to an embodiment.

[0346] Referring to FIG. 4, an electronic device with a multi-function human interface 1300 according to an embodiment may include a keycap layer 1310, an elastic unit layer 1320, and an electrode layer 1330.

[0347] In this specification, the details described above may apply to the keycap layer 1310, the elastic unit layer 1320, and the electrode layer 1330, and therefore redundant descriptions will be omitted.

[0348] According to an embodiment, the keycap layer 1310 may include multiple keycaps.

[0349] For example, as shown in FIG. 4, a keycap layer 1310 according to an embodiment may include, but is not limited to, a first keycap 1311 and a second keycap 1312.

[0350]

[0351] Furthermore, the elastic unit layer 1320 according to the embodiment may include multiple elastic units.

[0352] For example, as shown in FIG. 4, the elastic unit layer 1320 according to the embodiment may include, but is not limited to, a first elastic unit 1321 positioned corresponding to a first keycap 1311 and a second elastic unit 1322 positioned corresponding to a second keycap 1312.

[0353] Furthermore, the elastic units included in the elastic unit layer 1320 according to the embodiment may include a conductive material.

[0354] However, at least one key cap included in the key cap layer 1310 according to the embodiment may include the conductive material described above or the conductive material described below, or at least one key cap may be provided as a conductive material. In this case, the conductive material may be configured to move in response to the movement of the at least one key cap so as to change the distance to the electrode layer 1330. However, for convenience of explanation, the following description will be based on the case where the conductive material is included in multiple elastic units.

[0355] For example, the first elastic unit 1321 included in the elastic unit layer 1320 according to the embodiment may include a first conductive material 1323, and the second elastic unit 1322 may include a second conductive material 1324, but is not limited thereto.

[0356] In this specification, the conductive material may be an element for causing a change in the capacitance of the electrode layer 1330 as the conductive material approaches the electrode layer 1330 due to an external force applied to the keycap layer 1310.

[0357] Additionally, the conductive material may be provided as various materials, such as carbon, to create a change in the capacitance of the electrode layer 1330 .

[0358]

[0359] Further, the electrode layer 1330 according to an embodiment may include a plurality of electrodes, which may form part of an electrode line that functions as a transmitter or a receiver.

[0360] For example, the electrode layer 1330 according to an embodiment may include, but is not limited to, a first electrode 1331, a second electrode 1332, a third electrode 1333, a fourth electrode 1334, a fifth electrode 1335, and a sixth electrode 1336.

[0361] Furthermore, the electrodes included in the electrode layer 1330 according to an embodiment may be positioned so as to be overlapped by at least a portion of the keycaps.

[0362] For example, the first electrode 1331 to the fourth electrode 1334 included in the electrode layer 1330 according to the embodiment may be positioned so as to be overlapped by the first keycap 1311, and the fifth electrode 1335 and the sixth electrode 1336 may be positioned so as to be overlapped by the second keycap 1312, but are not limited to this.

[0363] In this specification, positioning an electrode so that it is overlapped by a keycap may mean, but is not limited to, that the electrode and the keycap overlap when viewed from the direction in which the layers included in the electronic device 1300 having a multi-function human interface are stacked.

[0364] Furthermore, at least some of the electrodes included in the electrode layer 1330 according to the embodiment may be positioned corresponding to the elastic units, respectively.

[0365] For example, the first electrode 1331 and the second electrode 1332 included in the electrode layer 1330 according to the embodiment may be positioned corresponding to the first elastic unit 1321, and the fifth electrode 1335 and the sixth electrode 1336 may be positioned corresponding to the second elastic unit 1322, but are not limited to these.

[0366] Furthermore, for ease of explanation, the first electrode 1331, the third electrode 1333, and the fifth electrode 1335 are described below as electrodes that form part of an electrode line that functions as a transmitter, and the second electrode 1332, the fourth electrode 1334, and the sixth electrode 1336 are described below as electrodes that form part of an electrode line that functions as a receiver.

[0367] According to an embodiment, when a user's key input or press input on the first keycap 1311 is acquired, the first keycap 1311 may move downwards.

[0368] In this specification, the shape of the first elastic unit 1321 may change as the first keycap 1311 moves, and the change in the shape of the first elastic unit 1321 may shorten the first conductive material 1323 contained in the first elastic unit 1321 and the distance between the first electrode 1331 and the second electrode 1332.

[0369] Thus, a first key input signal may be generated by varying the capacitance between the first conductive material 1323 and at least a first electrode 1331 constituting at least a part of a first electrode line acting as a first transmitter, and a second electrode 1332 constituting at least a part of a second electrode line acting as a first receiver.

[0370] Furthermore, according to an embodiment, when a user's key input or press input on the second keycap 1312 is acquired, the second keycap 1312 may move downward.

[0371] In this specification, the shape of the second elastic unit 1322 may change as the second keycap 1312 moves, and the change in the shape of the second elastic unit 1322 may shorten the distance between the second conductive material 1324 included in the second elastic unit 1322 and the fifth electrode 1335 and the sixth electrode 1336.

[0372] Thus, a second key input signal may be generated by varying the capacitance between the second conductive material 1324 and at least a fifth electrode 1335 constituting at least a portion of the third electrode line acting as a second transmitter, and a sixth electrode 1336 constituting at least a portion of the fourth electrode line acting as a second receiver.

[0373] Further, according to an embodiment, when a touch input by a user's finger is obtained on the first region 1340 of the keycap layer 1310, a first touch input signal may be generated by changing the capacitance between the user's finger and at least a third electrode 1333 constituting at least a portion of the fifth electrode line functioning as a third transmitter, and a fourth electrode 1334 constituting at least a portion of the sixth electrode line functioning as a third receiver.

[0374] In this specification, the size of the first key input signal and the size of the second key input signal may be equal to or greater than a first reference value, and the size of the first touch input signal may be equal to or greater than a second reference value, but no limitation is imposed thereon.

[0375]

[0376] Furthermore, the size of the first key input signal and the size of the second key input signal may be equal to or larger than a first reference value, and the size of the first touch input signal may be equal to or larger than a second reference value, but may be equal to or smaller than the first reference value, but no limitation is imposed thereon.

[0377] Furthermore, the first key input signal, the second key input signal, and the first touch input signal may be processed by the controller described above, and at least one key value or pointer position related information may be generated based on this. However, the details described above may be applied to these, so redundant description will be omitted.

[0378]

[0379] As described above, the electronic device with a multifunctional human interface 1300 shown in Fig. 4 relates to an embodiment in which the touch input sensor and the key input sensor are realized in an integrated layer, in which case the electronic device with a multifunctional human interface 1300 can have a reduced overall volume, improved durability, and reduced manufacturing costs.

[0380]

[0381] FIG. 5 is a diagram illustrating electrode layers included in an electronic device having a multifunctional human interface, according to an embodiment.

[0382] 5, an electronic device having a multifunctional human interface according to an embodiment may include electrode layers 1410 and 1420. For convenience of explanation, FIG. 5 illustrates a first electrode layer 1410 and a second electrode layer 1420 according to an embodiment.

[0383] According to an embodiment, the electrode layers 1410, 1420 may include a first type of lines and a second type of lines.

[0384] In this specification, each of the first type of lines may consist of electrodes electrically connected in the longitudinal direction (length direction) of the keyboard arrangement, and each of the second type of lines may consist of electrodes electrically connected in the width direction of the keyboard arrangement.

[0385] Furthermore, in this specification, the longitudinal direction of the keyboard array may be understood as the X-axis direction, and the width direction of the keyboard array may be understood as the Y-axis direction, although no limitation is imposed thereon.

[0386] Furthermore, in this specification, the electrical connection of the electrodes constituting the first type of wire or the second type of wire may be realized on the same surface on the same layer, or may be realized through different layers formed integrally with each other, but no limitation is imposed thereon.

[0387] Further, the first type of wire may function as either a transmitter or a receiver, and the second type of wire may function as the other of the transmitter or receiver, to generate an electrical signal based on changes in the capacitance of the electrode layers 1410, 1420.

[0388] For example, the first electrode layer 1410 may include a first type of wires consisting of electrodes electrically connected along the length of the keyboard arrangement and a second type of wires consisting of electrodes electrically connected along the width of the keyboard arrangement. The first type of wires included in the first electrode layer 1410 may function as at least one transmitter, and the second type of wires included in the first electrode layer 1410 may function as at least one receiver.

[0389] 5, the first electrode layer 1410 may include N first type lines and M second type lines, where the N first type lines may function as N different transmitters and the M second type lines may function as M different receivers, although no limitation is imposed thereon.

[0390] Further, for example, the second electrode layer 1420 may include a first type of wires of electrodes electrically connected along the length of the keyboard arrangement and a second type of wires of electrodes electrically connected along the width of the keyboard arrangement, The first type of wires included in the second electrode layer 1420 may function as at least one receiver, and the second type of wires included in the second electrode layer 1420 may function as at least one transmitter.

[0391] 5, the second electrode layer 1420 may include N first type lines and M second type lines, where the N first type lines may function as N different receivers and the M second type lines may function as M different transmitters, although no limitation is imposed thereon.

[0392] Furthermore, signal timings of the first type lines included in the electrode layers 1410, 1420 according to embodiments may be different from each other.

[0393] For example, and without limitation, when the first type of lines included in the electrode layers 1410, 1420 according to an embodiment function as respective transmitters, the drive signal timings of the first type of lines may be different from each other.

[0394] Furthermore, for example and without limitation, when the first type lines included in the electrode layers 1410, 1420 according to the embodiment function as respective receivers, the scanning signal timings of the first type lines may be different from each other.

[0395] Furthermore, signal timings of the second type of lines included in the electrode layers 1410, 1420 according to embodiments may be different from each other.

[0396] When the second type lines included in the electrode layers 1410, 1420 according to the embodiment function as respective transmitters, the drive signal timings of the second type lines may be different from each other, but are not limited to this.

[0397] Furthermore, for example and without limitation, when the second type lines included in the electrode layers 1410, 1420 according to the embodiment function as respective receivers, the scanning signal timings of the second type lines may be different from each other.

[0398] In the following, the electrodes contained in the above-described electrode layers 1410, 1420 are described in more detail.

[0399]

[0400] FIG. 6 is a diagram illustrating a portion of an electrode layer for explaining an electrode layer included in an electronic device having a multifunctional human interface according to an embodiment.

[0401] Referring to FIG. 6, an electrode layer 1500 included in an electronic device having a multifunctional human interface according to an embodiment may include a first type of wire 1510 and a second type of wire 1520.

[0402] In this specification, the details described above may apply to the first type line 1510 and the second type line 1520, and therefore redundant descriptions will be omitted.

[0403] According to an embodiment, the first type of wire 1510 may include a first electrode 1511 and a second electrode 1512, and the second type of wire 1520 may include a third electrode 1521 and a fourth electrode 1522, although no limitation is imposed thereto.

[0404] In this specification, the first electrode 1511 and the third electrode 1521 according to the embodiment may be defined as a first type of electrode, and the second electrode 1512 and the fourth electrode 1522 may be defined as a second type of electrode.

[0405] Furthermore, according to an embodiment, the first type of electrodes may refer to, but are not limited to, electrodes for generating at least a touch input signal according to a user's input.

[0406] For example, the first type of electrodes may refer to, but are not limited to, electrodes for generating touch input signals according to a user's touch input.

[0407] In this specification, the details described above may be applied to a user's touch input, and therefore redundant descriptions will be omitted.

[0408] Furthermore, according to the embodiment, the second type of electrodes may refer to, but are not limited to, electrodes for generating at least a key input signal according to a user's input.

[0409] For example, the second type of electrode may refer to, but is not limited to, an electrode for generating a key input signal according to a user's key input.

[0410] In this specification, the details described above may be applied to the user's key input, so redundant descriptions will be omitted.

[0411] Furthermore, according to the embodiment, the first type of electrode may refer to, but is not limited to, an electrode having a certain shape.

[0412] For example, the first type of electrodes may refer to, but is not limited to, diamond-shaped electrodes.

[0413] Furthermore, according to embodiments, the second type of electrodes may refer to, but are not limited to, electrodes having a different shape than the first type of electrodes.

[0414] For example, when the shape of the first type electrode is a diamond shape, the second type electrode may mean, but is not limited to, an electrode that is not diamond shaped.

[0415] Furthermore, according to an embodiment, the second type of electrodes may include a protrusion for generating at least a key input signal according to a user's input.

[0416] For example, the second electrode defined as the second type electrode may include a first protrusion 1531 and the fourth electrode may include a second protrusion 1532, although no limitation is imposed thereto.

[0417] Furthermore, according to an embodiment, electrodes of a second type included in a line of a first type may be positioned adjacent to electrodes of a second type included in a line of a second type.

[0418] For example, a second electrode 1512, which is an electrode of a second type included in a line of a first type 1510, may be positioned adjacent to a fourth electrode 1522, which is an electrode of a second type included in a line of a second type 1520.

[0419] Furthermore, according to an embodiment, a projection of an electrode of a second type included in a line of a first type may be positioned adjacent to a projection of an electrode of a second type included in a line of a second type.

[0420] For example, a first protrusion 1531 of a second electrode 1512, which is a second type electrode included in a first type line 1510, may be positioned adjacent to a second protrusion 1532 of a fourth electrode 1522, which is a second type electrode included in a second type line 1520.

[0421] Furthermore, according to an embodiment, the protrusions of the second type of electrodes may be positioned corresponding to an elastic unit (not shown) included in the electronic device with a multi-function human interface.

[0422] For example, the first protrusion 1531 of the second electrode 1512, which is a second type of electrode, and the second protrusion 1532 of the fourth electrode 1522 may be positioned corresponding to a first elastic unit (not shown) included in an electronic device having a multi-function human interface.

[0423] Furthermore, according to an embodiment, the protrusions of the second type of electrodes may be positioned corresponding to the conductive material (not shown) of an elastic unit included in the electronic device with a multi-function human interface.

[0424] For example, the first protrusion 1531 of the second electrode 1512, which is a second type of electrode, and the second protrusion 1532 of the fourth electrode 1522 may be positioned corresponding to a first conductive material (not shown) of a first elastic unit included in the electronic device having a multi-function human interface.

[0425] Furthermore, according to an embodiment, the protrusions of the second type of electrodes may be positioned to correspond to keycaps (not shown) included in an electronic device having a multi-function human interface.

[0426] For example, but not limited to, the first protrusion 1531 of the second electrode 1512, which is a second type of electrode, and the second protrusion 1532 of the fourth electrode 1522 may be positioned corresponding to a first keycap included in an electronic device having a multi-function human interface.

[0427] Furthermore, according to an embodiment, the areas of two adjacent protrusions may be substantially the same.

[0428] For example, the area of ​​the first protrusion 1531 of the second electrode 1512, which is a second type electrode, and the area of ​​the second protrusion 1532 of the fourth electrode 1522 may be substantially the same, but is not limited to this.

[0429] Furthermore, according to an embodiment, the areas of two adjacent protrusions may differ from each other.

[0430] For example, but not limited to, the area of ​​the first protrusion 1531 of the second electrode 1512, which is a second type electrode, and the area of ​​the second protrusion 1532 of the fourth electrode 1522 may be different from each other.

[0431] Furthermore, according to the embodiment, the areas of two adjacent protrusions may be formed to have various ratios.

[0432] For example, the area of ​​the first protrusion 1531 of the second electrode 1512, which is a second type electrode, and the area of ​​the second protrusion 1532 of the fourth electrode 1522 may be formed to have various ratios such as, but not limited to, 5:5, 4:6, 3:7, 2:8, 1:9, 6:4, 7:3, 8:2, and 9:1.

[0433] Furthermore, according to an embodiment, the protrusions of the second type of electrodes may be formed to protrude in a cape shape.

[0434]

[0435] For example, the second protrusion 1532 of the fourth electrode 1522, which is a second type electrode, may be formed to protrude in a cape shape from the fourth electrode 1522, but is not limited thereto.

[0436] Further, according to an embodiment, a protrusion of the second type of electrode may be formed at the location of the bay of the second type of electrode.

[0437] For example, the first protrusion 1531 of the second electrode 1512, which is a second type electrode, may be formed to protrude to the position of the bay of the second electrode 1512, but is not limited to this.

[0438] Furthermore, according to an embodiment, an electrode adjacent and electrically connected to an electrode of the second type may be an electrode of the first type.

[0439] For example, a first electrode 1511, which is an electrode adjacent to and electrically connected to a second electrode 1512, which is an electrode of a second type included in a first type line 1510, may be a first type electrode.

[0440] Furthermore, for example, a third electrode 1521, which is an electrode adjacent to and electrically connected to a fourth electrode 1522, which is a second type electrode included in a second type line 1520, may be a first type electrode.

[0441]

[0442] In the following, the second type of electrode described above is described in more detail.

[0443]

[0444] FIG. 7 illustrates various embodiments of a second type of electrode, according to an embodiment.

[0445] More specifically, FIG. 7 illustrates various embodiments of a second type of electrode that may be included in an electronic device having a multi-function human interface according to an embodiment.

[0446] In this specification, the details described above may be applied to electrodes of the second type. For convenience of explanation, the electrodes defined in the details described above are named as electrodes of the second type, and it will be appreciated by those skilled in the art that electrodes corresponding to the same definition may be named in other ways.

[0447] Referring to FIG. 7, various embodiments of the second type of electrode may include a first electrode 1610, a second electrode 1620, a third electrode 1630, a fourth electrode 1640, a fifth electrode 1650, and a sixth electrode 1660.

[0448] However, the embodiments of the present disclosure are not limited to the embodiment shown in FIG. 7 and may include various embodiments, such as modifications of FIG. 7 that may be modified to achieve the technical idea of ​​the present disclosure.

[0449] The second type of electrode according to the embodiment may include a protrusion for generating at least a key input signal according to a user's input.

[0450] For example, a first electrode 1610, which is an electrode of a second type according to an embodiment, may include a first protrusion 1611. A second electrode 1620, which is an electrode of a second type according to an embodiment, may include a second protrusion 1621. A third electrode 1630, which is an electrode of a second type according to an embodiment, may include a third protrusion 1631. A fourth electrode 1640, which is an electrode of a second type according to an embodiment, may include a fourth protrusion 1641. A fifth electrode 1650, which is an electrode of a second type according to an embodiment, may include a fifth protrusion 1651.

[0451] Furthermore, the location of the protrusions included in the second type of electrodes according to embodiments may vary.

[0452] For example, but not limited to, the first protrusion 1611 of the first electrode 1610, which is a second type electrode according to the embodiment, may be positioned at a position corresponding to the cape of the first electrode 1610.

[0453] Further, for example, but not limited to, the second protrusion 1621 of the second electrode 1620, which is a second type electrode according to the embodiment, may be positioned at a position corresponding to the bay of the second electrode 1620.

[0454] Further, for example, but not limited to, the third protrusion 1631 of the third electrode 1630, which is a second type electrode according to the embodiment, may be positioned at a position corresponding to the bay of the third electrode 1630.

[0455] In this specification, the size of the area corresponding to the bay of the third electrode 1630 may be different from the size of the area corresponding to the bay of the second electrode 1620. Thus, the position of the third protrusion 1631 of the third electrode 1630 may be different from the position of the second protrusion 1621 of the second electrode 1620.

[0456] Further, for example, but not limited to, the fourth protrusion 1641 of the fourth electrode 1640, which is a second type electrode according to the embodiment, may be positioned at a position corresponding to the bay of the fourth electrode 1640.

[0457] In this specification, the size of the area corresponding to the bay of the fourth electrode 1640 may be different from the size of the area corresponding to the bay of the second electrode 1620. Thus, the position of the fourth protrusion 1641 of the fourth electrode 1640 may be different from the position of the second protrusion 1621 of the second electrode 1620.

[0458] Further, for example, but not limited to, the fifth protrusion 1651 of the fifth electrode 1650, which is a second type electrode according to the embodiment, may be positioned at a position corresponding to the cape of the fifth electrode 1650.

[0459] Additionally, the second type of electrodes according to embodiments may not include protrusions.

[0460] For example, but not limited to, the sixth electrode 1660, which is a second type electrode according to an embodiment, may be formed so as not to include a protrusion.

[0461] Furthermore, according to an embodiment, two electrodes of a second type may be positioned as a pair.

[0462] In this specification, the two second type electrodes may be electrodes constituting at least part of a line acting as a transmitter and a line acting as a receiver, respectively.

[0463] For example, according to an embodiment, the first electrode 1610 and the second electrode 1620 may be positioned as a pair, but is not limited to such.

[0464] Further, for example, according to an embodiment, the third electrode 1630 and the fourth electrode 1640 may be positioned as a pair, but is not limited to such.

[0465] Further, for example, according to an embodiment, the fifth electrode 1650 and the sixth electrode 1660 may be positioned as a pair, but is not limited to such.

[0466] Further, according to an embodiment, two second type electrodes positioned as a pair may be positioned such that a protrusion of each electrode is at least partially received in a region corresponding to a bay of one of the electrodes.

[0467] For example, according to an embodiment, the first electrode 1610 and the second electrode 1620 may be positioned such that the first protrusion 1611 and the second protrusion 1621 are at least partially received in an area corresponding to the bay of the second electrode 1620, but are not limited to such.

[0468] Further, according to an embodiment, two second type electrodes positioned as a pair may be positioned such that a protrusion of each electrode is at least partially received in an area defined by a bay of each electrode.

[0469] For example, according to an embodiment, the third electrode 1630 and the fourth electrode 1640 may be positioned such that the third protrusion 1631 and the fourth protrusion 1641 are at least partially received in an area defined by an area corresponding to the bay of the third electrode 1630 and an area corresponding to the bay of the fourth electrode 1640, but are not limited thereto.

[0470] Further, according to an embodiment, two second type electrodes positioned as a pair may be positioned such that a protrusion of one of the electrodes is at least partially received in an area corresponding to the bay of the other electrode.

[0471] For example, according to an embodiment, the fifth electrode 1650 and the sixth electrode 1660 may be positioned such that the fifth protrusion 1651 is at least partially received in an area corresponding to the bay of the sixth electrode 1660, but is not limited thereto.

[0472]

[0473] FIG. 8 illustrates various embodiments of protrusions of a second type of electrode, according to an embodiment.

[0474] However, the embodiments of the present disclosure are not limited to the embodiment shown in FIG. 8 and may include various embodiments, such as modifications of FIG. 8 that may be modified to achieve the technical ideas of the present disclosure.

[0475] Referring to FIG. 8, the protrusions of the second type of electrodes according to an embodiment may be positioned in pairs and configured to form an area for generating at least a key input signal according to a user's input.

[0476] For example, referring to FIG. 8, a first protrusion 1711 and a second protrusion 1712 according to an embodiment may be positioned as a pair and may be arranged to form, but is not limited to, a first area 1710 for generating at least a key input signal according to a user's input.

[0477] Further, for example, referring to FIG. 8, the third protrusion 1721 and the fourth protrusion 1722 according to the embodiment may be positioned as a pair and may be arranged to form a second area 1720 for generating at least a key input signal according to a user's input, but is not limited thereto.

[0478] Further, for example, referring to FIG. 8, the fifth protrusion 1731 and the sixth protrusion 1732 according to the embodiment may be positioned as a pair and may be arranged to form a third area 1730 for generating at least a key input signal according to a user's input, but is not limited thereto.

[0479] Furthermore, the electronic device with a multi-function human interface according to the embodiment may include an elastic unit, which may be positioned corresponding to an area for generating at least a key input signal according to a user's input.

[0480] For example, the elastic unit included in the electronic device having a multi-functional human interface according to the embodiment may be positioned corresponding to the first area 1710 formed by the first protrusion 1711 and the second protrusion 1712 positioned as a pair according to the embodiment, and may generate at least a key input signal according to a user's input, but is not limited to this.

[0481] Further, for example, the elastic unit included in the electronic device having a multi-function human interface according to the embodiment may be positioned corresponding to the second region 1720 formed by the third protrusion 1721 and the fourth protrusion 1722 positioned as a pair according to the embodiment, and may generate at least a key input signal according to a user's input, but is not limited to this.

[0482] Further, for example, the elastic unit included in the electronic device having a multi-functional human interface according to the embodiment may be positioned corresponding to the third region 1730 formed by the fifth protrusion 1731 and the sixth protrusion 1732 positioned as a pair according to the embodiment, and may generate at least a key input signal according to a user's input, but is not limited to this.

[0483] Furthermore, the electronic device with a multi-function human interface according to the embodiment may include an elastic unit, which may include a conductive material, and the conductive material of the elastic unit may be positioned corresponding to an area for generating at least a key input signal according to a user's input.

[0484] For example, the conductive material of the elastic unit included in the electronic device having a multi-functional human interface according to the embodiment may be positioned corresponding to the first area 1710 formed by the first protrusion 1711 and the second protrusion 1712 positioned as a pair according to the embodiment, and may generate at least a key input signal according to a user's input, but is not limited to this.

[0485] Further, for example, the conductive material of the elastic unit included in the electronic device having a multi-functional human interface according to the embodiment may be positioned corresponding to the second region 1720 formed by the third protrusion 1721 and the fourth protrusion 1722 positioned as a pair according to the embodiment, and may generate at least a key input signal according to a user's input, but is not limited to this.

[0486] Furthermore, for example, the conductive material of the elastic unit included in the electronic device having a multi-functional human interface according to the embodiment may be positioned corresponding to the third region 1730 formed by the fifth protrusion 1731 and the sixth protrusion 1732 positioned as a pair according to the embodiment, and may generate at least a key input signal according to a user's input, but is not limited to this.

[0487]

[0488] At least the second type of electrodes for generating a key input signal have been described with reference to FIGS.

[0489] However, for convenience of explanation, the configuration of the electrode including the protrusion is explained as the second type electrode in Figures 6 to 8, but the configuration of the protrusion included in the second type electrode explained above can be understood as the second type electrode itself. This does not deviate from the technical idea of ​​the present disclosure.

[0490] Thus, the second type of electrode is an element for generating at least a key input signal, and in some cases may be understood as the protrusion itself as described above, or as an electrode including a protrusion as described above.

[0491]

[0492] FIG. 9 is a diagram showing a portion of an electrode layer according to an embodiment for explaining an electrode layer included in an electronic device having a multifunctional human interface according to an embodiment.

[0493] The details described above for the electrode layer may apply to the electrode layer 1800 according to the embodiment described with reference to FIG. 9, and the details described above may apply to the first type of lines, the second type of lines, the first type of electrodes, and the second type of electrodes included in the electrode layer, so redundant description will be omitted.

[0494] Referring to FIG. 9, an electrode layer 1800 according to an embodiment may include multiple electrodes.

[0495] For example, an electrode layer 1800 according to an embodiment may include a first electrode 1810 and a second electrode 1820.

[0496] In this specification, the first electrode 1810 and the second electrode 1820 may be a second type of electrode for generating at least a key input signal according to a user's input.

[0497] Further, with reference to FIG. 9, an electrode layer 1800 according to an embodiment may include a plurality of holes.

[0498] For example, an electrode layer 1800 according to an embodiment may include a first hole 1831, a second hole 1832, a third hole 1833, and a fourth hole 1834.

[0499] In this specification, the details described above may apply to multiple holes, so redundant descriptions will be omitted.

[0500] Furthermore, in this specification, the first hole 1831 to the fourth hole 1834 according to the embodiment may be holes for passing a connecting member of a lower plate for connecting a first keyboard mechanism unit included in an electronic device having a multi-function human interface, but are not limited thereto.

[0501]

[0502] According to an embodiment, at least one second type electrode included in electrode layer 1800 may be positioned such that it is at least partially contained within an area defined by at least four holes included in electrode layer 1800.

[0503] For example, referring to FIG. 9 , a first electrode 1810 and a second electrode 1820, which are second type electrodes included in the electrode layer 1800, may be positioned so as to be included in a first region 1840 defined by a first hole 1831 to a fourth hole 1834 included in the electrode layer 1800, but are not limited to this.

[0504] Further, according to an embodiment, the protrusion of at least one second type electrode included in the electrode layer 1800 may be positioned so as to be included in an area defined by at least four holes included in the electrode layer 1800.

[0505] For example, referring to FIG. 9 , the respective protrusions of the first electrode 1810 and the second electrode 1820, which are second type electrodes included in the electrode layer 1800, may be positioned so as to be included in a first region 1840 defined by the first hole 1831 to the fourth hole 1834 included in the electrode layer 1800, but are not limited to this.

[0506] Furthermore, according to an embodiment, the multiple holes included in the electrode layer 1800 may be formed to have different lengths in the longitudinal direction of the keyboard array and different lengths in the width direction of the keyboard array.

[0507] For example, the first hole 1831 to the fourth hole 1834 included in the electrode layer 1800 according to the embodiment may be formed in a rectangular shape whose length in the longitudinal direction of the keyboard array is longer than its length in the width direction of the keyboard array, but is not limited to this.

[0508] Furthermore, according to an embodiment, the holes included in the electrode layer 1800 may be provided in various shapes.

[0509] For example, the holes included in the electrode layer 1800 according to the embodiment may be rectangular, square, elliptical, circular, or trapezoidal, but may be formed in various shapes without being limited to the examples described above.

[0510] Furthermore, in embodiments where the holes included in the electrode layer 1800 may be formed such that their length in the longitudinal direction of the keyboard array is different from their length in the width direction of the keyboard array, the orientation of at least some of the holes may be the same.

[0511] For example, the orientations of the first hole 1831 to the fourth hole 1834 included in the electrode layer 1800 may be the same as each other, but are not limited to this.

[0512] Furthermore, among the multiple holes included in the electrode layer 1800 according to the embodiment, the orientations of the holes with respect to the same keycap may be the same as each other.

[0513] For example, when the first hole 1831 to the fourth hole 1834 included in the electrode layer 1800 are holes related to a first keycap, the orientations of the first hole 1831 to the fourth hole 1834 may be the same as each other, but are not limited to this.

[0514] Furthermore, among the multiple holes included in the electrode layer 1800 according to the embodiment, the orientations of the holes with respect to the same keyboard mechanism unit may be the same as each other.

[0515] For example, when the first hole 1831 to the fourth hole 1834 included in the electrode layer 1800 are holes related to a first keyboard mechanism unit, the orientations of the first hole 1831 to the fourth hole 1834 may be the same as each other, but are not limited to this.

[0516] Further, according to an embodiment, when a second type of electrode is positioned such that it is at least partially contained within an area defined by at least four holes contained in electrode layer 1800, the second type of electrode may not be contained within an area defined by at least two holes adjacent to some of the at least four holes.

[0517] For example, the electrode layer 1800 may include a first hole 1831 through a fourth hole 1834, a fifth hole 1835, and a sixth hole 1836. The first electrode 1810 and the second electrode 1820 may be included in a first region 1840 defined by the first hole 1831 through the fourth hole 1834. The second type of electrode may not be included in a second region 1850 defined by the second hole 1832, the fourth hole 1834, the fifth hole 1835, and the sixth hole 1836.

[0518] Further, according to an embodiment, when a protrusion of a second type of electrode is positioned so as to be included in an area defined by at least four holes included in electrode layer 1800, the protrusion of the second type of electrode may not be included in an area defined by at least two holes adjacent to some of the at least four holes.

[0519] For example, the electrode layer 1800 may include a first hole 1831 through a fourth hole 1834, a fifth hole 1835, and a sixth hole 1836. The protrusions of the first electrode 1810 and the second electrode 1820 may be included in a first region 1840 defined by the first hole 1831 through the fourth hole 1834. The protrusions of the second type of electrode may not be included in a second region 1850 defined by the second hole 1832, the fourth hole 1834, the fifth hole 1835, and the sixth hole 1836.

[0520] Further, according to the embodiment, the second hole 1832 may be adjacent to the first hole 1831 in the longitudinal direction of the keyboard arrangement. The fifth hole 1835 may be adjacent to the second hole 1832 in the longitudinal direction of the keyboard arrangement. The third hole 1833 may be adjacent to the first hole 1831 in the width direction of the keyboard arrangement. The fourth hole 1834 may be adjacent to the third hole 1833 in the longitudinal direction of the keyboard arrangement and adjacent to the second hole 1832 in the width direction of the keyboard arrangement. The sixth hole 1836 may be adjacent to the fourth hole 1834 in the longitudinal direction of the keyboard arrangement and adjacent to the fifth hole 1835 in the width direction of the keyboard arrangement. However, no limitation is imposed thereon.

[0521] Furthermore, the distance between the first hole 1831 and the third hole 1833 may be the same as the distance between the fifth hole 1835 and the sixth hole 1836, but no limitation is imposed thereon.

[0522] Furthermore, the distance between the first hole 1831 and the fifth hole 1835 may be the same as the distance between the third hole 1833 and the sixth hole 1836, but no limitation is imposed thereon.

[0523] FIG. 10 is a diagram showing a part of an electronic device having a multifunctional human interface according to an embodiment, for explaining the electronic device having a multifunctional human interface according to an embodiment.

[0524] Referring to FIG. 10, an electronic device 1900 having a multi-function human interface according to an embodiment may include a keycap layer and an electrode layer.

[0525] In this specification, the details described above may be applied to the keycap layer and the electrode layer, so redundant descriptions will be omitted.

[0526] A keycap layer according to an embodiment may include multiple keycaps.

[0527] For example, a keycap layer according to an embodiment may include a first keycap 1951, a second keycap 1952, and a third keycap 1953.

[0528] In this specification, according to an embodiment, the second keycap 1952 may refer to a keycap adjacent to the first keycap 1951 in the width direction of the keyboard array. The third keycap 1953 may refer to a keycap adjacent to the first keycap 1951 in the width direction of the keyboard array and spaced apart from the second keycap 1952 in the width direction of the keyboard array.

[0529]

[0530] Further, according to an embodiment, the second keycap 1952 may refer to a keycap that is displaced from the first keycap 1951 by a first distance in the longitudinal direction of the keyboard arrangement. The third keycap 1953 may refer to a keycap that is displaced from the first keycap 1951 by a second distance in the longitudinal direction of the keyboard arrangement. In this specification, the second distance may be greater than the first distance, but is not limited thereto.

[0531] Additionally, the electrode layer according to the embodiment may include a plurality of electrodes, and may include a plurality of second type lines of electrodes electrically connected across the width of the keyboard arrangement.

[0532] Additionally, an electrode layer according to an embodiment may include, but is not limited to, a first line 1910, a second line 1920, and a third line 1930 of electrodes electrically connected across the width of the keyboard arrangement.

[0533] In this specification, the shapes of the first line 1910, the second line 1920, and the third line 1930 may be shapes in which the electrodes constituting each of the first line 1910, the second line 1920, and the third line 1930 are connected. For ease of understanding, FIG. 10 shows the first line 1910, the second line 1920, and the third line 1930 in more detail.

[0534]

[0535] The second type of line according to the embodiment may be positioned so as to be overlapped by at least one keycap.

[0536] In this specification, positioning the second type of lines so that they are overlapped by at least one keycap may include positioning at least a portion of the electrodes that constitute each of the second type of lines so that they are overlapped by at least one keycap.

[0537] For example, but not limited to, the first line 1910 according to an embodiment may be positioned to be overlapped by a first keycap 1951 and a second keycap 1952 .

[0538] Further, for example, but not limited to, the second line 1920 according to an embodiment may be positioned to be overlapped by a first keycap 1951, a second keycap 1952, and a third keycap 1953.

[0539] Further, for example, but not limited to, the third line 1930 according to an embodiment may be positioned to be overlapped by the first keycap 1951 and the third keycap 1953 .

[0540]

[0541] Further, the second type lines according to the embodiment may include a first type electrode for generating at least a touch input signal or a second type electrode for generating at least a key input signal according to a user's input.

[0542] For example, a first line 1910 according to an embodiment may include, but is not limited to, a first electrode 1911 that is a second type electrode for generating at least a key input signal, and a second electrode 1912 that is a first type electrode for generating at least a touch input signal.

[0543] Further, for example, the second line 1920 according to an embodiment may include, but is not limited to, a third electrode 1921 which is a second type electrode for generating at least a key input signal, and a fourth electrode 1922 and a fifth electrode 1923 which are first type electrodes for generating at least a touch input signal.

[0544] Further, for example, the third line 1930 according to the embodiment may include, but is not limited to, a sixth electrode 1931 which is a second type electrode for generating at least a key input signal, and a seventh electrode 1932 which is a first type electrode for generating at least a touch input signal.

[0545]

[0546] Further, with respect to the electrodes constituting each of the second type lines according to the embodiment, the first type electrodes for generating at least the touch input signals may be provided with more or larger area than the second type electrodes for generating at least the key input signals.

[0547] For example, referring to a portion of the electrode layer shown in FIG. 10, of the ten electrodes constituting the first line 1910, only the first electrode 1911 may be a second type electrode, and the remaining nine electrodes may be first type electrodes, but are not limited to this.

[0548] Further, for example, referring to a portion of the electrode layer shown in FIG. 10, of the ten electrodes constituting the second line 1920, only the third electrode 1921 may be a second type electrode, and the remaining nine electrodes may be first type electrodes, but are not limited to this.

[0549] Further, for example, referring to a portion of the electrode layer shown in FIG. 10, of the ten electrodes constituting the third line 1930, only the sixth electrode 1931 may be a second type electrode, and the remaining nine electrodes may be first type electrodes, but are not limited to this.

[0550]

[0551] Further, according to an embodiment, a third electrode 1921, which is a second type electrode included in the second line 1920, may be used to generate a first key input signal according to a user's key input on the first keycap 1951.

[0552] Further, according to an embodiment, a first electrode 1911, which is a second type electrode included in the first line 1910, may be used to generate a second key input signal according to a user's key input on the second keycap 1952.

[0553] Further, according to an embodiment, a sixth electrode 1931, which is a second type electrode included in the third line 1930, may be used to generate a third key input signal according to a user's key input on the third keycap 1953.

[0554] Further, according to an embodiment, the first electrode 1911 used to generate a second key input signal according to a user's key input on the second keycap 1952 may be electrically connected to the second electrode 1912 used to generate a touch input signal according to a user's touch input on a certain area of ​​the first keycap 1951, but may not be electrically connected to the third electrode 1921 used to generate a first key input signal according to a user's key input on the first keycap 1951.

[0555] Further, according to an embodiment, the third electrode 1921 used to generate a first key input signal according to a user's key input on the first keycap 1951 may be electrically connected to the fourth electrode 1922 used to generate a touch input signal according to a user's touch input on a partial area of ​​the second keycap 1952 and the fifth electrode 1923 used to generate a touch input signal according to a user's touch input on a partial area of ​​the third keycap 1953, but may not be electrically connected to the first electrode 1911 used to generate a second key input signal according to a user's key input on the second keycap 1952, and may not be electrically connected to the sixth electrode 1931 used to generate a third key input signal according to a user's key input on the third keycap 1953.

[0556] Further, according to an embodiment, the sixth electrode 1931 used to generate a third key input signal according to a user's key input on the third keycap 1953 may be electrically connected to the seventh electrode 1932 used to generate a touch input signal according to a user's touch input on a certain area of ​​the first keycap 1951, but may not be electrically connected to the third electrode 1921 used to generate a first key input signal according to a user's key input on the first keycap 1951.

[0557]

[0558] Furthermore, according to an embodiment, at least some of the plurality of keycaps may be positioned to overlap the plurality of electrodes.

[0559] For example, a first keycap 1951, a second keycap 1952, and a third keycap 1953 included in the plurality of keycaps may be positioned to overlap the plurality of electrodes.

[0560] As a more specific example, the first keycap 1951 may be positioned to overlap the second electrode 1912 and the seventh electrode 1932, which are electrodes of the first type, and the third electrode 1921, which is an electrode of the second type. The second keycap 1952 may be positioned to overlap the fourth electrode 1922, which is an electrode of the first type, and the first electrode 1911, which is an electrode of the second type. The third keycap 1953 may be positioned to overlap the fifth electrode 1923, which is an electrode of the first type, and the sixth electrode 1931, which is an electrode of the second type.

[0561] In this specification, a first electrode 1911 which is a second type electrode overlaid by a second keycap 1952 may be electrically connected to a second electrode 1912 which is a first type electrode overlaid by a first keycap 1951, but may not be electrically connected to a third electrode 1921 which is a second type electrode overlaid by a first keycap 1951.

[0562] Further, in this specification, the third electrode 1921, which is a second type electrode overlaid by the first keycap 1951, may be electrically connected to the fourth electrode 1922, which is a first type electrode overlaid by the second keycap 1952, and the fifth electrode 1923, which is a first type electrode overlaid by the third keycap 1953, but may not be electrically connected to the first electrode 1911, which is a second type electrode overlaid by the second keycap 1952, and may not be electrically connected to the sixth electrode 1931, which is a second type electrode overlaid by the third keycap 1953.

[0563] Further, in this specification, the sixth electrode 1931, which is a second type electrode overlaid by the third keycap 1953, may be electrically connected to the seventh electrode 1932, which is a first type electrode overlaid by the first keycap 1951, but may not be electrically connected to the third electrode 1921, which is a second type electrode overlaid by the first keycap 1951.

[0564]

[0565] Furthermore, according to an embodiment, at least two adjacent ones of the second type lines included in the electrode layer may include at least one second type electrode.

[0566] For example, a first line 1910 and a second line 1920 adjacent to the first line 1910 may include a first electrode 1911 and a third electrode 1921, respectively, that are of a second type of electrode.

[0567] Further, for example, the second line 1920 and a third line 1930 adjacent to the second line 1920 may include a third electrode 1921 and a sixth electrode 1931, respectively, that are electrodes of a second type.

[0568]

[0569] FIG. 11 is a diagram showing a part of an electronic device having a multifunctional human interface according to an embodiment, for explaining the electronic device having a multifunctional human interface according to an embodiment.

[0570] Furthermore, the electrode layers shown in Fig. 10 and Fig. 11 may refer to the same part. The figures are divided for convenience of explanation, so that a person skilled in the art can derive the technical idea by comprehensively understanding Fig. 10 and Fig. 11. The technical idea of ​​the present disclosure also includes a technical idea derived by comprehensively considering Fig. 10 and Fig. 11.

[0571] Referring to FIG. 11, an electronic device 1900 having a multi-function human interface according to an embodiment may include a keycap layer and an electrode layer.

[0572] In this specification, the details described above may be applied to the keycap layer and the electrode layer, so redundant descriptions will be omitted.

[0573] A keycap layer according to an embodiment may include multiple keycaps.

[0574] For example, a keycap layer according to an embodiment may include a first keycap 1951, a fourth keycap 1954, and a fifth keycap 1955.

[0575] In this specification, according to an embodiment, the fourth keycap 1954 may refer to a keycap adjacent to the first keycap 1951 in the longitudinal direction of the keyboard arrangement. The fifth keycap 1955 may refer to a keycap adjacent to the first keycap 1951 in the longitudinal direction of the keyboard arrangement and spaced apart from the fourth keycap 1954 in the longitudinal direction of the keyboard arrangement.

[0576] Further, the electrode layer according to the embodiment may include a plurality of electrodes, and may include a plurality of first type lines of electrodes electrically connected in the longitudinal direction of the keyboard arrangement.

[0577] For example, an electrode layer according to an embodiment may include, but is not limited to, a fourth line 1960, a fifth line 1970, and a sixth line 1980 of electrodes electrically connected in the longitudinal direction of the keyboard arrangement.

[0578] In this specification, the shapes of the fourth line 1960, the fifth line 1970, and the sixth line 1980 may be shapes in which the electrodes constituting each of the fourth line 1960, the fifth line 1970, and the sixth line 1980 are connected. For ease of understanding, FIG. 11 shows the fourth line 1960, the fifth line 1970, and the sixth line 1980 in more detail.

[0579]

[0580] The first type of line according to the embodiment may be positioned so as to be overlapped by at least one keycap.

[0581] In this specification, positioning the first type of lines so that they are overlapped by at least one keycap may include positioning at least a portion of the electrodes that constitute each of the first type of lines so that they are overlapped by at least one keycap.

[0582] For example, but not limited to, the fourth line 1960 according to an embodiment may be positioned to be overlapped by the first keycap 1951, the fourth keycap 1954, and the fifth keycap 1955.

[0583] Further, for example, but not limited to, the fifth line 1970 according to an embodiment may be positioned to be overlapped by the first keycap 1951, the fourth keycap 1954, and the fifth keycap 1955.

[0584] Further, for example, but not limited to, the sixth line 1970 according to an embodiment may be positioned to be overlapped by the first keycap 1951, the fourth keycap 1954, and the fifth keycap 1955.

[0585] Further, the first type of line according to the embodiment may include a first type of electrode for generating at least a touch input signal or a second type of electrode for generating at least a key input signal according to a user's input.

[0586] For example, the fourth line 1960 according to an embodiment may include, but is not limited to, an eighth electrode 1961, a ninth electrode 1962, and a tenth electrode 1963, which are second type electrodes for generating key input signals.

[0587] Further, for example, the fifth line 1970 according to an embodiment may include, but is not limited to, an eleventh electrode 1971, a twelfth electrode 1972, and a thirteenth electrode 1973, which are at least a first type of electrodes for generating a touch input signal.

[0588] Further, for example, the sixth line 1980 according to an embodiment may include, but is not limited to, a fourteenth electrode 1981, a fifteenth electrode 1982, and a sixteenth electrode 1983, which are at least a first type of electrodes for generating a touch input signal.

[0589]

[0590] Further, with respect to the electrodes constituting each of the first type lines according to an embodiment, the first type electrodes for generating at least the touch input signals may be provided with more or larger area than the second type electrodes for generating at least the key input signals.

[0591]

[0592] For example, referring to a portion of the electrode layer shown in FIG. 11, of the ten electrodes constituting the fourth line 1960, the eighth electrode 1961, the ninth electrode 1962, and the tenth electrode 1963 may be second type electrodes, and the remaining seven electrodes may be first type electrodes, but are not limited to this.

[0593] Further, for example, with reference to the portion of the electrode layer shown in FIG. 11, all ten electrodes making up the fifth line 1970 may be, but are not limited to, the first type electrodes.

[0594] Further, for example, referring to the portion of the electrode layer shown in FIG. 11, all ten electrodes making up the sixth line 1980 may be, but are not limited to, the first type electrodes.

[0595]

[0596] Further, according to an embodiment, an eighth electrode 1961, which is a second type electrode included in the fourth line 1960, may be used to generate a fourth key input signal according to a user's key input on the fourth keycap 1954.

[0597] Further, according to an embodiment, a ninth electrode 1962, which is a second type electrode included in the fourth line 1960, may be used to generate a first key input signal according to a user's key input on the first keycap 1951.

[0598] Further, according to an embodiment, a tenth electrode 1963, which is a second type electrode included in the fourth line 1960, may be used to generate a fifth key input signal according to a user's key input on the fifth keycap 1955.

[0599]

[0600] Furthermore, according to an embodiment, if any one of the lines of a first type included in the electrode layer includes an electrode of a second type, another adjacent line may not include an electrode of the second type.

[0601] For example, if a fourth line 1960 includes an eighth electrode 1961, a ninth electrode 1962, and a tenth electrode 1963 that are second electrodes, the fifth line 1970 and the sixth line 1980 adjacent to the fourth line 1960 may not include electrodes of the second type.

[0602]

[0603] Further, according to an embodiment, when a first type line included in an electrode layer includes a plurality of second type electrodes, the number of first type electrodes positioned between adjacent second type electrodes among the plurality of second type electrodes may be at least partially the same.

[0604] For example, if the fourth line 1960 includes an eighth electrode 1961, a ninth electrode 1962, and a tenth electrode 1963, which are second type electrodes, the number of first type electrodes positioned between the eighth electrode 1961 and the ninth electrode 1962 may be two, and the number of first type electrodes positioned between the ninth electrode 1962 and the tenth electrode 1963 may also be two, but is not limited to this.

[0605]

[0606] FIG. 12 is a diagram illustrating electrode layers included in an electronic device having a multi-function human interface, according to an embodiment.

[0607] In FIG. 12, for convenience of explanation, the electrodes and electrical connection lines are shown as blocks.

[0608] Referring to FIG. 12, an electrode layer 2000 according to an embodiment may be comprised of multiple layers.

[0609] For example, as shown in FIG. 12, an electrode layer 2000 according to an embodiment may include at least a first layer 2010 and a second layer 2020, but is not limited thereto.

[0610] In this specification, the details described above for the electrode layer, such as the first type of lines, the second type of lines, the first type of electrodes, and the second type of electrodes, may apply to the electrode layer 2000, and therefore redundant description will be omitted.

[0611]

[0612] According to an embodiment, the first layer 2010 included in the electrode layer 2000 may be the layer in which the electrodes are positioned.

[0613] For example, the first layer 2010 may be, but is not limited to, a layer having electrodes patterned thereon.

[0614] Furthermore, according to an embodiment, the electrical connections of the electrodes included in at least one of the first type of wires constituting the electrodes and electrically connected in the longitudinal direction of the keyboard arrangement included in the electrode layer 2000, or the second type of wires constituting the electrodes and electrically connected in the width direction of the keyboard arrangement, may be provided in the first layer 2010.

[0615] For example, as shown in FIG. 12, electrical connections for a first type of wire constituting electrodes electrically connected in the longitudinal direction of the keyboard arrangement may be provided within a first layer 2010, but are not limited to this.

[0616] Further, according to an embodiment, the second layer 2020 included in the electrode layer 2000 may be a layer that provides electrical connection between at least some of the electrodes positioned in the first layer 2010.

[0617] For example, but not limited to, the second layer 2020 may be a layer having patterned wires to provide electrical connections between at least some of the electrodes positioned in the first layer 2010.

[0618] Furthermore, according to an embodiment, the electrical connections of the electrodes included in at least one of the first type of wires constituting the electrodes and electrically connected in the longitudinal direction of the keyboard arrangement included in the electrode layer 2000 or the second type of wires constituting the electrodes and electrically connected in the width direction of the keyboard arrangement may be provided in the second layer 2020.

[0619] For example, as shown in FIG. 12, electrical connections for the second type of wires constituting the electrodes electrically connected across the width of the keyboard arrangement may be provided through the second layer 2020, but are not limited to this.

[0620] The details described with reference to Fig. 12 relate to embodiments that provide electrical connections between electrodes for generating touch input signals or key input signals. The technical concept of the present disclosure is not limited to the embodiments described with reference to Fig. 12. Various methods of electrically connecting electrodes or providing electrically connected electrodes may also be included in the technical concept of the present disclosure.

[0621]

[0622] FIG. 13 illustrates an electronic device having a multi-function human interface according to an embodiment.

[0623] Referring to FIG. 13, an electronic device 2100 having a multi-function human interface according to an embodiment may include a keycap layer and an electrode layer.

[0624] In this specification, the details described above may be applied to the keycap layer and the electrode layer, so redundant descriptions will be omitted.

[0625] 13, an electronic device 2100 having a multi-function human interface according to an embodiment may include a key input area 2110 and a touch input area 2120. A multi-function area may be positioned in an area where the key input area 2110 and the touch input area 2120 overlap.

[0626] In this specification, the details described above may apply to the key input area 2110, the touch input area 2120, and the multi-function area, and therefore redundant descriptions will be omitted.

[0627]

[0628] A keycap layer according to an embodiment may include keycaps that are included in the multi-function area and keycaps that are not included in the multi-function area.

[0629] For example, a keycap layer according to an embodiment may include, but is not limited to, a first keycap 2130 that does not overlap and is not included in the multi-functional area, a second keycap 2140 that overlaps and is included in the multi-functional area, a third keycap 2150 that overlaps and is included in the multi-functional area, a fourth keycap 2160 that does not overlap and is not included in the multi-functional area, and a fifth keycap 2170 that partially overlaps and is not included in the multi-functional area.

[0630]

[0631] Further, according to an embodiment, at least one pair of electrodes may be positioned to be overlapped by a plurality of keycaps included in the keycap layer to generate a key input signal according to a user's key input into the key input area 2110 of the electronic device having a multi-function human interface 2100.

[0632] For example, at least the first electrode 2131 and the second electrode 2132 may be positioned to be overlapped by the first keycap 2130 to generate a first key input signal according to a user's key input on the first keycap 2130.

[0633] Further, for example, at least the third electrode 2141 and the fourth electrode 2142 may be positioned to be overlapped by the second keycap 2140 to generate a second key input signal in accordance with a user's key input on the second keycap 2140.

[0634] Further, for example, at least the fifth electrode 2151 and the sixth electrode 2152 may be positioned to be overlapped by a third keycap 2150 to generate a third key input signal according to a user's key input on the third keycap 2150.

[0635] Further, for example, at least the seventh electrode 2161 and the eighth electrode 2162 may be positioned to be overlapped by the fourth keycap 2160 to generate a fourth key input signal in accordance with a user's key input on the fourth keycap 2160.

[0636] Further, for example, at least the ninth electrode 2171 and the tenth electrode 2172 may be positioned to be overlapped by the fifth keycap 2170 to generate a fifth key input signal in accordance with a user's key input on the fifth keycap 2170.

[0637]

[0638] Furthermore, according to the embodiment, the pair of electrodes overlapped by the keycap not included in the multi-function area may be a third type of electrodes.

[0639] For example, the first electrode 2131 and the second electrode 2132 positioned to be overlapped by the first keycap 2130 may be, but are not limited to, a third type electrode.

[0640] Furthermore, for example, the seventh electrode 2161 and the eighth electrode 2162 positioned to be overlapped by the fourth keycap 2160 may be, but are not limited to, a third type of electrode.

[0641] Furthermore, for example, the ninth electrode 2171 and the tenth electrode 2172 positioned to be overlapped by the fifth keycap 2170 may be, but are not limited to, a third type of electrode.

[0642] In this specification, the third type of electrode may be an electrode for generating a key input signal according to a user's input.

[0643] Furthermore, the third type of electrodes may be provided in the form of, but are not limited to, protrusions of the second type of electrodes described above.

[0644] Furthermore, a keycap that does not overlap the multi-function area may overlap a pair of electrodes, but does not need to overlap other electrodes among the multiple electrodes included in the electrode layer.

[0645] For example, the first keycap 2130 may overlap the first electrode 2131 and the second electrode 2132, but may not overlap other electrodes included in the electrode layer, although no limitation is imposed thereon.

[0646]

[0647] Furthermore, according to the embodiment, among the keycaps included in the multi-function area, the electrodes for generating key input signals for two adjacent keycaps in the width direction of the keyboard array do not need to be electrically connected to each other.

[0648] For example, for a second keycap 2140 and a third keycap 2150 included in a multi-function area and adjacent to each other in the width direction of the keyboard array, the electrodes for generating the second key input signal and the third key input signal, respectively, may not be electrically connected to each other.

[0649] More specifically, the third electrode 2141 and the fourth electrode 2142, which are overlaid by the second keycap 2140 and for generating the second key input signal, may not be electrically connected to the fifth electrode 2151 and the sixth electrode 2152, which are overlaid by the third keycap 2150 and for generating the third key input signal.

[0650]

[0651] Furthermore, according to an embodiment, among the keycaps not included in the multi-function area, at least a portion of the electrodes for generating key input signals for two adjacent keycaps in the width direction of the keyboard array may be electrically connected to each other.

[0652] For example, for a fourth keycap 2160 and a fifth keycap 2170 that are not included in the multi-function area and are adjacent to each other in the width direction of the keyboard array, at least a portion of the electrodes for generating the fourth key input signal and the fifth key input signal, respectively, may be electrically connected to each other.

[0653] More specifically, a seventh electrode 2161 of a pair of electrodes for generating a fourth key input signal, which is overlapped by the fourth keycap 2160, may be electrically connected to a ninth electrode 2171 of a pair of electrodes for generating a fifth key input signal, which is overlapped by the fifth keycap 2170.

[0654]

[0655] According to the technical idea of ​​the present disclosure described with reference to FIG. 13, a key input sensor and a touch input sensor can be realized within the electrode layer, the touch resolution of the multi-function area can be improved, and the configuration of the key input area not included in the multi-function area can be simplified.

[0656]

[0657] FIG. 14 illustrates an electronic device having a multi-function human interface according to an embodiment.

[0658] More specifically, FIG. 14 is a diagram illustrating an electronic device having a multifunctional human interface, using a portion of the electronic device having a multifunctional human interface for the sake of convenience of explanation.

[0659] Referring to FIG. 14, an electronic device 2200 having a multi-function human interface according to an embodiment may include a keycap layer 2210, an elastic unit layer 2220, and an electrode layer 2230.

[0660] In this specification, the details described above may apply to the keycap layer 2210, the elastic unit layer 2220, and the electrode layer 2230, and therefore redundant descriptions will be omitted.

[0661]

[0662] Further, the electrode layer 2230 according to an embodiment may include at least one touch input sensor 2250 and at least one key input sensor 2240.

[0663] In this specification, the details described above may apply to at least one touch input sensor 2250, and therefore redundant description will be omitted.

[0664] Furthermore, in this specification, the details described above may apply to at least one key input sensor 2240, and therefore redundant descriptions will be omitted.

[0665] Furthermore, the details described above for the third type of electrodes and switches in this specification may apply to at least one key input sensor 2240, and therefore redundant description will be omitted.

[0666]

[0667] Furthermore, the at least one key input sensor 2240 according to the embodiment may be configured as a part of at least one electrode constituting the at least one touch input sensor 2250, and may be composed of an electrode different from the at least one electrode constituting the at least one touch input sensor 2250. When two electrodes constitute the at least one key input sensor 2240 according to the embodiment, one of the electrodes may be configured as a part of at least one electrode constituting the at least one touch input sensor 2250, and the other of the electrodes may be configured as an electrode different from the at least one electrode constituting the at least one touch input sensor 2250, although no limitation is imposed thereon.

[0668]

[0669] Furthermore, the electrode layer 2230 according to the embodiment may further include an insulating layer 2231.

[0670] In this specification, for convenience of explanation, the insulating layer 2231 is explained as being included in the electrode layer 2230, but it may be provided so as to be distinguished from the electrode layer 2230.

[0671] Further, the insulating layer 2231 according to an embodiment may be positioned to overlap at least one electrode included in the electrode layer 2230.

[0672] For example, the insulating layer 2231 according to the embodiment may be positioned to overlap the first electrode 2251 and the second electrode 2252 constituting the touch input sensor 2250 included in the electrode layer 2230, but is not limited to this.

[0673] Furthermore, the insulating layer 2231 according to the embodiment may be positioned so as not to overlap at least one electrode included in the electrode layer 2230.

[0674] For example, the insulating layer 2231 according to the embodiment may be positioned so as not to overlap the third electrode 2241 and the fourth electrode 2242 constituting the key input sensor 2240 included in the electrode layer 2230, but is not limited to this.

[0675] Further, the insulating layer 2231 according to an embodiment may be provided to include at least one hole.

[0676] For example, the insulating layer 2231 according to the embodiment may be provided to include a first hole positioned within an area corresponding to the third electrode 2241 and the fourth electrode 2242 constituting the key input sensor 2240 included in the electrode layer 2230, but is not limited to this.

[0677] Further, for example, the insulating layer 2231 according to the embodiment may be provided to include, but is not limited to, a first hole positioned within an area corresponding to a first conductive material included in a first elastic unit included in the elastic unit layer 2220.

[0678] Further, for example, but not limited to, the insulating layer 2231 in accordance with an embodiment may be provided to include a first hole positioned within an area corresponding to the center of a first keycap included in the keycap layer 2210.

[0679]

[0680] FIG. 15 illustrates an electronic device having a multi-function human interface, according to an embodiment.

[0681] More specifically, FIG. 15 is a diagram illustrating an electronic device having a multifunctional human interface, using a portion of the electronic device having a multifunctional human interface for the sake of convenience of explanation.

[0682] Referring to FIG. 15, an electronic device with a multi-function human interface 2300 according to an embodiment may include a keycap layer 2310, an elastic unit layer 2320, and an electrode layer 2330.

[0683] In this specification, the details described above may apply to the keycap layer 2310, the elastic unit layer 2320, and the electrode layer 2330, and therefore redundant descriptions will be omitted.

[0684]

[0685] Further, the electrode layer 2330 according to an embodiment may include at least one touch input sensor 2350 and at least one key input sensor 2340 .

[0686] In this specification, the details described above may apply to at least one touch input sensor 2350, and therefore redundant descriptions will be omitted.

[0687] Furthermore, in this specification, the details described above may apply to at least one key input sensor 2340, and therefore redundant descriptions will be omitted.

[0688] Furthermore, the details described above for the third type of electrodes and switches in this specification may apply to at least one key input sensor 2340, and therefore redundant description will be omitted.

[0689]

[0690] Furthermore, the at least one key input sensor 2340 according to the embodiment may be configured as part of at least one electrode constituting the at least one touch input sensor 2350, and may be composed of an electrode different from the at least one electrode constituting the at least one touch input sensor 2350. When two electrodes constitute the at least one key input sensor 2340 according to the embodiment, one of the electrodes may be configured as part of at least one electrode constituting the at least one touch input sensor 2350, and the other of the electrodes may be configured as an electrode different from the at least one electrode constituting the at least one touch input sensor 2350, although no limitation is imposed thereon.

[0691]

[0692] Furthermore, the electrode layer 2330 according to the embodiment may further include an insulating layer 2331 .

[0693] In this specification, for convenience of explanation, the insulating layer 2331 is explained as being included in the electrode layer 2330, but it may be provided so as to be distinguished from the electrode layer 2330.

[0694] Further, the insulating layer 2331 according to an embodiment may be positioned to overlap at least one electrode included in the electrode layer 2330.

[0695] For example, the insulating layer 2331 according to the embodiment may be positioned so as to overlap the first electrode 2351 and the second electrode 2352 constituting the touch input sensor 2350, and the third electrode 2341 and the fourth electrode 2342 constituting the key input sensor 2340, which are included in the electrode layer 2330, but is not limited to this.

[0696] Furthermore, the insulating layer 2331 according to the embodiment may be provided to have at least partially different thicknesses.

[0697] For example, the insulating layer 2331 according to the embodiment may be provided such that the thickness of a first region overlapping with the first electrode 2351 and the second electrode 2352 constituting the touch input sensor 2350 included in the electrode layer 2330 is greater than the thickness of a second region overlapping with the third electrode 2341 and the fourth electrode 2342 constituting the key input sensor 2340 included in the electrode layer 2330, but is not limited to this.

[0698] Further, for example, the insulating layer 2331 according to the embodiment may be provided such that the thickness of a first region overlapping with the first electrode 2351 and the second electrode 2352 constituting the touch input sensor 2350 included in the electrode layer 2330 is greater than the thickness of a second region corresponding to the first conductive material included in the first elastic unit included in the elastic unit layer 2220, but is not limited thereto.

[0699] Further, for example, the insulating layer 2331 according to the embodiment may be arranged such that the thickness of a first region overlapping with the first electrode 2351 and the second electrode 2352 constituting the touch input sensor 2350 included in the electrode layer 2330 is greater than the thickness of a second region corresponding to the center of the first keycap, but is not limited thereto.

[0700]

[0701] Furthermore, according to the technical ideas of the present disclosure generally described throughout this specification, the integration of the key input sensor and the touch input sensor can reduce the overall thickness and volume of the electronic device having a multi-functional human interface, and in terms of being able to control the integrated signals, can enable quicker and clearer switching of the usage interface of the electronic device having a multi-functional human interface, and as described above, can improve the durability and reduce the manufacturing cost of the electronic device having a multi-functional human interface.

[0702]

[0703] FIG. 16 illustrates the operation modes of an electronic device having a multifunctional human interface and the corresponding operation of the interface device according to an embodiment.

[0704] Referring to FIG. 16, an electronic device 3010 having a multifunction human interface according to an embodiment may include a touch input area and may operate in an operational mode in which at least a portion of the touch input area is active.

[0705] For example, an electronic device 3010 having a multifunctional human interface according to an embodiment may include a touch input area corresponding to at least a part of a keyboard arrangement, and may operate in a first operation mode in which a first touch input area 3011 included in the touch input area is active, although no limitation is imposed thereto.

[0706] In this specification, the details described above may be applied to the touch input area, and therefore redundant descriptions will be omitted.

[0707] 16 is described based on the case of a first operation mode in which a first touch input area 3011 included in the touch input area is active. However, the embodiments of the present disclosure are not limited thereto and may include an embodiment in the case of operation in another operation mode in which a touch input area different from the first touch input area 3011 (e.g., a right touch input area) is active.

[0708] Furthermore, in this specification, the touch input area being active may mean, but is not limited to, that pointer position related information is generated based on a touch input signal about the touch input area being active. The touch input area being active may include a concept that is generally understood to mean that the touch input area is active.

[0709] Fig. 16(a) is a diagram showing, for example, a case where a user's touch input to the first touch input area 3011 is acquired. Fig. 16(b) is a diagram showing, for example, a case where a user's touch input area outside the first touch input area 3011 is acquired.

[0710] First, referring to FIG. 16(a), according to an embodiment, a touch input to a first touch input area 3011 of an electronic device with a multifunctional human interface 3010 may be obtained from a user.

[0711] For example, as shown in FIG. 16(a), a touch input including a touch start point 3031 and a touch end point 3032 in a first touch input area 3011 of an electronic device with a multi-function human interface 3010 may be obtained from a user, but is not limited to this.

[0712] In this specification, the touch start point 3031 may mean a point at which a touch input from a user starts, may mean a point at which a touch input is acquired for the first time within a predetermined period, and may mean a point at which a touch input signal equal to or greater than a specific criterion is generated for the first time. However, without being limited thereto, the touch start point may include a concept that is generally understood as a touch start point.

[0713] Furthermore, in this specification, the touch end point 3032 may mean a point at which a touch input from a user ends, may mean a point at which the last touch input is acquired within a predetermined period of time, and may mean a point at which a touch input signal equal to or greater than a specific criterion is last generated. However, without being limited thereto, the touch end point may include a concept that is generally understood as a touch end point.

[0714] Furthermore, in this specification, the touch input between the touch start point 3031 and the touch end point 3032 may be defined as a touch path, but is not limited thereto.

[0715] Referring again to FIG. 16(a), when a touch input to a first touch input area 3011 of the electronic device with a multifunctional human interface 3010 is obtained from a user, pointer position related information may be generated.

[0716] For example, according to an embodiment, when a touch input to the first touch input area 3011 of the electronic device with a multifunctional human interface 3010 is obtained from a user, pointer position related information may be generated, the pointer position related information may be transferred to an electronic device connected to the electronic device with a multifunctional human interface 3010, and the position of the pointer 3021 displayed on the display device 3020 of the electronic device connected to the electronic device with a multifunctional human interface 3010 may be changed and displayed. However, no limitation is imposed thereon.

[0717]

[0718] Next, referring to FIG. 16(b), according to an embodiment, a touch input outside a first touch input area 3011 of an electronic device with a multifunctional human interface 3010 may be obtained from a user.

[0719] For example, as shown in FIG. 16(b), a touch input may be obtained from a user in which the first touch input area 3011 of the electronic device with a multi-function human interface 3010 does not include the touch start point 3041 and the touch end point 3042, but is not limited to this.

[0720] In this specification, the touch start point 3041 may mean a point at which a touch input from a user starts, may mean a point at which a touch input is acquired for the first time within a predetermined period, and may mean a point at which a touch input signal equal to or greater than a specific criterion is generated for the first time. However, without being limited thereto, the touch start point may include a concept that is generally understood as a touch start point.

[0721] Furthermore, in this specification, the touch end point 3042 may mean a point at which a touch input from a user ends, may mean a point at which the last touch input is acquired within a predetermined period of time, and may mean a point at which a touch input signal equal to or greater than a specific criterion is last generated. However, without being limited thereto, the touch end point may include a concept that is generally understood as a touch end point.

[0722] Furthermore, in this specification, the touch input between the touch start point 3041 and the touch end point 3042 may be defined as a touch path, but is not limited thereto.

[0723] Furthermore, in this specification, the outside of the first touch input area 3011 may mean an area not included in the first touch input area 3011, may mean an area included in the keyboard arrangement of the electronic device with a multifunctional human interface 3010 but not included in the first touch input area 3011, and may mean an area included in the touch input area of ​​the electronic device with a multifunctional human interface 3010 but not included in the first touch input area 3011. However, no limitation is imposed thereon.

[0724] Referring again to FIG. 16(b), when a touch input is obtained from a user outside the first touch input area 3011 of the electronic device with a multifunctional human interface 3010, pointer position related information may not be generated.

[0725] For example, according to an embodiment, when a touch input outside the first touch input area 3011 of the electronic device with a multifunctional human interface 3010 is obtained from a user, the pointer position related information is not generated. Therefore, the position of the pointer 3022 displayed on the display device 3020 of the electronic device connected to the electronic device with a multifunctional human interface 3010 may not be changed. However, no limitation is imposed thereon.

[0726] Furthermore, in this specification, the meaning of not generating pointer position related information may include a case where a touch input signal is acquired but the acquired touch input signal is ignored and no pointer position related information is generated, a case where a touch input signal is acquired and the acquired touch input signal is processed but no pointer position related information is generated, or a case where a touch input signal itself is not acquired. However, without being limited thereto, the meaning of not generating pointer position related information may include various examples of not generating pointer position related information.

[0727]

[0728] As in the example described above, when the electronic device 3010 having a multi-function human interface operates in an operational mode in which at least a portion of the touch input area is active, convenience may be provided to a user who primarily uses the active touch input area.

[0729] For example, as described above, when the electronic device having a multi-function human interface 3010 operates in a first operating mode in which the first touch input area 3011 is active, convenience may be provided to a user who primarily uses his or her left hand.

[0730] As a more specific example, when a user who mainly uses his / her left hand is typing using the electronic device with multifunctional human interface 3010 and wants to move a pointer using his / her left hand, the user can move the pointer using his / her left hand without removing and moving his / her right hand from the electronic device with multifunctional human interface 3010. In this case, the user's right hand may be positioned within an external area outside the first touch input area 3011, so that pointer position related information is not generated by touch input by the user's right hand, thus providing convenience to the user.

[0731] This can be understood as providing convenience to a user who mainly uses his / her right hand when the electronic device with multifunctional human interface 3010 operates in the second operation mode in which the second touch input area, which is the area corresponding to the right hand, is active. There are many other ways to provide convenience to a user, without being limited to the examples described above.

[0732] However, the size of the active touch input area may be smaller than the size of the entire touch input area of ​​the electronic device with a multifunctional human interface 3010, and the reduced touch input area may cause inconvenience to the user.

[0733] Therefore, there is a need to develop a technique for providing an active touch input area according to the user and eliminating the inconvenience caused by the reduction in the size of the touch input area.

[0734] This is explained in more detail below.

[0735]

[0736] FIG. 17 is a diagram illustrating the operation modes of an electronic device having a multifunctional human interface and the corresponding operation of the interface device according to an embodiment.

[0737] Referring to FIG. 17, an electronic device 3110 having a multifunction human interface according to an embodiment may include a touch input area and may operate in an operational mode in which at least a portion of the touch input area is active.

[0738] For example, an electronic device 3110 having a multifunctional human interface according to an embodiment may include a touch input area corresponding to at least a part of a keyboard arrangement, and may operate in a first operation mode in which a first touch input area 3111 included in the touch input area is active, although no limitation is imposed thereon.

[0739] In this specification, the details described above may be applied to the touch input area, and therefore redundant descriptions will be omitted.

[0740] 17 is described based on the case of a first operation mode in which a first touch input area 3111 included in the touch input area is active. However, the embodiments of the present disclosure are not limited thereto and may include an embodiment in the case of operation in another operation mode in which a touch input area different from the first touch input area 3111 (e.g., the right touch input area) is active.

[0741] Furthermore, in this specification, the touch input area being active may mean, but is not limited to, that pointer position related information is generated based on a touch input signal about the touch input area being active. The touch input area being active may include a concept that is generally understood to mean that the touch input area is active.

[0742] More specifically, FIG. 17 is a diagram showing a case where, for example, a touch start point 3131 of a user's touch input is positioned within the first touch input area 3111, but a touch end point 3132 of the user's touch input, or at least a portion of the touch path between the touch start point 3131 and the touch end point 3132 of the user's touch input, is positioned outside the first touch input area 3111.

[0743] In this specification, the touch start point 3131 may mean a point at which a touch input from a user starts, may mean a point at which a touch input is acquired for the first time within a predetermined period, and may mean a point at which a touch input signal equal to or greater than a specific criterion is generated for the first time. However, without being limited thereto, the touch start point may include a concept that is generally understood as a touch start point.

[0744] Furthermore, in this specification, the touch end point 3132 may mean a point at which a touch input from a user ends, may mean a point at which the last touch input is acquired within a predetermined period of time, and may mean a point at which a touch input signal equal to or greater than a specific criterion is last generated. However, without being limited thereto, the touch end point may include a concept that is generally understood as a touch end point.

[0745] Furthermore, in this specification, the touch input between the touch start point 3131 and the touch end point 3132 may be defined as a touch path, but is not limited thereto.

[0746] Referring again to FIG. 17 , when a touch start point 3131 of a user's touch input is positioned within the first touch input area 3111, pointer position related information may be generated even if a touch end point 3132 of the user's touch input, or at least a portion of the touch path between the touch start point 3131 and the touch end point 3132 of the user's touch input, is positioned outside the first touch input area 3111.

[0747] For example, according to an embodiment, when a touch start point 3131 by a user's touch input is positioned within the first touch input area 3111, and a touch end point 3132 by the user's touch input, or at least a part of a touch path between the touch start point 3131 and the touch end point 3132 by the user's touch input, is positioned outside the first touch input area 3111, pointer position related information may be generated. The pointer position related information may be transferred to an electronic device connected to the electronic device with a multifunctional human interface 3110. The position of the pointer 3121 displayed on the display device 3120 of the electronic device connected to the electronic device with a multifunctional human interface 3110 may be changed and displayed. However, no limitation is imposed thereon.

[0748] In this specification, the movement path of the pointer 3121 displayed on the display device 3120 may correspond to the touch path between the touch start point 3131 and the touch end point 3132, but is not limited to this.

[0749] Further, in this specification, a touch end point 3132 of a user's touch input, or at least a portion of a touch path between a touch start point 3131 and a touch end point 3132 of a user's touch input, may be positioned outside the first touch input area 3111, but may be positioned within the touch input area of ​​the electronic device with a multifunctional human interface 3110.

[0750]

[0751] FIG. 18 is a flow chart illustrating a method of operating an electronic device having a multifunctional human interface, according to an embodiment.

[0752] Referring to FIG. 18, an operating method 3200 of an electronic device having a multifunctional human interface according to an embodiment may include at least one of the following steps: in step S3210, operating in a first operating mode; in step S3220, acquiring touch input from a user; in step S3230, generating pointer position related information when a touch starting point due to the touch input acquired from the user is included in a first touch input area; and, in step S3240, not generating pointer position related information when a touch starting point due to the touch input acquired from the user is not included in the first touch input area.

[0753] In this specification, the details described above may be applied to an electronic device having a multi-function human interface, so redundant descriptions will be omitted.

[0754] Further, in the step S3210 of operating in a first operation mode according to the embodiment, the first operation mode may be an operation mode in which at least a part of the touch input area of ​​the electronic device having a multifunctional human interface is active.

[0755] For example, in step S3210 of operating in a first operating mode according to an embodiment, the first operating mode may be, but is not limited to, an operating mode in which a first touch input area included in a touch input area of ​​an electronic device having a multifunction human interface is active.

[0756] Further, in the step S3220 of obtaining touch input from a user according to an embodiment, the touch input from the user may mean, but is not limited to, touch input to at least a portion of a plurality of keycaps included in an electronic device having a multi-function human interface.

[0757] Further, in the step S3220 of obtaining touch input from a user according to an embodiment, the touch input from the user may mean, but is not limited to, an input from the user for generating a touch input signal on at least a portion of an electrode layer included in an electronic device having a multifunction human interface.

[0758] Furthermore, in the step S3230 of generating pointer position related information when a touch start point by a touch input acquired from a user is included in the first touch input area according to the embodiment, the touch start point may mean a point at which a touch input from a user starts, may mean a point at which a touch input is acquired for the first time within a predetermined period, and may mean a point at which a touch input signal equal to or greater than a specific criterion is generated for the first time. However, without being limited thereto, the touch start point may include a concept that is generally understood as a touch start point.

[0759] Further, in the embodiment, in step S3230 of generating pointer position related information when the touch starting point by the touch input obtained from the user is included in the first touch input area, the first touch input area may mean at least a portion of the touch input area that is active in the first operating mode.

[0760] Further, in the step S3230 of generating pointer position related information when the touch starting point by the touch input obtained from the user is included in the first touch input area according to the embodiment, the pointer position related information may be, but is not limited to, information regarding the position of the pointer of an electronic device connected to an electronic device having a multi-function human interface.

[0761] Furthermore, in the step S3230 of generating pointer position related information when the touch starting point by the touch input obtained from the user is included in the first touch input area according to the embodiment, the pointer position related information may be transferred to an electronic device connected to the electronic device having a multifunctional human interface. Therefore, the position of the pointer displayed on the display device of the electronic device connected to the electronic device having a multifunctional human interface may be changed and displayed. However, no limitation is imposed thereon.

[0762] Furthermore, in the step S3240 of not generating pointer position related information when the touch starting point due to the touch input obtained from the user is not included in the first touch input area according to the embodiment, not generating pointer position related information may be understood to include various cases, such as a case where a touch input signal due to the user's touch input is not generated, and a case where a touch input signal is generated but pointer position related information is not generated based on the touch input signal.

[0763]

[0764] FIG. 19 is a flow chart illustrating a method of operating an electronic device having a multifunctional human interface, according to an embodiment.

[0765] Referring to FIG. 19, an operating method 3300 of an electronic device having a multifunctional human interface according to an embodiment may include at least one of the following steps: in step S3310, operating in a first operating mode; in step S3320, acquiring touch input from a user; in step S3330, generating pointer position related information if a touch starting point by the touch input acquired from the user is included in a first touch input area; in step S3340, not generating pointer position related information if a touch starting point by the touch input acquired from the user is not included in the first touch input area; in step S3350, acquiring touch input to a predetermined area from the user; and in step S3360, operating in a third operating mode.

[0766] In this specification, the details described above may be applied to an electronic device having a multi-function human interface, so redundant descriptions will be omitted.

[0767] Furthermore, the details described above may apply to step S3310 of operating in the first operation mode according to the embodiment, and therefore redundant descriptions will be omitted.

[0768] Furthermore, the details described above may apply to the step S3320 of obtaining touch input from a user according to an embodiment, and therefore redundant description will be omitted.

[0769] Furthermore, the details described above may be applied to step S3330 of generating pointer position related information when the touch starting point by the touch input obtained from the user is included in the first touch input area according to the embodiment, and therefore redundant description will be omitted.

[0770] Furthermore, the details described above may be applied to step S3340 of not generating pointer position related information when the touch starting point of the touch input obtained from the user is not included in the first touch input area according to an embodiment, and therefore redundant description will be omitted.

[0771] Further, in the step S3350 of obtaining a touch input from a user to a predetermined area according to the embodiment, the predetermined area may be a predetermined area for changing an operation mode of the electronic device having a multifunctional human interface.

[0772] For example, in step S3350 of obtaining touch input from a user to a predetermined area according to an embodiment, the predetermined area may be, but is not limited to, a predetermined area for changing the touch input area of ​​an electronic device having a multi-function human interface.

[0773] Further, in the step S3350 of obtaining a touch input from a user to a predetermined area according to an embodiment, the predetermined area may be, but is not limited to, an area included in the first touch input area.

[0774] For example, in the step S3350 of obtaining a touch input from a user to a predetermined area according to an embodiment, the predetermined area may be, but is not limited to, a specific area included in the first touch input area.

[0775] Further, for example, in step S3350 of obtaining touch input from a user to a predetermined area according to an embodiment, the predetermined area may be an area proximate to a boundary of the first touch input area.

[0776] For example, in step S3350 of obtaining touch input from a user to a predetermined area according to an embodiment, the predetermined area may be, but is not limited to, an area including at least a portion of the boundary of the first touch input area.

[0777] Further, in the step S3350 of obtaining touch input from a user to a predetermined area according to the embodiment, the predetermined area may be an area proximate to a center of the touch input area of ​​the electronic device with a multifunctional human interface.

[0778] For example, in step S3350 of obtaining touch input from a user to a predetermined area according to an embodiment, the predetermined area may be, but is not limited to, an area including the center of the touch input area of ​​an electronic device having a multifunctional human interface.

[0779] Further, in the step S3350 of obtaining touch input from a user to a predetermined area according to an embodiment, the direction in which the center of the predetermined area is positioned from the center of the first touch input area may be different from the direction in which the center of the first touch input area is positioned from the center of the touch input area of ​​the electronic device having a multifunction human interface.

[0780] For example, in the step S3350 of obtaining a touch input from a user to a predetermined region according to an embodiment, if the center of the first touch input region is positioned to the left of the center of the touch input region of the electronic device having a multifunctional human interface, the center of the predetermined region may be positioned to the right of the center of the first touch input region, but no limitation is imposed thereon.

[0781] Further, in the step S3350 of obtaining touch input from a user to a predetermined area according to an embodiment, the predetermined area may be an area overlapping at least one of the keycaps corresponding to key G or the keycap corresponding to key H.

[0782] Further, in the step S3350 of obtaining touch input from a user to a predetermined area according to an embodiment, the predetermined area designed as in the embodiment described above may be for mechanically detecting the user's intention to use a large touch input area, but is not limited thereto.

[0783] Further, in the step S3350 of obtaining a touch input to a predetermined area from a user according to an embodiment, the touch input to the predetermined area may refer to, but is not limited to, a touch input corresponding to a touch path of a touch starting from a touch start point or a touch input corresponding to a touch end point.

[0784] Furthermore, in the step S3350 of acquiring a touch input to a predetermined area from a user according to the embodiment, if the touch start point of the touch input to the predetermined area is positioned within the first touch input area, an operation in the third operation mode is performed. Conversely, if the touch start point of the touch input to the predetermined area is not positioned within the first touch input area, an operation in the third operation mode may not be performed. However, no limitation is imposed thereon.

[0785] Further, in step S3350 of obtaining touch input from a user to a predetermined area according to an embodiment, the predetermined area may change according to an operation mode.

[0786] For example, in the step S3350 of obtaining a touch input from a user to a predetermined area according to an embodiment, when the electronic device with a multifunctional human interface operates in a first operation mode, the predetermined area may be a first area, and when the electronic device with a multifunctional human interface operates in a second operation mode, the predetermined area may be a second area, although no limitation is imposed thereon.

[0787] Further, for example, in step S3350 of obtaining a touch input to a predetermined area from a user according to an embodiment, the predetermined area may be a first area when the electronic device with a multifunctional human interface operates in a left-hand mode, and the predetermined area may be a second area when the electronic device with a multifunctional human interface operates in a right-hand mode, but no limitation is imposed thereon.

[0788] Further, in step S3360 of operating in a third operational mode according to an embodiment, the third operational mode may be an operational mode in which a different touch input area is active than the touch input area active in the first operational mode.

[0789] For example, in step S3360 of operating in a third operating mode according to an embodiment, the third operating mode may be, but is not limited to, an operating mode in which a second touch input area, which includes a first touch input area and is larger than the first touch input area, is active.

[0790] Further, for example, in step S3360 of operating in a third operating mode according to an embodiment, the third operating mode may be, but is not limited to, an operating mode in which a second touch input area that at least partially overlaps with the first touch input area and is different from the first touch input area is active.

[0791] Further, for example, in step S3360 of operating in a third operating mode according to an embodiment, the third operating mode may be, but is not limited to, an operating mode in which a second touch input area different from the first touch input area is active.

[0792] Further, for example, in step S3360 of operating in a third operating mode according to an embodiment, the third operating mode may be, but is not limited to, an operating mode in which the entire touch input area of ​​the electronic device having a multi-function human interface is active.

[0793] Furthermore, in step S3360 of operating in the third operation mode according to the embodiment, pointer position related information may be generated even if the touch path starting from the touch start point or the touch end point is not included in the first touch input area.

[0794] Furthermore, in step S3360 of operating in the third operation mode according to the embodiment, pointer position related information may be generated even if the touch input acquired from the user is not included in the first touch input region.

[0795] Furthermore, in the step S3360 of operating in the third operation mode according to the embodiment, if no touch input is obtained from the user for a certain time interval or longer, the electronic device with a multifunctional human interface may return to operate in the first operation mode, although no limitation is imposed thereon.

[0796] Further, according to the operation method 3300 of the electronic device having a multifunctional human interface according to the embodiment, the electronic device having a multifunctional human interface may operate in a left-hand mode. In the left-hand mode, the left touch input area may be activated. If the touch start point of the touch input obtained from the user is not included in the left touch input area, the pointer position related information may not be generated. If the touch start point of the touch input obtained from the user is included in the left touch input area, the pointer position related information may be generated. If the user slides to the right from the touch start point and at least a part of the touch path is included in a predetermined area, a switch to a full mode may be performed and an operation in the full mode may be performed. In the full mode, the entire touch input area may be activated. Even if the user leaves the left touch input area and slides to the right, the pointer position related information may be generated.

[0797] Further, according to the operation method 3300 of the electronic device having a multifunctional human interface according to the embodiment, the electronic device having a multifunctional human interface may operate in a right-hand mode. In the right-hand mode, the right touch input area may be activated. If the touch start point of the touch input obtained from the user is not included in the right touch input area, the pointer position related information may not be generated. If the touch start point of the touch input obtained from the user is included in the right touch input area, the pointer position related information may be generated. If the user slides left from the touch start point and at least a part of the touch path is included in a predetermined area, a switch to a full mode may be performed and an operation in the full mode may be performed. In the full mode, the entire touch input area may be activated. Even if the user leaves the right touch input area and slides left, the pointer position related information may be generated.

[0798]

[0799] FIG. 20 is a flow chart illustrating a method of operating an electronic device having a multifunctional human interface, according to an embodiment.

[0800] Referring to FIG. 20 , an operating method 3400 of an electronic device having a multifunctional human interface according to an embodiment may include at least one of the following steps: in step S3410, operating in a first operating mode; in step S3420, acquiring touch input from a user; in step S3430, operating in a third operating mode and generating pointer position related information if a touch starting point due to the touch input acquired from the user is included in the first touch input area; and in step S3440, not generating pointer position related information if a touch starting point due to the touch input acquired from the user is not included in the first touch input area.

[0801] In this specification, the details described above may be applied to an electronic device having a multi-function human interface, so redundant descriptions will be omitted.

[0802] Furthermore, the details described above may apply to step S3410 of operating in the first operation mode according to the embodiment, and therefore redundant descriptions will be omitted.

[0803] Furthermore, the details described above may apply to the step S3420 of obtaining touch input from a user according to an embodiment, and therefore redundant descriptions will be omitted.

[0804] Furthermore, the details described above may be applied to step S3440 of not generating pointer position related information when the touch starting point of the touch input obtained from the user is not included in the first touch input area according to an embodiment, and therefore redundant description will be omitted.

[0805] Furthermore, in the step S3430 of operating in a third operating mode and generating pointer position related information when the touch starting point of the touch input obtained from the user is included in the first touch input area according to the embodiment, the details described above may be applied to the third operating mode, and therefore redundant description will be omitted.

[0806] Further, in the step S3430 of operating in a third operating mode and generating pointer position related information when a touch starting point by a touch input obtained from a user is included in a first touch input area according to an embodiment, the details described above may be applied to the touch starting point and the first touch input area, and therefore redundant description will be omitted.

[0807] Further, in the embodiment, when the touch starting point of the touch input obtained from the user is included in the first touch input area, in step S3430 of operating in the third operating mode and generating pointer position related information, the details described above may be applied to the step of generating pointer position related information, and therefore redundant description will be omitted.

[0808] Further, according to the operation method 3400 of the electronic device having a multifunctional human interface according to the embodiment, the electronic device having a multifunctional human interface may operate in a left-hand mode. In the left-hand mode, the left touch input area may be activated. If the touch start point of the touch input obtained from the user is not included in the left touch input area, the pointer position related information may not be generated. If the touch start point of the touch input obtained from the user is included in the left touch input area, the switch to the full mode may be performed, the operation in the full mode may be performed, and the pointer position related information may be generated. In the full mode, the entire touch input area may be activated. Even if the user leaves the left touch input area and slides to the right, the pointer position related information may be generated.

[0809] Further, according to the operation method 3400 of the electronic device having a multifunctional human interface according to the embodiment, the electronic device having a multifunctional human interface may operate in a right-hand mode. In the right-hand mode, the right touch input area may be activated. If the touch start point of the touch input obtained from the user is not included in the right touch input area, the pointer position related information may not be generated. If the touch start point of the touch input obtained from the user is included in the right touch input area, the switch to the full mode may be performed, the operation in the full mode may be performed, and the pointer position related information may be generated. In the full mode, the entire touch input area may be activated. Even if the user leaves the right touch input area and slides to the left, the pointer position related information may be generated.

[0810]

[0811] In the following, various extensible embodiments of the method for operating an electronic device with a multifunctional human interface according to the various embodiments described with reference to Figures 1 to 20 are explained in more detail.

[0812]

[0813] A method of operating an electronic device having a multi-function human interface according to an embodiment may include changing the operation mode of the electronic device having a multi-function human interface from a second operation mode (full mode) to a first operation mode (first touch input area mode) when at least one cancellation condition is met during operation in the second operation mode (full mode).

[0814] In this specification, at least one cancellation condition may include a time-related condition, and if the electronic device having a multi-functional human interface does not receive touch input from a user for a certain period of time or longer while operating in the second operating mode, the operating mode of the electronic device having a multi-functional human interface may be changed from the second operating mode to the first operating mode.

[0815] Further, in this specification, the electronic device having a multi-function human interface may be equipped with a plurality of key caps, and at least one cancellation condition may include a condition related to key input, and when the electronic device having a multi-function human interface acquires a key input signal corresponding to a first key cap included in the plurality of key caps while operating in the second operating mode, the operating mode of the electronic device having a multi-function human interface may be changed from the second operating mode to the key input operating mode.

[0816] Further, in this specification, when an electronic device having a multi-function human interface acquires a key input signal corresponding to a second key cap included in the plurality of key caps while operating in a second operating mode, the operating mode of the electronic device having a multi-function human interface may remain in the second operating mode.

[0817] Further, in this specification, while operating in a second operating mode, the electronic device having a multi-function human interface obtains a key input signal corresponding to a first keycap included in the plurality of keycaps, and the operating mode of the electronic device having a multi-function human interface is changed from the second operating mode to the key input operating mode, and then, when a touch input is obtained from a user, the operating mode of the electronic device having a multi-function human interface may be changed from the key input operating mode to the first operating mode.

[0818] Further, in this specification, the at least one cancellation condition may include a condition related to touch input, and when the electronic device having a multi-function human interface obtains touch input for a predetermined number of touch points from a user while operating in the second operating mode, the operating mode of the electronic device having a multi-function human interface may be changed from the second operating mode to the first operating mode.

[0819] Furthermore, in this specification, touch input to a predetermined number of touch points may include touch input to four touch points.

[0820] Further, in this specification, at least one cancellation condition may include a condition related to touch input, and when the electronic device having a multi-function human interface obtains touch input to a specific area from a user while operating in the second operating mode, the operating mode of the electronic device having a multi-function human interface may be changed from the second operating mode to the first operating mode.

[0821] Further, in this specification, when the electronic device having a multi-function human interface obtains touch input from a user for four touch points for a specific area while operating in a second operating mode, the operating mode of the electronic device having a multi-function human interface may be changed from the second operating mode to the first operating mode.

[0822] Further, in this specification, the at least one cancellation condition may include a condition related to a power mode, and if the electronic device having a multi-function human interface is powered off while operating in the second operating mode and then powered on again, the electronic device having a multi-function human interface may operate in the first operating mode.

[0823]

[0824] Further, according to an embodiment of a method for operating an electronic device having a multi-function human interface, the operation mode of the electronic device having a multi-function human interface may be changed from a first operation mode to a second operation mode, and then may remain in the second operation mode.

[0825] For example, when a touch input in which a touch start point is included in a first touch input area and a touch end point or at least a part of a touch path is included in an external area (not included in the first touch input area but at least a part of an area included in the touch input area) is acquired from a user, and then an additional touch input in which a touch start point is included in the external area is acquired, the pointer position related information may be generated based on the additional touch input acquired from the user, but no limitation is imposed thereon.

[0826]

[0827] Furthermore, according to the operating method of an electronic device having a multi-function human interface according to an embodiment, when a touch starting point is obtained from a user in an area that is not included in the first touch input area but is included in the touch input area, pointer position related information does not need to be generated, but various functions related to the touch may be performed.

[0828] For example, if the touch input acquired from the user is included in an external region outside the first touch input region and is a touch input related to a predetermined gesture, a function related to the predetermined gesture may be generated, but no limitation is imposed thereon.

[0829] In this specification, the predetermined gesture may refer to the number of touch points and the direction of the touch, and may include a 2-point touch, a 3-point touch, a 4-point touch, a 5-point touch, a 2-point slide, a 2-point left slide, a 2-point right slide, a 2-point upward slide, a 2-point downward slide, a 3-point slide, a 3-point left slide, a 3-point right slide, a 3-point upward slide, a 3-point downward slide, a 4-point slide, a 4-point left slide, a 4-point right slide, a 4-point upward slide, a 4-point downward slide, a 5-point slide, a 5-point left slide, a 5-point right slide, a 5-point upward slide, and a 5-point downward slide, but no limitations are imposed thereon.

[0830] Further, in this specification, the function related to the predetermined gesture may include, but is not limited to, at least one of the functions of scrolling, zooming, and screen swapping. The function related to the predetermined gesture may include various functions that are generally understood as functions by touch gestures.

[0831] Furthermore, for example, when the touch input obtained from the user is included in an external region outside the first touch input region, adjustment information for adjusting the attribute value of the adjustment target attribute may be generated, but no limitation is imposed thereon.

[0832] In this specification, the attribute value of the attribute to be adjusted may refer to a volume-related attribute value and a playback-related attribute value, but may include various concepts that are generally understood as attribute values.

[0833] Furthermore, for example, when the touch input obtained from the user is included in an external region outside the first touch input region and is a touch input by one touch point, a key value corresponding to an arrow may be generated according to the sliding direction of the touch input, but no limitation is imposed thereon.

[0834] As a more specific example, if the touch input obtained from the user is included in an external area outside the first touch input area and is a touch input by one touch point, if the sliding direction of the touch input is right, a key value corresponding to a right arrow may be generated, or if the sliding direction is left, a key value corresponding to a left arrow may be generated, or if the sliding direction is upward, a key value corresponding to an upward arrow may be generated, or if the sliding direction is downward, a key value corresponding to a downward arrow may be generated, but no limitation is imposed thereon.

[0835] Furthermore, for example, when the touch input obtained from the user is included in an external region outside the first touch input region and is a touch input by two touch points, a key value corresponding to a combination key may be generated according to the sliding direction of the touch input, but no limitation is imposed thereon.

[0836] As a more specific example, when the touch input obtained from the user is included in an external area outside the first touch input area and is a touch input by two touch points, if the sliding direction of the touch input is right, a combination key input including a key value corresponding to the control and a key value corresponding to a right arrow may be generated, or if the sliding direction is left, a combination key input including a key value corresponding to the control and a key value corresponding to a left arrow may be generated, or if the sliding direction is upward, a combination key input including a key value corresponding to the control and a key value corresponding to an up arrow may be generated, or if the sliding direction is downward, a combination key input including a key value corresponding to the control and a key value corresponding to a down arrow may be generated. However, no limitation is imposed thereon.

[0837] Furthermore, for example, when the touch input obtained from the user is included in an external region outside the first touch input region and is a touch input by three touch points, a key value corresponding to a combination key may be generated according to the sliding direction of the touch input, but no limitation is imposed thereon.

[0838] As a more specific example, when the touch input obtained from the user is included in an external area outside the first touch input area and is a touch input by three touch points, if the sliding direction of the touch input is right, a combination key input including a key value corresponding to the control and a key value corresponding to a down arrow may be generated, or if the sliding direction is left, a combination key input including a key value corresponding to the control and a key value corresponding to an up arrow may be generated, but no limitation is imposed thereon.

[0839] This may be set so that when the slide direction is right, a combination key that moves the cursor to a lower paragraph in the Word file may be output, or when the slide direction is left, a combination key that moves the cursor to a higher paragraph in the Word file may be output, but no limitation is imposed thereon.

[0840] Furthermore, for example, when the touch input obtained from the user is included in an external area outside the first touch input area and is a touch input by four touch points, a key value corresponding to a function key may be generated according to the sliding direction of the touch input, but no limitation is imposed thereon.

[0841] As a more specific example, when the touch input obtained from the user is included in an external area outside the first touch input area and is a touch input by four touch points, if the sliding direction of the touch input is right, a function key value corresponding to page down may be generated, or if the sliding direction is left, a function key value corresponding to page up may be generated, but no limitation is imposed thereon.

[0842] Furthermore, the example described above is merely one of various embodiments, and any suitable combination of the examples described above is also included in the technical spirit of the present disclosure.

[0843]

[0844] Furthermore, an action by a user's touch input to an area included in an external area outside the first touch input area can be understood as an action by a user's touch input to an area within the first touch input area involving a specific key input.

[0845] For example, when a user touch input to a region within the first touch input region is obtained while a function key is being pressed, a key value corresponding to an arrow may be generated according to the sliding direction of the touch input, although no limitation is imposed thereon.

[0846] Furthermore, although only one example is described for ease of explanation, the various examples described above may be applied to operations based on a user's touch input to an area within the first touch input area using a specific key input.

[0847]

[0848] Furthermore, according to the operating method of the electronic device having a multifunctional human interface according to the embodiment, when the touch path of the touch input acquired from the user is included in an external area outside the first touch input area after the touch starting point of the touch input acquired from the user is included in the first touch input area, a second touch input area different from the first touch input area may be activated. When at least a part of the touch path of the touch input acquired from the user is again included in the first touch input area, the first touch input area may be activated.

[0849]

[0850] Further, according to the operating method of the electronic device with a multifunctional human interface according to the embodiment, the electronic device with a multifunctional human interface may include a second touch input area. When the touch start point of the touch input acquired from the user is included in the second touch input area, information related to adjustment of the attribute value of the attribute to be adjusted may be generated. When the touch start point of the touch input acquired from the user is included in the first touch input area and the touch end point or at least a part of the touch path is included in the second touch input area, pointer position related information may be generated. When the touch start point of the touch input acquired from the user is included in an external area (third area) outside the first touch input area and the touch end point or at least a part of the touch path is included in the second touch input area, information related to adjustment of the attribute value of the attribute to be adjusted may be generated.

[0851] That is, an electronic device with a multifunctional human interface may have an active area and an inactive area according to an operation mode, and may have an area for adjusting an attribute value. In a scenario according to an embodiment, the first touch input area may be an active area, the outer area may be an inactive area, and the second touch input area is an area for adjusting an attribute value. It can be understood that when a touch input starting from the first touch input area extends to the outer area or the second touch input area (meaning that the touch end point or at least a part of the touch path extends to the area), the pointer position related information may be continuously generated, the touch input starting from the second touch input area may function to adjust the attribute value, and the touch input starting from the outer area and extending to the second touch input area may function to adjust the attribute value.

[0852]

[0853] Further, according to an embodiment of a method for operating an electronic device having a multi-function human interface, when a touch input is obtained to an external area outside the first touch input area while operating in a first operating mode.

[0854]

[0855] In the following, usage scenarios of an electronic device with a multifunctional human interface according to an embodiment and the corresponding operation of the electronic device with a multifunctional human interface are described in detail.

[0856]

[0857] FIG. 21 illustrates a scenario of use of an electronic device with a multifunctional human interface according to an embodiment.

[0858] Referring to FIG. 21, a user 3510, an electronic device with a multi-function human interface 3520, a display device 3530, and a virtual reality device 3540 are shown to illustrate a scenario 3500 of use of an electronic device with a multi-function human interface according to an embodiment.

[0859] A scenario 3500 of use of an electronic device with a multifunctional human interface according to an embodiment may be a scenario in which a user 3510 uses both an electronic device with a multifunctional human interface 3520 and a virtual reality device 3540 .

[0860] More specifically, a scenario 3500 of use of an electronic device having a multi-function human interface according to an embodiment may be, but is not limited to, a scenario in which a user 3510 is working at a desk and using an electronic device having a multi-function human interface 3520 as an interface device and a virtual reality device 3540.

[0861] In this specification, the above-described details of the electronic device with a multifunctional human interface may be applied to the electronic device with a multifunctional human interface 3520 according to the embodiment, but no limitation is imposed thereon. For the connected electronic device, various examples of interface devices may be applied.

[0862] Further, in this specification, the display device 3530 according to an embodiment may refer to, but is not limited to, a computer monitor, and may include various display devices capable of displaying various types of information.

[0863] Further, in this specification, examples of virtual reality devices 3540 according to embodiments may include, but are not limited to, virtual reality (VR) devices, augmented reality (AR) devices, mixed reality (MR) devices, and extended reality (XR) devices.

[0864] Further, according to a scenario 3500 of use of an electronic device with a multifunctional human interface according to an embodiment, the virtual reality device 3540 may display an image 3550 corresponding to the surroundings of the user's 3510 field of view.

[0865] For example, according to a scenario 3500 of use of an electronic device with a multi-functional human interface according to an embodiment, the virtual reality device 3540 may display, but is not limited to, display images 3551 and 3552 corresponding to the electronic device with a multi-functional human interface 3520 and the display device 3530, which are included within the periphery of the user's 3510's field of view.

[0866] Further, according to a scenario 3500 of use of an electronic device having a multi-function human interface according to an embodiment, a virtual reality device 3540 may be connected to the main processor and may display images obtained from the main processor.

[0867] Further, according to the usage scenario 3500 of an electronic device having a multi-function human interface according to an embodiment, the virtual reality device 3540 may include a main processor and may generate and display various types of information.

[0868] Further, according to the scenario 3500 of use of the electronic device with a multifunctional human interface according to an embodiment, the virtual reality device 3540 may obtain at least one piece of information from the electronic device with a multifunctional human interface 3520.

[0869] For example, according to a scenario 3500 of using an electronic device with a multi-function human interface according to an embodiment, the virtual reality device 3540 may obtain a key input signal from the electronic device with a multi-function human interface 3520, but is not limited to this.

[0870] Further, for example, according to a scenario 3500 of using an electronic device with a multi-function human interface according to an embodiment, the virtual reality device 3540 may obtain key input values ​​from the electronic device with a multi-function human interface 3520, but is not limited to this.

[0871] Further, for example, according to a scenario 3500 of using an electronic device with a multi-function human interface according to an embodiment, the virtual reality device 3540 may acquire a touch input signal from the electronic device with a multi-function human interface 3520, but is not limited to this.

[0872] Further, for example, according to a scenario 3500 of using an electronic device with a multi-function human interface according to an embodiment, the virtual reality device 3540 may obtain pointer position related information from the electronic device with a multi-function human interface 3520, but is not limited to this.

[0873] Further, for example, according to a scenario 3500 of using an electronic device with a multi-function human interface according to an embodiment, the virtual reality device 3540 may obtain at least one coordinate value from the electronic device with a multi-function human interface 3520, but is not limited to this.

[0874] Further, for example, according to a scenario 3500 of using an electronic device with a multi-function human interface according to an embodiment, the virtual reality device 3540 may obtain information regarding the operating mode from the electronic device with a multi-function human interface 3520, but is not limited to this.

[0875] Further, for example, according to a scenario 3500 of use of an electronic device with a multi-function human interface according to an embodiment, the virtual reality device 3540 may obtain information regarding the power mode from the electronic device with a multi-function human interface 3520, but is not limited to this.

[0876]

[0877] In the following, the operation of an electronic device with a multifunctional human interface is described based on an image 3550 displayed on a virtual reality device 3540 according to an embodiment.

[0878]

[0879] 22 and 23 are diagrams illustrating screens displayed through a virtual reality device according to user input, according to an embodiment.

[0880] Referring to FIG. 22, a screen 3600 displayed through a virtual reality device according to an embodiment may include at least one of the following images: an image 3610 corresponding to an electronic device having a multi-function human interface, an image 3620 corresponding to a display device, and an image 3630 corresponding to a user's hand.

[0881] An image 3610 corresponding to an electronic device having a multifunctional human interface according to an embodiment may be modified at least in part according to user input.

[0882] For example, for an electronic device having a multi-function human interface, when a key input is obtained from a user, the image of the area corresponding to the key input obtained from the user, included in image 3610 corresponding to the electronic device having a multi-function human interface according to the embodiment, may be changed, but is not limited to this.

[0883] Furthermore, for example, when a key input signal is acquired from an electronic device having a multi-function human interface, an image of an area corresponding to the position where the key input signal was generated, included in image 3610 corresponding to the electronic device having a multi-function human interface according to the embodiment, may be changed, but is not limited to this.

[0884] Furthermore, for example, when a key input value is obtained from an electronic device having a multi-function human interface, the image of the area corresponding to the key input value included in the image 3610 corresponding to the electronic device having a multi-function human interface according to the embodiment may be changed, but is not limited to this.

[0885] Furthermore, at least partially modifying the image 3610 corresponding to an electronic device having a multifunctional human interface according to an embodiment may include various modifications.

[0886] For example, at least partially modifying the image 3610 corresponding to the electronic device with multifunctional human interface according to an embodiment may include, but is not limited to, changing the color of the corresponding region.

[0887] Further, for example, at least partially modifying the image 3610 corresponding to an electronic device having a multifunctional human interface according to an embodiment may include, but is not limited to, outputting a highlight mark in the corresponding region.

[0888] Further, at least partially modifying the image 3610 corresponding to an electronic device having a multifunctional human interface according to an embodiment may include outputting various visual effects for the corresponding region in addition to the examples described above.

[0889] Furthermore, at least partially modifying the image 3610 corresponding to the electronic device with a multifunctional human interface according to an embodiment may be maintained for a certain period of time.

[0890] For example, but not limited to, at least partially modifying the image 3610 corresponding to an electronic device having a multifunctional human interface according to an embodiment may be maintained for a first period of time.

[0891] Further, to at least partially modify the image 3610 corresponding to the electronic device with a multifunctional human interface according to an embodiment, the electronic device with a multifunctional human interface may transmit various types of information.

[0892] For example, but not limited to, an electronic device with a multi-function human interface may send a key input signal to at least partially change an image 3610 corresponding to the electronic device with a multi-function human interface according to an embodiment.

[0893] Further, for example, to at least partially modify an image 3610 corresponding to an electronic device with a multifunctional human interface according to an embodiment, the electronic device with a multifunctional human interface may transmit a key input signal and coordinate values ​​at which the key input signal was generated, but is not limited to this.

[0894] Further, for example, to at least partially change the image 3610 corresponding to an electronic device with a multi-function human interface according to an embodiment, the electronic device with a multi-function human interface may transmit keycap information corresponding to the location where the key input signal was generated, but is not limited to this.

[0895] Further, for example, but not limited to, in order to at least partially modify the image 3610 corresponding to the electronic device with a multifunctional human interface according to the embodiment, the electronic device with a multifunctional human interface may transmit a key value generated based on a key input signal.

[0896] Further, for example, to at least partially modify an image 3610 corresponding to an electronic device with a multifunctional human interface according to an embodiment, the electronic device with a multifunctional human interface may transmit a key value generated based on a key input signal and a coordinate value corresponding to the key value, but is not limited to this.

[0897] Additionally, an image 3620 corresponding to a display device according to an embodiment may be altered, at least in part, according to user input.

[0898] For example, when a key input is obtained from a user on an electronic device having a multi-function human interface, text corresponding to the key input obtained from the user may be output to an image 3620 corresponding to a display device according to an embodiment, but is not limited to this.

[0899] Furthermore, for example, when a key input signal is obtained from an electronic device having a multi-function human interface, text corresponding to the key input signal may be output to an image 3620 corresponding to a display device according to an embodiment, but is not limited thereto.

[0900] Furthermore, for example, when a key input value is obtained from an electronic device having a multi-function human interface, text corresponding to the key input value may be output to an image 3620 corresponding to a display device according to an embodiment, but is not limited thereto.

[0901] Additionally, the key inputs described above may be referred to as, but are not limited to, press inputs, key inputs, depression inputs, and text inputs.

[0902]

[0903] Referring to FIG. 23, a screen 3700 displayed through a virtual reality device in accordance with an embodiment may include at least one of the following images: an image 3710 corresponding to an electronic device having a multifunction human interface, an image 3720 corresponding to a display device, and an image 3730 corresponding to a user's hand.

[0904] An image 3710 corresponding to an electronic device having a multifunctional human interface according to an embodiment may be modified at least in part according to user input.

[0905] For example, when a touch input is obtained from a user on an electronic device having a multi-function human interface, the image of the area corresponding to the touch input obtained from the user included in image 3710 corresponding to an electronic device having a multi-function human interface according to an embodiment may be changed, but is not limited to this.

[0906] Furthermore, for example, when a touch input is acquired from a user on an electronic device having a multifunctional human interface, an image of an area corresponding to the touch start point and touch end point of the touch input acquired from the user, and the touch path from the touch start point to the touch end point, included in image 3710 corresponding to an electronic device having a multifunctional human interface according to an embodiment, may be changed, but is not limited to this.

[0907] Furthermore, for example, when a touch input signal is acquired from an electronic device having a multi-function human interface, an image of an area corresponding to the position where the touch input signal was generated, included in image 3710 corresponding to an electronic device having a multi-function human interface according to an embodiment, may be changed, but is not limited to this.

[0908] Furthermore, for example, when a touch input coordinate value is acquired from an electronic device having a multi-function human interface, an image of an area corresponding to the touch input coordinate value included in image 3710 corresponding to an electronic device having a multi-function human interface according to an embodiment may be changed, but is not limited to this.

[0909] Furthermore, at least partially modifying the image 3710 corresponding to an electronic device having a multifunctional human interface according to an embodiment may include various modifications.

[0910] For example, at least partially modifying the image 3710 corresponding to an electronic device with a multifunctional human interface according to an embodiment may include, but is not limited to, changing the color of the corresponding region.

[0911] Further, for example, at least partially modifying the image 3710 corresponding to an electronic device having a multifunctional human interface according to an embodiment may include, but is not limited to, outputting a highlight mark in the corresponding region.

[0912] Further, at least partially modifying the image 3710 corresponding to an electronic device having a multifunctional human interface according to an embodiment may include outputting various visual effects for the corresponding region, in addition to the examples described above.

[0913] Further, for example, at least partially modifying the image 3710 corresponding to an electronic device having a multifunctional human interface according to an embodiment may be maintained for a certain period of time.

[0914] For example, but not limited to, the at least partially altering image 3710 corresponding to an electronic device having a multifunction human interface according to an embodiment may be maintained for a second period of time.

[0915] Further, to at least partially modify the image 3710 corresponding to the electronic device with a multifunctional human interface according to an embodiment, the electronic device with a multifunctional human interface may transmit various types of information.

[0916] For example, but not limited to, an electronic device with a multifunctional human interface may send a touch input signal to at least partially modify an image 3710 corresponding to the electronic device with a multifunctional human interface according to an embodiment.

[0917] Further, for example, but not limited to, to at least partially modify an image 3710 corresponding to an electronic device with a multifunctional human interface according to an embodiment, the electronic device with a multifunctional human interface may transmit a touch input signal and coordinate values ​​at which the touch input signal was generated.

[0918] Further, for example, but not limited to, to at least partially modify the image 3710 corresponding to an electronic device with a multifunctional human interface according to an embodiment, the electronic device with a multifunctional human interface may transmit keycap information corresponding to the location where the touch input signal was generated.

[0919] Additionally, an image 3720 corresponding to a display device according to an embodiment may be altered, at least in part, according to user input.

[0920] Furthermore, for example, when a touch input is obtained from a user on an electronic device having a multifunctional human interface, the position of a pointer displayed in an image 3720 corresponding to a display device according to an embodiment may be changed, but is not limited to this.

[0921] Furthermore, for example, when a touch input signal is obtained from an electronic device having a multifunction human interface, the position of the pointer displayed in the image 3720 corresponding to the display device according to the embodiment may be changed, but is not limited to this.

[0922] Furthermore, for example, when touch input coordinate values ​​are acquired from an electronic device having a multifunction human interface, the position of the pointer displayed in the image 3720 corresponding to the display device according to the embodiment may be changed, but is not limited to this.

[0923] Furthermore, the touch inputs described above may be referred to as, but are not limited to, touch inputs and sliding touch inputs.

[0924]

[0925] Further, with reference to FIGS. 22 and 23, images 3610, 3710 corresponding to electronic devices with multifunctional human interfaces according to embodiments may be modified differently according to user input.

[0926] For example, for an electronic device having a multifunctional human interface, when a key input is obtained from a user, a first visual effect may be output in the image 3610, 3710 corresponding to the electronic device having a multifunctional human interface according to the embodiment. For an electronic device having a multifunctional human interface, when a touch input is obtained from a user, a second visual effect may be output in the image 3610, 3710 corresponding to the electronic device having a multifunctional human interface according to the embodiment. However, no limitation is imposed thereon.

[0927] Herein, the first visual effect and the second visual effect may have, but are not limited to, different colors.

[0928] Furthermore, in this specification, the size of the first visual effect and the size of the second visual effect may be different from each other, but are not limited thereto.

[0929] Further, herein, the duration of the first visual effect and the duration of the second visual effect may be different from each other.

[0930] For example, but not limited to, the duration of the second visual effect may be longer than the duration of the first visual effect.

[0931] Further, referring to FIG. 22 and FIG. 23, the images 3610, 3710 corresponding to the electronic device with a multifunctional human interface according to the embodiments may be modified differently according to the operation mode of the electronic device with a multifunctional human interface.

[0932] For example, when the electronic device with a multifunctional human interface operates in a first mode, a first visual effect may be output in the image 3610, 3710 corresponding to the electronic device with a multifunctional human interface according to the embodiment. When the electronic device with a multifunctional human interface operates in a second mode, a second visual effect may be output in the image 3610, 3710 corresponding to the electronic device with a multifunctional human interface according to the embodiment, but no limitation is imposed thereon.

[0933] Further, for example, when the electronic device with a multifunctional human interface operates in a text input mode, a first visual effect may be output in the image 3610, 3710 corresponding to the electronic device with a multifunctional human interface according to the embodiment. When the electronic device with a multifunctional human interface operates in a touch input mode, a second visual effect may be output in the image 3610, 3710 corresponding to the electronic device with a multifunctional human interface according to the embodiment, but no limitation is imposed thereon.

[0934] Herein, the first visual effect and the second visual effect may have, but are not limited to, different colors.

[0935] Furthermore, in this specification, the size of the first visual effect and the size of the second visual effect may be different from each other, but are not limited thereto.

[0936] Furthermore, in this specification, the first visual effect and the second visual effect do not have to be output simultaneously, but are not limited thereto.

[0937] For example, when an electronic device with a multifunctional human interface operates in a text input mode according to an embodiment and a user's touch input is obtained for the electronic device with a multifunctional human interface, the second visual effect may not be output, although no limitation is imposed thereon.

[0938] Furthermore, for example, when the electronic device with a multifunctional human interface according to the embodiment operates in a touch input mode and a user's key input is obtained on the electronic device with a multifunctional human interface, the first visual effect may not be output, but no limitation is imposed thereon.

[0939] Further, herein, the duration of the first visual effect and the duration of the second visual effect may be different from each other.

[0940] For example, but not limited to, the duration of the second visual effect may be longer than the duration of the first visual effect.

[0941] Furthermore, according to an embodiment, while a first visual effect is being output in the image 3610, 3710 corresponding to the electronic device with a multifunctional human interface, if a touch input is obtained from a user on the electronic device with a multifunctional human interface, the first visual effect may disappear and a second visual effect may be output, but no limitation is imposed thereon.

[0942] Furthermore, according to the embodiment, while the second visual effect is being output in the image 3610, 3710 corresponding to the electronic device with a multifunctional human interface, if a key input is obtained from a user on the electronic device with a multifunctional human interface, the second visual effect may disappear and the first visual effect may be output, but no limitation is imposed thereon.

[0943]

[0944] 24 to 28 are diagrams illustrating screens displayed through a virtual reality device according to an operation mode of an electronic device with a multifunctional human interface according to an embodiment.

[0945] Before describing Figures 24 to 28, it is understood that the details described above may apply to the operating modes of an electronic device having a multi-function human interface described below, and therefore redundant description will be omitted.

[0946] Referring to FIG. 24, a screen 3800 displayed through a virtual reality device according to an embodiment may include at least one of the following images: an image 3810 corresponding to an electronic device having a multifunction human interface, an image 3820 corresponding to a display device, and an image 3830 corresponding to a user's hand.

[0947] When the electronic device with a multi-function human interface according to an embodiment operates in a first operation mode, the image 3810 corresponding to the electronic device with a multi-function human interface may be provided as a first type of image.

[0948] For example, when an electronic device with a multi-function human interface according to an embodiment operates in a key input mode, an image 3810 corresponding to the electronic device with a multi-function human interface may be provided as an image corresponding to the keyboard layout of the electronic device with a multi-function human interface, but is not limited to this.

[0949] In this specification, the first operating mode according to the embodiment may be expressed as various modes such as, but not limited to, a key input mode, a text input mode, and a keyboard mode for acquiring a key input signal for text input.

[0950]

[0951] Referring to FIG. 25, a screen 3900 displayed through a virtual reality device in accordance with an embodiment may include at least one of the following images: an image 3910 corresponding to an electronic device having a multifunction human interface, an image 3920 corresponding to a display device, and an image 3930 corresponding to a user's hand.

[0952] When the electronic device with a multifunctional human interface according to an embodiment operates in a second mode of operation, the image 3910 corresponding to the electronic device with a multifunctional human interface may be provided as a second type of image.

[0953] For example, when an electronic device with a multi-function human interface according to an embodiment operates in a touch input mode, the image 3910 corresponding to the electronic device with a multi-function human interface may be provided as, but is not limited to, an image showing an area corresponding to a touch area of ​​the electronic device with a multi-function human interface.

[0954] In this specification, the second operating mode according to the embodiment may be expressed as various modes such as, but not limited to, a touch input mode, a pointer position related information acquisition mode, and a touch mode for acquiring a touch input signal in accordance with touch input from a user.

[0955]

[0956] Referring to FIG. 26, a screen 4000 displayed through a virtual reality device according to an embodiment may include at least one of the following images: an image 4010 corresponding to an electronic device having a multi-function human interface, an image 4020 corresponding to a display device, and an image 4030 corresponding to a user's hand.

[0957] When the electronic device with a multifunctional human interface according to the embodiment operates in a third operation mode, the image 4010 corresponding to the electronic device with a multifunctional human interface may be provided as a third type of image.

[0958] For example, when an electronic device with a multi-function human interface according to an embodiment operates in a right-hand touch input mode, the image 4010 corresponding to the electronic device with a multi-function human interface may be provided as, but is not limited to, an image showing an area corresponding to a right-hand touch area of ​​the electronic device with a multi-function human interface.

[0959] As used herein, the third mode of operation according to an embodiment may be referred to as, but is not limited to, a right-hand touch input mode, a right-handed mode, and a right-hand mode.

[0960]

[0961] Referring to FIG. 27, a screen 4100 displayed through a virtual reality device in accordance with an embodiment may include at least one of the following images: an image 4110 corresponding to an electronic device having a multi-function human interface, an image 4120 corresponding to a display device, and an image 4130 corresponding to a user's hand.

[0962] When the electronic device with a multi-functional human interface according to the embodiment operates in a fourth operation mode, the image 4110 corresponding to the electronic device with a multi-functional human interface may be provided as a fourth type of image.

[0963] For example, when an electronic device with a multi-function human interface according to an embodiment operates in a left-hand touch input mode, the image 4110 corresponding to the electronic device with a multi-function human interface may be provided as, but is not limited to, an image showing an area corresponding to a left-hand touch area of ​​the electronic device with a multi-function human interface.

[0964] The fourth operational mode according to an embodiment may be referred to herein as, but is not limited to, a left-handed touch input mode, a left-handed mode, and a left-handed mode.

[0965]

[0966] Referring to FIG. 28, a screen 4200 displayed through a virtual reality device in accordance with an embodiment may include at least one of the following images: an image 4210 corresponding to an electronic device having a multi-function human interface, an image 4220 corresponding to a display device, and an image 4230 corresponding to a user's hand.

[0967] When the electronic device with a multifunctional human interface according to the embodiment operates from the fourth operation mode to the second operation mode, the image 4210 corresponding to the electronic device with a multifunctional human interface may be at least partially changed.

[0968] For example, when the operation mode of the electronic device with a multifunctional human interface according to the embodiment is changed to the touch input mode while operating in the left-hand touch input mode, the image 4210 corresponding to the electronic device with a multifunctional human interface may be changed from an image showing an area corresponding to the left-hand touch area of ​​the electronic device with a multifunctional human interface to an image showing an area corresponding to the touch area of ​​the electronic device with a multifunctional human interface, but no limitation is imposed thereon.

[0969]

[0970] 24 to 28, the operation mode of the electronic device with a multifunctional human interface may be changed according to a user's input, and the images 3810, 3910, 4010, 4110, and 4210 corresponding to the electronic device with a multifunctional human interface may be changed accordingly.

[0971] For example, according to an embodiment, if the electronic device with a multifunctional human interface obtains a first input from a user while operating in a first operating mode, the operating mode of the electronic device with a multifunctional human interface may be changed to a second operating mode. Thus, the images 3810, 3910, 4010, 4110, 4210 corresponding to the electronic device with a multifunctional human interface may be changed from a first type image to a second type image, although no limitation is imposed thereon.

[0972] As a more specific example, according to an embodiment, when the electronic device with a multifunctional human interface receives a touch input from a user while operating in a text input mode, the operation mode of the electronic device with a multifunctional human interface may be changed to a touch input mode. Thus, the images 3810, 3910, 4010, 4110, and 4210 corresponding to the electronic device with a multifunctional human interface may be changed from images corresponding to a keyboard arrangement to images showing a touch area. However, no limitation is imposed thereon.

[0973] Further, for example, according to an embodiment, if the electronic device with a multifunctional human interface acquires a second input from a user while operating in the second operating mode, the operating mode of the electronic device with a multifunctional human interface may be changed to the first operating mode. Thus, the images 3810, 3910, 4010, 4110, 4210 corresponding to the electronic device with a multifunctional human interface may be changed from the second type images to the first type images, although no limitation is imposed thereon.

[0974] As a more specific example, according to an embodiment, when the electronic device with a multifunctional human interface receives a key input from a user while operating in a touch input mode, the operation mode of the electronic device with a multifunctional human interface may be changed to a text input mode. Therefore, the images 3810, 3910, 4010, 4110, and 4210 corresponding to the electronic device with a multifunctional human interface may be changed from images showing touch areas to images corresponding to a keyboard layout. However, no limitation is imposed thereon.

[0975] Further, for example, according to an embodiment, if the electronic device with a multifunctional human interface acquires a third input from a user while operating in the second operating mode, the operating mode of the electronic device with a multifunctional human interface may be changed to a third operating mode. Thus, the images 3810, 3910, 4010, 4110, 4210 corresponding to the electronic device with a multifunctional human interface may be changed from the second type images to the third type images, although no limitation is imposed thereon.

[0976] As a more specific example, according to an embodiment, when the electronic device with a multifunctional human interface receives a predetermined combination key input from a user while operating in the touch input mode, the operation mode of the electronic device with a multifunctional human interface may be changed to a right-hand touch input mode. Therefore, the images 3810, 3910, 4010, 4110, and 4210 corresponding to the electronic device with a multifunctional human interface may be changed from images showing touch areas to images showing right-hand touch areas, but no limitation is imposed thereon.

[0977]

[0978] 29 and 30 are diagrams illustrating screens displayed through a virtual reality device according to the context of an application running on the virtual reality device, according to an embodiment.

[0979] Before explaining Figures 29 and 30, the environment of an application running on a virtual reality device can be understood as a concept including the environment of an application running on a main processor and the setting environment of a multifunction human interface device, but for convenience of explanation, it will be described as the environment of an application running on a virtual reality device.

[0980] Referring to FIG. 29, a screen 4400 displayed through a virtual reality device in an embodiment may include at least one of the following images: an image 4410 corresponding to an electronic device having a multi-function human interface, and an image 4420 corresponding to a display device.

[0981] When the environment of an application running on a virtual reality device according to an embodiment is a first environment, an image 4410 corresponding to an electronic device having a multifunctional human interface may be provided as a first type of image.

[0982] For example, when the language environment of an application running on a virtual reality device according to an embodiment is set to English, an image 4410 corresponding to an electronic device having a multifunction human interface may be provided as, but is not limited to, an image corresponding to a QWERTY keyboard.

[0983]

[0984] Referring to FIG. 30, a screen 4500 displayed through a virtual reality device in accordance with an embodiment may include at least one of the following images: an image 4510 corresponding to an electronic device having a multi-function human interface, and an image 4520 corresponding to a display device.

[0985] When the environment of an application running on a virtual reality device according to an embodiment is a second environment, an image 4510 corresponding to an electronic device having a multifunctional human interface may be provided as a second type of image.

[0986] For example, when the language environment of an application running on a virtual reality device according to an embodiment is set to Korean, an image 4510 corresponding to an electronic device having a multi-function human interface may be provided as, but is not limited to, an image corresponding to a Korean two-set keyboard.

[0987]

[0988] Further, in addition to the examples described with reference to Figures 29 and 30, according to various embodiments, images 4310, 4410 corresponding to an electronic device having a multi-function human interface may be modified and provided according to the environment of an application running on a virtual reality device.

[0989]

[0990] 31 and 32 are diagrams illustrating screens displayed through a virtual reality device according to an application running on the virtual reality device, according to an embodiment.

[0991] Before explaining Figures 31 and 32, an application running on a virtual reality device can be understood as a concept including an application running on a main processor, but for convenience of explanation, it will be described as an application running on a virtual reality device.

[0992] Referring to FIG. 31, a screen 4500 displayed through a virtual reality device in accordance with an embodiment may include at least one of the following images: an image 4510 corresponding to an electronic device having a multi-function human interface, and an image 4520 corresponding to a display device.

[0993] When the application running on the virtual reality device according to the embodiment is a first application, the image 4510 corresponding to the electronic device having a multifunctional human interface may be provided as a first type of image.

[0994] For example, if an application running on a virtual reality device according to an embodiment is a game and the active button for moving a game character is WASD, the image 4510 corresponding to an electronic device with a multifunction human interface may be provided such that only the image of the button corresponding to WASD may be output, or such that a highlight may be output within the image of the button corresponding to WASD, but no limitation is imposed thereto.

[0995]

[0996] Referring to FIG. 32, a screen 4600 displayed through a virtual reality device in accordance with an embodiment may include at least one of the following images: an image 4610 corresponding to an electronic device having a multi-function human interface, and an image 4620 corresponding to a display device.

[0997] If the application running on the virtual reality device according to the embodiment is a second application, the image 4610 corresponding to the electronic device with a multifunctional human interface may be provided as a second type of image.

[0998] For example, if an application running on a virtual reality device according to an embodiment is a game and the active buttons for controlling a game character are 1, 2, 3, 4, Q, W, E, R, then the image 4610 corresponding to an electronic device with a multifunction human interface may be provided such that only images of the buttons corresponding to 1, 2, 3, 4, Q, W, E, R may be output, or such that highlights may be output within the images of the buttons corresponding to 1, 2, 3, 4, Q, W, E, R, although no limitation is imposed thereto.

[0999]

[1000] Further, in addition to the examples described with reference to Figures 31 and 32, according to various embodiments, images 4510, 4610 corresponding to an electronic device having a multifunction human interface may be modified and provided according to an application running on a virtual reality device.

[1001]

[1002] FIG. 33 illustrates a screen displayed through a virtual reality device according to a power mode of an electronic device having a multifunction human interface, according to an embodiment.

[1003] Referring to FIG. 33, a screen displayed through a virtual reality device according to an embodiment may include an image corresponding to an electronic device having a multi-function human interface.

[1004] When the power mode of the electronic device with a multi-functional human interface according to the embodiment is a first power mode, the image corresponding to the electronic device with a multi-functional human interface may be provided as a first type image 4710. When the power mode of the electronic device with a multi-functional human interface according to the embodiment is a second power mode, the image corresponding to the electronic device with a multi-functional human interface may be provided as a second type image 4720. When the power mode of the electronic device with a multi-functional human interface according to the embodiment is a third power mode, the image corresponding to the electronic device with a multi-functional human interface may be provided as a third type image 4730. When the power mode of the electronic device with a multi-functional human interface according to the embodiment is a fourth power mode, the image corresponding to the electronic device with a multi-functional human interface may be provided as a fourth type image 4740.

[1005] As used herein, a first power mode may refer to, but is not limited to, a power off mode or a disconnected mode.

[1006] Furthermore, as used herein, the second power mode may refer to, but is not limited to, a power sleep mode or a standby mode.

[1007] Furthermore, in this specification, the third power mode may refer to, but is not limited to, a semi-active mode and an active standby mode.

[1008] Furthermore, in this specification, the fourth power mode may refer to, but is not limited to, an active mode.

[1009] Furthermore, the first to fourth type images 4710 to 4740 may be different from each other.

[1010] Furthermore, Fig. 33 merely illustrates embodiments of the first to fourth type images 4710 to 4740, and embodiments of the present disclosure are not limited to Fig. 33. The scope of the present disclosure also includes various embodiments in which images included on a screen displayed through a virtual reality device and corresponding to an electronic device with a multifunctional human interface may be provided as different types of images or distinguishable types of images according to a power mode of the electronic device with a multifunctional human interface.

[1011] Furthermore, although the power modes of the electronic device with a multifunctional human interface have been described in four power modes with reference to Fig. 33, the embodiments of the present disclosure are not limited to the embodiments of the four power modes described with reference to Fig. 33. An electronic device with a multifunctional human interface with various types of power modes, such as 2, 3, 5, and 6, may be used, and different types of images may be provided accordingly.

[1012]

[1013] FIG. 34 illustrates an image included on a screen displayed through a virtual reality device and corresponding to an electronic device having a multifunctional human interface, according to an embodiment.

[1014]

[1015] Referring to FIG. 34, an image 4810 included on a screen displayed through a virtual reality device and corresponding to an electronic device having a multi-function human interface according to an embodiment may be provided as different images according to various conditions.

[1016] In this specification, an image 4810 included on a screen displayed through a virtual reality device and corresponding to an electronic device having a multi-function human interface according to an embodiment may be provided as a custom image 4820 of various types.

[1017] Further, in this specification, custom image 4820 may be various images generated or provided by a user, an image provider, a provider of an electronic device with a multi-function human interface, and a provider of a virtual reality device for image 4810 corresponding to an electronic device with a multi-function human interface.

[1018] Further, in this specification, the various conditions 4830 may be an operating mode of the electronic device with a multifunctional human interface, a power mode, or an environment of an application, such as a type of application running on the virtual reality device, but may include, but is not limited to, various conditions for modifying the image 4810 included on the screen displayed through the virtual reality device and corresponding to the electronic device with a multifunctional human interface according to an embodiment.

[1019] That is, referring to FIG. 34, an image 4810 included on a screen displayed through a virtual reality device and corresponding to an electronic device with a multi-function human interface according to an embodiment may be provided as a different type of custom image 4820 according to an operating mode of the electronic device with a multi-function human interface.

[1020] Further, referring to FIG. 34, an image 4810 included on a screen displayed through a virtual reality device and corresponding to an electronic device with a multi-function human interface according to an embodiment may be provided as a different type of custom image 4820 according to a power mode of the electronic device with a multi-function human interface.

[1021] Further, referring to FIG. 34, an image 4810 included on a screen displayed through a virtual reality device and corresponding to an electronic device having a multi-function human interface according to an embodiment may be provided as a different type of custom image 4820 depending on the type of application running on the virtual reality device.

[1022] Further, referring to FIG. 34, an image 4810 included on a screen displayed through a virtual reality device and corresponding to an electronic device having a multi-function human interface according to an embodiment may be provided as a different type of custom image 4820 depending on the environment of an application running on the virtual reality device.

[1023]

[1024] The method according to the present embodiment may be embodied as program instructions executable by various computer means and may be recorded on a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, and the like, individually or in combination. The program instructions to be recorded on the computer-readable recording medium may be specially designed and constructed for the present embodiment, or may be well known and usable by those skilled in the art of computer software. Examples of computer-readable recording media include magnetic recording media such as hard disks, floppy disks, and magnetic tapes; optical data storage media such as CD-ROMs or DVD-ROMs; magneto-optical media such as optical floppy disks; and hardware devices such as read-only memory (ROM), random-access memory (RAM), and flash memory that are specifically constructed to store and implement program instructions. Examples of program instructions include not only machine language code formatted by a compiler, but also high-level language code that can be implemented by a computer using an interpreter and the like. A hardware device may be configured to be operated by one or more software modules to perform operations in accordance with an embodiment, or vice versa.

[1025] Although the present embodiment has been described with reference to a limited number of embodiments and drawings, it will be appreciated by those skilled in the art that various modifications and variations may be made from this description. For example, suitable results may be achieved if the described techniques are performed in an order different from that described, and / or the elements of the systems, structures, devices, and circuits described above are combined or combined in a manner different from that described, or are replaced or substituted by other elements or equivalents.

[1026] Accordingly, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

[1027] Aspects of the invention

[1028] As explained above, the relevant matter has been explained in the best mode.

Claims

1. 1. An electronic device having a multi-function human interface, comprising: a plurality of keycaps, wherein the plurality of keycaps comprises a first keycap; a plurality of elastic units, where the plurality of elastic units comprises a first elastic unit; a plurality of conductive materials, where the plurality of conductive materials comprises a first conductive material; and an electrode layer configured to generate key input signals and touch input signals; wherein the electrode layer is: a first type of electrode configured to generate a touch input signal; and a second type of electrode configured to generate at least a key input signal; having wherein a first electrode included in the first type of electrodes and a second electrode included in the second type of electrodes are arranged to at least partially overlap the first keycap; wherein the second electrode is disposed so as to at least partially overlap the first conductive material; Here, the first electrode is disposed so as not to overlap the first conductive material. An electronic device comprising:

2. the electrode layer having a first type of lines of electrodes electrically connected in a longitudinal direction of a keyboard arrangement and a second type of lines of electrodes electrically connected in a width direction of the keyboard arrangement; The first type of line is configured to function as one of a transmitter or a receiver, and the second type of line is configured to function as the other of the transmitter or the receiver. The electronic device of claim 1 .

3. The electronic device of claim 2 , wherein the first electrode and the second electrode are included in a line of the first type.

4. The electronic device of claim 2 , wherein the first electrode and the second electrode are included in the second type of line.

5. the first electrode is included in either the first type of line or the second type of line; the second electrode being included in the other of the first type of wire or the second type of wire; The electronic device of claim 2 .

6. the electrode layer further comprises a third electrode included in the first type of electrodes and a fourth electrode included in the second type of electrodes; the third electrode and the fourth electrode are disposed so as to at least partially overlap the first keycap; the fourth electrode is disposed to at least partially overlap the first conductive material; The third electrode is disposed so as not to overlap at least partially with the first conductive material. The electronic device of claim 1 .

7. The electronic device of claim 6 , wherein the second electrode and the fourth electrode are disposed adjacent to one another.

8. The electronic device of claim 1 , wherein the second type of electrodes includes protrusions.

9. The electronic device of claim 6 , wherein the second type of electrodes include protrusions, and the shape of the protrusions of the second electrodes is the same as the shape of the protrusions of the fourth electrodes.

10. The electronic device of claim 6 , wherein the second type of electrodes include protrusions, and a shape of the protrusions of the second electrodes is different from a shape of the protrusions of the fourth electrodes.

11. 7. The electronic device of claim 6, wherein the second type of electrodes include protrusions, and the protrusions of the second electrodes and the protrusions of the fourth electrodes are arranged to overlap the first conductive material.

12. 12. The electronic device of claim 11, wherein a size of an area where the protrusion of the second electrode overlaps with the first conductive material is the same as a size of an area where the protrusion of the fourth electrode overlaps with the first conductive material.

13. The electronic device of claim 1 , wherein the first conductive material is arranged to move in accordance with movement of the first keycap.

14. The electronic device of claim 13 , wherein the first conductive material is formed to be contained in the first keycap.

15. The electronic device of claim 1 , wherein the first conductive material is formed to be contained in the first keycap.

16. The electronic device of claim 1 , wherein the first conductive material is formed to be contained in the first elastic unit.

Images