Electronic device and operation method thereof

Abstract

Provided are an electronic device having a projection unit and an operation method thereof. The electronic device comprises: a projection unit; a memory for storing one or more instructions; and at least one processor for executing the one or more instructions stored in the memory. The processor individually or collectively executes the one or more instructions to identify whether a touch sensing device is coupled to the electronic device so as to detect a user's touch input on a soft keyboard. The touch sensing device is configured to be detachably coupled to the electronic device. The processor individually or collectively executes the one or more instructions to, on the basis of identifying that the touch sensing device is coupled to the electronic device, control the projection unit to project a soft keyboard corresponding to a first keyboard layout on a projection surface.

Description

Electronic device and method of operation thereof

[0001] The present disclosure relates to an electronic device and an operating method thereof, and more particularly, to an electronic device having a projection module and an operating method thereof.

[0002] With recent advancements in mobile communication technology, portable electronic devices such as smartphones and tablet PCs are now easily portable, yet support a variety of functions, including calling, sending and receiving messages, internet access, and chatting. These portable electronic devices include displays and touch panels to receive user input. Touch panels on portable electronic devices allow users to perform various inputs by touching a soft keyboard displayed on the display.

[0003] However, since there are limitations to increasing the display size of portable electronic devices, input using a soft keyboard is likely to result in various typos, and may be less efficient in terms of speed and accuracy compared to using a regular keyboard. In particular, on tablet PCs, the soft keyboard may block part of the display.

[0004] Additionally, there is a problem that changing the soft keyboard layout or manipulating the configuration of soft keys included in the soft keyboard layout requires the user to manually manipulate the settings.

[0005] The present disclosure discloses a method for dynamically configuring a soft keyboard layout that is most effective for a user based on the user's input method when an electronic device projects a soft keyboard to solve the above-mentioned problems, thereby enabling the user to input more efficiently and conveniently.

[0006] According to one embodiment of the present disclosure, an electronic device is provided, including a projection unit, at least one processor including a processing circuit, and a memory storing one or more instructions. When the at least one processor individually or collectively executes one or more instructions, the electronic device performs the following operations: the electronic device identifies whether a touch-sensitive device is coupled to the electronic device to detect a touch input on a user's soft keyboard; the touch-sensitive device is configured to be detachably coupled to the electronic device; and when the touch-sensitive device is identified as being coupled to the electronic device, the electronic device controls the projection unit to project a soft keyboard corresponding to a first keyboard layout onto a projection surface.

[0007] When at least one processor individually or collectively executes one or more instructions, the electronic device further performs the following actions: The electronic device controls the projection unit to project a soft keyboard corresponding to the second keyboard layout onto the projection surface, when the touch-sensitive device is identified as not being coupled to the electronic device.

[0008] When at least one processor individually or collectively executes one or more instructions, the electronic device further performs the following actions: When the electronic device identifies that a touch-sensitive device is coupled to the electronic device while projecting a soft keyboard corresponding to the second keyboard layout, the electronic device controls the projection unit to change the soft keyboard corresponding to the second keyboard layout to a soft keyboard corresponding to the first keyboard layout and project it.

[0009] When at least one processor individually or collectively executes one or more instructions, the electronic device further performs the following actions: When the electronic device identifies that the touch-sensitive device is separated from the electronic device while projecting a soft keyboard corresponding to the first keyboard layout, the electronic device controls the projection unit to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout and project it.

[0010] According to one embodiment of the present disclosure, the first keyboard layout is a keyboard layout corresponding to a touch input mode, and the second keyboard layout is a keyboard layout corresponding to a remote input mode.

[0011] When at least one processor individually or collectively executes one or more instructions, the electronic device further performs the following actions: the electronic device identifies that a projection mode of the electronic device coupled with the touch-sensitive device has been switched from a floor projection mode to a wall projection mode, and upon identifying that the projection mode of the electronic device coupled with the touch-sensitive device has been switched to the wall projection mode, causes the projection unit to change a soft keyboard corresponding to a first keyboard layout to a soft keyboard corresponding to a second keyboard layout and project the soft keyboard.

[0012] When at least one processor individually or collectively executes one or more instructions, the electronic device further performs the following actions. When the electronic device identifies that the projection mode of the electronic device coupled with the touch-sensitive device has been switched to the wall projection mode, the electronic device disables the touch input mode and controls the projection unit to project a user interface (UI) on the projection surface that guides adjustment of the projection direction or the position of the electronic device to correspond to the wall projection mode or the floor projection mode.

[0013] When at least one processor individually or collectively executes one or more instructions, the electronic device further performs the following operations: the electronic device detects a user's touch input error based on information collected by a touch-sensitive device coupled to the electronic device, and adjusts at least one of the size, spacing, or position of soft keys included in a soft keyboard corresponding to the first keyboard layout to compensate for the detected user's touch input error.

[0014] When at least one processor individually or collectively executes one or more instructions, the electronic device further performs the following operations. The electronic device acquires image data that captures a touch input action of the user, analyzes the image data to acquire information related to the user's hands, and the information related to the user's hands includes at least one of the number of the user's hands, the positions and directions of the user's hands, whether the user's hands are left-handed or right-handed, the spacing between the user's two hands, or the lengths of the fingers included in the user's hands, and determines the type of a soft keyboard corresponding to the first keyboard layout based on the acquired information related to the user's hands, and adjusts the size, spacing, or positions of soft keys included in the soft keyboard corresponding to the first keyboard layout.

[0015] When at least one processor individually or collectively executes one or more instructions, the electronic device further performs the following operations. When the electronic device analyzes the image data to identify the user's hand, the projector is controlled to project a soft keyboard corresponding to the first keyboard layout, and when the image data is analyzed to identify the user's hand, the projector is controlled to project a soft keyboard corresponding to the second keyboard layout or not to project the soft keyboard.

[0016] According to one embodiment of the present disclosure, a method of operating an electronic device is provided. The method of operating the electronic device includes the step of identifying whether a touch-sensitive device is coupled to the electronic device to detect a user's touch input on a soft keyboard. The touch-sensitive device is configured to be detachably coupled to the electronic device. The method of operating the electronic device includes the step of controlling a projection unit to project a soft keyboard corresponding to a first keyboard layout onto a projection surface when the touch-sensitive device is identified as being coupled to the electronic device.

[0017] The method of operating the electronic device further comprises the step of controlling the projection unit to project a soft keyboard corresponding to the second keyboard layout onto the projection surface when the touch-sensitive device is identified as not being coupled to the electronic device.

[0018] The method of operating the electronic device further includes the step of controlling the projection unit to change the soft keyboard corresponding to the second keyboard layout to a soft keyboard corresponding to the first keyboard layout and project it upon identifying that the touch-sensitive device is coupled to the electronic device while projecting the soft keyboard corresponding to the second keyboard layout.

[0019] The method of operating the electronic device further includes a step of controlling the projection unit to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout and project it upon identifying that the touch-sensitive device is separated from the electronic device while projecting the soft keyboard corresponding to the first keyboard layout.

[0020] According to one embodiment of the present disclosure, the first keyboard layout is a keyboard layout corresponding to a touch input mode, and the second keyboard layout is a keyboard layout corresponding to a remote input mode.

[0021] A method of operating an electronic device further comprises: a step of identifying that a projection mode of an electronic device coupled with a touch-sensitive device has been switched from a floor projection mode to a wall projection mode; and a step of controlling a projection unit to change a soft keyboard corresponding to a first keyboard layout to a soft keyboard corresponding to a second keyboard layout and project the soft keyboard upon identifying that the projection mode of the electronic device coupled with the touch-sensitive device has been switched to the wall projection mode.

[0022] The method of operating an electronic device further includes the steps of: disabling a touch input mode when the projection mode of the electronic device coupled with the touch sensing device is switched to a wall projection mode; and controlling a projection unit to project a user interface (UI) on a projection surface that guides adjustment of a projection direction or a position of the electronic device to correspond to the wall projection mode or the floor projection mode.

[0023] A method of operating an electronic device further includes the steps of: detecting a user's touch input error based on information collected by a touch-sensitive device coupled to the electronic device; and adjusting at least one of a size, spacing, or position of soft keys included in a soft keyboard corresponding to a first keyboard layout to compensate for the detected user's touch input error.

[0024] A method of operating an electronic device comprises the steps of: obtaining image data that captures a user's touch input behavior; and analyzing the image data to obtain information related to the user's hands; the information related to the user's hands includes at least one of the number of the user's hands, positions and directions of the user's hands, whether the user's hands are left-handed or right-handed, a gap between the user's two hands, or a length of a finger included in the user's hands; and further comprising the steps of determining a type of a soft keyboard corresponding to a first keyboard layout based on the obtained information related to the user's hands, and adjusting a size, spacing, or position of soft keys included in the soft keyboard corresponding to the first keyboard layout.

[0025] One embodiment of the present disclosure can provide a computer-readable recording medium having recorded thereon a program for executing at least one of the embodiments of the disclosed method as a technical means for achieving the above-described technical task on a computer.

[0026] Other technical features will be readily apparent to those skilled in the art from the following drawings, descriptions and claims.

[0027] Figure 1 is a reference diagram for explaining the concept of an electronic device according to one embodiment.

[0028] FIGS. 2A and 2B are drawings for explaining an example of a coupling method between an electronic device and a touch-sensitive device according to one embodiment.

[0029] FIG. 2C is a diagram illustrating a method for an electronic device according to one embodiment to receive information about a user's touch location from a touch-sensitive device.

[0030] FIG. 3A is a drawing for explaining an example of a first keyboard layout corresponding to a touch input mode according to one embodiment.

[0031] FIG. 3b is a drawing for explaining an example of a second keyboard layout corresponding to a remote input mode according to one embodiment.

[0032] FIG. 4 is a flowchart illustrating an operating method of an electronic device according to one embodiment.

[0033] FIG. 5 is a drawing for explaining the operation of an electronic device when a touch sensing device is combined with an electronic device according to one embodiment.

[0034] FIG. 6 is a drawing for explaining the operation of an electronic device when a touch-sensitive device is separated from the electronic device according to one embodiment.

[0035] FIG. 7A is a diagram for explaining a floor projection mode of an electronic device according to one embodiment.

[0036] FIG. 7b is a diagram illustrating a wall projection mode of an electronic device according to one embodiment.

[0037] FIG. 8 is a drawing for explaining the operation of an electronic device when the projection mode of the electronic device according to one embodiment is switched from a floor projection mode to a wall projection mode.

[0038] FIG. 9 is a drawing for explaining the operation of an electronic device when the projection mode of the electronic device according to one embodiment is switched from a floor projection mode to a wall projection mode.

[0039] FIGS. 10A and 10B are diagrams illustrating examples of operations of an electronic device when the electronic device detects a touch input error according to one embodiment.

[0040] FIGS. 11A to 11E are diagrams illustrating examples of a type of soft keyboard layout based on information related to a user's hand according to one embodiment.

[0041] FIG. 12 is a flowchart for explaining an operating method of an electronic device according to one embodiment.

[0042] FIG. 13A is a diagram for explaining the operation of an electronic device when the electronic device identifies a user's hand according to one embodiment.

[0043] FIG. 13b is a diagram illustrating the operation of an electronic device when the electronic device does not identify a user's hand according to one embodiment.

[0044] Figure 14 is a block diagram of a processor according to one embodiment.

[0045] FIG. 15 is a block diagram of an electronic device according to one embodiment.

[0046] Fig. 16 is a specific block diagram of an electronic device according to one embodiment.

[0047] The terms used in this disclosure are described as currently used general terms in consideration of the functions mentioned in this disclosure; however, these may mean various other terms depending on the intentions of engineers working in the field, precedents, the emergence of new technologies, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in such cases, the meanings thereof will be described in detail in the description of the relevant embodiments. Therefore, the terms used in this disclosure should not be interpreted solely on the basis of the names of the terms, but should be interpreted based on the meanings of the terms and the overall contents of this disclosure.

[0048] Additionally, the terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the present disclosure.

[0049] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.

[0050] When a part of this specification is said to "include" a component, unless otherwise specifically stated, this does not exclude other components but rather implies the inclusion of other components. Furthermore, terms such as "part," "module," etc., used herein refer to a unit that processes at least one function or operation, which may be implemented in hardware, software, or a combination of hardware and software.

[0051] In addition, each component described below may additionally perform some or all of the functions performed by other components in addition to its own main function, and some of the main functions performed by each component may be performed exclusively by other components.

[0052] The expression “configured to” as used herein can be used interchangeably with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.”

[0053] The term "configured (or set up) to" may not necessarily mean "specifically designed to" hardware. Instead, in some contexts, the phrase "a system configured to" may mean that the system, in conjunction with other devices or components, is "capable of" doing something.

[0054] When a component is referred to herein as being “connected” or “connected” to another component, it should be understood that the component may be directly connected or directly connected to the other component, but may also be connected or connected via another component in between, unless otherwise specifically stated. When a part is referred to herein as being “connected” to another part, this includes not only cases where the parts are “directly connected,” but also cases where the parts are “electrically connected” with another element in between.

[0055] As used herein, and particularly in the claims, the terms "above" and "above" and similar referents may refer to both the singular and the plural. Furthermore, unless the order of steps in a method according to the present disclosure is explicitly specified, the steps described may be performed in any appropriate order. The present disclosure is not limited by the order in which the steps are described.

[0056] The appearances of phrases such as “in some embodiments” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment.

[0057] Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various hardware and / or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a given function. Furthermore, for example, the functional blocks of the present disclosure may be implemented using various programming or scripting languages. The functional blocks may be implemented as algorithms that execute on one or more processors. Furthermore, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and / or data processing.

[0058] In order to clearly explain the present disclosure in the drawings, parts that are not related to the description have been omitted, and similar parts have been designated with similar drawing reference numerals throughout the specification. In addition, the drawing reference numerals used in each drawing are only for the purpose of explaining each drawing, and different drawing reference numerals used in different drawings do not indicate different elements. In addition, the connecting lines or connecting members between components illustrated in the drawings are only examples of functional connections and / or physical or circuit connections. In an actual device, connections between components may be indicated by various functional connections, physical connections, or circuit connections that may be replaced or added.

[0059] In describing embodiments, if it is determined that a specific description of a related known technology may unnecessarily obscure the gist of the present disclosure, the detailed description thereof will be omitted. In addition, in the specification, the expression “at least one of a, b, or c” may refer to “a,” “b,” “c,” “a and b,” “a and c,” “b and c,” “all of a, b, and c,” or variations thereof. The numbers (e.g., first, second, third, etc.) used in the description of the specification are merely identifiers to distinguish one component from another.

[0060] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.

[0061] In this disclosure, a 'user' means a person who controls a function or operation of an electronic device using a control device, and may include a consumer, an evaluator, a viewer, an administrator, or an installer.

[0062] FIG. 1 is a reference diagram for explaining the concept of an electronic device (100) according to one embodiment.

[0063] Referring to FIG. 1, an electronic device (100) according to one embodiment can identify whether a touch sensing device (20) is coupled to the electronic device (100).

[0064] An electronic device (100) according to one embodiment can be detachably coupled to a touch sensing device (20).

[0065] A touch-sensitive device (20) according to one embodiment may be an external device distinguishable from the electronic device (100), and may refer to a device for detecting a user's soft keyboard touch input. For example, the touch-sensitive device (20) may include, but is not limited to, an IR (Intra Radio) camera and an IR laser.

[0066] The electronic device (100) can obtain various information (e.g., touch location information, touch count information, etc.) regarding the user's touch input on the soft keyboard layout corresponding to the projected first keyboard layout (30) from the touch sensing device (20) through a data pin or wireless communication technology (e.g., NFC (Near Field Communication), Bluetooth, etc.).

[0067] In one embodiment, the coupling between the electronic device (100) and the touch-sensitive device (20) may mean that the electronic device (100) and the touch-sensitive device (20) are coupled in a detachable manner from each other. For example, the electronic device (100) and the touch-sensitive device (20) may be physically attached to each other, but may also be detached from each other at any time. This will be discussed in detail with reference to FIGS. 2A and 2B.

[0068] If a user wants to perform touch input via a soft keyboard using the user's body (e.g., hand) without using a remote control, a touch sensing device (20) can be coupled to the electronic device (100).

[0069] According to one embodiment, the electronic device (100) can control the projection module to project a soft keyboard corresponding to the first keyboard layout (30) onto the projection surface (40) when it identifies that the touch-sensitive device (20) is coupled to the electronic device (100).

[0070] In one embodiment, the first keyboard layout (30) may refer to a keyboard layout of a soft keyboard corresponding to a touch input mode of the electronic device (100). The first keyboard layout (30) may refer to a keyboard layout configuration of a soft keyboard that is more advantageous / suitable / optimized for touch input using a user's body (e.g., hand) (e.g., touch input mode) than for input using a remote control (e.g., remote input mode). For example, the first keyboard layout (30) may include, but is not limited to, a QWERTY keyboard layout.

[0071] When the electronic device (100) identifies that the touch-sensitive device (20) is coupled to the electronic device (100), the electronic device (100) can predict / determine / judge that the user will perform input using the body (e.g., hand) rather than input using a remote control (e.g., remote input mode) (e.g., touch input mode). Accordingly, the electronic device (100) can determine the soft keyboard layout as the first keyboard layout (30) corresponding to the touch input mode and control the projection module to automatically project the first keyboard layout (30) onto the projection surface.

[0072] Accordingly, when a user wishes to perform touch input via a soft keyboard using an electronic device (100), the inconvenience of having to perform additional setup work to change the keyboard layout of the soft keyboard layout to be advantageous / suitable for touch input can be resolved.

[0073] According to one embodiment of the present disclosure, an electronic device (100) can provide a method for dynamically configuring a soft keyboard layout that is most effective for a user based on the user's input method, thereby enabling the user to input more efficiently and conveniently.

[0074] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0075] FIGS. 2A and 2B are drawings for explaining an example of a coupling method between an electronic device (100) and a touch sensing device (20) according to one embodiment.

[0076] Referring to FIGS. 2A and 2B, an electronic device (100) according to one embodiment can be detachably coupled to a touch sensing device (20).

[0077] A touch-sensitive device (20) according to one embodiment may be an external device distinguishable from the electronic device (100), and may refer to a device for detecting a user's soft keyboard touch input. For example, the touch-sensitive device (20) may include an IR (Intra Radio) camera, but is not limited thereto.

[0078] In one embodiment, the coupling between the electronic device (100) and the touch-sensitive device (20) may mean that the electronic device (100) and the touch-sensitive device (20) are coupled in a detachable state with respect to each other, for example, the electronic device (100) and the touch-sensitive device (20) may be physically attached to each other, but may also be detached from each other at any time.

[0079] According to one embodiment, the electronic device (100) and the touch-sensitive device (20) may include a coupling means (10) for detachably coupling them to each other. A user may use the coupling means (10) to physically attach the touch-sensitive device (20) to the electronic device (100) or physically detach the touch-sensitive device (20) from the electronic device (100).

[0080] The coupling means (10) according to one embodiment may refer to any means capable of physically detachably coupling the electronic device (100) and the touch-sensitive device (10). For example, the coupling means (10) may include, but is not limited to, a magnetic connector or a USB (Universal Serial Bus) port.

[0081] Referring to FIG. 2A, a coupling means (10) according to one embodiment may include magnetic connectors (21a and 22a). An electronic device (100) according to one embodiment may include a magnetic connector (22a) as a coupling means (10) for detachably coupling with a touch sensing device (20). When a user brings the touch sensing device (20) close to the electronic device (100), an attractive force is applied between the magnetic connectors 21a and 22a, so that the electronic device (100) and the touch sensing device (20) may be physically coupled. When the user pulls the touch sensing device (20) in an opposite direction to the electronic device (100), the electronic device (100) and the touch sensing device (20) may be physically separated.

[0082] The electronic device (100) can identify that the touch sensing device (20) has been coupled when it receives a predetermined signal indicating that the touch sensing device (20) has been coupled through a sensor, an electric circuit, a data pin included in the magnetic connector (21a and 22a), or a wireless communication technology (e.g., NFC, Bluetooth, etc.) integrated into the magnetic connector (21a and 22a), and can obtain various information (e.g., touch position information, touch count information, etc.) about the user's touch input on the soft keyboard layout corresponding to the first keyboard arrangement (30) from the touch sensing device (20).

[0083] According to one embodiment, the electronic device (100) can control the projection module to project a soft keyboard corresponding to the first keyboard layout (30) onto the projection surface (40) when it identifies that the touch-sensitive device (20) is coupled to the electronic device (100) via the magnetic connector (22a).

[0084] Referring to FIG. 2b, a coupling means (10) according to one embodiment may include USB ports (21b and 22b). An electronic device (100) according to one embodiment may include a USB port (22b) as a coupling means (10) for detachably coupling with a touch-sensitive device (20). When a user inserts the USB port (21b) of the touch-sensitive device (20) into the USB port (22b) of the electronic device (100), the electronic device (100) and the touch-sensitive device (20) may be physically coupled. When a user pulls the touch-sensitive device (20) in the opposite direction to the electronic device (100), the electronic device (100) and the touch-sensitive device (20) may be physically separated.

[0085] The electronic device (100) can identify that the touch sensing device (20) has been coupled when it receives a predetermined signal indicating that the touch sensing device (20) has been coupled through a sensor, an electric circuit, a data pin included in the USB port (21b and 22b) or a wireless communication technology (e.g., NFC, Bluetooth, etc.) integrated into the USB port (21b and 22b), and can obtain various information (e.g., touch position information, touch count information, etc.) about the user's touch input on the soft keyboard layout corresponding to the first keyboard arrangement (30) from the touch sensing device (20).

[0086] According to one embodiment, the electronic device (100) can control the projection module to project a soft keyboard corresponding to the first keyboard layout (30) onto the projection surface (40) when it identifies that the touch-sensitive device (20) is coupled to the electronic device (100) via the USB port (22b).

[0087] FIG. 2c is a diagram illustrating a method for an electronic device (100) according to one embodiment to receive information about a user's touch position from a touch sensing device (20).

[0088] Referring to FIG. 2c, in one embodiment, the electronic device (100) may include an IR light emitting unit (60). When the touch sensing device (20) is coupled to the electronic device (100), the IR light emitting unit (60) of the electronic device (100) may generate an IR field in the same plane as the bottom surface of the electronic device (100).

[0089] The touch sensing device (20) can use an IR camera to determine which location on the soft keyboard the user touches, i.e., the location of the user's touch input on the soft keyboard.

[0090] When a user touches the projected soft keyboard, the touch sensing device (20) can detect IR interference occurring in the IR field using an IR camera. Through this, the touch sensing device (20) can determine which location on the soft keyboard the user is touching.

[0091] The electronic device (100) can receive information about the user's touch position, including the result of determining the touch input position on the user's soft keyboard, from the touch sensing device (20) via a data pin or wireless communication technology.

[0092] Accordingly, when the electronic device (100) is in floor projection mode (710), the projection surface on which the soft keyboard is projected and the plane on which the IR field is generated (the bottom surface of the electronic device (100)) are almost identical, making it suitable for a user to perform touch input. On the other hand, when the electronic device (100) is in wall projection mode (720), the projection surface on which the soft keyboard is projected and the plane on which the IR field is generated (the bottom surface of the electronic device (100)) are spaced apart, making it unsuitable for a user to perform touch input, and suitable for a user to perform remote input. This will be described in detail with reference to FIGS. 7A and 7B.

[0093] According to one embodiment of the present disclosure, the electronic device (100) can be detachably coupled to the touch-sensitive device (20) through various coupling means, and when the touch-sensitive device (20) is coupled to the electronic device (100), the electronic device (100) automatically projects a soft keyboard layout corresponding to a touch input mode, so that when a user wishes to perform a soft keyboard touch input, the user can automatically perform a touch input without additional settings by simply attaching the touch-sensitive device (20) to the electronic device (100).

[0094] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0095] FIG. 3A is a drawing for explaining an example of a first keyboard layout (310) corresponding to a touch input mode according to one embodiment. The first keyboard layout (310) of FIG. 3A may refer to the first keyboard layout (30) of FIG. 1.

[0096] Referring to FIG. 3a, the first keyboard layout (310) according to one embodiment may mean a keyboard layout of a soft keyboard corresponding to a touch input mode of an electronic device (100).

[0097] The first keyboard layout (310) may refer to a keyboard layout configuration of a soft keyboard that is more advantageous / suitable / optimized for touch input using the user's body (e.g. hand) (e.g. touch input mode) than input using a remote control (e.g. remote input mode).

[0098] For example, the first keyboard layout (310) may include, but is not limited to, any one of a QWERTY layout, a DVORAK layout, a COLEMAK layout, a QWERTZ layout, an AZERTY layout, a Hangul 2-set layout, a Hangul 3-set layout, or a JIS layout.

[0099] The example of FIG. 3a merely illustrates an example of the first keyboard layout (310), and the first keyboard layout (310) may include various soft keys to be advantageous / suitable for the user's touch input, and the soft keys included in the first keyboard layout (310) may have various arrangements to be advantageous / suitable for the user's touch input.

[0100] FIG. 3b is a drawing for explaining an example of a second keyboard layout (320) corresponding to a remote input mode according to one embodiment.

[0101] Referring to FIG. 3b, the second keyboard layout (320) according to one embodiment may mean a keyboard layout of a soft keyboard corresponding to a remote input mode of an electronic device (100).

[0102] The second keyboard layout (320) may refer to a keyboard layout configuration of a soft keyboard that is more advantageous / suitable / optimized for input using a remote control (e.g. remote input mode) than for touch input using the user's body (e.g. hand) (e.g. touch input mode).

[0103] For example, the second keyboard layout (320) may include, but is not limited to, any one of the Moaki layout, the Cheonjiin layout, the Naratgeul layout, the Sky Hangul layout, or the 10-key layout with the alphabet added.

[0104] The example of FIG. 3b merely illustrates an example of a second keyboard layout (320), and the second keyboard layout (320) may include various soft keys to be advantageous / suitable for input using a remote control, and the soft keys included in the second keyboard layout (320) may have various arrangements to be advantageous / suitable for input using a remote control.

[0105] In one embodiment, the electronic device (100) may project a soft keyboard corresponding to the first keyboard layout (310) in a smaller size than a soft keyboard corresponding to the second keyboard layout (320), taking into account the typical hand size of users.

[0106] FIG. 4 is a flowchart for explaining an operation method (400) of an electronic device (100) according to one embodiment.

[0107] Referring to FIG. 4, in step 410, an electronic device (100) according to one embodiment can identify whether a touch sensing device (20) detachably coupled to the electronic device to detect a user's touch input on a soft keyboard is coupled to the electronic device (100). At this time, the coupling between the touch sensing device (20) and the electronic device (100) may be a case where the touch sensing device (20) and the electronic device (100) are detachably coupled. The electronic device (100) may include a coupling means (10) for detachably coupling with the touch sensing device (20).

[0108] In one embodiment, the electronic device (100) can identify that the touch-sensitive device (20) is coupled via a magnetic sensor or a contact sensor. In one embodiment, the electronic device (100) can identify that the touch-sensitive device (20) is coupled by detecting that an electrical circuit is completed and a specific electrical signal flows when the touch-sensitive device (20) is coupled to the electronic device (100). In one embodiment, the electronic device (100) can identify that the touch-sensitive device (20) is coupled by exchanging status information or a specific signal with the touch-sensitive device (20) via wireless communication (e.g., NFC (Near Field Communication), Bluetooth, etc.).

[0109] In step 420, the electronic device (100) according to one embodiment can control the projection module to project a soft keyboard corresponding to the first keyboard layout (310) onto the projection surface (40) as the touch-sensitive device (20) is identified as being coupled to the electronic device (100).

[0110] In one embodiment, the electronic device (100) may control the projection module to project a soft keyboard corresponding to the first keyboard layout (310) onto the projection surface (40) the moment the touch-sensitive device (20) is identified / detected / indicated that the touch-sensitive device (20) has been coupled, without projecting the soft keyboard until the touch-sensitive device (20) is coupled.

[0111] In one embodiment, the first keyboard layout (310) may refer to a keyboard layout of a soft keyboard corresponding to a touch input mode of the electronic device (100). The first keyboard layout (310) may refer to a keyboard layout configuration of a soft keyboard that is more advantageous / suitable / optimized for touch input (e.g., touch input mode) using a user's body (e.g., hand) than for input using a remote control (e.g., remote input mode). For example, the first keyboard layout (310) may include, but is not limited to, any one of a QWERTY layout, a DVORAK layout, a COLEMAK layout, a QWERTZ layout, an AZERTY layout, a Hangul 2-set layout, a Hangul 3-set layout, or a JIS layout.

[0112] In step 430, the electronic device (100) according to one embodiment may control the projection module to project a soft keyboard corresponding to the second keyboard layout (320) onto the projection surface (40) as the touch-sensitive device (20) is identified as not being coupled to the electronic device (100).

[0113] In one embodiment, the electronic device (100) may predict / determine that the user will use the electronic device (100) in remote input mode if the touch-sensitive device (20) is not coupled, and control the projection module to project a soft keyboard corresponding to the second keyboard layout (320) onto the projection surface (40).

[0114] In one embodiment, the second keyboard layout (320) may refer to a keyboard layout of a soft keyboard corresponding to a remote input mode of the electronic device (100). The second keyboard layout (320) may refer to a keyboard layout configuration of a soft keyboard that is more advantageous / suitable / optimized for input using a remote control (e.g., remote input mode) than for touch input using a user's body (e.g., hand) (e.g., touch input mode). For example, the second keyboard layout (320) may include, but is not limited to, any one of the Moaki layout, the Cheonjiin layout, the Naratgeul layout, the Sky Hangul layout, or the ten-key layout with alphabets added.

[0115] In one embodiment, when the electronic device (100) receives a signal requesting display of a soft keyboard while projecting content (e.g., when a user selects a search function), the electronic device (100) may control the projection module to project a soft keyboard corresponding to the first keyboard layout (310) of step 420 or a soft keyboard corresponding to the second keyboard layout (320) of step 430 at the bottom of the layout on which the content is being projected.

[0116] In one embodiment, when the electronic device (100) receives a signal requesting display of a soft keyboard while projecting content (e.g., when a user selects a search function), the electronic device (100) may stop projecting the content and control the projection module to project a soft keyboard corresponding to the first keyboard layout (310) of step 420 or a soft keyboard corresponding to the second keyboard layout (320) of step 430.

[0117] According to one embodiment of the present disclosure, an electronic device (100) can provide a method for dynamically configuring a soft keyboard layout that is most effective for a user based on an input method of the user when projecting a soft keyboard, thereby enabling the user to input more efficiently and conveniently.

[0118] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0119] FIG. 5 is a drawing for explaining the operation of an electronic device (100) when a touch sensing device (20) is coupled to the electronic device (100) according to one embodiment.

[0120] Referring to FIG. 5, in one embodiment, the electronic device (100) can change the keyboard layout of the soft keyboard layout from the second keyboard layout (320) to the first keyboard layout (310) as the touch-sensitive device (20) is coupled to the electronic device (100) while projecting a soft keyboard corresponding to the second keyboard layout (320).

[0121] In one embodiment, the electronic device (100) can control the projection module to project a soft keyboard layout corresponding to a second keyboard layout (320) until the touch-sensitive device (20) is coupled, and change the keyboard layout of the soft keyboard layout to a first keyboard layout (310) and project the soft keyboard corresponding to the first keyboard layout (310) onto the projection surface (40) the moment the touch-sensitive device (20) is identified / detected / indicated that the touch-sensitive device (20) is coupled.

[0122] For example, when a user uses an electronic device (100) in remote input mode and inputs a soft keyboard with a remote control, a situation may arise where the input speed and input accuracy need to be significantly increased. At this time, the user can connect a touch-sensitive device (20) to the electronic device (100) without additional settings. The electronic device (100) projects a soft keyboard corresponding to the second keyboard layout (320), and when the user connects the touch-sensitive device (20) to the electronic device (100), the electronic device (100) can identify / detect / detect this and automatically change it to a soft keyboard corresponding to the first keyboard layout (310) and project it on the projection surface (40). The user can perform touch input through the soft keyboard corresponding to the first keyboard layout (310) projected by the electronic device (100) without additional settings, and can significantly increase the input speed and input accuracy.

[0123] FIG. 6 is a drawing for explaining the operation of an electronic device (100) when a touch sensing device (20) is separated from the electronic device (100) according to one embodiment.

[0124] Referring to FIG. 6, in one embodiment, the electronic device (100) can identify whether the touch-sensitive device (20) is detached from the electronic device (100) while projecting a soft keyboard corresponding to the first keyboard layout (310). As the touch-sensitive device (20) is detached from the electronic device (100), the electronic device (100) can change the keyboard layout of the soft keyboard from the first keyboard layout (310) to the second keyboard layout (320).

[0125] In one embodiment, the electronic device (100) can control the projection module to project a soft keyboard corresponding to the first keyboard layout (310) when the touch-sensitive device (20) is coupled, and to change the keyboard layout of the soft keyboard to the second keyboard layout (320) and project the soft keyboard corresponding to the second keyboard layout (320) onto the projection surface (40) the moment the touch-sensitive device (20) is identified / detected / indicated that the touch-sensitive device (20) is detached.

[0126] For example, a situation may arise where a user is using an electronic device (100) in touch input mode to input soft keyboard touch input by hand, and then wants to perform soft keyboard input using a remote control. At this time, the user can detach the touch-sensitive device (20) from the electronic device (100) without additional settings. The electronic device (100) projects a soft keyboard layout corresponding to the first keyboard layout (310), and when the user detaches the touch-sensitive device (20) from the electronic device (100), the electronic device (100) can identify / detect / detect this, automatically convert it to a soft keyboard corresponding to the second keyboard layout (320), and project it on the projection surface (40). The user can perform input using the remote control through the soft keyboard corresponding to the second keyboard layout (310) projected by the electronic device (100) without additional settings.

[0127] According to one embodiment of the present disclosure, an electronic device (100) can provide a method for dynamically configuring a soft keyboard layout that is most effective for a user based on an input method of the user when projecting a soft keyboard, thereby enabling the user to input more efficiently and conveniently.

[0128] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0129] FIGS. 7A and 7B are diagrams illustrating projection modes of an electronic device (100) according to one embodiment. Referring to FIGS. 7A and 7B, the electronic device (100) according to one embodiment can be used in a floor projection mode as illustrated in FIG. 7A or in a wall projection mode as illustrated in FIG. 7B.

[0130] FIG. 7A is a drawing for explaining a floor projection mode (710) of an electronic device (100) according to one embodiment.

[0131] Referring to FIG. 7a, a case in which the projection module of the electronic device (100) according to one embodiment faces the front of the electronic device (100) may be referred to as a floor projection mode.

[0132] In one embodiment, the electronic device (100) can identify that the projection module that projects the soft keyboard is facing the front of the electronic device (100) using a motion sensor or an acceleration sensor. When the electronic device (100) identifies that the projection module is facing the front, the electronic device (100) can recognize / determine that it is in floor projection mode (710).

[0133] For example, a user can adjust the electronic device (100) to stand up or lie down so that the projection module faces the front, and the electronic device (100) can recognize / determine that it is in floor projection mode (710) in this case.

[0134] In one embodiment, the electronic device (100) can recognize / determine that it is in the floor projection mode (710) by a user's action of placing the electronic device (100) on a table. The electronic device (100) can recognize / determine that the projection mode of the electronic device (100) is the floor projection mode (710) when the user places the electronic device (100) on the table so that the projection module of the electronic device (100) faces the front.

[0135] In one embodiment, the electronic device (100) can recognize / determine that it is in the floor projection mode (710) by a user's action of pushing the floor projection mode button (711) of the electronic device (100). When the user pushes the floor projection mode button (711) of the electronic device (100), a sensor connected to the floor projection mode button (711) detects this and generates an electrical signal or a signal indicating a change in state, thereby recognizing / determining that the projection mode of the electronic device (100) is the floor projection mode (710).

[0136] In one embodiment, the electronic device (100) may project a soft keyboard corresponding to the first keyboard layout (310) in response to the floor projection mode (710) when the electronic device (100) identifies that the touch-sensitive device (20) is engaged and recognizes / determines that the floor projection mode (710) is engaged.

[0137] In one embodiment, when the projection mode of the electronic device (100) is the floor projection mode, the projection surface is the floor surface of the electronic device (100), and the IR field is also generated on the floor surface of the electronic device (100). In this case, the generated IR field and the floor surface of the electronic device (100) almost coincide. Therefore, the touch sensing device (20) coupled to the electronic device (100) can determine which location on the soft keyboard the user touches by detecting IR interference occurring in the generated IR field using an IR camera when the user touches the soft keyboard corresponding to the projected first keyboard layout (310). The electronic device (100) can receive information about the user's touch location from the touch sensing device (20) through a data pin or wireless communication technology. Accordingly, the user can efficiently perform a touch input through the soft keyboard corresponding to the first keyboard layout (310).

[0138] The user can use the soft keyboard simply by positioning the projection module of the electronic device (100) to face the front, placing the electronic device (100) on a table, or pushing the floor projection mode button (711) without the cumbersome process of adjusting the projection surface of the electronic device (100).

[0139] FIG. 7b is a drawing for explaining a wall projection mode (720) of an electronic device (100) according to one embodiment.

[0140] Referring to FIG. 7b, a case in which the projection module of the electronic device (100) according to one embodiment is directed toward the ceiling may be referred to as a wall projection mode.

[0141] In one embodiment, the electronic device (100) can use a motion sensor or an acceleration sensor to identify that the projection module projecting the soft keyboard is facing the ceiling. If the electronic device (100) identifies that the projection module is facing the ceiling, the electronic device (100) can recognize / determine that it is in wall projection mode (720). For example, a user can adjust the projection module to face the ceiling by standing or lying down the electronic device (100), and in this case, the electronic device (100) can recognize / determine that it is in floor projection mode (710).

[0142] According to one embodiment, the electronic device (100) can recognize / determine that it is in the wall projection mode (720) by an action of a user attaching the electronic device (100) to a wall. The electronic device (100) can recognize / determine that the projection mode of the electronic device (100) is the wall projection mode (720) when the user attaches the electronic device (100) to a wall so that the projection module of the electronic device (100) faces the ceiling.

[0143] In one embodiment, the electronic device (100) can recognize / determine that the projection mode of the electronic device (100) is the wall projection mode (720) by a user's action of pushing the wall projection mode button (721) of the electronic device (100). When the user pushes the wall projection mode button (721) of the electronic device (100), a sensor connected to the wall projection mode button (721) detects this and generates an electrical signal or a signal indicating a state change, thereby recognizing / determining that the projection mode of the electronic device (100) is the wall projection mode (720).

[0144] In one embodiment, the electronic device (100) may project a soft keyboard corresponding to the second keyboard layout (320) in response to the wall projection mode (720) if it recognizes / determines that the touch-sensitive device (20) is engaged.

[0145] In one embodiment, when the projection mode of the electronic device (100) is wall projection mode, the projection surface is a wall surface, and the IR field is generated on the bottom surface of the electronic device (100). In this case, the generated IR field and the projection surface of the electronic device (100) may not be aligned and may be spaced apart. "Spaced apart" may mean that the two surfaces are not in complete contact or aligned, but have some space or gap. Therefore, in the wall projection mode, even if the user touches the projected soft keyboard, IR interference does not occur on the IR field, and thus the touch sensing device (20) coupled to the electronic device (100) may not be suitable for detecting the user's touch. Therefore, in this case, the electronic device (100) may project a soft keyboard of the second keyboard layout (320) corresponding to the remote input mode, and accordingly, the user may efficiently perform remote input using a remote input device such as a remote control through the soft keyboard corresponding to the second keyboard layout (310).

[0146] The user can use the soft keyboard simply by positioning the projection module of the electronic device (100) toward the ceiling, attaching the electronic device (100) on a wall, or pushing the wall projection mode button (721) without the cumbersome process of adjusting the projection surface of the electronic device (100).

[0147] According to one embodiment of the present disclosure, the electronic device (100) can provide a method for dynamically configuring a soft keyboard layout that is most effective for the user according to the user's input method and the projection mode of the electronic device (100) when projecting a soft keyboard, thereby enabling the user to input more efficiently and conveniently.

[0148] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0149] FIG. 8 is a drawing for explaining the operation of an electronic device (100) when the projection mode of the electronic device (100) according to one embodiment is switched from a floor projection mode (710) to a wall projection mode (720).

[0150] Referring to FIG. 8, an electronic device (100) according to one embodiment can identify that the projection mode of the electronic device (100) has been switched from a floor projection mode (710) to a wall projection mode (720).

[0151] In one embodiment, the electronic device (100) can use a motion sensor or an acceleration sensor to identify that the projection module projecting the soft keyboard has been adjusted from facing forward to facing the ceiling. Accordingly, the electronic device (100) can identify that the projection mode of the electronic device (100) has been switched from a floor projection mode (710) to a wall projection mode (720).

[0152] In one embodiment, the electronic device (100) can identify that the projection mode of the electronic device (100) has been switched from the floor projection mode (710) to the wall projection mode (720) by a user's action of attaching the electronic device (100) to a wall. The electronic device (100) can recognize / determine that the projection mode of the electronic device (100) has been switched to the wall projection mode (720) when the user attaches the electronic device (100) to a wall and the projection module of the electronic device (100) is adjusted to face the ceiling from the front.

[0153] According to one embodiment, the electronic device (100) can change the soft keyboard layout to the second keyboard layout (320) as the projection mode of the electronic device (100) is switched from the floor projection mode (710) to the wall projection mode (720).

[0154] In one embodiment, when the projection mode of the electronic device (100) is wall projection mode, the projection surface is a wall surface, and the IR field is generated on the bottom surface of the electronic device (100). In this case, the generated IR field and the projection surface of the electronic device (100) do not coincide, and may be spaced apart. "Spaced apart" may mean that the two surfaces do not completely contact or coincide, but there is a slight space or gap. Therefore, the wall projection mode may not be suitable for the touch sensing device (20) coupled to the electronic device (100) to detect the user's touch.

[0155] Accordingly, when the projection mode of the electronic device (100) is switched from the floor projection mode (710) to the wall projection mode (720), the electronic device (100) may automatically decide to change the soft keyboard of the first keyboard layout (100) corresponding to the touch input mode to the soft keyboard of the second keyboard layout (320) corresponding to the remote input mode, and may automatically project the soft keyboard corresponding to the second keyboard layout (320).

[0156] Accordingly, when a user wants to perform a remote input while performing a touch input, he or she can efficiently perform input using the remote control through a soft keyboard corresponding to the second keyboard layout (310) automatically projected by the electronic device (100) by simply attaching the electronic device (100) to the wall, laying it down, or standing it up without any additional settings.

[0157] In one embodiment, the electronic device (100) projects a soft keyboard corresponding to the first keyboard layout (310) in response to the floor projection mode (710) while the touch-sensitive device (20) is engaged, and then, when the user recognizes / detects / identifies that the projection mode is switched to the wall projection mode (720) by attaching the electronic device (100) to a wall or laying down or standing up the electronic device (100), the electronic device (100) can project a soft keyboard corresponding to the second keyboard layout (320) in response to the wall projection mode (720). At this time, the electronic device (100) can project a soft keyboard corresponding to the second keyboard layout (320) in response to the wall projection mode (720), regardless of whether the touch-sensitive device (20) is engaged.

[0158] For example, a situation may arise where a user is using an electronic device (100) on a table in touch input mode to input soft keyboard touch input by hand, and then wants to attach the electronic device (100) to a wall, lay it down, or stand it up to perform another task and perform soft keyboard input using a remote control. In this case, the user can perform input using the remote control through a soft keyboard corresponding to the second keyboard layout (310) projected by the electronic device (100) by simply attaching the electronic device (100) to a wall, laying it down, or standing it up without any additional settings.

[0159] According to one embodiment of the present disclosure, the electronic device (100) can provide a method for dynamically configuring a soft keyboard layout that is most effective for the user according to the user's input method and the projection mode of the electronic device (100) when projecting a soft keyboard, thereby enabling the user to input more efficiently and conveniently.

[0160] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0161] FIG. 9 is a drawing for explaining the operation of an electronic device (100) when the projection mode (100) of the electronic device according to one embodiment is switched from a floor projection mode (710) to a wall projection mode (720).

[0162] Referring to FIG. 9, an electronic device (100) according to one embodiment can identify that the projection mode of the electronic device (100) has been switched from a floor projection mode (710) to a wall projection mode (720).

[0163] The electronic device (100) can identify that the projection module projecting the soft keyboard has been adjusted from facing forward to facing the ceiling using a motion sensor or an acceleration sensor. Accordingly, the electronic device (100) can identify that the projection mode of the electronic device (100) has been switched from a floor projection mode (710) to a wall projection mode (720). In one embodiment, the electronic device (100) can identify that the projection mode of the electronic device (100) has been switched from a floor projection mode (710) to a wall projection mode (720) by a user's action of pushing a wall projection mode button (721). The electronic device (100) can identify that the projection mode of the electronic device (100) has been switched to the wall projection mode (720) by having a sensor connected to the wall projection mode button (721) detect when the user pushes the wall projection mode button (721) of the electronic device (100) and generate an electrical signal or a signal indicating a change in status.

[0164] An electronic device (100) according to one embodiment can deactivate a touch input mode when the projection mode of the electronic device (100) is switched to a wall projection mode (720).

[0165] According to one embodiment, the electronic device (100) can control the projection module to project a user interface (UI) (900) on the projection surface (40) that guides adjustment of the projection direction of the electronic device (100) or the position of the electronic device (100) to correspond to the wall projection mode (720) or to adjust the projection direction of the electronic device (100) or the position of the electronic device (100) to correspond to the floor projection mode (710) as the projection mode of the electronic device (100) is switched to the wall projection mode (720). Accordingly, the user can adjust the projection module of the electronic device (100) to face the front if he or she wants to continue using the electronic device (100) in floor projection mode (710), or can adjust the projection module of the electronic device (100) to face the ceiling if he or she wants to use the electronic device (100) in wall projection mode (720), according to the message included in the UI 900.

[0166] In one embodiment, when the projection mode of the electronic device (100) is wall projection mode, the projection surface is a wall surface, and the IR field is generated on the bottom surface of the electronic device (100). In this case, the generated IR field and the projection surface of the electronic device (100) do not coincide, and may be spaced apart. "Spaced apart" may mean that the two surfaces do not completely contact or coincide, but there is a slight space or gap. Therefore, the wall projection mode may not be suitable for the touch sensing device (20) coupled to the electronic device (100) to detect the user's touch.

[0167] Accordingly, when the projection mode of the electronic device (100) is switched from the floor projection mode (710) to the wall projection mode (720), the electronic device (100) may first disable the touch input mode and display a UI that induces the user to adjust the position and direction of the electronic device (100) to suit the wall projection mode (720) or the floor projection mode (710) according to the user's intention.

[0168] As shown in the example in FIG. 9, the UI 900 may include a message such as <Please stick the projector to the wall!> or <Please lay down or stand up the projector!>. In one embodiment, the electronic device (100) may project the UI 900 including the message <Please stick the projector to the wall!> or <Please lay down or stand up the projector!> while outputting a voice guidance sound such as <Please stick the projector to the wall!> or <Please lay down or stand up the projector!>.

[0169] The user can perform an action of attaching, laying down, or standing up the electronic device (100) on a wall so that the projection module of the electronic device (100) faces the ceiling according to the guidance message included in the UI 900, and accordingly, the electronic device (100) can identify that the projection mode of the electronic device (100) has been switched to the wall projection mode (720), as described in FIG. 8, and can project a soft keyboard layout corresponding to the second keyboard arrangement (320). Any content overlapping with that described in FIG. 8 will be omitted here and reference will be made to FIG. 8.

[0170] The user can perform an action of laying down or standing up the electronic device (100) so that the projection module of the electronic device (100) faces the front according to the guidance message included in the UI 900, and accordingly, the electronic device (100) can identify that the projection mode of the electronic device (100) has been switched to the floor projection mode (710), as described in FIG. 7A, and can project a soft keyboard corresponding to the first keyboard layout (310). Any content overlapping with that described in FIG. 7A will be omitted here, with reference to FIG. 7A.

[0171] According to one embodiment of the present disclosure, the electronic device (100) can provide a guide UI for dynamically configuring the most effective soft keyboard layout for the user when the projection mode of the electronic device (100) is changed, thereby enabling the user to input more efficiently and conveniently.

[0172] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0173] FIGS. 10A and 10B are drawings for explaining examples of operations of an electronic device (100) when the electronic device (100) detects a touch input error according to one embodiment.

[0174] Referring to FIGS. 10A and 10B, an electronic device (100) according to one embodiment can detect a user's touch input error based on information collected by a touch sensing device (20) coupled to the electronic device (100).

[0175] The touch sensing device (20) can detect a user's touch input on a soft keyboard layout corresponding to a first keyboard layout (310) projected by the electronic device (100), and can collect information about the user's touch location and information about the number of times the user's touches are made.

[0176] In one embodiment, the electronic device (100) can obtain information about the user's touch location and the number of times the user touches from the touch sensing device (20). The electronic device (100) can detect a user's touch input error based on the obtained information about the user's touch location and the number of times the user touches.

[0177] In one embodiment, the electronic device (100) may pre-set events corresponding to touch input errors as a policy. Events corresponding to touch input errors may include various events, and may include, but are not limited to, a case where a specific soft key included in a soft keyboard (e.g., a Korean / English switching key or a backspace key) is continuously pressed multiple times (e.g., 5 times) or more over a certain period of time.

[0178] In one embodiment, the electronic device (100) can detect an error by determining that an event corresponding to a touch input error has occurred based on information about the user's touch location and information about the number of times the user touches, obtained from the touch sensing device (20).

[0179] An electronic device (100) according to one embodiment may adjust at least one of the size, spacing, or position of soft keys included in a soft keyboard layout corresponding to a first keyboard arrangement (310) to compensate for a detected user touch input error.

[0180] For example, in the example of FIG. 10A, if the Korean / English switching key (1010) included in the soft keyboard corresponding to the first keyboard layout (310) is input 5 or more times, the electronic device (100) may determine that it is a touch input error and detect the error based on the information about the user's touch position and the information about the number of times the user touches, which are acquired from the touch sensing device (20). In order to compensate for the detected user's touch input error, the electronic device (100) may adjust the position of the Korean / English switching key (1010) included in the soft keyboard layout corresponding to the first keyboard layout (310) downward, as in the example of FIG. 10A. Accordingly, the electronic device (100) may prevent the Korean / English switching key (1010) from interfering with other soft keys and causing a touch input error when the user subsequently inputs a soft keyboard touch.

[0181] For example, in the example of FIG. 10b, if the backspace key (1020) included in the soft keyboard corresponding to the first keyboard layout (310) is input 5 or more times, the electronic device (100) may detect an error by determining it as a touch input error based on information about the user's touch position and information about the number of times the user touches, which are acquired from the touch sensing device (20). In order to compensate for the detected user's touch input error, the electronic device (100) may significantly adjust the size and spacing of the soft keys included in the soft keyboard layout corresponding to the first keyboard layout (310), as in the example of FIG. 10b. Accordingly, the electronic device (100) may prevent the backspace key (1020) from interfering with other soft keys and causing a touch input error when the user subsequently inputs a soft keyboard touch.

[0182] According to one embodiment of the present disclosure, an electronic device (100) can provide a method for detecting a user's touch input error and dynamically adjusting soft keys included in a soft keyboard layout to automatically compensate for the error, thereby enabling the user to input more efficiently and conveniently.

[0183] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0184] FIGS. 11A to 11E are diagrams illustrating examples of a type of soft keyboard layout based on information related to a user's hand according to one embodiment.

[0185] Referring to FIGS. 11A to 11E, an electronic device (100) according to one embodiment may receive image data capturing a user's touch input situation from a camera sensor (50). The camera sensor (50) may be built into the electronic device (100), or may be connected to the electronic device (100) via wireless / wired communication as an external device distinct from the electronic device (100). The camera sensor (50) may include an RGB camera, but is not limited thereto.

[0186] An electronic device (100) according to one embodiment may analyze received image data to obtain information related to the user's hands. In one embodiment, the information related to the user's hands may include at least one of the following: the number of the user's hands, the position and direction of the user's hands, whether the user's hands are left or right, the distance between the user's hands, or the length of the fingers included in the user's hands.

[0187] An electronic device (100) according to one embodiment can determine the type of soft keyboard corresponding to the first keyboard layout (310) based on information related to the user's hand obtained, and adjust the size, spacing, or position of soft keys included in the soft keyboard corresponding to the first keyboard layout (310).

[0188] In one embodiment, the types of soft keyboards corresponding to the first keyboard layout (310) may include left-hand mode, right-hand mode, two-hand mode, and split mode. This will be discussed in detail in FIGS. 11A to 11E.

[0189] FIG. 11A illustrates an example of a left-hand mode layout (1110) among the types of soft keyboards corresponding to the first keyboard layout (310). In one embodiment, if the electronic device (100) analyzes the image data received from the camera sensor (50) and detects that the number of hands of the user is one and that the user's hand is the left hand, the electronic device (100) may project the left-hand mode layout (1110). The left-hand mode layout (1110) may refer to a soft keyboard layout that allows the user to efficiently input data with only one left hand. For example, the electronic device (100) may project the left-hand mode layout (1110) by reducing the size and spacing of soft keys included in the soft keyboard corresponding to the first keyboard layout (310) to be small enough to match the length of the fingers included in the user's left hand, and positioning the soft keys close to the left hand.

[0190] FIG. 11B illustrates an example of a right-hand mode layout (1120) among the types of soft keyboards corresponding to the first keyboard layout (310). In one embodiment, if the electronic device (100) analyzes the image data received from the camera sensor (50) and detects that the number of hands of the user is one and that the user's hand is the right hand, the electronic device (100) can project the right-hand mode layout (1120). The right-hand mode layout (1120) may refer to a soft keyboard layout that allows the user to efficiently input data with only one right hand. For example, the electronic device (100) can project the right-hand mode layout (1110) by reducing the size and spacing of soft keys included in the soft keyboard corresponding to the first keyboard layout (310) to be small enough to fit the length of fingers included in the user's right hand, and by positioning the soft keys closer to the right hand.

[0191] Fig. 11c illustrates an example of a two-hand mode layout (1130) among the types of soft keyboards corresponding to the first keyboard layout (310). In one embodiment, the electronic device (100) analyzes image data received from the camera sensor (50) and, if it detects that the number of hands of the user is two, the electronic device (100) can project the two-hand mode layout (1130). The two-hand mode layout (1130) may refer to a soft keyboard layout that allows the user to efficiently input data with both hands. For example, the electronic device (100) can project a two-hand mode layout (1130) by adjusting the size and spacing of soft keys included in a soft keyboard corresponding to the first keyboard layout (310) to match the length of fingers included in the user's two hands, or by positioning the positions of soft keys included in a soft keyboard corresponding to the first keyboard layout (310) to correspond to the positions and directions of the user's two hands, as in the example (1140) of FIG. 11d.

[0192] FIG. 11E illustrates an example of a split mode layout (1150) among the types of soft keyboards corresponding to the first keyboard layout (310). In one embodiment, the electronic device (100) may analyze image data received from the camera sensor (50) to detect a gap between the user's right and left hands. If the electronic device (100) determines that the gap between the user's right and left hands is greater than a predetermined gap, the electronic device (100) may project the split mode layout (1150). The split mode layout (1150) may be a layout configured by dividing soft keys to be input by the user's left hand and soft keys to be input by the user's right hand, among the soft keys included in the soft keyboard corresponding to the first keyboard layout (310). For example, the electronic device (100) may project the split mode layout (1150) by positioning the soft keys to be input by the user's left hand closer to the user's left hand and positioning the soft keys to be input by the user's right hand closer to the user's right hand.

[0193] According to one embodiment of the present disclosure, an electronic device (100) can provide a method for dynamically configuring a soft keyboard layout that is most effective for the user based on information related to the user's hand, thereby enabling the user to input more efficiently and conveniently.

[0194] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0195] FIG. 12 is a flowchart for explaining an operating method (1200) of an electronic device (100) according to one embodiment.

[0196] Referring to FIG. 12, in step S1210, an electronic device (100) according to one embodiment may receive image data capturing a user's touch input situation from a camera sensor (50).

[0197] In step S1220, the electronic device (100) according to one embodiment can analyze the received image data to determine whether the user's hand is identified.

[0198] In step S1230, the electronic device (100) according to one embodiment can control the projection module to project a soft keyboard corresponding to the first keyboard layout (310) onto the projection surface (40) when the user's hand is identified.

[0199] The electronic device (100) can predict / determine / judge that the user will perform input using his / her body (e.g. hand) (e.g. touch input mode) rather than input using a remote control (e.g. remote input mode) when the user's hand is identified. Accordingly, the electronic device (100) can determine the soft keyboard layout as the first keyboard layout (30) corresponding to the touch input mode and control the projection module to automatically project the soft keyboard corresponding to the first keyboard layout (30) onto the projection surface.

[0200] Accordingly, when a user wishes to perform touch input via a soft keyboard using an electronic device (100), the inconvenience of having to perform additional setup work to change the keyboard layout of the soft keyboard to be advantageous / suitable for touch input can be resolved.

[0201] In step S1240, the electronic device (100) according to one embodiment may control the projection module to project a soft keyboard corresponding to the second keyboard layout (320) onto the projection surface (40) if the user's hand is not identified. Alternatively, the electronic device (100) according to one embodiment may control the projection module not to project the soft keyboard if the user's hand is not identified.

[0202] The electronic device (100) can predict / determine / judge that the user will use the electronic device (100) in a remote input mode rather than input using the body (e.g. hand) (e.g. touch input mode) when the user's hand is not identified, and control the projection module to project a soft keyboard corresponding to the second keyboard layout (320) onto the projection surface (40).

[0203] Accordingly, when a user wishes to perform remote input via a soft keyboard using an electronic device (100), the inconvenience of having to perform additional setup work to change the keyboard layout of the soft keyboard to be advantageous / suitable for remote input can be resolved.

[0204] Alternatively, the electronic device (100) may repeat the operation of projecting a soft keyboard corresponding to the first keyboard layout (310) as in step S1230 when the user's hand is identified, not projecting the soft keyboard when the user's hand disappears and is not identified, and projecting the soft keyboard corresponding to the first keyboard layout (310) when the user's hand is identified again.

[0205] According to one embodiment of the present disclosure, an electronic device (100) can provide a method for dynamically configuring a soft keyboard layout that is most effective for a user based on an input method of the user when projecting a soft keyboard, thereby enabling the user to input more efficiently and conveniently.

[0206] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0207] Below, FIG. 13a illustrates an example of operation when the electronic device (100) described in step S1230 identifies the user's hand, and FIG. 13b illustrates an example of operation when the electronic device (100) described in step S1240 does not identify the user's hand.

[0208] FIG. 13a is a diagram for explaining the operation of an electronic device (100) when the electronic device (100) identifies a user's hand according to one embodiment. Any description overlapping with that described in FIG. 12 is referred to FIG. 12 and is omitted here.

[0209] Referring to FIG. 13a, an electronic device (100) according to one embodiment can control a projection module to project a soft keyboard corresponding to a first keyboard layout (310) onto a projection surface (40) when a user's hand is identified.

[0210] FIG. 13b is a diagram illustrating the operation of an electronic device (100) when the electronic device (100) does not identify a user's hand according to one embodiment. Any description overlapping with that described in FIG. 12 is referred to FIG. 12 and is omitted herein.

[0211] Referring to FIG. 13b, the electronic device (100) according to one embodiment may control the projection module to project a soft keyboard corresponding to the second keyboard layout (320) onto the projection surface (40) if the user's hand is not identified. Alternatively, the electronic device (100) according to one embodiment may control the projection module not to project the soft keyboard if the user's hand is not identified.

[0212] FIG. 14 is a block diagram of a processor (1400) according to one embodiment.

[0213] Referring to FIG. 14, the processor (1400) of FIG. 14 may be an example of the processor (110) included in the electronic device (100) illustrated in FIGS. 15 and 16.

[0214] A processor (1400) according to one embodiment may include an application module (1410), an input management module (1420), and an IME (Input Method Editor) module (1430). The IME module (1430) may include a touch input mode control module (1440) and a remote input control module (1460).

[0215] Each component included in the processor (1400) may be a module. In one embodiment, a module may refer to a functional and structural combination of hardware for implementing the technical concepts of the present disclosure and software for driving the hardware. For example, a module may refer to a logical unit of a given code and hardware resources for executing the given code, and is not necessarily limited to physically connected code or a single type of hardware.

[0216] In one embodiment, the application module (1410) may activate the input management module (1420) when it determines that a user's keyboard input is required (e.g., when the user selects a search function). The application module (1410) may include a web browser.

[0217] In one embodiment, the input management module (1420), when activated by the application module (1410), can identify whether the touch-sensitive device (20) is coupled to the electronic device (100).

[0218] In one embodiment, the input management module (1420) can identify that the touch sensing device (20) is coupled to the electronic device (100) by detecting a change through a sensor, detecting the flow of a specific electrical signal, or receiving status information or a specific signal from the touch sensing device (20) via wireless communication (e.g., NFC, Bluetooth, etc.).

[0219] In one embodiment, the input management module (1420) may transmit the identification result to the IME module (1430) when it identifies whether the touch-sensitive device (20) is coupled to the electronic device (100).

[0220] In one embodiment, the IME module (1430) may activate the touch input mode control module (1440) when the identification result received from the input management module (1420) determines that the touch sensing device (20) is coupled to the electronic device (100).

[0221] In one embodiment, the IME module (1430) may activate the remote input mode control module (1460) if the identification result received from the input management module (1420) determines that the touch-sensitive device (20) is not coupled to the electronic device (100).

[0222] In one embodiment, the touch input mode control module (1440) may be activated by the IME module (1430) when the touch sensitive device (20) is coupled to the electronic device (100).

[0223] In one embodiment, the touch input mode control module (1440) can control the projection module to project a soft keyboard corresponding to the first keyboard layout (310) onto the projection surface (40).

[0224] In one embodiment, the touch input mode control module (1440) may determine to change the keyboard layout of the soft keyboard from the second keyboard layout (320) to the first keyboard layout (310), and control the projection module to project the soft keyboard corresponding to the first keyboard layout (310) onto the projection surface (40).

[0225] In one embodiment, the touch input mode control module (1440) may control the projection module to project a soft keyboard corresponding to the first keyboard layout (310) at the bottom of the layout on which content is being projected. In one embodiment, the touch input mode control module (1440) may control the projection module to stop projecting the content and project a soft keyboard corresponding to the first keyboard layout (310).

[0226] In one embodiment, the touch input mode control module (1440) may include a soft keyboard layout optimization module (1450).

[0227] In one embodiment, the soft keyboard layout optimization module (1450) can obtain various information (e.g., touch location information, touch count information, etc.) regarding the user's touch input on the soft keyboard corresponding to the projected first keyboard layout (310) via a data pin or wireless communication technology (e.g., NFC, Bluetooth, etc.) from the touch sensing device (20).

[0228] In one embodiment, the soft keyboard layout optimization module (1450) can detect a user's touch input error based on the acquired information about the user's touch location and the information about the number of times the user touches. In order to compensate for the detected user's touch input error, the soft keyboard layout optimization module (1450) can adjust at least one of the size, spacing, or position of the soft keys included in the soft keyboard corresponding to the first keyboard layout (310).

[0229] In one embodiment, the soft keyboard layout optimization module (1450) can receive image data capturing a user's touch input situation from a camera sensor (50).

[0230] In one embodiment, the soft keyboard layout optimization module (1450) may analyze the received image data to obtain information related to the user's hands. In one embodiment, the information related to the user's hands may include at least one of the following: the number of the user's hands, the position and orientation of the user's hands, whether the user's hands are left or right, the distance between the user's hands, or the length of the fingers included in the user's hands.

[0231] In one embodiment, the soft keyboard layout optimization module (1450) may determine the type of soft keyboard corresponding to the first keyboard layout (310) based on information related to the user's hand obtained, and adjust the size, spacing, or position of soft keys included in the soft keyboard corresponding to the first keyboard layout (310).

[0232] In one embodiment, the remote input mode control module (1460) may be activated by the IME module (1430) when the touch sensitive device (20) is not coupled to the electronic device (100).

[0233] In one embodiment, the remote input mode control module (1460) can control the projection module to project a soft keyboard corresponding to the second keyboard layout (320) onto the projection surface (40).

[0234] In one embodiment, the remote input mode control module (1460) may determine to change the keyboard layout of the soft keyboard from the first keyboard layout (310) to the second keyboard layout (320), and control the projection module to project the soft keyboard corresponding to the second keyboard layout (320) onto the projection surface (40).

[0235] In one embodiment, the remote input mode control module (1460) may control the projection module to project a soft keyboard corresponding to the second keyboard layout (320) at the bottom of the layout on which content is being projected. In one embodiment, the remote input mode control module (1460) may control the projection module to stop projecting the content and project a soft keyboard corresponding to the second keyboard layout (320).

[0236] According to one embodiment of the present disclosure, the processor (1400) can provide a method for dynamically configuring a soft keyboard layout that is most effective for the user based on the user's input method, thereby enabling the user to input more efficiently and conveniently.

[0237] Meanwhile, the block diagram of the processor (1400) illustrated in FIG. 14 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the processor (1400) actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0238] Fig. 15 is a block diagram of an electronic device (100) according to one embodiment.

[0239] Referring to FIG. 15, an electronic device (100) according to one embodiment may include a projection module (162), a memory (130), and at least one processor (110). However, the electronic device (100) may be implemented with more components than the illustrated components and is not limited to the examples described above. The components will now be described in turn.

[0240] The projection module (162) can project a graphic image onto a projection surface under the control of the processor (110). The projection module (162) may also be referred to as an optical module. The projection module (162) may also be referred to as a 'projection unit (162)' as a device element.

[0241] The memory (130) can store a program for processing and controlling at least one processor (110), and can store data input to or output from the electronic device (100).

[0242] The memory (130) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0243] A memory (130) according to one embodiment may include one or more instructions that perform the function of dynamically configuring a soft keyboard layout that is most effective for a user as disclosed in the present disclosure.

[0244] At least one processor (110) controls the overall operation of the electronic device (100). For example, at least one processor (110) may control the projection module 162 by executing one or more instructions stored in the memory (130), and may perform the functions of the electronic device (100) described in FIGS. 1 to 14.

[0245] The processor (110) may be composed of one or more processors. In this case, one or more processors may be a general-purpose processor, such as a CPU, AP, or DSP (Digital Signal Processor), a graphics-only processor, such as a GPU or VPU (Vision Processing Unit), or an artificial intelligence-only processor, such as an NPU. For example, if one or more processors are artificial intelligence-only processors, the artificial intelligence-only processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0246] The processor (110) may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits, including at least one processor. One or more processors within at least one processor (110) may be configured to perform various functions described herein, individually and / or collectively, in a distributed fashion. As used herein, “processor,” “at least one processor,” and “one or more processors” may be configured to perform multiple functions. However, these terms encompass, without limitation, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor may perform all of the functions. Furthermore, at least one processor (110) may include a combination of processors that perform various of the disclosed functions in a distributed manner. At least one processor (110) may execute program instructions to achieve or perform various functions.

[0247] In one embodiment, at least one processor (110) can identify whether a touch-sensitive device is coupled to the electronic device to detect a user's touch input on the soft keyboard. The touch-sensitive device is configured to be detachably coupled to the electronic device. Upon identifying that the touch-sensitive device is coupled to the electronic device, the at least one processor (110) can control the projection unit to project a soft keyboard corresponding to the first keyboard layout onto the projection surface.

[0248] In one embodiment, at least one processor (110) may control the projector to project a soft keyboard corresponding to the second keyboard layout onto the projection surface upon identifying that the touch-sensitive device is not coupled to the electronic device.

[0249] According to one embodiment, at least one processor (110) can control the projector to change the soft keyboard corresponding to the second keyboard layout to a soft keyboard corresponding to the first keyboard layout and project it upon identifying that the touch-sensitive device is coupled to the electronic device while projecting the soft keyboard corresponding to the second keyboard layout.

[0250] According to one embodiment, at least one processor (110) can control the projector to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout and project it upon identifying that the touch-sensitive device is detached from the electronic device while projecting the soft keyboard corresponding to the first keyboard layout.

[0251] According to one embodiment, the first keyboard layout may be a keyboard layout corresponding to a touch input mode, and the second keyboard layout may be a keyboard layout corresponding to a remote input mode.

[0252] According to one embodiment, at least one processor (110) can identify that the projection mode of the electronic device coupled with the touch-sensitive device has been switched from a floor projection mode to a wall projection mode. Upon identifying that the projection mode of the electronic device coupled with the touch-sensitive device has been switched to a wall projection mode, the at least one processor (110) can control the projection unit to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout and project the change.

[0253] According to one embodiment, at least one processor (110) can identify that the projection mode of an electronic device having a touch-sensitive device attached thereto has been switched from a floor projection mode to a wall projection mode. When the at least one processor (110) identifies that the projection mode of the electronic device having the touch-sensitive device attached thereto has been switched to a wall projection mode, the at least one processor (110) can deactivate the touch input mode. The at least one processor (110) can control a projection unit to project a user interface (UI) onto a projection surface that guides adjustment of a projection direction or a position of the electronic device to correspond to the wall projection mode or the floor projection mode.

[0254] According to one embodiment, at least one processor (110) may detect a user's touch input error based on information collected by a touch-sensitive device coupled to the electronic device. In order to compensate for the detected user's touch input error, the at least one processor (110) may adjust at least one of the size, spacing, or position of soft keys included in a soft keyboard corresponding to the first keyboard layout.

[0255] According to one embodiment, at least one processor (110) may obtain image data capturing a user's touch input behavior. The at least one processor (110) may analyze the image data to obtain information related to the user's hands. The information related to the user's hands may include at least one of the number of the user's hands, the positions and directions of the user's hands, whether the user's hands are left or right, the distance between the user's two hands, or the lengths of the fingers included in the user's hands. Based on the obtained information related to the user's hands, the at least one processor (110) may determine the type of a soft keyboard corresponding to the first keyboard layout, and adjust the size, spacing, or positions of soft keys included in the soft keyboard corresponding to the first keyboard layout.

[0256] In one embodiment, at least one processor (110) may analyze the image data and, if the user's hand is identified, control the projector to project a soft keyboard corresponding to the first keyboard layout. If the user's hand is not identified, the at least one processor (110) may analyze the image data and, if the user's hand is identified, control the projector to project a soft keyboard corresponding to the second keyboard layout or not to project a soft keyboard.

[0257] According to one embodiment of the present disclosure, an electronic device (100) can provide a method for dynamically configuring a soft keyboard layout that is most effective for a user based on the user's input method, thereby enabling the user to input more efficiently and conveniently.

[0258] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0259] Fig. 16 is a specific block diagram of an electronic device (100) according to one embodiment.

[0260] Referring to FIG. 16, the electronic device (100) may constitute, for example, all or part of the electronic device (100) illustrated in FIG. 15. The electronic device (100) may include at least one processor 110, a communication module 120, a memory 130, a sensor module 140, an input device 150, an optical module 160, an interface 170, an audio module 180, a camera module 191, an indicator 192, a motor 193, a power management module 194, a battery 195, and a wireless charging module 196.

[0261] At least one processor 110 may run an operating system or application program to control a plurality of hardware or software components connected to the processor 110 and perform various data processing and calculations, including multimedia data. The processor 110 may be implemented as, for example, a system on chip (SoC). The processor 110 may further include a GPU (graphics processing unit, not shown).

[0262] The communication module 120 can perform data transmission and reception in communication between the electronic device 100 and other electronic devices connected via the network 400, for example, peripheral devices 200 or servers 300. According to one embodiment, the communication module 120 can include a Wifi module 121, a BT module 122, and an RF (radio frequency) module 123.

[0263] The WiFi module 121 and the BT module 122 may include, for example, a processor that processes data transmitted and received through the corresponding module. In FIG. 4, the WiFi module 121 and the BT module 122 are each illustrated as separate blocks, but according to one embodiment, at least some of the WiFi module 121 or the BT module 122 may be included in one integrated chip (IC) or IC package. For example, at least some of the processors corresponding to each of the WiFi module 121 and the BT module 122 may be implemented as one SoC.

[0264] The RF module 123 can transmit and receive data, for example, RF signals. The RF module 123 may include, for example, a transceiver, a power amp module (PAM), a frequency filter, or a low noise amplifier (LNA), although not shown. In addition, the RF module 123 may further include components for transmitting and receiving electromagnetic waves in free space in wireless communication, for example, a conductor or a wire. In FIG. 4, the Wifi module 121 and the BT module 122 are shown as sharing one RF module 123, but according to one embodiment, at least one of the Wifi module 121 and the BT module 122 may transmit and receive RF signals through a separate RF module.

[0265] The memory 130 may include built-in memory 131. The built-in memory 131 may include, for example, at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.) or non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, NAND flash memory, NOR flash memory, etc.).

[0266] The memory 130 can store various data, programs, or applications that drive and control the electronic device 100 under the control of the processor 110. The memory 130 can store input / output signals or data corresponding to the driving of at least one processor 110, a communication module 120, a sensor module 140, an input device 150, an optical module 160, an interface 170, an audio module 180, a camera module 191, an indicator 192, a motor 193, a power management module 194, a battery 195, and a wireless charging module 196.

[0267] The sensor module 140 can measure a physical quantity or detect an operating state of the electronic device 100, and convert the measured or detected information into an electrical signal. The sensor module 140 may include, for example, at least one of a space detection sensor 140A, a gyro sensor 140B, an acceleration sensor 140C, an ultrasonic sensor 140D, an infrared sensor 140E, a hall sensor 140F, a proximity sensor 140G, and an illuminance sensor 140H. Additionally or alternatively, the sensor module 140 may include, for example, a gesture sensor, an olfactory sensor (E-nose sensor), an electromyography sensor (EMG sensor), an electroencephalogram sensor (EEG sensor), an electrocardiogram sensor (ECG sensor), an iris sensor or a fingerprint sensor, a pressure sensor, etc., although not shown. The sensor module 140 may further include a control circuit that controls at least one sensor included therein.

[0268] The input device 150 may include a key 151. The key 151 may include, for example, a physical button, an optical key, or a keypad. According to one embodiment, the electronic device 100 may also receive user input from an external device connected thereto using the communication module 120.

[0269] The optical module 160 may include a lighting module 161 and a projection module 162. The projection module 163 may project light onto a screen to display an image.

[0270] The projection module 162 can project light in various ways, including DLP, LCOS, 3LCD, LCD, and laser.

[0271] DLP is a projection display method that uses a digital micromirror display (DMD), which is a type of display element. The LCOS (Liquid Crystal on Silicon) method can also project using an LCOS panel that defines pixels by multiple scan lines and data lines, has liquid crystals with a specific molecular arrangement, and displays by transmitting and reflecting light input from the outside through the liquid crystals. The 3LCD method has three liquid crystal displays (LCDs) that the projector's lamp light source passes through, and the 3LCD uses 3LCDs of red, blue, and green that are divided into colors before the light from the lamp is expanded by a lens through the LCD panel. A projector can be implemented using the 3LCD method as described above. Alternatively, a projector using a single LCD panel, like an LCD, can be equipped. The laser method includes a light source composed of red, green, and blue laser light-emitting elements, a light tunnel into which laser light emitted from the light source enters, and a display element that projects an image on a screen using the laser light entered through the light tunnel. The light tunnel may include a projection module having a structure in which a synthesis module is formed inside the projection module that transmits or reflects some of the colors of the laser light emitted from the light source and synthesizes them, and a speckle removal unit that removes speckles by irregularly changing the phase of the laser light synthesized through the synthesis module.

[0272] The interface 170 may include, for example, a high-definition multimedia interface (HDMI) 171, a universal serial bus (USB) 172. The interface 170 may be included in, for example, a communication module 120. Additionally or alternatively, the interface 170 may include, for example, a mobile high-definition link (MHL) interface, a secure digital (SD) card / multi-media card (MMC) interface, or an infrared data association (IrDA) standard interface.

[0273] The audio module 180 can convert sound and electrical signals bidirectionally. The audio module 180 can process sound information input or output through, for example, a speaker 181 or a microphone 182182. According to one embodiment, the electronic device 100 may transmit audio to an external device using the BT module 122 included in the communication module 120 without the audio module 180.

[0274] The camera module 191 is a device capable of capturing still images and moving images, and according to one embodiment, may include one or more image sensors (e.g., a front sensor or a rear sensor), a lens (not shown), an image signal processor (ISP, not shown), or a flash (e.g., an LED or xenon lamp).

[0275] The camera module 191 receives images (e.g., consecutive frames) corresponding to a user's motion, including a gesture, within the camera's recognition range. For example, the camera module 191's recognition range may be a distance of 0.1 to 5 m from the camera module 191 to the user. The user's motion may include, for example, the user's face, facial expression, a part of the user's body, such as a hand, a fist, or a finger, or the motion of a part of the user.

[0276] Indicator 192 may indicate a particular status of the electronic device 100 or a portion thereof (e.g., processor 110), such as boot status, message status, or charging status.

[0277] Motor 193 can convert electrical signals into mechanical vibrations. Electronic device 100 may include a processing unit (e.g., a GPU) capable of supporting mobile TV, although not shown. The processing unit capable of supporting mobile TV may process media data according to standards such as DMB (digital multimedia broadcasting), DVB (digital video broadcasting), or media flow.

[0278] The power management module 194 can manage the power of the electronic device 100. The power management module 194 may include, for example, a power management integrated circuit (PMIC), a charger integrated circuit (IC), or a battery or fuel gauge, although not shown.

[0279] The power management module 194 can supply power to the optical module 160 to operate the optical module 160 when the electronic device 100 is located on the projection surface or approaches within a predetermined distance from the projection surface.

[0280] The power management module 194 can cut off power to the optical module 160 to prevent the optical module 160 from operating when the electronic device 100 does not approach within a predetermined distance from the projection surface.

[0281] A PMIC can be embedded, for example, in an integrated circuit or SoC semiconductor. Charging methods can be categorized as wired or wireless. A charging IC can charge a battery and prevent overvoltage or overcurrent from the charger. According to one embodiment, the charging IC may include a charging IC capable of at least one of wired charging and wireless charging.

[0282] The wireless charging module 196 may include a circuit capable of wireless charging, such as a coil loop, a resonant circuit, or a rectifier, and the wireless charging method may include, for example, a magnetic resonance method, a magnetic induction method, or an electromagnetic wave method.

[0283] The battery gauge may measure, for example, the remaining capacity of the battery 195, voltage, current, or temperature during charging. The battery 195 may store or generate electricity, and may use the stored or generated electricity to power the electronic device 100. The battery 195 may include, for example, a rechargeable battery or a solar battery.

[0284] Each of the aforementioned components of the electronic device (100) according to one embodiment of the present disclosure may be composed of one or more components, and the names of the corresponding components may vary depending on the type of the electronic device. The electronic device (100) according to one embodiment of the present disclosure may be composed of at least one of the aforementioned components, and some components may be omitted or additional other components may be further included. In addition, some of the components of the electronic device (100) according to one embodiment of the present disclosure may be combined to form a single entity, thereby performing the same functions as the corresponding components prior to combination.

[0285] A specific example for explaining an embodiment according to the present disclosure is only one combination of each criterion, method, detailed method, and operation, and through a combination of at least two or more of the various techniques described, the electronic device (100) provides a method for dynamically configuring the most effective soft keyboard layout for the user according to the user's input method, thereby enabling the user to input more efficiently and conveniently. In addition, at this time, it may be performed according to a method determined through one or a combination of at least two or more of the above-described techniques. For example, it may be possible to perform a part of the operation of one embodiment in combination with a part of the operation of another embodiment.

[0286] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0287] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0288] According to one embodiment of the present disclosure, an electronic device provides a method for dynamically configuring a soft keyboard layout that is most effective for the user based on the user's input method when projecting a soft keyboard, thereby enabling the user to input more efficiently and conveniently. However, the effects obtained from the present disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art to which the present disclosure pertains from other descriptions of the present disclosure.

Claims

1. In an electronic device (100), Projection Department (162); A memory (130) storing one or more instructions; and At least one processor (110) comprising a processing circuit, The at least one processor (110) individually or collectively executes the one or more instructions, Identifying whether a touch-sensitive device is coupled to the electronic device to detect a touch input on the user's soft keyboard (410), wherein the touch-sensitive device is configured to be detachably coupled to the electronic device, and An electronic device that controls the projection unit to project a soft keyboard corresponding to the first keyboard layout onto a projection surface (420) as the touch-sensitive device is identified as being coupled to the electronic device.

2. In the first paragraph, the at least one processor executes the one or more instructions, An electronic device that controls the projection unit to project a soft keyboard corresponding to a second keyboard layout onto the projection surface when the touch-sensitive device is identified as not being coupled to the electronic device.

3. In the first or second paragraph, the at least one processor executes the one or more instructions, An electronic device that, while projecting a soft keyboard corresponding to the second keyboard layout, controls the projection unit to change the soft keyboard corresponding to the second keyboard layout to a soft keyboard corresponding to the first keyboard layout and project it upon identifying that the touch-sensitive device is coupled to the electronic device.

4. In any one of the first to third paragraphs, the at least one processor executes the one or more instructions, An electronic device that, while projecting a soft keyboard corresponding to the first keyboard layout, controls the projection unit to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout and project it upon identifying that the touch-sensitive device is separated from the electronic device.

5. In paragraph 2, An electronic device wherein the first keyboard layout is a keyboard layout corresponding to a touch input mode, and the second keyboard layout is a keyboard layout corresponding to a remote input mode.

6. In any one of paragraphs 1 to 5, the at least one processor executes the one or more instructions, Identifying that the projection mode of the electronic device coupled with the touch sensing device has been switched from floor projection mode to wall projection mode, An electronic device that controls the projection unit to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout and project the soft keyboard upon identifying that the projection mode of the electronic device coupled with the touch sensing device has been switched to the wall projection mode.

7. In any one of paragraphs 1 to 6, the at least one processor executes the one or more instructions, Upon identifying that the projection mode of the electronic device coupled with the touch sensing device has been switched to the wall projection mode, the touch input mode is disabled, An electronic device that controls the projection unit to project a UI (user interface) on the projection surface that guides adjustment of the projection direction or the position of the electronic device to correspond to the wall projection mode or the floor projection mode.

8. In any one of paragraphs 1 to 7, the at least one processor executes the one or more instructions, Detecting a user's touch input error based on information collected by the touch sensing device coupled to the electronic device, An electronic device that adjusts at least one of the size, spacing, or position of soft keys included in a soft keyboard corresponding to the first keyboard layout to compensate for the detected user touch input error.

9. In any one of paragraphs 1 to 8, the at least one processor executes the one or more instructions, Obtain video data capturing the user's touch input behavior, By analyzing the above image data, information related to the user's hand is obtained, Information related to the user's hands includes at least one of the number of hands of the user, the position and direction of the user's hands, whether the user's hands are left-handed or right-handed, the distance between the user's two hands, or the length of the fingers included in the user's hands. An electronic device that determines the type of soft keyboard corresponding to the first keyboard layout based on the information related to the user's hand obtained above, and adjusts the size, spacing, or position of soft keys included in the soft keyboard corresponding to the first keyboard layout.

10. In the 9th paragraph, the at least one processor executes the one or more instructions, When the user's hand is identified by analyzing the image data, the projection unit is controlled to project a soft keyboard corresponding to the first keyboard layout. An electronic device that analyzes the image data and, if the user's hand is not identified, projects a soft keyboard corresponding to the second keyboard layout or controls the projection unit not to project the soft keyboard.

11. In the operating method (400) of the electronic device (100), A step (410) of identifying whether a touch-sensitive device is coupled to the electronic device to detect a touch input on the user's soft keyboard, wherein the touch-sensitive device is configured to be detachably coupled to the electronic device; and A method comprising the step of controlling a projector to project a soft keyboard corresponding to a first keyboard layout onto a projection surface, upon identification that the touch-sensitive device is coupled to the electronic device.

12. In paragraph 11, A method further comprising the step of controlling the projection unit to project a soft keyboard corresponding to a second keyboard layout onto the projection surface when the touch-sensitive device is identified as not being coupled to the electronic device.

13. In paragraph 11 or 12, A method further comprising the step of controlling the projection unit to change the soft keyboard corresponding to the second keyboard layout to a soft keyboard corresponding to the first keyboard layout and project it upon identifying that the touch-sensitive device is coupled to the electronic device while projecting the soft keyboard corresponding to the second keyboard layout.

14. In any one of paragraphs 11 to 13, A method further comprising the step of controlling the projection unit to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout and project it when the touch-sensitive device identifies that the touch-sensitive device is separated from the electronic device while projecting the soft keyboard corresponding to the first keyboard layout.

15. A computer-readable recording medium having recorded thereon at least one program for implementing the method described in any one of claims 11 to 14.

Images