Electronic device and method of operating the same

Abstract

An electronic device having a projection unit and an operating method thereof are provided. The electronic device includes a projection unit, a memory for storing one or more instructions, and at least one processor for executing the one or more instructions stored in the memory. The processor(s), individually or collectively, executes the one or more instructions to identify whether a touch sensing device is coupled to the electronic device to detect a touch input of a user on a soft keyboard. The touch sensing device is configured to be detachably coupled to the electronic device. The processor(s), individually or collectively, executes the one or more instructions to control the projection unit to project a soft keyboard corresponding to a first keyboard layout on a projection surface based on identifying that the touch sensing device is coupled to the electronic device.

Description

Technical Field

[0001] This disclosure relates to electronic devices and methods of operating thereof, and more specifically, to electronic devices including a projection module and methods of operating thereof. Background Technology

[0002] With the latest developments in mobile communication technology, portable electronic devices such as smartphones and tablet PCs can be easily carried and support various functions, such as making calls, sending and receiving messages, accessing the internet, and chatting. These portable electronic devices include a display and a touch panel for receiving user input. The touch panel of a portable electronic device allows users to perform various inputs by touching a soft keyboard on the display.

[0003] However, there are limitations in increasing the display size of portable electronic devices. Therefore, various typing errors are likely to occur when using a user's on-screen keyboard, and it may be less efficient in terms of speed and accuracy compared to using a conventional keyboard. In the case of tablet PCs, in particular, part of the display is hidden by the on-screen keyboard.

[0004] In addition, users must manually manipulate the settings in order to change the soft keyboard layout or manipulate the configuration of the soft keys included in the soft keyboard layout.

[0005] To address the aforementioned issues, this disclosure provides a method for dynamically configuring the most effective soft keyboard layout for the user based on the user's input method when projecting a soft keyboard onto an electronic device, allowing the user to perform input more efficiently and conveniently. Summary of the Invention

[0006] According to embodiments of the present disclosure, an electronic device is provided, including: a projection component; at least one processor including processing circuitry; and a memory storing one or more instructions, which, when executed individually or jointly by the at least one processor, cause the electronic device to be configured to: identify whether a touch sensing device is coupled to the electronic device to sense touch input from a user on a soft keyboard, wherein the touch sensing device is configured to be detachably coupled to the electronic device, and based on the identification that the touch sensing device is coupled to the electronic device, control the projection component to project a soft keyboard corresponding to a first keyboard layout onto a projection plane.

[0007] The memory can store one or more instructions that, when executed individually or jointly by at least one processor, cause the electronic device to further: based on the recognition that the touch sensing device is not coupled to the electronic device, control the projection component to project a soft keyboard corresponding to the second keyboard layout onto the projection plane.

[0008] The memory can store one or more instructions that, when executed individually or jointly by at least one processor, cause the electronic device to further: based on recognizing that a touch sensing device is coupled to the electronic device when projecting a soft keyboard corresponding to a second keyboard layout, control the projection component to change the soft keyboard corresponding to the second keyboard layout to a soft keyboard corresponding to a first keyboard layout, and project the soft keyboard corresponding to the first keyboard layout.

[0009] The memory can store one or more instructions that, when executed individually or jointly by at least one processor, cause the electronic device to further: based on recognizing that the touch sensing device is separated from the electronic device when projecting a soft keyboard corresponding to a first keyboard layout, control the projection component to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to a second keyboard layout and project the soft keyboard corresponding to the second keyboard layout.

[0010] The first keyboard layout can be a keyboard layout corresponding to the touch input mode, and the second keyboard layout can be a keyboard layout corresponding to the remote input mode.

[0011] The memory may store one or more instructions that, when executed individually or jointly by at least one processor, cause the electronic device to further: recognize that the projection mode of the electronic device coupled to the touch sensing device has switched from a ground projection mode to a wall projection mode; and based on recognizing that the projection mode of the electronic device coupled to the touch sensing device has switched to the wall projection mode, control the projection component to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout, and project the soft keyboard corresponding to the second keyboard layout.

[0012] The memory may store one or more instructions that, when executed individually or jointly by at least one processor, cause the electronic device to further: recognize that the projection mode of the electronic device coupled to the touch sensing device has switched from a ground projection mode to a wall projection mode; disable the touch input mode based on the recognition that the projection mode of the electronic device coupled to the touch sensing device has switched to the wall projection mode; and control the projection component to project a user interface (UI) onto the projection plane, wherein the UI guides the adjustment of the projection direction or position of the electronic device to correspond to the wall projection mode or the ground projection mode.

[0013] The memory may store one or more instructions that, when executed individually or jointly by at least one processor, cause the electronic device to further: detect errors in the user's touch input based on information collected by a touch sensing device coupled to the electronic device; and adjust at least one of the size, spacing, or position of the soft keys included in the soft keyboard corresponding to the first keyboard layout to compensate for the detected errors in the user's touch input.

[0014] The memory may store one or more instructions that, when executed individually or jointly by at least one processor, cause the electronic device to further: acquire image data capturing a user's touch input activity; obtain information related to the user's hand by analyzing the image data, wherein the information related to the user's hand includes at least one of the following: the number of the user's hands, the position and orientation of the user's hands, whether the user's hands are left or right, the spacing between the user's two hands, and the length of the fingers included in the user's hands; and determine, based on the obtained information related to the user's hand, the type of soft keyboard corresponding to a first keyboard layout; and adjust the size, spacing, or position of the soft keys included in the soft keyboard corresponding to the first keyboard layout.

[0015] The memory may store one or more instructions that, when executed individually or jointly by at least one processor, cause the electronic device to further: control the projection component to project a soft keyboard corresponding to a first keyboard layout based on the identification of a user's hand by analyzing image data; and control the projection component to project a soft keyboard corresponding to a second keyboard layout or not project a soft keyboard based on the failure to identify a user's hand by analyzing image data.

[0016] According to embodiments of this disclosure, an operation method for an electronic device is provided. The operation method includes identifying whether a touch sensing device is coupled to the electronic device to sense touch input from a user on a soft keyboard. The touch sensing device is configured to be detachably coupled to the electronic device. The operation method includes, based on identifying that the touch sensing device is coupled to the electronic device, controlling a projection component to project a soft keyboard corresponding to a first keyboard layout onto a projection plane.

[0017] The method may further include: based on the identification that the touch sensing device is not coupled to the electronic device, controlling the projection component to project a soft keyboard corresponding to the second keyboard layout onto the projection plane.

[0018] The method may further include: based on recognizing that a touch sensing device is coupled to an electronic device when projecting a soft keyboard corresponding to a second keyboard layout, controlling the projection component to change the soft keyboard corresponding to the second keyboard layout to a soft keyboard corresponding to a first keyboard layout, and projecting a soft keyboard corresponding to the first keyboard layout.

[0019] The method may further include: based on recognizing that when the touch sensing device is separated from the electronic device during the projection of a soft keyboard corresponding to the first keyboard layout, controlling the projection module to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout and projecting the soft keyboard corresponding to the second keyboard layout.

[0020] The first keyboard layout can be a keyboard layout corresponding to the touch input mode, and the second keyboard layout can be a keyboard layout corresponding to the remote input mode.

[0021] The method may further include: identifying that the projection mode of the electronic device coupled to the touch sensing device is switched from a ground projection mode to a wall projection mode; and based on the identification that the projection mode of the electronic device coupled to the touch sensing device is switched to the wall projection mode, controlling the projection module to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout, and projecting the soft keyboard corresponding to the second keyboard layout.

[0022] The method may further include: identifying that the projection mode of the electronic device coupled to the touch sensing device has switched from a ground projection mode to a wall projection mode; disabling the touch input mode based on the identification that the projection mode of the electronic device coupled to the touch sensing device has switched to the wall projection mode; and controlling the projection module to project a user interface (UI) onto the projection plane, wherein the UI guides the adjustment of the projection direction or position of the electronic device to correspond to the wall projection mode or the ground projection mode.

[0023] The method may further include: detecting errors in the user's touch input based on information collected by a touch sensing device coupled to an electronic device; and adjusting at least one of the size, spacing, or position of soft keys included in a soft keyboard corresponding to a first keyboard layout to compensate for the detected errors in the user's touch input.

[0024] The method may further include: acquiring image data capturing a user's touch input activity; analyzing the image data to obtain information related to the user's hands, wherein the information related to the user's hands includes at least one of the following: the number of the user's hands, the position and orientation of the user's hands, whether the user's hands are left or right, the spacing between the user's two hands, and the length of the fingers included in the user's hands; determining the type of soft keyboard corresponding to a first keyboard layout based on the obtained information related to the user's hands; and adjusting the size, spacing, or position of the soft keys included in the soft keyboard corresponding to the first keyboard layout.

[0025] Embodiments of this disclosure may provide a computer-readable recording medium having a program recorded thereon for causing a computer to execute at least one embodiment of the method disclosed as a technical means of solving the above-described technical problems.

[0026] Other technical features can be readily understood by those skilled in the art based on the accompanying drawings, description, and claims. Attached Figure Description

[0027] Figure 1 The present disclosure illustrates the concept of an electronic device according to embodiments thereof.

[0028] Figure 2a and Figure 2b An example of a coupling method between an electronic device and a touch sensing device according to an embodiment of the present disclosure is shown.

[0029] Figure 2c A method for receiving information about a user's touch position from a touch sensing device, performed by an electronic device according to an embodiment of the present disclosure, is illustrated.

[0030] Figure 3a An example of a first keyboard layout corresponding to a touch input mode according to an embodiment of the present disclosure is shown.

[0031] Figure 3b An example of a second keyboard layout corresponding to a remote input mode according to an embodiment of the present disclosure is shown.

[0032] Figure 4 This is a flowchart of an operation method of an electronic device according to an embodiment of the present disclosure.

[0033] Figure 5 The operation of an electronic device according to an embodiment of the present disclosure is illustrated when a touch sensing device is coupled to the electronic device.

[0034] Figure 6 The operation of an electronic device according to an embodiment of the present disclosure is illustrated when the touch sensing device is separated from the electronic device.

[0035] Figure 7a A ground projection mode of an electronic device according to an embodiment of the present disclosure is shown.

[0036] Figure 7b A wall projection mode of an electronic device according to an embodiment of the present disclosure is shown.

[0037] Figure 8 The operation of an electronic device according to an embodiment of the present disclosure is illustrated when the projection mode of the electronic device is switched from a ground projection mode to a wall projection mode.

[0038] Figure 9 The operation of an electronic device according to an embodiment of the present disclosure is illustrated when the projection mode of the electronic device is switched from a ground projection mode to a wall projection mode.

[0039] Figure 10a and Figure 10b An example of how an electronic device operates when it detects an error in touch input, according to an embodiment of the present disclosure, is shown.

[0040] Figures 11a to 11e An example of a type of soft keyboard layout based on information related to the user's hands, according to an embodiment of this disclosure, is shown.

[0041] Figure 12 This is a flowchart of an operation method of an electronic device according to an embodiment of the present disclosure.

[0042] Figure 13a The operation of an electronic device according to an embodiment of the present disclosure is illustrated when the electronic device recognizes a user's hand.

[0043] Figure 13b The operation of an electronic device according to an embodiment of the present disclosure is shown when the electronic device does not recognize the user's hand.

[0044] Figure 14 This is a block diagram of a processor according to an embodiment of the present disclosure.

[0045] Figure 15 This is a block diagram of an electronic device according to an embodiment of the present disclosure.

[0046] Figure 16 This is a detailed block diagram of an electronic device according to embodiments of the present disclosure. Detailed Implementation

[0047] Regarding the terminology used in this disclosure, as many commonly used terms as possible that are currently widely used have been selected when considering the functionality of this disclosure. However, depending on the intent of those skilled in the art, precedents, the emergence of new technologies, etc., these terms may refer to a variety of other terms. Furthermore, in certain cases, there are terms that are arbitrarily chosen by the applicant. In such cases, the meaning of these terms will be described in detail in the description of embodiments of this disclosure. Therefore, the terminology used herein should be defined based on the meaning of the terms and the description of the entire disclosure, rather than simply based on the names of the terms.

[0048] The terminology used in this disclosure is only for describing specific embodiments of this disclosure and is not intended to limit this disclosure.

[0049] Unless the context clearly indicates otherwise, the singular form used herein is intended to include the plural form as well. All terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art.

[0050] Throughout this disclosure, unless otherwise stated, the expression "a portion includes a certain element" means that the portion also includes other elements, not excludes other elements. Furthermore, terms such as "unit" and "module" described in the specification mean a unit that performs at least one function or operation and can be implemented as hardware, software, or a combination of hardware and software.

[0051] In addition to their primary functions, each of the elements described below may additionally perform some or all of the functions that other elements are responsible for, and some of the primary functions that each element is responsible for may be undertaken by other elements.

[0052] Depending on the context, the expression “configured to” as used herein may be used interchangeably with, for example, “suitable for,” “capable of,” “designed to,” “suitable for,” “manufactured as,” or “capable of.”

[0053] The term "configured as" may not necessarily mean that it is "specifically designed" in terms of hardware. Rather, in some cases, the expression "a system configured as..." can indicate that the system, together with other devices or components, is "capable of...".

[0054] Furthermore, when an element is referred to as being “connected” or “coupled” to another element, the element may be directly connected or coupled to the other element; however, it will be understood that, unless the context explicitly states otherwise, these elements may be connected or coupled to each other via an intermediate element therebetween. Furthermore, it will be understood that when a part is referred to as being “connected to” another part, it may be “directly connected to” or “electrically connected to” the other part, and there may be an intermediate part between them.

[0055] In this specification, the term "described" and similar indicative words, particularly as used in the patent claims, may refer to both the singular and plural. The operations constituting the method may be performed in any suitable order unless otherwise stated herein or clearly contradicted by the context, and are not necessarily limited to such an order. This disclosure is not limited by the order of operations described herein.

[0056] The phrase "in embodiments of this disclosure" appearing throughout this specification does not necessarily refer to the same embodiments.

[0057] Some embodiments of this disclosure can be represented by functional block configurations and various processes. Some or all of these functional blocks can be implemented in any number of hardware and / or software configurations performing a particular function. For example, the functional blocks of this disclosure can be implemented by one or more microprocessors, or by circuit configurations for certain functions. Furthermore, for example, the functional blocks of this disclosure can be implemented in various programming or scripting languages. Functional blocks can be implemented as algorithms to be executed by one or more processors. Furthermore, this disclosure can employ conventional techniques for electronic environment setup, signal processing, and / or data processing.

[0058] To clearly explain this disclosure, parts irrelevant to the description have been omitted from the drawings, and similar reference numerals have been assigned to similar parts throughout the specification. Furthermore, the reference numerals used in the drawings are for descriptive purposes only, and different reference numerals used in different drawings are not intended to indicate different elements. Additionally, the connecting lines or connecting members shown in the drawings are intended to indicate functional connections and / or physical or electrical connections. In actual devices, the connecting lines or connecting members shown in the drawings may represent various alternative or additional functional, physical, or electrical connections.

[0059] In describing embodiments of this disclosure, detailed descriptions of related known functions or configurations may be omitted herein when it is determined that such detailed descriptions would unnecessarily obscure the gist of the disclosure. Throughout this disclosure, the expression "at least one of a, b, and c" indicates only a, only b, only c, both a and b, both a and c, both b and c, all of a, b, and c, or variations thereof. Furthermore, the numbers used in the description (e.g., first, second, etc.) are merely identifiers used to distinguish one element from another.

[0060] In the following, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, enabling those skilled in the art to readily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.

[0061] As used herein, the term "user" refers to a person who controls the function or operation of an electronic device by using a control device, and may include consumers, evaluators, viewers, administrators, or installers.

[0062] Figure 1 The concept of an electronic device 100 according to an embodiment of the present disclosure is illustrated.

[0063] refer to Figure 1 According to embodiments of the present disclosure, the electronic device 100 can identify whether the touch sensing device 20 is coupled to the electronic device 100.

[0064] An electronic device 100 according to an embodiment of the present disclosure may be detachably coupled to a touch sensing device 20.

[0065] The touch sensing device 20 according to embodiments of the present disclosure is an external device distinguishable from the electronic device 100, and may refer to a device configured to sense touch input from a user's soft keyboard. For example, the touch sensing device 20 may include an internal radio (IR) camera and an IR laser, but the present disclosure is not limited thereto.

[0066] Electronic device 100 can obtain various information (e.g., touch location information, touch count information, etc.) about the user's touch input on the soft keyboard layout corresponding to the projected first keyboard layout 30 from touch sensing device 20 via data pins or wireless communication technologies (e.g., near field communication (NFC), Bluetooth, etc.).

[0067] In embodiments of this disclosure, the coupling between the electronic device 100 and the touch sensing device 20 can refer to the electronic device 100 and the touch sensing device 20 being detachably coupled to each other. For example, the coupling between the electronic device 100 and the touch sensing device 20 can refer to a state where the electronic device 100 and the touch sensing device 20 can be physically attached to each other, but can be separated from each other at any time. (Refer to...) Figure 2a and Figure 2b This will be described in detail.

[0068] When a user wants to perform touch input via a soft keyboard using their body (e.g., hand) instead of a remote control, the touch sensing device 20 can be coupled to the electronic device 100.

[0069] When the electronic device 100 according to an embodiment of the present disclosure recognizes that the touch sensing device 20 is coupled to the electronic device 100, the electronic device 100 can control the projection module to project a soft keyboard corresponding to the first keyboard layout 30 onto the projection plane 40.

[0070] In embodiments of this disclosure, the first keyboard layout 30 may refer to the keyboard layout of a soft keyboard corresponding to the touch input mode of the electronic device 100. The first keyboard layout 30 may refer to a keyboard layout configuration of the soft keyboard that is more advantageous / suitable / better for touch input using the user's body (e.g., hand) (e.g., touch input mode) than for input using a remote control (e.g., remote input mode). For example, the first keyboard layout 30 may include a QWERTY keyboard layout, but this disclosure is not limited thereto.

[0071] When electronic device 100 recognizes that touch sensing device 20 is coupled to electronic device 100, electronic device 100 can predict / determine / determine that the user will use his / her body (e.g., hand) to perform input (e.g., touch input mode) instead of using a remote control to perform input (e.g., remote input mode). Therefore, electronic device 100 can determine the soft keyboard layout as a first keyboard layout 30 corresponding to the touch input mode, and can control the projection module to automatically project the first keyboard layout 30 onto the projection plane.

[0072] This solves the inconvenience of having to perform additional settings to change the keyboard layout of the soft keyboard to be favorable / suitable for touch input when a user wants to perform touch input via the soft keyboard using the electronic device 100.

[0073] According to embodiments of this disclosure, electronic device 100 provides a method for dynamically configuring the most effective soft keyboard layout for the user based on the user's input method, thereby allowing the user to perform input more efficiently and conveniently.

[0074] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0075] Figure 2a and Figure 2b This is a diagram illustrating an example of a coupling method between an electronic device 100 and a touch sensing device 20 according to an embodiment of the present disclosure.

[0076] refer to Figure 2a and Figure 2b The electronic device 100 according to an embodiment of the present disclosure can be detachably coupled to the touch sensing device 20.

[0077] The touch sensing device 20 according to embodiments of the present disclosure is an external device distinguishable from the electronic device 100, and may refer to a device configured to sense touch input from a user's soft keyboard. For example, the touch sensing device 20 may include an IR camera, but the present disclosure is not limited thereto.

[0078] In embodiments of this disclosure, the coupling between the electronic device 100 and the touch sensing device 20 can refer to the electronic device 100 and the touch sensing device 20 being detachably coupled to each other. For example, the coupling between the electronic device 100 and the touch sensing device 20 can refer to a state in which the electronic device 100 and the touch sensing device 20 can be physically attached to each other, but can be separated from each other at any time.

[0079] An electronic device 100 and a touch sensing device 20 according to embodiments of the present disclosure may include a coupling member 10 for detachably coupling the electronic device 100 and the touch sensing device 20 to each other. A user can physically attach the touch sensing device 20 to the electronic device 100 by using the coupling member 10, or physically detach the touch sensing device 20 from the electronic device 100 by using the coupling member 10.

[0080] The coupling component 10 according to embodiments of the present disclosure may refer to any component capable of physically and detachably coupling the electronic device 100 and the touch sensing device 20 to each other. For example, the coupling component 10 may include a magnetic connector or a Universal Serial Bus (USB) port, but the present disclosure is not limited thereto.

[0081] refer to Figure 2a The coupling component 10 according to embodiments of the present disclosure may include magnetic connectors 21a and 22a. An electronic device 100 according to embodiments of the present disclosure may include magnetic connector 22a as a coupling component 10 for detachable coupling to a touch sensing device 20. When a user brings the touch sensing device 20 close to the electronic device 100, an attractive force can act between the magnetic connectors 21a and 22a, thus physically coupling the electronic device 100 and the touch sensing device 20 to each other. When the user pulls the touch sensing device 20 away from the electronic device 100, the electronic device 100 and the touch sensing device 20 can physically separate from each other.

[0082] When electronic device 100 receives a specific signal indicating that touch sensing device 20 is coupled to electronic device 100 via a sensor, circuit or data pin included in magnetic connectors 21a and 22a or a wireless communication technology (e.g., NFC, Bluetooth, etc.) integrated in magnetic connectors 21a and 22a, electronic device 100 can recognize that touch sensing device 20 is coupled to electronic device 100 and can obtain various information (e.g., touch position information, touch count information, etc.) about the user's touch input on the soft keyboard layout corresponding to the first keyboard layout 30 from touch sensing device 20.

[0083] When the electronic device 100 according to an embodiment of the present disclosure recognizes that the touch sensing device 20 is coupled to the electronic device 100 through the magnetic connector 22a, the electronic device 100 can control the projection module to project a soft keyboard corresponding to the first keyboard layout 30 onto the projection plane 40.

[0084] refer to Figure 2bThe coupling component 10 according to embodiments of the present disclosure may include USB ports 21b and 22b. The electronic device 100 according to embodiments of the present disclosure may include USB port 22b as a coupling component 10 for detachable coupling to the touch sensing device 20. When a user inserts the USB port 21b of the touch sensing device 20 into the USB port 22b of the electronic device 100, the electronic device 100 and the touch sensing device 20 can be physically coupled to each other. When the user pulls the touch sensing device 20 in a direction away from the electronic device 100, the electronic device 100 and the touch sensing device 20 can be physically separated from each other.

[0085] When electronic device 100 receives a specific signal indicating that touch sensing device 20 is coupled to electronic device 100 via a sensor, circuit, or data pin included in USB ports 21b and 22b or a wireless communication technology (e.g., NFC, Bluetooth, etc.) integrated in USB ports 21b and 22b, electronic device 100 can recognize that touch sensing device 20 is coupled to electronic device 100 and can obtain various information (e.g., touch position information, touch count information, etc.) about the user's touch input on the soft keyboard layout corresponding to the first keyboard layout 30 from touch sensing device 20.

[0086] When the electronic device 100 according to an embodiment of the present disclosure recognizes that the touch sensing device 20 is coupled to the electronic device 100 through the USB port 22b, the electronic device 100 can control the projection module to project a soft keyboard corresponding to the first keyboard layout 30 onto the projection plane 40.

[0087] Figure 2c This is a diagram illustrating a method performed by an electronic device 100 to receive information about a user's touch position from a touch sensing device 20, according to an embodiment of the present disclosure.

[0088] refer to Figure 2c In embodiments of this disclosure, the electronic device 100 may include an IR light emitter 60. When the touch sensing device 20 is coupled to the electronic device 100, the IR light emitter 60 of the electronic device 100 can generate an IR field on the same plane as the bottom surface of the electronic device 100.

[0089] The touch sensing device 20 can use an IR camera to determine the location where the user touches the soft keyboard, that is, the location of the user's touch input on the soft keyboard.

[0090] When a user touches the projected soft keyboard, the touch sensing device 20 can use an IR camera to sense IR interference occurring in the IR field. Therefore, the touch sensing device 20 can determine the location where the user touches the soft keyboard.

[0091] Electronic device 100 can receive information about the user's touch position from touch sensing device 20 via data pins or wireless communication technology, including the result of determining the user's touch input position on the soft keyboard.

[0092] Therefore, when the electronic device 100 is in ground projection mode 710, the projection plane on which the soft keyboard is projected and the plane on which the IR field is generated (the bottom surface of the electronic device 100) almost coincide, which is suitable for the user to perform touch input. On the other hand, when the electronic device 100 is in wall projection mode 720, the projection plane on which the soft keyboard is projected and the plane on which the IR field is generated (the bottom surface of the electronic device 100) are spaced apart, which is not suitable for the user to perform touch input, but is suitable for the user to perform remote input. (Refer to...) Figure 7a and Figure 7b This will be described in detail.

[0093] According to embodiments of this disclosure, electronic device 100 can be detachably coupled to touch sensing device 20 via various coupling components. Once touch sensing device 20 is coupled to electronic device 100, electronic device 100 automatically projects a soft keyboard layout corresponding to the touch input mode. Therefore, when a user wants to perform soft keyboard touch input, the user can automatically perform touch input by simply attaching touch sensing device 20 to electronic device 100 without any additional setup.

[0094] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0095] Figure 3a This is a diagram illustrating an example of a first keyboard layout 310 corresponding to a touch input mode according to an embodiment of the present disclosure. Figure 3a The first keyboard layout 310 can be used as a reference. Figure 1 The first keyboard layout is 30.

[0096] refer to Figure 3a According to the embodiments of the present disclosure, the first keyboard layout 310 may refer to the keyboard layout of a soft keyboard corresponding to the touch input mode of the electronic device 100.

[0097] The first keyboard layout 310 may refer to a keyboard layout configuration in which the soft keyboard is more advantageous / suitable / superior for touch input using the user's body (e.g., hand) (e.g., touch input mode) than for input using a remote control (e.g., remote input mode).

[0098] For example, the first keyboard layout 310 may include one of the following: QWERTY layout, DVORAK layout, COLEMAK layout, QWERTZ layout, AZERTY layout, Hangul 2-beol layout, Hangul 3-beol layout, or JIS layout, but this disclosure is not limited thereto.

[0099] Figure 3a The example shown is only an example of a first keyboard layout 310. The first keyboard layout 310 may include various soft keys that are advantageous / suitable for user touch input. The soft keys included in the first keyboard layout 310 may have various layouts that are advantageous / suitable for user touch input.

[0100] Figure 3b This is a diagram illustrating an example of a second keyboard layout 320 corresponding to a remote input mode according to an embodiment of the present disclosure.

[0101] refer to Figure 3b According to embodiments of the present disclosure, the second keyboard layout 320 may refer to the keyboard layout of a soft keyboard corresponding to the remote input mode of the electronic device 100.

[0102] The second keyboard layout 320 may refer to a keyboard layout configuration that is more advantageous / suitable / superior for touch input using a remote control (e.g., remote input mode) than for touch input using a user's body (e.g., hand) (e.g., touch input mode).

[0103] For example, the second keyboard layout 320 may include one of the following: Moaki layout, Cheonjiin layout, Naratgeul layout, SkyHangul layout, or a 10-key layout with an added alphabet.

[0104] Figure 3b The example shown is only an example of the second keyboard layout 320. The second keyboard layout 320 may include various soft keys that are advantageous / suitable for input using a remote control. The soft keys included in the second keyboard layout 320 may have various layouts that are advantageous / suitable for input using a remote control.

[0105] In embodiments of this disclosure, the electronic device 100 may take into account the average hand size of a user and project a soft keyboard corresponding to the first keyboard layout 310 at a smaller size than the soft keyboard corresponding to the second keyboard layout 320.

[0106] Figure 4 This is a flowchart describing an operation method 400 of an electronic device 100 according to an embodiment of the present disclosure.

[0107] refer to Figure 4In operation 410, the electronic device 100 according to an embodiment of the present disclosure can identify whether a touch sensing device 20, which can be detachably coupled to the electronic device, is coupled to the electronic device 100 to sense touch input from a user on a soft keyboard. In this case, the coupling between the touch sensing device 20 and the electronic device 100 can refer to a detachable coupling between the touch sensing device 20 and the electronic device 100. The electronic device 100 may include a coupling member 10 for detachable coupling to the touch sensing device 20.

[0108] In embodiments of this disclosure, the electronic device 100 can identify its coupling to the touch sensing device 20 using a magnetic sensor or a contact sensor. In embodiments of this disclosure, when the touch sensing device 20 is coupled to the electronic device 100, the electronic device 100 can identify its coupling by sensing a circuit connection and the flow of a specific electrical signal through the circuit. In embodiments of this disclosure, the electronic device 100 can identify its coupling to the touch sensing device 20 by exchanging status information or specific signals with the touch sensing device 20 via wireless communication (e.g., NFC, Bluetooth, etc.).

[0109] In operation 420, when the electronic device 100 according to an embodiment of the present disclosure recognizes that the touch sensing device 20 is coupled to the electronic device 100, the electronic device 100 can control the projection module to project a soft keyboard corresponding to the first keyboard layout 310 onto the projection plane 40.

[0110] In embodiments of this disclosure, the electronic device 100 may control the projection module not to project a soft keyboard before the touch sensing device 20 is coupled to it, and when the electronic device 100 recognizes / senses / detects the touch sensing device 20 being coupled to it, it projects a soft keyboard corresponding to the first keyboard layout 310 onto the projection plane 40.

[0111] In embodiments of this disclosure, the first keyboard layout 310 may refer to the keyboard layout of a soft keyboard corresponding to the touch input mode of the electronic device 100. The first keyboard layout 310 may refer to a keyboard layout configuration of the soft keyboard that is more advantageous / suitable / better for touch input using the user's body (e.g., hand) (e.g., touch input mode) than for input using a remote control (e.g., remote input mode). For example, the first keyboard layout 310 may include one of the following: QWERTY layout, DVORAK layout, COLEMAK layout, QWERTZ layout, AZERTY layout, Hangul 2-beol layout, Hangul 3-beol layout, or JIS layout, but this disclosure is not limited thereto.

[0112] In operation 430, when the electronic device 100 according to an embodiment of the present disclosure recognizes that the touch sensing device 20 is not coupled to the electronic device 100, the electronic device 100 can control the projection module to project a soft keyboard corresponding to the second keyboard layout 320 onto the projection plane 40.

[0113] In embodiments of this disclosure, when the touch sensing device 20 is not coupled to the electronic device 100, the electronic device 100 can predict / determine that the user is using the electronic device 100 in a remote input mode, and can control the projection module to project a soft keyboard corresponding to the second keyboard layout 320 onto the projection plane 40.

[0114] In embodiments of this disclosure, the second keyboard layout 320 may refer to the keyboard layout of a soft keyboard corresponding to the remote input mode of the electronic device 100. The second keyboard layout 320 may refer to a keyboard layout configuration of the soft keyboard that is more advantageous / suitable / better for touch input using a remote control (e.g., remote input mode) than for touch input using a user's body (e.g., hand) (e.g., touch input mode). For example, the second keyboard layout 320 may include one of the following: Moaki layout, Cheonjiin layout, Naratgeul layout, Sky Hangul layout, or a 10-key layout with an added alphabet.

[0115] In embodiments of this disclosure, when the electronic device 100 receives a signal indicating a request to display a soft keyboard while projecting content (e.g., when a user selects a search function, etc.), the electronic device 100 can control the projection module to project a soft keyboard corresponding to the first keyboard layout 310 for operation 420 or a soft keyboard corresponding to the second keyboard layout 320 for operation 430 at the lower end of the layout.

[0116] In embodiments of this disclosure, when the electronic device 100 receives a signal indicating a request to display a soft keyboard while projecting content (e.g., when the user selects a search function, etc.), the electronic device 100 can control the projection module to stop projecting content and project the soft keyboard corresponding to the first keyboard layout 310 in operation 420 or the soft keyboard corresponding to the second keyboard layout 320 in operation 430.

[0117] According to embodiments of this disclosure, electronic device 100 can allow users to perform input more efficiently and conveniently by providing a method for dynamically configuring the most effective soft keyboard layout for the user based on the user's input method when projecting content.

[0118] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0119] Figure 5This is a diagram illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure when a touch sensing device 20 is coupled to the electronic device 100.

[0120] refer to Figure 5 In the embodiments of this disclosure, when the touch sensing device 20 is coupled to the electronic device 100 when the soft keyboard corresponding to the second keyboard layout 320 is projected, the electronic device 100 can change the keyboard layout of the soft keyboard layout from the second keyboard layout 320 to the first keyboard layout 310.

[0121] In embodiments of this disclosure, the electronic device 100 can control the projection module to project a soft keyboard layout corresponding to the second keyboard layout 320 until the touch sensing device 20 is coupled to the electronic device 100, so that when the electronic device 100 recognizes / senses / detects that the touch sensing device 20 is coupled to the electronic device 100, the keyboard layout of the soft keyboard layout is changed to the first keyboard layout 310, and a soft keyboard corresponding to the first keyboard layout 310 is projected on the projection plane 40.

[0122] For example, it's possible that a user, in remote input mode, uses electronic device 100 to perform soft keyboard input via a remote control, significantly improving input speed and accuracy. In this case, the user can couple touch sensing device 20 to electronic device 100 without additional setup. Electronic device 100 can project a soft keyboard corresponding to a second keyboard layout 320, can recognize / sensor / detect the moment the user couples touch sensing device 20 to electronic device 100, can automatically change to a soft keyboard corresponding to a first keyboard layout 310, and can project the soft keyboard onto projection plane 40. The user can perform touch input via the soft keyboard corresponding to the first keyboard layout 310 projected by electronic device 100 without additional setup, and input speed and accuracy can be significantly improved.

[0123] Figure 6 This is a diagram illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure when the touch sensing device 20 is separated from the electronic device 100.

[0124] refer to Figure 6 In embodiments of this disclosure, the electronic device 100 can identify whether the touch sensing device 20 is separated from the electronic device 100 when projecting a soft keyboard corresponding to the first keyboard layout 310. When the touch sensing device 20 is separated from the electronic device 100, the electronic device 100 can change the keyboard layout of the soft keyboard from the first keyboard layout 310 to the second keyboard layout 320.

[0125] In the embodiments of this disclosure, the electronic device 100 can control the projection module to project a soft keyboard corresponding to the first keyboard layout 310 when the touch sensing device 20 is coupled to the electronic device 100, and change the keyboard layout of the soft keyboard to the second keyboard layout 320 when the electronic device 100 recognizes / senses / detects that the touch sensing device 20 is separated from the electronic device 100, and project a soft keyboard corresponding to the second keyboard layout 320 onto the projection plane 40.

[0126] For example, a situation might occur where a user uses electronic device 100 in touch input mode to perform soft keyboard touch input with their hand, and then wants to perform soft keyboard input using a remote control. In this case, the user can detach the touch sensing device 20 from electronic device 100 without any additional setup. Electronic device 100 can project a soft keyboard layout corresponding to a first keyboard layout 310, can recognize / sensor / detect the moment the user detaches the touch sensing device 20 from electronic device 100, can automatically change to a soft keyboard corresponding to a second keyboard layout 320, and can project the soft keyboard onto projection plane 40. The user can then perform input using a remote control via the soft keyboard corresponding to the second keyboard layout 320 projected by electronic device 100 without any additional setup.

[0127] According to embodiments of this disclosure, electronic device 100 can allow users to perform input more efficiently and conveniently by providing a method for dynamically configuring the most effective soft keyboard layout for the user based on the user's input method when projecting content.

[0128] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0129] Figure 7a and Figure 7b This is a diagram illustrating the projection pattern of an electronic device 100 according to an embodiment of the present disclosure. Reference Figure 7a and Figure 7b The electronic device 100 according to embodiments of the present disclosure can, for example, Figure 7a Use in the ground projection mode shown, or in, as in Figure 7b Use the wall projection mode shown.

[0130] Figure 7a This is a diagram used to describe the ground projection mode of an electronic device 100 according to an embodiment of the present disclosure.

[0131] refer to Figure 7a The case where the projection module of the electronic device 100 according to an embodiment of the present disclosure faces the front side of the electronic device 100 can be referred to as ground projection mode.

[0132] In embodiments of this disclosure, the electronic device 100 can identify whether the projection module of the projected soft keyboard is facing the front of the electronic device 100 via a motion sensor or an accelerometer. When the electronic device 100 identifies that the projection module is facing the front, the electronic device 100 can identify / determine that the projection mode of the electronic device 100 is ground projection mode 710.

[0133] For example, a user can adjust the projection module to face forward by standing the electronic device 100 upright or flat. In this case, the electronic device 100 can identify / determine that the projection mode of the electronic device 100 is the ground projection mode 710.

[0134] In embodiments of this disclosure, the electronic device 100 can identify / determine that its projection mode is ground projection mode 710 by the user placing the electronic device 100 on a table. When the user places the electronic device 100 on the table such that the projection module of the electronic device 100 faces forward, the electronic device 100 can identify / determine that its projection mode is ground projection mode 710.

[0135] In embodiments of this disclosure, the electronic device 100 can identify / determine that its projection mode is ground projection mode 710 by the user pressing the ground projection mode button 711 of the electronic device 100. When the user presses the ground projection mode button 711 of the electronic device 100, a sensor connected to the ground projection mode button 711 can sense the press, generate an electrical signal or a signal indicating a change in state, and identify / determine that the projection mode of the electronic device 100 is ground projection mode 710.

[0136] In embodiments of this disclosure, when electronic device 100 recognizes that touch sensing device 20 is coupled to electronic device 100 and identifies / determines that the projection mode of electronic device 100 is ground projection mode 710, electronic device 100 can project a soft keyboard corresponding to the first keyboard layout 310 in response to ground projection mode 710.

[0137] In embodiments of this disclosure, when the projection mode of the electronic device 100 is a ground projection mode, the projection plane is the bottom surface of the electronic device 100, and the IR field is also generated on the bottom surface of the electronic device 100. In this case, the generated IR field and the bottom surface of the electronic device 100 almost coincide with each other. Therefore, when a user touches the soft keyboard corresponding to the first keyboard layout 310 of the projection, the touch sensing device 20 coupled to the electronic device 100 can determine the position of the user's touch on the soft keyboard by using an IR camera to sense IR interference occurring in the generated IR field. The electronic device 100 can receive information about the user's touch position from the touch sensing device 20 via a data pin or wireless communication technology. Therefore, the user can efficiently perform touch input using the soft keyboard corresponding to the first keyboard layout 310.

[0138] Users can use the soft keyboard by simply placing the projection module of the electronic device 100 facing forward, by simply placing the electronic device 100 on a table, or by simply pressing the ground projection mode button 711, without the cumbersome process of adjusting the projection plane of the electronic device 100.

[0139] Figure 7b This is a diagram used to describe the wall projection mode of an electronic device 100 according to an embodiment of the present disclosure.

[0140] refer to Figure 7b The case where the projection module of the electronic device 100 according to an embodiment of the present disclosure faces the ceiling can be referred to as the wall projection mode.

[0141] In embodiments of this disclosure, electronic device 100 can use a motion sensor or an accelerometer to identify that the projection module projecting the soft keyboard is facing the ceiling. When electronic device 100 identifies that the projection module is facing the ceiling, electronic device 100 can identify / determine that the projection mode of electronic device 100 is wall projection mode 720. For example, a user can adjust the projection module to face the ceiling by standing electronic device 100 upright or flat. In this case, electronic device 100 can identify / determine that the projection mode of electronic device 100 is wall projection mode 720.

[0142] In embodiments of this disclosure, the electronic device 100 can identify / determine that its projection mode is wall projection mode 720 by the user attaching the electronic device 100 to a wall. When the user attaches the electronic device 100 to the wall such that the projection module of the electronic device 100 faces the ceiling, the electronic device 100 can identify / determine that its projection mode is wall projection mode 720.

[0143] In embodiments of this disclosure, the electronic device 100 can identify / determine that its projection mode is wall projection mode 720 by the user pressing the wall projection mode button 721 of the electronic device 100. When the user presses the wall projection mode button 721 of the electronic device 100, a sensor connected to the wall projection mode button 721 can sense the press, generate an electrical signal or a signal indicating a change in state, and identify / determine that the projection mode of the electronic device 100 is wall projection mode 720.

[0144] In embodiments of this disclosure, even when the electronic device 100 recognizes that the touch sensing device 20 is coupled to the electronic device 100, when the electronic device 100 identifies / determines that the projection mode of the electronic device 100 is the wall projection mode 720, the electronic device 100 can project a soft keyboard corresponding to the second keyboard layout 320 in response to the wall projection mode 720.

[0145] In embodiments of this disclosure, when the projection mode of the electronic device 100 is a wall projection mode, the projection plane is a wall, and the IR field is also generated on the bottom surface of the electronic device 100. In this case, the generated IR field and the projection plane of the electronic device 100 do not coincide with each other and can be spaced apart. The expression "spaced apart" can mean that the two surfaces are not in complete contact or coincidence and there is some space or gap between them. In the wall projection mode, even when the user touches the projected soft keyboard, no IR interference occurs in the IR field. Therefore, the touch sensing device 20 coupled to the electronic device 100 may not be suitable for sensing the user's touch. In this case, the electronic device 100 can project a soft keyboard of a second keyboard layout 320 corresponding to the remote input mode, so that the user can efficiently perform remote input by using a remote input device such as a remote control through the soft keyboard corresponding to the second keyboard layout 320.

[0146] Users can use the soft keyboard by simply placing the projection module of the electronic device 100 facing the wall, by simply placing the electronic device 100 on the wall, or by simply pressing the wall projection mode button 721, without the cumbersome process of adjusting the projection plane of the electronic device 100.

[0147] According to embodiments of this disclosure, electronic device 100 can enable users to perform input more efficiently and conveniently by providing a method for dynamically configuring the most effective soft keyboard layout for the user based on the user's input method and the projection mode of electronic device 100 when projecting the soft keyboard.

[0148] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0149] Figure 8 This is a diagram illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure when the projection mode of the electronic device 100 switches from a ground projection mode 710 to a wall projection mode 720.

[0150] refer to Figure 8 According to embodiments of the present disclosure, the electronic device 100 can recognize that the projection mode of the electronic device 100 has switched from ground projection mode 710 to wall projection mode 720.

[0151] In embodiments of this disclosure, electronic device 100 may use a motion sensor or accelerometer to detect when the projection module projecting the soft keyboard is adjusted from facing forward to facing the ceiling. Therefore, electronic device 100 can detect when its projection mode switches from ground projection mode 710 to wall projection mode 720.

[0152] In embodiments of this disclosure, the electronic device 100 can recognize that its projection mode has switched from floor projection mode 710 to wall projection mode 720 by the user attaching the electronic device 100 to a wall. When the user attaches the electronic device 100 to the wall, causing the projection module of the electronic device 100 to face the ceiling, the electronic device 100 can recognize / determine that its projection mode has switched to wall projection mode 720.

[0153] When the projection mode of the electronic device 100 switches from the ground projection mode 710 to the wall projection mode 720, the electronic device 100 according to the embodiments of the present disclosure can change the soft keyboard layout to the second keyboard layout 320.

[0154] In embodiments of this disclosure, when the projection mode of the electronic device 100 is a wall projection mode, the projection plane is a wall, and the IR field is generated on the bottom surface of the electronic device 100. In this case, the generated IR field and the projection plane of the electronic device 100 do not coincide with each other and may be spaced apart. The expression "spaced apart" can mean that the two surfaces are not in complete contact or coincidence and there is some space or gap between them. Therefore, the wall projection mode may not be suitable for the touch sensing device 20 coupled to the electronic device 100 to sense the user's touch.

[0155] Therefore, when the projection mode of the electronic device 100 switches from the ground projection mode 710 to the wall projection mode 720, the electronic device 100 can determine to automatically change the soft keyboard of the first keyboard layout 310 corresponding to the touch input mode to the soft keyboard of the second keyboard layout 320 corresponding to the remote input mode, and can automatically project the soft keyboard corresponding to the second keyboard layout 320.

[0156] Therefore, when a user wants to perform remote input while performing touch input, the user can efficiently perform input via a soft keyboard corresponding to the second keyboard layout 320 automatically projected by the electronic device 100, or by using a remote control, simply by attaching the electronic device 100 to the wall, laying the electronic device 100 flat, or standing the electronic device 100 upright, without any additional setup.

[0157] In embodiments of this disclosure, when the touch sensing device 20 is coupled to the electronic device 100, and a soft keyboard corresponding to the first keyboard layout 310 is projected in response to the ground projection mode 710, when the electronic device 100 identifies / detects / recognizes that its projection mode has switched to the wall projection mode 720 through the user's operation of attaching the electronic device 100 to a wall or placing it flat or upright, the electronic device 100 can project a soft keyboard corresponding to the second keyboard layout 320 in response to the wall projection mode 720. At this time, the electronic device 100 can project a soft keyboard corresponding to the second keyboard layout 320 in response to the wall projection mode 720, regardless of whether the touch sensing device 20 is coupled to the electronic device 100.

[0158] For example, a situation might arise where a user is using electronic device 100 on a table in touch input mode to perform soft keyboard touch input with their hands, and then wants to perform another task by attaching electronic device 100 to a wall, laying it flat, or standing it upright, and using a remote control to perform soft keyboard input. In this case, by simply attaching electronic device 100 to a wall, laying it flat, or standing it upright, without any additional setup, the user can perform input using a remote control via a soft keyboard corresponding to the second keyboard layout 320 projected by electronic device 100.

[0159] According to embodiments of this disclosure, electronic device 100 can enable users to perform input more efficiently and conveniently by providing a method for dynamically configuring the most effective soft keyboard layout for the user based on the user's input method and the projection mode of electronic device 100 when projecting the soft keyboard.

[0160] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0161] Figure 9 This is a diagram illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure when the projection mode of the electronic device 100 switches from a ground projection mode 710 to a wall projection mode 720.

[0162] refer to Figure 9 According to embodiments of the present disclosure, the electronic device 100 can recognize that the projection mode of the electronic device 100 has switched from ground projection mode 710 to wall projection mode 720.

[0163] Electronic device 100 can use a motion sensor or accelerometer to detect when the projection module of the projected soft keyboard is adjusted from facing forward to facing the ceiling. Therefore, electronic device 100 can detect when its projection mode changes from floor projection mode 710 to wall projection mode 720. In embodiments of this disclosure, electronic device 100 can detect the change in projection mode from floor projection mode 710 to wall projection mode 720 by the user pressing the wall projection mode button 721. When the user presses the wall projection mode button 721, a sensor connected to the button can sense the press, generate an electrical signal or a signal indicating a change in state, and detect the change in projection mode.

[0164] When the projection mode of the electronic device 100 is switched to the wall projection mode 720, the electronic device 100 according to the embodiments of the present disclosure can disable the touch input mode.

[0165] When the projection mode of the electronic device 100 is switched to the wall projection mode 720, the electronic device 100 according to embodiments of the present disclosure can control the projection module to project a user interface (UI) 900 onto the projection plane 40. The UI 900 guides the adjustment of the projection direction or position of the electronic device 100 to correspond to the wall projection mode 720, or guides the adjustment of the projection direction or position of the electronic device 100 to correspond to the floor projection mode 710. Therefore, when a user wants to continue using the electronic device 100 in the floor projection mode 710 according to the messages included in the UI 900, the user can adjust the projection module of the electronic device 100 to face forward, or when a user wants to use the electronic device 100 in the wall projection mode 720, the user can adjust the projection module of the electronic device 100 to face the ceiling.

[0166] In embodiments of this disclosure, when the projection mode of the electronic device 100 is a wall projection mode, the projection plane is a wall, and the IR field is generated on the bottom surface of the electronic device 100. In this case, the generated IR field and the projection plane of the electronic device 100 do not coincide with each other and may be spaced apart. The expression "spaced apart" can mean that the two surfaces are not in complete contact or coincidence and there is some space or gap between them. Therefore, the wall projection mode may not be suitable for the touch sensing device 20 coupled to the electronic device 100 to sense the user's touch.

[0167] Therefore, when the projection mode of the electronic device 100 is switched from the ground projection mode 710 to the wall projection mode 720, the electronic device 100 can disable the touch input mode and then display a UI that guides the user to adjust the position and orientation of the electronic device 100 according to the user's intention to suit the wall projection mode 720 or the ground projection mode 710.

[0168] As Figure 9 As illustrated in the example, UI 900 may include messages such as "Please attach the projector to the wall!" or "Please lay the projector flat or upright!". In embodiments of this disclosure, electronic device 100 may output voice guidance sounds such as "Please attach the projector to the wall!" or "Please lay the projector flat or upright!" while projecting UI 900 including messages such as "Please attach the projector to the wall!" or "Please lay the projector flat or upright!".

[0169] Users can perform actions such as attaching electronic device 100 to the wall, laying electronic device 100 flat, or standing electronic device 100 upright, based on the guidance messages included in UI 900, so that the projection module of electronic device 100 faces the ceiling. Therefore, as shown in the reference... Figure 8 As described, the electronic device 100 can recognize that its projection mode has switched to wall projection mode 720, and can project a soft keyboard layout corresponding to the second keyboard layout 320. (Refer to the reference...) Figure 8 The provided description is duplicated and referenced. Figure 8 The description is replaced and omitted here.

[0170] Users can perform actions such as placing the electronic device 100 flat or standing it upright based on the guidance messages included in UI 900, so that the projection module of the electronic device 100 faces forward. Therefore, as shown in the reference Figure 7a As described, the electronic device 100 can recognize that its projection mode has switched to ground projection mode 710, and can project a soft keyboard layout corresponding to the first keyboard layout 310. (Refer to the reference...) Figure 7a The provided description is duplicated and referenced. Figure 7a The description is replaced and omitted here.

[0171] According to embodiments of this disclosure, when the projection mode of electronic device 100 changes, electronic device 100 can allow users to perform input more efficiently or conveniently by providing a guided UI for dynamically configuring the soft keyboard layout most effective for the user.

[0172] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0173] Figure 10a and Figure 10b This is a diagram illustrating an example of the operation of an electronic device 100 according to an embodiment of the present disclosure when the electronic device 100 detects an error in touch input.

[0174] refer to Figure 10a and Figure 10b According to embodiments of the present disclosure, an electronic device 100 can detect errors in a user's touch input based on information collected by a touch sensing device 20 coupled to the electronic device 100.

[0175] The touch sensing device 20 can sense the user's touch input on a soft keyboard layout corresponding to the first keyboard layout 310 projected by the electronic device 100, and can collect information about the user's touch count.

[0176] In embodiments of this disclosure, electronic device 100 can obtain information about the user's touch location and the user's touch count from touch sensing device 20. Electronic device 100 can detect errors in the user's touch input based on the obtained information about the user's touch location and the obtained information about the user's touch count.

[0177] In embodiments of this disclosure, the electronic device 100 may pre-set events corresponding to touch input errors as a strategy. Events corresponding to touch input errors may include a variety of events. For example, an event may include a situation where a specific soft key included in the soft keyboard (e.g., a Korean / English toggle key or backspace, etc.) is pressed consecutively a certain number of times (e.g., 5 times) or more during a specific time period, but this disclosure is not limited thereto.

[0178] In embodiments of this disclosure, when an event corresponding to a touch input error occurs, the electronic device 100 can determine the event as a touch input error and detect the error based on information about the user's touch position and touch count obtained from the touch sensing device 20.

[0179] In order to compensate for errors detected in user touch input, the electronic device 100 according to an embodiment of the present disclosure may adjust at least one of the size, spacing or position of the soft keys included in the soft keyboard layout corresponding to the first keyboard layout 310.

[0180] For example, in Figure 10aIn the example, when the Korean / English toggle key 1010 included in the soft keyboard corresponding to the first keyboard layout 310 is pressed 5 or more times, the electronic device 100 can determine the event as a touch input error and detect the error based on information about the user's touch location and touch count obtained from the touch sensing device 20. (As in...) Figure 10a In the example, to compensate for detected user touch input errors, the electronic device 100 can adjust the position of the Korean / English switch key 1010 included in the soft keyboard layout corresponding to the first keyboard layout 310, so that the position of the Korean / English switch key 1010 is changed downwards. Therefore, when the user subsequently performs soft keyboard touch input, the electronic device 100 can prevent touch input errors due to interference between the Korean / English switch key 1010 and other soft keys.

[0181] For example, in Figure 10b In the example, when the backspace key 1020 included in the soft keyboard corresponding to the first keyboard layout 310 is pressed 5 or more times, the electronic device 100 can determine the event as a touch input error and detect the error based on information about the user's touch position and touch count obtained from the touch sensing device 20. (As in...) Figure 10b In the example, to compensate for detected user touch input errors, the electronic device 100 can adjust the size and spacing of the soft keys included in the soft keyboard layout corresponding to the first keyboard layout 310, thereby increasing the size and spacing of the soft keys. Therefore, when the user subsequently performs soft keyboard touch input, the electronic device 100 can prevent touch input errors due to interference between the backspace key 1020 and other soft keys.

[0182] According to embodiments of this disclosure, electronic device 100 can allow users to perform input more efficiently and conveniently by providing a method for detecting errors in user touch input and dynamically adjusting the soft keys included in the soft keyboard layout to compensate for the detected errors in user touch input.

[0183] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0184] Figures 11a to 11e This is a diagram illustrating an example of a type of soft keyboard layout based on information related to the user's hands, according to embodiments of this disclosure.

[0185] refer to Figures 11a to 11eAccording to embodiments of the present disclosure, the electronic device 100 can receive image data of user touch input from the camera sensor 50. The camera sensor 50 can be embedded in the electronic device 100 or connected to the electronic device 100 via wireless / wired communication as an external device separate from the electronic device 100. The camera sensor 50 may include an RGB camera, but the present disclosure is not limited thereto.

[0186] An electronic device 100 according to an embodiment of the present disclosure can obtain information related to a user's hand by analyzing received image data. In embodiments of the present disclosure, the information related to a user's hand may include at least one of the following: the number of the user's hands, the position and orientation of the user's hands, whether the user's hands are left or right, the spacing between the user's hands, or the length of the fingers included in the user's hands.

[0187] According to an embodiment of the present disclosure, the electronic device 100 can determine the type of soft keyboard corresponding to the first keyboard layout 310 based on obtained information related to the user's hand, and can adjust the size, spacing, or position of the soft keys included in the soft keyboard corresponding to the first keyboard layout 310.

[0188] In embodiments of this disclosure, the type of soft keyboard corresponding to the first keyboard layout 310 may include left-hand mode, right-hand mode, two-hand mode, and split mode. (See reference...) Figures 11a to 11e This will be described in detail.

[0189] Figure 11a An example of a left-handed mode layout 1110 of a soft keyboard type corresponding to the first keyboard layout 310 is shown. In embodiments of this disclosure, the electronic device 100 can analyze image data received from the camera sensor 50. When the electronic device 100 detects that the number of hands is 1 and the user's hand is left-handed, the electronic device 100 can project the left-handed mode layout 1110. The left-handed mode layout 1110 may refer to a soft keyboard layout that allows the user to efficiently input data using only their left hand. For example, the electronic device 100 can project the left-handed mode layout 1110 by reducing the size and spacing of the soft keys included in the soft keyboard corresponding to the first keyboard layout 310 to fit the length of the fingers included in the user's left hand and positioning the soft keys closer to the left hand.

[0190] Figure 11bAn example of a right-hand mode layout 1120 in a type of soft keyboard corresponding to the first keyboard layout 310 is shown. In embodiments of this disclosure, the electronic device 100 can analyze image data received from the camera sensor 50. When the electronic device 100 detects that the number of hands is 1 and the user's hand is right-handed, the electronic device 100 can project the right-hand mode layout 1120. The right-hand mode layout 1120 may refer to a soft keyboard layout that allows the user to efficiently input data using only one right hand. For example, the electronic device 100 can project the right-hand mode layout 1120 by reducing the size and spacing of the soft keys included in the soft keyboard corresponding to the first keyboard layout 310 to fit the length of the fingers included in the user's right hand and positioning the soft keys closer to the right hand.

[0191] Figure 11c An example of a two-handed mode layout 1130 in the type of soft keyboard corresponding to the first keyboard layout 310 is shown. In embodiments of this disclosure, the electronic device 100 can analyze image data received from the camera sensor 50. When the electronic device 100 detects that the number of hands is 2, the electronic device 100 can project the two-handed mode layout 1130. The two-handed mode layout 1130 can refer to a soft keyboard layout that allows users to efficiently input data using their hands. For example, by adjusting the size and spacing of the soft keys included in the soft keyboard corresponding to the first keyboard layout 310 to suit the length of the fingers included in the user's hands, the electronic device 100 can project the two-handed mode layout 1130 by positioning the soft keys included in the soft keyboard corresponding to the first keyboard layout 310 to correspond to the position and orientation of the user's hands, such as... Figure 11d As in Example 1140.

[0192] Figure 11e An example of a split-mode layout 1150 in a type of soft keyboard corresponding to the first keyboard layout 310 is shown. In embodiments of this disclosure, the electronic device 100 can detect the interval between a user's right and left hands by analyzing image data received from the camera sensor 50. When the electronic device 100 determines that the interval between the user's right and left hands is greater than or equal to a defined interval, the electronic device 100 can project the split-mode layout 1150. The split-mode layout 1150 can be a layout configured by splitting the soft keys included in the soft keyboard corresponding to the first keyboard layout 310 into soft keys to be input by the user's left hand and soft keys to be input by the user's right hand. For example, the electronic device 100 can project the split-mode layout 1150 by positioning the soft keys to be input by the user's left hand closer to the user's left hand and the soft keys to be input by the user's right hand closer to the user's right hand.

[0193] According to embodiments of this disclosure, electronic device 100 can allow users to perform input more efficiently and conveniently by providing a method for dynamically configuring the most effective soft keyboard layout for the user based on information related to the user's hands.

[0194] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0195] Figure 12 This is a flowchart describing an operation method 1200 of an electronic device 100 according to an embodiment of the present disclosure.

[0196] refer to Figure 12 In operation 1210, the electronic device 100 according to an embodiment of the present disclosure can receive image data of the user's touch input from the camera sensor 50.

[0197] In operation 1220, the electronic device 100 according to an embodiment of the present disclosure can determine whether the user's hand is recognized by analyzing the received image data.

[0198] In operation 1230, when the user's hand is detected, the electronic device 100 according to an embodiment of the present disclosure can control the projection module to project a soft keyboard corresponding to the first keyboard layout 310 onto the projection plane 40.

[0199] When a user's hand is detected, the electronic device 100 can predict / determine / determine that the user will use his / her body (e.g., hand) to perform input (e.g., touch input mode) instead of using a remote control (e.g., remote input mode). Therefore, the electronic device 100 can determine the soft keyboard layout as a first keyboard layout 30 corresponding to the touch input mode, and can control the projection module to automatically project the soft keyboard corresponding to the first keyboard layout 30 onto the projection plane.

[0200] This solves the inconvenience of having to perform additional settings to change the keyboard layout of the soft keyboard to be favorable / suitable for touch input when a user wants to perform touch input via the soft keyboard using the electronic device 100.

[0201] In operation 1240, when the user's hand is not recognized, the electronic device 100 according to an embodiment of the present disclosure can control the projection module to project a soft keyboard corresponding to the second keyboard layout 320 onto the projection plane 40. Alternatively, when the user's hand is not recognized, the electronic device 100 according to an embodiment of the present disclosure can control the projection module not to project the soft keyboard.

[0202] When the user's hand is not recognized, the electronic device 100 can predict / determine / determine that the user will use the electronic device 100 in a remote input mode instead of using his / her body (e.g., hand) for input (e.g., touch input mode), and can control the projection module to project a soft keyboard corresponding to the second keyboard layout 320 onto the projection plane 40.

[0203] Therefore, when a user wants to perform remote input via a soft keyboard using electronic device 100, the inconvenience of having to perform additional settings to change the keyboard layout of the soft keyboard to be favorable / suitable for remote input can be resolved.

[0204] Alternatively, the electronic device 100 may repeat the following operations: projecting a soft keyboard corresponding to the first keyboard layout 310 when the user's hand is detected in operation 1230, not projecting a soft keyboard when the user's hand disappears and is not detected, and projecting a soft keyboard corresponding to the first keyboard layout 310 when the user's hand is detected again.

[0205] According to embodiments of this disclosure, electronic device 100 can allow users to perform input more efficiently and conveniently by providing a method for dynamically configuring the most effective soft keyboard layout for the user based on the user's input method when projecting content.

[0206] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0207] Figure 13a An example of the operation when the electronic device 100 recognizes the user's hand, as described in operation 1230, is shown, and Figure 13b An example of operation is shown when the electronic device 100 does not recognize the user's hand, as described in operation 1240.

[0208] Figure 13a This is a diagram illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure when the electronic device 100 recognizes a user's hand. (See reference...) Figure 12 The provided description is duplicated and referenced. Figure 12 The description is replaced and omitted here.

[0209] refer to Figure 13a When the user's hand is detected, the electronic device 100 according to an embodiment of the present disclosure can control the projection module to project a soft keyboard corresponding to the first keyboard layout 310 onto the projection plane 40.

[0210] Figure 13b This is a diagram illustrating the operation of an electronic device 100 according to an embodiment of the present disclosure when the electronic device 100 does not recognize the user's hand. (See reference...) Figure 12 The provided description is duplicated and referenced. Figure 12 The description is replaced and omitted here.

[0211] refer to Figure 13b When the user's hand is not recognized, the electronic device 100 according to an embodiment of the present disclosure can control the projection module to project a soft keyboard corresponding to the second keyboard layout 320 onto the projection plane 40. Optionally, when the user's hand is not recognized, the electronic device 100 according to an embodiment of the present disclosure can control the projection module not to project the soft keyboard.

[0212] Figure 14 This is a block diagram of a processor 1400 according to an embodiment of the present disclosure.

[0213] refer to Figure 14 , Figure 14 The processor 1400 can be Figure 15 and Figure 16 An example of a processor 110 included in the electronic device 100 shown.

[0214] The processor 1400 according to embodiments of the present disclosure may include an application module 1410, an input management module 1420, and an input method editor (IME) module 1430. The IME module 1430 may include a touch input mode control module 1440 and a remote input mode control module 1460.

[0215] Each element included in processor 1400 may be a module. In embodiments of this disclosure, a module may refer to a combination of functions and structures of hardware for performing the technical concepts of this disclosure and software for driving the hardware. For example, a module may refer to a logical unit of specific code and hardware resources for executing that specific code, and does not necessarily refer to physically linked code or be limited to a single type of hardware.

[0216] In embodiments of this disclosure, when it is determined that user keyboard input is required (e.g., when the user selects a search function), application module 1410 can activate input management module 1420. Application module 1410 may include a web browser.

[0217] In embodiments of this disclosure, when the input management module 1420 is activated by the application module 1410, the input management module 1420 can identify whether the touch sensing device 20 is coupled to the electronic device 100.

[0218] In embodiments of this disclosure, the input management module 1420 can identify that the touch sensing device 20 is coupled to the electronic device 100 by sensing changes via sensors, sensing the flow of specific electrical signals, or receiving status information or specific signals from the touch sensing device 20 via wireless communication (e.g., NFC, Bluetooth, etc.).

[0219] In embodiments of this disclosure, when the input management module 1420 identifies whether the touch sensing device 20 is coupled to the electronic device 100, the input management module 1420 can send the identification result to the IME module 1430.

[0220] In embodiments of this disclosure, when the recognition result received from the input management module 1420 determines that the touch sensing device 20 is coupled to the electronic device 100, the IME module 1430 can activate the touch input mode control module 1440.

[0221] In embodiments of this disclosure, when the recognition result received from the input management module 1420 determines that the touch sensing device 20 is not coupled to the electronic device 100, the IME module 1430 can activate the remote input mode control module 1460.

[0222] In embodiments of this disclosure, when the touch sensing device 20 is coupled to the electronic device 100, the touch input mode control module 1440 can be activated by the IME module 1430.

[0223] In embodiments of this disclosure, the touch input mode control module 1440 can control the projection module to project a soft keyboard corresponding to the first keyboard layout 310 onto the projection plane 40.

[0224] In the embodiments of this disclosure, the touch input mode control module 1440 can determine to change the keyboard layout of the soft keyboard from the second keyboard layout 320 to the first keyboard layout 310, and can control the projection module to project the soft keyboard corresponding to the first keyboard layout 310 onto the projection plane 40.

[0225] In embodiments of this disclosure, the touch input mode control module 1440 can control the projection module to project a soft keyboard corresponding to the first keyboard layout 310 onto the lower end of the layout on which content is being projected. In embodiments of this disclosure, the touch input mode control module 1440 can control the projection module to stop projecting content and project the soft keyboard corresponding to the first keyboard layout 310.

[0226] In embodiments of this disclosure, the touch input mode control module 1440 may include a soft keyboard layout optimization module 1450.

[0227] In embodiments of this disclosure, the soft keyboard layout optimization module 1450 can obtain various information (e.g., touch position information, touch count information, etc.) about the user's touch input on the soft keyboard corresponding to the projected first keyboard layout 310 from the touch sensing device 20 via a data pin or wireless communication technology (e.g., NFC, Bluetooth, etc.).

[0228] In embodiments of this disclosure, the soft keyboard layout optimization module 1450 can detect user touch input errors based on obtained information about the user's touch position and obtained information about the user's touch count. To compensate for detected user touch input errors, the soft keyboard layout optimization module 1450 can adjust at least one of the size, spacing, or position of the soft keys included in the soft keyboard corresponding to the first keyboard layout 310.

[0229] In embodiments of this disclosure, the soft keyboard layout optimization module 1450 can receive image data of the user's touch input from the camera sensor 50.

[0230] In embodiments of this disclosure, the soft keyboard layout optimization module 1450 can obtain information related to the user's hands by analyzing received image data. In embodiments of this disclosure, the information related to the user's hands may include at least one of the following: the number of the user's hands, the position and direction of the user's hands, whether the user's hands are left or right, the spacing between the user's hands, or the length of the fingers included in the user's hands.

[0231] In embodiments of this disclosure, the soft keyboard layout optimization module 1450 can determine the type of soft keyboard corresponding to the first keyboard layout 310 based on the obtained information related to the user's hands, and can adjust the size, spacing, or position of the soft keys included in the soft keyboard corresponding to the first keyboard layout 310.

[0232] In embodiments of this disclosure, when the touch sensing device 20 is not coupled to the electronic device 100, the remote input mode control module 1460 can be activated by the IME module 1430.

[0233] In embodiments of this disclosure, the remote input mode control module 1460 can control the projection module to project a soft keyboard corresponding to the second keyboard layout 320 onto the projection plane 40.

[0234] In the embodiments of this disclosure, the remote input mode control module 1460 can determine to change the keyboard layout of the soft keyboard from the first keyboard layout 310 to the second keyboard layout 320, and can control the projection module to project the soft keyboard corresponding to the second keyboard layout 320 onto the projection plane 40.

[0235] In embodiments of this disclosure, the remote input mode control module 1460 can control the projection module to project a soft keyboard corresponding to the second keyboard layout 320 onto the lower end of the layout on which content is being projected. In embodiments of this disclosure, the remote input mode control module 1460 can control the projection module to stop projecting content and project the soft keyboard corresponding to the second keyboard layout 320.

[0236] According to embodiments of this disclosure, processor 1400 can allow users to perform input more efficiently and conveniently by providing a method for dynamically configuring the most effective soft keyboard layout for the user based on the user's input method.

[0237] on the other hand, Figure 14 The block diagram of the processor 1400 shown is a block diagram of an embodiment of this disclosure. Each element of the block diagram may be integrated, added, or omitted according to the specifications of an actual implementation of the processor 1400. For example, two or more elements may be integrated into one element, or a single element may be subdivided into two or more elements, where necessary. Furthermore, the functions performed by each block are used to describe embodiments of this disclosure, and their specific operation or apparatus is not intended to limit the scope of this disclosure.

[0238] Figure 15 This is a block diagram of an electronic device 100 according to an embodiment of the present disclosure.

[0239] refer to Figure 15 An electronic device 100 according to embodiments of the present disclosure may include a projection module 162, a memory 130, and at least one processor 110. However, the electronic device 100 may use a different... Figure 15 The components shown are implemented with more components, and this disclosure is not limited to the examples described above. The components are described below in sequence.

[0240] The projection module 162 can project graphic images onto a projection plane under the control of at least one processor 110. The projection module 162 can also be referred to as an optical module. The projection module 162 can also be referred to as a "projection assembly" as a device element.

[0241] The memory 130 can store programs for processing and control by at least one processor 110, and can store data input to or output from the electronic device 100.

[0242] The memory 130 may include at least one type of storage medium selected from flash memory, hard disk memory, multimedia card micro-memory, card-type memory (e.g., Secure Digital (SD) or Extreme Digital (XD) memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk.

[0243] The memory 130 according to embodiments of the present disclosure may include one or more instructions that perform the functions disclosed herein for dynamically configuring a soft keyboard layout that is most effective for the user.

[0244] At least one processor 110 can control the overall operation of the electronic device 100. For example, at least one processor 110 can execute one or more instructions stored in the memory 130 to control the projection module 162 and perform reference... Figures 1 to 14 The functions of the described electronic device 100.

[0245] The processor 110 can be implemented as one or more processors. In this case, the one or more processors can be general-purpose processors (such as central processing units (CPUs), application processors (APs), or digital signal processors (DSPs)), dedicated graphics processors (such as graphics processing units (GPUs) or vision processing units (VPUs)), or dedicated artificial intelligence processors (such as neural processing units (NPUs)). For example, when one or more processors are dedicated artificial intelligence processors, the dedicated artificial intelligence processors can be designed with hardware architectures specifically designed to process particular artificial intelligence models.

[0246] Processor 110 may include various processing circuitry and / or multiple processors. For example, as used herein (including the claims), the term "processor" may include various processing circuitry, including at least one processor, wherein one or more of the at least one processor may be configured individually and / or collectively in a distributed manner to perform the various functions described herein. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform multiple functions, these terms cover, for example, but not limited to, cases where one processor performs some of the functions and another processor performs other functions, and cases where a single processor can perform all of the functions. Furthermore, at least one processor 110 may include, for example, a combination of processors performing the various described / disclosed functions in a distributed manner. At least one processor 110 may execute program instructions to implement or perform the various functions.

[0247] According to embodiments of this disclosure, at least one processor 110 can identify whether a touch sensing device is coupled to an electronic device to detect user touch input on a soft keyboard. The touch sensing device is configured to be detachably coupled to the electronic device. When at least one processor 110 identifies that the touch sensing device is coupled to the electronic device, at least one processor 110 can control a projection assembly to project a soft keyboard corresponding to a first keyboard layout onto a projection plane.

[0248] According to embodiments of this disclosure, when at least one processor 110 identifies that a touch sensing device is not coupled to an electronic device, at least one processor 110 can control a projection component to project a soft keyboard corresponding to a second keyboard layout onto a projection plane.

[0249] According to embodiments of this disclosure, when at least one processor 110 recognizes that a touch sensing device is coupled to an electronic device when projecting a soft keyboard corresponding to a second keyboard layout, at least one processor 110 can control the projection component to change the soft keyboard corresponding to the second keyboard layout to a soft keyboard corresponding to the first keyboard layout and project the changed soft keyboard.

[0250] According to embodiments of this disclosure, when at least one processor 110 recognizes that the touch sensing device is separated from the electronic device when projecting a soft keyboard corresponding to a first keyboard layout, at least one processor 110 can control the projection component to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to a second keyboard layout and project the changed soft keyboard.

[0251] According to embodiments of this disclosure, the first keyboard layout may be a keyboard layout corresponding to a touch input mode, and the second keyboard layout may be a keyboard layout corresponding to a remote input mode.

[0252] According to embodiments of this disclosure, at least one processor 110 can identify when the projection mode of the electronic device coupled to the touch sensing device switches from a ground projection mode to a wall projection mode. Based on the identification that the projection mode of the electronic device coupled to the touch sensing device has switched to the wall projection mode, at least one processor 110 can control the projection component to change the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout and project the changed soft keyboard.

[0253] According to embodiments of this disclosure, at least one processor 110 can identify when the projection mode of an electronic device coupled to a touch-sensing device switches from a ground projection mode to a wall projection mode. Based on the identification that the projection mode of the electronic device coupled to the touch-sensing device has switched to the wall projection mode, at least one processor 110 can control a projection component to project a UI onto a projection plane, the UI guiding the adjustment of the projection direction or position of the electronic device to correspond to the wall projection mode or the ground projection mode.

[0254] According to embodiments of this disclosure, at least one processor 110 can detect errors in a user's touch input based on information collected by a touch sensing device coupled to an electronic device. To compensate for detected errors in the user's touch input, at least one processor 110 can adjust at least one of the size, spacing, or position of soft keys included in a soft keyboard corresponding to a first keyboard layout.

[0255] According to embodiments of this disclosure, at least one processor 110 can acquire image data capturing a user's touch input activity. At least one processor 110 can obtain information related to the user's hands by analyzing the image data. In embodiments of this disclosure, the information related to the user's hands may include at least one of the following: the number of the user's hands, the position and orientation of the user's hands, whether the user's hands are left or right, the spacing between the user's hands, or the length of the fingers included in the user's hands. At least one processor 110 can determine the type of soft keyboard corresponding to a first keyboard layout based on the acquired information related to the user's hands, and can adjust the size, spacing, or position of the soft keys included in the soft keyboard corresponding to the first keyboard layout.

[0256] According to embodiments of this disclosure, when a user's hand is identified by analyzing image data, at least one processor 110 can control a projection component to project a soft keyboard corresponding to a first keyboard layout. When a user's hand is not identified by analyzing image data, at least one processor 110 can control the projection component to project a soft keyboard corresponding to a second keyboard layout or not project a soft keyboard.

[0257] According to embodiments of this disclosure, electronic device 100 can allow users to perform input more efficiently and conveniently by providing a method for dynamically configuring the most effective soft keyboard layout for the user based on the user's input method.

[0258] However, the effects to be achieved by this disclosure are not limited to those described above, and other effects not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0259] Figure 16 This is a detailed block diagram of an electronic device 100 according to an embodiment of the present disclosure.

[0260] refer to Figure 16 Electronic device 100 can, for example, constitute Figure 15 All or part of the electronic device 100 shown. The electronic device 100 may include at least one processor 110, a communication module 120, a memory 130, a sensor module 140, an input device 150, an optical module 160, an interface 170, an audio module 180, a camera module 191, an indicator 192, a motor 193, a power management module 194, a battery 195, and a wireless charging module 196.

[0261] At least one processor 110 can drive an operating system or application to control multiple hardware or software elements connected to the processor 110, and can perform various data processing and calculations, including multimedia data. The processor 110 can be implemented as, for example, a system-on-a-chip (SoC). The processor 110 may also include a GPU (not shown).

[0262] The communication module 120 can send and receive data in communications between the electronic device 100 and other electronic devices (e.g., peripheral devices or servers) connected via a network. According to embodiments of this disclosure, the communication module 120 may include a Wi-Fi module 121, a Bluetooth (BT) module 122, and a radio frequency (RF) module 123.

[0263] Each of the Wi-Fi module 121 and the BT module 122 may include, for example, a processor for processing data sent and received through the corresponding module. Figure 4 In this embodiment, Wi-Fi module 121 and BT module 122 are shown as separate blocks. However, according to embodiments of this disclosure, at least a portion of Wi-Fi module 121 or BT module 122 may be included in a single integrated chip (IC) or IC package. For example, at least some of the processors corresponding to Wi-Fi module 121 and BT module 122 may be implemented as a single SoC.

[0264] RF module 123 can transmit and receive data, such as RF signals. RF module 123 may include, for example, a transceiver (not shown), a power amplifier module (PAM), a frequency filter, or a low-noise amplifier (LNA). Furthermore, RF module 123 may also include components for transmitting and receiving electromagnetic waves in free space in wireless communication, such as conductors or wires. Figure 4 In this embodiment, Wi-Fi module 121 and BT module 122 are shown sharing a single RF module 123. However, according to embodiments of this disclosure, at least one of the Wi-Fi module 121 or BT module 122 can transmit and receive RF signals via a separate RF module.

[0265] Memory 130 may include built-in memory 131. Built-in memory 131 may include at least one of, for example, volatile memory (e.g., dynamic random access memory (RAM) (DRAM), static RAM (SRAM), synchronous DRAM (SDRAM), etc.) or non-volatile memory (e.g., one-time programmable read-only memory (ROM) (OTPROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), mask ROM, flash ROM, NAND flash, NOR flash, etc.).

[0266] The memory 130 can store various data, programs, or applications that drive and control the electronic device 100 under the control of the processor 110. The memory 130 can store input / output signals or data corresponding to the drives of at least one processor 110, communication module 120, sensor module 140, input device 150, optical module 160, interface 170, audio module 180, camera module 191, indicator 192, motor 193, power management module 194, battery 195, and wireless charging module 196.

[0267] Sensor module 140 can measure physical quantities or sense the operating state of electronic device 100, and can convert the measured or sensed information into electrical signals. Sensor module 140 may include at least one of, for example, a gesture sensor 140A, a gyroscope sensor 140B, an accelerometer sensor 140C, an ultrasonic sensor 140D, an infrared sensor 140E, a Hall sensor 140F, a proximity sensor 140G, or an illuminance sensor 140H. Additionally or alternatively, sensor module 140 may include, for example, a spatial sensor (not shown), an electronic nose sensor (not shown), an electromyography (EMG) sensor (not shown), an electroencephalography (EEG) sensor (not shown), an electrocardiogram (ECG) sensor (not shown), an iris sensor, a fingerprint sensor, or a pressure sensor. Sensor module 140 may also include control circuitry for controlling at least one of the included sensors.

[0268] Input device 150 may include keys 151. Keys 151 may include, for example, physical buttons, optical keys, or keypads. According to embodiments of this disclosure, electronic device 100 may receive user input from external devices connected to it using communication module 120.

[0269] The optical module 160 may include an illumination module 161 and a projection module 162. The projection module 163 can display images by projecting light onto a screen.

[0270] The projection module 162 can project light using digital light processing (DLP), liquid crystal on silicon (LCOS), 3-liquid crystal display (3LCD), LCD, or laser methods.

[0271] DLP is a projection display method that uses a digital micromirror display (DMD) as one of the display elements. The LCOS method can define pixels using multiple scan lines and multiple data lines, can include liquid crystals with a specific molecular arrangement, and can project light using an LCOS panel that transmits, reflects, and displays externally input light through the liquid crystal. In the 3LCD method, the projector's lamp light source can be divided into three parts through its transmitted LCD. 3LCD can use red, blue, and green 3LCDs, where the light from the lamp is separated into each color before being magnified by lenses through the LCD panel. The projector can be implemented using the 3LCD method as described above. Furthermore, similar to LCDs, projectors using a single LCD panel can also be provided. The laser method can include: a light source including red, green, and blue laser emitting elements; an optical tunnel into which the laser emitted from the light source enters; and a display element that projects an image onto a screen using the laser incident through the optical tunnel. Inside the optical tunnel, a structure including a synthesis module and a speckle remover can be provided as a projection module. The synthesis module synthesizes some colors of the laser emitted from the light source by transmitting or reflecting the colors of the laser. The speckle remover removes speckle by irregularly switching the phase of the laser synthesized by the synthesis module.

[0272] Interface 170 may include, for example, a High Definition Multimedia Interface (HDMI) 171 and a USB 172. Interface 170 may be included in, for example, a communication module 120. Additionally or alternatively, interface 170 may include, for example, a Mobile High Definition Link (MHL) interface, an SD card / Multimedia Card (MMC) interface, or an Infrared Data Association (IrDA) standard interface.

[0273] The audio module 180 can bidirectionally convert sound and electrical signals. The audio module 180 can process sound information input or output via, for example, a speaker 181 or a microphone 182. According to embodiments of this disclosure, the electronic device 100 may not include the audio module 180, and audio may be transmitted to external devices using the BT module 122 included in the communication module 120.

[0274] Camera module 191 is a device capable of capturing still and moving images. According to embodiments of this disclosure, camera module 191 may include one or more image sensors (e.g., front or rear sensors), lenses (not shown), image signal processors (ISPs) (not shown), or flashes (not shown) (e.g., LEDs or xenon lamps).

[0275] Camera module 191 can receive images (e.g., consecutive frames) corresponding to the user's movements (including gestures) within its camera recognition range. For example, the recognition range of camera module 191 can be within 0.1 m to 5 m from camera module 191 to the user. The user's movements can include, for example, the user's face, facial expressions, movements of a part of the user's body (such as a hand, fist, or finger), or movements of a part of the user.

[0276] Indicator 192 can display a specific state of electronic device 100 or a part thereof (e.g., processor 110), such as startup state, message state, or charging state.

[0277] The motor 193 can convert electrical signals into mechanical vibrations. Although not shown, the electronic device 100 may include a processing device (e.g., a GPU) capable of supporting mobile TV. The processing device capable of supporting mobile TV can process, for example, media data according to standards such as Digital Multimedia Broadcasting (DMB), Digital Video Broadcasting (DVB), or media streaming.

[0278] The power management module 194 can manage the power of the electronic device 100. Although not shown, the power management module 194 may include, for example, a power management integrated circuit (PMIC), a charger IC, or a battery gauge or fuel gauge.

[0279] When the electronic device 100 is located on or close to the projection plane within a certain distance, the power management module 194 can apply power to the optical module 160 to enable the optical module 160 to operate.

[0280] When the electronic device 100 does not approach the projection plane within a certain distance, the power management module 194 can cut off the power to the optical module 160 to prevent the optical module 160 from operating.

[0281] The PMIC can be installed within, for example, an IC or SoC semiconductor. Charging methods can be categorized into wired charging methods and wireless charging methods. The charger IC can charge the battery and prevent overvoltage or overcurrent from being introduced from the charger. According to embodiments of this disclosure, the charger IC can perform at least one of a wired charging method or a wireless charging method.

[0282] The wireless charging module 196 may include circuitry capable of wireless charging, such as a coil circuit, a resonant circuit, or a rectifier, and the wireless charging method may include, for example, a magnetic resonance method, a magnetic induction method, or an electromagnetic wave method.

[0283] A battery gauge can measure, for example, the remaining capacity of battery 195, as well as voltage, current, or temperature during charging. Battery 195 can store or generate electricity and supply power to electronic device 100 using the stored or generated electricity. Battery 195 may include, for example, a rechargeable battery or a solar cell.

[0284] Each of the aforementioned elements in the electronic device 100 according to embodiments of the present disclosure may include one or more components, and the names of the corresponding elements may vary depending on the type of electronic device. The electronic device 100 according to embodiments of the present disclosure may be configured to include at least one of the aforementioned elements. Some elements may be omitted, or other additional elements may be further included. Furthermore, some elements of the electronic device 100 according to embodiments of the present disclosure may be combined to form a single entity, thereby performing the same function as the elements before combination.

[0285] The specific examples used to describe embodiments of this disclosure are merely combinations of each standard, method, detailed method, and operation. By combining at least two of the various techniques described above, electronic device 100 can allow users to perform input more efficiently and conveniently by providing a method for dynamically configuring the most effective soft keyboard layout for the user based on their input method. Furthermore, this can be performed according to a method determined by one or at least two of the techniques described above. For example, some operations of one embodiment of this disclosure can be performed in combination with some operations of another embodiment of this disclosure.

[0286] Machine-readable storage media may be provided in the form of non-transitory storage media. "Non-transitory storage media" refers to tangible devices and simply means that signals (e.g., electromagnetic waves) are not included. This term does not distinguish between cases where data is stored semi-permanently and cases where data is temporarily stored. For example, a non-transitory storage medium may include a buffer for temporarily storing data.

[0287] According to embodiments of this disclosure, methods according to various embodiments of this disclosure can be provided by being included in a computer program product. The computer program product can be traded as a commodity between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., an optical disc read-only memory (CD-ROM)), or can be distributed online (e.g., downloaded or uploaded) between two user devices (e.g., smartphones) via an app store or directly. In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) is at least temporarily stored on a machine-readable storage medium, such as the memory of a manufacturer's server, an app store's server, or a relay server, or can be temporarily generated.

[0288] According to embodiments of this disclosure, electronic devices can allow users to perform input more efficiently and conveniently by providing a method for dynamically configuring the most effective soft keyboard layout for the user based on the user's input method when projecting content. However, the effects to be achieved by this disclosure are not limited to the above-described effects, and other effects not mentioned herein will be clearly understood by those skilled in the art from other descriptions.

Claims

1. An electronic device (100), comprising: Projection assembly (162); At least one processor (110) includes processing circuitry; and A memory (130) stores one or more instructions that, when executed individually or jointly by at least one processor (110), cause the electronic device (100) to: Identify (410) whether the touch sensing device (20) is coupled to the electronic device (100) to sense the user’s touch input on the soft keyboard, wherein the touch sensing device (20) is configured to be detachably coupled to the electronic device (100). and Based on the identification of the touch sensing device (20) coupled to the electronic device (100), the control (420) projection component projects a soft keyboard corresponding to the first keyboard layout onto the projection plane.

2. The electronic device according to claim 1, wherein, The memory stores the one or more instructions, which, when executed individually or jointly by at least one processor, cause the electronic device to further: Based on the recognition that the touch sensing device is not coupled to the electronic device, the control projection component projects a soft keyboard corresponding to the second keyboard layout onto the projection plane.

3. The electronic device according to claim 1 or 2, wherein, The memory stores the one or more instructions, which, when executed individually or jointly by at least one processor, cause the electronic device to further: Based on the recognition that the touch sensing device is coupled to the electronic device when projecting a soft keyboard corresponding to the second keyboard layout, the control projection component changes the soft keyboard corresponding to the second keyboard layout to a soft keyboard corresponding to the first keyboard layout, and projects the soft keyboard corresponding to the first keyboard layout.

4. The electronic device according to any one of claims 1 to 3, wherein, The memory stores the one or more instructions, which, when executed individually or jointly by at least one processor, cause the electronic device to further: Based on the recognition that the touch sensing device and the electronic device are separated when projecting a soft keyboard corresponding to the first keyboard layout, the control projection component changes the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout, and projects the soft keyboard corresponding to the second keyboard layout.

5. The electronic device according to claim 2, wherein, The first keyboard layout is the keyboard layout corresponding to the touch input mode, and the second keyboard layout is the keyboard layout corresponding to the remote input mode.

6. The electronic device according to any one of claims 1 to 5, wherein, The memory stores the one or more instructions, which, when executed individually or jointly by at least one processor, cause the electronic device to further: It can identify when the projection mode of the electronic device coupled to the touch sensing device switches from ground projection mode to wall projection mode. and Based on the identification of the projection mode of the electronic device coupled to the touch sensing device, the projection component is switched to the wall projection mode, and the soft keyboard corresponding to the first keyboard layout is changed to the soft keyboard corresponding to the second keyboard layout, and the soft keyboard corresponding to the second keyboard layout is projected.

7. The electronic device according to any one of claims 1 to 6, wherein, The memory stores the one or more instructions, which, when executed individually or jointly by at least one processor, cause the electronic device to further: Based on the identification of the electronic device coupled to the touch sensing device, the projection mode is switched to wall projection mode, and touch input mode is disabled; and The control projection component projects a user interface (UI) onto a projection plane, wherein the UI guides the adjustment of the projection direction or position of the electronic device to correspond to a wall projection mode or a floor projection mode.

8. The electronic device according to any one of claims 1 to 7, wherein, The memory stores the one or more instructions, which, when executed individually or jointly by at least one processor, cause the electronic device to further: Errors in the user's touch input are detected based on information collected by touch sensing devices coupled to electronic devices; and Adjust at least one of the size, spacing, or position of the soft keys included in the soft keyboard corresponding to the first keyboard layout to compensate for errors in the detected user touch input.

9. The electronic device according to any one of claims 1 to 8, wherein, The memory stores the one or more instructions, which, when executed individually or jointly by at least one processor, cause the electronic device to further: Obtain image data capturing the user's touch input activity; Information related to the user's hands is obtained by analyzing image data, wherein the information related to the user's hands includes at least one of the following: the number of the user's hands, the position and direction of the user's hands, whether the user's hands are left or right, the distance between the user's two hands, and the length of the fingers included in the user's hands. Based on the information obtained related to the user's hands, the type of soft keyboard corresponding to the first keyboard layout is determined, and the size, spacing, or position of the soft keys included in the soft keyboard corresponding to the first keyboard layout is adjusted.

10. The electronic device according to claim 9, wherein, The memory stores the one or more instructions, which, when executed individually or jointly by at least one processor, cause the electronic device to further: When the user's hand is identified by analyzing image data, the projection component is controlled to project a soft keyboard corresponding to the first keyboard layout. and When the user's hand is not identified by analyzing the image data, the control projection component projects a soft keyboard corresponding to the second keyboard layout or does not project a soft keyboard.

11. An operation method (400) of an electronic device (100), wherein, The operation method (400) includes: Identify (410) whether the touch sensing device (20) is coupled to the electronic device (100) to sense user touch input on the soft keyboard, wherein the touch sensing device (20) is configured to be detachably coupled to the electronic device (100); and Based on the identification of the touch sensing device (20) coupled to the electronic device (100), the control (420) projection component (162) projects a soft keyboard corresponding to the first keyboard layout onto the projection plane.

12. The operating method according to claim 11, further comprising: Based on the recognition that the touch sensing device is not coupled to the electronic device, the control projection component projects a soft keyboard corresponding to the second keyboard layout onto the projection plane.

13. The operating method according to claim 11 or 12, further comprising: Based on the recognition that the touch sensing device is coupled to the electronic device when projecting a soft keyboard corresponding to the second keyboard layout, the control projection component changes the soft keyboard corresponding to the second keyboard layout to a soft keyboard corresponding to the first keyboard layout, and projects the soft keyboard corresponding to the first keyboard layout.

14. The operating method according to any one of claims 11 to 13, further comprising: Based on the recognition that the touch sensing device and the electronic device are separated when projecting a soft keyboard corresponding to the first keyboard layout, the control projection component changes the soft keyboard corresponding to the first keyboard layout to a soft keyboard corresponding to the second keyboard layout, and projects the soft keyboard corresponding to the second keyboard layout.

15. A computer-readable recording medium having recorded thereon at least one program for enabling a computer to implement the operating method according to any one of claims 11 to 14.

Images