Electronic device and method for operating same

Abstract

An electronic device and a method for operating same are provided. The electronic device comprises: a memory that stores one or more instructions; and one or more processors that executes the one or more instructions stored in the memory, wherein the one or more processors receive information on a gesture to be changed and a user input corresponding to a change application range of the gesture by executing the one or more instructions. The one or more processors acquire, on the basis of the information on the gesture and the information on an action corresponding to the gesture, information on a plurality of candidate gestures corresponding to a gesture set by another user for activation of the action. The one or more processors provide a recommended gesture corresponding to the action on the basis of the information on the plurality of candidate gestures and the change application range.

Description

Electronic device and method of operation thereof

[0001] The disclosed various embodiments relate to electronic devices and methods of operating the same, and more particularly to electronic devices that recognize user gestures and methods of operating the same.

[0002] Recent electronic devices offer gesture recognition services that recognize user gestures and perform actions corresponding to the recognized gestures. For example, a user can pre-define specific gestures and corresponding actions on the electronic device. If the electronic device recognizes the user's gesture input as a pre-defined gesture, it can perform an action corresponding to the pre-defined gesture.

[0003] However, if a non-predefined gesture is input to an electronic device, the electronic device may not recognize the gesture. Furthermore, if the user's physical or environmental limitations prevent them from expressing predefined gestures on the electronic device, the gesture recognition service may not be utilized.

[0004] An electronic device according to one embodiment of the present disclosure includes a memory storing one or more instructions, and one or more processors executing one or more instructions stored in the memory, wherein the one or more processors receive information about a target gesture to be changed and a user input corresponding to a change application range of the gesture by executing the one or more instructions. The one or more processors obtain information about a plurality of candidate gestures corresponding to a gesture set by another user for activating the action based on the information about the gesture and the information about an action corresponding to the gesture. The one or more processors provide a recommended gesture corresponding to the action based on the information about the plurality of candidate gestures and the change application range.

[0005] A method of operating an electronic device according to one embodiment of the present disclosure includes the steps of receiving user input corresponding to information about a change target gesture and a change application range of the gesture, obtaining information about a plurality of candidate gestures corresponding to a gesture set by another user for activating the action based on the information about the gesture and the information about an action corresponding to the gesture, and providing a recommended gesture corresponding to the action based on the information about the plurality of candidate gestures and the change application range.

[0006] FIG. 1 is a drawing for explaining an operation of an electronic device providing a gesture recognition service according to one embodiment.

[0007] FIG. 2 is a schematic block diagram of an electronic device and a server according to one embodiment.

[0008] FIG. 3 is an example drawing of a gesture DB and an action DB according to one embodiment.

[0009] FIG. 4 is an example drawing of a candidate action list and a candidate gesture list according to one embodiment.

[0010] FIG. 5 is a flowchart illustrating an operation method for an electronic device to modify a gesture according to one embodiment.

[0011] FIG. 6 is an exemplary drawing for explaining an operation of an electronic device according to one embodiment of the present invention to provide a recommended gesture for a change target gesture.

[0012] FIG. 7 is an exemplary drawing for explaining an operation of an electronic device according to one embodiment of the present invention to provide a recommended gesture for a change target gesture.

[0013] FIG. 8 illustrates an example of a user interface representing a gesture setting screen according to one embodiment.

[0014] FIG. 9 illustrates an example of an interface for a user to inquire about change application information for a change target gesture according to one embodiment.

[0015] FIG. 10 illustrates an example of an interface for a user to inquire about a change target gesture according to one embodiment.

[0016] FIG. 11 illustrates an example of a user interface that provides a recommended gesture for a change target gesture according to one embodiment.

[0017] FIG. 12 is a flowchart illustrating an operation method for an electronic device according to one embodiment to change the shape of a gesture, change the properties of a gesture, or change an action.

[0018] FIG. 13 illustrates an example of an interface for a user to inquire about the type of modification of a gesture by an electronic device according to one embodiment.

[0019] FIG. 14 is a flowchart illustrating an operation method for an electronic device to change the shape of a gesture according to one embodiment.

[0020] FIG. 15 is a flowchart illustrating an operation method for recommending an existing gesture by an electronic device according to one embodiment.

[0021] FIG. 16 is a flowchart illustrating an operation method for an electronic device to obtain a new gesture from a user according to one embodiment.

[0022] FIG. 17 is an exemplary diagram showing the result of an electronic device determining the similarity of gestures according to one embodiment.

[0023] FIG. 18A is a flowchart illustrating an operation method for an electronic device to change the properties of a gesture according to one embodiment.

[0024] FIG. 18b is an example diagram illustrating properties of a gesture stored in an electronic device according to one embodiment.

[0025] FIG. 19 is a flowchart illustrating an operation method for an electronic device to change an action according to one embodiment.

[0026] Figure 20 is a flowchart illustrating the operation of an electronic device and a server according to one embodiment.

[0027] FIG. 21 is a detailed block diagram of an electronic device according to one embodiment.

[0028] In this disclosure, the expression “at least one of a, b or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “all of a, b and c”, or variations thereof.

[0029] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.

[0030] Although the functions mentioned in this disclosure are described using currently used general terms, they may refer to various other terms depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Therefore, the terms used in this disclosure should not be interpreted solely based on their names, but rather based on the meanings of the terms and the overall content of this disclosure.

[0031] Additionally, the terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the present disclosure.

[0032] When a part of the specification is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," etc., used throughout the specification refer to a unit that processes at least one function or operation, which may be implemented in hardware, software, or a combination of hardware and software.

[0033] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement the present invention. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description have been omitted to clearly explain the present invention, and similar parts have been designated with similar reference numerals throughout the specification.

[0034] In the embodiments of this specification, the term “user” means a person who controls a system, function or operation, and may include a developer, administrator or installer.

[0035] The present disclosure will be described in detail with reference to the attached drawings below.

[0036] FIG. 1 is a drawing for explaining an operation of an electronic device providing a gesture recognition service according to one embodiment.

[0037] Referring to FIG. 1, an electronic device (100) according to an embodiment of the present disclosure may provide a gesture recognition service. The gesture recognition service according to an embodiment of the present disclosure may be a service that recognizes a user's gesture and provides an action corresponding to the recognized gesture. A user of the electronic device (100) may control the electronic device (100) through a gesture so that the electronic device (100) performs an action corresponding to the gesture without a separate input device. The action corresponding to the gesture is an action that can be activated by the gesture, and may include one or more operations that can be activated according to the recognition of the gesture.

[0038] The electronic device (100) may include at least one of a TV, a smartphone, a tablet PC, a digital camera, a camcorder, a laptop computer, a desktop, an e-book reader, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, an MP3 player, a wearable device, a smart watch, a home network system, a security system, a medical device, a head-mounted display (HMD), a hemispherical display, a large display, and a projector display.

[0039] An electronic device (100) according to one embodiment of the present disclosure may be equipped with an operating system (OS) and an Internet connection function. In this case, the electronic device (100) may be referred to as a smart TV or an Internet TV. In addition to the original function of a TV, which is to output real-time broadcast programs, the electronic device (100) may execute various types of applications (apps) using the operating system installed therein. Various types of applications may be installed on the electronic device (100) by default. Alternatively, the electronic device (100) may, under user control, access the Internet, search for applications requested by the user, and install the applications. By executing applications, the electronic device (100) may provide various services provided by the applications. Applications may include various categories, types, attributes, types, genres, etc. For example, applications may include game category applications that provide game content, OTT category applications that provide VOD (Video On Demand) content, and music category applications that provide music content. In the present disclosure, a 'category application' may include one or more applications whose types or properties correspond to a specific category.

[0040] An electronic device (100) according to one embodiment of the present disclosure can provide personalized gestures for each user of the electronic device (100). For example, the electronic device (100) can store information regarding predefined gestures. For example, the electronic device (100) can map and store predefined gestures and actions corresponding to each predefined gesture. A user can preset various gestures for controlling the electronic device (100) and corresponding actions.

[0041] Additionally, an electronic device (100) according to one embodiment of the present disclosure may store a setting range in which predefined gestures are set together with information regarding predefined gestures. In the present disclosure, the setting range may represent a system range in which an action corresponding to a pre-stored gesture is set to be activated.

[0042] For example, the setting scope may include the entire system of the electronic device (100), the category application scope, or the application scope. For example, the setting scope of the gesture is a concept that narrows in the order of the entire system, the category application scope, and the application scope. For example, the application scope may refer to an individual application, the category application scope may refer to an individual category application such as a game category or an OTT category, and the system as a whole may refer to all applications that can be executed on the electronic device (100) such as a game category, an OTT category, and a music category. In the present disclosure, the entire system may refer to a scope that can be controlled by the operating system installed in the electronic device (100). For example, the entire system may include the electronic device (100) itself and a combination of all hardware and software included in the electronic device (100). For example, a gesture set for the entire system may be used to control the electronic device (100) itself, all hardware and software included in the electronic device (100), and all executable applications through the operating system installed in the electronic device (100).

[0043] In one embodiment of the present disclosure, gestures set throughout the system may be used to select and manipulate user interface elements (UI Components) such as menus, icons, items, widgets, etc., or to control operations such as power, volume control, channel change, etc. In addition, gestures set throughout the system may be used to execute or control various applications installed in the electronic device (100). In one embodiment, actions corresponding to gestures may include operations for selecting and manipulating user interface elements, operations for power, volume control, channel change, etc., or operations for executing or controlling various applications installed in the electronic device (100).

[0044] For example, the electronic device (100) can store information about a palm open gesture (10), information about an action mapped to the palm open gesture (10), and a setting range of the palm open gesture (10) (20). For example, when the electronic device (100) acquires the palm open gesture (10) through a sensor, it can perform a gesture recognition mode initiation operation. For example, since the palm open gesture (10) is set throughout the system, the electronic device (100) can perform an action corresponding to the gesture (10) in various situations, such as outputting a user interface screen such as a home screen or a setting screen, outputting a broadcast program, or executing applications of various categories.

[0045] In one embodiment of the present disclosure, a gesture set within a category application range may be used to control the electronic device (100) only when a specific category application is executed. For example, the electronic device (100) may store information regarding a gesture (20) of moving left and right with a palm open, information regarding an action mapped to the gesture (20), and a setting range of the gesture (20) (60). For example, when the electronic device (100) acquires a gesture (20) of moving left and right with a palm open through a sensor, the electronic device (100) may control an object within a game. For example, since the gesture (20) is set only within a game category application range, the electronic device (100) may perform an action corresponding to the gesture (20) only while executing a game category application. For example, the electronic device (100) may not perform an action corresponding to the gesture (20) while executing an OTT category application.

[0046] In one embodiment of the present disclosure, a gesture set in an application scope may be used to control the electronic device (100) only when a specific application is running. For example, if a first gesture set in a first game app and an action corresponding thereto are stored in the electronic device (100), the electronic device (100) may not perform an action corresponding to the first gesture while running a second game app.

[0047] In one embodiment of the present disclosure, the electronic device (100) can modify a predefined gesture into another gesture desired by the user. For example, the electronic device (100) can modify a predefined gesture into another form of gesture desired by the user, or can modify the properties of a predefined gesture. For example, the properties of a gesture may include the duration of recognition of the gesture, the movement direction of the gesture, or whether the gesture is combined with a previous gesture. In addition, for example, the electronic device (100) can modify an action corresponding to a predefined gesture into another action desired by the user. For example, the electronic device (100) can output a gesture modification screen that provides a gesture modification function based on a user's input of selecting a setting item (15) displayed on the home screen. Alternatively, for example, the electronic device (100) can output a gesture modification screen based on a user's voice input requesting the gesture modification screen.

[0048] In one embodiment of the present disclosure, when a user changes a predefined gesture, the user can select a scope of application of the change to the target gesture. In the present disclosure, the target gesture may indicate a gesture that the user will change. The target gesture may correspond to a predefined gesture. In the present disclosure, the scope of application of the change may indicate a setting scope to which the change to the target gesture will be applied. For example, the scope of application of the change may include any one of the entire system, a category of applications, or an individual application. For example, the user may select the scope of application of the change to be applied to the entire system so that the change to the gesture is reflected throughout the entire system, select the scope of application of a specific category so that the change to the gesture is reflected only in a specific category of applications, or select the scope of application of the change to be applied to a specific application so that the change to the gesture is reflected only in a specific application.

[0049] The electronic device (100) can acquire a target gesture to be changed and a range of application of the change in the gesture based on the user's input. The electronic device (100) can be configured to reflect the change in the gesture only within the acquired range. The electronic device (100) can maintain the existing gesture, not the changed gesture, outside the acquired range. For example, when a user wishes to change a palm-opening gesture (10) to another type of gesture (e.g., a fist-closing gesture), the OTT category application can be selected as the change application range so that the gesture change information is reflected only within an OTT category application. In this case, the electronic device (100) can initiate a gesture recognition mode in response to a fist-closing gesture only when executing an OTT category application. When executing an application other than an OTT category application (e.g., a game application), the electronic device (100) can still initiate the gesture recognition mode through the palm-opening gesture (10).

[0050] In one embodiment of the present disclosure, the electronic device (100) may provide a recommended gesture to the user when the user changes a predefined gesture to another gesture. For example, the recommended gesture may include a candidate gesture set for the corresponding action by a user of another electronic device other than the user of the electronic device (100). The candidate gesture may be a gesture set for the corresponding action by a user of another electronic device. For example, the electronic device (100) may prioritize one or more candidate gestures for the corresponding action and provide a customized recommended gesture to the user of the electronic device (100).

[0051] Additionally, in one embodiment of the present disclosure, the electronic device (100) may provide a recommended action to the user when the user changes an action corresponding to a predefined gesture to another action. For example, the recommended action may include a candidate action set for the corresponding gesture by a user of another electronic device in addition to the user of the electronic device (100). The candidate action may be an action set for the corresponding gesture by a user of another electronic device. For example, the electronic device (100) may prioritize one or more candidate actions for the corresponding gesture and provide a recommended action customized to the user of the electronic device (100).

[0052] Meanwhile, in one embodiment of the present disclosure, a user may change the setting range of a predefined gesture. For example, the user may change the setting range of the palm-opening gesture (10) to a game category application rather than the entire system. In this case, the electronic device (100) initiates gesture recognition mode through the palm-opening gesture (10) only when executing a game category application. During other operations, even if the palm-opening gesture (10) is recognized, the electronic device (100) may not perform the gesture recognition mode initiation operation.

[0053] According to one embodiment of the present disclosure, the electronic device (100) can provide personalized gestures for each user by allowing the user to modify gestures as desired. This can resolve the problem of users being unable to change gestures defined in the electronic device (100) as desired. Furthermore, the electronic device (100) can recommend gestures or actions to modify to the user of the electronic device (100) by considering the setting history of other users. Accordingly, the interaction between the electronic device (100) and the user can be enhanced. Furthermore, the user convenience of the electronic device (100) can be enhanced.

[0054] Although the electronic device (100) is illustrated as including a display in FIG. 1, the present invention is not limited thereto. For example, the electronic device (100) may be a device that provides content to an external display device including a display. The content may include, but is not limited to, images, videos, audio, text, games, applications, etc. The electronic device (100) may include a set-top box (STB), a Blu-ray Disc player, a Digital Versatile Disk (DVD) player, a game device, a digital camera, a camcorder, a streaming device, a home theater, etc. In this case, the electronic device (100) may be connected to the external display device through an input / output unit such as an HDMI port, and configured to transmit video / audio signals to the external display device. Alternatively, the electronic device (100) may be connected to the external display device through wired communication, short-range wireless communication such as wireless LAN (W-LAN), Wi-Fi, or Bluetooth, or long-range wireless communication.

[0055] FIG. 2 is a schematic block diagram of an electronic device and a server according to one embodiment.

[0056] Referring to FIG. 2, the electronic device (100) may include a processor (110), a memory (120), a communication unit (130), a sensor (140), and a user interface (150). However, the electronic device (100) may be implemented with more or fewer components than the illustrated components, and is not limited to the examples described above.

[0057] The memory (120) can store a program for processing and controlling the processor (110), and can store data input to or output from the electronic device (100). The memory (120) can include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0058] In one embodiment of the present disclosure, the memory (120) may store information regarding gestures defined by the user in the electronic device (100) and information regarding actions mapped to the gestures. The memory (120) may also store at least one of information regarding a setting range of the gesture, information regarding a setting account of the gesture, and information regarding the duration of the gesture, together with information regarding the gesture and information regarding the action. In one embodiment of the present disclosure, the memory (120) may store the above-described information in a gesture database (Gesture DB) and an action database (Action DB), which will be described in detail with reference to FIG. 3.

[0059] In one embodiment of the present disclosure, the memory (120) may store one or more candidate actions representing information regarding actions set by other users for gestures. The one or more candidate actions may include actions that other users have set frequently for gestures. The memory (120) may also store at least one of information regarding the setting range of the one or more candidate actions, information regarding the setting account of the one or more candidate actions, or information regarding the duration of the one or more candidate actions. The memory (120) may store the information described above in the candidate action list (410), which is described in detail in FIG. 4.

[0060] In one embodiment of the present disclosure, the memory (120) may store one or more candidate gestures representing information about gestures set by other users for actions. The one or more candidate gestures may include gestures that other users have set with a high frequency for actions. The memory (120) may also store at least one of information about a set range of the one or more candidate gestures, information about a set account of the one or more candidate gestures, or information about a duration of the one or more candidate gestures. Information about gestures stored in the memory (120) may be periodically updated by the processor (110). The memory (120) may store the above-described information in a candidate gesture list (420), which will be described in detail with reference to FIG. 4.

[0061] The processor (110) controls the overall operation of the electronic device (100). For example, the processor (110) may perform the functions of the electronic device (100) described in the present disclosure by executing one or more instructions stored in the memory (120). In this case, the memory (120) may store one or more instructions executable by the processor (110). In addition, the processor (110) may store one or more instructions in an internally provided memory, and execute one or more instructions stored in the internally provided memory to control the performance of the aforementioned operations. That is, the processor (110) may perform a predetermined operation by executing at least one instruction or program stored in the internal memory provided within the processor (110) or the memory (120).

[0062] The processor (110) may include one or more processors. At this time, one or more processors may be general-purpose processors such as a CPU, AP, or DSP (Digital Signal Processor), graphics-only processors such as a GPU or VPU (Vision Processing Unit), or artificial intelligence-only processors such as an NPU. If one or more processors are artificial intelligence-only processors, the artificial intelligence-only processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0063] The communicator (130) can transmit and receive data or signals with external devices, peripheral devices, servers, display devices, etc. under the control of the processor (110). For example, the communicator (130) can include a Wi-Fi module, a Bluetooth module, an infrared communication module, a wireless communication module, a LAN module, an Ethernet module, a wired communication module, etc. In this case, each communication module can be implemented in the form of at least one hardware chip. The Wi-Fi module and the Bluetooth module perform communication in the Wi-Fi method and the Bluetooth method, respectively. When using the Wi-Fi module or the Bluetooth module, various connection information such as the SSID and the session key are first transmitted and received, and after establishing a communication connection using this, various information can be transmitted and received. The wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.

[0064] In one embodiment of the present disclosure, the communication unit (130) can update information about gestures and information about actions by periodically transmitting to the server (200) the gestures and actions mapped to the gestures defined by the user in the electronic device (100). In addition, the communication unit (130) can transmit to the server (200) at least one of information about the setting range of the gesture, information about the setting account of the gesture, and information about the duration of the gesture, together with the information about the gesture and the information about the action.

[0065] In one embodiment of the present disclosure, the communication unit (130) may periodically receive from the server (200) one or more candidate actions representing information about actions set by other users for gestures. The one or more candidate actions may include actions with a high mapping frequency for each gesture. The communication unit (130) may periodically receive from the server (200) one or more candidate gestures representing information about gestures set by other users for actions. The one or more candidate gestures may include gestures with a high mapping frequency for each action. In addition, the communication unit (130) may receive from the server (200) at least one of information about a setting range of one or more candidate gestures, information about a setting account of one or more candidate gestures, or information about a duration of one or more candidate gestures. The communication unit (130) may periodically exchange data with the server (200) through a background operation.

[0066] The sensor (140) can detect the presence, location, and type of the user's spatial gestures, touches, and other user interactions. For example, the sensor (140) may include one or more sensors. For example, the sensor (140) may include a distance sensor, an image sensor, a gesture sensor, an illuminance sensor, a gyro sensor, and the like. For example, the distance sensor may include various sensors that detect the distance between the electronic device (100) and the user, such as an ultrasonic sensor, an IR (Infrared Radiation) sensor, and a TOF (Time of Flight) sensor. For example, the image sensor may include a camera, and may capture an image of the user through the camera, convert the captured image into sensing data, and transmit the captured image to the processor (110). When the sensor (140) includes two or more cameras, gestures may be recognized using various other sensors, such as a TOF sensor or a 3D camera.

[0067] The sensor (140) may not be built into the electronic device (100), but may be implemented as a camera of a terminal connected to the electronic device (100), a camera connected via USB, a sensor, a peripheral IoT (Internet of Things) device, etc. For example, when a user holds a remote control or an external device equipped with a gyro sensor in his / her hand and makes a gesture, the gyro sensor can recognize the user's gesture. Alternatively, when a user wears a wearable device such as a watch, bracelet, or ring and makes a gesture, the wearable device can recognize the user's gesture.

[0068] The user interface (150) may include an input interface and / or an output interface. The user interface (150) may be capable of receiving a user's input under the control of the processor (110). The user interface (150) may include at least one of a key pad, a dome switch, a touch panel (contact electrostatic capacitance type, pressure resistive film type, infrared detection type, surface ultrasonic conduction type, integral tension measurement type, piezo effect type, etc.), a jog wheel, and a jog switch as an input interface, but is not limited thereto. The user interface (150) may also include a microphone. The microphone may receive an acoustic signal from an external device or a speaker (a user of the electronic device (100)). The microphone may receive an acoustic signal and convert it into audio data. The microphone may be built into the electronic device (100) or may be separately provided in a remote control.

[0069] The user interface (150) can output images or data processed in the electronic device (100) under the control of the processor (110). The user interface (150) can include a display as an output interface.

[0070] A user interface (150) according to one embodiment of the present disclosure may receive user input for modifying a gesture. A user interface (150) according to one embodiment of the present disclosure may receive user input regarding the scope of change within which a change to a gesture is to be reflected. A user interface (150) according to one embodiment of the present disclosure may receive user input for selecting a target gesture for modification. A user interface (150) according to one embodiment of the present disclosure may display recommended gestures.

[0071] According to one embodiment of the present disclosure, one or more processors (110) receive user input regarding information about a target gesture to be changed and a change application range for the gesture by executing one or more instructions. Based on the information about the target gesture to be changed and information about an action that can be activated by the gesture, the one or more processors (110) obtain one or more candidate gestures corresponding to gestures set by another user to activate the action. Based on the one or more candidate gestures and the change application range, the one or more processors (110) provide a recommended gesture for the action.

[0072] An electronic device (100) according to one embodiment of the present disclosure can provide personalized gestures for each user by allowing the user to modify gestures as desired. Furthermore, the electronic device (100) can recommend gestures or actions to modify to the user of the electronic device (100) by considering the setting history of other users.

[0073] Meanwhile, in one embodiment, the electronic device (100) can execute a gesture recommendation function by collecting the setting history set by other users for gestures and actions within the electronic device (100) itself without interfacing with a separate server. For example, in one embodiment, the electronic device (100) can provide a gesture recommendation function in an on-device form.

[0074] The server (200) may include a processor (210), memory (220), and communication unit (230).

[0075] The processor (210) controls the overall operation of the server (200). For example, the processor (210) may perform the functions of the server (200) described in the present disclosure by executing one or more instructions stored in the memory (220).

[0076] The memory (220) can store a program for processing and controlling the processor (210) and can store data input to or output from the server (200).

[0077] In one embodiment of the present disclosure, the memory (220) may store one or more candidate actions representing information about actions set by another user for a gesture. The memory (220) may store one or more candidate gestures representing information about gestures set by another user for an action. The memory (220) may also store at least one of information about a setting range of one or more candidate gestures, information about a setting account of one or more candidate gestures, or information about a duration of one or more candidate gestures. Information about gestures stored in the memory (220) may be periodically updated by the processor (210).

[0078] The communication unit (230) may include one or more modules that enable wireless communication between the server (200) and the network where the electronic device (100) is located. The communication unit (230) may transmit and receive data or signals to and from the electronic device (100).

[0079] In one embodiment of the present disclosure, the communication unit (230) may periodically receive, from the electronic device (100), a gesture defined by a user of the electronic device (100) and an action mapped to the gesture. In addition, the communication unit (230) may receive, from the electronic device (100), at least one of information regarding a setting range of the gesture, information regarding a setting account of the gesture, and information regarding the duration of the gesture, together with information regarding the gesture and information regarding the action.

[0080] In one embodiment of the present disclosure, the communication unit (230) may periodically receive, from each of a plurality of electronic devices, gestures defined by a user of each electronic device and actions mapped to the gestures. The processor (210) may identify an action with a high mapping frequency for each gesture based on the gesture-related information and action-related information received from each of the plurality of electronic devices, and update candidate actions in order of the highest mapping frequency. In addition, the processor (210) may identify a gesture with a high mapping frequency for each action, and update candidate gestures in order of the highest mapping frequency.

[0081] In one embodiment of the present disclosure, the communication unit (230) may periodically transmit to the electronic device (100) one or more candidate actions representing information about actions set by another user for a gesture. The one or more candidate actions may include actions having a high mapping frequency for each gesture. The communication unit (230) may periodically transmit to the electronic device (100) one or more candidate gestures representing information about gestures set by another user for an action. The one or more candidate gestures may include gestures having a high mapping frequency for each action. In addition, the communication unit (230) may transmit to the electronic device (100) at least one of information about a setting range of the one or more candidate gestures, information about a setting account of the one or more candidate gestures, or information about a duration of the one or more candidate gestures.

[0082] FIG. 3 is an example drawing of a gesture DB and an action DB according to one embodiment.

[0083] Referring to FIG. 3, the electronic device (100) can store a gesture DB (340) and an action DB (350) in the memory (120).

[0084] The gesture DB (340) may include information (341) about gestures defined by the user in the electronic device (100) and information (342) about actions mapped to the gestures. The gesture DB (340) may include at least one of information (343) about a setting range of the gesture, information (344) about a setting account of the gesture, and information (not shown) about the duration of the gesture. The gesture DB (340) may further include embedded data (not shown) indicating the characteristics of the gesture. The electronic device (100) may recognize the shape of the gesture, the properties of the gesture, etc. through the embedded data stored in the gesture DB (340).

[0085] The gesture DB (340) can store information about gestures (341) as a gesture ID and information about actions (342) as an action ID. The gesture DB (340) can store information about the setting range of gestures (343) as System, Category_#, App_#, etc. Here, System refers to the entire system of the electronic device (100), Category_# refers to a specific category application running on the electronic device (100), and App_# refers to a specific application running on the electronic device (100). The gesture DB (340) can store information about the setting account of the gesture (344) as All, User_#, etc. Here, All refers to all user accounts registered on the electronic device (100), and User_# refers to a specific user account registered on the electronic device (100).

[0086] For example, information about gestures (341) may include one-hand gestures such as a thumb up gesture while making a fist, an index finger up gesture while making a fist, a palm open gesture, and a fist gesture. Alternatively, information about gestures (341) may include two-hand gestures or gestures using body parts other than the hands. In addition, for example, information about gestures (341) may include motion gestures such as swiping, zoom-in, and zoom-out in addition to static gestures. In addition, for example, information about gestures (341) may further include attribute information about the gesture in addition to the shape information of the gesture described above. For example, attribute information about the gesture may include the duration of recognition of the gesture, the direction of movement, or a combination with a previous gesture. For example, information about gestures (341) may include a gesture of holding the palm open for 5 seconds, a gesture of moving the palm open left and right, or a gesture of holding the palm open for 5 seconds and then moving it up and down.

[0087] The action DB (350) may include information about actions mapped to gestures set in the electronic device (100). For example, the action DB (350) may include information about actions (351) and target actions (352). The target actions (352) may include functions or services that can be performed in the electronic device (100).

[0088] The action DB (350) stores information about actions (351) as action IDs, and may include various functions such as Launch Home, Volume Up, Launch Netflix, Channel Up, Mute, and Control Object as target actions (352). For example, functions such as Launch Home, Volume Up, Launch Netflix, Channel Up, and Mute are within the scope of controllable operation systems installed in the electronic device (100), and may be set to the entire system, category applications, applications, and the like. For example, the Control Object function controls characters or objects of specific applications running in the electronic device (100), and thus may be mainly set to game category applications, game applications, and the like.

[0089] For example, referring to 301 of the gesture DB (340), Gesture_9 (e.g., a fist-clenching gesture) is mapped to Action_4. Gesture_9 can be set system-wide. Gesture_9 can be set for all users. Referring to 302 of the action DB (350), Action_4 represents a Mute function. Accordingly, when the electronic device (100) acquires the fist-clenching gesture, it can perform a Mute action. Since the fist-clenching gesture is set system-wide, the electronic device (100) can perform the Mute action in response to the fist-clenching gesture in various situations, such as when outputting a user interface screen such as a home screen or a setting screen, outputting a broadcast program, or executing applications of various categories. Since the fist-clenching gesture is set for all users, the electronic device (100) can provide the Mute action in response to the fist-clenching gesture to users of all accounts registered in the electronic device (100).

[0090] Alternatively, for example, in the gesture DB (340), Gesture_21 may be mapped to Action_7, and Gesture_21 may be set in Category_1. For example, Category_1 may correspond to a game category application. The electronic device (100) may perform an action corresponding to Gesture_21 only when executing a game category application.

[0091] Alternatively, for example, in the gesture DB (340), Gesture_4 may be mapped to Action_3, and Gesture_4 may be set in App_23. For example, App_23 may be a game app. The electronic device (100) may perform the action corresponding to Gesture_4 only when the game app is executed. In addition, Gesture_4 may be set for User_1. The electronic device (100) may perform the action corresponding to Gesture_4 only when the electronic device (100) is executed under the first user account.

[0092] FIG. 4 is an example drawing of a candidate action list and a candidate gesture list according to one embodiment.

[0093] Referring to FIG. 4, the electronic device (100) can store a candidate action list (410) and a candidate gesture list (420) in the memory (120).

[0094] The candidate action list (410) may store one or more candidate actions representing information about actions set by other users for gestures. The one or more candidate actions may include actions that other users have set with a high frequency for gestures. The candidate action list (410) may be periodically received from the server (200). The server (200) may identify actions that are mapped with a high frequency for each gesture based on the gesture DB (340) of the electronic device (100) and the gesture DB of an external electronic device, and update the candidate action list (410).

[0095] The candidate action list (410) may include embedded data (412) corresponding to the gesture, candidate actions (413) for the gesture, information regarding the setting range of the candidate action (414), and information regarding the setting account of the candidate action (415). In addition, the candidate action list (410) may further include information (not shown) regarding the duration of the candidate action.

[0096] Embedding data (412) corresponding to a gesture can be expressed as embedding data representing the characteristics of the gesture. Embedding data may vary depending on the form and properties of the gesture. Candidate actions (413) for a gesture may include one or more candidate actions for each gesture. Candidate actions (413) for a gesture may be stored as an action ID. In FIG. 4, the candidate action list (410) is exemplified as having one candidate action for each gesture, but is not limited thereto. The candidate action list (410) may have more than one candidate action for each gesture. Information (414) regarding the setting scope of the candidate action may be stored as System, Category_#, App_#, etc. Here, System, Category_#, and App_# indicate that different users have set actions corresponding to the gesture in the entire system, a specific category application, or a specific category, respectively. Information (415) regarding the setting account of the candidate action may be stored as All, Personal, etc. Here, "All" and "Personal" indicate that other users have set actions corresponding to the gesture, either for the entire user account or for individual user accounts, respectively. Information regarding the duration of the candidate action (not shown) may include whether other users have set the action corresponding to the gesture to be permanent or temporary.

[0097] For example, referring to 401 of the candidate action list (410), Gesture_4 may have Action_3 as a candidate action. Action_3, a candidate action of Gesture_4, has a history set for the entire system and a history set for individual users.

[0098] The candidate gesture list (420) may store one or more candidate gestures representing information about gestures set by other users for actions. The one or more candidate gestures may include gestures that other users have set with a high frequency for actions. The candidate gesture list (420) may be periodically received from the server (200). The server (200) may identify gestures that are mapped with a high frequency for each action based on the gesture DB (340) of the electronic device (100) and the gesture DB of an external electronic device, and update the candidate gesture list (420).

[0099] The candidate gesture list (420) may include candidate gestures for actions (422, 423, 424), information about the set range of the candidate gestures (425), and information about the set account of the candidate gestures (426). In addition, the candidate gesture list (420) may further include information (not shown) about the duration of the candidate gestures.

[0100] Candidate gestures (422, 423, 424) for an action may include one or more candidate gestures for each action. Candidate gestures (422, 423, 424) for an action may be stored as gesture IDs. In FIG. 4, the candidate gesture list (420) is exemplified as having three candidate gestures for each action, for example, a first candidate gesture (422), a second candidate gesture (423), and a third candidate gesture (424), but is not limited thereto. The candidate gesture list (420) may have more than three candidate actions for each action, or may have fewer than three candidate actions. Information (425) regarding the setting range of the candidate gestures may be stored as System, Category_#, App_#, etc. Here, System, Category_#, and App_# indicate that different users have set a history of gestures corresponding to the action in the entire system, a specific category application, and a specific category, respectively. Information (426) regarding the candidate gesture's setting account can be stored as "All," "Personal," etc. Here, "All" and "Personal" indicate that other users have set a history of gestures corresponding to the action for the entire user account or for individual user accounts, respectively. Information regarding the duration of the candidate gesture (not shown) may include information regarding whether other users have set the gesture corresponding to the action to be permanent or temporary.

[0101] For example, referring to 402 of the candidate gesture list (420), Action_4 may have Gesture_1, Gesture_3, and Gestrue_2 as candidate gestures. Gesture_1, the first candidate gesture (422) of Action_4, is set system-wide and has a history set for all users. Gesture_3, the second candidate gesture (423) of Action_4, is set in Category_1 and has a history set for individual users. Gesture_2, the third candidate gesture (424) of Action_4, is set in Category_1 and has a history set for all users. For example, Category_1 may correspond to a game category application, but is not limited thereto.

[0102] FIG. 5 is a flowchart illustrating an operation method for an electronic device to modify a gesture according to one embodiment.

[0103] Referring to FIG. 5, at step 510, the electronic device (100) may receive a user input to enter a gesture modification menu.

[0104] For example, the gesture modification menu may appear as a gesture modification screen. For example, the electronic device (100) may receive user input through the user interface (150). The electronic device (100) may display the gesture modification screen based on the user input for entering the gesture modification screen.

[0105] In one embodiment, the electronic device (100) may receive a user input for selecting or manipulating a user interface element, such as a menu, icon, item, widget, etc. The electronic device (100) may display a gesture modification screen based on the user input. For example, the electronic device (100) may output a gesture setting screen based on a user input for selecting a setting item (15) displayed on a home screen, as illustrated in FIG. 1. The user may enter the gesture modification screen by selecting a user interface element through multiple steps or depths.

[0106] Alternatively, in one embodiment, the electronic device (100) may receive a user's voice input requesting a gesture modification screen. The electronic device (100) may display the gesture modification screen based on the user's voice input.

[0107] Alternatively, in one embodiment, the electronic device (100) may display a gesture modification screen based on the settings of the currently running application. For example, the electronic device (100) may display a gesture modification screen based on a user input selecting a settings item present on the currently running application screen. Referring to FIG. 8, an example of a user interface for entering the gesture modification screen will be described.

[0108] In step 520, the electronic device (100) may receive information about the gesture to be changed and a user input corresponding to the change application scope of the gesture. In the present disclosure, the change application scope of the gesture may indicate the setting scope to which the change to the gesture will be applied. For example, the setting scope may include the entire system of the electronic device (100), the category application scope, or the application scope.

[0109] An electronic device (100) according to one embodiment may display a user interface that inquires the user about the scope of application for a change in a gesture. The electronic device (100) according to one embodiment may receive user input regarding the scope of application for a change in a gesture through the user interface that inquires about the scope of application for a change in a gesture. The user interface that inquires about the scope of application for a change in a gesture may be expressed as a "first gesture modification screen." The first gesture modification screen will be described in detail with reference to FIG. 9 , which will be described later.

[0110] The system represents the range that can be controlled by the operating system installed in the electronic device (100), and may include the electronic device (100) itself and a combination of all hardware and software included within the electronic device (100). For example, gestures set throughout the system may be used to select and manipulate user interface elements such as menus, icons, items, widgets, etc., or to control operations such as power, volume control, channel change, etc., or to execute or control various applications installed in the electronic device (100).

[0111] The category application scope may represent individual category applications, such as the game category or the OTT category. For example, a gesture set in the category application scope may be used to control the electronic device (100) only when executing a specific category application.

[0112] An application scope may represent an individual application, such as an OTT content app, a game app, etc. For example, a gesture set in an application scope may be used to control an electronic device (100) only when a specific application is running.

[0113] For example, the scope of change application may indicate the setting scope of the second gesture when the first gesture (existing gesture) is changed to the second gesture (changed gesture). For example, a user may select the game category as the scope of change application so that the first gesture set throughout the system is set to the second gesture in the OTT category. For example, when the electronic device (100) executes the game category, it may perform an action corresponding to the changed second gesture, and when executing any operation other than the game category, it may perform an action corresponding to the existing first gesture.

[0114] In one embodiment, the electronic device (100) may receive user input regarding whether a change to a gesture is set for the entire system of the electronic device (100), for a specific category application installed on the electronic device (100), or for a specific application installed on the electronic device (100). For example, the electronic device (100) may receive user input selecting any one of the system setting item (911), the category setting item (912), and the individual app setting item (913) shown on the first gesture change screen (900) of FIG. 9.

[0115] Additionally, the electronic device (100) according to one embodiment may receive a user input regarding a change application time of a gesture. In the present disclosure, the change application time of a gesture may indicate the time for which a change to a gesture will persist. The electronic device (100) may receive a user input regarding whether the change to a gesture persists for a permanent or temporary period of time. For example, the electronic device (100) may receive a user input selecting either a permanent persistence item (921) or a temporary persistence item (922) shown in the first gesture modification screen (900) of FIG. 9.

[0116] Additionally, the electronic device (100) according to one embodiment may receive a user input regarding an account to which a change in a gesture is applied. In the present disclosure, the account to which a change in a gesture is applied may indicate a settings account to which a change in the gesture is to be applied. The electronic device (100) may receive a user input regarding whether the change in the gesture is to be applied to all user accounts or to individual user accounts. For example, the electronic device (100) may receive a user input selecting either the all user account item (931) or the individual user account item (932) shown in the first gesture modification screen (900) of FIG. 9.

[0117] According to one embodiment, the electronic device (100) may control the display to output one or more gestures corresponding to the change application range as the change application range is acquired. For example, the electronic device (100) may display a user interface indicating one or more gestures set in the same setting range as the change application range. For example, the electronic device (100) may control the display to display one or more gestures set for the entire system of the electronic device (100), a category application, or at least one of the applications. The user interface indicating one or more gestures set in the same setting range as the change application range selected by the user may be expressed as a 'second gesture modification screen'. The second gesture modification screen will be described in detail with reference to FIG. 10, which will be described later.

[0118] An electronic device (100) according to one embodiment may receive a user input regarding a target gesture to be changed. The target gesture may be a gesture that the user wishes to change. For example, the electronic device (100) may receive a user input selecting a desired gesture from among one or more gestures set within the same setting range as the change application range.

[0119] An electronic device (100) according to one embodiment can identify information about an action corresponding to a target gesture based on a user input selecting the target gesture. For example, the electronic device (100) can identify information about a gesture stored in a gesture database (340 of FIG. 3) and information about an action that can be activated by the gesture.

[0120] For example, in the second gesture modification screen (1000) of FIG. 10, the electronic device (100) may display a gesture list (1010) set throughout the system. The user may select the 'Fist' gesture (1030) to modify the 'Fist' gesture (1030) belonging to the gesture list (1010). The gesture list (1010) may include one or more gestures set throughout the system. The electronic device (100) may receive a user input for selecting the 'Fist' gesture (1030). Based on the user input, the electronic device (100) may identify the 'Mute' action, which is information about the 'Fist' gesture (1030) and information about an action corresponding thereto.

[0121] In step 530, the electronic device (100) may obtain information about a plurality of candidate gestures corresponding to gestures set by other users for activating the action, based on information about the gesture and information about the action corresponding to the gesture. The plurality of candidate gestures may include gestures set by other users for activating the action. The plurality of candidate gestures may represent history information about gestures set by other users for the action. Alternatively, one or more candidate gestures may include one or more gestures that other users have set with a high frequency for the action.

[0122] An electronic device (100) according to one embodiment may identify information about a target gesture to be changed and information about an action corresponding to the gesture, and obtain one or more candidate gestures for the action. For example, the electronic device (100) may store one or more candidate gestures set by another user for the action in a candidate gesture list (420 of FIG. 4). The electronic device (100) may identify one or more candidate gestures for the action stored in the candidate gesture list (420). For example, in FIG. 10, the electronic device (100) may obtain one or more candidate gestures for the 'mute' action based on the 'fist' gesture (1030) and the 'mute' action.

[0123] In step 540, the electronic device (100) may provide a recommended gesture corresponding to the action based on information about multiple candidate gestures and a change application range.

[0124] According to one embodiment, an electronic device (100) may prioritize candidate gestures having the same setting range as the change application range among a plurality of candidate gestures. The electronic device (100) may provide one or more candidate gestures as recommended gestures based on the priorities. For example, if the received change application range is the entire system of the electronic device (100), the electronic device (100) may provide a first candidate gesture set for the entire system among the plurality of candidate gestures as a recommended gesture for an action. For example, if the received change application range is a specific category application, the electronic device (100) may provide a second candidate gesture set for the specific category application among the plurality of candidate gestures as a recommended gesture for an action. For example, if the received change application range is a specific application, the electronic device (100) may provide a third candidate gesture set for the specific application among the plurality of candidate gestures as a recommended gesture for an action. This will be described in detail with reference to FIG. 6.

[0125] In addition, the electronic device (100) according to one embodiment may provide a recommended gesture for an action by further considering at least one of the change application time or the change application account for one or more candidate gestures. The electronic device (100) may give a first priority to a first candidate gesture having a setting range equal to the change application range of the gesture, and may give a second priority to a candidate gesture set in response to the change application time or the change application account. The electronic device (100) may provide one or more candidate gestures as recommended gestures based on the priorities. For example, if there are two or more candidate gestures having the same setting range as the received change application range, the electronic device (100) may give the next priority by considering the change application time or the change application account. For example, the electronic device (100) may give priority to a candidate gesture set to the same setting account as the change application account among the plurality of candidate gestures. For example, the electronic device (100) may give priority to a candidate gesture set to the same duration as the change application time among the plurality of candidate gestures. This is explained in detail in Fig. 7.

[0126] An electronic device (100) according to one embodiment may display a user interface indicating a recommended gesture. The electronic device (100) may receive a user input for selecting a gesture to be changed through the user interface indicating the recommended gesture. The user interface indicating the recommended gesture may be expressed as a "third gesture modification screen." The third gesture modification screen will be described in detail with reference to FIG. 11.

[0127] According to one embodiment, the electronic device (100) may change a target gesture to another gesture based on a user input selecting one of the recommended gestures. For example, the electronic device (100) may change a first gesture (an existing gesture or a target gesture) mapped to a specific action to a second gesture (a changed gesture). Upon recognizing the second gesture, the electronic device (100) may activate a specific action that was previously activated in response to the first gesture. Based on the user input regarding the change application range, the electronic device (100) may set the changed gesture (the second gesture) to be reflected only within the corresponding range. The electronic device (100) may set the existing gesture (the first gesture) to be maintained instead of the changed gesture (the second gesture) outside the corresponding range. The electronic device (100) may store the change application range as the set range of the second gesture.

[0128] For example, the electronic device (100) can change the first gesture set in the system to the second gesture in an OTT category application. The electronic device (100) can recognize the first gesture in environments other than the OTT category application. For example, the electronic device (100) can change the first gesture set in the game category to the second gesture in an OTT category application. The electronic device (100) may recognize the first gesture in the game category or may not recognize the first gesture in the game category. For example, the electronic device (100) can change the first gesture set in the game category to the second gesture throughout the system. The electronic device (100) may only recognize the second gesture throughout the system and may not recognize the first gesture.

[0129] According to one embodiment, the electronic device (100) may set the changed gesture (second gesture) to be reflected only in the corresponding setting account based on the user's input for the change application account. The electronic device (100) may set the existing gesture (first gesture) to be maintained instead of the changed gesture (second gesture) for other setting accounts. For example, the electronic device (100) may set the changed gesture to be reflected only in the first user account, and the existing gesture to be maintained for the remaining user accounts. The electronic device (100) may store the changed application account as the setting account for the second gesture. In addition, the electronic device (100) may also store the change application time as the duration of the second gesture.

[0130] FIG. 6 is an exemplary drawing for explaining an operation of an electronic device according to one embodiment of the present invention to provide a recommended gesture for a change target gesture.

[0131] In operation 610, the electronic device (100) can obtain information about a change target gesture, action information corresponding to the gesture, and a change application range of the gesture.

[0132] For example, the electronic device (100) may receive a user input regarding the scope of application of a change in a gesture through step 520 of FIG. 5. The electronic device (100) may receive a user input for selecting one of whether the change in the gesture is applied to the entire system, to applications of a specific category, or to a specific application. For example, the electronic device (100) may obtain the scope of application of the change in which the change in the gesture is to be reflected through the first gesture modification screen (900) of FIG. 9. For example, the electronic device (100) is exemplified as receiving a user input in which the modification in the gesture is set to Category_1 (a first category application).

[0133] For example, the electronic device (100) can obtain information about a target gesture for change and information about an action corresponding to the gesture through step 530 of FIG. 5. The electronic device (100) can receive a user input for selecting one of the gestures set within the same setting range as the change application range. For example, the electronic device (100) can obtain information about a target gesture for change through the second gesture modification screen (1000) of FIG. 10. For example, the electronic device (100) can obtain Gesture_9 (fist clenching gesture) as information about a target gesture for change. For example, the electronic device (100) can identify that Gesture_9 (fist clenching gesture) is mapped to Action_4 in 301 of the gesture DB (340).

[0134] In operation 620, the electronic device (100) may obtain one or more candidate gestures for the action based on information about the change target gesture and action information corresponding to the gesture.

[0135] For example, the electronic device (100) may obtain one or more candidate gestures for an action through step 530 of FIG. 5. For example, the electronic device (100) may identify Gesture_1, Gesture_3, and Gestrue_2 as candidate gestures for Action_4 in the candidate gesture list (420) at 402. Gesture_1, a first candidate gesture (422) of Action_4, is set system-wide and has a history set for all users. Gesture_3, a second candidate gesture (423) of Action_4, is set in Category_1 and has a history set for individual users. Gesture_2, a third candidate gesture (424) of Action_4, is set in Category_1 and has a history set for all users. For example, Category_1 may correspond to a game category application, but is not limited thereto.

[0136] In step 630, the electronic device (100) may prioritize candidate gestures set within a set range equal to the change application range of the gesture. The electronic device (100) may provide a recommended gesture for the action based on the priority. The electronic device (100) may provide a recommended gesture for the action based on the priority through step 540 of FIG. 5 .

[0137] For example, the electronic device (100) can identify the setting ranges of Gesture_1, Gesture_3, and Gestrue_2, and give priority to Gesture_2 and Gesture_3, which have the same setting range as the change application range for Gesture_9 (a fist-clenching gesture). For example, the change application range to which the change for Gesture_9 (a fist-clenching gesture) will be reflected is Category_1, and the setting ranges of Gesture_1 and Gesture_2 can be Category_1, which means that the setting ranges are the same.

[0138] For example, the electronic device (100) can use the candidate gestures of Action_4 to identify which gestures users frequently set for Action_4. In addition, the electronic device (100) can identify gestures that users frequently set for Action_4 within the same setting range and recommend appropriate gestures for Action_4. For example, the electronic device (100) can identify that in the game category, Gesture_2 or Gesture_3 is mainly set for Action_4. The electronic device (100) can give priority to Gesture_2 or Gesture_3, which are candidate gestures set for Action_4 in the game category. The electronic device (100) can give priority to Gesture_1, which is a candidate gesture with a different setting range, or can give no priority to it.

[0139] For example, the electronic device (100) may provide candidate gestures set within the same setting range as the received change application range as recommended gestures for the action. For example, the electronic device (100) may first provide Gesture_2 and Gesture_3, which users have set for Action_4 in the game category, as recommended gestures for Action_4. For example, the electronic device (100) may provide only Gesture_2 and Gesture_3 as recommended gestures, or may provide Gesture_2 and Gesture_3 followed by Gesture_1 as recommended gestures in that order.

[0140] FIG. 7 is an exemplary diagram illustrating an operation of an electronic device according to one embodiment of the present invention to provide a recommended gesture for a change target gesture. The electronic device (100) according to one embodiment of the present invention may further obtain a change application time and a change application account in addition to the change application range for the change target gesture. In FIG. 7, any overlapping content from FIG. 6 will be omitted for brevity.

[0141] In operation 710, the electronic device (100) may obtain information regarding a change target gesture, action information corresponding to the gesture, and change application information. The change application information may include a change application range, a change application time, and a change application account.

[0142] For example, the electronic device (100) exemplifies that the change application scope is Category_1 (first category application), the change application account is All users, and the change application time has received a user input that is permanent. For example, the electronic device (100) can obtain Gesture_9 (fist clenching gesture) as information about the change target gesture. The electronic device (100) can identify that Gesture_9 (fist clenching gesture) is mapped to Action_4 in 301 of the gesture DB (340).

[0143] In operation 720, the electronic device (100) may obtain one or more candidate gestures for an action based on information about a target gesture to be changed and action information corresponding to the gesture. Gesture_1, Gesture_3, and Gestrue_2 may be identified as candidate gestures for Action_4 in 402 of the candidate gesture list (420).

[0144] In operation 730, the electronic device (100) may assign a first priority to a candidate gesture set corresponding to a change application range of the gesture, and may assign a second priority to a candidate gesture set corresponding to either a change application account or a change application time. The electronic device (100) may provide a recommended gesture for the action based on the priority.

[0145] For example, the electronic device (100) can identify the setting ranges of Gesture_1, Gesture_3, and Gestrue_2, and give first priority to Gesture_2 and Gesture_3, which have the same setting range as the change application range for Gesture_9 (fist clenching gesture). For example, the change application range of Gesture_9 (fist clenching gesture) is Category_1, and the setting ranges of Gesture_1 and Gesture_2 are Category_1, so the setting ranges can be the same.

[0146] For example, the electronic device (100) may assign the next priority based on the change application account or change application time. For example, the electronic device (100) may assign the next priority to Gesture_3, which has the same setting account as the change application account for Gesture_9 (a fist-clenching gesture). For example, the change application account for Gesture_9 (a fist-clenching gesture) may be the entire user, and the setting scope of Gesture_3 may be the entire user, and the setting account may be the same.

[0147] For example, the electronic device (100) may also give the same priority to a candidate gesture that has the same duration as the change application time for Gesture_9 (a clenched fist gesture).

[0148] Alternatively, the electronic device (100) according to one embodiment may give a second priority to a candidate gesture set within the same setting range as the change application account of the gesture, and give a third priority to a candidate gesture set with the same duration as the change application time of the gesture. Alternatively, the electronic device (100) according to one embodiment may give a second priority to a candidate gesture set with the same duration as the change application time of the gesture, and give a third priority to a candidate gesture set with the same setting account as the change application account of the gesture.

[0149] For example, the electronic device (100) may provide Gesture_3, which has a history set by users for Action_4 in the game category and overall user account, as a recommended gesture for Action_4. The electronic device (100) may provide Gesture_3, Gesture_2, and Gesture_1 as recommended gestures in that order. Alternatively, the electronic device (100) may provide only Gesture_3 as a recommended gesture.

[0150] FIG. 8 illustrates an example of a user interface representing a gesture setting screen according to one embodiment.

[0151] FIG. 8 illustrates an example of a gesture setting screen (800) that an electronic device (100) can display when the electronic device (100) receives a user input for selecting a setting item (15). The gesture setting screen (800) may include a gesture recognition item (810) indicating whether a gesture recognition mode is running, a gesture addition item (820) that allows adding a gesture, a gesture modification item (830) that allows modifying a gesture, a gesture deletion item (840) that allows deleting a gesture, etc. For example, the electronic device (100) may differently output a gesture recognition item (810) that is displayed when the gesture recognition mode is running and a gesture recognition item (810) that is displayed when the gesture recognition mode is not running.

[0152] The electronic device (100) can display a gesture modification screen based on a user's input for selecting a gesture modification item (830).

[0153] FIG. 9 illustrates an example of an interface for a user to inquire about change application information for a change target gesture according to one embodiment.

[0154] Referring to FIG. 9, the first gesture modification screen (900) represents an example of a user interface that the electronic device (100) may display when receiving a user input for selecting, for example, a gesture modification item (830) illustrated in FIG. 8. The first gesture modification screen (900) may inquire about change application information for a target gesture. For example, the change application information for a target gesture may include a change application range (910) of the gesture, a change application time (920) of the gesture, and a change application account (930) of the gesture.

[0155] The scope of application of the change in the gesture (910) indicates the scope to which the change in the gesture will be reflected. The scope of application of the change in the gesture (910) may include a system application item (911), a category application item (912), and an individual app application item (913). The system application item (911) indicates an item that allows the change in the gesture to be applied to the entire system. The category application item (912) indicates an item that allows the change in the gesture to be applied to an individual category application. A submenu (not shown) of the category application item (912) may include a game category, an OTT category, a music category, etc. The individual app application item (913) indicates an item that allows the change in the gesture to be applied to an individual application. A submenu (not shown) of the individual app application item (913) may include a game app, an OTT app, a music app, etc.

[0156] The gesture change application time (920) indicates the duration for which the gesture change will persist. The gesture change application time (920) may include a permanent persistence item (921) and a temporary persistence item (922). The permanent persistence item (921) indicates an item that allows the gesture modification to persist permanently. The temporary persistence item (922) indicates an item that allows the gesture modification to persist temporarily. A submenu (not shown) of the temporary persistence item (922) may include an item that inquires about a specific duration.

[0157] The gesture change application account (930) represents a user account to which a gesture change will be reflected. The gesture change application account (930) may include a full user account item (931) and an individual user account item (932). The full user account item (931) represents an item that allows a gesture change to be applied to all user accounts. The individual user account item (932) represents an item that allows a gesture change to be applied to an individual user account. The individual user account item (932) may include one or more user accounts currently registered in the electronic device (100), such as User 1 and User 2. For example, the user account currently connected to the electronic device (100) may be indicated by the current user account item (950). For example, the current user account item (950) may indicate that the user account currently connected to the electronic device (100) is 'User 1'.

[0158] FIG. 10 illustrates an example of an interface for a user to inquire about a change target gesture according to one embodiment.

[0159] Referring to FIG. 10, the second gesture modification screen (1000) represents an example of a user interface that an electronic device (100) may display when receiving a user input for selecting a first app from a submenu (not shown) of an individual app application item (913) illustrated in FIG. 9, for example.

[0160] The second gesture modification screen (1000) displays one or more gestures set in the electronic device (100). The electronic device (100) may display a list of gestures (1010) set in the entire system of the electronic device (100) and a list of gestures (1020) set in the first app on the second gesture modification screen (1000). However, the electronic device (100) may not be limited thereto and may only display a list of gestures (1020) set in the first app on the second gesture modification screen (1000).

[0161] The electronic device (100) may display a 'Volume Up' action and a 'Thumb Up' gesture related thereto, a 'Mute' action and a 'Fist' gesture related thereto (1030), a 'Start Gesture Recognition Mode' action and a 'Palm Open' gesture related thereto, or a 'Channel Up' action and a 'On-finger Up' gesture related thereto in a system-wide gesture list (1010).

[0162] The electronic device (100) may display a 'subtitle setting' action and a 'Fist' gesture related thereto, or a 'channel subscription' action and a 'Victory' gesture related thereto in the gesture list (1020) set in the first app.

[0163] The electronic device (100) can display a user interface (UI) such as “Please select a gesture to modify” on the second gesture modification screen (1000).

[0164] Meanwhile, although not illustrated, the electronic device (100) may display a list of gestures (1010) set for the entire system based on a user's input selecting a system setting item (911). In addition, the electronic device (100) may display a list of gestures (1010) set for the entire system and a list of gestures set for the first category application based on a user's input selecting a first category application from a submenu (not illustrated) of a category setting item (912).

[0165] FIG. 11 illustrates an example of a user interface that provides a recommended gesture for a change target gesture according to one embodiment.

[0166] Referring to FIG. 11, the third gesture modification screen (1100) illustrates an example of a user interface that an electronic device (100) may display when receiving a user input selecting to modify, for example, the 'Fist' gesture (1030) illustrated in FIG. 10.

[0167] One or more recommended gestures (1110) appear on the third gesture modification screen (1100). The electronic device (100) may display one or more recommended gestures (1110) whose shape has been changed from the 'Fist' gesture (1030) on the third gesture modification screen (1100). The electronic device (100) may display one or more recommended gestures (1110) based on a user's input for changing the shape of the 'Fist' gesture (1030). In addition, the electronic device (100) may display one or more recommended gestures (1110) based on a user's input requesting a recommended gesture for the shape of the 'Fist' gesture (1030).

[0168] FIG. 12 is a flowchart illustrating an operation method for an electronic device according to one embodiment to change the shape of a gesture, change the properties of a gesture, or change an action.

[0169] Referring to FIG. 12, in operation 1210, the electronic device (100) may receive a user input for entering a gesture modification menu. Operation 1210 may correspond to operation 510 of FIG. 5.

[0170] In operation 1220, the electronic device (100) may receive user input regarding the change application range, change application account, and change application time of the change target gesture. The electronic device (100) may display a user interface, such as the first gesture modification screen (900 of FIG. 9), that inquires the user about change application information. For example, the change application information may include the change application range, change application account, and change application time. The electronic device (100) may receive user input regarding the change application range, change application account, and change application time through the user interface.

[0171] According to one embodiment, the electronic device (100) may control the display to output a list of gestures corresponding to the change application range as the change application range is acquired. The electronic device (100) may display a user interface, for example, a second gesture modification screen (1000 of FIG. 10), indicating one or more gestures set within the same set range as the change application range. For example, the electronic device (100) may control the display to display one or more gestures set for the entire system of the electronic device (100), a category application, or at least one of the applications.

[0172] An electronic device (100) according to one embodiment may receive a user input for selecting a change target gesture from among one or more gestures set within a setting range identical to the change application range.

[0173] In operation 1230, the electronic device (100) may control the display to output a UI corresponding to a selection of at least one of a shape change, a property change, and an action change corresponding to a specific gesture of the target gesture. The electronic device (100) may receive a user input selecting at least one of a shape change, a property change, and an action change corresponding to a specific gesture of the target gesture.

[0174] A user interface corresponding to at least one of changing the shape of a gesture, changing its properties, and changing an action corresponding to a specific gesture may be expressed as a 'fourth gesture modification screen'. The fourth gesture modification screen will be described in detail with reference to FIG. 13.

[0175] An electronic device (100) according to one embodiment may perform operation 1410 of FIG. 14 based on a user's input for changing the shape of a gesture.

[0176] An electronic device (100) according to one embodiment may perform operation 1810 of FIG. 18 based on a user input for changing a property of a gesture.

[0177] An electronic device (100) according to one embodiment may perform operation 1910 of FIG. 19 based on a user input for changing an action.

[0178] FIG. 13 illustrates an example of an interface for a user to inquire about the type of modification of a gesture by an electronic device according to one embodiment.

[0179] Referring to FIG. 13, the fourth gesture modification screen (1300) illustrates an example of a user interface that the electronic device (100) may display when receiving a user input selecting to modify, for example, the 'Fist' gesture (1030) illustrated in FIG. 10. The fourth gesture modification screen (1300) may inquire about the type of modification of the gesture. For example, the fourth gesture modification screen (1300) may include a gesture shape change item (1310) that allows changing the gesture shape, a gesture property change item (1320) that allows changing the gesture property, and an action change item (1330) that allows changing the action mapped to the gesture.

[0180] The gesture shape change item (1310) is an item for changing the shape of a gesture for an action. When the electronic device (100) receives a user input selecting the gesture shape change item (1310), it may display a third gesture modification screen (1110) including one or more recommended gestures (1110) for the action, as illustrated in FIG. 11.

[0181] The gesture property change item (1320) is an item for changing the properties of a gesture.

[0182] The action change item (1330) is an item for changing an action for a gesture. When the electronic device (100) receives a user input selecting the action change item (1330), it can display one or more recommended actions for the gesture.

[0183] FIG. 14 is a flowchart illustrating an operation method for an electronic device to change the shape of a gesture according to one embodiment.

[0184] Referring to FIG. 14, in operation 1410, the electronic device (100) may receive a user input for changing the shape of a first gesture. The first gesture may be a gesture to be changed. For example, the electronic device (100) may receive a user input for selecting a gesture shape change item (1310) displayed on the fourth gesture modification screen (1300) of FIG. 14.

[0185] At operation 1420, the electronic device (100) may receive a user input to change the first gesture to a new gesture. For example, the new gesture may include a gesture not previously defined in the electronic device (100). For example, the new gesture may be a concept opposite to a previously defined gesture. For example, the previously defined gesture may include a gesture previously defined by the user in the electronic device (100).

[0186] In one embodiment, the electronic device (100) may prompt the user to change the first gesture to a new gesture or to an existing gesture. For example, the electronic device (100) may control the display to display a graphical user interface that prompts the user to select at least one of changing the first gesture to a new gesture or changing it to a predefined gesture.

[0187] An electronic device (100) according to one embodiment may receive a user input for changing a first gesture into a new gesture. Based on the user input for changing the first gesture into a new gesture, the electronic device (100) may perform operation 1430.

[0188] An electronic device (100) according to one embodiment may receive a user input for changing a first gesture into a predefined gesture. Based on the user input for changing the first gesture into the predefined gesture, the electronic device (100) may perform operation 1425.

[0189] In operation 1425, the electronic device (100) may provide the predefined gesture as a recommended gesture for an action based on a user input for changing the first gesture to a predefined gesture. This will be described in detail with reference to FIG. 15.

[0190] FIG. 15 is a flowchart illustrating an operation method for recommending an existing gesture by an electronic device according to one embodiment.

[0191] Referring to FIG. 15, in operation 1510, the electronic device (100) may acquire one or more candidate gestures for an action corresponding to a first gesture. For example, the electronic device (100) may identify the first gesture and the action corresponding to the first gesture, and may identify one or more candidate gestures for the action stored in the candidate gesture list (420).

[0192] In operation 1520, the electronic device (100) may delete a candidate gesture that does not correspond to a predefined gesture among one or more candidate gestures. For example, the electronic device (100) may delete a new gesture that is not defined in the electronic device (100) among one or more candidate gestures. Alternatively, the electronic device (100) may exclude a new gesture that is not defined in the electronic device (100) among one or more candidate gestures from the recommended gestures.

[0193] In operation 1530, the electronic device (100) may prioritize candidate gestures set within the same setting range as the change application range of the first gesture. For example, the electronic device (100) may identify, among one or more candidate gestures, a candidate gesture having the same setting range as the change application range of the first gesture. The electronic device (100) may prioritize candidate gestures having the same setting range as the change application range of the first gesture. The change application range is described in detail in operation 520 of FIG. 5.

[0194] In operation 1540, the electronic device (100) may provide a predefined gesture as a recommended gesture based on a priority. The electronic device (100) may provide a candidate gesture that does not correspond to a new gesture among one or more candidate gestures as a recommended gesture. The electronic device (100) may provide a candidate gesture that has a setting range that is the same as the change application range of the first gesture among the candidate gestures that do not correspond to the new gesture as a recommended gesture. For example, the recommended gesture may be composed only of predefined gestures. For example, the recommended gesture may not include a new gesture.

[0195] Meanwhile, the electronic device (100) according to one embodiment may give priority by considering either the change application account of the first gesture or the change application time of the first gesture in addition to the change application range of the first gesture.

[0196] Referring again to FIG. 14, at operation 1430, the electronic device (100) may inquire whether the user desires a recommendation for a new gesture based on the user's input for changing the first gesture to a new gesture. The electronic device (100) may inquire whether the user desires a recommendation for a new gesture or whether the user desires to directly register a new gesture. For example, the electronic device (100) may control the display to output a graphical user interface for inquiring about a selection of at least one of a new gesture recommendation and a new gesture registration.

[0197] An electronic device (100) according to one embodiment may receive an input from a user who desires a recommendation for a new gesture. Based on the input from the user who desires a recommendation for a new gesture, the electronic device (100) may perform operation 1440.

[0198] An electronic device (100) according to one embodiment may receive a user input for directly registering a new gesture. Based on the user input for directly registering a new gesture, the electronic device (100) may perform operation 1435.

[0199] In operation 1435, the electronic device (100) may set a gesture acquired through the sensor (140) as a new gesture based on a user input for directly registering a new gesture. This will be described in detail with reference to FIGS. 16 and 17.

[0200] FIG. 16 is a flowchart illustrating an operation method for an electronic device to acquire a new gesture from a user according to one embodiment. FIG. 17 is an exemplary diagram illustrating the results of an electronic device determining the similarity of gestures according to one embodiment.

[0201] Referring to FIG. 16, in operation 1610, the electronic device (100) may acquire a user's gesture through a sensor (140). For example, the electronic device (100) may extract characteristic information of the user's gesture acquired through the sensor (140). For example, the characteristic information of the user's gesture may be represented as embedded data.

[0202] In operation 1620, the electronic device (100) can determine the similarity between the user's gesture and a predefined gesture. The electronic device (100) can determine the similarity based on the acquired characteristic information of the user's gesture and the characteristic information of the predefined gesture.

[0203] For example, similarity can be calculated using cosine similarity of mathematical formula 1. However, the method for calculating similarity is not limited to mathematical formula 1.

[0204]

[0205] In mathematical expression 1, A may be embedding data representing feature information about a user's gesture, and B may be embedding data representing feature information about a predefined gesture.

[0206] The electronic device (100) may perform operation 1625 when the similarity between the user's gesture and the predefined gesture is greater than or equal to a threshold value. The electronic device (100) may perform operation 1630 when the similarity between the user's gesture and the predefined gesture is less than or equal to a threshold value.

[0207] In operation 1625, the electronic device (100) may control the display to output a user interface corresponding to another gesture input request based on whether the similarity between the user's gesture and the predefined gesture is greater than or equal to a threshold value. For example, referring to FIG. 17, the electronic device (100) may identify the similarity between the first user's gesture (1710) and each of the predefined gestures, and may identify that the maximum similarity (Max Similarity) is greater than or equal to the threshold value. In addition, the electronic device (100) may identify the similarity between the second user's gesture (1720) and each of the predefined gestures, and may identify that the maximum similarity is greater than or equal to the threshold value. For example, the threshold value is exemplified as 0.8, but is not limited thereto. The electronic device (100) may request the user to input another gesture instead of the first user's gesture (1710). In addition, the electronic device (100) may request the user to input another gesture instead of the second user's gesture (1720).

[0208] According to one embodiment, the electronic device (100) may request re-input when there is a high degree of similarity between the user's gesture and the pre-defined gesture, as there is a possibility that the gesture may be confused with or misrecognized as the pre-defined gesture.

[0209] In operation 1630, the electronic device (100) may apply the acquired user gesture as a gesture for an action based on whether the similarity between the user's gesture and the predefined gesture is below a threshold value. For example, referring to FIG. 17, the electronic device (100) may identify the similarity between the third user's gesture (1730) and each of the predefined gestures, and may identify that the maximum similarity is below the threshold value. The electronic device (100) may set the third user's gesture (1730) as a new gesture.

[0210] In one embodiment, the electronic device (100) may consider at least one of the change application range, change application time, or change application account for a gesture when determining similarity. For example, the electronic device (100) may identify a higher similarity if the change application range for a first gesture received from a user is identical to the setting range of a predefined gesture. For example, the electronic device (100) may identify a higher similarity if the change application time for a first gesture received from a user is identical to or similar to the duration of a predefined gesture. For example, the electronic device (100) may identify a higher similarity if the change application account for a first gesture received from a user is identical to the setting account of a predefined gesture.

[0211] At operation 1440, the electronic device (100) may provide a recommended gesture for an action based on a user input requesting a recommendation for a new gesture. The electronic device (100) may provide a recommended gesture for the action based on one or more candidate gestures and a change application range for the action corresponding to the first gesture. Operation 1440 may correspond to operation 540 of FIG. 5 .

[0212] In operation 1450, the electronic device (100) can update the changed second gesture in the gesture DB (340). The second gesture may be a changed gesture. The electronic device (100) can change the first gesture set for the action to the second gesture. The electronic device (100) can store information about the second gesture changed from the first gesture in the gesture DB (340). For example, the electronic device (100) can store the change application range input by the user for the second gesture as the setting range of the second gesture. The electronic device (100) can store the change application account input by the user for the second gesture as the setting account of the second gesture. The electronic device (100) can store the change application time input by the user for the second gesture as the duration of the second gesture.

[0213] An electronic device (100) according to one embodiment can perform an operation corresponding to a second gesture based on a set range of the second gesture.

[0214] According to one embodiment, the electronic device (100) may perform an operation corresponding to the second gesture based on the set account of the second gesture. For example, the electronic device (100) may set the second gesture to be reflected only to an individual user account, for example, User 1. In this case, the electronic device (100) may set the second gesture to be reflected only to User 1. The electronic device (100) may maintain the first gesture, not the second gesture, for the remaining user accounts other than User 1. Alternatively, for example, the electronic device (100) may set the second gesture to be reflected to all user accounts.

[0215] According to one embodiment, the electronic device (100) may perform an action corresponding to the second gesture based on the duration of the second gesture. For example, the electronic device (100) may be configured to permanently change from the first gesture to the second gesture. Alternatively, for example, the electronic device (100) may be configured to temporarily change from the first gesture to the second gesture. In this case, the electronic device (100) may change from the second gesture back to the first gesture after a certain period of time (a period of time arbitrarily set by the user) has elapsed.

[0216] FIG. 18A is a flowchart illustrating an operation method for an electronic device to change the properties of a gesture according to one embodiment. FIG. 18B is an exemplary diagram illustrating the properties of a gesture stored in an electronic device according to one embodiment.

[0217] Referring to FIG. 18A, in operation 1810, the electronic device (100) may receive a user input for changing the properties of a first gesture. The properties of the gesture may include at least one of a duration of recognition of the gesture, a movement direction, or a combination with a previous gesture. Operation 1810 may be an example of the operation described in operation 1230 of FIG. 12. For example, operation 1810 may be performed when a user input for selecting a gesture property change item (1320) in a fourth gesture modification screen (1300) of FIG. 13 is received.

[0218] In operation 1820, the electronic device (100) may change at least one of the duration of the gesture, the direction of movement, or the combination with the previous gesture.

[0219] Referring to FIG. 18b, in one embodiment, the electronic device (100) may store information regarding the properties of a gesture, such as the duration of recognition of the gesture (1830), the direction of movement (1840), or the combination with a previous gesture (1850). For example, the electronic device (100) may store information regarding the properties of the gesture in the gesture DB (340).

[0220] For example, in the case of Gesture_1 (e.g., a palm-opening gesture), the duration of recognition (1830) is 0 seconds, there is no movement direction (1840), and there is no combination with the previous gesture (1850). When the electronic device (100) recognizes the palm-opening gesture, it can perform a corresponding action.

[0221] For example, in the case of Gesture_2 (e.g., a gesture of moving to the left with a palm open), the duration of recognition (1830) is 0.5 seconds, the direction of movement (1840) is rightward, and Gesture_2 can be performed using Gesture_1. The electronic device (100) can recognize Gesture_2 by maintaining the palm open for 0.5 seconds, and can perform a corresponding action when moving to the right.

[0222] For example, in the case of Gesture_4 (e.g., a thumb-up gesture), if the electronic device (100) recognizes the thumb-up gesture, it can perform a corresponding action. In the case of Gesture_5 (e.g., a gesture of moving downwards while raising the thumb), the electronic device (100) can recognize Gesture_5 when the thumb is raised and maintained for 0.5 seconds, and can perform a corresponding action when the thumb is moved downwards.

[0223] In one embodiment, the electronic device (100) can change the duration of recognition of the first gesture (1830). For example, the electronic device (100) can change the duration of recognition of Gesture_2 (1830) from 0.5 seconds to 2 seconds. For example, the electronic device (100) can change the attribute of Gesture_2 to recognize Gesture_2 when the palm is held flat for 2 seconds.

[0224] In one embodiment, the electronic device (100) can change the movement direction (1840) of the first gesture. For example, the electronic device (100) can change the movement direction (1840) of Gesture_2 from the right direction to the left direction. For example, the electronic device (100) can hold the palm open for 2 seconds and perform a corresponding action when the palm moves to the left.

[0225] In one embodiment, the electronic device (100) can change the combination (1850) of the first gesture with the previous gesture. For example, the electronic device (100) can change the previous gesture of Gesture_2 to a gesture other than Gesture_1.

[0226] In operation 1830, the electronic device (100) may update information regarding the properties of the changed first gesture. For example, the electronic device (100) may store information regarding the properties of the changed first gesture in the gesture DB (340).

[0227] FIG. 19 is a flowchart illustrating an operation method for an electronic device to change an action according to one embodiment.

[0228] Referring to FIG. 19, in operation 1910, the electronic device (100) may receive a user input for changing an action corresponding to a first gesture. Operation 1910 may be an example of the operation described in operation 1230 of FIG. 12. For example, operation 1910 may be performed when a user input for selecting an action change item (1330) in the fourth gesture modification screen (1300) of FIG. 13 is received.

[0229] At operation 1920, the electronic device (100) may provide one or more candidate actions for the first gesture.

[0230] An electronic device (100) according to one embodiment may obtain one or more candidate actions for a first gesture based on information about the first gesture and information about an action corresponding to the gesture. For example, the electronic device (100) may store one or more candidate actions set by other users for a gesture in a candidate action list (410 of FIG. 4). The electronic device (100) may identify one or more candidate actions for a gesture stored in the candidate action list (410). The one or more candidate actions may represent history information set by other users for the gesture. Additionally, the one or more candidate actions may include one or more actions that other users have set with a high frequency for the gesture. The electronic device (100) according to one embodiment may provide one or more candidate actions as recommended actions.

[0231] According to one embodiment, the electronic device (100) may prioritize, among one or more candidate actions, a candidate action set within a set range corresponding to the change application range of the action. The electronic device (100) may also provide one or more candidate actions as recommended actions based on the priority.

[0232] In operation 1930, the electronic device (100) according to one embodiment may change the first action for the first gesture to a second action. The electronic device (100) may change the first action to the second action based on a user input selecting one of the recommended actions (or candidate actions). The electronic device (100) may update information regarding the changed second action. The electronic device (100) may store information regarding the changed second action in the gesture DB (340).

[0233] Figure 20 is a flowchart illustrating the operation of an electronic device and a server according to one embodiment.

[0234] Referring to FIG. 20, the external electronic device (2000) may be an electronic device of another user other than the electronic device (100). The external electronic device (2000) may be implemented as one or more electronic devices.

[0235] In operation 2011, the electronic device (100) may transmit information stored in the gesture DB (340) to the server (200). The gesture DB (340) may include information about gestures defined by a user of the electronic device (100) in the electronic device (100) and information about actions mapped to the gestures. The gesture DB (340) may include at least one of information about a setting range of the gesture, information about a setting account of the gesture, and information about a duration of the gesture.

[0236] In operation 2012, the external electronic device (2000) may transmit information stored in a gesture DB to the server (200). The gesture DB may include information about gestures defined by a user of the external electronic device (2000) in the external electronic device (2000), information about actions mapped to the gestures, and may further include at least one of information about a setting range of the gesture, information about a setting account of the gesture, and information about a duration of the gesture.

[0237] In operation 2020, the server (200) may generate a candidate action list (410) for each gesture with an action having a high mapping frequency for each gesture based on information stored in the gesture DB. The server (200) may update the candidate actions in order of high mapping frequency based on information about gestures and information about actions mapped to gestures stored in the gesture DB (340) of the electronic device (100) and the gesture DB of the external electronic device (2000). The server (200) may generate a candidate action list (410) including one or more candidate actions for each gesture.

[0238] In operation 2030, the server (200) may generate a candidate gesture list (420) for each action with a high mapping frequency for each action based on the information stored in the gesture DB. The server (200) may update the candidate gestures in order of high mapping frequency based on information about gestures stored in the gesture DB (340) of the electronic device (100) and the gesture DB of the external electronic device (2000) and information about actions mapped to gestures. The server (200) may generate a candidate gesture list (420) including one or more candidate gestures for each action. In addition, the candidate gesture list (420) may include at least one of information about a setting range of one or more candidate gestures, information about a setting account of one or more candidate gestures, or information about a duration of one or more candidate gestures.

[0239] In operation 2041, the server (200) may transmit a candidate action list (410) and / or a candidate gesture list (420) to the electronic device (100). The electronic device (100) may store one or more candidate actions having a high mapping frequency for each gesture included in the candidate action list (410) in the memory (120). The electronic device (100) may store one or more candidate gestures having a high mapping frequency for each action included in the candidate gesture list (420) in the memory (120). The electronic device (100) may include at least one of information regarding a setting range of one or more candidate gestures, information regarding a setting account of one or more candidate gestures, or information regarding a duration of one or more candidate gestures.

[0240] In operation 2042, the server (200) may transmit a candidate action list (410) and / or a candidate gesture list (420) to an external electronic device (2000). The external electronic device (2000) may store one or more candidate actions having a high mapping frequency for each gesture in a memory. The external electronic device (2000) may store one or more candidate gestures having a high mapping frequency for each action in a memory. The external electronic device (2000) may include at least one of information regarding a setting range of one or more candidate gestures, information regarding a setting account of one or more candidate gestures, or information regarding a duration of one or more candidate gestures.

[0241] FIG. 21 is a detailed block diagram of an electronic device according to one embodiment.

[0242] The electronic device (2100) of FIG. 21 may be an example of the electronic device (100) of FIG. 2.

[0243] Referring to FIG. 21, an electronic device (2100) may include a processor (2101) and a memory (2102). The processor (2101) and the memory (2102) included in the electronic device (2100) may correspond to the processor (110) and the memory (120) included in the electronic device (100) of FIG. 2. In addition, the communication unit (2120) included in the electronic device (2100) may correspond to the communication unit (130) included in the electronic device (100) of FIG. 2, and the sensor (2132) included in the electronic device (2100) may correspond to the sensor (140) included in the electronic device (100) of FIG. 2. In addition, the user input unit (2190) included in the electronic device (2100) may be included in the user interface (150) of the electronic device (100) of FIG. 2.

[0244] An electronic device (2100) according to one embodiment may further include, in addition to a processor (2101) and a memory (2102), a tuner unit (2110), a communication unit (2120), a detection unit (2130), an input / output unit (2140), a video processing unit (2150), a display (2160), an audio processing unit (2170), an audio output unit (2180), and a user input unit (2190).

[0245] The tuner unit (2110) can select and tune only the frequency of the channel to be received by the electronic device (2100) among many radio wave components through amplification, mixing, resonance, etc. of broadcast content received via wire or wireless. The content received through the tuner unit (2110) is decoded and separated into audio, video, and / or additional information. The separated audio, video, and / or additional information can be stored in the memory (2102) under the control of the processor (2101).

[0246] The communication unit (2120) can connect the electronic device (2100) to peripheral devices, external devices, a server (200), a display device (300), a remote control device (400), a mobile terminal, etc., under the control of the processor (2101). The communication unit (2120) can include at least one communication module capable of performing wireless communication. The communication unit (2120) can include at least one of a wireless LAN module (2121), a Bluetooth module (2122), and a wired Ethernet (2123) in accordance with the performance and structure of the electronic device (2100).

[0247] The Bluetooth module (2122) can receive a Bluetooth signal transmitted from a peripheral device according to the Bluetooth communication standard. The Bluetooth module (2122) can be a BLE (Bluetooth Low Energy) communication module and can receive a BLE signal. The Bluetooth module (2122) can constantly or temporarily scan the BLE signal to detect whether a BLE signal is received. The wireless LAN module (2121) can transmit and receive a Wi-Fi signal with a peripheral device according to the Wi-Fi communication standard.

[0248] In one embodiment, the communication module for communicating with the server (200), the communication module for communicating with the display device (300), the communication module for communicating with the remote control device (400), and the communication module for communicating with the mobile terminal may be different or may be the same.

[0249] The detection unit (2130) detects the user's voice, the user's image, or the user's interaction, and may include a microphone (2131), a sensor (2132), and a light receiving unit (2133).

[0250] The microphone (2131) can receive an audio signal including a user's uttered voice or noise, and can convert the received audio signal into an electrical signal and output it to the processor (2101).

[0251] The microphone (2131) may be provided in a remote control device (400), such as a remote control, a mobile terminal, or an AI speaker. For example, the mobile terminal may execute an application for remotely controlling the electronic device (2100). In this case, the microphone (2131) provided in the remote control device (400) may receive an audio signal including a user's spoken voice or noise, and the remote control device (400) may convert the audio signal into a control signal and transmit it to the electronic device (2100). The electronic device (2100) may receive a control signal from the remote control device (400) through the communication unit (2130).

[0252] The sensor (2132) detects the user's image, or the user's interaction, gesture, and touch, and may include a distance sensor, an image sensor, a gesture sensor, an illumination sensor, and the like. The distance sensor may include various sensors that detect the distance between the electronic device (2100) and the user, such as an ultrasonic sensor, an IR (Infrared Radiation) sensor, and a TOF (Time Of Flight) sensor. The distance sensor detects the distance from the user and can transmit the sensing data to the processor (2101). The image sensor can capture the user's gesture by taking a picture using a camera or the like and transmit it to the processor (2101). The gesture sensor can detect the movement speed or direction using an acceleration sensor or a gyro sensor. The illumination sensor can detect the ambient illumination.

[0253] The optical receiver (2133) can receive an optical signal (including a control signal). The optical receiver (2133) can receive an optical signal corresponding to a user input (e.g., touch, press, touch gesture, voice, or motion) from a control device such as a remote control or a mobile phone.

[0254] The input / output unit (2140) can receive video (e.g., dynamic image signal or still image signal), audio (e.g., voice signal or music signal), and additional information from an external device, etc., under the control of the processor (2101). The input / output unit (2140) can include a port for outputting video and audio together, and can also include a port for separate output of video and audio, respectively.

[0255] The input / output unit (2140) may include one of an HDMI port (High-Definition Multimedia Interface port, 2141), a component jack (component jack, 2142), a PC port (PC port, 2143), and a USB port (USB port, 2144). The input / output unit (2140) may include a combination of an HDMI port (2141), a component jack (2142), a PC port (2143), and a USB port (2144). In addition, the input / output unit (2140) may include one of a DP (Display Port), a Thunderbolt port, a VGA port, an RGB port, a D-SUB, and a DVI.

[0256] In one embodiment, when the electronic device (100) is a content providing device such as a set-top box, the input / output unit (2140) can output video, audio, and additional information to the display device (300) under the control of the processor (2101).

[0257] The video processing unit (2150) processes image data to be displayed by the display (2160) and can perform various image processing operations such as decoding, rendering, scaling, noise filtering, frame rate conversion, and resolution conversion on the image data.

[0258] The display (2160) can display content received from a broadcasting station, an external server, or an external device such as an external storage medium. The content is a media signal and may include a video signal, an image, a text signal, etc.

[0259] In one embodiment, the display (2160) may output a recommended gesture on the screen based on a user's input for changing the form of a gesture. The display (2160) may output a recommended action on the screen based on a user's input for changing an action. The display (2160) may output a graphical user interface for inquiring about the scope of change application for the gesture, the time of change application, and / or the account to which the change is applied. The processor (2101) may control the display (2160) to output a recommended gesture on the screen based on a user's input for changing the form of the gesture. The processor (2101) may control the display (2160) to output a recommended action on the screen based on a user's input for changing an action. The processor (2101) may control the display (2160) to output a graphical user interface for inquiring about the scope of change application for the gesture, the time of change application, and / or the account to which the change is applied.

[0260] In one embodiment, when the electronic device (2100) is connected to the display device (300), the processor (2101) may transmit information about a recommended gesture to the display device (300) based on a user input for changing the shape of the gesture.

[0261] The audio processing unit (2170) performs processing on audio data. The audio processing unit (2170) can perform various processing such as decoding, amplification, and noise filtering on audio data.

[0262] The audio output unit (2180) can output audio included in content received through the tuner unit (2110) under the control of the processor (2101), audio input through the communication unit (2120) or the input / output unit (2140), and audio stored in the memory (2102). The audio output unit (2180) can include at least one of a speaker (2181), a headphone (2182), or an S / PDIF (Sony / Philips Digital Interface: output terminal) (2183).

[0263] In one embodiment, the audio output unit (2180) may output information regarding a target action predicted for a user's gesture as audio. The processor (2101) may control the audio output unit (2180) to output information regarding a target action predicted for a user's gesture as audio.

[0264] The user input unit (2190) can receive user input for controlling the electronic device (2100). The user input unit (2190) can include various types of user input devices, including, but not limited to, a touch panel that detects a user's touch, a button that receives a user's push operation, a wheel that receives a user's rotation operation, a keyboard, a dome switch, a microphone for voice recognition, a motion detection sensor that senses motion, etc. When a remote control device (400) or other mobile terminal controls the electronic device (2100), the user input unit (2190) can receive a control signal received from the remote control device (400).

[0265] According to one embodiment, the memory (1802) may include a feature extraction module (1803), a gesture recognition module (1804), a gesture / action modification module (1805), and an update module (1806). The programs stored in the memory (1802) may be classified into a plurality of modules according to their functions. Specifically, each of the feature extraction module (1803), the gesture recognition module (1804), the gesture / action modification module (1805), and the update module (1806) included in the memory (1802) may include suitable software, logic, circuits, interfaces, and / or codes that may be operable to perform a predetermined function.

[0266] The feature extraction module (1803) can extract feature information representing the characteristics of a gesture based on the user's gesture acquired through the sensor (140). For example, the feature information can include embedding data. For example, the feature information can be different or similar for each gesture. For example, if the shapes between gestures are similar, the similarity between the feature information of the gestures can be high. If the shapes between gestures are dissimilar, the similarity between the feature information of the gestures can be low. For example, the embedding data can be represented through 1024 data, but is not limited thereto. The feature extraction module (1803) can extract feature information representing the characteristics of a gesture using a known algorithm or one or more neural networks using artificial intelligence. The feature extraction module (1803) can provide the feature information to the gesture recognition module (1804).

[0267] The gesture recognition module (1804) can obtain feature information about the user's gesture extracted through the feature extraction module (1803). The gesture recognition module (1804) can determine whether the user's gesture corresponds to a predefined gesture. For example, the gesture recognition module (1804) can determine whether the user's gesture corresponds to a predefined gesture by determining the similarity between the user's gesture and the predefined gesture. For example, the gesture recognition module (1804) can determine the similarity based on feature information about the user's gesture and feature information about the predefined gesture stored in the gesture DB (340). For example, the gesture recognition module (1804) can also determine whether a newly input user's gesture is similar to a predefined gesture based on a user's input for changing the form of the gesture to a new gesture.

[0268] The gesture / action modification module (1805) can change the form of a predefined gesture, change the properties of a predefined gesture, or change an action mapped to a predefined gesture based on user input.

[0269] When the form of a gesture changes, the update module (1806) can update the changed form of the gesture in the gesture DB (340). When the properties of a gesture change, the update module (1806) can update the properties of the changed gesture in the gesture DB (340). When an action changes, the update module (1806) can update the changed action in the gesture DB (340).

[0270] According to one embodiment, one or more processors receive information about a target gesture to be changed and a user input corresponding to a change application range of the gesture by executing one or more instructions. Based on the information about the gesture and the information about an action corresponding to the gesture, the one or more processors obtain information about a plurality of candidate gestures corresponding to a gesture set by another user for activating the action. Based on the information about the plurality of candidate gestures and the change application range, the one or more processors provide a recommended gesture corresponding to the action.

[0271] One or more processors according to one embodiment may provide the recommended gesture by prioritizing a candidate gesture having a setting range equal to the change application range among the plurality of candidate gestures by executing one or more instructions.

[0272] According to one embodiment, one or more processors may obtain at least one of a change application time for the gesture or a change application account for the gesture by executing one or more instructions. The one or more processors may provide the recommended gesture by assigning a second priority to a candidate gesture corresponding to the change application time or the change application account among the plurality of candidate gestures.

[0273] One or more processors according to one embodiment may receive user input that selects whether a change to the gesture applies to the entire system, to a specific category of applications, or to a specific application by executing one or more instructions.

[0274] According to one embodiment, one or more processors may, by executing one or more instructions, provide a first candidate gesture applied to the entire system among the plurality of candidate gestures as a recommended gesture for the action, when the change application range corresponds to the entire system. One or more processors may, when the change application range corresponds to a specific category application, provide a second candidate gesture applied to the specific category application among the plurality of candidate gestures as a recommended gesture for the action. One or more processors may, when the change application range corresponds to a specific application, provide a third candidate gesture set to the specific application among the plurality of candidate gestures as a recommended gesture for the action.

[0275] In one embodiment, one or more processors may control the display to output a list of gestures corresponding to the change application range when the change application range is acquired by executing one or more instructions. The one or more processors may control the display to output a UI corresponding to a selection of at least one of a shape change, an attribute change, and an action change corresponding to the specific gesture when a user input corresponding to a selection of a specific gesture from the output gesture list is received.

[0276] In one embodiment, one or more processors may control the display to output a UI corresponding to at least one selection of changing the gesture to a new gesture or changing it to a predefined gesture, upon receiving a user input corresponding to a change in the form of the gesture by executing one or more instructions. In another embodiment, one or more processors may provide a candidate gesture that does not correspond to the new gesture among the plurality of candidate gestures as a recommended gesture for the action, upon receiving a user input corresponding to a change to the predefined gesture.

[0277] According to one embodiment, one or more processors may acquire a user gesture through a sensor (140) by executing one or more instructions, when a user input corresponding to a gesture registration corresponding to the action is received for changing the shape of the gesture. The one or more processors may control the display to output a UI corresponding to another gesture input request when a similarity between the acquired user gesture and the predefined gesture is greater than or equal to a threshold value. The one or more processors may apply the acquired gesture as a gesture for the action when a similarity between the acquired user gesture and the predefined gesture is less than or equal to the threshold value.

[0278] According to one embodiment, one or more processors may control the communication unit (120) to transmit at least one of information about the gesture, information about an action mapped to the gesture, information about a setting range of the gesture, information about a setting account of the gesture, or information about a duration of the gesture to an external device by executing one or more instructions.

[0279] According to one embodiment, one or more processors may control the communication unit (120) to receive at least one of information about the plurality of candidate gestures mapped to the action by a plurality of other users from an external device, information about a setting range of the plurality of candidate gestures, information about a setting account of the plurality of candidate gestures, or information about a duration of the plurality of candidate gestures by executing one or more instructions.

[0280] A method of operating an electronic device (100) according to one embodiment includes a step (520) of receiving user input corresponding to information about a change target gesture and a change application range of the gesture, a step (530) of obtaining information about a plurality of candidate gestures corresponding to a gesture set by another user for activating the action based on the information about the gesture and the information about an action corresponding to the gesture, and a step (540) of providing a recommended gesture corresponding to the action based on the information about the plurality of candidate gestures and the change application range.

[0281] The step (540) of providing a recommended gesture corresponding to the action based on the information about the plurality of candidate gestures and the change application range may include a step of providing the recommended gesture by prioritizing a candidate gesture having the same setting range as the change application range among the plurality of candidate gestures.

[0282] The method of operating an electronic device (100) according to one embodiment may further include a step of acquiring at least one of a change application time for the gesture or a change application account for the gesture. The step (540) of providing a recommended gesture corresponding to the action based on information about the plurality of candidate gestures and the change application range may include a step of providing the recommended gesture by giving a second priority to a candidate gesture corresponding to the change application time or the change application account among the plurality of candidate gestures.

[0283] A method of operating an electronic device (100) according to one embodiment may further include a step of receiving a user input for selecting one of whether the change to the gesture is to be applied to the entire system, to a specific category of applications, or to a specific application.

[0284] The step (540) of providing a recommended gesture corresponding to the action based on the information about the plurality of candidate gestures and the change application range may include the step of providing a first candidate gesture applied to the entire system among the plurality of candidate gestures as a recommended gesture for the action when the change application range corresponds to the entire system, the step of providing a second candidate gesture applied to the specific category application among the plurality of candidate gestures as a recommended gesture for the action when the change application range corresponds to a specific category application, and the step of providing a third candidate gesture set to the specific application among the plurality of candidate gestures as a recommended gesture for the action when the change application range corresponds to a specific application.

[0285] An operating method of an electronic device (100) according to one embodiment may further include a step of controlling a display to output a gesture list corresponding to a change application range when the change application range is acquired, and a step of controlling the display to output a UI corresponding to selection of at least one of a shape change of the specific gesture, a property change, and an action change corresponding to the specific gesture when a user input corresponding to selection of a specific gesture from the output gesture list is received.

[0286] A method of operating an electronic device (100) according to one embodiment may further include a step of controlling a display to output a UI corresponding to selection of at least one of a change to a new gesture and a change to a predefined gesture when a user input corresponding to a change in the shape of the gesture is received, and a step of providing a candidate gesture that does not correspond to the new gesture among the plurality of candidate gestures as a recommended gesture for the action when a user input corresponding to a change to the predefined gesture is received.

[0287] A method of operating an electronic device (100) according to one embodiment may further include a step of acquiring a user gesture through a sensor (140) when a user input corresponding to a gesture registration corresponding to the action is received for changing the shape of the gesture, a step of controlling a display to output a UI corresponding to another gesture input request when a similarity between the acquired user gesture and the predefined gesture is greater than or equal to a threshold value, and a step of applying the acquired gesture as a gesture for the action when the similarity between the acquired user gesture and the predefined gesture is less than or equal to the threshold value.

[0288] The method of operating an electronic device (100) according to one embodiment may further include a step of controlling a communication unit (120) to transmit at least one of information about the gesture, information about an action mapped to the gesture, information about a setting range of the gesture, information about a setting account of the gesture, or information about a duration of the gesture to an external device.

[0289] The method of operating an electronic device (100) according to one embodiment may further include a step of controlling a communication unit (120) to receive at least one of information about a plurality of candidate gestures mapped to the action by a plurality of other users from an external device, information about a setting range of the plurality of candidate gestures, information about a setting account of the plurality of candidate gestures, or information about a duration of the plurality of candidate gestures.

[0290] A storage medium that can be read by a machine may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is stored semi-permanently in the storage medium and cases where data is stored temporarily. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0291] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

Claims

1. In an electronic device (100), A memory (120) storing one or more instructions; and comprising one or more processors (110) for executing one or more instructions stored in the memory (120); The one or more processors (110) execute the one or more instructions, Receive information about the gesture to be changed and user input corresponding to the scope of change of said gesture, Based on the information about the above gesture and the information about the action corresponding to the above gesture, information about a plurality of candidate gestures corresponding to the gesture set by another user for activating the action is obtained, An electronic device that provides a recommended gesture corresponding to the action based on information about the plurality of candidate gestures and the scope of application of the change.

2. In paragraph 1, The one or more processors (110) execute the one or more instructions, An electronic device (100) that provides the recommended gesture by prioritizing a candidate gesture having the same setting range as the change application range among the plurality of candidate gestures.

3. In paragraph 2, The one or more processors (110) execute the one or more instructions, Obtain at least one of the change application time for the above gesture or the change application account for the above gesture, An electronic device (100) that provides the recommended gesture by giving a second priority to a candidate gesture corresponding to the change application time or the change application account among the plurality of candidate gestures.

4. In any one of paragraphs 1 to 3, The one or more processors (110) execute the one or more instructions, An electronic device (100) that receives user input selecting whether a change to the above gesture applies to the entire system, to a specific category of applications, or to a specific application.

5. In any one of paragraphs 1 to 4, The one or more processors (110) execute the one or more instructions, As the scope of the above change application corresponds to the entire system, the first candidate gesture applied to the entire system among the plurality of candidate gestures is provided as a recommended gesture for the action. As the scope of the above change corresponds to a specific category application, the second candidate gesture applied to the specific category application among the plurality of candidate gestures is provided as a recommended gesture for the action. An electronic device (100) that provides a third candidate gesture set for the specific application among the plurality of candidate gestures as a recommended gesture for the action, as the scope of the above change corresponds to a specific application.

6. In any one of paragraphs 1 to 5, Including more displays, The one or more processors (110) execute the one or more instructions, As the above change application range is acquired, the display is controlled to output a list of gestures corresponding to the above change application range, An electronic device that controls the display to output a UI corresponding to selection of at least one of a shape change of the specific gesture, a property change, and an action change corresponding to the specific gesture, when a user input corresponding to selection of a specific gesture from the list of displayed gestures is received.

7. In any one of paragraphs 1 to 6, Including more displays, The one or more processors (110) execute the one or more instructions, When a user input corresponding to a change in the form of the gesture is received, the display is controlled to output a UI corresponding to at least one selection among a change to a new gesture and a change to a predefined gesture for the gesture. An electronic device (100) that, when a user input corresponding to a change in the above-described gesture is received, provides a candidate gesture that does not correspond to the new gesture among the plurality of candidate gestures as a recommended gesture for the action.

8. In any one of paragraphs 1 to 7, Including more displays, The one or more processors (110) execute the one or more instructions, When a user input corresponding to the gesture registration corresponding to the above action is received to change the form of the above gesture, the user gesture is acquired through the sensor, If the similarity between the acquired user gesture and the defined gesture exceeds a threshold value, the display is controlled to output a UI corresponding to another gesture input request, An electronic device (100) that applies the acquired gesture as a gesture for the action when the similarity between the acquired user gesture and the defined gesture is less than the threshold value.

9. In any one of paragraphs 1 to 8, Including further a communication department (120), The one or more processors (110) execute the one or more instructions, An electronic device (100) that controls the communication unit (120) to transmit at least one of information about the gesture, information about an action mapped to the gesture, information about a setting range of the gesture, information about a setting account of the gesture, or information about a duration of the gesture to an external device.

10. In any one of paragraphs 1 to 9, Including further a communication department (120), The one or more processors (110) execute the one or more instructions, An electronic device (100) that controls the communication unit (120) to receive at least one of information about a plurality of candidate gestures mapped to the action by a plurality of different users from an external device, information about a setting range of the plurality of candidate gestures, information about a setting account of the plurality of candidate gestures, or information about a duration of the plurality of candidate gestures.

11. In the operating method of an electronic device (100), Step (520) of receiving information about a gesture to be changed and a user input corresponding to the scope of application of the change of the gesture; Step (530) of obtaining information about a plurality of candidate gestures corresponding to gestures set by another user for activating the action, based on information about the gesture and information about an action corresponding to the gesture; and A method comprising a step (540) of providing a recommended gesture corresponding to the action based on information about the plurality of candidate gestures and the scope of application of the change.

12. In paragraph 11, Step (540) of providing a recommended gesture corresponding to the action based on the information about the plurality of candidate gestures and the scope of application of the change, A method comprising the step of providing the recommended gesture by prioritizing a candidate gesture having the same setting range as the change application range among the plurality of candidate gestures.

13. In paragraph 12, The above method, Further comprising a step of obtaining at least one of a change application time for said gesture or an account for applying a change for said gesture; The step (540) of providing a recommended gesture corresponding to the action based on the information about the plurality of candidate gestures and the scope of application of the change is as follows. An electronic device (100) comprising a step of providing the recommended gesture by giving a second priority to a candidate gesture corresponding to the change application time or the change application account among the plurality of candidate gestures.

14. In any one of paragraphs 11 to 13, The above method, A method further comprising the step of receiving user input selecting whether the change to said gesture applies to the entire system, to a specific category of applications, or to a specific application.

15. In any one of paragraphs 11 to 14, Step (540) of providing a recommended gesture corresponding to the action based on the information about the plurality of candidate gestures and the scope of application of the change, A step of providing a first candidate gesture applied to the entire system among the plurality of candidate gestures as a recommended gesture for the action, as the scope of the change application corresponds to the entire system; As the scope of the change application corresponds to a specific category application, a step of providing a second candidate gesture applied to the specific category application among the plurality of candidate gestures as a recommended gesture for the action; and A method comprising the step of providing a third candidate gesture set for the specific application among the plurality of candidate gestures as a recommended gesture for the action, as the scope of application of the change corresponds to a specific application.

Images