Electronic device, method, and computer-readable storage media for changing trajectory of gesture

Abstract

An electronic device according to one embodiment may include a touch sensor and a processor. The processor may identify a distance between a plurality of contact points and a center point of the plurality of contact points based on a touch input by a plurality of contact points contacted on the touch sensor. The processor may obtain probabilities that the touch input corresponds to a first designated gesture related to the distance and a second designated gesture related to the movement of the center point, respectively, based on the speed of the center point due to the movement of the contact points. The processor may change at least one of the distance or the center point based on the probabilities.

Description

Technology Field

[0001] Various embodiments include an electronic device, a method, and a computer-readable storage medium for changing the trajectory of a gesture. Background Technology

[0003] Recently, the distribution of various types of portable electronic devices, such as smartphones, tablet PCs, wireless earphones, and smartwatches, has been expanding. These portable electronic devices can receive one or more touch inputs using a touch sensor. The portable electronic device can identify a gesture using the received one or more touch inputs based on a specified time interval. The portable electronic device can identify various gestures based on the number, trajectory, and / or quantity of the received one or more touch inputs. means of solving the problem

[0006] An electronic device according to one embodiment may include a touch sensor and a processor. The processor may identify a distance between a plurality of contact points and a center point of the plurality of contact points based on a touch input by a plurality of contact points contacted on the touch sensor. The processor may obtain probabilities that the touch input corresponds to a first designated gesture related to the distance and a second designated gesture related to the movement of the center point, respectively, based on the speed of the center point due to the movement of the contact points. The processor may change at least one of the distance or the center point based on the probabilities.

[0007] A method of an electronic device according to one embodiment may include an operation of identifying a distance between a plurality of contact points and a center point of the plurality of contact points based on a touch input by a plurality of contact points contacted on a touch sensor. The method may include an operation of obtaining probabilities that the touch input corresponds to a first designated gesture related to the distance and a second designated gesture related to the movement of the center point, respectively, based on the speed of the center point due to the movement of the contact points. The method may include an operation of changing at least one of the distance or the center point based on the probabilities.

[0008] One or more programs of a computer-readable storage medium storing one or more programs according to one embodiment can identify the distance between a plurality of contact points and the center point of the plurality of contact points based on touch input by a plurality of contact points contacted on a touch sensor when executed by a processor of an electronic device. The one or more programs can obtain probabilities that the touch input corresponds to a first designated gesture related to the distance and a second designated gesture related to the movement of the center point, respectively, based on the speed of the center point due to the movement of the contact points. The one or more programs can change at least one of the distance or the center point based on the probabilities. Brief explanation of the drawing

[0010] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIGS. 2a and 2b are exemplary drawings showing a gesture corresponding to an input according to an embodiment. FIG. 3 is an exemplary block diagram of an electronic device according to one embodiment. FIG. 4 is an exemplary graph showing the probability of a gesture identified by an electronic device according to one embodiment. FIG. 5 is an exemplary drawing showing an electronic device according to one embodiment performing an operation for said gesture based on the degree of influence of said gesture. FIG. 6 is an exemplary drawing showing that an electronic device according to one embodiment corrects at least part of a gesture based on the degree of influence. FIG. 7 is an exemplary flowchart illustrating an operation in which an electronic device according to one embodiment corrects at least some of a plurality of gestures based on input. Specific details for implementing the invention

[0011] The various embodiments of this document and the terms used therein are not intended to limit the technology described in this document to specific embodiments and should be understood to include various modifications, equivalents, and / or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar components. A singular expression may include a plural expression unless the context clearly indicates otherwise. In this document, expressions such as "A or B," "at least one of A and / or B," "A, B or C," or "at least one of A, B and / or C" may include all possible combinations of items listed together. Expressions such as "first," "second," "first," or "second" may modify said components regardless of order or importance and are used only to distinguish one component from another and do not limit said components. Where it is stated that a certain (e.g., first) component is "(functionally or telecommunicationally) connected" or "connected" to another (e.g., second) component, said certain component may be directly connected to said other component or connected through another component (e.g., third component).

[0012] As used in this document, the term "module" includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be a component formed as a whole, or a minimum unit or part thereof that performs one or more functions. For example, a module may be composed of an application-specific integrated circuit (ASIC).

[0013] Hereinafter, various embodiments of this document will be described with reference to the attached drawings.

[0015] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0016] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0017] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0018] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0019] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0020] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0021] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0022] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0023] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0024] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0025] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multi-media interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0026] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0027] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0028] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0029] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0030] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0031] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0032] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0033] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0034] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0035] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0036] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0037] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0038] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0039] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0040] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0041] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0042] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0044] FIGS. 2a and 2b are exemplary drawings illustrating a gesture corresponding to an input according to an embodiment. Referring to FIGS. 2a and 2b, an electronic device (101) for identifying a gesture corresponding to an input by a plurality of contact points according to an embodiment is shown. The electronic device (101) may include the electronic device of FIG. 1. The display (240) may include the display module (160) of FIG. 1.

[0045] Referring to FIG. 2a, in state (200), an electronic device (101) according to one embodiment may receive touch inputs by a plurality of contact points on a display (240). For example, the electronic device (101) may identify a gesture (203) corresponding to the received touch inputs. The gesture (203) may be identified, for example, based on touch inputs following a designated trajectory. The trajectory may be referred to as a path. The trajectory identified by the electronic device (101) may be one or more. For example, the electronic device (101) may identify the designated trajectory by identifying the path of the touch inputs. For example, the designated trajectory may include touch inputs by a plurality of contact points. For example, the electronic device (101) may identify the type of gesture based on touch inputs following the designated trajectory. The types of the above gestures are described later in Fig. 3.

[0046] An electronic device (101) according to one embodiment can identify a touch input according to a specified trajectory (or pattern) based on a specified time interval (e.g., 8ms or 16ms). For example, the electronic device (101) can identify a touch input corresponding to contact points (210). For example, the electronic device (101) can perform an operation to identify a touch input based on the specified time interval in response to identifying a touch input by the contact points (210). For example, the touch input by the contact points (210) can be referenced to contact points indicating contact with an external object.

[0047] For example, the electronic device (101) can identify touch inputs corresponding to each of the contact points (210) based on a specified time interval. For example, at a first time point, the electronic device (101) can identify touch inputs corresponding to contact point (210-1) and / or contact point (210-2). At a second time point, the electronic device (101) can identify touch inputs corresponding to contact point (220-1) and / or contact point (220-2). At a third time point, the electronic device (101) can identify touch inputs corresponding to contact point (230-1) and / or contact point (230-2).

[0048] For example, an electronic device (101) can identify a touch input corresponding to a contact point (210-1), a touch input corresponding to a contact point (220-1), and / or a touch input corresponding to a contact point (230-1) as a first index, based on the distance between the contact point (210-1) and the contact point (220-1), and the specified time interval. Based on identifying each of the touch inputs as a first index, the electronic device (101) can identify a first specified trajectory using the touch inputs corresponding to the contact point (210-1), the contact point (220-1), and / or the contact point (230-1).

[0049] For example, the electronic device (101) can identify each of the touch inputs by the contact point (210-2), the contact point (220-2), and / or the contact point (230-2) as a second index. For example, the electronic device (101) can identify a second designated trajectory using the touch inputs by the contact point (210-2), the contact point (220-2), and / or the contact point (230-2).

[0050] An electronic device (101) according to one embodiment can identify a pivot point (205) and / or a distance (211) between contact points (210) based on an identified touch input. For example, the pivot point (205) may correspond to a location (a) between the contact points (210). For example, the pivot point (205) may be located at a half point between the contact points (210).

[0051] According to one embodiment, the electronic device (101) can identify a change in distance (211) based on identifying a touch input by contact points (210). For example, the electronic device (101) can identify a touch input corresponding to contact points (220) and / or contact points (230) based on a specified time interval.

[0052] For example, the electronic device (101) can identify the distance (221) between contact points (220) and / or the distance (222) between contact points (230). For example, while identifying the distance (221) and / or the distance (222), the electronic device (101) can identify center points corresponding to each of the distance (221) and the distance (222). For example, the center points may correspond to a center point (205). For example, the specified time interval may be 8ms and / or 16ms, but is not limited thereto.

[0053] An electronic device (101) according to one embodiment can identify a gesture (203) using each of the touch inputs by contact points (210, 220, 230). For example, the gesture (203) can be identified based on identifying a first designated trajectory including touch inputs by contact points (210-1, 220-1, 230-1), and / or a second designated trajectory including touch inputs by contact points (210-2, 220-2, 230-2). The gesture (203) can be referenced to a pinch-zoom gesture. The electronic device (101) can perform an event corresponding to the gesture (203) based on identifying the gesture (203). The above event may be an example of an event indicating the enlargement of a screen displayed by the electronic device (101) on the display (240). For example, the above event may be an example of an event indicating the enlargement of content (e.g., an image) displayed by the electronic device (101) on the display (240).

[0054] For example, the electronic device (101) can identify touch inputs based on a designated trajectory from contact points (230) toward contact points (210) with respect to a center point (205). The electronic device (101) can identify a designated gesture (e.g., a zoom-in gesture) based on the identified touch inputs (or, designated trajectory). Based on the identified designated gesture, the electronic device (101) can perform an event indicating the reduction of the screen displayed on the display (240) or the reduction of content (e.g., an image). However, it is not limited thereto.

[0055] An electronic device (101) according to one embodiment can identify the movement of a center point (205) while identifying touch inputs along a designated trajectory. For example, based on identifying the movement of the center point (205) to less than a designated distance, the electronic device (101) can identify a pinch-zoom gesture. For example, based on identifying the movement of the center point (205) to more than a designated distance, the electronic device (101) can identify a scroll gesture different from the pinch-zoom gesture. For example, the electronic device (101) can identify the user's intention based on the movement of the center point (205) and / or the amount of change in the distance between contact points. The electronic device (101) may use data representing a probability to identify the user's intention. The operation of the electronic device (101) identifying a gesture corresponding to a user intention using the data is described later in FIG. 4.

[0056] Referring to FIG. 2b, an electronic device (101) according to one embodiment can identify touch inputs by contact points (260) in a state (250). For example, in response to identifying touch inputs by contact points (260), the electronic device (101) can identify touch inputs by contact points (270, 280) different from the contact points (260) based on a specified time interval. For example, the electronic device (101) can identify a touch input by contact point (260-1) at a first time point. The electronic device (101) can identify a touch input by contact point (270-1) at a second time point. The electronic device (101) can identify a touch input by contact point (280-1) at a third time point. For example, the electronic device (101) can identify the movement of contact points (260, 270, 280) based on identifying the touch inputs.

[0057] For example, the electronic device (101) can identify touch inputs by each of the contact points (260-1, 270-1, 280-1) as a first index based on the specified time interval and / or the distance between the contact points (260-1, 270-1, 280-1). For example, the electronic device (101) can identify a first specified trajectory using the locations of the contact points (260-1, 270-1, 280-1) based on what was identified by the first index.

[0058] For example, the electronic device (101) can identify touch inputs by contact points (260-2, 270-2, 280-2), each by a second index. Based on what is identified by the second index, the electronic device (101) can identify a second designated trajectory using the locations of the contact points (260-2, 270-2, 280-2). For example, based on what is identified as a first designated trajectory and / or a second designated trajectory, the electronic device (101) can identify a gesture (253).

[0059] An electronic device (101) according to one embodiment can identify center points (255) and / or distances (261, 271, 281) corresponding to each of the contact points (260, 270, 280). While identifying the locations of the contact points (260, 270, 280), the electronic device (101) can identify the distances of each of the contact points (260, 270, 280). For example, the electronic device (101) can identify the distance (261), the distance (271), and / or the distance (281) respectively based on a specified time interval. For example, each of the distances (261, 271, 281) may be substantially similar.

[0060] For example, the electronic device (101) may identify center points (255) while identifying each of the contact points (260, 270, 280). For example, the center points (255) may be obtained based on each of the contact points (260, 270, 280). For example, a center point (255-1) may correspond to a position between the contact points (260). For example, a center point (255-2) may correspond to a position between the contact points (270). For example, a center point (255-3) may correspond to a position between the contact points (280). For example, each of the center points (255) may be placed at the center of the distance between the contact points (260, 270, 280). However, it is not limited thereto.

[0061] For example, the electronic device (101) can identify the movement of a center point (255) based on a designated trajectory. Based on the identified movement of the center point (255), the electronic device (101) can identify the speed at which the center point (255) is moved. Based on the identified speed, the electronic device (101) can infer a user intention. The operation of the electronic device (101) identifying the user intention is described later in FIG. 4.

[0062] An electronic device (101) according to one embodiment may identify a gesture (253) based on identifying a designated trajectory. For example, the designated trajectory may include a first designated trajectory based on touch inputs by contact points (260-1, 270-1, 280-1), and / or a second designated trajectory based on touch inputs by contact points (260-2, 270-2, 280-2). The gesture (253) may mean, for example, a two-hand scroll gesture. For example, the electronic device (101) may perform an action indicating scrolling of a screen displayed on a display (240) based on identifying a two-hand scroll gesture. However, it is not limited thereto.

[0063] Referring to FIGS. 2a and 2b, an electronic device (101) according to one embodiment can identify touch inputs during a specified time interval. The electronic device (101) can identify a specified trajectory using the touch inputs. The electronic device (101) can identify a specified gesture (e.g., gesture (203), or gesture (253)) based on the specified trajectory. For example, the specified gesture identified by the electronic device (101) based on the specified trajectory may be one or more. For example, the electronic device (101) can identify a contact point based on identifying touch inputs by one or more contact points (e.g., contact points (210) in FIG. 2a and / or contact points (260) in FIG. 2b) at a first time point. Based on the identification of the above contact point, the electronic device (101) can infer one or more designated gestures.

[0064] For example, the electronic device (101) may perform an action corresponding to a first gesture among one or more designated gestures. To perform an action corresponding to the first gesture, the electronic device (101) may use data representing probabilities associated with the one or more designated gestures. Using the data, the electronic device (101) may select the first gesture among the one or more designated gestures. For example, the electronic device (101) may identify the first gesture by using the movement of the center point (205, 255), the speed at which the center point (205, 255) moves, and / or the amount of change in the distance between the contact points. As the electronic device (101) selects the first gesture, it may change at least some of the center point and the distance obtained based on touch input along a designated trajectory. The action of the electronic device (101) changing the at least some is described later in FIG. 6.

[0065] As described above, the electronic device (101) can identify one or more touch inputs corresponding to a plurality of contact points using at least one sensor. For example, the electronic device (101) can identify the identified one or more touch inputs according to a designated trajectory. For example, based on identifying the one or more touch inputs, it can infer a user intention to input a designated gesture. For example, the electronic device (101) can use probability data to infer the user intention. The probability data may refer to data indicating the probability that the designated gesture matches the user intention. The electronic device (101) can change at least some of the center point and / or distance corresponding to each of the plurality of contact points using the probability data. Based on changing at least some of the at least some, the electronic device (101) can perform an action corresponding to the designated gesture to suit the user intention. Below, in FIG. 3, a simplified block diagram of the electronic device (101) is described.

[0067] FIG. 3 is an exemplary block diagram of an electronic device according to one embodiment. Referring to FIG. 3, the electronic device (101) may be an example of the electronic device (101) of FIG. 1 and / or the electronic device (101) of FIG. 2. Referring to FIG. 3, the electronic device (101) according to one embodiment may include at least one of a processor (120), a memory (130), a touch sensor (310), and / or a display (320). The processor (120), the memory (130), the touch sensor (310), and the display (320) may be electrically and / or operably coupled with each other by an electronic component such as a communication bus. The type and / or number of hardware components included in the electronic device (101) are not limited to those shown in FIG. 3. For example, the electronic device (101) may include only some of the hardware components shown in FIG. 3.

[0068] A processor (120) of an electronic device (101) according to one embodiment may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a field programmable gate array (FPGA), an application processor (AP), a communication processor (CP), a graphics processing unit (GPU), and / or a central processing unit (CPU). The number of processors (120) may be one or more. For example, the processor (120) may have the structure of a multi-core processor such as a dual core, a quad core, or a hexa core.

[0069] A memory (130) of an electronic device (101) according to one embodiment may include a hardware component for storing data and / or instructions that are input and / or output to a processor (120). The memory (130) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). Volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). Non-volatile memory may include, for example, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disk, and embedded multimedia card (eMMC).

[0070] In the memory (130) of an electronic device (101) according to one embodiment, one or more instructions representing an operation to be performed on data by a processor (120) may be stored. A set of instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. For example, the electronic device (101) and / or the processor (120) of the electronic device (101) may perform the operation of FIG. 7 by executing a set of a plurality of instructions distributed in the form of an application. Hereinafter, the statement that an application is installed on the electronic device (101) may mean that one or more instructions provided in the form of an application are stored in the memory (130) of the electronic device (101), and that said one or more applications are stored in an executable format (e.g., a file having an extension specified by the operating system of the electronic device (101)) by the processor (120) of the electronic device (101). An electronic device (101) according to one embodiment can provide a user with an action based on a designated gesture by using at least one of the one or more applications.

[0071] A display (320) according to one embodiment may be controlled by a controller such as a processor (120) to output visualized information to a user. The display (320) may include a flat panel display (FPD) and / or electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs may include organic LEDs (OLEDs).

[0072] According to one embodiment, the display (320) may include a touch sensor (310) (e.g., a touch sensor panel (TSP)) for detecting an external object (e.g., a user's finger) on the display (320). However, it is not limited thereto. For example, the touch sensor (310) may be included within the electronic device (101) independently of the display (320). For example, based on the touch sensor (310), the electronic device (101) may detect an external object that is in contact with or floating on the display (320). The processor (120) may identify at least one touch input based on the detected external object. For example, the processor (120) can identify at least one of information about the area where at least one touch input is performed, information about the speed at which at least one touch input is performed, and information about the direction in which at least one touch input is performed, based on at least one touch input identified using the touch sensor (310). For example, the processor (120) can identify at least one designated trajectory based on the at least one touch input using the touch sensor (310). The processor (120) can identify at least one gesture based on the identified at least one designated trajectory.

[0073] For example, the touch sensor (310) of the electronic device (101) may be composed of a plurality of layers. For example, the touch sensor (310) may include a drive electrode, a dielectric, and / or a sense electrode. For example, the touch sensor (310) may identify capacitance values ​​that change in a plurality of regions where the drive electrode and the sense electrode intersect (e.g., contact points (210) of FIG. 2A). For example, the touch sensor (310) may identify capacitance values ​​between the drive electrode and the sense electrode. The touch sensor (310) may identify capacitance values ​​between the drive electrode and the sense electrode that change based on touch input.

[0074] According to one embodiment, the touch sensor (310) can transmit data regarding the identified capacitance value to the processor (120). The processor (120) can receive the data from the touch sensor (310). Based on the data, the processor (120) can identify information regarding user input (or trajectory).

[0075] According to one embodiment, user input may consist of at least one touch input. For example, the processor (120) may identify at least one touch input by identifying the identified touch inputs from the time user input is started until the time user input is released. For example, the processor (120) may identify the touch inputs based on a specified time interval from the time user input is started until the time user input is released. The processor (120) may identify at least one gesture by identifying the identified touch inputs. For example, the processor (120) may identify at least one gesture (e.g., gesture (203) of FIG. 2a or gesture (253) of FIG. 2b) by identifying the user input according to a predefined period.

[0076] The gestures identified by the electronic device (101) according to one embodiment may be one or more. For example, the gestures may include at least one of a tap gesture, a drag gesture, a swipe gesture, a pinch-zoom gesture, and a scroll gesture. For example, the electronic device (101) may initiate the execution of the content based on identifying a tap gesture for the content within the screen displayed on the display (320). For example, the electronic device (101) may move the content within the screen based on identifying a drag gesture for the content included within the screen. For example, the electronic device (101) may reduce and / or enlarge the screen displayed on the display (320) based on identifying a pinch gesture. For example, the electronic device (101) can scroll the screen displayed in the display (320) based on identifying a scroll gesture.

[0077] An electronic device (101) according to one embodiment can identify touch inputs by a plurality of contact points based on a designated trajectory using a touch sensor (310). The electronic device (101) can identify a plurality of gestures in response to identifying the touch inputs. The electronic device (101) can identify that one of the plurality of gestures matches a user intention. To identify that the one gesture matches a user intention, the electronic device (101) can use data related to the one gesture. The data may include a probability for a gesture corresponding to the designated trajectory. Based on identifying a one gesture that matches the user intention using the data, the electronic device (101) can perform an action suitable for the user intention.

[0078] An electronic device (101) according to one embodiment as described above can identify a plurality of external objects that come into contact on a display (320) using a touch sensor (310). The electronic device (101) can infer the motion of the plurality of external objects based on identifying the plurality of external objects. For example, the electronic device (101) can identify that the plurality of external objects are moving in different directions relative to a certain point. For example, the electronic device (101) can identify that the plurality of external objects are moving in the same direction. For example, the electronic device (101) can identify a gesture based on the direction in which the plurality of external objects are moving.

[0079] For example, the electronic device (101) may change a portion of the trajectory corresponding to the identified gesture in order to perform an action based on the identified gesture. For example, the distance between the contact points in contact with the plurality of external objects may be changed. For example, a center point located at a point between the contact points may be changed. For example, the electronic device (101) may prevent the performance of an action not intended by the user by changing a portion of the trajectory. For example, the electronic device (101) may perform an action corresponding to the gesture visually and naturally by changing a portion of the trajectory. The electronic device (101) may use probability data to infer the motion of the plurality of external objects in order to perform an action that matches the user's intention. Below, in FIG. 4, the action of the electronic device (101) identifying a gesture using the probability data is described.

[0081] FIG. 4 is an exemplary graph showing the probability of a gesture identified by an electronic device according to one embodiment. Referring to FIG. 4, a graph (400) is shown showing the probability of an electronic device (101) according to one embodiment identifying a gesture corresponding to a touch input by a plurality of contact points. The graph (400) shows the movement speed of a center point (e.g., the center point (205) in FIG. 2a) (e.g., FIG. 4 Based on ), the probability that a gesture corresponding to the input by the plurality of contact points matches the user's intention (e.g., of FIG. 4) or It can represent ). For example, the probability may correspond to one value from 0 to 1. The electronic device (101) of FIG. 4 may be an example of the electronic device (101) of FIG. 1 and / or the electronic device (101) of FIG. 2a.

[0082] Referring to a graph (400) according to one embodiment, an electronic device (101) can identify the distance between a plurality of contact points (e.g., the distance (211) in FIG. 2a) and the center point of the plurality of contact points (e.g., the center point (205) in FIG. 2a) based on touch input by a plurality of contact points contacted on a touch sensor (e.g., the touch sensor (310) in FIG. 3). For example, the electronic device (101) can obtain a probability of corresponding to a plurality of gestures based on identifying touch input by a plurality of contact points.

[0083] For example, the electronic device (101) may obtain probabilities that the touch input corresponds to each of a first gesture related to the movement of the center point and / or a second gesture related to the distance, based on the speed of the center point due to the movement of the contact points. However, it is not limited thereto. As an example, the electronic device (101) may obtain the probabilities by identifying the distance between a plurality of contact points.

[0084] For example, the electronic device (101) can identify the speed of the center point by identifying the movement of the contact points based on a specified time interval. For example, the probability of responding to the first gesture can be represented by the first graph (410). For example, the probability of responding to the second gesture can be represented by the second graph (420). For example, the first gesture can be referenced to a two-hand scroll gesture (e.g., gesture (253) in FIG. 2b). For example, the second gesture can be referenced to a pinch-zoom gesture (e.g., gesture (203) in FIG. 2a).

[0085] For example, when the movement speed of the center point is 0, the electronic device (101) can identify the probability that touch inputs by the plurality of contact points correspond to a first gesture and the probability that they correspond to a second gesture, each with equal probability (e.g., 0.5). However, it is not limited thereto.

[0086] A first graph (410) according to one embodiment is a center point moving speed (e.g., of FIG. 4). This may be an example of a graph proportional to ). For example, referring to the first graph (410), as the movement speed of the center point increases, the probability that touch inputs by multiple contact points are identified as the first gesture may increase. For example, the electronic device (101) can infer touch inputs by multiple contact points as the first gesture with a higher probability based on identifying that the movement speed of the center point is increasing. For example, the first graph (410) can be indicated based on Equation 1 described below.

[0088]

[0090] Referring to mathematical formula 1, This can mean the probability of responding to the first gesture. ... may mean the movement speed of the center point. An electronic device (101) according to one embodiment may obtain a probability of matching to the first gesture based on identifying the movement speed of the center point using Equation 1. An electronic device (101) according to one embodiment may change at least some of the distances between the plurality of contact points (e.g., the distances (261, 271, 281) in FIG. 2b) while in a state where the touch input by the plurality of contact points is identified as being related to the first gesture. The operation of the electronic device (101) changing at least some of the distances is described later in FIG. 6.

[0091] A second graph (420) according to one embodiment may be an example of a graph that is inversely proportional to the movement speed of the center point. For example, referring to the second graph (420), as the movement speed of the center point increases, the probability of being identified as a second gesture may decrease. For example, the electronic device (101) may infer that a touch input by a plurality of contact points is a second gesture based on a probability lower than the probability of being identified as a first gesture, based on identifying that the movement speed of the center point increases. For example, the second graph (420) may be represented based on Equation 2 described below.

[0093]

[0095] Referring to mathematical formula 2, ...can mean the probability of responding to the second gesture. ... may mean the movement speed of the center point. An electronic device (101) according to one embodiment may obtain a probability that a touch input by a plurality of contact points matches a second gesture based on identifying the movement speed of the center point using Equation 2. An electronic device (101) according to one embodiment may change at least some of the center points corresponding to the plurality of contact points while in a state where it has identified that the touch input by the plurality of contact points is related to the second gesture. The operation of the electronic device (101) changing at least some of the center points is described later in FIG. 6.

[0096] An electronic device (101) according to one embodiment may perform an operation related to at least one of a first gesture or a second gesture based on changing at least one of a distance or a center point related to a plurality of contact points. For example, the electronic device (101) may obtain a parameter for performing the operation based on respective probabilities corresponding to the first gesture or the second gesture. The parameter may represent the degree to which at least one of the first gesture and / or the second gesture influences the operation. An operation in which the electronic device (101) obtains the parameter based on the obtained probabilities is described later in FIG. 5.

[0097] As described above, an electronic device (101) according to one embodiment can identify touch inputs by a plurality of contact points using a touch sensor. Based on identifying touch inputs by the plurality of contact points, a designated trajectory can be identified. The electronic device (101) can identify one or more gestures based on identifying the designated trajectory during a designated time. The electronic device (101) can identify a first gesture that matches the user's intention among the one or more gestures, and a second gesture that is different from the first gesture, using probability data included in a graph (400). Using parameters corresponding to the first gesture and the second gesture, the electronic device (101) can perform at least one event.

[0099] FIG. 5 is an exemplary diagram showing an electronic device according to one embodiment performing an operation for a gesture based on the influence of the gesture. The electronic device (101-1) and / or the electronic device (101-2) of FIG. 5 may be an example of the electronic device (101) of FIG. 1. For example, the size of the display (531) of the electronic device (101-2) may be different from the size of the display (521) of the electronic device (101-1). For example, the size of the display (531) may be larger than the size of the display (521).

[0100] Referring to FIG. 5, an electronic device (101) according to one embodiment can identify at least one gesture using a touch sensor. The at least one gesture (510) may be referenced to the gesture (203) of FIG. 2a. For example, the distance (514) between contact points (512-1, 512-2) may include a value different from the distance (513). For example, the distance (514) may include a value greater than the distance (513). For example, the distance (514) may include a value twice the distance (513).

[0101] An electronic device (101) according to one embodiment may perform an event corresponding to a gesture (510) identified by a touch sensor (e.g., touch sensor (310) in FIG. 3) depending on the size and / or touch sensing area of ​​a display (e.g., display (320) in FIG. 3). For example, the electronic device (101) may perform the event based on a parameter regarding the gesture (510). For example, the parameter may indicate the degree to which the identified gesture affects the event performed by the electronic device (101). For example, the parameter may include at least one value from 0 to 1. The electronic device (101) may obtain the parameter using Equation 2 described below.

[0103]

[0105] Referring to mathematical formula 3, This may mean the degree to which an event performed by an electronic device (101) is influenced based on a gesture identified by a touch sensor. ...may mean information about time. For example, the information about time may mean a time interval for the electronic device (101) to identify contact points included within at least one gesture. For example, the information about time may be a value obtained by dividing the time interval by a specified value (e.g., 8.3 ms). For example, It can correspond to at least one of 1 to 2 values. is of Fig. 4 It can be referenced in. can refer to information related to the size of the display. For example, The value may include at least one value from 0.5 to 1. For example, based on obtaining a parameter (e.g., 1) for a gesture (510), the electronic device (101) may expand (e.g., double) the screen on the display based on the parameter by identifying a distance (514) that is twice the distance (513). However, it is not limited thereto.

[0106] According to one embodiment, the electronic device (101-1) and the electronic device (101-2) can identify a gesture (510) based on the same time interval. A screen displayed on the display (521) of the electronic device (101-1) may contain substantially similar information to a screen displayed on the display (531) of the electronic device (101-2). For example, parameters for the gesture (510) (e.g., of Equation 3) ) may differ based on the size of each of the displays (521, 531).

[0107] For example, in state (520), the electronic device (101-1) can adjust the size of one area of ​​the screen displayed on the display (521) based on identifying the gesture (510). For example, the electronic device (101-1) can enlarge the size of the screen displayed within area (523) so that it is displayed within area (525). The size of the areas (523, 525) is determined by the distances (513, 514) and / or parameters (e.g., of Equation 3). It can be adjusted based on ).

[0108] For example, in state (530), the electronic device (101-2) can adjust the size of one area of ​​the screen displayed on the display (531) based on identifying the gesture (510). For example, the electronic device (101-2) can enlarge the size of the screen displayed within area (533) to display it within area (535). The size of the areas (533, 535) is determined by distances (513, 514) and / or parameters (e.g., of Equation 3). It can be adjusted based on ).

[0109] For example, the sizes of the regions (523, 533) based on the contact points (511) may be substantially similar. For example, the sizes of the regions (525, 535) based on the contact points (512) may differ based on parameters. However, the above-described embodiments are not limited thereto.

[0110] According to one embodiment, the electronic device (101) obtains the probability (e.g., of Equation 2) through the graph (400) of FIG. 4 using Equation 2. Based on ), the performance of an event corresponding to at least one gesture can be corrected at least partially. The operation of the electronic device (101) correcting at least partially the performance of an event based on Equation 3 is described later in FIG. 6.

[0111] As described above, the electronic device (101) can control the performance of an action for the gesture based on at least one parameter. For example, the parameter may be obtained based on a probability indicating the identification of a gesture based on touch input by a plurality of contact points, a specified time interval, and / or the size of the display of the electronic device (101). By controlling the performance of an action for the gesture based on obtaining the parameter, the electronic device (101) can provide a more convenient user interface (UI) to the user.

[0113] FIG. 6 is an exemplary drawing showing an electronic device according to one embodiment correcting at least a portion of a gesture based on the degree of influence. The electronic device (101) of FIG. 6 may be an example of the electronic device (101) of FIG. 1 and / or the electronic device (101) of FIG. 2a.

[0114] Referring to FIG. 6, an electronic device (101) according to one embodiment can obtain touch inputs by contact points (601, 602, 603) based on a specified time interval using a touch sensor (e.g., touch sensor (310) of FIG. 3). For example, the electronic device (101) can identify a first input for contact points (601-1, 601-2) at a first time point within the specified time interval. For example, the electronic device (101) can identify a second input by contact points (602-1, 602-2) at a second time point within the specified time interval. For example, the electronic device (101) can identify an nth input by contact points (603-1, 603-2) at an nth time point within the specified time interval.

[0115] For example, the electronic device (101) can obtain center points (610) and / or distances (661, 662, 663) corresponding to each of the contact points (601, 602, 603) based on identifying a first input, a second input, and / or an nth input. For example, the electronic device (101) can identify changes in the location of the center points (610-1, 610-2, 610-3) and / or distances (661, 662, 663) obtained based on a specified time interval. For example, the distances (662, 663) may be different from the distance (661).

[0116] For example, the electronic device (101) can identify one or more gestures (e.g., gesture (203) of FIG. 2a or gesture (253) of FIG. 2b) based on identifying the position of the center points and / or changes in the distance.

[0117] An electronic device (101) according to one embodiment can obtain a probability corresponding to one or more gestures by using probability data (e.g., probability data included in the graph (400) of FIG. 4). For example, the electronic device (101) can identify a gesture (640) based on the probability of a first gesture (e.g., gesture (253) of FIG. 2b) corresponding to the first graph (410) of FIG. 4, and / or the probability of a second gesture (e.g., gesture (203) of FIG. 2a) corresponding to the second graph (420) of FIG. 4. For example, the gesture (640) may be at least partially similar to the gesture (253) of FIG. 2b.

[0118] An electronic device (101) according to one embodiment can change a designated trajectory corresponding to a gesture (640) by using a parameter for the second gesture based on a relatively low probability. For example, the electronic device (101) can use Equation 4 described below to change the designated trajectory.

[0120]

[0121] Referring to mathematical formula 4, for example, can mean a corrected data value. can mean a data value identified by the electronic device (101). is of mathematical formula 3 It can be referenced in. ...can mean information about a time interval. silver, It may mean the previously corrected data value.

[0122] An electronic device (101) according to one embodiment may change a portion of the trajectory corresponding to the gesture (640) using Equation 4. For example, the electronic device (101) may change each of the distances between the contact points (601, 602, 603) to less than the distances (661, 662, 663). For example, the electronic device (101) may change the position of the contact points (602-1, 602-2) to be located at different points (620-1, 620-2), respectively. For example, the distance between the different points (620-1, 620-2) may correspond to a value less than the distance (662). For example, the distance between the different points (620-1, 620-2) may be similar to the distance (661).

[0123] For example, the electronic device (101) can compensate for the location of the contact points (603) to be located at different points (630-1, 630-2), respectively. For example, the distance between the different points (630-1, 630-2) may be less than the distance (663). For example, the distance between the different points (630-1, 630-2) may be similar to the distance (661).

[0124] An electronic device (101) according to one embodiment, although not illustrated, can correct a designated trajectory of a second gesture different from the first gesture based on parameters for a first gesture (e.g., gesture (253) of FIG. 2b) corresponding to the first graph when the probability for the second graph (420) of FIG. 4 is relatively higher than the probability for the first graph (410) of FIG. 4. For example, the electronic device (101) can identify the movement of a center point caused by the movement of contact points included in the second gesture. For example, the electronic device (101) can change the position of the center point to less than the distance the center point has moved based on the identified movement of the center point. However, it is not limited to the above-described embodiment.

[0125] An electronic device (101) according to one embodiment may store the corrected data value using Equation 4 in a resource file based on an operating system included in the electronic device (101). For example, the data value may be represented by Table 1 described below.

[0127] time interval Distance between contact points Probability (e.g., the second graph (420) of Fig. 4) Parameters (e.g., of mathematical formula 3) ) Distance between corrected contact points First point in time 744.4255 0.1 0.05 744.4255 Second point in time 578.6548942 0.11 0.055 735.3081167 ... ... ... ... ... time n-1 521.2452412 0.06 0.03 626.7698621 point n 614.2818352 0.07 0.035 626.3327812

[0128] Referring to Table 1, an electronic device (101) according to one embodiment may acquire contact points based on a specified time interval. For example, the electronic device (101) may identify the distance between the acquired contact points (e.g., distance (663)), probability, and / or parameter at the nth time point. The electronic device (101) may change the distance between the contact points using Equation 4. For example, the electronic device (101) may identify the distance between the contact points (e.g., 744.4255) at the first time point. For example, the electronic device (101) may acquire a distance (e.g., 735.3081167) corrected based on the distance between the identified contact points (e.g., 578.6548942), rate (e.g., 0.11), and / or parameter (e.g., 0.55) at the second time point. The above-mentioned corrected distance may be similar to the distance between contact points identified at the first time point, rather than the distance between the identified contact points. However, it is not limited to the data values ​​included in Table 1 described above.

[0129] An electronic device (101) according to one embodiment can perform an event corresponding to a gesture (640) by changing the trajectory of a gesture (640). For example, the electronic device (101) can perform an event related to at least one of a first gesture (e.g., gesture (253) of FIG. 2b) or a second gesture (e.g., gesture (203) of FIG. 2a) based on an application executed by a processor (e.g., processor (120) of FIG. 3) based on changing at least one of the distance between contact points or a center point. For example, the electronic device (101) can control a screen displayed through a display based on the performed event. For example, the event may be referenced to screen scrolling. For example, the electronic device (101) can perform screen scrolling more naturally by changing the trajectory of the gesture (640).

[0130] As described above, an electronic device (101) according to one embodiment can acquire contact points based on a specified time interval. The electronic device (101) can identify a plurality of gestures based on the locations of the acquired contact points. Among the plurality of gestures, the electronic device (101) can identify a first gesture based on a higher probability (e.g., gesture (253) of FIG. 2b) using probability data. The electronic device (101) can acquire an influence (or parameter) for a second gesture (e.g., gesture (203) of FIG. 2a) that is different from the first gesture among the plurality of gestures, based on Equation 3. For example, the electronic device (101) can change the locations of the contact points based on the acquired influence for the second gesture. The electronic device (101) can perform an event corresponding to the first gesture in accordance with the user's intention by changing the positions of the contact points.

[0132] FIG. 7 is an exemplary flowchart illustrating an operation in which an electronic device according to one embodiment corrects at least some of a plurality of gestures based on input. At least one of the operations of FIG. 7 may be performed by the electronic device (101) of FIG. 1 and / or the processor (120) of FIG. 1.

[0133] Referring to FIG. 7, in operation 700, a processor according to one embodiment can identify an input using a touch sensor. For example, the input may be one or more. For example, the processor can identify one or more inputs based on a specified time interval.

[0134] Referring to FIG. 7, in operation 710, a processor according to one embodiment may identify a plurality of gestures based on the identified input. For example, the plurality of gestures may include at least one of the gesture (203) of FIG. 2a and / or the gesture (253) of FIG. 2b. For example, the plurality of gestures may be identified based on the number and / or location of one or more contact points.

[0135] Referring to FIG. 7, in operation 720, a processor according to one embodiment can identify a probability corresponding to each of the identified plurality of gestures. For example, the processor can identify a probability corresponding to each of the plurality of gestures using probability data included in the graph (400) of FIG. 4. The probability may differ for each of the plurality of gestures.

[0136] Referring to FIG. 7, in operation 730, a processor according to one embodiment can obtain an influence degree corresponding to each of the plurality of gestures based on the identified probability. The influence degree is of Equation 3 of FIG. 5 This may mean that. For example, the processor may acquire an influence degree for a gesture based on a relatively low probability among the plurality of gestures. However, it is not limited thereto.

[0137] Referring to FIG. 7, in operation 740, a processor according to one embodiment can identify whether the probability corresponding to a first designated gesture among a plurality of gestures is greater than or equal to the probability corresponding to a second designated gesture. For example, the first designated gesture may be a gesture corresponding to the second graph (420) of FIG. 4. For example, the first designated gesture may be referenced to the gesture (203) of FIG. 2a. For example, the second designated gesture may be a gesture corresponding to the first graph (410) of FIG. 4. For example, the second designated gesture may be referenced to the gesture (253) of FIG. 2b. For example, the processor may perform operation 740 using probability data included in the graph (400) of FIG. 4.

[0138] Referring to FIG. 7, when the probability corresponding to the first designated gesture is greater than or equal to the probability corresponding to the second designated gesture (operation 740-e), in operation 750, a processor according to one embodiment may correct the first designated gesture based on the influence corresponding to the second designated gesture. For example, the processor may change the position of the center points between the contact points constituting the first designated gesture. For example, by changing the position of the center points, the processor may at least partially refrain from performing the action corresponding to the second designated gesture. For example, by at least partially refraining from performing the action corresponding to the second designated gesture, the processor may provide a more accurate action corresponding to the first designated gesture to a user who intended to perform the action corresponding to the first designated gesture.

[0139] Referring to FIG. 7, if the probability corresponding to the first designated gesture is less than the probability corresponding to the second designated gesture (operation 740-No), in operation 760, a processor according to one embodiment may correct the second designated gesture based on the influence corresponding to the first designated gesture. For example, the processor may change the trajectory of the second designated gesture to perform the correction. For example, the position of at least some of the plurality of contact points corresponding to the second designated gesture may be adjusted. By adjusting the position of at least some, the trajectory of the second designated gesture may partially indicate a straight line. By correcting the second designated gesture, the processor may execute an event corresponding to the second designated gesture. For example, by changing the trajectory of the second designated gesture, the processor may at least partially refrain from performing an action based on the first designated gesture.

[0140] An electronic device according to one embodiment can identify one or more gestures using a touch sensor. Among the identified one or more gestures, the electronic device can identify a gesture corresponding to a user's intention based on using a probability based on the movement of contact points.

[0142] An electronic device according to one embodiment can identify one or more gestures using a touch sensor. A method is required for the electronic device to identify a gesture that corresponds to a user's intention among the identified one or more gestures.

[0144] An electronic device (101) according to one embodiment as described above may include a touch sensor (310) and a processor (120). The processor may identify the distance between the plurality of contact points (211; 221; 222; 261; 271; 281; 513; 514; 661; 662; 663) and the center point (205; 255; 515; 510) of the plurality of contact points based on touch input from a plurality of contact points (210; 220; 230; 260; 270; 280; 511; 512; 601; 602; 603) contacted on the touch sensor. The processor may obtain probabilities (410; 420) that the touch input corresponds to each of the first designated gesture (203) related to the distance and the second designated gesture (253) related to the movement of the center point, based on the speed of the center point due to the movement of the contact points. The processor may change at least one of the distance or the center point based on the probabilities.

[0145] For example, the processor may change the distance or the center point among the center points based on the probabilities, in a state of identifying that the touch input is associated with the first designated gesture.

[0146] For example, the processor can identify that the touch input is associated with the first designated gesture based on the probabilities that are inversely proportional to the speed of the center point.

[0147] For example, the processor may change the distance, or the distance among the center points, in another state in which it identifies that the touch input is associated with the second designated gesture based on the probabilities.

[0148] For example, the processor can identify that the touch input is associated with the second designated gesture based on the probabilities proportional to the speed of the center point.

[0149] For example, the processor can change the distance to less than the distance between the contact points.

[0150] For example, the processor can identify the movement of the center point caused by the movement of the contact points. Based on the identified movement of the center point, the processor can change the center point by a distance less than the distance the center point has moved.

[0151] For example, the processor can identify the movement of the contact points based on a specified time interval.

[0152] For example, the processor may execute an event related to at least one of the first designated gesture or the second designated gesture based on an application executed by the processor based on changing at least one of the distance or the center point.

[0153] For example, the processor may change at least one of the distance or the center point based on the size of the touch sensing area based on the touch sensor.

[0154] A method of an electronic device (101) according to one embodiment as described above may include an operation of identifying the distance between the plurality of contact points (211; 221; 222; 261; 271; 281; 513; 514; 661; 662; 663), and the center point (205; 255; 515; 510) of the plurality of contact points, based on touch input by the plurality of contact points (210; 220; 230; 260; 270; 280; 511; 512; 601; 602; 603) contacted on the touch sensor (310). The above method may include an operation of obtaining probabilities (410; 420) that the touch input corresponds to each of a first designated gesture (203) related to the distance and a second designated gesture (253) related to the movement of the center point, based on the speed of the center point due to the movement of the contact points. The above method may include an operation of changing at least one of the distance or the center point based on the probabilities.

[0155] For example, the above method may include an operation to change the center point among the distance or the center point, within a state of identifying that the touch input is associated with the first designated gesture based on the above probabilities.

[0156] For example, the above method may include an action of identifying that the touch input is associated with the first designated gesture based on the probabilities that are inversely proportional to the velocity of the center point.

[0157] For example, the above method may include an operation to change the distance, or the distance among the center points, in another state in which the touch input is identified as being associated with the second designated gesture based on the above probabilities.

[0158] For example, the above method may include an action of identifying that the touch input is associated with the second designated gesture based on the probabilities proportional to the velocity of the center point.

[0159] For example, the above method may include an operation to change the distance to less than the distance between the contact points.

[0160] For example, the above method may include an operation of identifying the movement of the center point caused by the movement of the contact points. The above method may include an operation of changing the center point by a distance less than the distance the center point has moved, based on the identified movement of the center point.

[0161] For example, the above method may include an operation to identify the movement of the contact points based on a specified time interval.

[0162] For example, the above method may include an action of executing an event related to at least one of the first designated gesture or the second designated gesture based on an application executed by a processor based on changing at least one of the distance or the center point.

[0163] For example, the above method may include an operation of changing at least one of the distance or the center point based on the size of the touch sensing area based on the touch sensor.

[0164] The one or more programs of a computer-readable storage medium storing one or more programs according to one embodiment as described above can identify the distance between the plurality of contact points (211; 221; 222; 261; 271; 281; 513; 514; 661; 662; 663), and the center point of the plurality of contact points (205; 255; 515; 510) based on touch input by the plurality of contact points (210; 220; 230; 260; 270; 280; 511; 512; 601; 602; 603) contacted on the touch sensor (310) when executed by the processor (120) of the electronic device (101). The above one or more programs may obtain probabilities (410; 420) that the touch input corresponds to each of the first designated gesture (203) related to the distance and the second designated gesture (253) related to the movement of the center point, based on the speed of the center point due to the movement of the contact points. The above one or more programs may change at least one of the distance or the center point based on the probabilities.

[0165] For example, when the above one or more programs are executed by the processor, they may change the distance or the center point among the center points based on the probabilities, within a state in which the touch input is identified as being associated with the first designated gesture.

[0166] For example, when executed by the processor, the above one or more programs can identify that the touch input is associated with the first designated gesture based on the probabilities that are inversely proportional to the speed of the center point.

[0167] For example, the above one or more programs may change the distance, or the distance among the center points, in another state in which the touch input is identified as being associated with the second designated gesture based on the probabilities when executed by the processor.

[0168] For example, when executed by the processor, the above one or more programs can identify that the touch input is associated with the second designated gesture based on the probabilities proportional to the speed of the center point.

[0169] For example, when the above one or more programs are executed by the processor, the distance between the contact points can be changed to less than the distance between the contact points.

[0170] For example, the above one or more programs can identify the movement of the center point caused by the movement of the contact points when executed by the processor. The above one or more programs can change the center point by a distance less than the distance the center point has moved, based on the identified movement of the center point when executed by the processor.

[0171] For example, when the above one or more programs are executed by the processor, they can identify the movement of the contact points based on a specified time interval.

[0172] For example, the above one or more programs may execute an event related to at least one of the first designated gesture or the second designated gesture based on an application executed by the processor, based on changing at least one of the distance or the center point when executed by the processor.

[0173] For example, when the above one or more programs are executed by the processor, at least one of the distance or the center point may be changed based on the size of the touch sensing area based on the touch sensor.

[0175] The device described above may be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. For example, the device and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.

[0176] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or instruct the processing unit independently or collectively. Software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0177] A method according to one embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may continuously store a program executable by a computer, or temporarily store it for execution or download. Additionally, the medium may be various recording or storage means in the form of a single or several hardware combined, and may not be limited to a medium directly connected to a computer system but may exist distributed over a network. Examples of media may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and media configured to store program instructions, including ROM, RAM, and flash memory. Additionally, other examples of media may include recording or storage media managed by an app store that distributes applications or a site or server that supplies or distributes various other software.

[0178] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, suitable results can be achieved even if the described techniques are performed in a different order than described, and / or the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0179] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.

Claims

Claim 1 An electronic device comprising: a touch sensor; and a processor, wherein the processor identifies, based on a touch input by a plurality of contact points contacted on the touch sensor, a distance between the plurality of contact points and a center point of the plurality of contact points; obtains probabilities that the touch input corresponds to a first designated gesture related to the distance and a second designated gesture related to the movement of the center point, respectively, based on the speed of the center point due to the movement of the contact points; and is configured to change at least one of the distance or the center point based on the probabilities. Claim 2 An electronic device according to claim 1, wherein the processor is configured to change the distance or the center point among the center points within a state in which the touch input is associated with the first designated gesture based on the probabilities. Claim 3 An electronic device according to paragraph 2, wherein the processor is configured to identify that the touch input is associated with the first designated gesture based on the probabilities inversely proportional to the velocity of the center point. Claim 4 An electronic device according to claim 1, wherein the processor is configured to change the distance, or the distance among the center points, in another state in which the touch input is associated with the second designated gesture based on the probabilities. Claim 5 An electronic device according to claim 4, wherein the processor is configured to identify that the touch input is associated with the second designated gesture based on the probabilities proportional to the velocity of the center point. Claim 6 An electronic device according to claim 1, wherein the processor is configured to change the distance to less than the distance between the contact points. Claim 7 An electronic device according to claim 1, wherein the processor identifies a movement of the center point caused by the movement of the contact points, and is configured to change the center point by a distance less than the distance the center point has moved based on the identified movement of the center point. Claim 8 An electronic device according to claim 1, wherein the processor is configured to identify the movement of the contact points based on a specified time interval. Claim 9 An electronic device according to claim 1, wherein the processor is configured to execute an event associated with at least one of the first designated gesture or the second designated gesture based on an application executed by the processor based on changing at least one of the distance or the center point. Claim 10 An electronic device according to claim 1, wherein the processor is configured to change at least one of the distance or the center point based on the size of the touch sensing area based on the touch sensor. Claim 11 A method of an electronic device comprising: identifying a distance between a plurality of contact points and a center point of the plurality of contact points based on a touch input by a plurality of contact points contacted on a touch sensor; obtaining probabilities that the touch input corresponds to a first designated gesture related to the distance and a second designated gesture related to the movement of the center point, respectively, based on the speed of the center point due to the movement of the contact points; and changing at least one of the distance or the center point based on the probabilities. Claim 12 A method according to claim 11, comprising an action of changing the center point among the distance or center point within a state in which the touch input is identified as being associated with the first designated gesture based on the probabilities. Claim 13 A method comprising, in claim 12, identifying that the touch input is associated with the first designated gesture based on the probabilities inversely proportional to the velocity of the center point. Claim 14 A method according to claim 11, comprising an action of changing the distance, or the distance among the center points, in another state in which the touch input is identified as being associated with the second designated gesture based on the probabilities. Claim 15 A method comprising, in claim 14, identifying that the touch input is associated with the second designated gesture based on the probabilities proportional to the velocity of the center point. Claim 16 A method according to claim 11, comprising an operation to change the distance to less than the distance between the contact points. Claim 17 A method according to claim 11, comprising: an operation of identifying the movement of the center point caused by the movement of the contact points; and an operation of changing the center point to a distance less than the distance the center point has moved, based on the identified movement of the center point. Claim 18 A method according to claim 11, comprising an operation to identify the movement of the contact points based on a specified time interval. Claim 19 A method according to claim 11, comprising an action of executing an event associated with at least one of the first designated gesture or the second designated gesture based on an application executed by a processor based on changing at least one of the distance or the center point. Claim 20 A computer-readable storage medium for storing one or more programs, wherein the one or more programs, when executed by a processor of an electronic device, identify a distance between a plurality of contact points and a center point of the plurality of contact points based on a touch input by a plurality of contact points contacted on a touch sensor; obtain probabilities that the touch input corresponds to a first designated gesture related to the distance and a second designated gesture related to the movement of the center point, respectively, based on the speed of the center point due to the movement of the contact points; and change at least one of the distance or the center point based on the probabilities.

Images