Electronic device including at least one key, control method thereof, and non-transitory computer-readable recording medium
By utilizing a memory, processor, and input unit with touch and pressure sensors, the electronic device addresses the challenge of integrating virtual and physical key functionalities, resulting in a more intuitive and efficient user input experience.
Patent Information
- Application Number
- PCT/KR2024/014357
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-30
- Filing Date
- 2024-09-24
- Publication Date
- 2025-04-10
AI Technical Summary
Existing electronic devices struggle to effectively integrate virtual keys with physical key functionality, leading to a lack of intuitive and efficient user input methods.
The electronic device incorporates a memory, processor, and input unit with touch and pressure sensors to identify user inputs, allowing for the control of execution screens based on touch direction and pressure intensity.
This solution enables seamless integration of virtual and physical key functionalities, providing a more intuitive and efficient user input experience by accurately interpreting touch and pressure inputs.
Smart Images

Figure KR2024014357_10042025_PF_FP_ABST
Abstract
Description
Electronic device comprising at least one key, method for controlling the same, and non-transitory computer-readable recording medium
[0001] Embodiments of the present disclosure relate to an electronic device including at least one key, a method of controlling the same, and a non-transitory computer-readable recording medium.
[0002] The variety of services and additional features offered through electronic devices, such as smartphones, is steadily increasing. To enhance the utility of these devices and satisfy the diverse needs of users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices to offer a variety of features and differentiate themselves from competitors. Consequently, the various functions offered through electronic devices are also becoming increasingly sophisticated.
[0003] An electronic device may include a physical key (or hardware key) exposed outside the electronic device (e.g., a key including a tact dome switch). For example, the electronic device may obtain an input from a user by pressing (or touching) a physical key exposed outside the electronic device.
[0004] In electronic devices, attempts are being made to replace physical keys exposed outside the electronic device with virtual keys (or software keys) displayed through the display. For example, in an electronic device, a home key, which performs a designated function while the electronic device is powered on, may be implemented as a virtual key, replacing a physical key.
[0005] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.
[0006] According to one embodiment, an electronic device may include a housing, a display supported by the housing, an input unit disposed on a side of the housing for receiving user input for touch and pressure, a processor, and a memory storing instructions that cause the electronic device to perform when executed by the processor.
[0007] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to display an execution screen of a first application on the display.
[0008] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to identify a direction of a touch and a strength of pressure for a user input when receiving a user input through the input unit.
[0009] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to control the execution screen of the first application based on the identified information.
[0010] According to one embodiment, a method for controlling an electronic device may include an operation of receiving a user input through an input unit of the electronic device.
[0011] According to one embodiment, a method for controlling an electronic device may include an operation of identifying a direction of a touch and a strength of pressure for a user input when receiving a user input through an input unit of the electronic device.
[0012] According to one embodiment, a method for controlling an electronic device may include an operation of controlling an execution screen of the first application based on the identified information.
[0013] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include commands for causing an electronic device to display an execution screen of a first application on the display.
[0014] According to one embodiment, the one or more programs may include instructions for identifying a direction of touch and a strength of pressure for a user input when the electronic device receives a user input through an input unit of the electronic device.
[0015] According to one embodiment, the one or more programs may include commands that cause the electronic device to control the execution screen of the first application based on the identified information.
[0016] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.
[0017] FIG. 2 is a drawing for explaining a plurality of keys arranged on a side of an electronic device according to one embodiment of the present disclosure.
[0018] FIG. 3 is a schematic diagram illustrating the structure of a key according to an embodiment of the present disclosure.
[0019] FIG. 4a illustrates a simplified structure of a touch sensor according to one embodiment of the present disclosure.
[0020] FIG. 4b illustrates a simplified structure of a touch sensor according to one embodiment of the present disclosure.
[0021] FIG. 5 illustrates a simplified configuration of an electronic device according to an embodiment of the present disclosure.
[0022] FIG. 6 is a flowchart illustrating an operation when a swipe input is received on a key on the side of an electronic device according to an embodiment of the present disclosure.
[0023] FIG. 7 is a drawing for explaining swipe inputs received on a key on the side of an electronic device according to one embodiment of the present disclosure.
[0024] FIG. 8 is a flowchart illustrating an operation of an electronic device according to a direction of a swipe input received on a key on a side of the electronic device, according to an embodiment of the present disclosure.
[0025] FIG. 9 is a drawing for explaining the operation of an electronic device according to the direction of a swipe input received on a key on the side of the electronic device, according to one embodiment of the present disclosure.
[0026] FIG. 10 is a drawing for explaining the operation of an electronic device according to the direction of a swipe input received by a key on the side of the electronic device while the AOD screen is displayed, according to one embodiment of the present disclosure.
[0027] FIG. 11A is a diagram for explaining the operation of an electronic device according to the direction of a swipe input received on a key on the side of the electronic device in a locked state, according to one embodiment of the present disclosure.
[0028] FIG. 11b is a drawing for explaining a screen for setting a swipe direction of a key on the side of an electronic device for unlocking an electronic device according to an embodiment of the present disclosure.
[0029] FIG. 12 is a drawing for explaining the operation of an electronic device according to a user input received on a key on the side of the electronic device when playing a video, according to one embodiment of the present disclosure.
[0030] FIG. 13 is a drawing for explaining the operation of an electronic device according to a pressure value of a swipe input received on a key on the side of the electronic device, according to one embodiment of the present disclosure.
[0031] FIG. 14 is a diagram illustrating an operation of an electronic device that provides a user interface related to a function based on a set order according to a swipe input received on a key on the side of the electronic device, according to one embodiment of the present disclosure.
[0032] FIG. 15 is a diagram illustrating vibration feedback provided in response to a user input received on a key on the side of an electronic device, according to one embodiment of the present disclosure.
[0033] FIG. 16 is a diagram illustrating vibration feedback provided in response to a user input received on a key on the side of an electronic device, according to one embodiment of the present disclosure.
[0034] FIG. 17 is a diagram illustrating an operation of providing vibration corresponding to heart rate information through a key on the side of an electronic device according to an embodiment of the present disclosure.
[0035] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0036] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0037] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0038] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0039] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0040] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0041] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0042] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0043] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0044] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0045] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0046] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0047] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0048] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0049] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0050] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0051] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0052] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0053] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0054] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0055] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0056] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0057] FIG. 2 is a drawing for explaining a plurality of keys arranged on a side of an electronic device according to one embodiment of the present disclosure.
[0058] Referring to FIG. 2, an electronic device (101) (e.g., the electronic device (101) of FIG. 1) may include a first input unit (210) and a second input unit (220). According to one embodiment, the electronic device (101) may include a first input unit (210) and a second input unit (220) arranged in an area of a housing on a side of the electronic device (101). For example, the first input unit (210) and the second input unit (220) may be in the form of a button that is more convex than the housing, or may be in the form of a flat buttonless button that has no height difference from the housing.
[0059] According to one embodiment, the first input unit (210) may receive inputs at the top (211) and the bottom (212), respectively. For example, the top (211) and the bottom (212) may be distinguished by a 50% position in the y-axis direction of the first input unit (210).
[0060] According to one embodiment, the first input unit (210) may be used to adjust settings within a specific application, such as volume control, brightness control, or camera zoom function. For example, by touching the top (211) or bottom (212) of the first input unit (210), swiping upward or downward, or holding the touch and then moving upward or downward, the corresponding function may be controlled.
[0061] According to one embodiment, the second input unit (220) can perform power or screen on / off, call Bixby, execute camera or payment functions, or quickly execute a user-specified application. According to one embodiment, when the second input unit (220) is touched, swiped upward or downward, or touched and then moved upward or downward, the corresponding function can be controlled.
[0062] FIG. 3 is a schematic diagram illustrating the structure of a key according to an embodiment of the present disclosure.
[0063] Referring to FIG. 3, an input unit (e.g., a first input unit (210) of FIG. 2 or a second input unit (220) of FIG. 2) may include a housing (310), a touch sensor (320) (e.g., a sensor module (176) of FIG. 1), a pressure sensor (330) (e.g., a sensor module (176) of FIG. 1), and a haptic actuator (340).
[0064] In one embodiment, the housing (310) may have key areas displayed through buttons, raised or engraved areas, or may not have key areas displayed.
[0065] According to one embodiment, the user input (10) may be received through the outer surface of the housing. According to one embodiment, the electronic device may detect the user input (10) through a touch sensor (320) and a pressure sensor (330) disposed on the inner surface of the housing (310).
[0066] According to one embodiment, the touch sensor (320) and the pressure sensor (330) may be arranged in an overlapping order, but may also be arranged side by side under the housing (310).
[0067] According to one embodiment, the touch sensor (320) may be implemented in an electrostatic or ultrasonic manner. According to one embodiment, the electrostatic touch sensor (320) will be described in more detail with reference to FIG. 4A below. According to one embodiment, the ultrasonic touch sensor (320) will be described in more detail with reference to FIG. 4B below.
[0068] According to one embodiment, the pressure sensor (330) may be of an electrostatic type, an inductive type, a strain gauge type, or a piezoelectric type.
[0069] A capacitive pressure sensor (330) can detect pressure based on changes in capacitance formed between two electrodes with a dielectric between them in response to user input pressure. The capacitance can increase as the distance between the two electrodes decreases due to user input pressure.
[0070] An inductive pressure sensor (330) can detect pressure based on changes in the current induced in an inductor (e.g., a coil) depending on the pressure of a user input. The current can increase as a conductor (e.g., a metal housing or a user's finger) approaches the inductor (e.g., a coil) placed inside the housing due to the pressure of the user input.
[0071] A strain gauge type pressure sensor (330) can detect pressure based on changes in the resistance of a conductor depending on the pressure of a user input. The resistance can increase as the cross-sectional area of the conductor decreases as the length of the conductor increases due to the pressure of the user input.
[0072] A piezoelectric pressure sensor (330) can detect pressure based on a current or voltage difference generated by a piezoelectric material in response to a pressure input from a user. The current or voltage difference can increase as the amount of current converted by the piezoelectric material increases in response to a pressure input from the user.
[0073] In one embodiment, a haptic actuator (340) may provide vibrations that transmit vibrations to the hand of a user who touches a key. For example, the haptic actuator (340) may include a piezoelectric actuator, a horizontal motor, a vertical motor, a soundboard, or a coil motor.
[0074] In one embodiment, the haptic actuator (340) is configured to provide vibration to the key, and may be configured differently from the haptic actuator that provides vibration to the entire electronic device (101).
[0075] In one embodiment, the haptic actuator (340) may be positioned below the pressure sensor (330), but is not limited thereto, and may be positioned below the housing (310) in parallel with at least one of the touch sensor (320) or the pressure sensor (330).
[0076] FIG. 4a illustrates a simplified structure of a touch sensor according to one embodiment of the present disclosure.
[0077] Referring to FIG. 4a, a key area (410) may be arranged on a housing (e.g., housing (310) of FIG. 3) on the side of an electronic device (e.g., electronic device (101) of FIG. 1).
[0078] According to one embodiment, a touch sensor (320) may be positioned below the key area (410) of the housing. For example, the touch sensor (320) may be of an electrostatic type.
[0079] According to one embodiment, the touch sensor (320) may include a plurality of electrode pads (321). The plurality of electrode pads (321) may be arranged in a grid shape. For example, the plurality of electrode pads (321) may be arranged in one layer or two layers along the X-axis and the Y-axis.
[0080] According to one embodiment, the electrostatic method is a method of determining whether a touch has occurred by receiving a change in electrostatic capacitance at the X-axis and Y-axis electrode pads at the location of the touch input when a touch input is received on the surface of the key area (410).
[0081] According to one embodiment, a plurality of electrode pads (321) are arranged at regular intervals in one or two layers in the X-axis and Y-axis directions, so that the electronic device can detect left, right, up, and down swipe inputs by comparing the electrostatic capacitance changed in the X-axis and Y-axis electrode pads at each position when the electronic device is moved in the left, right, up, and down directions while the touch input is maintained.
[0082] According to one embodiment, although a plurality of electrode pads (321) are illustrated as being arranged in a grid shape in FIG. 4A, the position of a touch input or a swipe input may be detected by detecting electrostatic capacitances at the intersection of electrode pads of a first electrode layer in which long electrode pads in the first direction are arranged in a row in a second direction perpendicular to the first direction, and a second electrode layer in which long electrode pads in the second direction are arranged in a row in the first direction.
[0083] FIG. 4b illustrates a simplified structure of a touch sensor according to one embodiment of the present disclosure.
[0084] Referring to FIG. 4b, a key area (410) may be arranged on a housing (e.g., housing (310) of FIG. 3) on the side of an electronic device (e.g., electronic device (101) of FIG. 1).
[0085] According to one embodiment, a touch sensor (320) may be arranged below the key area (410) of the housing. For example, the touch sensor (320) may be an ultrasonic type. According to one embodiment, the ultrasonic type can determine whether a touch input has occurred based on the intensity of the ultrasonic waves that are reflected and returned after emitting ultrasonic waves. For example, when a finger touches the surface of the key area (410), the intensity of the ultrasonic waves that are reflected and returned is weaker than when the finger is not touching, so it is possible to determine whether a touch input has occurred based on the intensity of the ultrasonic waves that are reflected and returned.
[0086] According to one embodiment, the ultrasonic touch sensor (320) may include a plurality of ultrasonic sensors (322) arranged in the vertical, horizontal, and right directions. According to one embodiment, the electronic device may detect the direction of a swipe input based on changes in the intensity of ultrasonic waves detected by each of the ultrasonic sensors (322).
[0087] FIG. 5 illustrates a simplified configuration of an electronic device according to an embodiment of the present disclosure.
[0088] Referring to FIG. 5, an electronic device (e.g., electronic device (101) of FIG. 1) may include a processor (120) (e.g., processor (120) of FIG. 1), a memory (e.g., memory (130) of FIG. 1), a touch sensor (320) (e.g., sensor module (176) of FIG. 1 or touch sensor (320) of FIG. 3), a touch sensor IC (510), a pressure sensor (330) (e.g., sensor module (176) of FIG. 1 or pressure sensor (330) of FIG. 3), a pressure sensor IC (520), a display (160) (e.g., display module (160) of FIG. 1), a display driver IC (530), and a haptic actuator (340) (e.g., haptic actuator (340) of FIG. 3).
[0089] According to one embodiment, the touch sensor IC (510) can transmit or receive signals (transmit signal (TX), receive signal (RX), stimulus signal (shield), etc.) to and from the touch sensor (320). The touch sensor IC (510) can detect a user's touch input position based on the signals transmitted and received from and to the touch sensor (310). The touch sensor IC (510) can transmit the position (e.g., x-coordinate, y-coordinate) of the detected touch input to the processor (120).
[0090] According to one embodiment, the pressure sensor IC (520) may transmit or receive signals (transmit signal (TX), receive signal (RX), stimulus signal (shield), etc.) to and from the pressure sensor (330). The pressure sensor IC (520) may transmit the intensity (pressure) of the detected touch input and / or the duration of the pressure to the processor (120). The processor (120) or the pressure sensor IC (520) may determine the intensity (pressure) of the user's touch input and / or the duration of the pressure based on the signal received from the pressure sensor (330).
[0091] According to one embodiment, the processor (120) may perform a corresponding function based on the position of the touch input received from the touch sensor IC (510) and / or the intensity of the touch input received from the pressure sensor IC (520). For example, the processor (120) may control the display (160) to display a corresponding screen based on the position and / or intensity of the touch input, or control the haptic actuator (340) to provide vibration.
[0092] According to one embodiment, the processor (120) may determine screen information and the location of the screen information to be transmitted to the display driver IC (530). For example, if the intensity of the received touch input is greater than or equal to a first value, the processor (120) may transmit first image information to the display driver IC (530). According to one embodiment, if the intensity of the received touch input is greater than or equal to a second value that is greater than the first value, the processor (120) may transmit second image information to the display driver IC (530).
[0093] According to one embodiment, the display driver IC (530) may transmit a driving signal (e.g., a driver driving signal, a gate driving signal, etc.) to the display (160) based on image information received from the processor (120).
[0094] According to one embodiment, the processor (120) may determine haptic information to be transmitted to the haptic actuator (340). For example, if the intensity of the received touch input is greater than or equal to a first value, the processor (120) may transmit first haptic information to the haptic actuator (340). For example, if the intensity of the received touch input is greater than or equal to a second value that is greater than the first value, the processor (120) may transmit second haptic information (e.g., haptic information stronger than the first haptic information) to the haptic actuator (340).
[0095] According to one embodiment, the processor (120) can synchronize a first position and a first intensity of a touch input received at a first time, and can synchronize a second position and a second intensity of a touch input received at a second time different from the first time.
[0096] According to one embodiment, the memory (130) may store instructions or data that cause the processor (120) to perform the operations described above, and may include volatile or non-volatile memory.
[0097] FIG. 6 is a flowchart illustrating an operation when a swipe input is received on a key on the side of an electronic device according to an embodiment of the present disclosure.
[0098] FIG. 7 is a drawing for explaining swipe inputs received on a key on the side of an electronic device according to one embodiment of the present disclosure.
[0099] Referring to FIG. 6, in operation 610, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display an execution screen of a first application on a display (e.g., the display module (160) of FIG. 1).
[0100] According to one embodiment, the execution screen of the first application may include a home screen, an always on display (AOD), a lock screen, and an execution screen of a specific application.
[0101] According to one embodiment, in operation 620, when the electronic device receives a user input through an input unit (e.g., the first input unit (210) of FIG. 2 or the second input unit (220) of FIG. 2), the electronic device can identify the direction of the touch and the strength of the pressure for the user input.
[0102] For example, an electronic device may recognize a press when an input unit is pressed with a force greater than a certain pressure. For example, an electronic device may recognize a double press when an input unit is pressed twice with a force greater than a certain pressure within a certain time interval. For example, an electronic device may recognize a press when an input unit is pressed n times with a force greater than a certain pressure within a certain time interval. For example, an electronic device may recognize a long press when an input unit is pressed with a force greater than a certain pressure for a certain period of time. For example, an electronic device may recognize a combination press when two or more keys on an input unit are pressed with a force greater than a certain pressure.
[0103] For example, an electronic device may recognize a touch when an input unit is touched with a force lower than a certain pressure and higher than a minimum threshold pressure. For example, an electronic device may recognize a double touch when an input unit is touched twice with a force lower than a certain pressure and higher than a minimum threshold pressure within a certain time interval. In one embodiment, an input signal should be separated between a first touch and a second touch that is applied subsequently. For example, an electronic device may recognize an n-touch when an input unit is touched n times with a force lower than a certain pressure and higher than a minimum threshold pressure within a certain time interval. In one embodiment, an input signal should be separated between a first touch and a second touch that is applied subsequently.
[0104] For example, as illustrated in FIG. 7, the electronic device may recognize the input unit as a swipe front (710) when the surface of the key is swiped in the display direction (or in the +z-axis direction) from the rear of the electronic device. For example, the electronic device may recognize the input unit as a swipe back (720) when the surface of the key is swiped in the rear direction (or in the -z-axis direction) from the display of the electronic device. For example, the electronic device may recognize the input unit as a swipe up (730) when the surface of the key is swiped in the upper direction (or in the +y-axis direction) of the electronic device. For example, the electronic device may recognize the input unit as a swipe down (740) when the surface of the key is swiped in the lower direction (or in the -y-axis direction) of the electronic device. According to one embodiment, the electronic device may detect the swipe direction through a touch sensor.
[0105] According to one embodiment, the electronic device may determine the pressure value of the user input based on a pressure sensor (e.g., the sensor module (176) of FIG. 1 or the pressure sensor (330) of FIG. 3). For example, the electronic device may determine the pressure value of the user input through an electrostatic, inductive, strain gauge, or piezoelectric pressure sensor.
[0106] According to one embodiment, the electronic device can determine the swipe direction of the user input based on a change in the electrostatic capacity value of each of a plurality of electrode pads (e.g., electrode pads (321) of FIG. 4A) of a touch sensor (e.g., sensor module (176) of FIG. 1, touch sensor (320) of FIG. 3, touch sensor (320) of FIG. 4A). For example, the electronic device can determine the direction of the swipe input detected through an electrostatic touch sensor (e.g., touch sensor (320) of FIG. 4A) or an ultrasonic touch sensor (e.g., touch sensor (320) of FIG. 4B). According to one embodiment, the electronic device can determine whether the swipe direction of the user input is a first direction toward the display from the input unit, a second direction opposite to the first direction, a third direction upward from the input unit, or a fourth direction downward from the input unit, based on a change in the electrostatic capacity value of each of the plurality of electrode pads.
[0107] In one embodiment, in operation 650, the execution screen of the first application can be controlled based on the identified information.
[0108] According to one embodiment, the electronic device may display a user interface including at least one icon, each icon corresponding to at least one function, by overlaying it on a portion of the execution screen of the first application, based on a pressure value being greater than or equal to a first value and a swipe direction being a first direction from the input unit toward the display. For example, a swipe input in the first direction may be a swipe front input. For example, the at least one function may include execution of a specific application, a function of a specific application (e.g., square capture, circular capture, music playback control, music playlist).
[0109] For example, the user interface may be an edge panel that includes icons each corresponding to at least one function designated by the user. In one embodiment, the electronic device may execute functions through icons included in the user interface without executing an application.
[0110] In one embodiment, the user interface may be displayed outside the display area and then moved into the display area based on a swipe input (e.g., swipe front). For example, the user interface may be displayed on an edge area of the display on the side where the swipe input is received, or on an edge area of the display opposite the side where the swipe input is received, based on the user input.
[0111] In one embodiment, the user interface may be displayed as a layer above the execution screen of the first application.
[0112] In one embodiment, when the execution screen of the first application is the AOD screen, the electronic device may display a user interface in a portion of the AOD screen. According to one embodiment, an operation of displaying a user interface based on a swipe input while the AOD screen is displayed will be described in more detail below with reference to FIG. 10.
[0113] According to one embodiment, the user interface may further include an indicator indicating an icon to be selected from at least one icon. According to one embodiment, the electronic device may change the position of the indicator based on whether the swipe direction is a third direction having an angle within a set range from the first direction. For example, the swipe input in the third direction may be a swipe up or a swipe down. According to one embodiment, an operation of selecting an icon displayed on the user interface through the input unit will be described in more detail below with reference to FIG. 9.
[0114] In one embodiment, when the execution screen of the first application is a lock screen, the electronic device may display a user interface in a portion of the lock screen. In one embodiment, the electronic device may display a screen for unlocking based on receiving a user input selecting an icon from the user interface displayed in a portion of the lock screen.
[0115] According to one embodiment, the electronic device may unlock the screen based on receiving a plurality of swipe inputs in a set order through the input unit. For example, the order of the plurality of swipe inputs may be preset by the user.
[0116] In one embodiment, the electronic device may display an application execution screen for the selected icon. In one embodiment, as the application execution screen for the selected icon is displayed, the display of the user interface may be terminated.
[0117] According to one embodiment, the operation of unlocking based on a swipe input on the lock screen is described in more detail with reference to FIGS. 11A and 11B below.
[0118] In one embodiment, the electronic device may display an object related to the user interface based on a pressure value being less than a first value and greater than or equal to a second value. For example, when a low-pressure user input is received, the electronic device may display a bar-shaped object (or handler or UI) related to the user interface. In one embodiment, the low-pressure user input may be a touch input or a swipe input in a first direction (e.g., a swipe front).
[0119] In one embodiment, the electronic device may display a user interface based on determining that the pressure value is greater than or equal to a first value while the object is displayed.
[0120] By displaying objects related to the user interface based on low-pressure user input in this way, information about the function that will be executed can be provided in advance.
[0121] According to one embodiment, the operation of displaying an object related to a user interface based on a low-pressure user input is described in more detail below with reference to FIG. 13.
[0122] In one embodiment, the electronic device may select a function to be performed by a high user input having a pressure value greater than or equal to the first value through a low-pressure user input having a pressure value less than or equal to the first value and greater than or equal to the second value. For example, the electronic device may change the function to be performed each time it receives a low-pressure user input, and may change and display an object corresponding to the function to be performed. In one embodiment, the electronic device may perform a function corresponding to an object displayed when a high-pressure user input is performed.
[0123] For example, the electronic device may display a first object associated with a first application and a first function corresponding to the user input based on a pressure value of the user input being less than a first value and greater than or equal to a second value. For example, the first application and the first function corresponding to the user input may not be a function that displays a user interface (e.g., an edge panel) that includes at least one icon each corresponding to at least one function.
[0124] In one embodiment, the electronic device may display a second object related to a second function different from the first function based on a second user input, which is a swipe input in a first direction, received while the first object is displayed. In one embodiment, the second function may be a function of displaying a user interface (e.g., an edge panel) including at least one icon each corresponding to at least one function.
[0125] In one embodiment, the electronic device may display a user interface corresponding to a second function based on determining that a pressure value is greater than or equal to a first value while a second object is displayed.
[0126] In this way, users can select the desired function through swipe input via the input section.
[0127] According to one embodiment, the operation of changing the function to be executed through swipe input is described in more detail below with reference to FIG. 14.
[0128] In one embodiment, when a user interface includes multiple layers, the electronic device may, when a second user input, which is a swipe input in a first direction, is received while the first layer is displayed, terminate the display of the first layer and display the second layer, which is a layer below the first layer. In this way, the electronic device may select a layer that includes a function that the user wishes to use through repeated swipe inputs in the first direction.
[0129] In one embodiment, the electronic device may delete the user interface based on receiving a user input in a second direction opposite to the first direction while the user interface is displayed.
[0130] In one embodiment, the displayed user interface may be terminated by moving out of the display area based on a swipe input (e.g., a swipe back).
[0131] According to one embodiment, the electronic device may determine a function to be executed based on a swipe input based on a first application running when a swipe input is received and the swipe direction. For example, if the execution screen of the first application is a home screen, an AOD screen, or a lock screen, the electronic device may display a user interface including at least one icon based on a swipe input in the first direction (e.g., swipe front). For example, if the execution screen of the first application is a home screen, an AOD screen, or a lock screen, the electronic device may display a user interface related to a payment function based on a swipe input in a third direction (e.g., swipe up). For example, if the execution screen of the first application is a home screen, an AOD screen, or a lock screen, the electronic device may display a user interface including at least one icon for changing settings based on a swipe input in a fourth direction (e.g., swipe down).
[0132] In one embodiment, when the execution screen of the first application is the execution screen of a video application or the execution screen of a music playback application, the electronic device may display a user interface for section search, volume control, or brightness control based on a swipe input in a third direction (e.g., swipe up) or a fourth direction (e.g., swipe down).
[0133] According to one embodiment, the electronic device may further include a haptic actuator corresponding to the input unit (e.g., haptic actuator (340) of FIG. 3).
[0134] In one embodiment, the electronic device can control a haptic actuator to provide vibrations with an intensity and pattern associated with a first function corresponding to a first application and user input.
[0135] In one embodiment, the electronic device may receive a second user input that changes a setting value. For example, the setting value may include a volume control or a brightness control. In one embodiment, the electronic device may control a haptic actuator to provide a vibration of adjusted intensity based on the changed setting value based on the second user input.
[0136] In one embodiment, the electronic device may control a haptic actuator to provide vibrations with an intensity and pattern corresponding to a stored heart rate based on a heart rate-related application being executed.
[0137] According to one embodiment, the operation of providing vibration feedback through a haptic actuator is described in more detail below with reference to FIGS. 15, 16 and 17.
[0138] FIG. 8 is a flowchart illustrating an operation of an electronic device according to a direction of a swipe input received on a key on a side of the electronic device, according to an embodiment of the present disclosure.
[0139] Referring to FIG. 8, in operation 810, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) can check whether a swipe in a first direction is input to a side key (e.g., a first input unit (210) of FIG. 2 or a second input unit (220) of FIG. 2).
[0140] According to one embodiment, the electronic device may determine whether a swipe input in a first direction is received by a side key disposed on a housing on a side of the electronic device while the electronic device is displaying a home screen, an AOD screen, a lock screen, or a running screen of a specific application. For example, the swipe input in the first direction may be a swipe front, which is a swipe in a direction from the rear of the electronic device to the front of the electronic device (e.g., a swipe front (710) of FIG. 7).
[0141] According to one embodiment, the electronic device can determine that the first swipe input has been received if the pressure of the swipe input in the first direction is greater than or equal to a first value, and can determine that the first swipe input has not been received if the pressure of the swipe input in the first direction is less than the first value.
[0142] In one embodiment, if a swipe input in the first direction is not received (operation 810 - No), the electronic device may repeat operation 810.
[0143] According to one embodiment, when a swipe input in the first direction is received (operation 810 - Yes), in operation 820, the electronic device may display a user interface including a plurality of icons. For example, the plurality of icons may each correspond to a plurality of functions. The plurality of functions may be the execution of a specific application or the execution of a function of a specific application (e.g., screen capture or music playback).
[0144] In one embodiment, the electronic device may display a user interface that is positioned outside the display and then moves into the display based on a swipe input.
[0145] In one embodiment, in operation 830, the electronic device can determine whether a swipe in a second direction is input on the side key.
[0146] In one embodiment, the second direction may be the opposite direction of the first direction. For example, the swipe input in the second direction may be a swipe back, which is a swipe from the front of the electronic device to the back of the electronic device (e.g., swipe back (720) of FIG. 7).
[0147] In one embodiment, in operation 840, the electronic device may maintain the display of the user interface.
[0148] In one embodiment, in operation 850, the electronic device may terminate display of the user interface.
[0149] In one embodiment, the electronic device may terminate the display of the user interface by moving the displayed user interface off the display.
[0150] FIG. 9 is a drawing for explaining the operation of an electronic device according to the direction of a swipe input received on a key on the side of the electronic device, according to one embodiment of the present disclosure.
[0151] Referring to FIG. 9, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) can receive a swipe input (901) (e.g., swipe front) in a first direction from the rear to the front of the electronic device through an input unit (e.g., a first input unit (210) of FIG. 2 or a second input unit (220) of FIG. 2) disposed on a housing on the side of the electronic device while the execution screen (910) of the first application is displayed.
[0152] According to one embodiment, the electronic device may display a user interface (920) including at least one icon, each icon corresponding to at least one function, based on receiving a swipe input (901) in a first direction. According to one embodiment, the electronic device may display an indicator indicating that a first icon (921) included in the user interface (920) is the icon to be selected. For example, the first icon (921) may be an icon located at the top of the user interface (920).
[0153] In one embodiment, the electronic device may receive a swipe input (902) in a third direction upward and / or a fourth direction downward (e.g., swipe up and / or swipe down) through the input unit while the user interface (920) is displayed. In one embodiment, the electronic device may move the position of the indicator to the second icon (922) based on the swipe input (902) in the third direction and / or the fourth direction.
[0154] According to one embodiment, the electronic device may receive a user input (903) (e.g., a touch, a double touch, a press, a long press, or a double press) for selecting a second icon (922) through the input unit while an indicator is displayed on the second icon (922). According to one embodiment, the movement of the indicator may be performed based on a swipe input in a third direction and / or a fourth direction through a first input unit (e.g., the first input unit (210) of FIG. 2) among the input units, and the selection of the icon may be performed through a second input unit (e.g., the second input unit (220) of FIG. 2) among the input units. According to one embodiment, the movement operation of the indicator and the icon selection operation may be performed through a single input unit.
[0155] According to one embodiment, the electronic device may display an execution screen (930) of an application corresponding to the second icon (922) based on receiving a user input (903) for selecting the second icon (922).
[0156] According to one embodiment, when the electronic device displays the execution screen (930) of the application corresponding to the second icon (922), the display of the user interface (920) may be terminated.
[0157] FIG. 10 is a drawing for explaining the operation of an electronic device according to the direction of a swipe input received by a key on the side of the electronic device while the AOD screen is displayed, according to one embodiment of the present disclosure.
[0158] Referring to FIG. 10, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) can receive a swipe input (1001) (e.g., swipe front) in a first direction from the rear to the front of the electronic device through an input unit (e.g., a first input unit (210) of FIG. 2 or a second input unit (220) of FIG. 2) disposed on a housing on the side of the electronic device while an AOD screen (1010) is displayed.
[0159] According to one embodiment, the electronic device may display a user interface (1020) including at least one icon, each icon corresponding to at least one function, based on receiving a swipe input (1001) in a first direction. According to one embodiment, the electronic device may display an indicator indicating that a first icon (1021) included in the user interface (1020) is the icon to be selected. For example, the first icon (1021) may be an icon located at the top of the user interface (1020).
[0160] In one embodiment, if badge display on icons is allowed, the electronic device may display the update status of an application (e.g., a social networking service application, a messaging application, or a phone application) that has recently received a notification among the icons included in the user interface (1020) as a badge. If badge display on icons is not allowed, the electronic device may only display a list of icons through the user interface (1020).
[0161] According to one embodiment, the electronic device may receive a swipe input (1002) in a third direction upward and / or a fourth direction downward (e.g., swipe up and / or swipe down) through the input unit while the user interface (1020) is displayed. According to one embodiment, the electronic device may move the position of the indicator to a second icon based on the swipe input (1002) in the third direction and / or the fourth direction.
[0162] According to one embodiment, the electronic device may determine whether the AOD screen is a lock screen when a user input is received to select an icon on which the indicator is displayed after moving the indicator through a swipe input (1002) in the third direction and / or the fourth direction.
[0163] According to one embodiment, when the AOD screen is a lock screen, the electronic device may display a screen for unlocking when an icon is selected. When unlocked, the electronic device may perform a function corresponding to the selected icon. The unlocking operation according to one embodiment will be described in more detail with reference to FIGS. 11A and 11B below.
[0164] In one embodiment, if the AOD screen is not a lock screen, when an icon is selected, the electronic device may perform a function corresponding to the selected icon. For example, if the icon is an icon for launching a specific application, the electronic device may display the launch screen of the application corresponding to the selected icon.
[0165] FIG. 11A is a diagram for explaining the operation of an electronic device according to the direction of a swipe input received on a key on the side of the electronic device in a locked state, according to one embodiment of the present disclosure.
[0166] Referring to FIG. 11A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a user interface (1120) including at least one icon each corresponding to at least one function based on receiving a swipe input (e.g., swipe front) in a first direction from the rear to the front of the electronic device through an input unit (e.g., the first input unit (210) of FIG. 2 or the second input unit (220) of FIG. 2) disposed on a housing on a side of the electronic device while a lock screen (1110) is displayed. According to one embodiment, the electronic device may display an indicator indicating that the first icon (1121) included in the user interface (1120) is an icon to be selected.
[0167] According to one embodiment, the electronic device may display a screen (1130) for unlocking based on receiving a user input (1101) for selecting a first icon (1121) where an indicator is located. For example, the screen (1130) for unlocking may include a guide for unlocking (e.g., a pattern input request message, a fingerprint input request message, or a password input request message).
[0168] According to one embodiment, the electronic device can unlock based on inputting multiple swipe inputs (1102) in a set order through the input unit and perform a function corresponding to the selected first icon (1121). For example, if the first icon (1121) is an icon for executing a specific application, the electronic device can display an execution screen (1140) of the application corresponding to the first icon (1121).
[0169] According to one embodiment, setting of multiple swipe input directions for unlocking can be performed through a setting screen as illustrated in FIG. 11b below.
[0170] FIG. 11b is a drawing for explaining a screen for setting a swipe direction of a key on the side of an electronic device for unlocking an electronic device according to an embodiment of the present disclosure.
[0171] Referring to FIG. 11b, the electronic device can receive user input for setting a pattern of swipe input directions using the side button through the lock screen setting screen (1150). For example, the electronic device can check the directions (1151) of multiple swipe inputs through the input unit and set the directions (1151) of the multiple swipe inputs as a pattern for unlocking through the input unit.
[0172] FIG. 12 is a drawing for explaining the operation of an electronic device according to a user input received on a key on the side of the electronic device when playing a video, according to one embodiment of the present disclosure.
[0173] Referring to FIG. 12, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) may perform a function corresponding to a user input based on receiving a user input through an input unit (e.g., a first input unit (210) of FIG. 2 or a second input unit (220) of FIG. 2) disposed on a housing on the side of the electronic device while an execution screen (1210) of a media application (e.g., a video application or a music playback application) is displayed.
[0174] According to one embodiment, as illustrated in FIG. 12(a), when the electronic device receives a swipe input (1201) in a third direction toward the top and / or a fourth direction toward the bottom through the input unit while the execution screen (1210) of the media application is displayed, the electronic device may perform a search for a playback section of the content. According to one embodiment, when selecting a playback section through a content playback progress bar, it is difficult to make a fine selection, whereas the electronic device of the present disclosure allows the user to move the playback section back and forth finely through the swipe (1201) motion, thereby quickly selecting a desired playback section.
[0175] According to one embodiment, as illustrated in FIG. 12(b), the electronic device may move forward the content playback section by n seconds (e.g., 10 seconds) based on receiving a double touch (or double tap) (1202) through the input unit while the execution screen of the media application is displayed.
[0176] FIG. 13 is a drawing for explaining the operation of an electronic device according to a pressure value of a swipe input received on a key on the side of the electronic device, according to one embodiment of the present disclosure.
[0177] Referring to FIG. 13, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may, based on receiving a low-pressure user input (1301) through an input unit (e.g., the first input unit (210) of FIG. 2 or the second input unit (220) of FIG. 2) disposed on a housing on a side of the electronic device while the execution screen of the first application is displayed, display an object (1310) (e.g., a bar-shaped object) related to a function based on the first application and the user input (1301) by overlaying it on a portion of the execution screen of the first application. According to one embodiment, the electronic device may also provide vibration feedback together with the display of the object (1310).
[0178] In one embodiment, the low-pressure user input (1301) may be a user input having a pressure lower than a first pressure value for performing a function, but greater than a first pressure value, which is a minimum threshold pressure value. In one embodiment, the low-pressure user input (1301) may be a low-pressure touch or a low-pressure swipe input (e.g., a swipe front).
[0179] According to one embodiment, the electronic device may execute a function corresponding to a first application and the user input (1302) based on receiving a high-pressure user input (1302) through the input unit while an object (1301) is displayed. For example, if the function corresponding to the first application and the user input (1301) is a display of a user interface (1320) including at least one icon each corresponding to at least one function, the electronic device may display the user interface (1320). For example, the electronic device may display the user interface (1320) by overlaying it on the execution screen of the first application.
[0180] FIG. 14 is a diagram illustrating an operation of an electronic device that provides a user interface related to a function based on a set order according to a swipe input received on a key on the side of the electronic device, according to one embodiment of the present disclosure.
[0181] Referring to FIG. 14, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) can change a function to be performed each time it receives a user input (1401, 1402) through an input unit (e.g., a first input unit (210) of FIG. 2 or a second input unit (220) of FIG. 2) disposed on a housing on a side of the electronic device.
[0182] For example, when the electronic device receives a low-pressure user input through the input unit while the execution screen of the first application is displayed, the electronic device may display a first object (1410) (e.g., a bar-shaped object) related to the first application and a first function based on the user input by overlaying it on a portion of the execution screen of the first application. For example, the first object (1410) may correspond to a function of displaying a user interface including at least one icon each corresponding to at least one function.
[0183] In one embodiment, the electronic device may, upon receiving a low-pressure user input (1401) while the first object (1410) is displayed, change the first object (1410) to a second object (1420) associated with a second function different from the first function. For example, the second object (1420) may correspond to a function for adjusting the brightness of the screen.
[0184] In one embodiment, the electronic device may, upon receiving a low-pressure user input (1430) while the second object (1420) is displayed, change the second object (1420) to a third object (1430) associated with a third function different from the first and second functions. For example, the third object (1430) may correspond to a function for adjusting zoom in / out of the screen.
[0185] In one embodiment, the electronic device may change the third object (1430) back to the first object (1410) based on receiving a low pressure user input (1430) while the second object (1420) is displayed.
[0186] In one embodiment, the electronic device may perform a function corresponding to an object indicated at the time the high pressure user input is received, based on the receipt of a high pressure user input.
[0187] In this way, users can select the desired function through swipe input via the input section.
[0188] FIG. 15 is a diagram illustrating vibration feedback provided in response to a user input received on a key on the side of an electronic device, according to one embodiment of the present disclosure.
[0189] Referring to FIG. 15, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) may control a haptic actuator (e.g., a haptic actuator (340) of FIG. 3) to provide vibration feedback (1510, 1520, 1530) corresponding to the user input (1501) through an input unit (e.g., a first input unit (210) of FIG. 2 or a second input unit (220) of FIG. 2)) disposed on a housing on a side of the electronic device based on receiving a user input (1501).
[0190] For example, the electronic device may control a haptic actuator to provide a first vibration (1510) of a strength and pattern corresponding to the press input (1501) through the input unit based on receiving a press input (1501) through the input unit.
[0191] According to one embodiment, the electronic device may display a user interface indicating the adjusted setting value based on receiving a press input (1501) for adjusting a setting value (e.g., volume or brightness) through the input unit, and control a haptic actuator to provide a first vibration (1510) of a strength and pattern corresponding to the press input (1501) through the input unit.
[0192] For example, the electronic device may control a haptic actuator to provide a second vibration (1520) of a strength and pattern corresponding to the up-and-down swipe input (1502) through the input unit based on receiving an up-and-down swipe input (1502) through the input unit.
[0193] According to one embodiment, the electronic device may display a user interface indicating the adjusted setting value based on receiving an up-and-down swipe input (1502) for adjusting a setting value (e.g., volume or brightness) through the input unit, and control a haptic actuator to provide a second vibration (1520) through the input unit with an intensity and pattern corresponding to the up-and-down swipe input (1502). For example, the second vibration (1520) may be provided with a faster cycle and lower intensity than the first vibration (1510).
[0194] For example, when an electronic device displays a scrollable page, the electronic device may control a haptic actuator to provide a third vibration (1530) through the input unit with a strength and pattern corresponding to reaching the top or bottom of the page based on receiving an up or down swipe input (1503) through the input unit and reaching the top or bottom of the page. For example, the third vibration (1530) may be a single vibration provided upon reaching the top or bottom of the page.
[0195] FIG. 16 is a diagram illustrating vibration feedback provided in response to a user input received on a key on the side of an electronic device, according to one embodiment of the present disclosure.
[0196] Referring to FIG. 16, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) can provide vibration (1610) through an input unit (e.g., a first input unit (210) of FIG. 2 or a second input unit (220) of FIG. 2). For example, the vibration (1610) can include vibrations (1620) of various intensities and patterns.
[0197] For example, an electronic device may control a haptic actuator (e.g., haptic actuator (340) of FIG. 3) to provide vibrations (1620) of various intensities and patterns for the progress, failure, error, and increase or decrease of a setpoint of an action.
[0198] For example, start / transition feedback may be a single vibration feedback provided when starting a function or switching modes to indicate that the current function has started or is ready to start. For example, feedback of the end stage may be a single vibration feedback provided when the currently executing function has ended. In one embodiment, the electronic device may provide vibration feedback of the end stage at a specific time, such as a few seconds or a few minutes before the end, as feedback suggesting that the end is imminent. For example, when adjusting the volume, adjusting the brightness, or scrolling the pages on the screen, the electronic device may provide vibration feedback of different intensities according to the increase / decrease, and may provide feedback of the end stage once when the peak / low point is reached. For example, the electronic device may provide vibration feedback that gradually increases from a weak vibration to a strong vibration when the volume or brightness increases, and may provide vibration feedback that decreases from a strong vibration to a weak vibration when the volume or brightness decreases. For example, an electronic device may provide repeated vibration feedback of a small intensity while performing a swipe gesture when scrolling a page or fine-tuning a dial-type setting through a swipe input. For example, when pausing a media function such as music, video, or voice recording, the electronic device may provide repeated vibration feedback of the same intensity at regular intervals while touching the input unit to indicate that the function is paused and to prompt execution.
[0199] In one embodiment, the electronic device may provide vibration feedback in a pattern similar to the sensation of a bouncing ball or a running horse. In another embodiment, the electronic device may provide vibration feedback of different intensities and patterns for each notification based on user settings.
[0200] FIG. 17 is a diagram illustrating an operation of providing vibration corresponding to heart rate information through a key on the side of an electronic device according to an embodiment of the present disclosure.
[0201] Referring to FIG. 17, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may provide vibration feedback (1720) of intensity and pattern corresponding to a stored heart rate through an input unit (e.g., the first input unit (210) of FIG. 2 or the second input unit (220) of FIG. 2) while executing an application (1710) related to heart rate (e.g., a health application). For example, the electronic device may provide vibration feedback (1720) corresponding to a heart rate through the input unit while a touch is maintained on the input unit. The stored heart rate may be measured by the electronic device, or may be measured by an external electronic device (e.g., a wearable electronic device such as a smart watch or a smart ring) (e.g., the electronic device (104) of FIG. 1) and received from the external electronic device. According to one embodiment, the electronic device may provide vibration feedback corresponding to a heart rate that has been measured in advance and stored, or may be received by the electronic device or an external electronic device. Vibration feedback corresponding to a heart rate measured in real time may also be provided. In one embodiment, the heart rate may be the user's own or another person's heart rate.
[0202] In this way, electronic devices can provide the experience of feeling one's heart rate without having to look at the screen by providing vibration feedback of intensity and pattern corresponding to the heart rate through the input unit.
[0203] According to one embodiment, an electronic device may include a housing, a display supported by the housing, an input unit disposed on a side of the housing for receiving user input for touch and pressure, a processor, and a memory storing instructions that cause the electronic device to perform when executed by the processor.
[0204] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to display an execution screen of a first application on the display.
[0205] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to identify a direction of a touch and a strength of pressure for a user input when receiving a user input through the input unit.
[0206] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to control the execution screen of the first application based on the identified information.
[0207] According to one embodiment, the input unit may include a touch sensor for sensing the touch and a pressure sensor for sensing the pressure of the touch.
[0208] According to one embodiment, the touch sensor and the pressure sensor may be arranged in a stacked manner.
[0209] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to determine, based on a change in a capacitance value of each of the plurality of electrode pads of the touch sensor, whether the swipe direction of the user input is a first direction from the input unit toward the display, a second direction opposite to the first direction, a third direction upward from the input unit, or a fourth direction downward from the input unit.
[0210] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to overlay a user interface including at least one icon, each icon corresponding to at least one function, on a portion of an execution screen of the first application, based on the swipe direction being the first direction.
[0211] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to delete the user interface based on a user input in which the swipe direction is in the second direction while the user interface is displayed.
[0212] According to one embodiment, the user interface may further include an indicator indicating which of the at least one icons is to be selected.
[0213] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to change the position of the indicator based on whether the swipe direction is the third direction or the fourth direction.
[0214] According to one embodiment, the execution screen of the first application may store commands that make it an always on display (AOD) screen.
[0215] According to one embodiment, the instructions, when executed by the processor, may cause the electronic device to display the user interface in a portion of the AOD screen.
[0216] According to one embodiment, the execution screen of the first application may be a lock screen.
[0217] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to display a screen for unlocking based on receiving a user input selecting an icon from the user interface displayed in a portion of the lock screen.
[0218] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to unlock the lock screen based on receiving a plurality of swipe inputs in a set order through the input unit.
[0219] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to display an execution screen of an application for the selected icon.
[0220] According to one embodiment, the input unit may further include a pressure sensor.
[0221] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to display an object associated with the user interface based on a pressure value of the user input detected based on the pressure sensor being less than the first value and greater than or equal to the second value.
[0222] In one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to display the user interface based on determining that the pressure value is greater than or equal to a first value while the object is displayed.
[0223] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to display a first object associated with the first application and a first function corresponding to the user input based on a pressure value of the user input detected based on the pressure sensor being less than the first value and greater than or equal to the second value.
[0224] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to display a second object related to a second function different from the first function based on a second user input being received, which is a swipe input in the first direction, while the first object is displayed.
[0225] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to display the user interface corresponding to the second function based on determining that the pressure value is greater than or equal to the first value while the second object is displayed.
[0226] According to one embodiment, the electronic device may further include a haptic actuator corresponding to the input unit.
[0227] In one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to control the haptic actuator to provide vibrations with an intensity and pattern associated with the first application and the first function corresponding to the user input.
[0228] According to one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to receive a second user input that changes a setting value.
[0229] In one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to control the haptic actuator to provide a vibration of an adjusted intensity based on a set value changed based on the second user input.
[0230] In one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to control the haptic actuator to provide vibrations with an intensity and pattern corresponding to a stored heart rate based on a heart rate-related application being executed.
[0231] According to one embodiment, a method for controlling an electronic device may include an action of displaying an execution screen of a first application on a display of the electronic device.
[0232] According to one embodiment, a method for controlling an electronic device may include an operation of identifying a direction of a touch and a strength of pressure for a user input when receiving a user input through an input unit of the electronic device.
[0233] According to one embodiment, a method for controlling an electronic device may include an operation of controlling an execution screen of the first application based on the identified information.
[0234] In one embodiment, the identifying action may include an action of checking a pressure value of the user input based on a pressure sensor included in the input unit.
[0235] According to one embodiment, a control method of an electronic device may include an operation of determining whether a swipe direction of the user input is a first direction from the input unit toward the display, a second direction opposite to the first direction, a third direction upward from the input unit, or a fourth direction downward from the pressure unit, based on a change in a capacitance value of each of a plurality of electrode pads of a touch sensor included in the input unit.
[0236] According to one embodiment, the operation of controlling the execution screen of the first application may include an operation of overlaying a user interface including at least one icon each corresponding to at least one function on a portion of the execution screen of the first application based on the swipe direction being the first direction.
[0237] According to one embodiment, a control method of an electronic device may further include an operation of deleting the user interface based on receiving a user input in which a swipe direction is the second direction while the user interface is displayed.
[0238] According to one embodiment, the user interface may further include an indicator indicating which of the at least one icons is to be selected.
[0239] According to one embodiment, the control method of the electronic device may further include an operation of changing the position of the indicator based on whether the swipe direction is the third direction or the fourth direction.
[0240] According to one embodiment, the execution screen of the first application may be an AOD (always on display) screen.
[0241] According to one embodiment, the operation of displaying the user interface by overlaying it on a portion of the execution screen of the first application may display the user interface on a portion of the AOD screen.
[0242] According to one embodiment, the execution screen of the first application may be a lock screen.
[0243] According to one embodiment, a method of controlling an electronic device may further include an action of displaying a screen for unlocking based on receiving a user input of selecting one icon from the user interface displayed in a portion of the lock screen.
[0244] According to one embodiment, a control method of an electronic device may further include an operation of unlocking the lock screen based on receiving a plurality of swipe inputs in a set order through the input unit.
[0245] According to one embodiment, the control method of an electronic device may further include an action of displaying an execution screen of an application for the selected icon.
[0246] According to one embodiment, a control method of an electronic device may further include an operation of displaying an object related to the user interface based on a pressure value of the user input detected by a pressure sensor of the input unit being less than the first value and greater than or equal to the second value.
[0247] According to one embodiment, a control method of an electronic device may further include an action of displaying the user interface based on confirmation that the pressure value is greater than or equal to a first value while the object is displayed.
[0248] According to one embodiment, a control method of an electronic device may further include an operation of displaying a first object related to the first application and the first function corresponding to the user input based on a pressure value of the user input detected by a pressure sensor of the input unit being less than the first value and greater than or equal to the second value.
[0249] According to one embodiment, a control method of an electronic device may further include an operation of displaying a second object related to a second function different from the first function based on a second user input being received, which is a swipe input in the first direction, while the first object is displayed.
[0250] According to one embodiment, a control method of an electronic device may further include an operation of displaying the user interface corresponding to the second function based on confirmation that the pressure value is greater than or equal to the first value while the second object is displayed.
[0251] According to one embodiment, the method of controlling an electronic device may further include controlling a haptic actuator corresponding to the input unit to provide vibration with an intensity and pattern related to the first application and the first function corresponding to the user input.
[0252] In one embodiment, the act of controlling the haptic actuator may include receiving a second user input that changes a set value.
[0253] In one embodiment, the act of controlling the haptic actuator may include an act of controlling the haptic actuator to provide a vibration of controlled intensity based on a set value changed based on the second user input.
[0254] According to one embodiment, the act of controlling the haptic actuator may control the haptic actuator to provide vibration with an intensity and pattern corresponding to a stored heart rate based on the execution of a heart rate-related application.
[0255] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include commands for causing an electronic device to display an execution screen of a first application on a display of the electronic device.
[0256] According to one embodiment, the one or more programs may include instructions for identifying a direction of touch and a strength of pressure for a user input when the electronic device receives a user input through an input unit of the electronic device.
[0257] According to one embodiment, the one or more programs may include commands that cause the electronic device to control the execution screen of the first application based on the identified information.
[0258] According to one embodiment, the one or more programs may include instructions for the electronic device to determine whether the swipe direction of the user input is a first direction from the input unit toward the display, a second direction opposite to the first direction, a third direction upward from the input unit, or a fourth direction downward from the input unit, based on a change in the electrostatic capacity value of each of the plurality of electrode pads of the touch sensor included in the input unit.
[0259] In one embodiment, the one or more programs may include commands that cause the electronic device to overlay a portion of the execution screen of the first application with a user interface including at least one icon, each icon corresponding to at least one function, based on the swipe direction being the first direction.
[0260] In one embodiment, the one or more programs may include instructions for causing the electronic device to delete the user interface based on receiving a user input in which the swipe direction is the second direction while the user interface is displayed.
[0261] According to one embodiment, the user interface may further include an indicator indicating which of the at least one icons is to be selected.
[0262] According to one embodiment, the one or more programs may include instructions for the electronic device to change the position of the indicator based on whether the swipe direction is the third direction or the fourth direction.
[0263] According to one embodiment, the execution screen of the first application may be an AOD (always on display) screen.
[0264] In one embodiment, the one or more programs may include commands that cause the electronic device to display the user interface in a portion of the AOD screen.
[0265] According to one embodiment, the execution screen of the first application may be a lock screen.
[0266] In one embodiment, the one or more programs may include instructions for causing the electronic device to display a screen for unlocking based on receiving a user input selecting an icon from the user interface displayed in a portion of the lock screen.
[0267] In one embodiment, the one or more programs may include commands for unlocking the lock screen based on the electronic device receiving a plurality of swipe inputs in a set order through the input unit.
[0268] In one embodiment, the one or more programs may include commands that cause the electronic device to display an execution screen of an application for the selected icon.
[0269] In one embodiment, the one or more programs may include instructions for the electronic device to display an object associated with the user interface based on a pressure value of the user input detected based on the pressure sensor being less than the first value and greater than or equal to the second value.
[0270] In one embodiment, the one or more programs may include instructions for the electronic device to display the user interface based on determining that the pressure value is greater than or equal to a first value while the object is displayed.
[0271] In one embodiment, the one or more programs may include instructions for causing the electronic device to display a first object associated with the first application and a first function corresponding to the user input based on a pressure value of the user input detected based on the pressure sensor being less than the first value and greater than or equal to the second value.
[0272] In one embodiment, the one or more programs may include instructions for the electronic device to display a second object related to a second function different from the first function based on receiving a second user input, which is a swipe input in the first direction, while the first object is displayed.
[0273] In one embodiment, the one or more programs may include instructions for the electronic device to display the user interface corresponding to the second function based on determining that the pressure value is greater than or equal to the first value while the second object is displayed.
[0274] According to one embodiment, the electronic device may further include a haptic actuator corresponding to the input unit.
[0275] In one embodiment, the one or more programs may include instructions for controlling the haptic actuator to cause the electronic device to provide vibrations with an intensity and pattern associated with the first application and the first function corresponding to the user input.
[0276] In one embodiment, the one or more programs may include instructions for the electronic device to receive a second user input that changes a setting value.
[0277] In one embodiment, the one or more programs may include instructions for controlling the haptic actuator to provide a vibration of an adjusted intensity based on a set value changed based on the second user input.
[0278] In one embodiment, the one or more programs may include instructions for controlling the haptic actuator to provide vibrations with an intensity and pattern corresponding to a stored heart rate based on the execution of a heart rate-related application.
[0279] Electronic devices according to the embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.
[0280] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0281] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0282] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0283] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0284] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In electronic devices, housing; A display supported by the above housing; An input unit disposed on a side of the housing and configured to receive user input regarding touch and pressure; processor; and A memory storing instructions that cause the electronic device to perform when executed by the processor; The above instructions, when executed by the processor, cause the electronic device to: The execution screen of the first application is displayed on the above display, When receiving user input through the above input section, identify the direction of the touch and the strength of the pressure for the user input, An electronic device set to control the execution screen of the first application based on the identified information.
2. In paragraph 1, The above input section, a touch sensor for sensing the above touch; and Includes a pressure sensor for sensing the pressure of the above touch, An electronic device wherein the above touch sensor and the above pressure sensor are arranged in a stacked manner.
3. In paragraph 2, The above instructions, when executed by the processor, cause the electronic device to: Based on the change in the electrostatic capacity value of each of the plurality of electrode pads included in the touch sensor, it is determined whether the swipe direction of the user input is a first direction from the input unit toward the display, a second direction opposite to the first direction, a third direction upward from the input unit, or a fourth direction downward from the input unit. An electronic device set to display a user interface including at least one icon, each icon corresponding to at least one function, by overlaying it on a portion of the execution screen of the first application, based on the swipe direction being the first direction.
4. In paragraph 3, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to delete the user interface based on a user input in which the swipe direction is in the second direction while the user interface is displayed.
5. In paragraph 3 or 4, The above user interface, Further comprising an indicator indicating an icon to be selected from at least one of the above icons, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to change the position of the indicator based on whether the swipe direction is the third direction or the fourth direction.
6. In any one of paragraphs 3 to 5, The execution screen of the above first application is an AOD (always on display) screen, The above instructions, when executed by the processor, cause the electronic device to: An electronic device set to display the user interface on a portion of the AOD screen.
7. In any one of paragraphs 1 to 4, The execution screen of the above first application is a lock screen, The above instructions, when executed by the processor, cause the electronic device to: Based on receiving a user input selecting an icon from the user interface displayed in some area of the above lock screen, displaying a screen for unlocking, Based on receiving multiple swipe inputs in the order set through the above input unit, the lock screen is unlocked, An electronic device set to display the execution screen of an application for the above selected icon.
8. In any one of paragraphs 3 to 7, The above instructions, when executed by the processor, cause the electronic device to: Displaying an object related to the user interface based on a pressure value of the user input detected based on the pressure sensor being less than the first value and greater than or equal to the second value; An electronic device set to display the user interface based on confirmation that the pressure value is greater than or equal to the first value while the object is displayed.
9. In clauses 3 to 7, The above instructions, when executed by the processor, cause the electronic device to: Based on the pressure value of the user input detected by the pressure sensor being less than the first value and greater than or equal to the second value, displaying a first object related to the first application and the first function corresponding to the user input; In a state where the first object is displayed, a second user input, which is a swipe input in the first direction, is received, and a second object related to a second function different from the first function is displayed. An electronic device set to display the user interface corresponding to the second function based on confirmation that the pressure value is greater than or equal to the first value while the second object is displayed.
10. In any one of paragraphs 1 to 9, Further comprising a haptic actuator corresponding to the above input unit; The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to control the haptic actuator to provide vibration with an intensity and pattern associated with the first application and the first function corresponding to the user input.
11. In paragraph 10, The above instructions, when executed by the processor, cause the electronic device to: Receive a second user input that changes the setting value, An electronic device configured to control the haptic actuator to provide a vibration of controlled intensity based on a set value changed based on the second user input.
12. In clause 10 or 11, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to control said haptic actuator to provide vibrations with an intensity and pattern corresponding to a stored heart rate based on the execution of a heart rate related application.
13. In a method for controlling an electronic device, An action of displaying the execution screen of the first application on the display of the electronic device; When receiving a user input through the input unit of the electronic device, an operation of identifying the direction of the touch and the strength of the pressure for the user input; and A method for controlling an electronic device, comprising: an operation of controlling an execution screen of the first application based on the identified information.
14. In paragraph 13, The above identifying action is, An operation of determining whether the swipe direction of the user input is a first direction from the input unit toward the display, a second direction opposite to the first direction, a third direction upward from the input unit, or a fourth direction downward from the pressure unit based on a change in the electrostatic capacity value of each of the plurality of electrode pads of the touch sensor included in the input unit, The operation for controlling the execution screen of the above first application is as follows: A control method of an electronic device for displaying a user interface including at least one icon each corresponding to at least one function by overlaying it on a portion of an execution screen of the first application based on the swipe direction being the first direction.
15. In paragraph 14, The above user interface, Further comprising an indicator indicating an icon to be selected from at least one of the above icons, A control method of an electronic device further comprising: an operation of changing a position of the indicator based on whether the swipe direction is the third direction or the fourth direction.
Citation Information
Patent Citations
Mobile terminal
KR1020140099004A
Method and apparatus for providing a haptic feedback shape-changing display
KR1020170003738A
Mobile terminal and method for controlling the same
KR1020170041040A
Electronic device comprising display
KR1020170129372A
Electronic device and method for cotrolling of the electronic device
KR1020180028857A