Electronic device and the method for electronic pen operation
Patent Information
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-08-10
- Publication Date
- 2026-08-12
Smart Images

Figure 112021091934890-PAT00007_ABST
Abstract
Description
Technology Field
[0001] This document relates to electronic devices, and, for example, to a method for operating an electronic pen in an electronic device. Background Technology
[0003] With the development of mobile communication technology and hardware / software technology, portable electronic devices (hereinafter referred to as "electronic devices") have become capable of implementing various functions beyond just calling capabilities. Electronic devices can establish wireless communication with external devices using a communication module and can receive various inputs from users through a specified input device connected via wireless communication.
[0004] The electronic device can determine the input location of the input device and perform corresponding functions. The electronic device can detect a magnetic field generated from an input device including an EM-type resonant circuit by using an electromagnetic resonance (EMR) method. The electronic device can determine the location of the input device based on the induced electromotive force generated by the magnetic field for each channel.
[0005] An electronic device can perform a defined function based on a signal received from an input device. For example, the electronic device determines the action to be performed based on the received frequency, and can perform a mapped action when a specific frequency is received from the input device. The problem to be solved
[0007] An electronic device according to one embodiment may include ultratin glass (UTG) in a glass layer of a flexible display to enable bending. Although UTG has superior visibility and hardness compared to transparent polyimide (PI) film, it can easily break or crack due to external impact. There was a risk of damage to the display of the electronic device when many touch inputs were made to the flexible display using the pen tip of the input device.
[0008] The various embodiments of this document are intended to provide a method for detecting the type of input device in an electronic device and guiding the user to use a suitable input device. means of solving the problem
[0010] An electronic device according to various embodiments comprises a display, a communication module, a memory, and a processor operatively connected to the display, the communication module, and the memory. The processor detects a pen event for the display to obtain a frequency, establishes a communication connection with an electronic pen using the communication module to obtain at least one of switch information and a device ID, obtains an electronic pen connection record from the memory, determines the type of the electronic pen based on the device ID, and, if the switch information is obtained, determines the operating mode of the electronic pen based on the switch information, and can perform a predetermined function based on at least one of the frequency, the electronic pen connection record, the type of the electronic pen, and the operating mode.
[0011] A method for operating an electronic pen of an electronic device according to various embodiments may include: an operation of detecting a pen event for a display to obtain a frequency; an operation of establishing a communication connection with the electronic pen using a communication module to obtain at least one of switch information and a device ID; an operation of obtaining an electronic pen connection record from a memory; an operation of determining the type of the electronic pen based on the device ID; an operation of determining the operation mode of the electronic pen based on the switch information when the switch information is obtained; and an operation of performing a predetermined function based on at least one of the frequency, the electronic pen connection record, the type of the electronic pen, and the operation mode. Effects of the invention
[0013] According to various embodiments, the electronic device can prevent the use of an input device that may damage the display. The electronic device can establish a communication connection and determine the type of input device using the device ID of the received input device, and can display an appropriate warning message on the display to guide the use of a display-specific pen. Through this, the electronic device can reduce the risk of damage to the display.
[0014] According to various embodiments, the electronic device can prevent a situation in which it malfunctions when used with the frequency incorrectly set. Since the operation mapped to the received frequency is different from that of conventional electronic devices, the electronic device may not perform any function when the frequency is incorrectly set.
[0015] In addition, effects that can be obtained or predicted by various embodiments of the electronic device will be disclosed directly or implicitly in the detailed description of the embodiments of the electronic device. For example, various effects predicted according to various embodiments of the electronic device will be disclosed in the detailed description to be set forth below. Brief explanation of the drawing
[0017] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. Figures 2a and 2b are drawings illustrating two types of electronic devices and electronic pens. FIG. 3 is a block diagram of an electronic device according to various embodiments. FIG. 4 is a diagram illustrating the configuration of an electronic device and an external electronic device according to various embodiments. FIG. 5 is a diagram illustrating an electronic device and an input device performing a communication connection according to various embodiments. FIG. 6 is a drawing illustrating the display of a graphic UI including a warning message in an electronic device according to various embodiments. FIGS. 7a and 7b are drawings illustrating inputting with a second electronic pen to a first electronic device according to various embodiments. FIGS. 8A and FIGS. 8B are drawings illustrating inputting with a first electronic pen into a second electronic device according to various embodiments. FIGS. 9a and 9b are drawings illustrating a graphic UI including a warning message according to the pressure of an input device in an electronic device according to various embodiments. FIG. 10 is a diagram illustrating the input of an input device according to various embodiments, which is performed in a first electronic device and then in a second electronic device. FIG. 11 is a flowchart of a method in which an electronic device operates an input device according to various embodiments. FIG. 12 is a flowchart of the case where a second frequency is received in a first electronic device according to various embodiments. FIG. 13 is a flowchart of the case where a first frequency is received in a second electronic device according to various embodiments. Specific details for implementing the invention
[0018] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.
[0019] In describing the embodiments, technical details that are well known in the technical field to which the present invention belongs and are not directly related to the present invention are omitted. Additionally, detailed descriptions of components having substantially the same configuration and function are omitted.
[0020] For the same reason, some components in the attached drawings are exaggerated, omitted, or schematically depicted, and the size of each component does not entirely reflect its actual size. Accordingly, the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.
[0021] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
[0022] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0023] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0024] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0025] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0026] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0027] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0028] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0029] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0030] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0031] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0032] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0033] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0034] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0035] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0036] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0037] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0038] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0039] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.
[0040] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0041] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0042] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0043] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0044] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0045] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0046] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0047] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0048] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0049] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0051] Figures 2a and 2b are drawings illustrating two types of electronic devices and input devices.
[0052] According to various embodiments, the electronic device (200) may include a first electronic device (201) and a second electronic device (202). The first electronic device (201) may include a foldable display (or a flexible display). The glass layer of the foldable display may include ultrathin glass (UTG) to be bendable. Although UTG has superior visibility and hardness compared to a transparent polyimide (PI) film, it can easily break or crack due to external impact. The second electronic device (202) may include a display module capable of receiving touch input and may receive touch input from an input device (210) (e.g., an electronic pen). Although the electronic device (200) is described below as including the first electronic device (201) and the second electronic device (202), embodiments of the present invention are not limited thereto and may further include an electronic device (200) that performs a predetermined operation using various frequencies.
[0053] According to various embodiments, the electronic device (200) can receive a frequency from the input device (210) and perform a corresponding function. The first electronic device (201) and the second electronic device (202) may provide different functions for the same frequency. For example, the first electronic device (201) may perform a first function (e.g., pen tip function) when receiving a first frequency, and may block touch input from the input device (210) when receiving a second frequency. On the other hand, the second electronic device (202) may perform a second function (e.g., eraser function) when receiving a first frequency, and may perform a first function (e.g., pen tip function) when receiving a second frequency.
[0054] According to various embodiments, the electronic device (200) can determine the input location of the input device (210) and perform a corresponding function. The electronic device (200) can detect a magnetic field generated from the input device (210) using an electromagnetic resonance (EMR) method. The electronic device (200) can determine the location of the input device (210) based on the induced electromotive force generated by the magnetic field for each channel.
[0055] According to various embodiments, the input device (210) may include an EM-type resonance circuit. Energy can be transferred to the input device (210) in the form of an electric field generated by flowing current through a sensor panel (e.g., EMR panel, coil) of the electronic device (200) to induce a first resonance. When the current is cut off from the sensor panel of the electronic device (200), the resonance signal induced in the resonance circuit of the input device (210) remains in a attenuated form, and a second resonance can be induced in the sensor panel of the electronic device (200). The electronic device (200) can determine the position of the input device (210) by measuring the current (or voltage) induced by the second resonance.
[0056] According to various embodiments, the electronic device (200) can detect pen events and receive a frequency from the input device (210). According to one embodiment, the pen event may include touch input and hover input. The input device (210) may transmit a frequency to perform a function determined according to the settings. For example, it may transmit a first frequency (e.g., about 562.5 kHz) to perform a first function (e.g., pen tip function) and a second frequency (e.g., about 593.75 kHz) to perform a second function (e.g., eraser function). The electronic device (200) may receive a frequency from the input device (210) approaching within a reference distance and may perform an operation corresponding to the received frequency. For example, the electronic device (200) may perform the first function when it receives the first frequency and perform the second function when it receives the second frequency. According to another embodiment, the electronic device (200) may perform a second function when receiving a first frequency, and perform a first function when receiving a second frequency. In the following description, the input device (210) transmits the first frequency and the second frequency to the electronic device (200), and the electronic device (200) also receives the first frequency and the second frequency to receive a predetermined function; however, the frequencies used for the operation of the electronic device (200) and the input device (210) are not limited thereto.
[0057] According to various embodiments, the input device (210) may include a first electronic pen (211) and a second electronic pen (212). The first electronic pen (211) may be equipped with a soft pen tip and may include at least one button, an LED, and a switch toggle. According to one embodiment, the first electronic pen (211) may be attached or detached using a groove in the housing (not shown) of the electronic device (200). The first electronic pen (211) may perform a pre-specified function based on user input to the button. The first electronic pen (211) may determine an action to perform upon receiving touch input to each button, which may be set during the manufacture of the first electronic pen (211) or may be set directly by the user. For example, the first electronic pen (211) may call an air command based on user input to the first button. The user may perform a specified function by pressing the first button on the first electronic pen (211) and performing various gestures. The first electronic pen (211) can determine the function to be performed and transmit a corresponding frequency to the electronic device (200), and the electronic device (200) can receive the frequency and process the corresponding operation. According to one embodiment, the first electronic pen (211) can display the status of the system by displaying at least one color (e.g., red, green, blue) on an LED. For example, the first electronic pen (211) can display the status of the communication connection with an external device, battery, error, and update status using at least one color. The information that the first electronic pen (211) can display using an LED may be set during the manufacturing of the input device (210) or may be set directly by the user during use. The first electronic pen (211) can use at least one frequency to perform a predetermined function.For example, the frequency used by the first electronic pen (211) may include a first frequency used when performing hover and touch functions on the electronic device (200), a second frequency used when performing a second function on the electronic device (200), and a third frequency used when performing a defined function (e.g., air command, pen select) while pressing a button attached to the first electronic pen (211).
[0058] According to various embodiments, the first electronic pen (211) may change the operating frequency to perform a defined function using a switch toggle. The first electronic pen (211) may determine an operating mode as either a first mode or a second mode based on the position of the switch toggle. In the first mode, the first electronic pen (211) may use a first frequency to perform a first function (e.g., pen tip function) and may not support a second function (e.g., eraser function). In the second mode, the first electronic pen (211) may use a first frequency to perform a second function (e.g., eraser function) and may use a second frequency to perform a first function (e.g., pen tip function). According to one embodiment, in the first electronic pen (211), the first mode may be a setting for use in the first electronic device (201), and the second mode may be a setting for use in the second electronic device (202). For example, regarding a selected function (e.g., pen tip function), the first mode of the first electronic pen (211) and the first electronic device (201) use the same frequency, while the second electronic device (202) may use a different frequency. For example, when the first electronic pen (211) operates in the second mode, the second frequency can be transmitted to the electronic device (200) when performing the first function, and the first frequency can be transmitted when performing the second function. Since the second electronic device (202) performs the second function when receiving the first frequency and performs the first function when receiving the second frequency, it can be set to be the same as the frequency used by the first electronic pen (211) for operation in the second mode. On the other hand, since the first electronic device (201) performs the first function when receiving the first frequency and blocks touch input when receiving the second frequency, it may not perform the action intended by the user. According to one embodiment, the operation mode of the first electronic pen (211) can be changed by the user operating a switch toggle, and text indicating each operation mode can be further displayed on both sides of the switch toggle.
[0059] According to various embodiments, the second electronic pen (212) may be equipped with a sharp pen tip (e.g., having a larger radius of curvature than the pen tip of the first electronic pen (211)) and may include at least one button. The second electronic pen (212) may perform a defined function based on user input to the button. The action to be performed in response to touch input to the button in the second electronic pen (212) may be set during the manufacture of the second electronic pen (212) or may be determined by user settings. The second electronic pen (212) may use at least one frequency to perform the defined function. For example, the second electronic pen (212) may use a second frequency to perform a first function and a first frequency to perform a second function.
[0061] FIG. 3 is a block diagram of an electronic device according to various embodiments.
[0062] Referring to FIG. 3, the electronic device (300) (e.g., the electronic device (200) of FIG. 2) may include a display (320), a pressure sensor (330), a communication module (340), a processor (310), and a memory (350), and in various embodiments, some of the illustrated components may be omitted or substituted. The electronic device (300) may further include at least some of the components and / or functions of the electronic device (101) of FIG. 1. At least some of each component of the illustrated (or unillustrated) electronic device (300) may be operatively, functionally, and / or electrically connected.
[0063] According to various embodiments, the display (320) may display various images under the control of the processor (310). The display (320) may be implemented as any one of a liquid crystal display (LCD), a light-emitting diode (LED) display, a micro LED display, a quantum dot (QD) display, or an organic light-emitting diode (OLED) display, but is not limited thereto. The display (320) may be formed as a touch screen that detects touch and / or proximity touch (or hovering) input using a part of the user's body (e.g., finger) or an input device (e.g., stylus pen) (e.g., input device (210) of FIG. 2). The display (320) may include at least some of the configuration and / or functions of the display module (160) of FIG. 1.
[0064] According to various embodiments, the display (320) may be at least partially flexible and may be implemented as a foldable display or a rollable display.
[0065] According to various embodiments, a pressure sensor (330) may receive pressure applied to the sensor, convert the magnitude of the pressure into an analog electrical signal, and generate an output signal proportional to the supply voltage of the sensor. The pressure sensor (330) may include a pressure transducer and a pressure transmitter. The pressure sensor (330) may include a resonant pressure sensor, a manifold pressure sensor, a strain gage pressure sensor, a capacitive pressure sensor, an unamplified output pressure sensor, an amplified output pressure sensor, and a digital output pressure sensor. The pressure sensor (330) may include at least some of the configuration and / or functions of the sensor module (176) of FIG. 1.
[0066] According to various embodiments, the communication module (340) may communicate with an external device via a wireless network under the control of the processor (310). The communication module (340) may include hardware and software modules for transmitting and receiving data from a cellular network (e.g., LTE (long term evolution) network, 5G network, NR (new radio) network) and a short-range network (e.g., Wi-Fi, Bluetooth). The communication module (340) may include at least some of the configuration and / or functions of the communication module (190) of FIG. 1.
[0067] According to various embodiments, the memory (350) may include volatile memory (e.g., volatile memory (132) of FIG. 1) and non-volatile memory (e.g., non-volatile memory (134) of FIG. 1) and may store various data temporarily or permanently. The memory (350) may include at least some of the configuration and / or functions of the memory (130) of FIG. 1 and may store the program (140) of FIG. 1.
[0068] According to various embodiments, the memory (350) may store various instructions that can be executed by the processor (310). Such instructions may include control commands such as arithmetic and logical operations, data movement, and input / output that can be recognized by the processor (310).
[0069] According to various embodiments, the processor (310) may be configured to be operatively, functionally, and / or electrically connected to each component of the electronic device (300) (e.g., display (320), pressure sensor (330), communication module (340), and memory (350)) to perform operations or data processing regarding the control and / or communication of each component. The processor (310) may include at least some of the configuration and / or functions of the processor (120) of FIG. 1.
[0070] According to various embodiments, there may be no limitations on the computation and data processing functions that the processor (310) can implement on the electronic device (300), but below, various embodiments are described for preventing display damage by the electronic device (300) controlling the operating frequency and displaying a graphic UI including a warning phrase. The operations of the processor (310) described below can be performed by loading instructions stored in memory (350).
[0071] According to various embodiments, the processor (310) can detect pen events and receive frequencies. According to various embodiments, the processor (310) can detect pen events when an input device approaches within a certain distance from the electronic device (300). For example, when an input device approaches the display (320) of the electronic device (300) to make a touch input, the processor (310) can determine the location of the input device using an electromagnetic induction method and detect pen events. While detecting pen events, the processor (310) can receive frequencies from the input device. The input device transmits frequencies to perform a function determined according to user settings, and the processor (310) can receive the frequencies transmitted by the input device. According to one embodiment, the processor (310) can store touch information including touch input and input coordinates of the input device (e.g., the input device (210) of FIG. 2) in memory (350).
[0072] According to various embodiments, the electronic device (300) can perform a specific function depending on the received frequency. Depending on the type, the electronic device (300) can perform different functions even for the same frequency. For example, a first electronic device (e.g., the first electronic device (201) of FIG. 2) can perform a first function (e.g., pen tip function) when receiving a first frequency, and can block touch input of an input device when receiving a second frequency. A second electronic device (e.g., the second electronic device (202) of FIG. 2) can perform a second function (e.g., eraser function) when receiving a first frequency, and can perform a first function (e.g., pen tip function) when receiving a first frequency.
[0073] According to various embodiments, the processor (310) may establish a communication connection with an input device using a communication module (340). According to various embodiments, the processor (310) may receive at least one of switch information and a device ID from the input device. The information received by the processor (310) from the input device may or may not include switch information. For example, if the input device is a first electronic pen (e.g., the first electronic pen (211) of FIG. 2), the input device may transmit switch information to the electronic device (300), and if the input device is a second electronic pen (e.g., the second electronic pen (212) of FIG. 2), the input device may not transmit switch information to the electronic device (300). The switch information may include information on how the switch toggle is set in the input device, and the device ID may be a unique number for each input device. The processor (310) can determine the operating mode of the input device as either a first mode or a second mode using switch information, and can determine the input device with which a communication connection has been established as either a first electronic pen or a second electronic pen using a device ID.
[0074] For example, if the operating mode of an input device (e.g., the first electronic pen (211) of FIG. 2) is determined to be the first mode, the processor (310) may determine that the input device uses the first frequency to perform the first function and does not perform the second function. Conversely, if the operating mode is determined to be the second mode, the processor (310) may determine that the input device uses the second frequency to perform the first function and uses the first frequency to perform the second function.
[0075] According to various embodiments, in order to prevent damage to the display that may occur when multiple touch inputs are performed on the first electronic device with the second electronic pen, the processor (310) may display a warning message on one side of the display (320). According to various embodiments, the processor (310) may display warning messages of different content based on the type of electronic device (300), the type of input device, the operating mode of the input device, and switch information. Hereinafter, the operation of the processor (310) displaying a warning message when the first electronic device or the second electronic device detects a pen event of the first electronic pen or the second electronic pen will be described in detail.
[0076] According to various embodiments, the processor (310) can check whether it has previously been connected to an input device. When the processor (310) establishes a communication connection with an input device and receives information, it can store a record of this in memory (350). For example, when a communication connection is established with a first electronic pen, the processor (310) can store an electronic pen connection record in memory (350) that maps the first electronic pen and the information received from the first electronic pen. Subsequently, when a communication connection is established with a new input device, the processor (310) can check whether the input device currently connected to the communication has previously been connected to the communication by referring to the stored connection record.
[0077] According to various embodiments, when a first frequency is received by a first electronic device, the processor (310) can perform a first function. For example, if it is determined that the first electronic device performs a pen tip function in response to the first frequency, the processor (310) can perform the pen tip function. According to one embodiment, the input device may be a first electronic pen or a second electronic pen. When the first electronic pen is in a first mode, the first frequency may be used to perform a first function, and the second function may not be supported. When the first electronic pen is in a second mode, the first frequency may be used to perform a second function, and the second frequency may be used to perform a first function. Accordingly, when a first frequency is received by a first electronic device, it may include performing a first function in the first mode of the first electronic pen, performing a second function in the second mode of the first electronic pen, and performing a second function in the second electronic pen. In such cases, damage to the display can be prevented, so the processor (310) may not display a warning message. For example, when performing the first function in the first mode of the first electronic pen and when performing the second function in the second mode of the first electronic pen, damage to the display can be prevented because the pen event is performed with the soft pen tip of the first electronic pen. Additionally, when performing the second function with the second electronic pen, the touch can be made with the blunt eraser part (214) at the rear end rather than the sharp pen tip part of the second electronic pen. Since there is little risk of damage to the display (320) even when the display (320) of the first electronic device is touched with that part, the first function can be performed without displaying a warning message.
[0078] According to various embodiments, when a second frequency is received by the second electronic device, the processor (310) can perform a first function. For example, if it is determined that the second electronic device performs a pen tip function in response to the second frequency, the processor (310) can perform the pen tip function. According to one embodiment, the input device may be a second electronic pen or a first electronic pen operating in a second mode. The second electronic pen and the first electronic pen operating in a second mode may use the second frequency to perform the first function and may use the first frequency to perform the second function. Since the second electronic pen and the second electronic device use the same frequency for the selected operation, the processor (310) may not display a warning message when a pen event occurs with the second electronic pen and the first electronic pen operating in a second mode on the second electronic device.
[0079] According to various embodiments, when a second frequency is received by a first electronic device, the processor (310) may display a warning message based on at least one of the received frequency, an electronic pen connection record, a type of electronic pen, and an operating mode. When a second frequency is received by a first electronic device, it may include a case where a first function is to be performed in a second mode of the first electronic pen or a case where a first function is to be performed in a second electronic pen.
[0080] According to various embodiments, when a pen event occurs in which a second frequency is received, the processor (310) can check the first electronic pen connection record. If there is no history of connecting the first electronic pen, the processor (310) determines that the second frequency currently being received was transmitted by the second electronic pen and may display a graphic UI including a warning message instructing the user to switch to using the first electronic pen. When the user attempts to touch the display (320) of the first electronic device with the second electronic pen, there is a risk of damage to the display of the first electronic device, so to prevent this, the processor (310) may guide the user to use the first electronic pen instead of the second electronic pen.
[0081] According to various embodiments, if there is a history of connecting the first electronic pen, the processor (310) can check whether the first electronic pen is currently connected to communication. If the first electronic pen is not currently connected to communication, the processor (310) determines that the second frequency currently being received was transmitted by the second electronic pen and can display a graphic UI including a warning message to switch to and use the first electronic pen. Since this is the same as the case where there is no history of connecting the first electronic pen mentioned above, the explanation is omitted.
[0082] According to various embodiments, if there is a history of connecting the first electronic pen and the electronic device (300) has currently established a communication connection with the first electronic pen, the processor (310) can determine the operating mode of the first electronic pen by checking switch information. According to various embodiments, if the first electronic pen is operating in the first mode, the processor (310) may determine that a pen event from an input device other than the currently communication-connected input device has been detected because the first mode of the first electronic pen does not support the second frequency. For example, the electronic pen connected to the electronic device (300) is the first electronic pen and is operating in the first mode, but the pen event may have occurred from a second electronic pen located close to the electronic device (300). Since there is a risk of damage to the display when performing touch input on the first electronic device with the second electronic pen, the processor (310) may display a graphic UI including a warning message to use the first electronic pen. On the other hand, if the first electronic pen is operating in the second mode, the processor (310) may determine that the user is using a pen suitable for the first electronic device but has incorrectly set the switch. For example, if the user intends to perform the first function but the first electronic pen is currently operating in the second mode, the second frequency, rather than the first frequency, can be transmitted to the electronic device (300). In this case, the processor (310) may display a graphic UI containing a warning message to change the switch of the first electronic pen currently connected to the communication, thereby guiding the user to change the switch of the first electronic pen to operate in the first mode. When the user changes the switch of the first electronic pen to operate in the first mode, the first frequency for performing the first function will be transmitted to the first electronic device, so the processor (310) can perform a function that aligns with the user's intention.
[0083] According to various embodiments, when a first frequency is received by a second electronic device, the processor (310) may display a warning message based on at least one of the received frequency, an electronic pen connection record, a type of input device, and an operating mode. When a first frequency is received by a second electronic device, it may include cases where a first function is to be performed in a first mode of the first electronic pen, cases where a second function is to be performed in a second mode of the first electronic pen, and cases where a second function is to be performed in the second electronic pen.
[0084] According to various embodiments, when a pen event occurs in which a first frequency is received from the second electronic device, the processor (310) can check the first electronic pen connection record. If there is no record of the first electronic pen being connected, the processor (310) may determine that the first frequency currently being received was transmitted from the second electronic pen and may not take any action. For example, the first frequency is transmitted to perform the second function from the second electronic pen, and since there is no risk of damage to the display when the second electronic device is touched with the second electronic pen, a warning message may not be displayed.
[0085] According to various embodiments, if there is a record of the first electronic pen being connected, the processor (310) can determine whether the input device currently connected via communication is the first electronic pen. If the first electronic pen is not currently connected via communication, the processor (310) can determine that the first frequency currently being received is one of the cases where the first function is performed in the first mode of the first electronic pen, where the second function is performed in the second mode of the first electronic pen, or where the second function is performed by the second electronic pen. Among these, the case where the second function is performed by the second electronic pen and the case where the second function is performed in the second mode of the first electronic pen are normal operations, so a warning message may not be displayed. On the other hand, if the first function is performed in the first mode of the first electronic pen, the processor (310) may display a graphic UI containing a warning message to change the switch. Since the second electronic device performs the second function in response to the first frequency, if the user uses the first mode of the first electronic pen, a result different from the user's intention may occur. For example, the user wants to use the first function in the first mode of the first electronic pen, and the second electronic device that receives the first frequency can perform the second function. Accordingly, the processor (310) can display a warning message instructing the user to change the switch of the first electronic pen to operate in the second mode.
[0086] According to one embodiment, the processor (310) may decide not to display the warning message again within a first time (e.g., 3 days) when the first frequency is currently received by the second electronic device but the first electronic pen is not connected to communication. Since normal operation occurs when the second electronic pen performs the second function and when the second function is performed in the second mode of the first electronic pen when the first frequency is received by the second electronic device, the processor (310) can avoid malfunction by displaying the warning message only when the first function is performed in the first mode of the first electronic pen. Therefore, since there is no need to display the warning message in all cases under these circumstances, the processor (310) may decide not to display the warning message again within a first time after displaying it once.
[0087] According to various embodiments, when the first frequency is received by the second electronic device and the first electronic pen is currently connected via communication, the processor (310) can check the switch information of the first electronic pen. When the first electronic pen is operating in the second mode, it may be operating normally because the user has made a touch input to perform the second function and the second electronic device also receives the first frequency and performs the second function. In this case, the processor (310) may not take any action. According to another embodiment, when the first electronic pen is operating in the first mode, the processor (310) may display a graphic UI containing a warning message instructing the user to change the switch of the first electronic pen. The first electronic pen can transmit the first frequency to the second electronic device to perform the first function in the first mode. However, since the second electronic device receives the first frequency and performs the second function, it may perform a function different from the user's intention. Therefore, the processor (310) may display a graphic UI containing a warning message instructing the user to change the switch of the first electronic pen. According to one embodiment, the processor (310) may decide to display the warning message only once while the communication connection between the electronic device (300) and the first electronic pen is maintained. The processor (310) may decide to display the warning message again when the communication connection between the electronic device (300) and the first electronic pen is disconnected and then reconnected.
[0088] According to various embodiments, the processor (310) may be configured not to display the warning message again within a second time (e.g., one hour) when the first frequency is received by the second electronic device. Since the second electronic device has a low risk of display damage even when touch input is made with the second electronic pen with a sharp pen tip, the graphic UI displayed by the processor (310) in this case may include a warning message to change the switch of the first electronic pen. In order not to display the warning message too frequently, the processor (310) may not display the same warning message within the second time.
[0089] According to various embodiments, the processor (310) can obtain touch pressure applied to the display (320) from the pressure sensor (330). The display of the first electronic device may be damaged by touch input from the second electronic pen to the first electronic device. To prevent this, the processor (310) can measure the touch pressure applied to the electronic device (300).
[0090] According to various embodiments, the processor (310) may display a graphic UI containing a warning message when the touch pressure exceeds a reference pressure (e.g., 300 gf). The processor (310) may display a graphic UI containing a warning message instructing the user to reduce the touch pressure to prevent damage to the display caused by the touch pressure of the input device.
[0092] FIG. 4 is a diagram illustrating the configuration of an electronic device and an external electronic device according to various embodiments of the present invention.
[0093] Referring to FIG. 4, according to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) can communicate with an input device (e.g., the input device (210) of FIG. 2b and FIG. 4). The electronic device (101) and the input device (210) can communicate using a communication circuit and at least one of various short-range wireless communication methods. For example, the short-range wireless communication method may be Bluetooth Low Energy (BLE) communication, but is not limited thereto.
[0094] The electronic device (101) may include a pen controller (410) (e.g., the processor (120) of FIG. 1 or the processor (310) of FIG. 3).
[0095] The pen controller (410) may include, for example, at least one amplifier (not shown) connected to at least one coil (411, 412). The pen controller (410) may include at least one coil (411, 412) and may provide charging power to the input device (210) through at least one coil (411, 412).
[0096] According to one embodiment, at least one coil (411, 412) may be positioned in a location physically adjacent to the coil (421) of the input device (210) when the input device (210) is inserted into the internal space of the electronic device (101), but there is no limitation on the position of placement. Meanwhile, insertion into the internal space is exemplary, and the electronic device (101) may include an area (or space) in addition to the internal space where the input device (210) can be mounted (or attached), and in this case, the input device (210) may be detachably attached to the area (or space). At least some of the functions of the pen controller (410) may be performed by the processor (120), or the pen controller (410) and the processor (120) may be integrated to perform at least some of the functions.
[0097] For example, the pen controller (410) may include, in addition to at least one coil (411, 412), a control circuit (e.g., a control circuit independent of the processor (120)), an inverter, and / or an amplifier.
[0098] The resonant circuit (420) of the input device (210) may include a coil (421), at least one capacitor (422, 423), and / or a switch (424). When the switch (424) is in the off state, the coil (421) and the capacitor (422) may form a resonant circuit, and when the switch (424) is in the on state, the coil (421) and the capacitors (422, 423) may form a resonant circuit. Accordingly, the resonant frequency of the resonant circuit (420) may change depending on the on / off state of the switch (424). For example, the electronic device (101) may determine the on / off state of the switch (424) based on the frequency of a signal from the input device (210). For example, when a button of the input device (210) is pressed / released, the switch (424) can be turned on / off, and the electronic device (101) can determine whether the button of the input device (210) is pressed based on the frequency of the received signal confirmed through the digitizer.
[0099] At least one rectifier (431, 435) can rectify and output an alternating current waveform signal (VPEN) output from a resonant circuit (420). A charging switch controller (SWchg ctrl) (432) can receive a rectified signal (VM) output from a rectifier (431). Based on the rectified signal (VM), the charging switch controller (432) can determine whether the signal generated by the resonant circuit (420) is a charging signal or a position detection signal. For example, the charging switch controller (432) can determine whether the signal generated by the resonant circuit (420) is a charging signal or a position detection signal based on, for example, the magnitude of the voltage of the rectified signal (VM). Alternatively, the charging switch controller (432) can determine whether a signal having a charging initiation pattern is input based on the waveform of the rectified signal (VM).
[0100] The charging switch controller (432) can turn the charging switch (436) on or off. The charging switch controller (432) can control the charging of the battery (437).
[0101] In one embodiment, the charging switch (436) can transfer charging power received from the rectifier (435) to the battery (437) under the control of the charging switch controller (432).
[0102] The battery (437) can be charged using the received rectified signal (VIN) when the charging switch (436) is in the ON state. The over-voltage protection circuit (OVP) (433) can check the battery voltage (VBAT) and control the charging switch (436) to the OFF state if the battery voltage (VBAT) exceeds an overvoltage threshold.
[0103] In one embodiment, the load switch controller (SWL ctrl) (434) can measure the voltage value output by the battery (437).
[0104] The load switch controller (SWL ctrl) (434) can control the load switch (SWL) (438) to the ON state when it is determined that the battery voltage (VBAT) exceeds the operating voltage threshold. When the load switch (438) is in the ON state, power from the battery (437) can be transferred to the BLE communication circuit and controller (BLE + controller) (439). The load switch controller (434) may include an under voltage lock out (UVLO) circuit.
[0105] In one embodiment, the load switch (438) can supply power necessary for the BLE communication circuit and controller (439) to operate under the control of the load switch controller (434). The load switch (438) can control the connection between the BLE communication circuit and controller (439) and the battery (437).
[0106] The BLE communication circuit and controller (439) can operate using the received power. The button control circuit (440) can transmit information about the button input to the BLE communication circuit and controller (439) when the distance between the input device (210) and the electronic device (101) is greater than a threshold distance. The BLE communication circuit and controller (439) can transmit information about the received button input to the electronic device (101) through the antenna (441).
[0107] The sensor (450) may include a gyroscope sensor (451) and / or an accelerometer sensor (452). Sensing data acquired by the gyroscope sensor (451) and / or the accelerometer sensor (452) may be transmitted to a BLE communication circuit and a controller (439).
[0108] The BLE communication circuit and controller (439) can transmit a communication signal containing received sensing data to the electronic device (101) through the antenna (441). Alternatively, the BLE communication circuit and controller (439) can identify information associated with the location of the input device (210) identified based on the received sensing data (e.g., coordinates and / or displacement of the input device (210)). The BLE communication circuit and controller (439) can transmit the information associated with the location of the input device (210) identified to the electronic device (101) through the antenna (441).
[0109] The BLE communication circuit and controller (439) can activate the acceleration sensor (452) when the input device (210) is withdrawn or detached from the electronic device (101). The BLE communication circuit and controller (439) can activate the gyroscope sensor (451) when a button is pressed. Meanwhile, the activation timing is merely exemplary, and there is no limitation on the activation timing for each sensor. Additionally, the sensor (450) may further include a geomagnetic sensor. When only the acceleration sensor (452) is activated, the input device (210) can provide acceleration information measured by the acceleration sensor (452) to the electronic device (101), and the electronic device (101) may operate based on the position of the input device (210) and acceleration information identified based on the input device signal.
[0111] FIG. 5 is a diagram illustrating an electronic device and an input device performing a communication connection according to various embodiments.
[0112] According to various embodiments, a processor (e.g., processor (310) of FIG. 3) may establish a communication connection with an input device (510) (e.g., input device (210) of FIG. 2b and FIG. 4) (e.g., stylus). The processor may obtain at least one of switch information and a device ID from the input device. For example, in the case of a first electronic pen (e.g., first electronic pen (211) of FIG. 2), switch information indicating which mode it is operating in may be generated, and a second electronic pen (e.g., second electronic pen (212) of FIG. 2) may not generate switch information. The information received by the processor from the first electronic pen may include switch information, and the information received from the second electronic pen may not include switch information. The processor may determine the operating mode of the first electronic pen based on the switch information.
[0113] According to various embodiments, the processor can detect a pen event and determine the location of the input device (510) using an electromagnetic induction method. According to various embodiments, a first resonance generated in the input device (510) induces a second resonance, and the processor can determine the location of the input device (510) by measuring the current (or voltage) induced by the second resonance. According to various embodiments, the input device (510) can transmit a frequency along with the pen event to an electronic device (500) (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2). The frequency transmitted from the input device (510) to the electronic device (500) can be determined according to the type of input device and the function that the user intends to perform through the input device (510). For example, if a first function (e.g., pen tip function) is to be performed in the first mode of the first electronic pen, the first electronic pen can transmit a first frequency (e.g., about 562.5 kHz), and if a first function (e.g., pen tip function) is to be performed in the second electronic pen, the second electronic pen can transmit a second frequency (e.g., about 593.75 kHz). The input device (510) that established the communication connection and the input device (510) where the pen event occurred may be the same or different. For example, the processor may establish a communication connection with the first input device and detect a pen event by the second input device.
[0114] According to various embodiments, the input device (510) may include a switch (520). The first electronic pen may include a switch (520), and the frequency transmitted to the electronic device (500) may be changed according to the setting of the switch (520). For example, in the first mode of the first electronic pen, a first frequency may be transmitted to perform a first function, and a second frequency may be transmitted to perform a second function. In the second mode, a second frequency may be transmitted to perform a first function, and a first frequency may be transmitted to perform a second function. The processor may obtain switch information from the input device (510) connected via communication, and may determine the operating mode of the connected input device (510) based on the obtained switch information.
[0115] According to various embodiments, the input device (510) may include at least one button. For example, the input device (510) may include a first button (530) and a second button (540). The input device may transmit a third frequency for performing a third function while the button is pressed. For example, the second electronic pen may transmit a third frequency to the electronic device (500) for performing an air command function while the button is pressed. The first button (530) and the second button (540) of the input device (510) may each be used to perform different functions. The input device (510) may transmit a frequency corresponding to the first button operation when the user uses the input device (510) while pressing the first button (530) of the input device (510), and transmit a frequency corresponding to the second button operation when the user uses the input device (510) while pressing the second button (540).
[0117] FIG. 6 is a drawing illustrating the display of a graphic UI including a warning message in an electronic device according to various embodiments.
[0118] According to various embodiments, a processor (e.g., processor (310) of FIG. 3) may detect a pen event and display a graphic UI (602) including a warning message on a display (e.g., display (320) of FIG. 3) based on the type of electronic device (600) (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2), the type of input device (610) (e.g., input device (210) of FIG. 2b and FIG. 4)) and the operating mode of the input device (610). The input device may include a switch (616) (e.g., switch (520) of FIG. 5) and at least one button. For example, it may include a first button (612) and a second button (614). Referring to FIG. 6, the processor may display a graphic UI (602) including a graphic object and a warning message instructing caution regarding touch input in one area of the display. Depending on the situation, the processor may display a warning message of various messages together.
[0119] According to various embodiments, the processor may display a graphic UI (602) including a graphic object and a warning message instructing the user to use an input device (610) suitable for the electronic device (600). Since the first electronic device (e.g., the first electronic device (201) of FIG. 2) is equipped with a display that is prone to damage, it may be suitable to use a first electronic pen with a soft pen tip (e.g., the first electronic pen (211) of FIG. 2). If touch input is continued with a second electronic pen with a sharp pen tip (e.g., the second electronic pen (212) of FIG. 2), the display of the first electronic device may be damaged. When the processor detects touch input using the second electronic pen on the first electronic device, it may display a graphic UI (602) including a warning message instructing the user to use an input device (610) suitable for the electronic device (600).
[0120] For example, when the processor of the first electronic device receives the second frequency, the processor may display a graphic UI (602) containing a warning message instructing the user to use an input device (610) suitable for the electronic device (600). The case of receiving the second frequency in the first electronic device may include when the user intends to use the first function in the second mode of the first electronic pen or when the user intends to use the first function in the second electronic pen. At this time, if there is no history of the first electronic pen being connected to the first electronic device or if the first electronic pen is not currently connected, the processor may determine that the input device (610) currently transmitting the second frequency is the second electronic pen and display a graphic UI (602) containing a warning message instructing the user to use a different type of input device (610).
[0121] In another embodiment, when the processor of the first electronic device receives the second frequency, a graphic UI (602) including a warning message to use a suitable input device (610) when the first electronic pen is connected via communication and operating in the first mode may be displayed. Since the first mode of the first electronic pen does not use the second frequency, even if the first electronic pen is currently connected to the electronic device (600), the second frequency received by the processor may not have been transmitted from the currently connected first electronic pen. Since the second frequency may have been received by performing touch input with a second electronic pen other than the first electronic pen connected via communication, the processor may display a graphic UI (602) including a warning message to use a first electronic pen suitable for the first electronic device.
[0122] According to various embodiments, the processor may display a graphic UI (602) containing a warning message to change the switch (616) of the input device (610). When a first electronic pen is connected to the electronic device (600) via communication, the first electronic pen must be set to a first mode in the first electronic device to perform the desired operation by the user, and the first electronic pen must be set to a second mode in the second electronic device (e.g., the second electronic device (202) of FIG. 2) to perform the desired operation by the user. The processor may display a graphic UI (602) containing a warning message to change the switch (616) of the input device (610) based on switch information when the first electronic pen is set to a second mode in the first electronic device or when it is set to a first mode in the second electronic device.
[0123] For example, if the processor of the first electronic device receives the second frequency, and the first electronic pen is connected and set to the second mode, the processor may display a graphic UI (602) containing a warning message to change the switch (616). In the second mode, the first electronic pen may transmit the second frequency to perform the first function and transmit the first frequency to perform the second function. On the other hand, since the first electronic device performs the first function when it receives the first frequency and blocks touch input when it receives the second frequency, it may not be able to perform the function desired by the user. Therefore, the processor may guide the user to perform the desired action on the first electronic device by displaying a graphic UI (602) containing a warning message to change the switch (616).
[0124] In another embodiment, when the processor of the second electronic device receives the first frequency, a graphic UI (602) including a warning message to change the switch (616) may be displayed if the first electronic device has a history of connection but is not currently connected. Cases in which the processor of the second electronic device receives the first frequency may include cases where the user uses the first function in the first mode of the first electronic pen, cases where the user uses the second function in the second mode of the first electronic pen, and cases where the user uses the second function with the second electronic pen. The first mode of the first electronic pen transmits the first frequency when performing the first function and does not support the second function, whereas the second electronic device can perform the second function when receiving the first frequency and perform the first function when receiving the second frequency. Therefore, even if the user performs touch input to use the first function with the first mode of the first electronic pen, the second electronic device can perform the second function. The processor may display a graphic UI (602) that includes a warning message instructing the user to change the operation mode of the first electronic pen to the second mode in order to guide the user to perform the intended action.
[0125] In another embodiment, when the processor of the second electronic device receives the first frequency, a graphic UI (602) including a warning message to change the operating mode when the first electronic device is currently connected and operating in the first mode may be displayed. Since this is the same as described in the preceding embodiment, the description will be omitted.
[0127] FIGS. 7a and 7b are drawings illustrating inputting with a second electronic pen to a first electronic device according to various embodiments.
[0128] Referring to FIG. 7a, a processor (e.g., processor (310) of FIG. 3) can detect pen events of a second electronic pen (710) (e.g., second electronic pen (212) of FIG. 2) for a first electronic device (700) (e.g., first electronic device (201) of FIG. 2). Since the first electronic device (700) may include a foldable display (e.g., display (320) of FIG. 3), damage to the display may occur if touch input is performed with the sharp pen tip of the second electronic pen (710).
[0129] Referring to FIG. 7b, the processor may display a graphic UI (702) containing a warning message when a pen event for the first electronic device (700) is detected by the pen tip of the second electronic pen (710). In the first electronic device (700), the processor may receive a first frequency to perform a first function and may block touch input when it receives a second frequency. The second electronic pen (710) may transmit a second frequency to perform a first function and transmit a first frequency to perform a second function. Therefore, when the user uses the second electronic pen (710) to perform a first function, the processor may receive the second frequency and block touch input. When the user uses the second electronic pen (710) to perform a second function, the processor may receive the first frequency and perform the first function. Since the user's intention and the action performed by the processor are different, the processor may induce the user to use a different type of pen. Along with that, the processor can display a graphic UI (702) containing a warning message on the display.
[0131] FIGS. 8A and FIGS. 8B are drawings illustrating inputting with a first electronic pen into a second electronic device according to various embodiments.
[0132] Referring to FIG. 8a, a processor (e.g., processor (310) of FIG. 3) can detect pen events of a first electronic pen (810) (e.g., first electronic pen (211) of FIG. 2) for a second electronic device (800) (e.g., second electronic device (202) of FIG. 2). The processor, which includes a first button (812) and a second button (814) to perform various functions of the first electronic pen (810), can establish a communication connection with the first electronic pen (810) and obtain switch information and a device ID of the first electronic pen (810). The processor can determine the operating mode of the first electronic pen (810) based on the switch information.
[0133] Referring to FIG. 8b, the processor may display a graphic UI (802) containing a warning message when a pen event for the second electronic device (800) is detected by the pen tip of the first electronic pen (810). In the second electronic device (800), the processor may receive a first frequency to perform a second function and receive a second frequency to perform a first function. The first electronic pen (810) may transmit a first frequency to perform a first function in a first mode and not support a second function, and transmit a second frequency to perform a first function in a second mode and transmit a first frequency to perform a second function. Therefore, when the user transmits a first frequency in the first mode of the first electronic pen (810) to perform a first function, the processor may perform a second function. Since the user's intention and the action performed by the processor are different, the processor may induce the user to change the switch (816) of the first electronic pen (810) (e.g., switch (520) in FIG. 5). Along with this, the processor may display a graphic UI (802) containing a warning message on the display (e.g., display (320) in FIG. 3).
[0134] According to various embodiments, the processor may not display the warning message again until a set time has elapsed after displaying the warning message. When the first frequency is received by the second electronic device (800), it may include cases where the second function is performed with the second electronic pen (e.g., the second electronic pen (212) of FIG. 2) and cases where the second function is performed in the second mode of the first electronic pen (810). In these cases, since a suitable input device corresponding to the second electronic device (800) (e.g., the input device (210) of FIG. 2b and FIG. 4) is used, the processor may operate normally without displaying the graphic UI (802) containing the warning message. Therefore, the processor may not display the graphic UI (802) containing the warning message in all cases where the first frequency is input, and may display the graphic UI (802) containing the warning message when the first frequency is input again after a set time has elapsed.
[0136] FIGS. 9a and 9b are drawings illustrating a graphic UI including a warning message according to the pressure of an input device in an electronic device according to various embodiments.
[0137] Referring to FIG. 9a, a processor (e.g., processor (310) of FIG. 3) can detect pen events of an input device (910) (e.g., input device (210) of FIG. 2b and FIG. 4) for an electronic device (900) (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2). Pen events may include touch inputs for a display (e.g., display (320) of FIG. 3) and hover inputs that move the input device (910) within a reference distance from the display. The processor can obtain information about the touch inputs and hover inputs of the input device (910) from a sensor module (e.g., sensor module (176) of FIG. 1).
[0138] According to various embodiments, the processor may identify the type of input device (910) performing the detected pen event and display a graphic UI (902) including a warning message. The processor may establish a communication connection with the input device (910) and receive a device ID transmitted by the input device (910). For example, the processor may detect a touch input from a second electronic pen (e.g., the second electronic pen (212) of FIG. 2) to a first electronic device (e.g., the first electronic device (201) of FIG. 2). Based on the device ID obtained by establishing a communication connection with the second electronic pen, the processor may determine that the input device (910) currently performing the touch input is the second electronic pen. Since touching the first electronic device with the second electronic pen may cause damage to the display of the first electronic device, the processor may display a graphic UI (902) including a warning message instructing the user to change the pen being used. For example, the processor can display a graphic UI (902) that includes a warning message such as "We recommend using S Pen Pro. Using a regular S Pen may cause screen damage."
[0139] Referring to FIG. 9b, the processor may display a graphic UI (902) containing a warning message based on touch input from an input device (910). If the pressure applied by the input device (910) to the display of the electronic device (900) exceeds a reference pressure (e.g., 300 gf), the display of the electronic device (900) may be damaged. To prevent damage to the display, the processor may obtain pressure information from a pressure sensor (e.g., pressure sensor (330) in FIG. 3) regarding the pressure applied by the input device (910) to the display. Based on the obtained pressure information, the processor may display a graphic UI (902) containing a warning message instructing the input device (910) to reduce the touch pressure on the display. For example, the processor may display a graphic UI (902) containing a warning message such as, "Using the pen with force may cause screen damage."
[0141] FIG. 10 is a diagram illustrating the input of an input device according to various embodiments, which is performed in a first electronic device and then in a second electronic device.
[0142] According to various embodiments, a processor (e.g., processor (310) of FIG. 3) may display various warning messages depending on the received frequency and the type of electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2). FIG. 10 illustrates a user performing a pen event on a first (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2) (1000)) and performing a pen event on a second electronic device (1010) (e.g., second electronic device (202) of FIG. 2). When a user performs a touch input on a first electronic device (1000) (e.g., first electronic device (201) of FIG. 2) using a first electronic pen (1020) (e.g., first electronic pen (211) of FIG. 2), the first electronic pen (1020) may be set to a first mode. The first processor of the first electronic device (1000) can receive a first frequency from the first electronic pen (1020) and perform a first function. Subsequently, when the user touches the second electronic device (1010) while the first mode is set using the same input device (e.g., the input device (210) of FIG. 2b and FIG. 4), the first frequency is transmitted to perform the first function as when using the first electronic device (1000), and the second function is not supported and therefore may not be used. On the other hand, the second processor of the second electronic device (1010) can receive the first frequency and perform a second function. If the user uses the second electronic device (1010) immediately without changing the switch of the first electronic pen (1020) (e.g., the switch (520) of FIG. 5), the second processor may not be able to accurately perform the function that the user intends to perform on the second electronic device (1010). The second processor can display a graphic UI containing a warning message instructing the user to change the switch of the first electronic pen (1020), thereby inducing the user to change the switch of the first electronic pen (1020).
[0143] An electronic device according to various embodiments comprises a display, a communication module, a memory, and a processor operatively connected to the display, the communication module, and the memory. The processor detects a pen event for the display to obtain a frequency, establishes a communication connection with an electronic pen using the communication module to obtain at least one of switch information and a device ID, obtains an electronic pen connection record from the memory, determines the type of the electronic pen based on the device ID, and, if the switch information is obtained, determines the operating mode of the electronic pen based on the switch information, and can perform a predetermined function based on at least one of the frequency, the electronic pen connection record, the type of the electronic pen, and the operating mode.
[0144] According to various embodiments, the processor can perform a first function when the frequency is a first frequency and block touch input of an electronic pen when the frequency is a second frequency.
[0145] According to various embodiments, when the processor acquires the second frequency, it checks whether it is the first connection based on the electronic pen connection record, and if it is the first connection, it may display a graphic UI on one side of the display that includes a warning message instructing the user to use a dedicated pen.
[0146] According to various embodiments, the processor may determine the electronic pen as either a first electronic pen or a second electronic pen based on the device ID, and display a graphic UI on one side of the display that includes a warning message instructing the user to use a dedicated pen if the electronic pen is the second electronic pen.
[0147] According to various embodiments, the processor may determine the operating mode of the electronic pen based on the switch information as one of a first mode in which a first function is performed at a first frequency and a second function is performed at a second frequency, or a second mode in which a second function is performed at a first frequency and a first function is performed at a second frequency.
[0148] According to various embodiments, the processor may display a graphic UI on one side of the display that includes a warning message instructing the use of a dedicated pen when the second frequency is acquired and the electronic pen is in the first mode.
[0149] According to various embodiments, the processor may display a graphic UI on one side of the display that includes a warning message guiding to change the switch when the second frequency is acquired and the electronic pen is in the second mode.
[0150] According to various embodiments, the processor may perform a second function when the frequency is a first frequency, and perform a first function when the frequency is a second frequency.
[0151] According to various embodiments, when the processor acquires a first frequency, it checks whether it is the first connection based on the electronic pen connection record, and if it is not the first connection, it can display a graphic UI including a warning message on one side of the display based on at least one of the type of electronic pen and switch information.
[0152] According to various embodiments, the processor may not display the graphic UI again until a reference time has elapsed from the time when the graphic UI was last displayed.
[0153] According to various embodiments, the processor may display the graphic UI only once while the communication connection established with the electronic pen is maintained.
[0154] According to various embodiments, the electronic device further includes a pressure sensor, and the processor obtains the touch pressure of the electronic pen on the display from the pressure sensor, and can display a graphic UI including a warning message on one side of the display when the touch pressure exceeds a reference pressure.
[0155] According to various embodiments, the processor may receive a touch input of an electronic pen for the display and store touch information including the input coordinates of the touch input in the memory.
[0157] FIG. 11 is a flowchart of a method in which an electronic device operates an input device according to various embodiments.
[0158] The method illustrated in FIG. 11 can be performed by the electronic device described through FIG. 1 to FIG. 10 (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2), and the description of the technical features described above will be omitted below.
[0159] According to various embodiments, in operation 1111, the electronic device can detect a pen event and acquire a frequency. According to various embodiments, the electronic device can detect a pen event in which an input device (e.g., the input device (210) of FIG. 2b and FIG. 4) approaches within a certain distance from the electronic device. For example, when the input device approaches the display of the electronic device (e.g., the display (320) of FIG. 3) to make a touch input, the electronic device can determine the location of the input device using an electromagnetic induction method and detect a pen event. While detecting the pen event, the electronic device can receive a frequency from the input device. The input device transmits a frequency to perform a function determined according to user settings, and the electronic device can receive the frequency transmitted by the input device. According to one embodiment, the electronic device can store touch information including the touch input and input coordinates of the input device in a memory (e.g., the memory (350) of FIG. 3).
[0160] According to various embodiments, the electronic device may perform a defined function depending on the received frequency. Depending on the type, the electronic device may perform different functions even for the same frequency. For example, a first electronic device (e.g., the first electronic device (201) of FIG. 2) may perform a first function when receiving a first frequency and block touch input of an input device when receiving a second frequency. A second electronic device (e.g., the second electronic device (202) of FIG. 2) may perform a second function when receiving a first frequency and perform a first function when receiving a first frequency.
[0161] According to various embodiments, in operation 1120, the electronic device may establish a communication connection with the input device (e.g., the switch (520) of FIG. 5) to obtain information and a device ID. The information received by the electronic device from the input device may or may not include switch information. For example, if the input device is a first electronic pen (e.g., the first electronic pen (211) of FIG. 2), the input device may transmit switch information to the electronic device, and if the input device is a second electronic pen (e.g., the second electronic pen (212) of FIG. 2), the input device may not transmit switch information to the electronic device. The switch information may include information on how the switch (e.g., the switch (520) of FIG. 5) is set in the input device.
[0162] According to various embodiments, in operation 1130, the electronic device may obtain an electronic pen connection record from memory. When the electronic device establishes a communication connection with an input device and receives information, it may store a record of this in memory. Subsequently, when a communication connection is established with a new input device, the electronic device may refer to the stored connection record to check whether the input device currently connected to the communication has previously been connected to the communication.
[0163] According to various embodiments, in operation 1140, the electronic device can determine the type of electronic device and the operating mode of the input device. The electronic device can determine the operating mode of the input device as either a first mode or a second mode using switch information, and can determine the input device with which a communication connection has been established as either a first electronic pen or a second electronic pen using a device ID.
[0164] According to various embodiments, when a first frequency is received by a first electronic device, the electronic device may perform a first function. According to one embodiment, the input device may be a first electronic pen or a second electronic pen. When the first electronic pen is in a first mode, the first frequency may be used to perform a first function, and the second function may not be supported. When the first electronic pen is in a second mode, the first frequency may be used to perform a second function, and the second frequency may be used to perform a first function. Accordingly, when the first frequency is received by the first electronic device, it may include cases where the first function is performed in the first mode of the first electronic pen, cases where the second function is performed in the second mode of the first electronic pen, and cases where the second function is performed by the second electronic pen. In such cases, damage to the display can be prevented, so the electronic device may not display a warning message. For example, when performing the first function in the first mode of the first electronic pen and when performing the second function in the second mode of the first electronic pen, the pen event is performed with the soft pen tip of the first electronic pen, so damage to the display can be prevented. In addition, when performing the second function with the second electronic pen, the touch can be made with the blunt eraser part (214) at the rear end rather than the sharp pen tip part of the second electronic pen. Since there is less risk of damage to the display even when the display of the first electronic device is touched with that part, the first function can be performed without displaying a warning message.
[0165] According to various embodiments, when a second frequency is received by a second electronic device, the electronic device may perform a first function. According to one embodiment, the input device may be a second electronic pen or a first electronic pen operating in a second mode. The second electronic pen and the first electronic pen operating in a second mode may use the second frequency to perform a first function and may use the first frequency to perform a second function. Since the second electronic pen and the second electronic device use the same frequency for the selected operation, the electronic device may not display a warning message when a pen event occurs with the second electronic pen and the first electronic pen operating in a second mode on the second electronic device.
[0166] According to various embodiments, in operation 1150, the electronic device may perform a defined function based on acquired information. According to various embodiments, in order to prevent damage to the display that may occur when multiple touch inputs are performed on the first electronic device with the second electronic pen, and to prevent errors caused by incorrect switch settings of the first electronic pen, the electronic device may display a warning message on one side of the display. According to various embodiments, the electronic device may display warning messages of different content based on the type of electronic device, the type of input device, the operating mode of the input device, and switch information.
[0167] According to various embodiments, when a second frequency is received by a first electronic device, the electronic device may display a warning message based on at least one of the received frequency, an electronic pen connection record, a type of input device, and an operating mode. The case where a second frequency is received by the first electronic device may include a case where a first function is to be performed in a second mode of the first electronic pen or a case where a first function is to be performed in the second electronic pen.
[0168] According to various embodiments, when a first frequency is received by a second electronic device, the electronic device may display a warning message based on at least one of the received frequency, an electronic pen connection record, a type of input device, and an operating mode. The case in which a first frequency is received by a second electronic device may include a case in which a first function is to be performed in a first mode of the first electronic pen, a case in which a second function is to be performed in a second mode of the first electronic pen, and a case in which a second function is to be performed in the second electronic pen.
[0170] FIG. 12 is a flowchart of the case where a second frequency is received in a first electronic device according to various embodiments.
[0171] According to various embodiments, in operation 1202, an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2) may detect a pen event in a first electronic device (e.g., first electronic device (201) of FIG. 2) and obtain a second frequency. When the second frequency is received by the first electronic device, it may include cases where a first function is to be performed in a second mode of a first electronic pen (e.g., first electronic pen (211) of FIG. 2) or where a first function is to be performed in a second electronic pen (e.g., second electronic pen (212) of FIG. 2).
[0172] According to various embodiments, in operation 1210, the electronic device can check whether there is a previous connection record of the electronic pen. If there is no history of connecting the first electronic pen, the electronic device determines that the second frequency currently being received was transmitted by the second electronic pen and may display a graphic UI including a warning message instructing the user to switch to using the first electronic pen. When the user attempts to touch the display of the first electronic device (e.g., the display (320) of FIG. 3) with the second electronic pen, there is a risk of damage to the display of the first electronic device, so to prevent this, the electronic device may guide the user to use the first electronic pen instead of the second electronic pen.
[0173] According to various embodiments, in operation 1212, if there is no previous connection record of the first electronic pen, the electronic device may display a graphic UI including a warning message to change to the first electronic pen or change the switch (e.g., the switch (520) of FIG. 5).
[0174] According to various embodiments, in operation 1220, the electronic device can check whether it has currently established a communication connection with the first electronic pen. If the first electronic pen is not currently connected to the communication, the electronic device can determine that the second frequency currently being received was transmitted by the second electronic pen and display a graphic UI including a warning message to switch to and use the first electronic pen.
[0175] According to various embodiments, in operation 1230, the electronic device can determine whether the first electronic pen is operating in a first mode. Based on switch information received from the first electronic pen, the electronic device can determine whether the first electronic pen is operating in a first mode or in a second mode.
[0176] According to various embodiments, in operation 1232, the electronic device may display a graphic UI including a warning message to switch to the first electronic pen. When the first electronic pen is operating in the first mode, the electronic device may determine that a pen event has been detected from an input device other than the input device currently connected to communication (e.g., the input device (210) of FIG. 2b and FIG. 4) because the first mode of the first electronic pen does not support the second frequency. Since there is a risk of damage to the display when performing touch input on the first electronic device with the second electronic pen, the electronic device may display a graphic UI including a warning message to use the first electronic pen. On the other hand, when the first electronic pen is operating in the second mode, the electronic device may determine that the user is using a pen suitable for the first electronic device but has incorrectly set the switch.
[0177] According to various embodiments, in operation 1240, the electronic device may display a graphic UI including a warning message to change the switch. If the user intends to perform the first function but the first electronic pen is currently operating in the second mode, the second frequency, rather than the first frequency, may be transmitted to the electronic device. In this case, the electronic device may display a graphic UI including a warning message to change the switch of the first electronic pen currently connected to the communication, thereby guiding the user to change the switch of the first electronic pen to operate in the first mode. When the user changes the switch of the first electronic pen to operate in the first mode, the first frequency for performing the first function will be transmitted to the first electronic device, so the electronic device can perform a function that aligns with the user's intention.
[0179] FIG. 13 is a flowchart of the case where a first frequency is received in a second electronic device according to various embodiments.
[0180] According to various embodiments, in operation 1302, an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2) may detect a pen event in a second electronic device (e.g., second electronic device (202) of FIG. 2) to obtain a first frequency. When the first frequency is received by the second electronic device, it may include cases where a first function is to be performed in a first mode of the first electronic pen (e.g., first electronic pen (211) of FIG. 2), cases where a second function is to be performed in a second mode of the first electronic pen, and cases where a second function is to be performed in the second electronic pen (e.g., second electronic pen (212) of FIG. 2).
[0181] According to various embodiments, in operation 1310, the electronic device may check whether there is a previous connection record of the first electronic pen. If there is no record of connecting the first electronic pen, the electronic device may determine that the first frequency currently being received was transmitted by the second electronic pen and may not take any action. For example, the first frequency is transmitted to perform the second function by the second electronic pen, and since there is no risk of damage to the display when the second electronic device is touched with the second electronic pen, a warning message may not be displayed.
[0182] According to various embodiments, in operation 1312, the electronic device may not perform any operation. According to one embodiment, if there is no previous connection record of the first electronic pen, the electronic device may not perform any operation. According to another embodiment, if the electronic device is currently connected to the first electronic pen but is operating in the first mode, the electronic device may not perform any operation.
[0183] According to various embodiments, in operation 1320, the electronic device can check whether it is currently connected to the first electronic pen. If the first electronic pen is not currently connected to the communication, the electronic device can determine that the first function is being performed in the first mode of the first electronic pen, the second function is being performed in the second mode of the first electronic pen, or the second function is being performed in the second electronic pen. Among these, if the second function is being performed in the second electronic pen, it is a normal operation, so a warning message may not be displayed. On the other hand, if the first electronic pen is performing the first function in the first mode of the first electronic pen with another electronic device, the electronic device may display a graphic UI containing a warning message to change the switch (e.g., the switch (520) in FIG. 5) (1340). Since the second electronic device performs the second function in response to the first frequency, if the user uses the first mode of the first electronic pen, a result different from the user's intention may occur. For example, the user may want to use the first function in the first mode of the first electronic pen, and the second electronic device that receives the first frequency may perform the second function. Therefore, the electronic device may display a warning message instructing the user to change the switch of the first electronic pen to operate in the second mode (1340).
[0184] According to various embodiments, in operation 1322, the electronic device can check whether a warning message has been displayed within a first time. Since normal operation occurs when the second electronic device receives the first frequency and performs the second function in the second electronic pen and performs the second function in the second mode of the first electronic pen, the electronic device can avoid malfunction by displaying a warning message only when the first function is performed in the first mode of the first electronic pen. Therefore, since there is no need to display a warning message in all cases under these circumstances, the electronic device can decide not to display the warning message again within the first time after displaying it once.
[0185] According to various embodiments, in operation 1324, the electronic device may check whether a warning message has been displayed within a second time. Since the second electronic device has a low risk of damage to the display even when touch input is made with the second electronic pen with a sharp pen tip, the graphic UI displayed by the electronic device in this case may include a warning message to change the switch of the first electronic pen. In order to avoid displaying the warning message too frequently, the electronic device may not display the same warning message within the second time.
[0186] According to various embodiments, in operation 1330, the electronic device can check whether the first electronic pen is operating in the first mode. If the first electronic pen is operating in the first mode, the electronic device may display a graphic UI including a warning message instructing the user to change the switch of the first electronic pen. The first electronic pen may transmit a first frequency to the second electronic device to perform a first function in the first mode. However, since the second electronic device receives the first frequency and performs the second function, it may perform a function different from the user's intention. Therefore, the electronic device may display a graphic UI including a warning message instructing the user to change the switch of the first electronic pen.
[0187] According to various embodiments, in operation 1332, the electronic device may check whether it is in communication with the first electronic pen. The electronic device may decide to display the warning message only once while the communication connection between the electronic device and the first electronic pen is maintained. The electronic device may decide to display the warning message again if the communication connection between the electronic device and the first electronic pen is disconnected and then reconnected.
[0188] According to various embodiments, in operation 1334, the electronic device may check whether a warning message has been displayed within a second time. As in operation 1324, the electronic device may not display the same warning message within the second time in order not to display the warning message too frequently.
[0189] According to various embodiments, in operation 1340, the electronic device may display a warning message instructing to change the switch. If the first electronic pen is currently not connected to communication, or if the first electronic pen is connected to communication and operating in the first mode, the operating mode may be incorrectly set and perform a function different from the user's intention. The electronic device may display a warning message instructing to change the switch currently set to the first mode to the second mode.
[0190] According to various embodiments, the electronic device may obtain touch pressure applied to a display (e.g., display (320) of FIG. 3) from a pressure sensor (e.g., pressure sensor (330) of FIG. 3). The display of the first electronic device may be damaged by touch input from a second electronic pen to the first electronic device (e.g., first electronic device (201) of FIG. 2). To prevent this, the electronic device may measure the touch pressure applied to the electronic device.
[0191] According to various embodiments, the electronic device may display a graphic UI containing a warning message when the touch pressure exceeds a reference pressure (e.g., 300 gf). The electronic device may display a graphic UI containing a warning message instructing the user to reduce the touch pressure to prevent damage to the display caused by the touch pressure of the input device (e.g., the input device (210) of FIG. 2b and FIG. 4).
[0192] A method for operating an electronic pen of an electronic device according to various embodiments may include: an operation of detecting a pen event for a display to obtain a frequency; an operation of establishing a communication connection with the electronic pen using a communication module to obtain at least one of switch information and a device ID; an operation of obtaining an electronic pen connection record from a memory; an operation of determining the type of the electronic pen based on the device ID; an operation of determining the operation mode of the electronic pen based on the switch information when the switch information is obtained; and an operation of performing a predetermined function based on at least one of the frequency, the electronic pen connection record, the type of the electronic pen, and the operation mode.
[0193] According to various embodiments, the operation of performing the defined function may further include an operation of performing a first function when the frequency is a first frequency, and an operation of blocking touch input of an electronic pen when the frequency is a second frequency.
[0194] According to various embodiments, the operation of performing the defined function may further include the operation of determining the electronic pen as either a first electronic pen or a second electronic pen based on the device ID, and the operation of displaying a graphic UI on one side of the display that includes a warning message instructing the use of a dedicated pen when the electronic pen is the second electronic pen.
[0195] According to various embodiments, the operation of performing the defined function may further include an operation of determining the operation mode of the electronic pen based on the switch information as one of a first mode that performs a first function at a first frequency and a second function at a second frequency, or a second mode that performs a second function at a first frequency and a first function at a second frequency.
[0196] According to various embodiments, the operation of performing the above-determined function may further include the operation of displaying a graphic UI on one side of the display that includes a warning message instructing the use of a dedicated pen when the second frequency is acquired and the electronic pen is in the first mode.
[0197] According to various embodiments, the operation of performing the defined function may further include an operation of performing a second function when the frequency is a first frequency, and an operation of performing a first function when the frequency is a second frequency.
[0198] According to various embodiments, the operation of performing the defined function may further include, when a first frequency is acquired, an operation of checking whether it is the first connection based on the electronic pen connection record, and when it is not the first connection, an operation of displaying a graphic UI including a warning message on one side of the display based on at least one of the type of electronic pen and switch information.
Claims
Claim 1 An electronic device comprising: a display; a communication module; a memory for storing instructions; and at least one processor operatively connected to the display, the communication module, and the memory, wherein when the instructions stored in the memory are executed by the at least one processor, the electronic device is configured to detect a pen event for the display to obtain a frequency, establish a communication connection with an electronic pen using the communication module, obtain at least one of switch information including information on the operating mode of the electronic pen based on switch toggle information of the electronic pen, and a device ID, obtain an electronic pen connection record from the memory, determine the type of the electronic pen based on the device ID, and, if the switch information is obtained, determine the operating mode of the electronic pen based on the switch information, and perform a predetermined function based on at least one of the frequency, the electronic pen connection record, the type of the electronic pen, and the operating mode. Claim 2 An electronic device configured such that, in the first paragraph, the instructions stored in the memory are executed by the at least one processor, the electronic device performs a first function when the frequency is a first frequency and blocks touch input of an electronic pen when the frequency is a second frequency. Claim 3 An electronic device configured such that, in the second paragraph, when the instructions stored in the memory are executed by the at least one processor, the electronic device, upon acquiring the second frequency, checks whether it is the first connection based on the electronic pen connection record, and if it is the first connection, displays a graphic UI on one side of the display including a warning message instructing the use of a dedicated pen. Claim 4 An electronic device configured such that, in the second paragraph, when the instructions stored in the memory are executed by the at least one processor, the electronic device determines the electronic pen as either a first electronic pen or a second electronic pen based on the device ID, and displays a graphic UI on one side of the display that includes a warning message instructing the user to use a dedicated pen if the electronic pen is the second electronic pen. Claim 5 An electronic device configured such that, when the instructions stored in the memory are executed by the at least one processor, the electronic device determines, based on the switch information, the operating mode of the electronic pen as one of a first mode that performs a first function at a first frequency and a second function at a second frequency, or a second mode that performs a second function at a first frequency and a first function at a second frequency. Claim 6 An electronic device configured such that, in the fifth paragraph, when the instructions stored in the memory are executed by the at least one processor, the electronic device has acquired the second frequency and, when the electronic pen is in the first mode, a graphic UI including a warning message instructing the use of a dedicated pen is displayed on one side of the display. Claim 7 An electronic device configured to display a graphic UI on one side of the display, which includes a warning message guiding the electronic device to change the switch when the instructions stored in the memory are executed by the at least one processor, wherein the second frequency is acquired and the electronic pen is in the second mode. Claim 8 An electronic device configured such that, in the first paragraph, when the instructions stored in the memory are executed by the at least one processor, the processor performs a second function when the frequency is a first frequency and performs a first function when the frequency is a second frequency. Claim 9 An electronic device configured such that, when the instructions stored in the memory are executed by the at least one processor, the electronic device, when a first frequency is acquired, checks whether it is the first connection based on the electronic pen connection record, and if it is not the first connection, displays a graphic UI including a warning message based on at least one of the type of electronic pen and switch information on one side of the display. Claim 10 In claim 9, the instructions stored in the memory are configured such that, when executed by the at least one processor, the electronic device is configured not to display the graphic UI again until a reference time has elapsed from the time the graphic UI was last displayed. Claim 11 In claim 9, the instructions stored in the memory are configured such that when executed by the at least one processor, the electronic device is configured to display the graphic UI only once while the communication connection established with the electronic pen is maintained. Claim 12 An electronic device according to claim 1, wherein the electronic device further comprises a pressure sensor, and the instructions stored in the memory, when executed by the at least one processor, are configured to cause the electronic device to obtain the touch pressure of the electronic pen on the display from the pressure sensor and to display a graphic UI including a warning message on one side of the display when the touch pressure exceeds a reference pressure. Claim 13 An electronic device configured such that, in the first paragraph, the instructions stored in the memory are executed by the at least one processor, the electronic device receives a touch input of an electronic pen for the display and stores touch information including the input coordinates of the touch input in the memory. Claim 14 A method for operating an electronic pen of an electronic device, comprising: an operation of detecting a pen event for a display and acquiring a frequency; an operation of establishing a communication connection with the electronic pen using a communication module and acquiring at least one of switch information including information on the operation mode of the electronic pen and a device ID based on switch toggle information of the electronic pen; an operation of acquiring an electronic pen connection record from memory; an operation of determining the type of the electronic pen based on the device ID; an operation of determining the operation mode of the electronic pen based on the switch information when the switch information is acquired; and an operation of performing a predetermined function based on at least one of the frequency, the electronic pen connection record, the type of the electronic pen, and the operation mode. Claim 15 In claim 14, the operation of performing the above-determined function further includes an operation of performing a first function when the frequency is a first frequency, and an operation of blocking touch input of an electronic pen when the frequency is a second frequency. Claim 16 In claim 15, the operation of performing the above-determined function further includes the operation of determining the electronic pen as either a first electronic pen or a second electronic pen based on the device ID, and the operation of displaying a graphic UI on one side of the display that includes a warning message instructing the user to use a dedicated pen when the electronic pen is the second electronic pen. Claim 17 In claim 15, the operation of performing the above-determined function further includes an operation of determining the operation mode of the electronic pen based on the switch information as one of a first mode that performs a first function at a first frequency and a second function at a second frequency, or a second mode that performs a second function at a first frequency and a first function at a second frequency. Claim 18 In claim 17, the operation of performing the above-determined function further includes the operation of displaying a graphic UI on one side of the display that includes a warning message instructing the use of a dedicated pen when the second frequency is acquired and the electronic pen is in the first mode. Claim 19 In claim 14, the operation for performing the above-determined function further comprises an operation for performing a second function when the frequency is a first frequency, and an operation for performing a first function when the frequency is a second frequency. Claim 20 In claim 19, the operation of performing the above-determined function further includes, when a first frequency is acquired, an operation of checking whether it is the first connection based on the electronic pen connection record, and when it is not the first connection, an operation of displaying a graphic UI including a warning message based on at least one of the type of electronic pen and switch information on one side of the display.
Citation Information
Patent Citations
Picture display device and picture operation method of the same
JP2013242821A
System and method for switching mode of electronic pen
KR1020150025696A
Digital Pen, Touch System, and Method for providing information thereof
KR1020160120969A
Electronic apparatus including digiter pen
KR1020200013548A