Electronic device for controlling screen attributes based on distance between pen input device and electronic device and method for controlling the same

Abstract

An electronic device and method are provided to control screen properties based on a distance between the electronic device and a pen input device. The electronic device includes: a camera, a touch screen display, and a processor, the processor being configured to display a screen including at least one target object image corresponding to at least one object obtained by the camera on the touch screen display, and to change the properties of the screen based on resizing of the at least one target object image according to movement of at least one of the electronic device or the object.

Description

Technical Field

[0001] The present disclosure generally relates to an electronic device and method for controlling screen properties based on a distance between a pen input device and the electronic device. Background Art

[0002] More services and additional functions are being provided through electronic devices, such as smart phones or other portable electronic devices. In order to meet the needs of various users and improve the efficiency of using electronic devices, communication service operators and device manufacturers are competing to develop electronic devices with diverse functions. Therefore, the functions provided by electronic devices are evolving rapidly. Summary of the invention

[0003] Technical issues

[0004] Due to their limited size, portable electronic devices (e.g., smartphones) may display screens with limited-size graphical objects (e.g., a capture button of a camera application.) This size limitation, compromised for portability, may cause discomfort to smartphone users when using their devices when the smartphone is placed relatively far away from the user (or if the user is holding a pen input device).

[0005] Solution

[0006] The present disclosure has been made to address the above-mentioned problems and disadvantages, and to provide at least the advantages described below.

[0007] According to aspects of the present disclosure, an electronic device includes: a camera, a touch screen display, and a processor, wherein the processor is configured to display a screen including at least one target object image corresponding to at least one object obtained by the camera on the touch screen display, and change the properties of the screen based on resizing of the at least one target object image according to movement of at least one of the electronic device or the object.

[0008] According to another aspect of the present disclosure, a method for controlling an electronic device includes: displaying a screen including at least one target object image corresponding to at least one object obtained by a camera of the electronic device on a touch screen display of the electronic device, and changing properties of the screen based on resizing of the at least one target object image according to movement of at least one of the electronic device or the object.

[0009] According to another aspect of the present disclosure, an electronic device includes: a camera, a touch screen display, and a processor, wherein the processor is configured to display a screen including at least one target object image corresponding to at least one object obtained by the camera on the touch screen display, and change the properties of the screen based on at least one of the strengths of a signal received from a wireless external electronic device connected to the electronic device, or based on resizing of the at least one target object image according to movement of at least one of the electronic device or the object.

[0010] Advantageous Effects of the Invention

[0011] According to various embodiments of the present disclosure, screen properties (e.g., the size of graphic objects) of an application (e.g., a camera application) can be controlled based on the distance between the electronic device and the pen input device (or a user holding the pen input device), thereby providing visual convenience to the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent through the following description in conjunction with the accompanying drawings, in which:

[0013] Figure 1 is a diagram showing an electronic device in a network environment according to an embodiment;

[0014] Figure 2 is a view showing an electronic device including a pen input device according to an embodiment;

[0015] Figure 3 is a view showing a pen input device according to an embodiment;

[0016] Figure 4 is a view showing an electronic device according to an embodiment;

[0017] Figure 5 is an exploded perspective view showing a pen input device according to an embodiment;

[0018] Figure 6 is a view showing an electronic device according to an embodiment;

[0019] Figure 7 is a view showing a pen input device according to an embodiment;

[0020] Figure 8 is a flowchart illustrating a method of operating an electronic device according to an embodiment;

[0021] Figure 9a , Figure 9b , Fig.9c , Figure 9d , Fig.9e , Figure 9f, Figure 9g , Figure 9h , Figure 9i , Figure 9j , Figure 9k and Figure 9l is a view illustrating an operation of controlling an execution screen (eg, a preview screen) of a camera application depending on a distance between an electronic device and a pen input device according to various embodiments;

[0022] Fig.10a and Fig.10b is a view illustrating an operation of controlling an execution screen (eg, a preview screen) of a camera application depending on a distance between an electronic device and a user when recording a video according to various embodiments;

[0023] Fig.11 is a flowchart illustrating a method of operating an electronic device according to an embodiment;

[0024] Fig.12a , Figure 12b and Fig.12c is a view showing an operation of outputting a capture notification sound of a specified magnitude depending on a change in the distance between an electronic device and a user (or a pen input device) according to various embodiments;

[0025] Fig.13 is a flowchart illustrating a method of operating an electronic device according to an embodiment;

[0026] Fig.14a and Fig.14b is a view illustrating an operation of outputting a designated visual effect on an execution screen (eg, a preview screen) of a camera application when an object (or a target object) is captured by a pen input device according to various embodiments;

[0027] Fig.15 is a flowchart illustrating a method of operating an electronic device according to an embodiment;

[0028] Fig.16a , Fig.16b , Fig.16c , Fig.16d , Fig.16e , Fig.16f and Figure 16g is a view illustrating an operation of an electronic device to control an execution screen (eg, a preview screen) of a camera application depending on a distance between the electronic device and a pen input device according to various embodiments; and

[0029] Fig.17 and Fig.18 is a flowchart illustrating a method of operating an electronic device according to various embodiments. DETAILED DESCRIPTION

[0030] Various embodiments of the present disclosure are described with reference to the accompanying drawings. However, the various embodiments of the present disclosure are not limited to specific embodiments, and it should be understood that various modifications, equivalents and / or substitutions may be made to the embodiments described herein. With respect to the description of the accompanying drawings, similar components may be marked with similar reference numerals.

[0031] Figure 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to an embodiment.

[0032] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit.For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented to be embedded in the display device 160 (eg, a display).

[0033] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may load a command or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be specifically used for a specified function. The auxiliary processor 123 may be implemented separately from the main processor 121 , or as part of the main processor 121 .

[0034] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 (not the main processor 121), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123.

[0035] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

[0036] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0037] The input device 150 may receive commands or data from outside the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101 (e.g., the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).

[0038] The sound output device 155 can output a sound signal to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records, and the receiver can be used for incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as a part of the speaker.

[0039] The display device 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display device 160 may include a touch circuit adapted to detect a touch or a sensor circuit (e.g., a pressure sensor) adapted to measure the strength of a force caused by a touch.

[0040] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0041] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0042] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0043] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0044] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0045] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0046] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0047] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0048] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0049] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiating element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a PCB). According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as a part of the antenna module 197.

[0050] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0051] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 and the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute the requested at least part of the function or service, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.

[0052] According to an embodiment, the electronic device provides visual convenience to the user by controlling properties (e.g., the size of the graphic objects displayed on the execution screen) of an application (e.g., a camera application) based on the distance between the electronic device and a pen input device (e.g., a user holding the pen input device) (e.g., a preview screen including various graphic objects related to image capture and a preview image).

[0053] According to an embodiment, a method of controlling an electronic device provides visual convenience to a user by controlling a property of an execution screen of an application based on a distance between the electronic device and a pen input device.

[0054] The “execution screen”, “preview screen” or “screen” may include various graphic objects (eg, icons) and at least one or more images.

[0055] Figure 2 is a perspective view 200 showing an electronic device 101 having a pen input device 201 according to an embodiment.

[0056] refer to Figure 2 , the electronic device 101 has a structure for allowing a pen input device 201 to be inserted therein. The electronic device 101 includes a housing 110, and has a hole 111 in a portion (e.g., a side portion) of the housing. The electronic device 101 includes a housing space 112 connected to the hole 111, and the pen input device 201 can be inserted into the housing space 112. One end of the pen input device 201 has a pressable button 201a to be easily pulled out from the housing space 112 of the electronic device 101. When the button 201a is pressed, a pop-up mechanism (e.g., at least one spring) configured in association with the button 201a can be operated to allow the pen input device 201 to be removed from the housing space 112.

[0057] Figure 3 is a view showing a pen input device 201 according to an embodiment.

[0058] refer to Figure 3 , the pen input device 201 includes a processor 320, a memory 330, a resonant circuit 387, a charging circuit 388, a battery 389, a communication circuit 390, an antenna 397 and / or a trigger circuit 398. The processor 320, at least a portion of the resonant circuit 387 and / or at least a portion of the communication circuit 390 of the pen input device 201 may be configured in the form of a chip or configured on a printed circuit board. The processor 320, the resonant circuit 387 and / or the communication circuit 390 may be electrically connected to the memory 330, the charging circuit 388, the battery 389, the antenna 397 or the trigger circuit 398. The pen input device 201 may include only the resonant circuit and the button.

[0059] The processor 320 may include a custom hardware module or a general-purpose processor configured to execute software (e.g., an application). The processor may include a hardware component (function) or a software element (program), which includes at least one of the following: a communication module or a module for managing the state or environment of the pen input device 201, an input / output interface, a data measurement module, and various sensors provided in the pen input device 201. The processor 320 may include, for example, one of hardware, software, or firmware, or a combination of two or more of hardware, software, or firmware. The processor 320 may receive a proximity signal corresponding to an electromagnetic signal generated from a digitizer (e.g., an electromagnetic induction panel 490) of the electronic device 101 through a resonant circuit 387. When a proximity signal is recognized, the processor 320 may control the resonant circuit 387 to send an electromagnetic resonance (EMR) input signal to the electronic device 101.

[0060] The memory 330 may store information related to the operation of the pen input device 201. For example, the information may include information for communicating with the electronic device 101 and frequency information related to the input operation of the pen input device 201.

[0061] The resonant circuit 387 may include at least one of a coil, an inductor, or a capacitor. The resonant circuit 387 may be used for the pen input device 201 to generate a signal having a resonant frequency. For example, in order to generate a signal, the pen input device 201 may use at least one of an EMR scheme, an active electrostatic (AES) scheme, or an electrically coupled resonance (ECR) scheme. When the pen input device 201 sends a signal via the EMR scheme, the pen input device 201 may generate a signal having a resonant frequency based on an electromagnetic field generated from the sensing panel of the electronic device 101. When the pen input device 201 sends a signal via the AES scheme, the pen input device 201 may generate a signal using capacitive coupling with the electronic device 101. When the pen input device 201 sends a signal via the ECR scheme, the pen input device 201 may generate a signal having a resonant frequency based on an electric field generated from a capacitive device of the electronic device. The resonant circuit 387 may be used to change the frequency or strength of the electromagnetic field according to the user's manipulation state. For example, the resonant circuit 387 may provide a frequency for identifying a hover input, a drawing input, a button input, or an erase input.

[0062] When connected with the resonance circuit 387 based on the switching circuit, the charging circuit 388 may rectify the resonance signal generated from the resonance circuit 387 into a direct current (DC) signal and provide the DC signal to the battery 389. The pen input device 201 may recognize whether the pen input device 201 is inserted into the electronic device 101 using the voltage level of the DC signal sensed by the charging circuit 388.

[0063] The battery 389 may be configured to store power required for the operation of the pen input device 201. The battery 389 may include a lithium-ion battery or a capacitor and may be recharged or replaced. The battery 389 may be charged using power received from the charging circuit 388 (e.g., a DC signal for DC power).

[0064] The communication circuit 390 may be configured to perform wireless communication between the pen input device 201 and the communication module 190 of the electronic device 101. The communication circuit 390 may use a short-range communication scheme to transmit input information and state information about the pen input device 201 to the electronic device 101. For example, the communication circuit 390 may transmit direction information (e.g., motion sensor data) about the pen input device 201 obtained through the trigger circuit 398, voice information input through the microphone, or remaining power information about the battery 389 to the electronic device 101. The short-range communication scheme may include at least one of Bluetooth Low Energy (BLE) communication or communication over a wireless local area network (WLAN).

[0065] The antenna 397 may be used to transmit a signal or power to the outside (e.g., to the electronic device 101), or to receive a signal or power from the outside. The pen input device 201 may include a plurality of antennas, and at least one antenna 397 suitable for a communication scheme may be selected from the plurality of antennas. The communication circuit 390 may exchange a signal or power with an external electronic device through at least one selected antenna 397.

[0066] The trigger circuit 398 may include at least one button or sensor circuit. The processor 320 may determine the input scheme (e.g., touch or press) or type (e.g., EMR button or BLE button) of the button of the pen input device 201. The sensor circuit may generate an electrical signal or data value corresponding to the internal operating state or external environmental state of the pen input device 201. The sensor circuit may include at least one of a motion sensor, a remaining battery sensor, a pressure sensor, a light sensor, a temperature sensor, a geomagnetic sensor, or a biometric sensor. The trigger circuit 398 may send a trigger signal to the electronic device 101 using a signal through the sensor or a button input signal.

[0067] Figure 4 is a view showing an electronic device 101 according to an embodiment.

[0068] refer to Figure 4 , the electronic device 101 includes a side frame structure 410, a first supporting member 411 (e.g., a bracket), a front plate 420, a display 430, an electromagnetic induction panel 490, a printed circuit board (PCB) 440, a battery 450, a second supporting member 460 (e.g., a rear case), an antenna 470, a pen input device 201, and a rear plate 480. The electronic device 101 may exclude at least one of the components (e.g., the first supporting member 411 or the second supporting member 460), or may add other components.

[0069] The electromagnetic induction panel 490 (e.g., a digitizer) can detect the input of the pen input device 201. The electromagnetic induction panel 490 may include a flexible printed circuit board (FPCB) and a shielding sheet. The shielding sheet may prevent inter-component interference caused by an electromagnetic field generated from a component (e.g., a display module, a PCB, or an electromagnetic induction panel) included in the electronic device 101. The shielding sheet may shield the electromagnetic field generated from the component, thereby allowing the input from the pen input device 201 to be accurately transmitted to the coil included in the electromagnetic induction panel 490. The electromagnetic induction panel 490 may include an opening formed in at least a portion corresponding to a biometric sensor embedded in the electronic device 101.

[0070] The first support member 411 may be arranged inside the electronic device 101 to be connected to the side frame structure 410 or integrated with the side frame structure 410. The first support member 411 may be formed of a metal and / or non-metal material (e.g., a polymer). The display 430 may be joined to one surface of the first support member 411, and the PCB 440 may be joined to the opposite surface of the first support member 311. The processor 120, the memory 130, and / or the interface may be mounted on the PCB 440. The processor may include one or more of a central processing unit, an application processor, a graphics processing device, an image signal processor, a sensor hub processor, or a communication processor.

[0071] Memory 130 may include volatile or nonvolatile memory.

[0072] The interface may include a high-definition multimedia interface (HDMI), a USB interface, an SD card interface, and / or an audio interface. The interface may electrically or physically connect the electronic device 101 to an external electronic device, and may include a USB connector, an SD card / multimedia card (MMC) connector, or an audio connector.

[0073] The battery 450 may be a device for supplying power to at least one component of the electronic device 101. The battery 450 may include a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell. At least a portion of the battery 450 may be arranged on a substantially same plane as the PCB 440. The battery 450 may be arranged inside the electronic device 101 integrally or detachably.

[0074] The antenna 470 may be arranged between the back plate 480 and the battery 450. The antenna 470 may include a near field communication (NFC) antenna, a wireless charging antenna, and / or a magnetic secure transmission (MST) antenna. The antenna 470 may perform short-range communication with an external device, or may wirelessly send or receive power required for charging. The antenna structure may be formed by a portion or combination of the side frame structure 410 and / or the first support member 411.

[0075] Figure 5 is an exploded perspective view 500 of the pen input device 201 according to an embodiment.

[0076] refer to Figure 5 , the pen input device 201 includes a pen housing 500-1 forming the appearance of the pen input device 201 and an inner assembly inside the pen housing 500-1. The inner assembly may include all of several parts installed inside the pen and may be inserted into the pen housing 500-1 through a single assembly operation.

[0077] The pen housing 500-1 includes an elongated accommodation space 501 between a first end 500a and a second end 500b. The cross section of the pen housing 500-1 may be shaped as an ellipse having a longer axis and a shorter axis, and may be shaped as an elliptical cylinder as a whole. Corresponding to the shape of the pen housing 500-1, the accommodation space 112 of the electronic device 101 may also have an elliptical cross section. The pen housing 500-1 may include a synthetic resin (e.g., plastic) and / or a metal (e.g., aluminum). The second end 500b of the pen housing 500-1 may be formed of a synthetic resin.

[0078] The internal component may be elongated corresponding to the shape of the pen housing 500-1. The internal component may be roughly divided into three parts along the length direction. For example, the internal component may include: an ejection member 510, arranged in a position corresponding to the first end 500a of the pen housing 500-1; a coil part 520, arranged in a position corresponding to the second end 500b of the pen housing 500-1; and a circuit board part 530, arranged in a position corresponding to the body of the housing.

[0079] The ejection member 510 may include a configuration for pulling the pen input device 201 out of the accommodation space 112 of the electronic device 101. The ejection member 510 includes a shaft 511, an ejection body 512 arranged around the shaft 511 to form the overall appearance of the ejection member 510, and a button part 513. When the internal components are fully inserted into the pen housing 500-1, the portion including the shaft 511 and the ejection body 512 may be surrounded by the first end 500a of the pen housing 500-1, and the button part 513 may be exposed to the outside of the first end 500a. A plurality of parts, for example, a cam member or an elastic member, may be arranged in the ejection body 512 to form a push-pull structure. The button part 513 may be substantially coupled with the shaft 511 to move back and forth linearly along the ejection body 512. The button part 513 may include a button with a jam to allow the user to pull out the pen input device 201 with his or her fingernails. The pen input device 201 may include a sensor to detect the linear movement of the shaft 511, thereby providing another input scheme.

[0080] The coil part 520 may include: a pen tip 521, which is exposed to the outside of the second end 500b when the internal components are fully inserted into the pen housing 500-1; a packing ring 522; a coil 523 wound multiple times; and / or a pen pressure sensor 524 for obtaining a change in pressure when pressure is applied to the pen tip 521. The packing ring 522 may include epoxy resin, rubber, urethane, or silicone resin, and may be provided for waterproof or dustproof purposes to protect the coil part 520 and the circuit board part 530 from contact with water or dust. The coil 523 may form a resonant frequency within a preset frequency band (e.g., 500kHz), and may be combined with at least one device (e.g., a capacitor) to adjust the resonant frequency generated by the coil 523 within a predetermined range.

[0081] The circuit board part 530 includes a PCB 532, a substrate 531 surrounding at least one surface of the PCB 532, and an antenna. A board seating part 533 may be formed on the top of the substrate 531 to allow the PCB 532 to rest, and the PCB 532 may be seated and fastened on the board seating part 533. The PCB 532 may include a top surface and a bottom surface. A variable capacitor or switch 534 may be arranged on the top surface of the PCB 532, and a charging circuit, a battery 536, or a communication circuit may be arranged on the bottom surface of the PCB 532. The battery 536 may include an electric double layer capacitor (EDLC). The charging circuit may be placed between the coil 523 and the battery 389, and may include a voltage detector circuit and a rectifier.

[0082] Antennas may include Figure 5 The antenna structure 539 shown and / or the antenna embedded in the PCB 532. A switch 534 may be provided on the PCB 532. A side button 537 provided to the pen input device 201 may be used to press the switch 534, and may be exposed to the outside through the side opening 502 of the pen housing 500-1. The side button 537 may be supported by a support member 538, and if no external force is applied to the side button 537, the support member 538 may provide an elastic restoring force to allow the side button 537 to remain in or return to a predetermined position.

[0083] The circuit board part 530 may include another sealing ring, such as an O-ring. For example, an O-ring may be arranged at both ends of the base 531, thereby forming a sealing structure between the base 531 and the pen housing 500-1. The support member 538 may be partially in close contact with the inner wall of the pen housing 500-1 around the side opening 502, thereby forming a sealing structure. The circuit board part 530 may also form a waterproof and dustproof structure similar to the sealing ring 522 of the coil part 520.

[0084] The pen input device 201 includes a board seating part 535 on the top surface of the base 531 to allow a battery 536 to be seated thereon. The battery 536 mountable on the board seating part 535 may include a cylindrical type battery.

[0085] The pen input device 201 may include a microphone directly connected to the PCB 532 or an FPCB connected to the PCB 532. The microphone may be arranged in a position parallel to the side button 537 along a longer direction of the pen input device 201.

[0086] Figure 6 is a view showing an electronic device 101 according to an embodiment.

[0087] refer to Figure 6 The electronic device 101 includes a window 601, a display component 602, an electromagnetic induction panel 490 (e.g., a digitizer), a first short-range communication controller 604 (e.g., a wireless communication module 192), a first antenna 605 (e.g., an antenna module 197), a digitizer controller 603, a detection coil and at least one of the processor 120.

[0088] The window 601 may be formed of a material (eg, glass) that protects the display assembly 602 from external impacts. The window 601 may be coupled (eg, attached) to the display assembly 602 in the form of covering the entire area of ​​the display assembly 602 .

[0089] The display component 602 can visually provide information to the outside of the electronic device 101 (e.g., to a user). The display component 602 may include a display, a hologram device, a projector, and a control circuit that controls the device. The display component 602 may include a touch circuit adapted to detect a touch, or a sensor circuit (e.g., a pressure sensor) adapted to measure the strength of the force caused by the touch.

[0090] The electromagnetic sensing panel 490 may output a signal (eg, an electromagnetic field) to identify a pen input device (eg, Figure 4 The position of the pen input device 201).

[0091] The first short-range communication controller 604 can send and receive signals to form a wireless communication connection with a wireless communication module of an external electronic device, and attempt to establish a wireless communication (e.g., short-range communication) connection with the external electronic device. The first short-range communication controller 604 can use the wireless communication connection to perform communication with an external electronic device (e.g., Figure 4 The short-range communication may include wireless fidelity (Wi-Fi), Wi-Fi direct, Bluetooth, BLE, or NFC.

[0092] The first antenna 605 may be operably connected to the first short-range communication controller 604, and may transmit a signal received from the first short-range communication controller 604 to an external electronic device. The first antenna 605 may receive a signal from the external electronic device.

[0093] The digitizer controller 603 may be operably connected to the electromagnetic induction panel 490, the detection coil, or the processor 120. The digitizer controller 603 may send a detection signal to the coil 523 of the external electronic device using the detection coil. The digitizer controller 603 may send a detection signal by using the detection coil to generate a magnetic field that varies over time to generate (or induce) an electromagnetic force (or an induced current) at the coil 523 of the external electronic device. The detection signal may be an electromagnetic field signal having a specified frequency to identify whether the external electronic device is placed on the touch screen or is housed in the internal space of the electronic device 101 (e.g., Figure 2 The digitizer controller 603 may receive a response signal from the coil 523 of the external electronic device using a detection coil. By changes in the magnetic field from the external electronic device, an induced current may be generated (or induced) at or around the detection coil. Therefore, the digitizer controller 603 may receive a response signal. The electronic device (e.g., the processor 120 or the digitizer controller 603) may identify the position of the external electronic device relative to the electronic device 101 based on the response signal. For example, the electronic device 101 may include a detection coil inside the electromagnetic induction panel 490 and in each of the internal spaces of the electronic device 101.

[0094] The electronic device (e.g., the processor 120 or the digitizer controller 603) may identify the position of the pen input device based on whether the induced current is generated from at least one of the detection coils included in the interior of the electromagnetic induction panel 490 or the detection coils included in the internal space. The electronic device may determine whether the pen input device 201 is placed on the display (e.g., the pen input device 201 contacts the display device 160 or is placed close to the display device 160) or inserted into the internal space of the electronic device 101 based on the position of the detection coil that generates (or induces) the induced (or generated) current by the magnetic field from the pen input device (e.g., the coil). When the induced current is not generated from the detection coils included in the interior and the detection coils included in the electromagnetic induction panel 490 or the induced current generated therefrom has an intensity less than a preset intensity (i.e., an intensity threshold), the electronic device (e.g., Figure 1 The processor 120 or the digitizer controller 603 of the electronic device 101 can determine that the pen input device is placed a specified distance or farther from the electronic device 101.

[0095] The digitizer controller 603 may use the detection coil to wirelessly transmit power to the external electronic device. For example, the digitizer controller 603 may use the detection coil to generate (or induce) an induced current at the coil 523 of the external electronic device to wirelessly transmit power to the external electronic device.

[0096] The detection coil may be operably connected to the digital converter controller 603 or the electromagnetic induction panel 490. The detection coil may generate a current (e.g., a detection signal or a detection signal for an external electronic device (e.g., Figure 7 The detection coil may transmit a current (eg, a response signal) induced and generated by a magnetic field generated by the coil 523 of the external electronic device to the digital converter controller 603.

[0097] The processor 120 may be operably connected to the digitizer controller 603 or the first short-range communication controller 604, and may control components included in the electronic device 101 or monitor the status of the components. The processor 120 may control the electromagnetic induction panel 490 provided adjacent to the display device 160 through the digitizer controller 603, and obtain information from an external electronic device (e.g., Figure 4 The pen input device 201 or Figure 1The digitizer controller 603 may include an independent control circuit to be able to control the processing time of the electric signal input to or output from the electromagnetic induction panel 490 without the control of the processor 120. The processor 120 may control the electronic device 101 to use the detection coil to send an electric or magnetic signal to an external electronic device, or to receive an electric or magnetic signal from an external electronic device. The processor 120 may use the signal received from the pen input device 201 to determine the position information about the pen input device 201 (for example, the state of the pen input device 201 being inserted into the internal space of the electronic device 101, or contacting the display device 160 or being placed close to the display device 160), or the state information about the pen input device 201 (for example, the remaining battery information or connection state information about the pen input device 201). The processor 120 may provide power to the pen input device 201 based on the position information about the pen input device 201. The processor 120 may display battery information or connection status information about the pen input device 201 on the display device 160 based on the status information about the pen input device 201. The processor 120 may control the first short-range communication controller 604 to communicate with the pen input device (eg, Figure 7 When the pen input device 201 is inserted into the internal space, the processor 120 may use the digitizer controller 603 to repeatedly supply power to the pen input device 201 during a first specified time (e.g., 9 seconds) and stop supplying power during a second specified time (e.g., 1 second).

[0098] Figure 7 700 is a view showing the pen input device 201 according to an embodiment.

[0099] refer to Figure 7 The pen input device 201 includes a coil 523, a variable capacitor circuit 701, a button switch 702, a rectifier 703, a first voltage detector 704, a charging switch 705, a battery 706, a second voltage detector 707, a second antenna 708, and a second short-range communication controller 709 (for example, Figure 3 communication circuit 390), start switch 710 or at least one of OR gate 711.

[0100] The coil 523 may be connected to be able to operate with the variable capacitor circuit 701. The coil 523 may generate a current (eg, a detection signal or a signal to an external electronic device (eg, Figure 4 The current charged by the pen input device 201) is transmitted to the variable capacitor circuit 701.

[0101] The variable capacitor circuit 701 may be a circuit that may have variable capacitance and may include at least one of one or more capacitors, one or more transistors, one or more input / output ports, or a logic circuit.

[0102] The button switch 702 may be operably connected to at least one of the rectifier 703 or the OR gate 711. The button switch 702 may be provided in the pen input device 201 as a button (eg, Figure 5 The switch 534 of the pen input device 201 is pressed or touched and is shorted or disconnected. When the button switch 702 is shorted due to pressing the button, the node or gate connected to the capacitor C2 can be grounded. When the button switch 702 is disconnected due to pressing the release button, the capacitor C2 can be connected in series with the OR gate. This may result in a difference in the resonant frequency of the resonant circuit 387 formed by the coil 523 and the capacitor connected between when the button is pressed and when the button is not pressed. The electronic device 101 can determine whether the button of the pen input device 201 is pressed by identifying the frequency of the signal generated from the resonant circuit 387 of the pen input device 201.

[0103] The rectifier 703 may be operably connected to at least one of the push button switch 702, the first voltage detector 704, or the charging switch 705. The rectifier 703 may rectify the alternating current (AC) power received from the electronic device 101, and convert the current from the coil 523 into DC power and transmit the DC power to at least one of the first voltage detector 704 or the charging switch 705.

[0104] The first voltage detector 704 may be operably connected to at least one of the rectifier 703, the charging switch 705, the second short-range communication controller 709, or the OR gate 711. The first voltage detector 704 may detect a voltage value on a path connecting the rectifier 703 and the second short-range communication controller 709. The first voltage detector 704 may detect whether the amplitude of the detected voltage belongs to a specified range based on the amplitude of the detected voltage value. The specified range may be divided into a specific range, for example, from 1.5V to 3.5V (level 1 range) or a range not less than 3.5V (level 2 range). For example, when the amplitude of the detected voltage belongs to the level 2 range, it may indicate that the pen input device 201 is inserted into the internal space of the electronic device 101. When the amplitude of the detected voltage belongs to the level 1 range, it may indicate that the pen input device 201 is being used (e.g., touched) by the user on the display device 160 of the electronic device 101. When the magnitude of the detected voltage belongs to the level 2 range, the first voltage detector 704 may apply an enable signal to the charging switch 705 to turn on the charging switch 705 to allow the charging signal sent from the rectifier 703 to be applied to the battery 706. When the magnitude of the detected voltage belongs to the level 1 range, the first voltage detector 704 may control the charging switch 705 to be turned off or remain open. The first voltage detector 704 may transfer DC power from the rectifier 703 to the charging switch 705.

[0105] When the magnitude of the detected voltage belongs to the level 2 range, the first voltage detector 704 may apply an enable signal to the second short-range communication controller 709. In this case, the second short-range communication controller 709 may send a wireless signal (e.g., an advertising signal or a message) to the first short-range communication controller 604 of the electronic device. When the magnitude of the detected voltage belongs to the level 1 range, the first voltage detector 704 may not apply an enable signal to the second short-range communication controller 709. The enable signal may be the same type or a different type from the enable signal applied by the first voltage detector 704 to the charging switch 705.

[0106] The first voltage detector 704 may include a wire between the first voltage detector 704 and the second short-range communication controller 709 to transmit a signal related to the above-mentioned state of the pen input device (e.g., a state in which the stylus pen is inserted into the internal space of the electronic device 101 by the user or touches the display device 160 of the electronic device 101) to the second short-range communication controller 709. The charging switch 705 may be connected to the second short-range communication controller 709 via a wire, and when the charging switch 705 is turned on, an enable signal is transmitted from the first voltage detector 704 to the second short-range communication controller 709.

[0107] The charging switch 705 may be operably connected to the rectifier 703, the first voltage detector 704, the battery 706, the second voltage detector 707, and the second short-range communication controller 709. The charging switch 705 may be turned on (e.g., short-circuited) or turned off (e.g., disconnected) based on the strength of the voltage detected by the first voltage detector 704. When the charging switch 705 is in the on state, the DC power transmitted from the rectifier 703 or the first voltage detector 704 may be applied to the battery 706 or the second voltage detector 707. In this case, the second short-range communication controller 709 may determine that the pen input device 201 is in a state of being charged by the electronic device 101. When the charging switch 705 is in the off state, the DC power transmitted from the rectifier 703 or the first voltage detector 704 may not be applied to the battery 706 or the second voltage detector 707. In this case, the second short-range communication controller 709 may determine that the pen input device 201 is in a non-charging state. The non-charging state may mean a state in which the pen input device 201 is not inserted into the internal space of the electronic device 101 and thus does not receive AC power from the electronic device 101 (eg, the coil 523 of the electronic device 101 ).

[0108] The second voltage detector 707 may be connected to be able to operate with at least one of the charging switch 705, the battery 706, or the start switch 710. The second voltage detector 707 may detect a voltage value output from the battery 706. The start switch 710 may be short-circuited based on the magnitude of the voltage value detected by the second voltage detector 707. In this case, the second short-range communication controller 709 may be started. "Start" may mean a cold start, which is performed when the voltage value detected by the second voltage detector 707 is greater than a specified value (e.g., 2.4V).

[0109] The second short-range communication controller 709 may establish a short-range communication (e.g., BLE) connection with the electronic device 101. The second short-range communication controller 709 may perform pairing with the electronic device 101 using a short-range wireless communication scheme such as BLE. The second short-range communication controller 709 may transmit status information about the battery 706 to the paired electronic device 101. The second short-range communication controller 709 may transmit and receive signals with the paired electronic device 101 to control the pen input device 201 or at least one component included in the electronic device 101.

[0110] The OR gate 711 may generate a signal to ignore a button input by a user or to execute an application on the electronic device 101 using short range communication based on the voltage value detected by the first voltage detector 704. The OR gate 711 may transmit the signal to the second short range communication controller 709.

[0111] The electronic device 101 can perform various functions, such as taking pictures, switching between a front camera capture mode and a rear camera capture mode, and running a camera application based on a signal sent from a pen input device 201 connected to the electronic device 101 via short-range wireless communication. For example, when a single press on the button part 201a or the side button 537 is recognized while the camera application is running, the electronic device 101 can capture an object being displayed on an execution screen (e.g., a preview screen) of the camera application. In the following example, a preview screen including various graphic objects related to the captured object and a preview image corresponding to the object is described as an execution screen of the camera application. The size of the preview screen can be substantially the same as the size of the display device 160.

[0112] When a double press of the button part 201a or the side button 537 is recognized when the camera application is running, the electronic device 101 can switch between the front camera capture mode and the rear camera capture mode. When a long press of the button part 201a or the side button 537 is recognized when the camera application is not running, the electronic device 101 can execute the camera application. When a single press of the button part 201a or the side button 537 is recognized when recording a video, the electronic device 101 can temporarily stop or terminate the video recording. When a single press of the button part 201a or the side button 537 is recognized when the camera application is running, the electronic device 101 can recognize the log information about the camera application and execute the function most frequently used during the specified period. The user can change (e.g., reset) the various functions or operations performed by a single press, double press, and long press.

[0113] Figure 8 is a flow chart illustrating a method 800 of operating an electronic device 101 according to an embodiment.

[0114] refer to Figure 8 , step 810, a method of operating the electronic device 101 (eg, by operating Figure 1 The processor 120 of the electronic device 101 uses the display device 160 to display a preview screen including at least one target object image. The at least one target object image may include an image of a user of the electronic device 101 holding the pen input device. The user may hold or carry the pen input device 201. The user of the electronic device 101 may use the camera module 180 on the front surface of the electronic device 101 (i.e., the portion that exposes at least a portion of the display device 160) to take a selfie. The user of the electronic device 101 may use the camera module 180 on the rear surface of the electronic device 101 (i.e., the surface facing away from the front surface) to capture an object.

[0115] In step 820, the electronic device 101 (including Figure 1The electronic device 101 may determine whether to resize the at least one target object image based on how much at least a portion of the target object image (eg, the user's face) is resized.

[0116] When it is identified that at least one target object image is resized (Yes in step 820), the electronic device 101 changes the properties of the preview screen in step 830. When it is identified that at least one target object image is not resized (No in step 820), the electronic device 101 may continue to display the current preview screen without changing the properties of the preview screen.

[0117] Figures 9a to 9l An operation of controlling the preview screen 910 of the camera application depending on the distance between the electronic device 101 and the pen input device (or a user holding the pen input device) according to an embodiment is shown.

[0118] refer to Figure 9a, the electronic device 101 displays a preview screen 910 on the display device 160. The preview screen 910 includes at least one of the following: a preview image including a target object image 912, a capture type 914, a video record button 916a, a still image capture button 916b, and a run button 916c for executing a gallery application. The preview image may include an image obtained by a camera and displayed on the display device 160. When a selection input (e.g., a touch input) to the capture button 916b is received from the user or a capture signal is received from a pen input device 201 connected to the electronic device 101 via short-range wireless communication (e.g., BLE), the electronic device 101 may store the preview image (e.g., an image obtained by a camera) included in the preview screen 910 currently being displayed on the electronic device 101 as a captured image. The captured image may mean an image actually stored in the memory of the electronic device 101 according to the capture input of the user. The electronic device 101 may determine the size of the target object image 912, and may determine the resizing of the target object image 912 using the resizing of a portion of the target object image 912 (e.g., the face of the user). The electronic device 101 may set a virtual line 918 on the preview screen 910, and may determine the resizing of the target object image 912 based on the ratio of the area corresponding to the portion of the target object image 912 to the entire preview screen 910. The virtual line 918 and the line 918a indicating the face area may not be displayed on the preview screen 910. The electronic device 101 may store in advance information (e.g., a lookup table) about the correspondence between the distance between the electronic device 101 and the pen input device 201 and the ratio between the area corresponding to the portion of the target object image 912 and the entire preview screen 910. The electronic device 101 may use the stored correspondence information to recognize the actual distance between the electronic device 101 and the pen input device. Figure 9a An example is shown in which buttons 916a, 916b, and 916c and capture type 914 are displayed in default sizes (a and c) on the preview screen 910. Various techniques may be applied to identify the size of a portion of the target object image 912 (eg, the user's face).

[0119] refer to Figure 9b When the preview screen 910 includes a plurality of target object images (a first target object image 912a, a second target object image 912b, and a third target object image 912c), the electronic device 101 may determine whether the reference image has been obtained by considering the size of any one target object image (e.g., the first target object image 912a) that occupies most of the preview screen 910. Figure 9bThe target object image is resized. The electronic device 101 can set any one target object image (e.g., the first target object image 912a) that occupies most of the preview screen at a specific time (e.g., when the target object images for multiple objects are first displayed on the preview screen) as a reference image for determining the resizing of the target object image. The electronic device 101 can determine the resizing of multiple target object images (the first target object image 912a, the second target object image 912b, and the third target object image 912c) based on the resizing of the target object image (e.g., the first target object image 912a) set as the reference image. The electronic device 101 can determine which of the target object images occupies most of the preview screen at each of the multiple times. In other words, the determination of the reference image can be updated by the electronic device 101 at each of the multiple times.

[0120] refer to Fig.9c , when it is recognized that the target object image 912 is reduced, the electronic device 101 may perform control to display the capture button 912b with an increased size b according to a pre-specified ratio. The size b may be larger than the size a (in terms of diameter). When the target object image 912 is reduced, the electronic device 101 may perform display of at least one of the capture types 914 (e.g., AUTO capture type) with an increased size d. The size d may be larger than the size c (in terms of length). When the target object image 912 is reduced, the electronic device 101 may avoid displaying at least one button (e.g., a video record button 916a and a run button 916c) on the preview screen 910. In addition, when the target object image 912 is reduced, the electronic device 101 may avoid displaying other capture types on the preview screen 910 except for the currently set capture type (e.g., AUTO capture type) among the capture types 914. When the ratio of a portion (e.g., a face) of the target object image 912 to the preview screen 910 is a threshold value (e.g., 3.2% of the entire area of ​​the preview screen 910 or the display device 160) or less, the electronic device 101 may determine that the target object image 912 has been reduced. The threshold value may vary, and there may be a plurality of threshold values.

[0121] refer to Figure 9d, when the target object image 912 is enlarged, the electronic device 101 may reduce the size of the buttons 916a, 916b, and 916c to size e. Size e may be smaller than size a (in terms of diameter). When the ratio of a portion (e.g., a face) of the target object image 912 to the preview screen 910 is a threshold value (e.g., 30% of the entire area of ​​the preview screen 910 or the display device 160) or higher, the electronic device 101 may determine that the target object image 912 has been enlarged. The electronic device 101 reduces the currently set capture type 914a to a size smaller than the default size and displays it. Size (e.g., horizontal length) f may be smaller than size c or size d.

[0122] refer to Figure 9e to Figure 9g , the electronic device 101 may perform control to display a visual effect (eg, a border 920 ) corresponding to the resizing of the at least one target object image 912 around the capture button 916 b . Fig.9e An example of displaying a visual effect (eg, chrome 920) having a default size (or area) is shown. The default size may include a pre-specified size.

[0123] like Figure 9f As shown, when at least one target object image 912 is reduced (for example, when the ratio of a portion of at least one target object image 912 to the preview screen 910 is a first threshold value (for example, 10%) or less due to movement of the electronic device 101 or the object), the electronic device 101 may make the area where the visual effect is displayed larger than Fig.9e The visual effect shown is in the area shown. Figure 9g As shown, when at least one target object image 912 is reduced by more than Figure 9f When the ratio of at least one portion of the target object image 912 to the preview screen 910 is a second threshold value (e.g., 3.2%) or less due to the movement of the electronic device 101 or the pen input device 201, the electronic device 101 may perform control so that the area where the visual effect is displayed is larger than Figure 9f The area where the visual effect is displayed is shown. The electronic device 101 can continuously or discretely (e.g., stepwise) change the area where the visual effect is displayed depending on the resizing of the target object image 912 (e.g., the change in the distance between the electronic device and the pen input device 201). The distance between the electronic device 101 and the pen input device 201 can be divided into several ranges, for example, a first range (e.g., 1.5m to 2m), a second range (e.g., 2m to 2.5m), and a third range (e.g., greater than 2.5m). The electronic device 101 can gradually resize the various graphic objects included in the preview screen 910 according to the range and output the various graphic objects included in the preview screen 910 or capture notification sounds.

[0124] refer to Figure 9h to Figure 9j , the electronic device 101 may perform control to display a visual effect (eg, a bar 930 ) corresponding to resizing the at least one target object image 912 at the top of the preview screen 910 . Figure 9h An example of displaying a visual effect (e.g., bar 930) having a default size (or area) is shown. Figure 9i As shown, when at least one target object image 912 is reduced (for example, when the ratio of at least one target object image 912 to the preview screen 910 is a first threshold value (for example, 10%) or less due to the movement of the electronic device 101 or the object), the electronic device 101 may make the visual effect (for example, the bar 930) longer than Figure 9h The visual effect shown. Figure 9j As shown, when at least one target object image 912 is Figure 9i When the ratio is further reduced (for example, when the ratio of at least one target object image 912 to the preview screen 910 is a second threshold value (for example, 3.2%) or less due to the movement of the electronic device 101 or the object), the electronic device 101 may make the visual effect (for example, the bar 930) longer than Figure 9i The electronic device 101 may continuously or discretely (e.g., stepwise) vary the length of the visual effect (e.g., bar 930) depending on at least one resizing of the target object image 912 (e.g., a change in the distance between the electronic device 101 and the pen input device 201).

[0125] refer to Figure 9k to Figure 9l , the electronic device 101 may perform control to display a visual effect (e.g., a designated color 940) corresponding to the resizing of the at least one target object image 912 along the edge of the preview screen 910. The electronic device 101 may display a notification 950 (e.g., a Bluetooth symbol) indicating a state of connection with the pen input device via short-range wireless communication inside the capture button 916b. Figure 9k An example of displaying a visual effect (e.g., a specified color 940) according to a default region is shown. Figure 9l As shown, when at least one target object image 912 is reduced due to the movement of the electronic device 101 or the at least one target object image 912, the electronic device 101 may increase the area in which the visual effect (e.g., the designated color 940) is displayed. The designated color 940 may be blue. Figures 9a to 9l At least some of the described embodiments may be combined together.

[0126] Fig.10a and Fig.10bAn operation of controlling the preview screen 910 of the camera application depending on the distance between the electronic device 101 and the pen input device 201 while recording a video is shown.

[0127] refer to Fig.10a , the electronic device 101 displays a preview screen 910 on the display device 160. The preview screen 910 includes: at least one target object image 912, a button 1012 for pausing video recording, a termination button 1014 for terminating video recording, a mode switching button 1016 for capturing a still image, and a time lapse 1000 from the start time of the video recording. Fig.10a An example is shown in which various objects 1000 , 1012 , 1014 , and 1016 are displayed according to a default setting when the size of a portion of the target object image 912 (eg, the user's face) is smaller than a threshold value.

[0128] refer to Fig.10b , when it is determined that the ratio of a portion of the target object image 912 (e.g., the face of the user) to the preview screen 910 is a threshold value or less, the electronic device 101 may enlarge and display at least one of the following in a pre-specified ratio: a termination button 1014 for terminating video recording and a time lapse 1000 from the start time of video recording. For example, the size g (e.g., diameter) of the termination button 1014 may be smaller than the size h (e.g., diameter). When it is determined that the ratio of a portion of the target object image 912 (e.g., the face of the user) to the preview screen 910 is a predetermined threshold value or less, the electronic device 101 may avoid displaying at least some buttons (e.g., a button 1012 for pausing video recording and a mode switching button 1016 for capturing a still image).

[0129] Fig.11 is a flow chart illustrating a method 1100 of operating an electronic device 101 according to an embodiment.

[0130] refer to Fig.11 In step 1110, the electronic device 101 displays a preview screen including at least one target object image. The preview screen may include a preview screen for capturing a still image or a video.

[0131] In step 1120, the electronic device 101 (including Figure 1 The processor 120 of the electronic device 101 identifies that at least one target object image has been resized. The distance between the electronic device 101 and the object (or the pen input device 201 held by the object (i.e., person)) can be determined based on the degree of resizing of the at least one target object image. The electronic device 101 can determine that the target object image 912 has been resized based on the resizing of a portion of the target object image (e.g., the user's face).

[0132] In step 1130, the electronic device 101 determines whether an input for capturing at least one object is received. For example, when a selection input for a capture button included in the preview screen is received, the electronic device 101 may determine that an input for capturing at least one target object image has been received. Figure 2 When the pen input device 201 of the electronic device 101 receives a capture signal (for example, an input signal on a button component), the electronic device 101 can determine that an input for capturing at least one target object has been received.

[0133] In step 1140, the electronic device 101 outputs a capture notification sound corresponding to the changed size of the at least one target object image using the sound output device 155. When the at least one target object image is reduced, the electronic device 101 may output the capture notification sound at a louder volume than the default notification sound.

[0134] Figures 12a to 12c is a view illustrating an operation of outputting a capture notification sound of a designated magnitude depending on a change in the distance between an electronic device and a user (or a pen input device) according to an embodiment.

[0135] refer to Fig.12a , the electronic device 101 displays a menu 1212 for activating the output of a capture notification sound on the camera setting screen 1210. When receiving an activation input (e.g., an input to a button part) from the pen input device 201 connected via short-range wireless communication or a user's touch input to the menu 1212, the electronic device 101 may activate the function of outputting a capture notification sound.

[0136] refer to Figure 12b When the ratio of a portion of the target object image 912 (e.g., the user's face) to the preview screen 910 is a threshold value (e.g., 3.2%) or less, the electronic device 101 may output a capture notification sound through the sound output device 155 at a volume louder than a default volume. Fig.12c When the ratio of a portion of the target object image 912 (e.g., the user's face) to the preview screen 910 is a threshold (e.g., 30%) or greater, the electronic device 101 may output a capture notification sound through the sound output device 155 at a volume lower than a default volume.

[0137] Fig.13 is a flowchart illustrating a method of operating the electronic device 101 according to an embodiment.

[0138] refer to Fig.13 , in step 1310 , the electronic device 101 displays a preview screen.

[0139] In step 1320 , the electronic device 101 determines whether a capture signal is received from the pen input device.

[0140] When a capture signal is received from the pen input device (step 1320 is yes), the electronic device 101 displays a specified visual effect on the preview screen in step 1330. The specified visual effect may include an effect of emitting surface light in a specified color (e.g., white). When a capture signal is not received from the pen input device (step 1320 is no), the electronic device 101 continues to display the preview screen.

[0141] In step 1340 , the electronic device 101 may store the preview screen as a captured image.

[0142] Fig.14a and Fig.14b 2 is a view illustrating an operation of outputting a designated visual effect on a preview screen when an object (ie, a target object) is captured by a pen input device according to an embodiment.

[0143] refer to Fig.14a and Fig.14b When capturing via the pen input device is recognized, the electronic device 101 may display a specified visual effect 1400 (eg, a surface glow effect) on the preview screen. The surface glow effect may be displayed in a semi-transparent or opaque manner.

[0144] Fig.15 is a flowchart illustrating a method of operating the electronic device 101 according to an embodiment.

[0145] refer to Fig.15 In step 1510, the electronic device 101 (including Figure 1 The processor 120) displays a preview screen.

[0146] In step 1520, the electronic device 101 determines whether it is possible to capture using a pen input device. The electronic device 101 may determine whether it is possible to capture using a pen input device based on whether a wireless signal of a pre-specified strength or greater is received from the pen input device. For example, when the distance between the electronic device 101 and the pen input device 201 is greater than 10 meters (m), the electronic device 101 may determine that such capture is not possible. Figure 1 The memory 130 of the electronic device 101 may store information indicating the correspondence between the distance from the electronic device 101 and the strength of the wireless signal sent from the pen (e.g., a lookup table). The electronic device 101 may determine the distance between the electronic device and the pen input device using the information indicating the correspondence between the distance from the electronic device 101 and the strength of the wireless signal.

[0147] When it is determined that capturing using a pen input device is possible (Yes in step 1520 ), in step 1530 , the electronic device 101 displays a notification indicating that capturing using a pen input device is possible on the preview screen.

[0148] When it is determined that capturing using the pen input device is impossible (No in step 1520 ), the electronic device 101 displays a notification indicating that capturing using the pen input device is impossible on the preview screen in step 1540 .

[0149] Figures 16a to 16g An operation of the electronic device 101 controlling the preview screen depending on the distance between the electronic device 101 and the pen input device 201 according to various embodiments is illustrated.

[0150] refer to Fig.16a and Fig.16b , the electronic device 101 displays a preview screen 910 on the display device 160 , the preview screen 910 including a target object image 912 and a capture button 916 b . Fig.16a It is shown that the capture button 916b is displayed in an increased size b on the preview screen 910. The electronic device 101 may display a first notification 1600 inside the capture button 916b, the first notification 1600 indicating that taking a photo with the pen input device 201 is possible.

[0151] refer to Fig.16b , the electronic device 101 displays a first notification 1600 inside the capture button 916b with a default size a, and the first notification 1600 indicates that it is possible to capture a still image or a video using the pen input device 201. When the pen input device 201 is removed from the electronic device 101, the electronic device 101 may perform control to display only at least one of the capture types and the still image capture button 916b on the preview screen 910.

[0152] refer to Fig.16c , the electronic device 101 displays a second notification 1610 on the preview screen 910, which indicates that it is impossible to capture a still image or a video using the pen input device 201. Therefore, the user of the electronic device 101 can easily recognize that it is impossible to capture using the pen input device 201 even at a remote location (e.g., 10 m or more from the electronic device 101).

[0153] refer to Fig.16d , the electronic device 101 displays a third notification 1620 on the preview screen 910, indicating that it is impossible to capture a still image or video using the pen input device 201. The third notification 1620 may include a notification displayed with a designated color (e.g., red) along an edge of the preview screen 910.

[0154] refer to Fig.16e , the electronic device 101 displays a fourth notification 1630 on the preview screen 910, indicating that it is impossible to capture a still image or video using the pen input device 201. The fourth notification 1630 may include a notification displayed with a designated color (e.g., red) inside the capture button 916b.

[0155] like Fig.16e As shown, when the electronic device 101 recognizes the distance between the pen input device 201 (or the user holding the pen input device) and the electronic device 101 as a specified distance (e.g., 10 m) or more, the capture button 916 b may be enlarged and other buttons (e.g., 916 a and 916 c) may be reduced to a size smaller than the default size.

[0156] refer to Fig.16f , the electronic device 101 displays a fifth notification 1640 on the preview screen 910, indicating that it is impossible to capture a still image or video using the pen input device 201. The fifth notification 1640 may include a notification message indicating that the distance between the pen input device 201 and the electronic device 101 is a specified distance or more.

[0157] refer to Figure 16g , the electronic device 101 displays a sixth notification 1650 on the preview screen 910, indicating that it is impossible to capture a still image or video using the pen input device 201. The sixth notification 1650 may include a notification displayed with a designated color (e.g., red) in the border of the capture button 916b.

[0158] The electronic device 101 may determine the distance between the electronic device 101 and the pen input device 201 based on the strength of the wireless signal sent from the pen input device 201. The electronic device 101 may perform various operations or functions according to the distance between the electronic device 101 and the pen input device 201 determined based on the strength of the wireless signal. Figures 16a to 16g At least some of the described embodiments may be combined together.

[0159] Fig.17 and Fig.18 are flow charts illustrating methods 1700 and 1800 of operating the electronic device 101 according to an embodiment.

[0160] refer to Fig.17 In step 1710, the electronic device 101 displays a touch screen display (eg, Figure 1A screen (eg, preview screen 910 of FIG. 9 ) including at least one target object image corresponding to at least one object obtained by a camera of the electronic device is displayed on a display device 160 of the electronic device.

[0161] In step 1720 , the electronic device 101 changes a property of the screen based on resizing of at least one target object image according to movement of at least one of the object and the electronic device 101 .

[0162] refer to Fig.18 In step 1810, the electronic device 101 displays a Figure 1 A screen including at least one target object image corresponding to at least one object obtained by a camera of the electronic device is displayed on a display device 160 of the electronic device.

[0163] In step 1820, the electronic device 101 receives a signal from an external electronic device (eg, Figure 2 The device 102 may change a property of a screen (e.g., preview screen 910 of FIG. 9 ) based on at least one of the strengths of a signal received by the electronic device 101 and the pen input device 201, and resize at least one target object image based on movement of at least one of the electronic device 101 and the object.

[0164] According to an embodiment, an electronic device includes: a camera, a touch screen display, and a processor, wherein the processor is configured to display a screen including at least one target object image corresponding to at least one object obtained by the camera on the touch screen display, and to change properties of the screen based on resizing of the at least one target object image according to movement of at least one of the electronic device or the object.

[0165] The screen may further include a plurality of graphic objects related to capturing the at least one object.

[0166] The processor may be further configured to, when it is identified that the at least one target object image is reduced to a size smaller than a pre-specified threshold size, enlarge at least one of the plurality of graphic objects to change a property of the screen.

[0167] The processor may be further configured to change the property of the screen by avoiding displaying a graphic object other than the at least one graphic object among the plurality of graphic objects.

[0168] The processor may be further configured to output, via the electronic device, a pre-specified sound corresponding to each reduction degree when it is recognized that the at least one target object image is reduced to a size smaller than a pre-specified threshold size.

[0169] The electronic device may further include a communication circuit configured to establish short-range wireless communication with an external electronic device. The processor may be configured to store the screen as a captured image in the electronic device according to a capture signal received from the external electronic device connected to the electronic device via short-range wireless communication.

[0170] The external electronic device may be detachably connected to the electronic device. The processor may be configured to, when detecting that the external electronic device is disconnected from the electronic device, display a notification indicating that the external electronic device is disconnected on the screen through at least one of the plurality of graphic objects, thereby changing the screen attribute.

[0171] The processor may be configured to display a notification indicating that communication with the external electronic device is impossible on the screen when it is recognized that at least one target object is reduced to a size smaller than a pre-specified threshold size while the external electronic device is disconnected from the electronic device.

[0172] Notifications may be displayed along an edge of the touch screen display.

[0173] According to an embodiment, a method for controlling an electronic device includes: displaying a screen including at least one target object image corresponding to at least one object obtained by a camera of the electronic device on a touch screen display of the electronic device; and changing properties of the screen based on resizing of the at least one target object image according to movement of at least one of the electronic device or the object.

[0174] According to an embodiment, an electronic device includes a camera, a touch screen display, and a processor, the processor being configured to display a screen on the touch screen display including at least one target object image corresponding to at least one object obtained by the camera, and to change properties of the screen based on at least one of the strengths of a signal received from an external electronic device wirelessly and detachably connected to the electronic device, or based on resizing of the at least one target object image according to movement of at least one of the electronic device or the object.

[0175] The wireless communication may be based at least in part on BLE.

[0176] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.

[0177] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., the second element)”, “combined to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” when the terms “operably” or “communicatively” are used or when the terms “operably” or “communicatively” are not used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0178] As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0179] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in a storage medium and data being temporarily stored in a storage medium.

[0180] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be published in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be published online (e.g., downloaded or uploaded) via an application store (e.g., Play StoreTM), or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a manufacturer's server, an application store's server, or a memory of a forwarding server).

[0181] According to various embodiments, each component (e.g., module or program) in the above-mentioned components may include a single entity or multiple entities. According to various embodiments, one or more components in the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each component in the multiple components in the same or similar manner as a corresponding component in the multiple components before integration. According to various embodiments, the operations performed by a module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.

[0182] As is apparent from the foregoing description, according to various embodiments of the present disclosure, screen properties (e.g., the size of graphic objects) of an application (e.g., a camera application) can be controlled based on the distance between the electronic device and the pen input device (or a user holding the pen input device), thereby providing visual convenience to the user.

[0183] The effects set forth herein are not limited thereto, and it is obvious to those of ordinary skill in the art that various effects may be disclosed herein.

[0184] While the present disclosure has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic device, comprising: camera; Touch screen display; as well as The processor is configured as: displaying a screen on the touch screen display, the screen including at least one target object image obtained by the camera corresponding to at least one subject and at least one graphical object configured to capture the at least one subject in response to receiving an input, identifying a change in size of the at least one target object image according to movement of at least one of the electronic device or the at least one subject, and In response to identifying a change in the size of the at least one target object image, a property of the screen is changed by changing the size of the at least one graphic object.

2. The electronic device according to claim 1, wherein: The screen further includes a plurality of graphic objects related to capturing the at least one subject.

3. The electronic device according to claim 2, wherein: The processor is further configured to, when it is identified that the at least one target object image is reduced by a pre-specified threshold ratio or more, enlarge the at least one graphic object to change the property of the screen.

4. The electronic device according to claim 2, wherein: The processor is further configured to change the property of the screen by avoiding displaying a graphic object other than the at least one graphic object among the plurality of graphic objects.

5. The electronic device according to claim 2, further comprising a communication circuit configured to establish short-range wireless communication with an external electronic device, wherein: The processor is configured to store the screen as a captured image in the electronic device according to a capture signal received from the external electronic device connected to the electronic device via short-range wireless communication.

6. The electronic device according to claim 5, wherein: The external electronic device is detachably connected to the electronic device, and wherein the processor is further configured to: when it is detected that the external electronic device is disconnected from the electronic device, change the property of the screen by displaying a notification on the screen indicating the disconnection of the external electronic device, wherein the processor is further configured to: upon determining that the distance between the external electronic device and the electronic device exceeds a pre-specified distance, display a notification on the screen indicating that communication with the external electronic device is impossible when the external electronic device is disconnected from the electronic device, and The notification is displayed along an edge of the touch screen display according to a pre-designated area.

7. A method for controlling an electronic device, the method comprising: displaying a screen on a touch screen display of the electronic device, the screen including at least one target object image corresponding to at least one subject obtained by a camera of the electronic device and at least one graphical object configured to capture the at least one subject in response to receiving an input; as well as identifying a change in size of the at least one target object image according to movement of at least one of the electronic device or the at least one subject, and In response to identifying a change in the size of the at least one target object image, a property of the screen is changed by changing the size of the at least one graphic object.

8. The method according to claim 7, wherein: The screen further includes a plurality of graphic objects related to capturing the at least one subject.

9. The method according to claim 8, wherein: Changing the property of the screen includes: when it is identified that the at least one target object image is reduced by a pre-specified threshold ratio or more, enlarging the at least one graphic object to change the property of the screen.

10. The method according to claim 8, wherein: Changing the attribute of the screen includes preventing display of graphic objects other than the at least one graphic object among the plurality of graphic objects.

11. The method according to claim 8, further comprising: The screen is stored as a captured image in the electronic device according to a capture signal received from an external electronic device connected to the electronic device via short-range wireless communication.

12. The method according to claim 11, wherein: The external electronic device is detachably connected to the electronic device, and wherein changing the attribute of the screen includes: when it is detected that the external electronic device is disconnected from the electronic device, changing the attribute of the screen by displaying a notification on the screen indicating the disconnection of the external electronic device, and When the distance between the external electronic device and the electronic device exceeds a pre-specified distance, a notification indicating that communication with the external electronic device is impossible while the external electronic device is disconnected from the electronic device is displayed on the screen.

13. The method according to claim 12, wherein: The notifications are displayed along an edge of the touch screen display according to a pre-designated area.

Images