Electronic device and method for recognizing input related to 3D image

Abstract

This electronic device may comprise at least one camera, a touch-sensitive display, at least one processor, and a memory for storing instructions. The instructions may cause, when executed individually or collectively by the at least one processor, the electronic device to: on the basis of a three-dimensional (3D) display mode, display two images through the touch-sensitive display to provide a 3D effect image in a space in front of the touch-sensitive display; on the basis of a positional relationship between the electronic device and a user's eyes in front of the electronic device, set a spatial range located within the space regarding the 3D effect image; through the at least one camera, identify whether a specific position of a stylus pen moves into the spatial range; and on the basis of a specific portion of the stylus pen, which has moved into the spatial range, identify the position of the specific portion of the stylus pen, as a user input for the 3D effect image.

Description

Electronic device and method for recognizing input regarding a 3D image

[0001] The following descriptions relate to an electronic device and method for recognizing inputs regarding 3D (three-dimensional) images.

[0002] An electronic device may include a touch circuit arranged on a display panel to perform a function in response to a finger or stylus pen contacting the display panel. For example, the touch circuit may include a touch sensor for identifying the contact based on a capacitive method, a resistive method, an infrared method, an acoustic method, and / or a pressure method, and a processing circuit for acquiring data through the touch sensor.

[0003] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0004] According to an exemplary embodiment of the present disclosure, an electronic device may include at least one camera. The electronic device may include a touch-sensitive display. The electronic device may include at least one processor including a processing circuit. The electronic device may include a memory that stores instructions and includes one or more storage media. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause two separate images to be displayed through the touch-sensitive display to provide a 3D effect image in the space in front of the touch-sensitive display based on the 3D (dimensional) display mode of the touch-sensitive display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause a spatial range located within the space regarding the 3D effect image to be set based on the positional relationship between the electronic device and the user's eye in front of the electronic device. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify whether a specific position of a stylus pen moves within the spatial range through the at least one camera while providing the 3D effect image. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify the position of the specific part of the stylus pen as user input regarding the 3D effect image based on the specific part of the stylus pen that has moved within the spatial range.

[0005] According to an exemplary embodiment of the present disclosure, an electronic device may include at least one camera configured to acquire images available for identifying the position of a stylus pen associated with the electronic device and the distance from the electronic device to an eye. The electronic device may include at least one sensor configured to acquire data available for identifying the direction of the eye relative to the electronic device. The electronic device may include a touch-sensitive display configured to operate in one of a two-dimensional (2D) display mode and a three-dimensional (3D) display mode. The electronic device may include at least one processor comprising a processing circuit. The electronic device may include a memory that stores instructions and includes one or more storage media. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause user input received from the stylus pen to identify, using the touch-sensitive display, a single effect image based on the two-dimensional display mode, by displaying a single image through the touch-sensitive display. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify user input received from the stylus pen using the at least one camera and the at least one sensor based on the 3D display mode, which represents a single effect image by displaying two separate images through the touch-sensitive display.

[0006] According to an exemplary embodiment of the present disclosure, a system may include an electronic device. The system may include a stylus pen coupled to the electronic device. The electronic device may be configured to display two separate images to provide a three-dimensional effect image in space in front of the electronic device based on a three-dimensional display mode of the electronic device. The electronic device may be configured to transmit a signal to the stylus pen to indicate the three-dimensional display mode of the electronic device. The stylus pen may be configured to acquire data available to identify pressure applied to the stylus pen. The stylus pen may be configured to transmit pressure information to the electronic device indicating the input applied to the stylus pen, identified based on the data, in response to the reception of the signal from the electronic device. The electronic device may be configured to receive pressure information from the stylus pen indicating the pressure applied to the stylus pen. The electronic device may be configured to identify the position of a specific part of the stylus pen as user input regarding the 3D effect image having the pressure.

[0007] The above-described and other aspects, features, and advantages of specific embodiments of this disclosure will become more apparent from the following detailed description, which is taken into account together with the accompanying drawings.

[0008] FIG. 1a is a drawing illustrating an example of a method for recognizing an input on a display of an electronic device displaying a 2D image according to various embodiments of the present disclosure.

[0009] FIG. 1b is a drawing illustrating an example of a method for recognizing an input on a display of an electronic device displaying a 3D image according to embodiments of the present disclosure.

[0010] FIG. 2 is a block diagram illustrating exemplary configurations of an electronic device and an external input device according to various embodiments of the present disclosure.

[0011] FIG. 3a is an exploded perspective view showing an electronic device including a touch circuit for identifying an external input device according to various embodiments of the present disclosure.

[0012] FIG. 3b is a drawing showing an example of a display panel for displaying a 3D image according to various embodiments of the present disclosure.

[0013] FIGS. 4a and 4b are drawings illustrating examples of a driving method for recognizing touch input by an external input device according to various embodiments of the present disclosure.

[0014] FIG. 5 is a diagram illustrating examples of a method for an electronic device according to various embodiments of the present disclosure to recognize an input regarding a 3D image displayed through a display.

[0015] FIG. 6 is a flowchart illustrating an exemplary method in which an electronic device according to various embodiments of the present disclosure transmits a signal to an external input device and performs a function according to the position of the external input device regarding a 3D image displayed through a display.

[0016] FIG. 7 is a diagram illustrating an example of a method for generating a 3D image according to various embodiments of the present disclosure.

[0017] FIG. 8 is a diagram illustrating an example of a method in which an electronic device according to various embodiments of the present disclosure identifies a reference position defining a space on a display using at least one sensor.

[0018] FIGS. 9a, FIGS. 9b, FIGS. 9c, FIGS. 9d, and FIGS. 9e are drawings illustrating examples of a method in which an electronic device according to various embodiments of the present disclosure identifies the location of an external input device in space using at least one camera.

[0019] FIGS. 10a and FIGS. 10b are drawings illustrating examples of a method in which an electronic device according to various embodiments of the present disclosure transmits a signal to an external input device according to the location of the external input device.

[0020] FIGS. 11a, FIGS. 11b, and FIGS. 11c are drawings illustrating examples of a method in which an external input device provides feedback according to various embodiments of the present disclosure.

[0021] FIGS. 12a and FIGS. 12b are drawings illustrating examples of the operation of an electronic device according to the positional state of an external input device according to various embodiments of the present disclosure.

[0022] FIG. 13 is a diagram illustrating an example of a method for an electronic device according to various embodiments of the present disclosure to display a 3D image within a split view.

[0023] FIG. 14 is a diagram illustrating an example of a method for an external input device to recognize pressure according to various embodiments of the present disclosure.

[0024] FIG. 15 is a signal flow diagram illustrating an example of a method for correcting the position of an external input device as an electronic device according to various embodiments of the present disclosure receives motion information from an external input device.

[0025] FIG. 16 is a signal flow diagram illustrating an example of a method in which an electronic device according to various embodiments of the present disclosure transmits a signal authorizing an external input device to perform a function based on a comparison of the location of the external input device and a reference range.

[0026] FIG. 17 illustrates an example of a method for an electronic device according to various embodiments of the present disclosure to recognize input by an external object regarding a 3D image displayed through a display.

[0027] FIGS. 18a and FIGS. 18b are drawings illustrating other examples of a method for an electronic device according to various embodiments of the present disclosure to recognize a plurality of inputs regarding a 3D image displayed through a display.

[0028] FIG. 19 is a block diagram illustrating an example of an electronic device in a network environment according to various embodiments of the present disclosure.

[0029] The terms used in this disclosure are used to describe various exemplary embodiments and do not limit the scope of other embodiments. A singular expression may include a plural expression unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art described in this disclosure. Terms used in this disclosure that are defined in a general dictionary may be interpreted as having the same or similar meaning as they have in the context of the relevant technology, and are not interpreted in an ideal or overly formal sense unless explicitly defined in this disclosure. In some cases, even terms defined in this disclosure are not to be interpreted to exclude the embodiments of this disclosure.

[0030] In the various embodiments of the present disclosure described below, a hardware-based approach is described as an example. However, since the various embodiments of the present disclosure include techniques using both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

[0031] Additionally, in this disclosure, expressions of "greater than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled; however, this is merely for the purpose of expressing an example and does not exclude descriptions of "greater than" or "less than." Conditions described as "greater than" may be replaced with "greater than," conditions described as "less than" may be replaced with "less than," and conditions described as "greater than and less than" may be replaced with "greater than and less than." Furthermore, "A" to "B" below refer to at least one of the elements from A (including A) to B (including B).

[0032] FIG. 1a is a 2D image according to various embodiments of the present disclosure.

[0033] FIG. 1b is a drawing illustrating an example of a method for recognizing input on a display of an electronic device that displays a 3D image according to various embodiments of the present disclosure.

[0034] FIG. 1a illustrates an example of a method for recognizing input on a display (110) while an electronic device (101) (e.g., the electronic device (101) of FIG. 2) displays an image (120) through a display (110). In FIG. 1a, the image (120) displayed through the display (110) may be a 2D image displayed on a display area of ​​the display (110). FIG. 1b illustrates an example of a method for recognizing input on a display (110) while an electronic device (101) displays images (131, 132) through the display (110). In FIG. 1b, when images (131, 132) displayed through the display (110) are displayed, a user located in the space above (or in front of) the display (110) may recognize the image (130). For example, the image (130) may be a 3D image recognized as being located in the space above the display (110) (or the space above the display area of ​​the display (110)). For example, the image (130) may not actually be displayed in the space, but may be recognized as being located in the space for the user as the electronic device (101) displays the images (131, 132).

[0035] The electronic device (101) of FIGS. 1a and 1b may include a tablet PC (personal computer). However, the present disclosure is not limited thereto. For example, the electronic device (101) may include a smartphone, a smart watch, a TV (television), a monitor, or a device including a display (e.g., a robot). As a non-limiting example, the electronic device (101) may be an example of an electronic device capable of displaying 3D images.

[0036] The display (110) of the electronic device (101) of FIG. 1a and FIG. 1b may include a display capable of displaying an image and identifying an input by an external input device (103). In the present disclosure, the display (110) may be referred to as a touch-sensitive display. For example, the display (110) may include a display panel comprising a display area visible from the outside. For example, the display panel may include the display area for displaying an image. For example, the display (110) may include a touch sensor for detecting contact points for a touch input received (or acquired, identified) with respect to the display area of ​​the display panel. For example, the touch input may include an input including contact points by an external input device (103) on the display area of ​​the display panel or a hovering input by an external input device (103). For example, the touch sensor may be used to acquire (or measure) sensing data by sensing a change in electrical characteristics (e.g., capacitance) caused by the contact points (or the contact points by an external object). For example, the display (110) may include an integrated circuitry (IC) (or touch IC) that processes the sensing data acquired from the touch sensor and controls the operation of the touch sensor. For example, the touch sensor and the touch IC may be referred to as a touch circuit. For example, FIG. 3a may be referenced below as an example of a display (110) including the touch circuit.

[0037] In FIG. 1a and FIG. 1b, the external input device (103) may include a stylus pen connected (connected) to the electronic device (101). However, the present disclosure is not limited thereto. For example, the external input device (103) may be an external object (e.g., a hand). Hereinafter, in the present disclosure, the external input device (103) may be referred to as a smart pen, an electronic pen, a stylus, or a stylus pen.

[0038] Referring to FIG. 1a, an electronic device (101) can display an image (120) on a display (110). For example, the image (120) may include a visual object (e.g., a dog). As a non-limiting example, the image (120) may have a size corresponding to the display area of ​​the display (110) or be smaller than the size of the display area. For example, the image (120) may include a visual object and a background image, or may include only a visual object.

[0039] For example, an electronic device (101) may receive input from an external input device (103) while displaying an image (120) through a display (110). For example, the electronic device (101) may identify (or detect) a location (or location of contact points) on the display area of ​​the external input device (103) that is in contact with the display (110), and recognize a touch input according to said location. In the example of FIG. 1a, an example of said touch input including an input including contact points is illustrated, but the present disclosure is not limited thereto. For example, the electronic device (101) may identify (or detect) a location on the display area of ​​the external input device (103) that is spaced apart from the display (110), and recognize a touch input which is a hovering input according to said location.

[0040] Referring to FIG. 1a, when displaying (or providing) a 2D image (or 2D media content, 2D effect image), the electronic device (101) may identify an external input device (103) located adjacent to (or in contact with) the display (110) and, by recognizing a touch input by the external input device (103), provide an output according to the touch input. For example, the output may include changing the image (120) or executing at least one function of the electronic device (101). For example, the at least one function may be a function triggered by the touch input.

[0041] The recognition of touch input exemplified in FIG. 1a may indicate that an electronic device (101) displays a 2D image and recognizes a position on a display (110) corresponding to the displayed 2D image. When the electronic device (101) displays a 3D image, specific details regarding the electronic device (101) recognizing a position on the display (110) may be referenced in FIG. 1b.

[0042] Referring to FIG. 1b, the electronic device (101) can display images (131, 132) on the display (110). For example, each of the image (131) and the image (132) may contain the same visual object (e.g., a dog). For example, the image (131) and the image (132) may be displayed in a partially overlapping state. In other words, the image (131) may be displayed in a different part of the display area of ​​the display (110) than the part where the image (132) is displayed. As the image (131) and the image (132) are displayed simultaneously, a user positioned in front of the display (110) (or the electronic device (101)) may perceive the image (130). For example, the image (130) may be referred to as 3D media content or a 3D effect image. For example, the image (130) may be recognized as being located within the space between the display (110) and the user.

[0043] As a non-limiting example, the display (110) may have a structure for simultaneously displaying an image (131) and an image (132). For example, the display (110) may be referred to as a lenticular display. For example, specific details regarding a lenticular display may be referenced below in FIG. 3b. The display (110) may be a lenticular display comprising first display areas and second display areas. For example, the first display areas and the second display areas may alternate with each other. In one example, the display (110) may be formed with a structure that repeats in the order of a first display area, a second display area, a first display area, and a second display area. In FIG. 1b, the first display areas may be used to display an image (131), and the second display areas may be used to display an image (132). As described above, the display (110), which is a lenticular display, can simultaneously display an image (131) through the first display areas and an image (132) through the second display areas so that the image (130) can be perceived by the user as being located within the space. For example, the image (130) may be a 3D image (or 3D media content, 3D effect image) with different depths in parts of the image (130).

[0044] For example, an electronic device (101) may receive input from an external input device (103) while simultaneously displaying images (131, 132) through a display (110). For example, the electronic device (101) may identify (or detect) a location (139) (or a location of contact points) on the display area of ​​the external input device (103) that is in contact with the display (110), and recognize a touch input according to said location. In the example of FIG. 1b, an example of said touch input including contact points is illustrated, but the present disclosure is not limited thereto. For example, the electronic device (101) may identify (or detect) a location on the display area of ​​the external input device (103) that is spaced apart from the display (110), and recognize a touch input which is a hovering input according to said location.

[0045] Referring to FIG. 1b, the electronic device (101) recognizes a location (139), but it may be difficult to determine whether the location (139) is a point on the image (131) or a point on the image (132). When the user recognizes (or views) the image (130) through the external input device (103) and performs an input for the location (139), a location (139) different from the location (138) intended by the user may be indicated. In other words, the display (110) that recognizes the touch input receives only the input for the image (131) (or image (132)) by the external input device (103) and cannot receive the input for the image (130), and the input for the image (131) (or image (132)) (e.g., the input for the location (139)) may not be the input intended by the user. Depending on the discrepancy between the input intended by the user and the input recognized by the electronic device (101), the user may experience discomfort in using the electronic device (101) that displays (or provides) a 3D image (or 3D media content, 3D effect image).

[0046] Although not illustrated in FIG. 1a and 1b, a wearable device providing XR (extended reality) (e.g., a head-mounted display (HMD) device) may display an image providing extended reality through a display. For example, the wearable device may perform an action to match the location of an input by a user within a real environment with the location within a virtual environment within the displayed image. For example, the action may include displaying (or indicating) a virtual object (or indicator) corresponding to the user's hand (or the controller of the wearable device) within the image. The wearable device may receive input reflecting the user's intention through the display of the virtual object. However, the wearable device may display both an image of the virtual environment and an indicator within the virtual environment through a display positioned in front of the user's eyes, so that the location within the real environment may match (or be mapped, corresponded to) the location within the virtual environment.

[0047] However, as with the electronic device (101) of FIG. 1a and FIG. 1b, by displaying images (131, 132) on a display (110), it may be difficult to accurately reflect the user's intention by recognizing an input for an image (130) that is perceived by the user as being displayed within the space as an input for at least one of the images (131, 132). Hereinafter, the present disclosure describes an electronic device (101) that displays a 3D image, which can identify the location of an external input device (103) for the 3D image and recognize an input for the 3D image according to the location. In other words, the electronic device (101) can recognize the location of the external input device (103) within the space (or air) between the electronic device (101) and the user as the location (or input) where an input for the 3D image (or 3D media content, 3D effect image) by the external input device (103) is to be applied. Accordingly, the present disclosure can improve the usability of an electronic device (101) that displays (or provides) a 3D image (or 3D media content, 3D effect image) by reducing the discrepancy between the user's intention and the input recognized by the electronic device (101).

[0048] FIG. 2 is a block diagram showing an exemplary configuration of an electronic device and an external input device according to various embodiments of the present disclosure.

[0049] FIG. 2 is a schematic diagram of components included in an electronic device (101) and a block diagram of components included in an external input device (103) connected to the electronic device (101). The block diagram of the electronic device (101) in FIG. 2 may be a schematic diagram of the electronic device (101) in FIG. 1a and FIG. 1b. The schematic diagram of the external input device (103) in FIG. 2 may be a schematic diagram of the external input device (103) in FIG. 1a and FIG. 1b.

[0050] Referring to FIG. 2, an electronic device (101) can be connected to an external input device (103) via a communication circuit (240) based on a wireless network (or communication technique). For example, the wireless network may include networks such as LTE (long term evolution), 5g NR (new radio), Wi-Fi (wireless fidelity), Zigbee, NFC (near field communication), Bluetooth, BLE (Bluetooth low-energy), or a combination thereof. In the example of FIG. 2, the electronic device (101) (e.g., tablet PC) and the external input device (103) (e.g., stylus pen) can be connected using the Bluetooth or BLE communication technique.

[0051] For example, the electronic device (101) may include at least one processor (210) (e.g., including a processing circuit), at least one camera (220), at least one sensor (230), a communication circuit (240), a display (110), and a memory (250). For example, at least one processor (210), at least one camera (220), at least one sensor (230), a communication circuit (240), a display (110), and a memory (250) may be electrically and / or operably coupled with each other by a communication bus. In the following, the operably coupled hardware components may be represented, for example, by a direct connection or an indirect connection between the hardware components being established by wire or wirelessly so that a second hardware component is controlled by a first hardware component among the hardware components. Although illustrated based on different blocks, the present disclosure is not limited thereto, and some of the hardware components illustrated in FIG. 2 (e.g., at least one processor (210), communication circuit (240), or memory (250)) may be included in a single integrated circuit such as a system on a chip (SoC) or a system in package (SIP). The type and / or number of hardware components included in the electronic device (101) are not limited to those illustrated in FIG. 2. For example, the electronic device (101) may include only some of the hardware components illustrated in FIG. 2. For example, the electronic device (101) may be an example of the electronic device (1901) of FIG. 19. For example, the electronic device (101) may include at least some of the electronic device (1901) of FIG. 19.

[0052] For example, the electronic device (101) may be implemented in various form factors. For example, the electronic device (101) may include not only an electronic device including a bar-type display, but also an electronic device including a display that is a flexible display. For example, the flexible display may include an electronic device including a foldable display, an electronic device including a multi-foldable display, or an electronic device including a rollable display. Additionally, for example, the electronic device (101) may include a tablet PC. Additionally, for example, the electronic device (101) may be implemented as a wearable device. For example, the wearable device may include a watch-shaped device. However, the present disclosure is not limited thereto.

[0053] For example, at least one processor (210) of the electronic device (101) may include a hardware component for processing communication and / or data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), or a field programmable gate array (FPGA). As an example, the hardware component for processing data may include a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing unit (DSP), a microcontroller (MCU), and / or a neural processing unit (NPU). For example, at least one processor (210) may have the structure of a multi-core processor such as a dual core, a quad core, or a hexa core. The at least one processor (210) of FIG. 2 may have substantially the same properties as the processor (1920) of FIG. 19.

[0054] For example, at least one processor (210) may include various processing circuits and / or multiple processors. For example, the term “processor” as used in the disclosure, including in the claims, may include various processing circuits including at least one processor, and one or more of the at least one processor may be configured to perform the various functions described below in a distributed manner, individually and / or collectively. As used below, where “processor,” “at least one processor,” and “one or more processors” are described as being configured to perform various functions, these terms encompass, for example, but not limited to, situations where one processor performs some of the cited functions and other processor(s) perform other parts of the cited functions, and also situations where one processor can perform all of the cited functions. Additionally, the at least one processor may include a combination of processors that perform the enumerated / disclosed various functions, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform the various functions.

[0055] For example, at least one camera (220) of the electronic device (101) may include one camera or a plurality of cameras. For example, at least one camera (220) may be used to acquire an image of the actual environment. As an example without limitation, at least one camera (220) may be positioned within the electronic device (101) facing the direction in which the display (110) of the electronic device (101) is positioned (or, the direction in which an image displayed from the display (110) can be seen). In other words, at least one camera (220) may acquire an image of the space above the display (110) (or the space in front of the display (110)) in the direction in which the display (110) is positioned. For example, the space may be at least a part of the actual environment. As an example without limitation, the space may be the space corresponding to the field of view (FoV) of at least one camera (220). For example, at least one camera (220) may be an example of the camera module (1980) of FIG. 19. At least one camera (220) may include at least a part of the camera module (1980) of FIG. 19. By example, without limitation, at least one camera (220) of FIG. 2 may be referred to as an image sensor. In other words, at least one camera (220) may be included in at least one sensor (230).

[0056] For example, at least one sensor (230) of the electronic device (101) may include a motion sensor for sensing the orientation or posture (or movement) of the electronic device (101). For example, the motion sensor may include an accelerometer or a gyroscope. The electronic device (101) may identify the orientation of the electronic device (101) and identify a reference position according to the orientation using sensing data obtained through at least one sensor (230). For example, the reference position may be used to define the space above the display (110). Specific details regarding this may be referenced below in FIG. 8. As an example without limitation, at least one sensor (230) may further include a time of flight (ToF) sensor, an infrared ray (IR) sensor, an optical sensor, a proximity sensor, a temperature sensor, or a barometric pressure sensor. For example, the ToF sensor, the IR sensor, or the optical sensor may be used to identify the location (or shape, direction) of an external input device (103) within the space.

[0057] According to one embodiment, a communication circuit (240) of an electronic device (101) may be used to perform communication with an external input device (103). By example, without limitation, the communication circuit (240) may include an antenna using Bluetooth or BLE communication techniques. For example, the electronic device (101) may be referred to as a source device, a master device, or a motor terminal for the external input device (103). For example, at least one processor (210) may control the operation of the communication circuit (240). By example, without limitation, at least one processor (210) may include a processor for controlling the operation or function of the communication circuit (240). The processor for controlling the operation or function of the communication circuit (240) may be referred to as a communication processor or a BT processor.

[0058] For example, a display (110) (or touch-sensitive display (110)) of an electronic device (101) may be used to display an image. For example, the display (110) may include a display panel that includes a display area for displaying an image. For example, the display (110) of the electronic device (101) may include a touch circuit used to recognize touch input by an external object or an external input device (103) on the display (110). For example, the touch circuit of the display (110) may include a touch sensor and a touch IC for controlling the touch sensor. Specific details regarding the touch circuit of the display (110) may be referenced below in FIG. 3a. For example, the display (110) may display a 3D image by displaying a plurality of images through different display areas (or pixels). A display (110) that uses different display areas to display a 3D image can be referred to as a lenticular display. Specific details regarding the lenticular display can be referred to in FIG. 3b below.

[0059] According to one embodiment, an electronic device (101) may include a memory (250). The memory (250) may include a hardware component for storing data and / or instructions that are input to or / or output from at least one processor (210). The memory (250) may include, for example, a volatile memory such as random-access memory (RAM), and / or a non-volatile memory such as read-only memory (ROM). The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, a hard disk, a compact disk, and an embedded multimedia card (eMMC). The specific details regarding the memory (250) of FIG. 2 can be substantially applied in the same way as the details regarding the memory (1930) of FIG. 19.

[0060] According to one embodiment, within the memory (250) of the electronic device (101), one or more instructions (or commands) representing operations and / or operations to be performed on data by at least one processor (210) of the electronic device (101) may be stored. A set of one or more instructions may be referred to as a program, firmware, operating system, process, routine, sub-routine, and / or application. Hereinafter, the statement that an application is installed within the electronic device (e.g., electronic device (101)) may be indicated as one or more instructions provided in the form of an application being stored within the memory (250), such that said one or more applications are stored in an executable format (e.g., a file having an extension specified by the operating system of the electronic device (101)) by the processor of the electronic device. According to one embodiment, the electronic device (101) may perform operations by executing one or more instructions stored in the memory (250). For example, the above one or more instructions may cause at least some of the operations of the electronic device (101) to be performed when executed by at least one processor (210).

[0061] Although not illustrated in FIG. 2, the electronic device (101) may include output means for outputting information in a form other than a visualized form. As an example, but not limited to, the electronic device (101) may further include a light-emitting part that emits light of a specific color, a speaker that outputs acoustic information, and an actuator (or motor) for providing haptic feedback based on vibration. Additionally, the electronic device (101) may include an input device (e.g., a microphone) (or an audio sensor) for acquiring (or receiving, detecting) acoustic information from the outside. For example, the audio sensor may include an accelerometer or a piezoelectric sensor that detects sound based on vibration. For example, the audio sensor may be referred to as a VPU (voice pickup unit).

[0062] Referring to FIG. 2, the external input device (103) may include a printed circuit board (PCB) (261), a pen tip (263), a pen tip circuit (265), a button (267), a communication circuit (269), at least one processor (271) (e.g., including a processing circuit), a memory (273), a motion sensor (275), a battery (277), a pressure sensor (279), an actuator (281), a speaker (283), and a light-emitting part (285). For example, the button (267), the communication circuit (269), at least one processor (271), the memory (273), the motion sensor (275), the battery (277), the pressure sensor (279), the actuator (281), the speaker (283), and the light-emitting part (285) may be mounted (or installed) on the PCB (261). In FIG. 2, a button (267), a communication circuit (269), at least one processor (271), a memory (273), a motion sensor (275), a battery (277), a pressure sensor (279), an actuator (281), a speaker (283), and a light-emitting part (285) are exemplified and placed on a PCB (261), but the present disclosure is not limited thereto. For example, an external input device (103) may include a plurality of PCBs or a component (e.g., a socket) for mounting electronic components.

[0063] For example, the pen tip (263) of the external input device (103) may be connected to a part of the external input device (103). For example, the part of the external input device (103) may include a connecting structure for connecting the pen tip (263). For example, the pen tip (263) may be connected (or electrically connected) to the pen tip circuit (265) of the external input device (103). For example, the pen tip circuit (265) may include a circuit that forms a magnetic field (or an electric field, an electromagnetic field). For example, the pen tip circuit (265) may include a coil (or an inductor, a solenoid). For example, the pen tip circuit (265) may include a resonant circuit for forming a magnetic field through the coil. For example, the resonant circuit may include at least one capacitor or a switch. Depending on the operation of the above resonant circuit, the resonant frequency of the signal forming the magnetic field may be changed. For example, the above resonant circuit may be resonated based on energy transmitted (or provided) from a magnetic field generated by a touch circuit included in the display (110) of the electronic device (101). The change in the resonant frequency may be used to recognize a touch input to the electronic device (101) of the external input device (103) or an input to the button (267) of the external input device (103). A touch input method to the electronic device (101) of the external input device (103) using a pen tip circuit (265) may be referred to as an EMR (electromagnetic resonance) method (or an EMR passive method). Specific details regarding the EMR method may be referenced below in FIG. 4a. In FIG. 2, an example of an external input device (103) including a pen tip circuit (265) is shown, but the present disclosure is not limited thereto.For example, the external input device (103) may include a pen tip circuit (265) including electrodes other than the resonant circuit. For example, the pen tip circuit (265) including electrodes may be used to directly transmit a signal (or an electrical signal). For example, a touch input method for the electronic device (101) of the external input device (103) using the pen tip circuit (265) including electrodes may be referred to as an active electrostatic solution (AES) method (or an active AES method). Specific details regarding the AES method may be referenced below in FIG. 4b. In the above example, the touch input method for the electronic device (101) of the external input device (103) is exemplified as an EMR method or an AES method, but the present disclosure is not limited thereto. For example, the electronic device (101) can recognize a touch input from an external input device (103) by identifying a change in capacitance caused by the external input device (103) using an electric field through a display (110). For example, the touch input method for the electronic device (101) of the external input device (103) utilizing the change in capacitance can be referred to as an ECR (electrically coupled resonance) method. At this time, the display (110) can be referred to as a TSP (touch screen panel).

[0064] For example, the button (267) of the external input device (103) may include a physical button for performing a preset function (or gesture) for the external input device (103). As an example without limitation, the capacitance inside the pen tip circuit (265) may be changed by an input (or press input) to the button (267). The external input device (103) may recognize the input to the button (267) by identifying the change in the capacitance inside the pen tip circuit (265). For example, the button (267) may be referred to as a physical button, an input button, or an input device.

[0065] For example, the communication circuit (269) of the external input device (103) may be used to perform communication with the electronic device (101). As an example without limitation, the communication circuit (269) may include an antenna using Bluetooth or BLE communication techniques. For example, at least one processor (271) may control the operation of the communication circuit (269). As an example without limitation, at least one processor (271) may include a processor for controlling the operation or function of the communication circuit (269). The processor for controlling the operation or function of the communication circuit (269) may be referred to as a communication processor or a BT processor.

[0066] For example, at least one processor (271) of the external input device (103) may include a hardware component for processing communication and / or data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), and a field programmable gate array (FPGA). As an example, the hardware component for processing data may include a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing unit (DSP), a microcontroller (MCU), and / or a neural processing unit (NPU). For example, at least one processor (271) may have the structure of a multi-core processor such as a dual core, a quad core, or a hexa core.

[0067] For example, at least one processor (271) may include various processing circuits and / or multiple processors. For example, the term “processor” as used in the disclosure, including in the claims, may include various processing circuits including at least one processor, and one or more of the at least one processor may be configured to perform the various functions described below in a distributed manner, individually and / or collectively. As used below, where “processor,” “at least one processor,” and “one or more processors” are described as being configured to perform various functions, these terms encompass, for example, situations in which one processor performs some of the cited functions and another processor(s) perform other parts of the cited functions, and also situations in which one processor can perform all of the cited functions. Additionally, the at least one processor may include a combination of processors that perform the enumerated / disclosed various functions, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform the various functions.

[0068] According to one embodiment, an external input device (103) may include a memory (273). The memory (273) may include a hardware component for storing data and / or instructions that are input to or / or output from at least one processor (271). The memory (273) may include, for example, a volatile memory such as random-access memory (RAM) and / or a non-volatile memory such as read-only memory (ROM). The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, a hard disk, a compact disk, and an embedded multimedia card (eMMC).

[0069] For example, the motion sensor (275) of the external input device (103) may include a motion sensor for sensing the orientation or posture (or movement) of the external input device (103). For example, the motion sensor (275) may include an accelerometer or a gyroscope. The external input device (103) may identify the orientation of the external input device (103) using sensing data obtained through the motion sensor (275). For example, the motion sensor (275) may be referred to as a 6-axis sensor.

[0070] For example, the external input device (103) may include a battery (277). As an example, without limitation, the external input device (103) may include a power management integrated circuitry (PMIC) that controls the operation of the battery (277) and at least one charging port. For example, the PMIC may be a processor for managing the power of the battery (277) of the external input device (103). For example, the PMIC may provide power stored in the battery to hardware components of the external input device (103). Additionally, for example, the PMIC may store power provided through at least one charging port within the battery (277).

[0071] For example, the external input device (103) may include a pressure sensor (279). For example, the pressure sensor (279) may be used to detect pressure exerted by an external object (e.g., a user's hand) holding the external input device (103). For example, the external input device (103) may acquire and process data regarding the pressure (or sensing data) using the pressure sensor (279). As an example, without limitation, the external input device (103) may transmit the data regarding the pressure to the electronic device (101). For example, the electronic device (101) may use the data regarding the pressure to adjust changes based on the input by the external input device (103). For example, the pressure may be referred to as pen pressure. Specific details regarding this may be referenced below in FIG. 14.

[0072] In the example of FIG. 2, the motion sensor (275) and pressure sensor (279) of the external input device (103) may be referred to as at least one sensor. For example, the at least one sensor included in the external input device (103) may further include other sensors in addition to the motion sensor (275) and pressure sensor (279). For example, the at least one sensor included in the external input device (103) may include an infrared (IR) sensor (or an optical sensor).

[0073] For example, the external input device (103) may include various components for providing feedback. For example, the external input device (103) may provide the feedback based on a signal received from the electronic device (101). For example, the feedback may be referred to as an output. For example, the external input device (103) may include tactile feedback, auditory feedback, or visual feedback. For example, to provide the tactile feedback, the external input device (103) may include an actuator (281). The actuator (281) may be an output device for providing feedback based on vibration. The actuator (281) may be referred to as a motor. For specific details regarding the feedback provided using the actuator (281), refer to FIG. 11a. For example, to provide the auditory feedback, the external input device (103) may include a speaker (283). A speaker (283) may be an output device for providing sound-based feedback. Specific details regarding the feedback provided using the speaker (283) may be referenced in FIG. 11b. For example, to provide the visual feedback, the external input device (103) may include an emitter (285). The emitter (285) may be an output device for providing feedback based on the color of the emitted light. Specific details regarding the feedback provided using the emitter (285) may be referenced in FIG. 11c. In FIG. 2, an external input device (103) including an actuator (281), a speaker (283), and an emitter (285) is shown, but the present disclosure is not limited thereto. For example, the external input device (103) may include at least one of an actuator (281), a speaker (283), or an emitter (285).Additionally, for example, the external input device (103) may provide feedback by using components other than the actuator (281), speaker (283), and light-emitting part (285). For example, the external input device (103) may provide tactile feedback by using an electronic component capable of providing electrical friction. For example, the electrical friction may also be referred to as static electricity. Or, for example, the external input device (103) may provide tactile feedback (e.g., temperature change) by using an electronic component capable of adjusting the temperature. The external input device (103) may provide olfactory feedback by using, for example, an electronic component capable of emitting a specific scent.

[0074] The examples of components within the external input device (103) illustrated in FIG. 2 are merely exemplary for convenience of explanation and the present disclosure is not limited thereto. In one example, the external input device (103) may not include a battery (277). An external input device (103) that does not include a battery (277) may not include a communication circuit (269), at least one processor (271), a memory (273), a motion sensor (275), a pressure sensor (279), an actuator (281), a speaker (283), and a light-emitting part (285).

[0075] Additionally, in one example, the external input device (103) may selectively drive (or turn on) at least one of a button (267), a communication circuit (269), at least one processor (271), a memory (273), a motion sensor (275), a battery (277), a pressure sensor (279), an actuator (281), a speaker (283), and a light-emitting unit (285). For example, the driving may include providing power. In an example without limitation, the external input device (103) may drive all of the button (267), the communication circuit (269), at least one processor (271), the memory (273), the motion sensor (275), the battery (277), the pressure sensor (279), the actuator (281), the speaker (283), and the light-emitting unit (285). As a non-limiting example, the external input device (103) may always drive a button (267), a communication circuit (269), at least one processor (271), a memory (273), a battery (277), and a pressure sensor (279), and optionally drive a motion sensor (275), an actuator (281), a speaker (283), and a light-emitting unit (285). As a non-limiting example, the external input device (103) may always drive a button (267), at least one processor (271), a memory (273), and a battery (277), and optionally drive a communication circuit (269), a motion sensor (275), an actuator (281), a speaker (283), a light-emitting unit (285), and a pressure sensor (279). As a non-limiting example, the external input device (103) can always drive the button (267) and battery (277), and optionally drive the communication circuit (269), at least one processor (271), memory (273), motion sensor (275), actuator (281), speaker (283), light-emitting part (285), and pressure sensor (279).

[0076] Referring to the above description, the external input device (103) can reduce power consumption by selectively driving some components. In one example, the external input device (103) may always drive a sensor for detecting contact between a user's body part (e.g., hand) and the external input device (103) and a circuit for driving the sensor, and may drive the remaining components as contact is detected (or may drive them selectively). For example, the external input device (103) may drive the remaining components as input to the button (267) while driving only the button (267) and the battery (277).

[0077] FIG. 3a is an exploded perspective view showing an exemplary electronic device including a touch circuit for identifying an external input device according to various embodiments of the present disclosure.

[0078] Referring to FIG. 3a, an example of a touch circuit (300) used to identify the location of an external input device (103) of an electronic device (101) is illustrated. The electronic device (101) of FIG. 3a may be an example of the electronic device (101) of FIG. 2. The external input device (103) of FIG. 3a may be an example of the external input device (103) of FIG. 2. For example, the electronic device (101) may include a display (110) (or a touch-sensitive display (110)) comprising a touch circuit (300) and a display panel (310). For example, the touch circuit (300) may be referred to as a digitizer.

[0079] For example, the display (110) may include a display panel (310) to which an external input device (103) contacts. For example, the display panel (310) may include a display area (or light-emitting elements) to which an image is displayed. For example, the display panel (310) may include glass to protect (or cover) the light-emitting elements to which an image is displayed. For example, the glass may be a part of the display (110) (or display panel (310)) to which the external input device (103) contacts. However, the present disclosure is not limited thereto. For example, the glass may be a separate component that is not part of the display (110) (or display panel (310)).

[0080] For example, the display (110) may include a touch circuit (300) positioned below the display panel (310). For example, the touch circuit (300) may generate a magnetic field by generating an electric current (or alternating current). For example, the electronic device (101) may identify the location of an external input device (103) and recognize a touch input by the external input device (103) by detecting a change in the magnetic field (or a change in capacitance due to a change in the magnetic field).

[0081] FIG. 3b is a drawing showing an example of a display panel for displaying a 3D image according to various embodiments of the present disclosure.

[0082] FIG. 3b illustrates examples (311, 312) of a method for displaying a 3D image on a display panel (310) of an electronic device (101). The electronic device (101) of FIG. 3b may be an example of the electronic device (101) of FIG. 2. For example, the display panel (310) may be included in the electronic device (101) (or the display (110) of the electronic device (101)). For example, the display panel (310) may be referred to as a lenticular display.

[0083] In FIG. 3b, the display panel (310) may include a pixel layer (320) and a lenticular layer (330). For example, the pixel layer (320) may include a plurality of pixels (321, 322). For example, the lenticular layer (330) may include a plurality of lenticular lenses (331, 332). For example, a first lenticular lens (331) may correspond to a first pixel (321-1) and a second pixel (321-2). For example, a second lenticular lens (332) may correspond to a third pixel (322-1) and a fourth pixel (322-2). That the lenticular lenses correspond to the pixels may indicate that the lenticular lenses are placed on the path of light emitted from the pixels (or light emission path).

[0084] Referring to the example (311) of FIG. 3b, a display panel (310) can display an image through pixels (321, 322). For example, the display panel (310) can display an image to a user (390) by emitting light (350) for the image through each of all pixels (321, 322) of the pixel layer (320). At this time, the light (350) emitted to the user (390) can be provided to both of the user's (390) eyes (391, 392) respectively. In other words, light (350) emitted through the first pixel (321-1) can be diffused (or refracted) to be provided to both of the user's (390) eyes (391, 392), and light (350) emitted through the second pixel (321-2) can be diffused to be provided to both of the user's (390) eyes (391, 392). In example (311), light (350) emitted from each of the pixels (321, 322) is provided equally to both of the user's (390) eyes (391, 392), so the user (390) can perceive a single image displayed on the display panel (310). At this time, the single image perceived by the user (390) may be a 2D image.

[0085] Referring to the example (312) of FIG. 3b, a display panel (310) can display a plurality of images through pixels (321, 322). For example, the display panel (310) can display the first image to a user (390) by emitting light (351) for the first image through a first set of pixels of a pixel layer (320). Additionally, the display panel (310) can display the second image to a user (390) by emitting light (352) for the second image through a second set of pixels of a pixel layer (320). For example, the first set of pixels may include a first pixel (321-1) and a third pixel (322-1). For example, the second set of pixels may include a second pixel (321-2) and a fourth pixel (322-2). For example, the first set of pixels may be referred to as first display areas of the display (110), and the second set of pixels may be referred to as second display areas of the display (110). As an example without limitation, the first set of pixels and the second set of pixels may alternate with each other. For example, a second pixel (321-2) may be placed next to a first pixel (321-1), a third pixel (322-1) may be placed next to a second pixel (321-2), and a fourth pixel (322-2) may be placed next to a third pixel (322-1). The light (351) emitted to the user (390) can be provided to the left eye (391) among the user's (390) eyes (391, 392), and the light (352) emitted to the user (390) can be provided to the right eye (392) among the user's (390) eyes (391, 392).In other words, light (351) emitted through each of the first pixel (321-1) and the third pixel (322-1) can be focused (or refracted) to be provided to the left eye (391) of the user (390), and light (352) emitted through each of the second pixel (321-2) and the fourth pixel (322-2) can be focused to be provided to the right eye (392) of the user (390). In example (312), light (351, 352) emitted from each of the pixels (321, 322) is provided individually to each of the two eyes (391, 392) of the user (390), so that the user (390) can perceive two images (e.g., the first image and the second image) displayed on the display panel (310). Accordingly, the user (390) can recognize a 3D image based on the disparity of multiple images.

[0086] Referring to the above description, the electronic device (101) can identify gaze information of the user's (390) eyes (391, 392) using at least one camera (220) or at least one sensor (230). For example, the gaze information may include the position of the eyes (391, 392) or the direction of gaze of the eyes (391, 392). For example, the electronic device (101) may provide light (351) to the left eye (391) and provide light (352) to the right eye (392) based on the gaze information.

[0087] In the above example, the diffusion and concentration of light may be caused by the lenticular lenses (331, 332) of the lenticular layer (330). In one example, the electronic device (101) may perform the diffusion (or refraction) and / or concentration (or refraction) of light by controlling the lenticular lenses (331, 332) of the lenticular layer (330). In one example, the electronic device (101) may perform the diffusion and / or concentration of light by adjusting the voltage applied to the lenticular lenses (331, 332). In the example of FIG. 3b, a display panel (310) is shown that provides a 2D image (or, 2D media content, 2D effect image) and a 3D image (or, 3D media content, 3D effect image) to one user (390), but the present disclosure is not limited thereto. For example, 2D images and 3D images may also be provided to users located at different locations. In one example, to provide 3D images to multiple users, the display panel (310) may include a lenticular layer (330) that includes multiple layers, rather than a lenticular layer (330) that includes a single layer. Accordingly, by refracting light to each of the users located at different locations through the multiple layers (or stacked layers), 3D images may be provided to each of the multiple users through a single display panel (310).

[0088] FIGS. 4a and 4b are drawings illustrating examples of a driving method for recognizing touch input by an external input device according to various embodiments of the present disclosure.

[0089] FIG. 4a illustrates examples (400, 405) of an EMR method for recognizing touch input by an external input device (103). FIG. 4b illustrates an example of an AES method for recognizing touch input by an external input device (103). The electronic device (101) of FIG. 4a may be an example of the electronic device (101) of FIG. 2. The external input device (103) of FIG. 4a may be an example of the external input device (103) of FIG. 2. The external input device (103) of FIG. 4b may be an example of the external input device (103) of FIG. 2.

[0090] Referring to the example (400) of FIG. 4a, the electronic device (101) can generate a magnetic field through the touch circuit (300) of the display (110). For example, the electronic device (101) can generate a magnetic field through the touch circuit (300) by providing current to the touch circuit (300). For example, the touch circuit (300) may be placed under the display panel (310) of the display (110). For example, the display panel (310) may include glass (410) and a layer (420) placed under the glass (410). For example, the layer (420) may include the pixel layer (320) and the lenticular layer (330) of FIG. 3b. As an example without limitation, providing current to the touch circuit (300) may be performed periodically. The magnetic field generated by the touch circuit (300) can affect the pen tip circuit (265) (or the coil of the pen tip circuit (265)) of the external input device (103). For example, the pen tip circuit (265) can be induced by the magnetic field generated by the touch circuit (300).

[0091] Referring to example (405), the pen tip circuit (265) can generate a magnetic field having a specific resonant frequency as it is induced (or current is induced) by the magnetic field generated by the touch circuit (300). For example, the electronic device (101) can recognize a touch input by the external input device (103) by identifying (or receiving) the magnetic field having the specific resonant frequency generated from the pen tip circuit (265) through the touch circuit (300). For example, identifying the magnetic field may include identifying a change in the magnetic field. In other words, the external input device (103) can operate as a transmitter, and the electronic device (101) (or touch circuit (300)) can operate as a receiver.

[0092] In the example (405) of FIG. 4a, a hovering input case is illustrated, in which the external input device (103) is a touch input that is not in contact with the display (110) of the electronic device (101), but the present disclosure is not limited thereto. For example, an input including contact points, in which the external input device (103) is a touch input that is in contact with the display (110) of the electronic device (101), can be understood substantially the same.

[0093] For example, when an external input device (103) comes into contact with the display (110) of an electronic device (101), the electronic device (101) can identify the pressure of the touch input by the external input device (103). For example, when the external input device (103) comes into contact with the display (110), the pen tip (263) of the external input device (103) may be pressed. As the pen tip (263) is pressed, the connection state of the pen tip circuit (265) within the external input device (103) may change. For example, the capacitance of the variable capacitor within the pen tip circuit (265) may change. As the capacitance of the variable capacitor within the pen tip circuit (265) changes, the resonant frequency of the resonant circuit of the pen tip circuit (265) may change. As an example not limited to, as the pen tip (263) is pressed, the capacitance of the variable capacitor may increase, and accordingly, the resonant frequency may decrease. At this time, the electronic device (101) (or touch circuit (300)) can identify the pressure of the touch input by the external input device (103) as it receives a magnetic field having a reduced resonant frequency.

[0094] In the EMR method as described above, when the electronic device (101) recognizes a touch input (e.g., a hovering input or an input including contact points) of an external input device (103) using a touch circuit (300), the external input device (103) may not include a battery (277). In other words, in the EMR method, even if the external input device (103) does not include a battery (277), the touch circuit (300) may receive a magnetic field generated (or transmitted) from the pen tip circuit (265) (or a coil within the pen tip circuit (265)) of the external input device (103) induced by a magnetic field generated (or transmitted) from the touch circuit (300). However, the present disclosure is not limited thereto. For example, even in the case of the EMR method, the external input device (103) may include a battery (277). The external input device (103) includes a battery (277) and can acquire data (or motion information) indicating the movement of the external input device (103) through a motion sensor (275) using power provided from the battery (277), and can transmit the acquired data (or motion information) to the electronic device (101) through a communication circuit (269). For example, the electronic device (101) can identify the movement (or gesture) of the external input device (103) based on the motion information. For example, the electronic device (101) can provide a function of the electronic device (101) according to the movement (or gesture).

[0095] Referring to FIG. 4b, the electronic device (101) can receive a signal transmitted from an external input device (103) through a touch circuit (300) of a display (110). For example, the external input device (103) can transmit a signal using electrodes (451, 452) included in a pen tip circuit (265). For example, the electrodes (451, 452) may include a first electrode (451) located at the distal end of the pen tip (263) and a second electrode (452) located at the other distal end of the pen tip (263). For example, the external input device (103) can transmit a signal through each of the electrodes (451, 452) controlled based on at least one processor (271). For example, the touch circuit (300) can receive signals transmitted from each of the electrodes (451, 452) of the external input device (103). Receiving the signals through the touch circuit (300) can be referred to as scanning through the touch circuit (300). For example, the electronic device (101) can identify the position of the first electrode (451) and the orthographically projected position of the second electrode (452) on the display (110) using the signals received through the touch circuit (300). At this time, the orthographically projected position of the second electrode (452) can indicate the position projected from the second electrode (452) onto the display (110). For example, the electronic device (101) can identify the tilt of the external input device (103) using the distance (460) between the electrodes (451, 452) and the distance (470) between the identified positions with respect to the electrodes (451, 452). For example, the electronic device (101) can recognize the pressure of a touch input by the external input device (103) using the tilt of the external input device (103).In the above example, an example of a method for recognizing the pressure is described by the electronic device (101) directly identifying the tilt of the external input device (103), but the present disclosure is not limited thereto. For example, the electronic device (101) may receive information regarding the tilt of the external input device (103) transmitted from the external input device (103) via a communication circuit (269), and may recognize the pressure using the received information.

[0096] In the AES method as described above, when the electronic device (101) recognizes a touch input (e.g., a hovering input or an input including contact points) of an external input device (103) using a touch circuit (300), the external input device (103) may include a battery (277). The battery (277) may be included within the external input device (103) so that the external input device (103) transmits a signal through electrodes (451, 452).

[0097] FIGS. 4a and 4b describe driving methods for an electronic device (101) to recognize a touch input by an external input device (103) that is adjacent to or in contact with a display (110) (or a touch circuit (300)). However, when the electronic device (101) displays a 3D image, the electronic device (101) may not recognize an input by an external input device (103) for a 3D image that is performed at a distance outside the recognizable distance by the touch circuit (300), even if the touch circuit (300) is used. A method for recognizing an input by an external input device (103) within a space recognized as where the 3D image is located may refer to FIG. 5 below.

[0098] FIG. 5 is a diagram illustrating examples of a method for an electronic device according to various embodiments of the present disclosure to recognize an input regarding a 3D image displayed through a display.

[0099] FIG. 5 illustrates examples (501, 502, 503, 504) of a method for recognizing input (or user input) from an external input device (103) regarding a 3D image while the electronic device (101) displays a 3D image through a display (110). The electronic device (101) of FIG. 5 may be an example of the electronic device (101) of FIG. 2. The external input device (103) of FIG. 5 may be an example of the external input device (103) of FIG. 2.

[0100] Referring to example (501), the electronic device (101) may display (or provide) a 3D image (530) through the display (110). To display (or provide) the 3D image (530), the electronic device (101) may simultaneously display a first image (510) and a second image (520) through the display (110). The first image (510) may include a visual object (e.g., a dog), and the second image (510) may include the visual object included in the first image (510). For example, the first image (510) may be displayed through first display areas of the display (110) (e.g., a first pixel (321-1) and a third pixel (322-1) included in the first set of pixels of FIG. 3B). For example, the second image (520) may be displayed through second display areas of the display (110) (e.g., the second pixel (321-2) and the fourth pixel (322-2) included in the second set of pixels of FIG. 3B). For example, the first display areas and the second display areas may alternate with each other. As the first image (510) and the second image (520) are displayed simultaneously, the 3D image (530) (or the visual object of the 3D image (530) (e.g., a dog)) may be perceived as being located within the space (540). The first image (510) and the second image (520) may be separated from each other. For example, the space (540) may be referred to as the actual environment above the display (110). As a non-limiting example, the range (or size) of the space (540) may be determined according to the FoV of at least one camera (220) of the electronic device (101). In FIG. 5, for convenience of explanation, the shape of the space (540) is depicted as a cuboid, but the present disclosure is not limited thereto.

[0101] As a non-limiting example, the electronic device (101) may simultaneously display a first image (510) and a second image (520) to display a 3D image (530) while the electronic device (101) (or the display (110)) is in a 3D display mode. For example, the electronic device (101) may simultaneously display the first image (510) and the second image (520) based on the execution of the 3D display mode of the electronic device (101). Although not shown in FIG. 5, the electronic device (101) may display a 2D image (or 2D media content, 2D effect image) through the display (110) before the execution of the 3D display mode (or while the 2D display mode (or normal display mode) of the electronic device (101) is executed). For example, the electronic device (101) may display an image containing the visual object through a display area of ​​the display (110). For example, the display area of ​​the display (110) may include at least some of the first display areas and the second display areas. For example, the image containing the visual object may be recognized as the visual object being located within (or on) the display area of ​​the display (110).

[0102] Referring to example (502), the electronic device (101) can identify the location (541) of a specific part of the external input device (103) while simultaneously displaying the first image (510) and the second image (520). As a non-limiting example, the location (541) of the specific part of the external input device (103) may be the location of the pen tip (263) of the external input device (103). In other words, the specific part may indicate the pen tip (263). For example, the electronic device (101) can identify the location (541) of the external input device (103) within the space (540) using at least one camera (220). Although the electronic device (101) is exemplified as identifying the location (541) of the external input device (103), the present disclosure is not limited thereto. For example, the electronic device (101) may identify not only the location of the external input device (103), but also the shape or direction of the external input device (103).

[0103] Although not illustrated in FIG. 5, the electronic device (101) may define coordinates corresponding to locations within space (540) and coordinates corresponding to the location (541) of the external input device (103). For example, the coordinates corresponding to locations within space (540) may be defined according to a reference location. For example, the reference location may be changed according to the positional relationship between the electronic device (101) and the user's eye in front of the electronic device (101). For example, the positional relationship may include the distance between the electronic device (101) and the user's eye and the direction of the user's eye with respect to the electronic device (101). For example, the distance between the electronic device (101) and the user's eye may be referenced to the position of the user's eye. For example, the direction of the user's eye with respect to the electronic device (101) may be referenced as an angle between a virtual line defined with respect to the electronic device (101) (or at least one camera (220)) and another virtual line between the electronic device (101) and the user's eye. The direction of the user's eye with respect to the electronic device (101) may change depending on the posture of the electronic device (101). Specific details regarding the method of identifying the reference position may be referenced below in FIG. 8.

[0104] For example, the location within the space (540) where the 3D image (530) is recognized as being provided may change according to the positional relationship between the electronic device (101) and the user's eye. For example, the electronic device (101) may display a first image (510) and a second image (520) to provide the 3D image (530) so that it is recognized as being located at a specific distance from the user's eye within the space (540) according to the positional relationship. As a non-limiting example, the specific distance may be fixed. As a non-limiting example, the specific distance may change according to a setting within the electronic device (101).

[0105] Referring to example (503), the electronic device (101) can determine whether the position (543) of the external input device (103) is located within a reference range. For example, the position (543) of the external input device (103) may be a position changed from position (541) as the external input device (103) moves. For example, the reference range may be referred to as a spatial range within space (540). By example, without limitation, the reference range may extend from the recognition positions of the 3D image (530) within space (540). By example, without limitation, the reference range may be the recognition positions of the 3D image (530) within space (540). For example, the recognized locations of the 3D image (530) may represent the locations of the 3D image (530) (or the visual object included in the 3D image (530)) that are recognized as being located within space (540) when the first image (510) and the second image (520) are displayed. For example, the electronic device (101) may set the reference range (or the spatial range) based on the positional relationship between the electronic device (101) and the user's eye.

[0106] As a non-limiting example, whether the position (543) of the external input device (103) is located within the reference range may indicate identifying whether the external input device (103) (or a specific part of the external input device (103) (e.g., pen tip (263)) moves within the reference range. For example, the electronic device (101) may identify whether the specific part of the external input device (103) moves within the reference range (or the spatial range) based on the position (543) of the external input device (103).

[0107] For example, the electronic device (101) may transmit a signal to the external input device (103) via the communication circuit (240) authorizing the external input device (103) to perform a function when the position (543) is within the reference range extended from the recognized positions of the 3D image (530). As an example without limitation, the signal may authorize the external input device (103) to provide feedback as a function of the external input device (103). For example, the feedback may include at least one of tactile feedback, auditory feedback, or visual feedback. Specific details regarding the feedback may be referenced in FIGS. 11a, FIGS. 11b, and FIGS. 11c.

[0108] The electronic device (101) may refrain from transmitting the signal authorizing the external input device (103) to perform a function of the external input device (103) through the communication circuit (240) when the location (543) is outside the reference range extended from the recognized locations of the 3D image (530). For example, the electronic device (101) may periodically identify the location of the external input device (103) (e.g., location (543)) and not transmit the signal.

[0109] In example (504), the electronic device (101) can acquire data indicating the movement (or position (545), gesture) of the external input device (103) while the position (545) of the external input device (103) is within the reference range. For example, the electronic device (101) can identify input regarding the 3D image (530) (or the visual object, 3D media content, 3D effect image included in the 3D image (530)) using the data indicating the movement of the external input device (103). For example, the electronic device (101) can identify the position (545) of the external input device (103) (or a specific part of the external input device (103) (e.g., pen tip (263)) as user input regarding the 3D image (530).

[0110] As a non-limiting example, the electronic device (101) may display an indicator (or pointer) within the 3D image (530) that indicates (or points to) the location (545) of the external input device (103) while the 3D image (530) is within the reference range. For example, the electronic device (101) may display the indicator within the 3D image (530) by displaying a first image (510) and a second image (520) that have been modified to represent the indicator through a display (110). For example, the indicator may be used to indicate the location of the input within the 3D image (530) to a user performing input regarding the 3D image (530), which is 3D media content (or 3D effect image).

[0111] As a non-limiting example, the electronic device (101) may provide feedback to indicate that user input to the 3D image (530) has started when the location (545) of the external input device (103) is identified as the input. For example, the feedback may be provided by changing the indicator (or visual effects displayed on the indicator). For example, the feedback may be provided by using auditory or tactile effects through an output device (e.g., speaker, actuator) of the electronic device (101). Or, for example, the feedback may be provided by using a signal transmitted from the electronic device (101) to the external input device (103). For example, the signal transmitted to the external input device (103) may be authorized to provide a function (or feedback) of the external input device (103).

[0112] For example, the electronic device (101) may execute at least one function based on the identified input. For example, the at least one function executed by the electronic device (101) may include a change in the 3D image (530) (or the visual object included in the 3D image (530)). For example, the electronic device (101) may simultaneously display, through the display (110), a third image containing a 3D image (or another visual object) modified from the 3D image (530) (or the visual object included in the 3D image (530)) and a fourth image containing the modified 3D image (or the other visual object). For example, the electronic device (101) may display the third image through the first display areas and the fourth image through the second display areas. For example, by the electronic device (101) simultaneously displaying the third image and the fourth image, the modified 3D image (or the other visual object) may be recognized as being located within space (540). As an example without limitation, the modified 3D image may be an image in which visual effects (e.g., color, shape of lines, thickness of lines, brightness) have been changed from the 3D image (530). The electronic device (101) may generate the third image and the fourth image by identifying coordinates within space (540) corresponding to the location (545) of the external input device (103) and modifying the first image (510) and the second image (520) corresponding to the coordinates, respectively.

[0113] In the above example, the electronic device (101) can change the first image (510) and the second image (520) into the third image and the fourth image based on the pressure of the input regarding the 3D image (530) of the external input device (103). For example, the electronic device (101) can receive pressure information from the external input device (103) indicating the pressure applied to the external input device (103). For example, the pressure information may indicate the pressure applied to the external input device (103) by the user's body part (590) (e.g., hand) at the part (599) where the pressure sensor (279) of the external input device (103) is located. For example, if the pressure is the first pressure, the third image can be generated based on the first change from the first image (510). If the pressure is a second pressure different from the first pressure, the third image may be generated from the first image (510) based on a second change different from the first change. As a non-limiting example, if the visual effect is the thickness of a line, the first change may include the addition of a line having a first thickness, and the second change may include the addition of a line having a second thickness different from the first thickness. However, the present disclosure is not limited thereto.

[0114] Referring to the above description, a system including an electronic device (101) and an external input device (103) can provide input regarding a 3D image (530) according to the interaction between the electronic device (101) and the external input device (103). For example, when the electronic device (101) provides a 3D image (530) by displaying a first image (510) and a second image (520), it can transmit a signal to the external input device (103) to indicate that it is in a 3D display mode. For example, the signal can be transmitted to the external input device (103) (or the communication circuit (269) of the external input device (103)) through the communication circuit (240) of the electronic device (101). In one example, the external input device (103) can obtain available data to identify pressure applied to the external input device (103). For example, the data available to identify the pressure may be obtained through a pressure sensor (279) of an external input device (103). For example, the external input device (103) may transmit pressure information indicating the pressure to an electronic device (101) (or a communication circuit (240) of the electronic device (101)) via a communication circuit (269). For example, the electronic device (101) may receive pressure information indicating the pressure applied to the external input device (103) from the external input device (103). For example, the electronic device (101) can identify the location of an external input device (103) (or a specific part of the external input device (103) (e.g., pen tip (263)) as user input regarding the 3D image (530) having the pressure. For example, the electronic device (101) can perform at least one function (e.g., a modified display of the 3D image (530)) according to the identified user input.

[0115] Referring to FIG. 5, the electronic device (101) may identify the location of an external input device (103) within a space (e.g., space (540)) where the 3D image is located while displaying a 3D image, transmit a signal to the external input device (103) to provide feedback according to the location of the external input device (103), or recognize an input regarding the 3D image of the external input device (103). The operations of the electronic device (101) described above may be explained in more detail below with reference to FIG. 6.

[0116]

[0117] FIG. 6 is a flowchart illustrating an exemplary method in which an electronic device according to various embodiments of the present disclosure transmits a signal to an external input device and performs a function according to the position of the external input device regarding a 3D image displayed through a display.

[0118] At least some of the above methods of FIG. 6 may be performed by the electronic device (101) of FIG. 2. For example, at least some of the above methods may be controlled by at least one processor (210) of the electronic device (101). In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0119] In operation (610), the electronic device (101) may generate a 3D image (or 3D media content, 3D effect image). For example, the electronic device (101) may generate multiple images for displaying the 3D image. As an example, without limitation, the electronic device (101) may identify depth information (or depth map) regarding a single 2D image (or 2D media content, 2D effect image) by analyzing the single 2D image. For example, the single 2D image may be an image obtained using at least one camera (220) and / or at least one sensor (230) of the electronic device (101), or an image obtained (or received, downloaded) from an external electronic device (e.g., a server). For example, the electronic device (101) may generate multiple images for displaying the 3D image based on the single 2D image and the depth information. Specific details regarding this may be referenced in Fig. 7 below.

[0120] In operation (620), the electronic device (101) may display a 3D image. As a non-limiting example, the electronic device (101) may display (or provide) the 3D image (or 3D media content, 3D effect image) based on the execution of the 3D display mode. For example, the electronic device (101) may simultaneously display the plurality of images generated to display the 3D image through the display (110). If the plurality of images includes a first image and a second image, the electronic device (101) may display the first image through the first display areas of the display (110) and display the second image through the second display areas of the display (110). Specific details regarding this may be referenced in FIG. 3b and FIG. 5 described above. As a non-limiting example, the first image and the second image may each be an image containing the same visual object.

[0121] In operation (630), the electronic device (101) can identify (or set) a reference position and space. For example, the electronic device (101) can acquire data indicating the posture of the electronic device (101) based on data acquired using at least one sensor (230). For example, the electronic device (101) can identify (or set) the reference position of the display (110) according to the posture of the electronic device (101) based on the data indicating the posture of the electronic device (101). Specific details regarding the method of identifying the reference position may be referenced below in FIG. 8. The electronic device (101) can identify the space on the display (110) (or electronic device (101)) defined from the identified reference position. For example, the space may be an actual environment where a 3D image is recognized as being located. For example, the center (or origin) within the space may be the reference position. As a non-limiting example, the electronic device (101) may identify the reference position and the space while displaying the 3D image in operation (620). In FIG. 6, operation (630) is illustrated as being performed after operation (620), but the present disclosure is not limited thereto. For example, the electronic device (101) may identify the reference position and the space before displaying the 3D image in operation (620) or simultaneously with displaying the 3D image in operation (620).

[0122] In operation (640), the electronic device (101) can identify the location of the external input device (103). For example, the electronic device (101) can identify the location of the external input device (103) within the space using at least one camera (220). As an example without limitation, the electronic device (101) can identify the location of the external input device (103) using images obtained through the two cameras when at least one camera (220) includes two cameras. As an example without limitation, the electronic device (101) can identify the location of the external input device (103) using images obtained through the one camera when at least one camera (220) includes one camera.

[0123] As a non-limiting example, the electronic device (101) may identify (or correct) the position of the external input device (103) based on information obtained (or received) from the external input device (103) through the communication circuit (240). For example, the information obtained from the external input device (103) may include motion information indicating the movement of the external input device (103). As a non-limiting example, the electronic device (101) may identify (or correct) the position of the external input device (103) based on motion information of the external input device (103) obtained using at least one camera (220) and / or at least one sensor (230) of the electronic device (101).

[0124] Specific details regarding the operation of identifying or correcting the position of the external input device (103) may be referenced below in FIGS. 9a, 9b, 9c, 9d, and 9e.

[0125] In operation (650), the electronic device (101) may transmit a signal authorizing the execution of the function of the external input device (103). For example, the electronic device (101) may perform a comparison between the position of the external input device (103) and a reference range (or spatial range). For example, the reference range may be determined (or set) according to the positional relationship between the electronic device (101) and the user's eye. For example, the positional relationship may include the distance between the electronic device (101) and the user's eye and the direction of the user's eye relative to the electronic device (101). For example, the distance between the electronic device (101) and the user's eye may be referenced to the position of the user's eye. For example, the direction of the user's eye with respect to the electronic device (101) may be referenced as the angle between a virtual line defined with respect to the electronic device (101) (or at least one camera (220)) and a virtual line between the electronic device (101) and the user's eye. The direction of the user's eye with respect to the electronic device (101) may change depending on the posture of the electronic device (101). For example, the electronic device (101) may determine whether the position of the external input device (103) is within the reference range. As a non-limiting example, whether the position of the external input device (103) is located within the reference range may indicate identifying whether the external input device (103) (or a specific part of the external input device (103) (e.g., pen tip (263)) moves within the reference range. For example, the electronic device (101) may identify whether the specific part of the external input device (103) moves within the reference range (or the spatial range) based on the position of the external input device (103).Specific details regarding the method for determining whether the position of the external input device (103) is within the reference range may be referenced below in FIG. 10a and FIG. 10b.

[0126] For example, the electronic device (101) may transmit the signal through the communication circuit (240) to authorize the execution of the function of the external input device (103) when the position is within the reference range. For example, the external input device (103) may execute the function based on receiving the signal. For example, the function executed by the external input device (103) may include providing feedback. For example, the feedback may include at least one of tactile feedback, auditory feedback, or visual feedback. Specific examples of the feedback as the function executed by the external input device (103) may be referenced below in FIGS. 11a, FIGS. 11b, and FIGS. 11c.

[0127] In operation (660), the electronic device (101) can perform at least one function of the electronic device (101). For example, the electronic device (101) can acquire data indicating the movement of the external input device (103) using at least one camera (220) and / or at least one sensor (230) while the position of the external input device (103) is located within the reference range. For example, the electronic device (101) can identify an input regarding a 3D image using the data indicating the movement of the external input device (103).

[0128] As a non-limiting example, the electronic device (101) may display an indicator (or pointer) within the 3D image (or the 3D media content, the 3D effect image) that indicates (or points to) the position of the external input device (103) while the 3D image (or the 3D media content, the 3D effect image) is within the reference range. For example, the electronic device (101) may display the indicator within the 3D image by displaying a first image and a second image modified to represent the indicator through a display (110). For example, the indicator may be used to indicate the position of the input within the 3D image to a user performing input (or user input) regarding the 3D image, which is 3D media content.

[0129] As a non-limiting example, the electronic device (101) may provide feedback to indicate that user input to a 3D image has started when the location of the external input device (103) is identified as the input (or user input). For example, the feedback may be provided by changing the indicator (or visual effect displayed on the indicator). For example, the feedback may be provided by using an auditory or tactile effect through an output device (e.g., speaker, actuator) of the electronic device (101). Or, for example, the feedback may be provided by using a signal transmitted from the electronic device (101) to the external input device (103). For example, the signal transmitted to the external input device (103) may be authorized to provide a function (or feedback) of the external input device (103).

[0130] For example, the electronic device (101) may execute the at least one function based on the identified input. For example, the at least one function executed by the electronic device (101) may include changing the 3D image being displayed. For example, the electronic device (101) may simultaneously display a third image and a fourth image through the display (110) to display a 3D image changed from the 3D image being displayed based on the identified input. For example, the third image may be an image changed from the first image, and the fourth image may be an image changed from the second image. For example, each of the third image and the fourth image may equally include another visual object changed from the visual object included in the first image and the second image. For example, the electronic device (101) may display the third image through the first display areas and display the fourth image through the second display areas.

[0131] For example, by the electronic device (101) simultaneously displaying the third image and the fourth image, the modified 3D image (or the other visual object) may be recognized as being located within the space. As a non-limiting example, the modified 3D image may be an image in which visual effects (e.g., color, shape of lines, thickness of lines, brightness) have been changed from the 3D image displayed in the operation (620). The electronic device (101) may generate the third image and the fourth image by identifying coordinates within the space corresponding to the location of the external input device (103) and modifying the first image and the second image corresponding to the coordinates, respectively.

[0132] The electronic device (101) can change the first image and the second image into the third image and the fourth image based on the pressure of the input regarding the 3D image displayed in the operation (620) of the external input device (103). For example, the electronic device (101) can receive pressure information from the external input device (103) indicating the pressure applied to the external input device (103). For example, the pressure information may indicate the pressure applied to the part where the pressure sensor (279) of the external input device (103) is located by the user's body part (e.g., hand) to the external input device (103). Specific details related to this may be referenced below in FIG. 14. For example, if the pressure is the first pressure, the third image may be generated based on the first change from the first image. If the pressure is a second pressure different from the first pressure, the third image may be generated from the first image based on a second change different from the first change. As a non-limiting example, if the visual effect is the thickness of a line, the first change may include the addition of a line having a first thickness, and the second change may include the addition of a line having a second thickness different from the first thickness. However, the present disclosure is not limited thereto.

[0133] FIG. 7 is a drawing illustrating an exemplary method for generating a 3D image according to embodiments of the present disclosure.

[0134] FIG. 7 illustrates an example of how an electronic device (101) generates a 3D image (730) from a single 2D image (710).

[0135] For example, the electronic device (101) may acquire a 2D image (710) using at least one camera (220) and / or at least one sensor (230) of the electronic device (101). Or, for example, the electronic device (101) may acquire a 2D image (710) from an external electronic device (e.g., a server) using the communication circuit (240) of the electronic device (101). The 2D image (710) may be referenced as the original image of a 3D image (730). In other words, the original image may be an image for providing 3D media content.

[0136] For example, the electronic device (101) can identify depth information (720) regarding the 2D image (710) by analyzing the 2D image (710). For example, the depth information (720) may include depth values ​​for each location (or pixels of the 2D image (710)) within the 2D image (710). For example, the depth information (720) may be identified (or generated) by analyzing the 2D image (710) acquired through each of the two cameras, similar to how a person perceives a three-dimensional object by acquiring images of an object through two eyes and processing them in the brain.

[0137] In FIG. 7, for convenience of explanation, depth information (720) is depicted as visualized information, but depth information (720) may be data containing depth values. For example, within the visualized depth information (720), brightness may indicate depth values. For example, the bright part of the depth information (720) may indicate a relatively close location (or shallow depth) compared to the dark part.

[0138] For example, an electronic device (101) can generate a 3D image (730) using a 2D image (710) and depth information (720). For example, generating a 3D image (730) may include generating a plurality of 2D images (731, 732) using depth information (720) from a 2D image (710). For example, the electronic device (101) can display a 3D image (730) by simultaneously displaying a plurality of 2D images (731, 732) through a display (110). For example, based on the depth information (720), the 2D images (731, 732) may be generated so that the near part of the 3D image (730) is perceived as closer, and the 2D images (731, 732) may be generated so that the far part of the 3D image (730) is perceived as farther. In other words, the positional (or pixelal) coordinates of the 3D image (730) (or each of the 2D images (731, 732)) can be calculated based on the depth information (720).

[0139] FIG. 8 is a drawing illustrating an exemplary method in which an electronic device according to various embodiments of the present disclosure identifies a reference position defining a space on a display using at least one sensor.

[0140] Referring to FIG. 8, the electronic device (101) can acquire data indicating the posture of the electronic device (101) using at least one sensor (230). For example, the posture of the electronic device (101) may include an angle at which the electronic device (101) is tilted. For example, at least one sensor (230) may include a motion sensor (or an accelerometer, a gyroscope). For example, the electronic device (101) can identify a reference position (800) of the display (110) according to the posture. FIG. 8 illustrates a case where the center point of the display (110) is the reference position (800) for convenience of explanation. For example, the electronic device (101) may define three axes (810, 820, 830) centered on the reference position (800). For example, the three axes (810, 820, 830) may be orthogonal to each other. For example, the first axis (810) may be referenced as the x-axis. For example, the second axis (820) may be referenced as the y-axis. For example, the third axis (830) may be referenced as the z-axis. For example, the space above the display (110) may be defined with the reference position (800) as the origin. For example, the space may be defined as a coordinate system using the three axes (810, 820, 830) passing through the reference position (800).

[0141] For example, depending on the position of the electronic device (101), the direction of the user's eyes toward the electronic device (101) may change. For example, the direction of the user's eyes may be referenced as an angle between a virtual line defined with respect to the electronic device (101) (or at least one camera (220)) and another virtual line between the electronic device (101) and the user's eyes. For example, the virtual line may represent a line substantially parallel to the third axis (830) and passing through at least one camera (220). For example, the other virtual line may represent a line extending from at least one camera (220) to the eyes. For example, the direction may represent the direction in which the other virtual line is facing. As an example without limitation, the other virtual line and the virtual line may be aligned.

[0142]

[0143] FIGS. 9a, FIGS. 9b, FIGS. 9c, FIGS. 9d, and FIGS. 9e are drawings illustrating examples of a method in which an electronic device according to various embodiments of the present disclosure identifies the location of an external input device in space using at least one camera.

[0144] FIG. 9a illustrates an example of a method in which an electronic device (101) identifies the location (909) of an external input device (103) in space using two cameras (221, 222). For example, at least one camera (220) may include a first camera (221) and a second camera (222). For example, the first camera (221) may have a first FoV. For example, the second camera (222) may have a second FoV. By example, without limitation, the first FoV may be the same as the second FoV. However, the present disclosure is not limited thereto. For example, the first FoV may be different from the second FoV.

[0145] For example, the electronic device (101) may acquire first image data having the first FoV acquired through the first camera (221). For example, the first image data may include a virtual object corresponding to an external input device (103). For example, the electronic device (101) may calculate (or identify) a first angle (901), a second angle (902), and a third angle (903) based on the first image data. For example, the first angle (901) may represent the angle between the first axis (810a) among the three axes (810a, 820a, 830a) defined with respect to the position of the first camera (221) and a straight line from the position of the first camera (221) to the external input device (103) (or the position of a pen tip (263), which is a point of the external input device (103)). For example, the first axis (810a) may be an axis translated from the first axis (810) defined with respect to the reference position (800) of FIG. 8. For example, the second angle (902) may represent the angle between the second axis (820a) among the three axes (810a, 820a, 830a) defined with respect to the position of the first camera (221) and the straight line from the position of the first camera (221) to the external input device (103) (or the position of the pen tip (263), which is a point of the external input device (103)). For example, the second axis (820a) may be an axis translated from the second axis (820) defined with respect to the reference position (800) of FIG. 8. For example, the third angle (903) may represent the angle between the second axis (830a) among the three axes (810a, 820a, 830a) defined with respect to the position of the first camera (221) and the straight line from the position of the first camera (221) to the external input device (103) (or the position of the pen tip (263), which is a point of the external input device (103)).For example, the third axis (830a) may be an axis translated from the third axis (830) defined with respect to the reference position (800) of FIG. 8.

[0146] In the above example, the case of identifying angles (901, 902, 903) regarding the first image data obtained through the first camera (221) is described, but the present disclosure is not limited thereto. For example, the electronic device (101) may obtain second image data having the second FoV through the second camera (222). For example, the second image data may include the virtual object corresponding to the external input device (103). For example, the electronic device (101) may calculate (or identify) a fourth angle, a fifth angle, and a sixth angle based on the second image data. The method for identifying the fourth angle may be applied substantially the same as the method for identifying the first angle (901). The method for identifying the fifth angle may be applied substantially the same as the method for identifying the second angle (902). The method for identifying the sixth angle above can be applied substantially the same way as the method for identifying the third angle (903).

[0147] For example, the electronic device (101) can identify the distance (904) between the first camera (221) and the second camera (222). For example, the distance (904) may represent the distance between the axis (820b) defined with respect to the position of the second camera (222) and the second axis (820a). For example, the axis (820b) may be an axis shifted parallel from the second axis (820) defined with respect to the reference position (800) of FIG. 8.

[0148] For example, the electronic device (101) can identify the location (909) of the external input device (103) based on the identified angles (e.g., first angle (901), second angle (902), third angle (903), fourth angle, fifth angle, and sixth angle) and distance (904). For example, the location (909) may be a location within the space of the pen tip (263) of the external input device (103).

[0149] Although not illustrated in FIG. 9a, the electronic device (101) can calculate (or identify) coordinates relative to the reference position (800) of FIG. 8 when identifying the position (909) of the external input device (103). In other words, the electronic device (101) can define the position (909) as coordinates (e.g., (x, y, z)) in the space defined from the reference position (800).

[0150] In FIG. 9a, at least two cameras of camera (220) are shown, but the present disclosure is not limited thereto. For example, the electronic device (101) may identify the location of the external input device (103) by measuring the distance to the external input device (103) using at least one sensor (230).

[0151] FIG. 9b illustrates an example of a method in which an electronic device (101) identifies the location of an external input device (103) in space using one camera (e.g., one of the first camera (221) or the second camera (222) of FIG. 9a). For example, the electronic device (101) can identify the location of the external input device (103) using the camera of at least one camera (220).

[0152] For example, the electronic device (101) can acquire first image data (910) using the camera. For example, after acquiring the first image data (910), the electronic device (101) can acquire second image data (915) using the camera.

[0153] For example, the first image data (910) may include a virtual object (911) corresponding to an external input device (103). For example, a part (912) of the virtual object (911) may correspond to a part including a pen tip (263) of the external input device (103). For example, the electronic device (101) may identify the size (913) of the part (912) based on the first image data (910).

[0154] For example, the second image data (915) may include a virtual object (916) corresponding to an external input device (103). For example, a part (917) of the virtual object (916) may correspond to the part including the pen tip (263) of the external input device (103). In other words, the part of the external input device (103) corresponding to the part (917) may be the same as the part of the external input device (103) corresponding to the part (912). For example, the electronic device (101) may identify the size (918) of the part (917) based on the second image data (915).

[0155] As a non-limiting example, the size (918) may be larger than the size (913). If the size (918) of the second image data (915) acquired later is larger than the size (913), it may indicate that the external input device (103) is closer to the electronic device (101). However, the present disclosure is not limited thereto.

[0156] For example, the electronic device (101) can identify the location of the external input device (103) within the space based on the first image data (910) and the second image data (915). For example, the electronic device (101) can identify (or calculate) the location of the external input device (103) within the space (or coordinates corresponding to the location) by using the difference between the size (913) of a portion (912) of the first image data (910) and the size (918) of a portion (917) of the second image data (915). The method of FIG. 9b can identify the location of the external input device (103) with low power consumption, although the accuracy of the location of the external input device (103) is lower compared to the method of FIG. 9a.

[0157] In FIG. 9b, the use of at least one camera (220) is illustrated, but the present disclosure is not limited thereto. For example, the electronic device (101) may identify the location of the external input device (103) by measuring the distance to the external input device (103) using at least one sensor (230).

[0158] In FIGS. 9a and 9b described above, the electronic device (101) is illustrated as identifying the location of the pen tip (263) of the external input device (103) as the location of the external input device (103), but the present disclosure is not limited thereto. For example, the electronic device (101) may identify a plurality of locations related to the external input device (103). For specific details regarding this, FIG. 9c may be referenced.

[0159] FIG. 9c illustrates an example of a method in which an electronic device (101) identifies the locations of external input devices (103) within a space. For example, the electronic device (101) can identify the locations of external input devices (103) using at least one camera (220).

[0160] For example, the electronic device (101) can identify locations (931, 932, 933) of the external input device (103). For example, the electronic device (101) can identify location (931), which is the location of the pen tip (263) (or other point) of the external input device (103). For example, the electronic device (101) can identify location (932) of the external input device (103). By example, without limitation, location (932) may be a location where the user's hand (939) and the external input device (103) come into contact. For example, the electronic device (101) can identify location (933) of the hand (939) holding the external input device (103). For example, location (933) may be different from location (932). For example, the method of FIG. 9a and FIG. 9b may be used to identify each of the locations (931, 932, 933). FIG. 9c is illustrated as identifying three locations, but the present disclosure is not limited thereto. For example, the electronic device (101) may identify two locations or four or more locations.

[0161] For example, the electronic device (101) can obtain motion information of the external input device (103) by periodically identifying the positions (931, 932, 933) of the external input device (103). For example, the motion information may include the position, movement, or tilt (or attitude) of the external input device (103). For example, the electronic device (101) can correct the position of the external input device (103) (e.g., position (931)) based on the motion information. For example, the electronic device (101) can use the corrected position as the position of the external input device (103).

[0162] FIGS. 9a, 9b, and 9c described above illustrate cases where the electronic device (101) independently identifies the location of the external input device (103), but the present disclosure is not limited thereto. For example, the electronic device (101) may identify the location of the external input device (103) by using information received from the external input device (103) or by using information provided by the external input device (103). Specific details regarding this may be referenced in FIGS. 9d and 9e below.

[0163] FIG. 9d illustrates an example of a method for an electronic device (101) to identify the location of an external input device (103) using motion information (945) received from an external input device (103).

[0164] For example, the external input device (103) may obtain data indicating motion information (945) of the external input device (103) using a motion sensor (275). As an example without limitation, the motion information (945) may include the position, movement (or rotation), or tilt (or attitude) of the external input device (103) using the data, which is a sensor value obtained through an accelerometer and / or a gyroscope. For example, the external input device (103) may generate motion information (945) processed based on the data. For example, the external input device (103) may transmit the motion information (945) to the electronic device (101) through a communication circuit (269). In the above example, motion information (945) processed by an external input device (103) (or at least one processor (271) of the external input device (103)) is described as being transmitted to an electronic device (101), but the present disclosure is not limited thereto. For example, the external input device (103) may transmit the data obtained using the motion sensor (275) to the electronic device (101) without processing it. Subsequently, the data may be used to generate motion information within the electronic device (101). The method of transmitting the data may reduce the power consumption of the external input device (103) compared to transmitting the motion information (945).

[0165] For example, the electronic device (101) may use the received motion information (945) (or the data) to identify the location of the external input device (103). For example, the electronic device (101) may correct the location of the external input device (103) identified through FIG. 9a, FIG. 9b, and FIG. 9c based on the received motion information (945).

[0166] FIG. 9e illustrates an example of a method for identifying the location of an external input device (103) by the electronic device (101) identifying light (951) emitted from the IR sensor (950) of the external input device (103).

[0167] For example, an electronic device (101) can identify light (951) emitted from an IR sensor (950) of an external input device (103) using at least one camera (220). For example, the light (951) emitted from the IR sensor (950) may be infrared. Accordingly, the light (951) emitted from the external input device (103) may not be perceived by the user's eyes but may be detected by at least one camera (220) of the electronic device (101). For example, the electronic device (101) can acquire data indicating the movement (or movement, posture) of the light (951) emitted from the IR sensor (950). For example, the electronic device (101) can identify motion information (e.g., position, movement, tilt) of the external input device (103) using the acquired data. For example, the electronic device (101) can be used to identify the position of an external input device (103) based on the motion information. For example, the electronic device (101) may correct the position of the external input device (103) identified through FIG. 9a, FIG. 9b, and FIG. 9c based on the identified motion information.

[0168] FIGS. 10a and FIGS. 10b illustrate examples of a method in which an electronic device transmits a signal to an external input device according to the location of the external input device.

[0169] Referring to FIG. 10a, when displaying a 3D image (1000) (or a visual object), the electronic device (101) can identify locations (or recognized locations) where the 3D image (1000) is recognized as being located within space (1010). For example, the electronic device (101) can identify the boundaries (1005) of the recognized locations of the 3D image (1000).

[0170] For example, the electronic device (101) can identify the location (1015) of the pen tip (263) of the external input device (103). For example, the electronic device (101) can identify the location (1015) of the external input device (103) based on the methods of FIG. 8 and FIG. 9a, FIG. 9b, FIG. 9c, FIG. 9d, and FIG. 9e. For example, the location (1015) may be a location within space (1010).

[0171] For example, the electronic device (101) can identify that the location (1015) corresponds to the boundary (1005). For example, the electronic device (101) can determine whether the coordinates corresponding to the location (1015) correspond to one of the coordinates corresponding to the boundary (1005). For example, if the location (1015) corresponds to the boundary (1005), the electronic device (101) can transmit a signal to the external input device (103) via the communication circuit (240) to authorize the external input device (103) to perform its function.

[0172] Referring to FIG. 10b, the electronic device (101) can identify locations (or recognized locations) where the 3D image (1000) (or visual object) is to be recognized as being located within space (1010) when displaying the 3D image (1000). For example, the electronic device (101) can identify the boundaries (1005) of the recognized locations of the 3D image (1000). For example, the electronic device (101) can identify a reference range (1020) extending from the recognized locations (or the boundaries (1005)) within space (1010). For example, the reference range (1020) may include a range spaced apart by a distance (1025) from the boundaries (1005) of the recognized locations.

[0173] For example, the electronic device (101) can identify the location (1015) of the pen tip (263) of the external input device (103). For example, the electronic device (101) can identify the location (1015) of the external input device (103) based on the methods of FIG. 8 and FIG. 9a through 9e. For example, the location (1015) may be a location within space (1010).

[0174] For example, the electronic device (101) can identify whether the location (1015) is within the reference range (1020). For example, the electronic device (101) can determine whether the coordinates corresponding to the location (1015) match one of the coordinates corresponding to the locations included within the reference range (1020). For example, if the location (1015) is within the reference range (1020), the electronic device (101) can transmit a signal to the external input device (103) via the communication circuit (240) to authorize the external input device (103) to perform its function.

[0175] In FIG. 10a and FIG. 10b, the boundary (1005) and the reference range (1020) are described as being distinct from each other, but the present disclosure is not limited thereto. For example, the boundary (1005) may be included in the reference range (1020) or may be referenced by the reference range (1020).

[0176] FIGS. 11a, FIGS. 11b, and FIGS. 11c are drawings illustrating examples of a method in which an external input device provides feedback according to various embodiments of the present disclosure.

[0177] FIG. 11a illustrates examples (1101, 1102) of a method in which an external input device (103) provides tactile feedback. Although not illustrated in FIG. 11a, the external input device (103) may receive a signal from an electronic device (101) authorizing the execution of the function of the external input device (103).

[0178] For example, the external input device (103) may include an actuator (281) for providing tactile feedback. Examples (1101, 1102) illustrate examples of the operation (or piezo effect) of a piezo (or piezo element) used as the actuator (281). As a non-limiting example, the piezo element may include a piezoelectric element (or piezoelectric ceramic). However, the present disclosure is not limited thereto. For example, the actuator (281) may be a motor.

[0179] Referring to example (1101), when external pressure (or external impact) (1105) is applied to the actuator (281), voltage (1107) (or electricity) may be generated in the actuator (281) according to the piezoelectric effect. Referring to example (1102), when voltage (1117) (or electricity) is applied to the actuator (281) from the outside, vibration (1115) may be generated in the actuator (281) according to the inverse piezoelectric effect. For example, vibration (1115) may be caused by the actuator (281) contracting or expanding.

[0180] As described above, the external input device (103) can perform the function of outputting vibration by the actuator (281) upon receiving a signal from the electronic device (101) authorizing the execution of the function of the external input device (103). As an example without limitation, the external input device (103) can adjust the intensity of the vibration output by the actuator (281) upon receiving the signal. Or, as an example without limitation, the external input device (103) can adjust the pattern of the vibration output by the actuator (281) upon receiving the signal. For example, the pattern of the vibration may be defined by the timing, intensity, and sequence in which the vibration occurs. For example, the pattern of the vibration may be stored in the memory (273) of the external input device (103) or received from the electronic device (101).

[0181] FIG. 11b is a drawing illustrating an example (1120) of a method in which an external input device (103) according to various embodiments of the present disclosure provides auditory feedback. Although not shown in FIG. 11b, the external input device (103) may receive a signal from an electronic device (101) authorizing the execution of the function of the external input device (103).

[0182] For example, the external input device (103) may include a speaker (283) for providing auditory feedback. For example, the speaker (283) may be mounted (or installed) on the PCB (261). For example, the speaker (283) may be a surface-mounted device (SMD) mounted on the surface of the PCB (261). In the example of FIG. 11b, the speaker (283) is shown to be placed in an area of ​​the PCB (261) far from the pen tip (263), but the present disclosure is not limited thereto. For example, the area where the speaker (283) is placed on the PCB (261) may be changed.

[0183] As described above, the external input device (103) can perform the function of outputting sound by the speaker (283) upon receiving a signal from the electronic device (101) authorizing the execution of the function of the external input device (103). As an example without limitation, the external input device (103) can adjust the intensity of the sound output by the speaker (283) upon receiving the signal. As an example without limitation, the external input device (103) can adjust the pattern of the sound output by the speaker (283) upon receiving the signal. For example, the pattern of the sound may be defined by the pitch (or amplitude) of the sound, the frequency of the sound, and the intensity of the sound. For example, the pattern of the sound may be stored in the memory (273) of the external input device (103) or received from the electronic device (101).

[0184] As a non-limiting example, the speaker (283) of FIG. 11b may include a piezoelectric element including the actuator (281) of FIG. 11a. For example, the piezoelectric element included in the speaker (283) may output sound by vibration. For example, if the frequency of vibration by the piezoelectric element included in the speaker (283) is changed, a sound having a musical scale corresponding to the changed frequency may be output. Accordingly, the speaker (283) using (or including) the piezoelectric element may generate various patterns of the sound.

[0185] FIG. 11c is a drawing illustrating an example (1130) of a method in which an external input device (103) according to various embodiments of the present disclosure provides visual feedback. Although not shown in FIG. 11c, the external input device (103) may receive a signal from an electronic device (101) authorizing the execution of the function of the external input device (103).

[0186] For example, the external input device (103) may include a light-emitting unit (285) for providing visual feedback. For example, the light-emitting unit (285) may include a plurality of light-emitting elements (e.g., LEDs (light-emitting diodes)). For example, each of the plurality of light-emitting elements may emit visible light of a specific color. For example, the plurality of light-emitting elements included in the light-emitting unit (285) may emit visible light of different colors.

[0187] As described above, the external input device (103) can perform the function of outputting light by the light-emitting unit (285) upon receiving a signal from the electronic device (101) authorizing the execution of the function of the external input device (103). As an example without limitation, the external input device (103) can adjust the brightness of the light output by the light-emitting unit (285) upon receiving the signal. Or, as an example without limitation, the external input device (103) can adjust the color of the light output by the light-emitting unit (285) upon receiving the signal. Or, as an example without limitation, the external input device (103) can adjust the pattern of the light output by the light-emitting unit (285) upon receiving the signal. For example, the pattern of the light can be defined by the color of the light, the emission period of the light, and the emission intensity of the light. For example, the pattern of the light may be stored in the memory (273) of the external input device (103) or received from the electronic device (101).

[0188] Although not illustrated in FIGS. 11a, 11b, and 11c, the external input device (103) may provide feedback using components other than the actuator (281), speaker (283), and light-emitting part (285). For example, the external input device (103) may provide tactile feedback by using an electronic component capable of providing electrical friction. For example, the electrical friction may be used to allow the material of a substance represented in a 3D image to be felt on a body part (e.g., hand, finger) in contact with the external input device (103). For example, the electrical friction may also be referred to as static electricity. Or, for example, the external input device (103) may provide tactile feedback (e.g., temperature change) by using an electronic component capable of adjusting the temperature. Or, for example, the external input device (103) may provide olfactory feedback by using an electronic component capable of emitting a specific scent.

[0189] Referring to the above description, it is described that when the location of the external input device (103) (e.g., the location (1015) in FIG. 10b) is located within a reference range (e.g., the reference range (1020) in FIG. 10b), the external input device (103) provides feedback, but the present disclosure is not limited thereto. For example, the electronic device (101) may provide feedback through an output device (e.g., a speaker) of the electronic device (101) when the location of the external input device (103) (e.g., the location (1015) in FIG. 10b) is located within a reference range (e.g., the reference range (1020) in FIG. 10b).

[0190] FIGS. 12a and FIGS. 12b are drawings illustrating examples of the operation of an electronic device according to the positional state of an external input device according to various embodiments of the present disclosure.

[0191] FIG. 12a illustrates an example (1200) of operation of an electronic device (101) according to the positional state of an external input device (103) within a 2D display mode of the electronic device (101). FIG. 12b illustrates an example (1250) of operation of an electronic device (101) according to the positional state of an external input device (103) within a 3D display mode of the electronic device (101). The electronic device (101) of FIG. 12a and FIG. 12b may be an example of the electronic device (101) of FIG. 2. The external input device (103) of FIG. 12a and FIG. 12b may be an example of the external input device (103) of FIG. 2.

[0192] Referring to the example (1200) of FIG. 12a, an external input device (103) is positioned outside a different reference range (1210) from the electronic device (101) and the button (267) of the external input device (103) is not pressed (1201); the external input device (103) is positioned outside a different reference range (1210) from the electronic device (101) and the button (267) of the external input device (103) is pressed (1202); the external input device (103) is positioned within a different reference range (1210) from the electronic device (101) and is separated from the display (110) (1203); and the external input device (103) is in contact with the display (110) of the electronic device (101) (1204). For example, another reference range (1210) can define a distance from one side of the display (110) that can recognize hovering input during touch input.

[0193] As a non-limiting example, the electronic device (101) may receive pressure information indicating pressure applied to the external input device (103) from the external input device (103) via the communication circuit (240). For example, the electronic device (101) may recognize that a part of the user's body (e.g., hand) is in contact with (or gripped) the external input device (103) based on the received pressure information. The following states (1201, 1202, 1203, 1204) may be states in which the electronic device (101) recognizes that the part of the user's body is in contact with the external input device (103). However, the present disclosure is not limited thereto. For example, the electronic device (101) may perform operations according to the following states (1201, 1202, 1203, 1204) without receiving the pressure information.

[0194] In state (1201), the electronic device (101) may not recognize touch input by an external input device (103) located outside of another reference range (1210), and may refrain from identifying (or stop, do not perform) the identification of gestures by the external input device (103) because the button (267) is not pressed. Accordingly, in state (1201), the electronic device (101) may refrain from interacting with the external input device (103) or performing functions caused by the external input device (103).

[0195] In state (1202), the electronic device (101) cannot recognize touch input by an external input device (103) located outside of another reference range (1210), but can identify a gesture by the external input device (103) because the button (267) is pressed. The electronic device (101) can identify said gesture by the external input device (103) and execute a function corresponding to said gesture (or mapped, defined). By example, without limitation, said gesture may include a click, a drag, or a rotation. In the above example, the electronic device (101) is described as identifying a gesture by the external input device (103) with the button (267) pressed with respect to the external input device (103) located outside of another reference range (1210), but the present disclosure is not limited thereto. For example, the electronic device (101) may identify a gesture by the external input device (103) based on whether there is a grip identified by the pressure sensor (279) of the external input device (103), rather than whether there is an input to the button (267) of the external input device (103). As an example without limitation, the electronic device (101) may receive sensing data (or pressure information identified based on the sensing data) obtained by the external input device (103) through the pressure sensor (279), and use the received sensing data (or pressure information) to recognize that a part of the user's body (e.g., hand) is in contact with (or is gripped by) the external input device (103). At this time, the electronic device (101) may identify a gesture by the external input device (103) located outside of another reference range (1210). Additionally, for example, the external input device (103) can identify, through the pressure sensor (279), an input to the housing (or exterior) of the external input device (103) (e.g., double tap, or press through a part of the user's body (e.g., fingernail)) as a gesture, rather than an input to the button (267) (e.g., double tap).The electronic device (101) receives constant sensing data (or pressure information) indicating the identified input from an external input device (103) and may identify a gesture accordingly.

[0196] In state (1203), the electronic device (101) can recognize a hovering input by an external input device (103) located within another reference range (1210) and spaced apart from (or not in contact with) the display (110). For example, the electronic device (101) can identify a position on the display (110) for the hovering input based on a change in the magnetic field by the external input device (103). Based on the identified position, the electronic device (101) can recognize the hovering input by the external input device (103). Examples, without limitation, include a click, a drag, or a rotation.

[0197] In state (1204), the electronic device (101) can recognize an input including contact points by an external input device (103) that is in contact with the display (110). For example, the electronic device (101) can identify a location (1220) on the display (110) for the input including the contact points according to a change in the magnetic field by the external input device (103). Based on the identified location (1220), the electronic device (101) can recognize an input including the contact points by the external input device (103). As an example without limitation, the input including the contact points may include a click, a drag, or a rotation.

[0198] As a non-limiting example, the electronic device (101) can identify pressure exerted by the external input device (103) on the display (110) by identifying the degree to which the pen tip (263) of the external input device (103) is pressed according to a change in the magnetic field (or resonant frequency). For example, based on the pressure, the electronic device (101) can execute a function according to the input by the external input device (103). As a non-limiting example, the function may include changing the image (or visual object) being displayed.

[0199] In a 2D display mode, the electronic device (101) can perform operations by recognizing a gesture or touch input (e.g., a hovering input or an input including contact points) of an external input device (103) using a touch circuit (300), a communication circuit (240), or at least one camera (220) included in the display (110) of the electronic device (101).

[0200] Referring to the example (1250) of FIG. 12b, an external input device (103) is positioned outside the space (1290) from the electronic device (101), and a state (1251) in which the button (267) of the external input device (103) is not pressed, a state (1252) in which the button (267) of the external input device (103) is pressed, a state (1253) in which the external input device (103) is positioned within another reference range (1260) from the electronic device (101) and is separated from the display (110), a state (1254) in which the external input device (103) is in contact with the display (110) of the electronic device (101), and a state (1255) in which the position of the external input device (103) corresponds (or maps, matches) to recognition positions defined with respect to a 3D image displayed by the electronic device (101). For example, the space (1290) (e.g., the space (540) of FIG. 5) may be at least a part of the actual environment where the 3D image on the display (110) is recognized to be located. As an example without limitation, the space may be a space corresponding to the field of view (FoV) of at least one camera (220). For example, another reference range (1260) (e.g., the other reference range (1210) of FIG. 12a) may define a distance from one side of the display (110) that can recognize hovering input during touch input.

[0201] For example, the electronic device (101) may receive pressure information indicating pressure applied to the external input device (103) from the external input device (103) via the communication circuit (240). For example, the electronic device (101) may recognize that a part of the user's body (e.g., hand) is in contact with (or gripped by) the external input device (103) based on the received pressure information. The following states (1251, 1252, 1253, 1254, 1255) may be states in which the electronic device (101) recognizes that the part of the user's body is in contact with the external input device (103). In the case of a 3D display mode, the electronic device (101) may perform operations according to the following states (1251, 1252, 1253, 1254, 1255) based on recognizing that the body part of the user is in contact with the external input device (103). Additionally, the electronic device (101) may perform operations according to the following states (1251, 1252, 1253, 1254, 1255) based on the execution of the 3D display mode.

[0202] In state (1251), the electronic device (101) cannot recognize touch input by an external input device (103) located outside the space (1290), and since the button (267) is not pressed, it may refrain from (or stop, not perform) identifying a gesture by the external input device (103). Accordingly, in state (1251), the electronic device (101) may refrain from interacting with the external input device (103) or performing a function caused by the external input device (103).

[0203] In state (1252), the electronic device (101) can perform a gesture recognition mode according to the relationship between the location and space (1290) of the external input device (103) when the button (267) of the external input device (103) is pressed. For example, the electronic device (101) can perform a 2D gesture recognition mode when the button (267) of the external input device (103) is pressed and the external input device (103) is located outside the said location and space (1290). For example, the electronic device (101) can perform a 3D gesture recognition mode when the button (267) of the external input device (103) is pressed and the external input device (103) is located within the said location and space (1290). For example, a function corresponding to (or mapped to, defined by) a specific gesture within the 2D gesture recognition mode may differ from a function corresponding to (or mapped to, defined by) the specific gesture within the third gesture recognition mode. The electronic device (101) may identify the gesture by the external input device (103) within the 2D gesture recognition mode (or the third gesture recognition mode) and execute a function corresponding to (or mapped to, defined by) the gesture. Examples, without limitation, include clicking, dragging, or rotating. In the above examples, cases where the 2D gesture recognition mode and the third gesture recognition mode are distinguished are illustrated, but the present disclosure is not limited thereto. For example, the electronic device (101) may operate in a gesture recognition mode when the button (267) of the external input device (103) is pressed. Within the gesture recognition mode, a function corresponding to (or mapped to, defined by) the specific gesture may be executed regardless of the position of the external input device (103).

[0204] In state (1253), the electronic device (101) can recognize a hovering input by an external input device (103) that is located within another reference range (1260) and is spaced apart from (or not in contact with) the display (110). For example, if the electronic device (101) recognizes that, within the 3D display mode, the position of the external input device (103) is located within another reference range (1260) as the external input device (103) moves, the mode of the electronic device (101) can be switched (or changed, switched) from the 3D display mode to the 2D display mode. Within the 2D display mode, the method of recognizing the hovering input may be substantially the same as the content of state (1203) of FIG. 12a.

[0205] In state (1254), the electronic device (101) can recognize an input including contact points by an external input device (103) in contact with the display (110). For example, the electronic device (101) can identify a location (1270) on the display (110) for the input including the contact points according to a change in the magnetic field by the external input device (103). As described above in state (1253), the electronic device (101) may be in a state where the mode of the electronic device (101) has been switched from the 3D display mode to the 2D display mode. Within the 2D display mode, the method for recognizing the input including the contact points may be substantially the same as the content of state (1204) of FIG. 12a.

[0206] In state (1255), the electronic device (101) can identify that the position of the external input device (103) corresponds to (or maps to, matches with) recognition positions defined with respect to the 3D image displayed by the electronic device (101). The position of the external input device (103) may be located within a reference range of space (1290) (e.g., reference range (1020) of FIG. 10b). The reference range may extend from the recognition positions defined with respect to the 3D image. For example, while the position of the external input device (103) is located within the reference range, the electronic device (101) may acquire data indicating the movement of the external input device (103) using at least one camera (220) and / or at least one sensor (230). For example, the electronic device (101) can identify an input regarding a 3D image using data that directs the movement of the external input device (103). For example, the electronic device (101) can execute a function based on the identified input.

[0207] As a non-limiting example, the electronic device (101) may perform the above function based on pressure information indicating pressure applied to the external input device (103). For example, the pressure information may indicate pressure applied to the external input device (103) by a part of the user's body (e.g., hand) at the part where the pressure sensor (279) of the external input device (103) is located.

[0208] In 3D display mode, the electronic device (101) can perform operations by recognizing a gesture or touch input (e.g., a hovering input or an input including contact points) of an external input device (103) using a touch circuit (300), a communication circuit (240), or at least one camera (220) included in the display (110) of the electronic device (101).

[0209] FIG. 13 is a drawing illustrating an example of a method in which an electronic device according to various embodiments of the present disclosure displays a 3D image within a split view.

[0210] FIG. 13 illustrates an example (1301, 1302) of a method for displaying a 3D image while an electronic device (101) displays a plurality of images (1311, 1312) within a split screen through a display (110). The electronic device (101) of FIG. 13 may be an example of the electronic device (101) of FIG. 2. The external input device (103) of FIG. 13 may be an example of the external input device (103) of FIG. 2.

[0211] Referring to FIG. 13, the electronic device (101) may display an image (1311) on a first portion of the display area of ​​the display (110) within the split screen, and display an image (1312) on a second portion of the display area of ​​the display (110). For example, the second portion may be distinguishable from the first portion of the display area.

[0212] Referring to example (1301), the electronic device (101) can display an image (1311) and an image (1312) within the split screen while the electronic device (101) is in a 2D display mode. For example, the image (1311) may be recognized as being located on the display area (or the first part of the display area) of the display (110) according to the 2D display mode. For example, the image (1312) may be recognized as being located on the display area (or the second part of the display area) of the display (110) according to the 2D display mode.

[0213] As a non-limiting example, the electronic device (101) may display an icon for switching between a 3D display mode and a 2D display mode, and may perform switching between the 3D display mode and the 2D display mode of the electronic device (101) upon receiving input for said icon. However, the present disclosure is not limited thereto. For example, the electronic device (101) may perform switching between the 3D display mode and the 2D display mode of the electronic device (101) by identifying a gesture of an external input device (103) corresponding (or mapped, defined) to the switching between the 3D display mode and the 2D display mode. As described above in FIG. 12b, the electronic device (101) may switch to the 2D display mode when it recognizes a touch input (e.g., a hovering input or an input including contact points) by the external input device (103) within the 3D display mode. In this case, when the touch input by the external input device (103) ends and the position of the external input device (103) moves away from the display (110), the electronic device (101) can switch back from the 2D display mode to the 3D display mode.

[0214] Referring to the above description, the electronic device (101) can perform switching between a 3D display mode and a 2D display mode. When a plurality of images (1311, 1312) are displayed in the display area of ​​the display (110), the electronic device (101) can display some images (1311) as 3D images and maintain the display of the remaining images (1312) as 2D images. In other words, the electronic device (101) can apply a partial 3D display mode. The electronic device (101) can apply a partial 3D display mode to the part to which the 3D display mode is to be applied (e.g., the first part of the display area of ​​the display (110)) based on the identified input by identifying an input (or gesture) to the part to which the 3D display mode is to be applied.

[0215] Referring to example (1302), the electronic device (101) may simultaneously display a first image (1331) and a second image (1332) on the first portion of the display area of ​​the display (110). By simultaneously displaying the first image (1331) and the second image (1332), the 3D image (1330) may be recognized as being located within the space above the display (110) (or, the space above the first portion of the display area of ​​the display (110)). For example, the first image (1331) may be displayed through some of the first display areas of the display (110) (e.g., the first pixel (321-1) and the third pixel (322-1) included in the first set of pixels in FIG. 3B). The portion of the first display areas may represent pixels corresponding to the first portion. For example, the second image (1332) may be displayed through some of the second display areas of the display (110) (e.g., the second pixel (321-2) and the fourth pixel (322-2) included in the second set of pixels of FIG. 3B). The said portion of the second display areas may represent pixels corresponding to said second portion. While the display of the 3D image (1330) is being performed, the electronic device (101) may maintain the display of the image (1312) on said second portion of said display areas of the display (110).

[0216] In FIG. 13, an electronic device (101) is shown displaying images (1311, 1312) within the split screen, but the present disclosure is not limited thereto. For example, the method of FIG. 13 can be applied substantially the same way even when an image is displayed on the display area of ​​the display (110) within a normal screen rather than the split screen, and the displayed image includes a plurality of visual objects.

[0217] FIG. 14 is a drawing illustrating an exemplary method of an external input device recognizing pressure according to various embodiments of the present disclosure.

[0218] FIG. 14 illustrates examples (1401, 1402) of a method in which an external input device (103) uses a pressure sensor (279) to acquire data indicating pressure applied to the external input device (103) and recognizes the pressure based on the acquired data. The external input device (103) of FIG. 14 may be an example of the external input device (103) of FIG. 2. While the electronic device (101) displays a 3D image that is recognized as being located in space, the pressure sensor (279) of the external input device (103) can be used because there is no physical object such as a display (110) in the space, and the pen tip (263) of the external input device (103) is not pressed.

[0219] Referring to example (1401), the external input device (103) may come into contact with a part of the user's body (e.g., hand) (1410). For example, the user may grip the external input device (103) using the part of the body (1410). For example, the external input device (103) may acquire data indicating the pressure applied to the external input device (103) by using a pressure sensor (279) positioned adjacent to the part of the external input device (103) that is in contact with the part of the body (1410). For example, the pressure sensor (279) may include a piezo element, a touch sensor, or a sensor that measures electrical characteristics (e.g., inductance or resistance).

[0220] Referring to example (1402), the external input device (103) can recognize pressure (1420) exerted by a body part (1410) on the part of the external input device (103) where the pressure sensor (279) is placed, based on the data obtained using the pressure sensor (279). For example, the pressure (1420) may change depending on the strength with which the user grips the external input device (103) through the body part (1410).

[0221] Although not illustrated in FIG. 14, an external input device (103) may transmit pressure information indicating pressure (1420) to an electronic device (101). For example, the electronic device (101) may identify the pressure (1420) of the input regarding the 3D image based on the pressure information indicating pressure (1420). As described above, the electronic device (101) may perform a function according to the input regarding the 3D image based on the pressure (1420) used as pen pressure. As an example without limitation, the function may include adjusting a visual effect (e.g., line thickness) indicating a change in the image according to the input of the external input device (103) according to the pressure (1420). As a non-limiting example, the above function may include rotation of the 3D image (e.g., rotation from left to right) when the pressure (1420) exceeds the reference pressure and the input of the external input device (103) is identified as a swipe gesture (e.g., swipe from left to right). The rotation of the 3D image may indicate a change in the portion of the 3D image as viewed from the direction the user is looking. As a non-limiting example, the above function may include display of an internal image of the 3D image when the pressure (1420) exceeds the reference pressure. For example, the internal image of the 3D image may include a portion of the 3D image cut along a plane corresponding to the position of the external input device (103).

[0222] FIG. 15 is a signal flow diagram illustrating an exemplary method for correcting the position of an external input device as an electronic device according to various embodiments of the present disclosure receives motion information from an external input device.

[0223] FIG. 15 illustrates an example of a signal flow for a method in which an electronic device (101) identifies the position of an external input device (103) and corrects the identified position of the external input device (103) based on motion information received from the external input device (103). The electronic device (101) of FIG. 15 may be an example of the electronic device (101) of FIG. 2. The external input device (103) of FIG. 15 may be an example of the external input device (103) of FIG. 2.

[0224] In operation (1500), the electronic device (101) can identify the external input device (103). For example, the electronic device (101) can identify whether the external input device (103) is present. As an example without limitation, the electronic device (101) can identify whether the external input device (103) is present by using at least one camera (220), at least one sensor (230), or a communication circuit (240). In one example, the electronic device (101) can identify that the external input device (103) is present based on the establishment of a connection with the external input device (103) by using the communication circuit (240). If the electronic device (101) identifies that the external input device (103) is not present, it can identify whether the external input device (103) is present periodically (or non-periodically, according to a specific event).

[0225] In operation (1505), the electronic device (101) can identify the location of the external input device (103). For example, the electronic device (101) can identify the location of the external input device (103) using at least one camera (220) or at least one sensor (230). For specific details regarding this, refer to operation (640) of FIG. 6. Additionally, although not shown in FIG. 15, the electronic device (101) can identify a reference location of the electronic device (101) (or display (110)) and a space on the display (110) defined from said reference location. For specific details regarding this, refer to operation (630) of FIG. 6.

[0226] In operation (1510), the external input device (103) can obtain data indicating the movement of the external input device (103). For example, the external input device (103) can obtain the data indicating the movement by using a motion sensor (275).

[0227] As a non-limiting example, the external input device (103) may generate motion information of the external input device (103) by processing the data. For example, the motion information may include the position, movement, or tilt (or posture) of the external input device (103).

[0228] In operation (1515), the electronic device (101) can receive the motion information of the external input device (103) from the external input device (103). In one example, the external input device (103) can periodically transmit the motion information to the electronic device (101) or transmit the motion information to the electronic device (101) according to a specific event (e.g., a request received from the electronic device (101)).

[0229] In the example of FIG. 15, the motion information generated by the external input device (103) is shown as being transmitted from the external input device (103) to the electronic device (101), but the present disclosure is not limited thereto. For example, the external input device (103) may transmit the data indicating the movement to the electronic device (101), and the electronic device (101) may generate the motion information based on the received data indicating the movement.

[0230] In operation (1520), the electronic device (101) can correct the position of the external input device (103). For example, the electronic device (101) can correct the position of the external input device (103) identified in operation (1505) based on the motion information. Correcting the position may include correcting the coordinates corresponding to the identified position to new coordinates.

[0231] As a non-limiting example, the electronic device (101) can predict the movement of the external input device (103) based on the motion information. In one example, the electronic device (101) can identify the position of the external input device (103) according to the predicted movement.

[0232] FIG. 16 is a signal flow diagram illustrating an exemplary method in which an electronic device according to various embodiments of the present disclosure transmits a signal authorizing an external input device to perform a function based on a comparison of the location of the external input device and a reference range.

[0233] FIG. 16 illustrates an example of a signal flow for a method in which an electronic device (101) transmits a signal authorizing an external input device (103) to perform a function based on a comparison of the position of the external input device (103) and a reference range. The electronic device (101) of FIG. 16 may be an example of the electronic device (101) of FIG. 2. The external input device (103) of FIG. 16 may be an example of the external input device (103) of FIG. 2.

[0234] In operation (1600), the electronic device (101) may display a 3D image. As a non-limiting example, the electronic device (101) may display the 3D image based on the execution of a 3D display mode. For example, the electronic device (101) may simultaneously display the plurality of images generated to display the 3D image through the display (110). If the plurality of images includes a first image and a second image, the electronic device (101) may display the first image through the first display areas of the display (110) and display the second image through the second display areas of the display (110). Specific details regarding this may be referenced in FIG. 3b and FIG. 5 described above. As a non-limiting example, the first image and the second image may each be an image containing the same visual object.

[0235] In operation (1605), the electronic device (101) can identify the location of the external input device (103). For example, the electronic device (101) can identify the location of the external input device (103) using at least one camera (220) or at least one sensor (230). For specific details regarding this, refer to operation (640) of FIG. 6. Additionally, although not shown in FIG. 16, the electronic device (101) can identify a reference location of the electronic device (101) (or display (110)) and a space on the display (110) defined from said reference location. For specific details regarding this, refer to operation (630) of FIG. 6.

[0236] In operation (1610), the electronic device (101) can determine whether the position of the external input device (103) is within the reference range. Specific details regarding the method for determining whether the position of the external input device (103) is within the reference range may be referenced in FIG. 10a and FIG. 10b described above. In operation (1610), if the position is within the reference range, the electronic device (101) can execute operation (1615). In operation (1610), if the position is outside the reference range, the electronic device (101) can execute operation (1605).

[0237] In operation (1615), the electronic device (101) may transmit a signal authorizing the execution of the function of the external input device (103). For example, the electronic device (101) may transmit the signal authorizing the execution of the function of the external input device (103) through a communication circuit (240) when the position is within the reference range. The signal may be transmitted through a communication circuit (240) using a communication technique such as BT (or BLE).

[0238] Although not illustrated in FIG. 16, the electronic device (101) may directly provide feedback using an output device (e.g., speaker, actuator, light-emitting part) of the electronic device (101) when the position is within the reference range.

[0239] In operation (1620), the external input device (103) can perform a function. For example, the external input device (103) can perform the function based on receiving the signal. For example, the function performed by the external input device (103) may include providing feedback. For example, the feedback may include at least one of tactile feedback, auditory feedback, or visual feedback. Specific examples of the feedback as the function performed by the external input device (103) may be referenced in FIGS. 11a, 11b, and 11c described above.

[0240] FIG. 17 is a drawing illustrating an exemplary method for an electronic device according to various embodiments of the present disclosure to recognize input by an external object regarding a 3D image displayed through a display.

[0241] FIG. 17 illustrates an example of a method for recognizing input by an external object (1740) regarding a 3D image (1730) while the electronic device (101) displays a plurality of images (1710, 1720) through a display (110) to display a 3D image (1730). The electronic device (101) of FIG. 17 may be an example of the electronic device (101) of FIG. 2.

[0242] For example, the electronic device (101) may display a first image (1710) through first display areas of the display (110) and a second image (1720) through second display areas of the display (110). Specific details regarding this may be referenced in FIG. 3b and FIG. 5 described above. As a non-limiting example, the first image (1710) and the second image (1720) may each be an image containing the same visual object (e.g., a dog).

[0243] Referring to FIG. 17, the electronic device (101) can identify the location of an external object (1740). The external object (1740) may be a part of the user's body (e.g., a hand). However, the present disclosure is not limited thereto. For example, the external object (1740) may include an electronic pen, a pen, or a stick that is not connected to the electronic device (101). For example, the electronic device (101) can identify the location of the external object (1740) using at least one camera (220) or at least one sensor (230).

[0244] Although not illustrated in FIG. 17, the electronic device (101) can identify a reference position of the electronic device (101) (or display (110)) and a space on the display (110) defined from said reference position. For specific details regarding this, the operation (630) of FIG. 6 may be referenced. For example, the electronic device (101) can identify that an external object (1740) exists within said space and identify the location of the external object (1740) within said space.

[0245] The electronic device (101) may provide feedback based on a comparison between the position of the external object (1740) and the reference range. For example, the feedback may be used to indicate that the external object (1740) is adjacent to the 3D image (1730) when the position of the external object (1740) is located within the reference range. As an example, without limitation, the electronic device (101) may display notification information through the display (110) indicating that the external object (1740) is adjacent to the 3D image (1730) when the position of the external object (1740) is located within the reference range. As a non-limiting example, the electronic device (101) may output sound of a specific band (e.g., ultrasound) through speakers (or piezo elements) of the electronic device (101) so that vibrations in the external object (1740) can be recognized when the position of the external object (1740) is located within the reference range. For example, the sound output through the speakers (or piezo elements) may generate vibrations in the external object (1740) by causing the air in the area adjacent to the external object (1740) to be compressed and expanded. Alternatively, as a non-limiting example, the electronic device (101) may output sound through speakers (or piezo elements) to indicate that the external object (1740) is adjacent to the 3D image (1730) through the display (110) when the position of the external object (1740) is located within the reference range.

[0246] The electronic device (101) can identify an input regarding a 3D image (1730) by an external object (1740) and execute a function according to the input. For example, the function executed by the electronic device (101) may include changing the 3D image (1730) being displayed.

[0247] In FIGS. 2 through 17, a method is described in which an electronic device (101) identifies the location of one input device (e.g., an external input device (103) or an external object (1740)) or recognizes an input regarding a 3D image by said input device, but the present disclosure is not limited thereto. For example, the electronic device (101) may identify the locations of a plurality of input devices and recognize an input regarding a 3D image by the plurality of input devices. Specific details related thereto may be referenced below in FIGS. 18a and FIGS. 18b.

[0248] FIGS. 18a and FIGS. 18b are drawings illustrating an exemplary method for an electronic device according to various embodiments of the present disclosure to recognize a plurality of inputs regarding a 3D image displayed through a display.

[0249] FIG. 18a illustrates an example of a method for recognizing input by external objects (1740, 1800) regarding a 3D image (1730) while the electronic device (101) displays a plurality of images (1710, 1720) through a display (110), as in the example of FIG. 17. The electronic device (101) of FIG. 18a and FIG. 18b may be an example of the electronic device (101) of FIG. 2.

[0250] Referring to FIG. 18a, the electronic device (101) can identify the location of each of the external object (1740) and the external object (1800). For example, the external object (1740) may be a part of the user's body (e.g., left hand), and the external object (1800) may be another part of the user's body (e.g., right hand). However, the present disclosure is not limited thereto. For example, the external object (1740) may be a part of the first user's body, and the external object (1800) may be a part of the second user's body. For example, the external object (1740) may be a part of the user's body, and the external object (1800) may be a stick held by the user.

[0251] For example, the electronic device (101) can identify the location of the external object (1740) and the location of the external object (1800) using at least one camera (220) or at least one sensor (230).

[0252] The electronic device (101) can identify a reference position of the electronic device (101) (or, display (110)) and a space on the display (110) defined from said reference position. Specific details regarding this may be referenced to the operation (630) of FIG. 6. For example, the electronic device (101) can identify that an external object (1740) and / or an external object (1800) exist within said space, and can identify said position of the external object (1740) and / or said position of the external object (1800) within said space. As an example without limitation, the electronic device (101) can provide feedback when at least one of said position of the external object (1740) or said position of the external object (1800) is located within said reference range.

[0253] FIG. 18b illustrates an example of a method for recognizing input by external input devices (103, 1850) regarding a 3D image (1830) while the electronic device (101) displays a plurality of images (1810, 1820) through a display (110) to display the 3D image (1830). The electronic device (101) of FIG. 18b may be an example of the electronic device (101) of FIG. 2. The external input devices (103, 1850) of FIG. 18b may be an example of the external input device (103) of FIG. 2.

[0254] Referring to FIG. 18b, the electronic device (101) can identify the location of each of the external input device (103) and the external input device (1850). For example, the external input device (103) may be in contact (or gripped) with a part of the user's body (e.g., left hand) (1891), and the external input device (1850) may be in contact (or gripped) with another part of the user's body (e.g., right hand) (1892). However, the present disclosure is not limited thereto. For example, the external input device (103) may be in contact (or gripped) with a first part of the user's body (e.g., hand) (1891), and the external input device (1850) may be in contact (or gripped) with a second part of the user's body (e.g., hand) (1892).

[0255] For example, the electronic device (101) can identify the location of the external input device (103) and the location of the external input device (1850) using at least one camera (220) or at least one sensor (230). For specific details regarding this, the operation (640) of FIG. 6 may be referenced.

[0256] The electronic device (101) can identify a reference position of the electronic device (101) (or, display (110)) and a space on the display (110) defined from said reference position. For specific details regarding this, the operation (630) of FIG. 6 may be referenced.

[0257] For example, the electronic device (101) may identify the presence of external input devices (103, 1850) within the space and identify the location of the external input device (103) and / or the location of the external input device (1850) within the space. As an example, without limitation, the electronic device (101) may provide feedback when at least one of the location of the external input device (103) and the location of the external input device (1850) is located within the reference range.

[0258] Referring to FIGS. 2 through 18b, the present disclosure describes a case where an electronic device (101) displays a 3D image through a display (110) (or a lenticular display), but the present disclosure is not limited thereto. For example, the present disclosure may be substantially applicable to an electronic device (101) that includes (or uses) a display (or image player) that supports holography.

[0259] Additionally, with reference to FIGS. 2 through 18b, the present disclosure describes a case in which an electronic device (101) identifies the location of an external input device (103) (or external object) using at least one camera (220) or at least one sensor (230) and recognizes an input according to the relationship between said location of the external input device (103) and the location of a 3D image being displayed (or recognized locations), but the present disclosure is not limited thereto. For example, the present disclosure may recognize a 3D image input using gaze information of a user using the external input device (103) (or having a body part in contact with the external input device (103)). For example, the electronic device (101) may identify a user gripping the external input device (103) connected via a communication circuit (240) using at least one camera (220) or at least one sensor (230). For example, the electronic device (101) can identify the user's gaze information (or direction of gaze) and, based on the gaze information, identify the location the user is looking at as the location of the external input device (103). For convenience of explanation, it is assumed below that the location the user is looking at (or the location of the user's gaze direction) corresponds to (or maps to, matches with) the location of the 3D image (or recognized locations). The external input device (103) may be located outside the space where the 3D image is recognized as being located. In other words, the electronic device (101) may not recognize the external input device (103) using at least one camera (220). The user may move the external input device (103) located outside the space. The electronic device (101) may receive motion information from the external input device (103) that directs the movement of the external input device (103) through a communication circuit (240).The electronic device (101) can recognize the 3D image identified at the position the user is viewing as an input based on the motion information that directs the movement of the external input device (103).

[0260] FIG. 19 is a block diagram of an electronic device in a network environment according to various embodiments.

[0261] Referring to FIG. 19, in a network environment (1900), an electronic device (1901) may communicate with an electronic device (1902) through a first network (1998) (e.g., a short-range wireless communication network) or with at least one of an electronic device (1904) or a server (1908) through a second network (1999) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1901) may communicate with the electronic device (1904) through a server (1908). According to one embodiment, the electronic device (1901) may include a processor (1920), memory (1930), input module (1950), sound output module (1955), display module (1960), audio module (1970), sensor module (1976), interface (1977), connection terminal (1978), haptic module (1979), camera module (1980), power management module (1988), battery (1989), communication module (1990), subscriber identification module (1996), or antenna module (1997). In various embodiments, at least one of these components (e.g., connection terminal (1978)) may be omitted from the electronic device (1901), or one or more other components may be added. In various embodiments, some of these components (e.g., sensor module (1976), camera module (1980), or antenna module (1997)) may be integrated into a single component (e.g., display module (1960)).

[0262] The processor (1920) can, for example, execute software (e.g., program (1940)) to control at least one other component (e.g., hardware or software component) of the electronic device (1901) connected to the processor (1920) and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1920) can store commands or data received from other components (e.g., sensor module (1976) or communication module (1990)) in volatile memory (1932), process the commands or data stored in volatile memory (1932), and store the resulting data in non-volatile memory (1934). According to one embodiment, the processor (1920) may include a main processor (1921) (e.g., a central processing unit or an application processor) or an auxiliary processor (1923) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1901) includes a main processor (1921) and an auxiliary processor (1923), the auxiliary processor (1923) may be configured to use less power than the main processor (1921) or to be specialized for a designated function. The auxiliary processor (1923) may be implemented separately from the main processor (1921) or as part thereof.

[0263] Accordingly, the processor (1920) may include various processing circuits and / or multiple processors. For example, the term “processor” as used in the claims herein may include various processing circuits including at least one processor, and at least one of the at least one processor may be configured to perform the various functions described in the present disclosure individually and / or collectively in a distributed manner. When “one processor,” “at least one processor,” and “one or more processors” as used in the present disclosure are described as being configured to perform multiple functions, these terms include, but are not limited to, situations where, for example, one processor performs part of the mentioned functions and other processor(s) perform other parts of the mentioned functions, and situations where a single processor can perform all the mentioned functions. Additionally, at least one processor may include a combination of processors performing the various functions mentioned / disclosed, for example, and may be performed in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions.

[0264] The auxiliary processor (1923) may control at least some of the functions or states associated with at least one component of the electronic device (1901) (e.g., display module (1960), sensor module (1976), or communication module (1990)) on behalf of the main processor (1921) while the main processor (1921) is in an inactive (e.g., sleep) state, or together with the main processor (1921) while the main processor (1921) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1923) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1980) or communication module (1990)). According to one embodiment, the auxiliary processor (1923) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1901) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (1908)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0265] The memory (1930) may store various data used by at least one component of the electronic device (1901) (e.g., a processor (1920) or a sensor module (1976)). The data may include, for example, software (e.g., a program (1940)) and input or output data for related commands. The memory (1930) may include volatile memory (1932) or non-volatile memory (1934).

[0266] The program (1940) may be stored as software in memory (1930) and may include, for example, an operating system (1942), middleware (1944), or an application (1946).

[0267] The input module (1950) can receive commands or data to be used for a component of the electronic device (1901) (e.g., processor (1920)) from outside the electronic device (1901) (e.g., user). The input module (1950) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0268] The sound output module (1955) can output a sound signal to the outside of the electronic device (1901). The sound output module (1955) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0269] The display module (1960) can visually provide information to an external (e.g., user) of the electronic device (1901). The display module (1960) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1960) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0270] The audio module (1970) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1970) can acquire sound through an input module (1950) or output sound through an audio output module (1955) or an external electronic device (e.g., electronic device (1902)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (1901).

[0271] The sensor module (1976) can detect the operating state of the electronic device (1901) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1976) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0272] The interface (1977) may support one or more specified protocols that can be used for the electronic device (1901) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1902)). According to one embodiment, the interface (1977) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0273] The connection terminal (1978) may include a connector through which the electronic device (1901) can be physically connected to an external electronic device (e.g., electronic device (1902)). According to one embodiment, the connection terminal (1978) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0274] The haptic module (1979) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (1979) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0275] The camera module (1980) can capture still images and video. According to one embodiment, the camera module (1980) may include one or more lenses, image sensors, image signal processors, or flashes.

[0276] The power management module (1988) can manage power supplied to the electronic device (1901). According to one embodiment, the power management module (1988) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0277] The battery (1989) can supply power to at least one component of the electronic device (1901). According to one embodiment, the battery (1989) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0278] The communication module (1990) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1901) and an external electronic device (e.g., electronic device (1902), electronic device (1904), or server (1908)), and the performance of communication through the established communication channel. The communication module (1990) may include one or more communication processors that operate independently of the processor (1920) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1990) may include a wireless communication module (1992) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1994) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1904) through a first network (1998) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1999) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1992) can identify or authenticate the electronic device (1901) within a communication network such as the first network (1998) or the second network (1999) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1996).

[0279] The wireless communication module (1992) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. The NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1992) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1992) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1992) can support various requirements specified in the electronic device (1901), external electronic device (e.g., electronic device (1904)), or network system (e.g., second network (1999)). According to one embodiment, the wireless communication module (1992) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0280] An antenna module (1997) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1997) may include an antenna comprising a radiator that includes a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1997) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1998) or a second network (1999), may be selected from the plurality of antennas, for example, by a communication module (1990). A signal or power may be transmitted or received between the communication module (1990) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1997).

[0281] According to various embodiments, the antenna module (1997) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0282] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0283] According to one embodiment, commands or data may be transmitted or received between an electronic device (1901) and an external electronic device (1904) through a server (1908) connected to a second network (1999). Each of the external electronic devices (1902, or 1904) may be the same or a different type of device as the electronic device (1901). According to one embodiment, all or part of the operations performed on the electronic device (1901) may be performed on one or more of the external electronic devices (1902, 1904, or 1908). For example, if the electronic device (1901) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1901) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1901). The electronic device (1901) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1901) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (1904) may include an Internet of Things (IoT) device. The server (1908) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1904) or server (1908) may be included within the second network (1999). The electronic device (1901) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0284] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0285] As described above, the electronic device (101) may include at least one camera (220). The electronic device (101) may include at least one sensor (230). The electronic device (101) may include a communication circuit (240). The electronic device (101) may include a display (110) including first display areas and second display areas. The first display areas and the second display areas may alternate with each other. The electronic device (101) may include at least one processor (210) including a processing circuit. The electronic device (101) may include a memory (250) including one or more storage media for storing instructions. When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the first image containing a visual object to be displayed through the first display areas of the display (110) and the second image containing the visual object to be displayed through the second display areas of the display (110), based on the execution of the 3D (dimensional) display mode of the electronic device (101), so that the visual object is recognized as being located in the space above the display (110). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the location of an external input device (103) connected through the communication circuit (240) in the space to be identified based on data obtained using the at least one camera (220) or the at least one sensor (230).When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the external input device (103) to transmit a signal through the communication circuit (240) to authorize the external input device (103) to perform a function of the external input device (103) based on the location within a reference range defined with respect to the visual object in the space.

[0286] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire the data using the at least one camera (220) or the at least one sensor (230) while simultaneously displaying the first image and the second image. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the location of the external input device (103) defined with respect to the reference location of the display (110) based on the data.

[0287] According to one embodiment, the at least one sensor (230) may include an accelerometer or a gyroscope. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to obtain other data indicating the orientation or posture of the electronic device (101) using the at least one sensor (230). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the reference position of the display (110) according to the orientation of the electronic device (101) based on the other data indicating the orientation of the electronic device (101). The space may be defined from the reference position of the display (110).

[0288] According to one embodiment, the at least one camera (220) may include a first camera and a second camera positioned toward the space. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire first image data including a virtual object representing the external input device (103) according to the field of view (FoV) of the first camera, using the first camera, in order to acquire the data using the at least one camera (220) or the at least one sensor (230). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire second image data including the virtual object representing the external input device (103) according to the FoV of the second camera, using the second camera to acquire the data using the at least one camera (220) or the at least one sensor (230). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the location of the external input device (103) in the space based on the first image data, the second image data, and the distance between the first camera and the second camera.

[0289] According to one embodiment, the position of the external input device (103) within the space may indicate a point of the external input device (103). The first image data may include first angles defining the point of the external input device (103) with respect to the first camera. The second image data may include second angles defining the point of the external input device (103) with respect to the second camera.

[0290] According to one embodiment, the first image data may further include third angles defining different points of the external input device (103) with respect to the first camera. The second image data may further include fourth angles defining different points of the external input device (103) with respect to the second camera. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire motion information of the external input device (103) based on the first angles, the second angles, the third angles, and the fourth angles. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to correct the position of the external input device (103) in the space based on the motion information of the external input device (103). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the signal to be transmitted to the external input device (103) through the communication circuit (240) based on the corrected position within the reference range defined with respect to the visual object in the space.

[0291] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to receive motion information of the external input device (103) from the external input device (103) through the communication circuit (240). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to correct the position of the external input device (103) in the space based on the motion information of the external input device (103). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the signal to be transmitted to the external input device (103) through the communication circuit (240) based on the corrected position within the reference range defined with respect to the visual object in the space.

[0292] According to one embodiment, the at least one camera (220) may include a camera positioned toward the space. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire first image data including a virtual object representing the external input device (103) according to the field of view (FoV) of the camera using the at least one camera (220) or the at least one sensor (230) to acquire the data. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire second image data including the virtual object representing the external input device (103) according to the FoV of the camera using the camera after acquiring the first image data to acquire the data using the at least one camera (220) or the at least one sensor (230). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the location of the external input device (103) in the space based on a change in the size of the virtual object identified based on the first image data and the second image data.

[0293] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire other data indicating light emitted through the IR (infrared ray) sensor of the external input device (103) by using the at least one camera (220) or the at least one sensor (230) to acquire the data. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the location of the external input device (103) in the space based on the other data.

[0294] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the electronic device (101) to acquire an original image including the visual object. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the electronic device (101) to acquire depth information for the original image. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the electronic device (101) to generate the first image and the second image from the original image using the depth information.

[0295] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify recognition positions of the visual object that are recognized as being located within the space when the first image and the second image are displayed, based on the depth information. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the reference range extending from the recognition positions of the visual object.

[0296] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause a third image including the visual object to be displayed through the display (110) prior to the execution of the 3D display mode of the electronic device (101). The third image may be recognized as being located on the display (110).

[0297] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire other data indicating the movement of the external input device (103) using the at least one camera (220) or the at least one sensor (230) while the position of the external input device (103) is within the reference range defined for the visual object in the space. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify an input regarding the visual object recognized as being located in the space based on the other data indicating the movement of the external input device (103) while the position of the external input device (103) is within the reference range defined for the visual object in the space. When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to execute at least one function based on the identified input while the location of the external input device (103) is within the reference range defined with respect to the visual object in the space.

[0298] According to one embodiment, the at least one function may include simultaneously displaying a third image containing another visual object that has been at least partially modified from the visual object through the first display areas of the display (110), and a fourth image containing the other visual object through the second display areas of the display (110), so that the other visual object is recognized as being located within the space above the display (110).

[0299] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to receive pressure information indicating pressure applied to the external input device (103) from the external input device (103) via the communication circuit (240). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to generate the other visual object from the visual object based on a first change according to the pressure information indicating a first pressure. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to generate the other visual object from the visual object based on a second change different from the first change according to the pressure information indicating a second pressure different from the first pressure.

[0300] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the electronic device (101) to switch the mode of the electronic device (101) from the 3D display mode to the 2D display mode based on the location of the external input device (103) within a different reference range from the display (110). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the electronic device (101) to display a third image including the visual object based on the 2D display mode through the display (110) so that the visual object is recognized as being located on the display (110). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to recognize a touch input of the external input device (103) using the display (110) based on the 2D display mode. The touch input may include at least one of an input or a hovering input including contact points on the display (110).

[0301] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to receive another signal indicating that a physical button of the external input device (103) is pressed through the communication circuit (240). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to obtain other data indicating the movement of the external input device (103) using the at least one camera (220) or the at least one sensor (230) based on the reception of the other signal. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to execute at least one function according to the movement of the external input device (103) based on the other data.

[0302] According to one embodiment, the first image may be displayed in some of the first display areas. The second image may be displayed in some of the second display areas.

[0303] According to one embodiment, the function of the external input device (103) may include at least one of outputting vibration by an actuator of the external input device (103), outputting sound by a speaker of the external input device (103), or outputting light by an emitter of the external input device (103).

[0304] According to one embodiment, the electronic device (101) may include a tablet PC (personal computer). The external input device (103) may include a stylus pen.

[0305] As described above, the electronic device (101) may include at least one camera (220). The electronic device (101) may include a touch-sensitive display (110). The electronic device (101) may include at least one processor (210) including a processing circuit. The electronic device (101) may include a memory (250) that stores instructions and includes one or more storage media. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause two separate images to be displayed through the touch-sensitive display (110) to provide a 3D effect image in the space in front of the touch-sensitive display (110) based on the 3D (dimensional) display mode of the touch-sensitive display (110). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to set a spatial range located within the space regarding the 3D effect image based on the positional relationship between the electronic device (101) and the user's eye in front of the electronic device (101). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify whether a specific position of the stylus pen (103) moves within the spatial range through the at least one camera (220) while providing the 3D effect image.When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the position of the specific part of the stylus pen (103) as an input regarding the 3D effect image, based on the specific part of the stylus pen (103) moved into the spatial range.

[0306] According to one embodiment, the touch-sensitive display (110) may include first display areas and second display areas. The first display areas and the second display areas may alternate with each other. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the first image of the two images to be displayed through the first display areas and the second image of the two images to be displayed through the second display areas simultaneously in order to provide the 3D effect image in the space.

[0307] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire data available to identify the location of the specific part of the stylus pen (103) in the space while simultaneously displaying the first image and the second image. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the location of the specific part of the stylus pen (103) in the space according to the positional relationship between the electronic device (101) and the user's eye in front of the electronic device (101), based on the data available to identify the location of the specific part of the stylus pen (103). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify whether the specific part of the stylus pen (103) moves into the space range according to the position of the specific part of the stylus pen (103) within the space.

[0308] According to one embodiment, the electronic device (101) may include at least one sensor (230) including an accelerometer or a gyroscope. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire data available to identify the posture of the electronic device (101) through the at least one sensor (230). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the reference position of the touch-sensitive display (110) using the positional relationship determined according to the posture of the electronic device (101) based on the data available to identify the posture of the electronic device (101). The space may be defined from the reference position of the touch-sensitive display (110).

[0309] According to one embodiment, the at least one camera (220) may include a first camera and a second camera positioned toward the space. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may acquire data available for identifying the location of the specific part of the stylus pen (103) in the space by acquiring first image data including a virtual object representing the stylus pen (103) according to the field of view (FoV) of the first camera through the first camera, and acquiring second image data including the virtual object representing the stylus pen (103) according to the FoV of the second camera through the second camera. When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the location of the specific part of the stylus pen (103) in the space based on the first image data, the second image data, and the distance between the first camera and the second camera.

[0310] According to one embodiment, the specific part of the stylus pen (103) within the space may indicate the pen tip (263) of the stylus pen (103). The first image data may include first angles defining the specific part of the stylus pen (103) with respect to the first camera. The second image data may include second angles defining the specific part of the stylus pen (103) with respect to the second camera.

[0311] According to one embodiment, the electronic device (101) may further include a communication circuit (240). The first image data may further include third angles defining other specific parts of the stylus pen (103) with respect to the first camera. The second image data may further include fourth angles defining other specific parts of the stylus pen (103) with respect to the second camera. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire motion information of the stylus pen (103) based on the first angles, the second angles, the third angles, and the fourth angles. When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the position of the specific part of the stylus pen (103) within the space to be corrected based on the motion information of the stylus pen (103). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the stylus pen (103) to transmit a signal through the communication circuit (240) to the stylus pen (103) authorizing the execution of the function of the stylus pen (103) according to the corrected position of the specific range of the stylus pen (103) within the space range with respect to the 3D effect image. The above function of the stylus pen (103) may include at least one of outputting vibration by an actuator (281) of the stylus pen (103), outputting sound by a speaker (283) of the stylus pen (103), or outputting light by an emitter (285) of the stylus pen (103).

[0312] According to one embodiment, the electronic device (101) may further include a communication circuit (240). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause to receive motion information of the stylus pen (103) from the stylus pen (103) through the communication circuit (240). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause to correct the position of the specific part of the stylus pen (103) within the space based on the motion information of the stylus pen (103). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the stylus pen (103) to transmit a signal to the stylus pen (103) through the communication circuit (240) to execute a function of the stylus pen (103) according to the corrected position of the specific part of the stylus pen (103) within the spatial range in the space with respect to the 3D effect image. The function of the stylus pen (103) may include at least one of outputting vibration by an actuator (281) of the stylus pen (103), outputting sound by a speaker (283) of the stylus pen (103), or outputting light by an emitter (285) of the stylus pen (103).

[0313] According to one embodiment, the at least one camera (220) may include a camera positioned toward the space. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire first image data including a virtual object representing the stylus pen (103) according to the field of view (FoV) of the camera through the camera. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire data available for identifying the location of the specific part of the stylus pen (103) in the space by acquiring second image data including the virtual object representing the stylus pen (103) according to the FoV of the camera through the camera after acquiring the first image data. When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the location of the specific part of the stylus pen (103) in the space based on a change in the size of the virtual object identified based on the first image data and the second image data.

[0314] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to obtain data available to identify the location of the specific part of the stylus pen (103) in the space by obtaining data indicating light emitted through the IR (infrared ray) sensor of the stylus pen (103) through the at least one camera (220). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify the location of the specific part of the stylus pen (103) in the space based on the data indicating light emitted through the IR sensor of the stylus pen (103).

[0315] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire an original image for providing the 3D effect image. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to acquire depth information for the original image. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to generate the first image and the second image from the original image using the depth information.

[0316] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify recognition positions of the 3D effect image that are recognized as being located within the space when the first image and the second image are displayed, based on the depth information. When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to set the spatial range located within the space extending from the recognition positions of the 3D effect image, according to the positional relationship including the direction of the eye with respect to the electronic device (101) and the distance from the electronic device (101) to the eye.

[0317] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause one image to be displayed through the touch-sensitive display (110) to provide a 2D effect image on the touch-sensitive display (110) based on the 2D display mode prior to the execution of the 3D display mode. The 3D effect image may be recognized as being located in the space in front of the touch-sensitive display (110). The 2D effect image may be recognized as being located on the touch-sensitive display (110).

[0318] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to execute at least one function according to the identified input based on the specific part of the stylus pen (103) moved into the spatial range.

[0319] According to one embodiment, the at least one function may include displaying two other images modified from the two images through the touch-sensitive display (110) in order to provide another 3D effect image modified at least partially from the 3D effect image.

[0320] According to one embodiment, the electronic device (101) may further include a communication circuit (240). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause pressure information indicating pressure applied to the stylus pen (103) to be received from the stylus pen (103) through the communication circuit (240). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the other 3D effect image to be generated from the 3D effect image based on a first change according to the pressure information indicating a first pressure. When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to generate the other 3D effect image from the 3D effect image based on the second change different from the first change according to the pressure information indicating the second pressure different from the first pressure.

[0321] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the electronic device (101) to switch the mode of the electronic device (101) from the 3D display mode to the 2D display mode based on the position of the specific part of the stylus pen (103) within a reference range in the space from the touch-sensitive display (110). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may cause the electronic device (101) to display an image through the touch-sensitive display (110) to provide a 2D effect image on the touch-sensitive display (110) based on the 2D display mode. When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify an input received from the stylus pen (103) using the touch-sensitive display (110). The input identified using the touch-sensitive display (110) may include at least one of an input or a hovering input including contact points on the touch-sensitive display (110).

[0322] According to one embodiment, the electronic device (101) may further include a communication circuit (240). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may receive a signal indicating that the physical button (267) of the stylus pen (103) is pressed through the communication circuit (240). When the instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may obtain data available to identify the location of the specific part of the stylus pen (103) through the at least one camera (220) based on the reception of the signal. When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to perform at least one function based on the data available to identify the location of the specific part of the stylus pen (103).

[0323] As described above, the electronic device (101) may include at least one camera (220) configured to acquire images available for identifying the position of a stylus pen (103) linked to the electronic device (101) and the distance from the electronic device to the eye. The electronic device (101) may include at least one sensor (230) configured to acquire data available for identifying the direction of the eye relative to the electronic device (101). The electronic device (101) may include a touch-sensitive display (110) configured to operate in one of a 2D (two-dimensional) display mode and a 3D (three-dimensional) display mode. The electronic device (101) may include at least one processor (210) including a processing circuit. The electronic device (101) may include a memory (250) that stores instructions and includes one or more storage media. When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify input received from the stylus pen (103) using the touch-sensitive display (110) based on the 2D display mode, which represents one effect image by displaying one image through the touch-sensitive display (110). When the above instructions are executed individually or collectively by the at least one processor (210), the electronic device (101) may be caused to identify input received from the stylus pen (103) using the at least one camera (220) and the at least one sensor (230) based on the 3D display mode, which represents one effect image by displaying two separate images through the touch-sensitive display (110).

[0324] As described above, the system may include an electronic device (101). The system may include a stylus pen (103) connected to the electronic device (101). The electronic device (101) may be configured to display two separate images to provide a three-dimensional effect image in the space in front of the electronic device (101) based on a three-dimensional display mode of the electronic device (101). The electronic device (101) may be configured to transmit a signal to the stylus pen (103) to indicate the three-dimensional display mode of the electronic device (101). The stylus pen (103) may be configured to acquire available data to identify pressure applied to the stylus pen (103). The stylus pen (103) may be configured to transmit pressure information to the electronic device (101) indicating the input applied to the stylus pen (103), identified based on the data, in response to the reception of the signal from the electronic device (101). The electronic device (101) may be configured to receive pressure information from the stylus pen (103), indicating the pressure applied to the stylus pen (103). The electronic device (101) may be configured to identify the location of a specific part of the stylus pen (103) as an input regarding the 3D effect image having the pressure.

[0325]

[0326] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs from the description below.

[0327]

[0328] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0329] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0330] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software or firmware, or any combination thereof, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0331] Various embodiments of the present document may be implemented as software (e.g., program (1940)) comprising one or more instructions stored in a storage medium (e.g., internal memory (1936) or external memory (1938)) readable by a machine (e.g., electronic device (1901)). For example, a processor (e.g., processor (1920)) of the machine (e.g., electronic device (1901)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-transient' refers to a storage medium that is a tangible device and may not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily on the storage medium.

[0332] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). ™ It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0333] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0334] Although the present disclosure has been illustrated and described with reference to various exemplary embodiments, it should be understood that the various exemplary embodiments are intended to be illustrative and not limiting. Those skilled in the art should understand that various modifications, alternatives, and / or variations of the various exemplary embodiments may be made without departing from the true technical spirit and the entire technical scope of the present disclosure, including the appended claims and their equivalents. Furthermore, it should be understood that any embodiment described in the present disclosure may be used in conjunction with any other embodiment described in the present disclosure.

Claims

1. In an electronic device, At least one camera; Touch-sensitive display; At least one processor including a processing circuit; and Memory that stores instructions and includes one or more storage media, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on the 3D (dimensional) display mode of the touch-sensitive display, in order to provide a 3D effect image in the space in front of the touch-sensitive display, two images separated from each other are displayed through the touch-sensitive display; Based on the positional relationship between the electronic device and the user's eyes in front of the electronic device, a spatial range located within the space regarding the 3D effect image is set; While providing the above 3D effect image, identifying whether a specific position of the stylus pen moves within the spatial range through the at least one camera; and Based on the specific part of the stylus pen moved within the spatial range, causing the position of the specific part of the stylus pen to be identified as an input regarding the 3D effect image, Electronic device.

2. In Claim 1, The above touch-sensitive display includes first display areas and second display areas, and The first display areas and the second display areas alternate with each other, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Causing to simultaneously display the first image among the two images through the first display areas and the second image among the two images through the second display areas in order to provide the above 3D effect image in the above space, Electronic device.

3. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: While simultaneously displaying the first image and the second image, data available to identify the location of the specific part of the stylus pen within the space is obtained; Based on the data available to identify the location of the specific part of the stylus pen, the location of the specific part of the stylus pen within the space is identified according to the positional relationship between the electronic device and the user's eye in front of the electronic device; and Causing to identify whether the specific part of the stylus pen moves into the space range, depending on the position of the specific part of the stylus pen within the space. Electronic device.

4. In Claim 3, The electronic device comprises at least one sensor including an acceleration sensor and / or a gyroscope sensor, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Acquiring data available to identify the posture of the electronic device through the above at least one sensor; and Causing to identify the reference position of the touch-sensitive display using the positional relationship determined according to the position of the electronic device based on the data available to identify the position of the electronic device, and The above space is defined from the reference position of the touch-sensitive display, Electronic device.

5. In Claim 3, The above at least one camera includes a first camera and a second camera positioned toward the space, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Acquiring first image data including a virtual object representing the stylus pen according to the field of view (FoV) of the first camera through the first camera, and By acquiring second image data including a virtual object representing the stylus pen according to the FoV of the second camera through the second camera, the data available for identifying the location of the specific part of the stylus pen within the space is acquired; Causing to identify the location of the specific part of the stylus pen within the space based on the first image data, the second image data, and the distance between the first camera and the second camera. Electronic device.

6. In Claim 5, The specific part of the stylus pen within the above space indicates the pen tip of the stylus pen, and The first image data includes first angles defining the specific part of the stylus pen with respect to the first camera, and The second image data includes second angles defining the specific part of the stylus pen with respect to the second camera, Electronic device.

7. In Claim 6, The above electronic device further includes a communication circuit, and The first image data further includes third angles defining other specific parts of the stylus pen with respect to the first camera, and The second image data further includes fourth angles defining the other specific part of the stylus pen with respect to the second camera, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on the first angles, the second angles, the third angles, and the fourth angles, motion information of the stylus pen is obtained; Based on the motion information of the stylus pen, the position of the specific part of the stylus pen within the space is corrected; and With respect to the above 3D effect image, a signal authorizing the execution of a function of the stylus pen is transmitted to the stylus pen through the communication circuit according to the corrected position of the specific range of the stylus pen within the spatial range in the above space, and The above function of the stylus pen comprises at least one of outputting vibration by an actuator of the stylus pen, outputting sound by a speaker of the stylus pen, and / or outputting light by an emitter of the stylus pen. Electronic device.

8. In Claim 6, The above electronic device further includes a communication circuit, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Through the above communication circuit, motion information of the stylus pen is received from the stylus pen; Based on the motion information of the stylus pen, the position of the specific part of the stylus pen within the space is corrected; and With respect to the above 3D effect image, according to the corrected position of the specific part of the stylus pen within the spatial range in the space, a signal authorizing the execution of the function of the stylus pen is transmitted to the stylus pen through the communication circuit, and The above function of the stylus pen comprises at least one of outputting vibration by an actuator of the stylus pen, outputting sound by a speaker of the stylus pen, and / or outputting light by an emitter of the stylus pen. Electronic device.

9. In Claim 3, The above at least one camera includes a camera positioned toward the space, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Acquiring first image data including a virtual object representing the stylus pen according to the field of view (FoV) of the camera through the camera, and After acquiring the first image data, by acquiring second image data including a virtual object representing the stylus pen according to the FoV of the camera through the camera, thereby acquiring the data available for identifying the location of the specific part of the stylus pen within the space; and Causing to identify the location of the specific part of the stylus pen within the space based on a change in the size of the virtual object identified based on the first image data and the second image data, Electronic device.

10. In Claim 3, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: By acquiring data indicating light emitted through the IR (infrared ray) sensor of the stylus pen through the at least one camera, the data available for identifying the location of the specific part of the stylus pen within the space is acquired; and Causing to identify the location of the specific part of the stylus pen within the space based on the data indicating the light observed through the IR sensor of the stylus pen. Electronic device.

11. In Claim 3, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Acquire an original image to provide the above 3D effect image; Acquire depth information for the above original image; and Causing to generate the first image and the second image from the original image using the depth information above, Electronic device.

12. In Claim 11, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on the depth information above, identify recognition positions of the 3D effect image to be recognized as being located within the space based on the first image and the second image displayed simultaneously; and Causing to establish the spatial range located within the space extending from the recognition positions of the 3D effect image, according to the positional relationship including the direction of the eye with respect to the electronic device and the distance from the electronic device to the eye. Electronic device.

13. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on the 2D display mode prior to the execution of the above 3D display mode, to provide a 2D effect image on the touch-sensitive display, one image is caused to be displayed through the touch-sensitive display, and The above 3D effect image is configured to be recognized as being located in the space in front of the touch-sensitive display, and The above 2D effect image is configured to be recognized as being located on the touch-sensitive display, Electronic device.

14. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Causing to execute at least one function according to the identified input based on the specific part of the stylus pen moved within the spatial range, Electronic device.

15. In Claim 14, The above at least one function includes displaying two other images modified from the two images through the touch-sensitive display (110) in order to provide another 3D effect image modified at least partially from the 3D effect image. Electronic device (101).

Images