Electronic device, method, and non-transitory computer-readable storage medium for changing layout of screen by photographing external electronic device

Abstract

An electronic device is disclosed. The electronic device may acquire a first image of an external electronic device through at least one camera. The electronic device may request, from the external electronic device identified in the image, screen information of a first screen being displayed by the external electronic device, through at least one communication circuit. In response to receiving the screen information, the electronic device may display, through a display, a user interface including a second image reduced from the first screen. The electronic device may change the display of the second image on the basis of at least one user input associated with the user interface. The electronic device may change the layout of a second screen displayed on the display, on the basis of the changed second image.

Description

Electronic device, method, and non-transitory computer-readable storage medium for changing the layout of a screen by photographing an external electronic device

[0001] The following descriptions relate to electronic devices, methods, and non-transitory computer-readable storage media for changing the layout of a screen by photographing an external electronic device.

[0002] Electronic devices may provide a customizable user interface. Customizing the user interface may involve changing the wallpaper applied to the electronic device's home screen or lock screen, or changing the layout or style of widgets, shortcuts, or icons.

[0003] An electronic device is disclosed. The electronic device may include a display. The electronic device may include at least one camera. The electronic device may include at least one communication circuit. The electronic device may include at least one processor. The electronic device may include at least one memory storing instructions. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to obtain a first image of an external electronic device through the at least one camera. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to request, through the at least one communication circuit, screen information of a first screen being displayed by the external electronic device from the external electronic device identified in the image. The instructions, when executed by the at least one processor, may be configured to cause the electronic device, in response to receiving the screen information, to display, through the display, a user interface including a second image scaled down from the first screen. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to change the display of the second image based on at least one user input related to the user interface. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to change the layout of a second screen displayed through the display based on the changed second image.

[0004] A method is disclosed. The method can be performed in an electronic device including a display, at least one camera, and at least one communication circuit. The method can include an operation of acquiring an image of an external electronic device via the at least one camera. The method can include an operation of requesting, via the at least one communication circuit, from the external electronic device identified in the image, screen information of a first screen being displayed by the external electronic device. The method can include an operation of displaying, through the display, a user interface including a reduced image from the first screen, in response to receiving the screen information. The method can include an operation of changing the display of the image based on at least one user input related to the user interface. The method can include an operation of changing the layout of a second screen displayed through the display based on the changed image.

[0005] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may store a program including instructions. The instructions, when executed by at least one processor, may cause an electronic device including a display, at least one camera, and at least one communication circuit, to obtain a first image of an external electronic device through the at least one camera. The instructions, when executed by the at least one processor, may cause the electronic device to request, through the at least one communication circuit, screen information of a first screen being displayed by the external electronic device from the external electronic device identified in the image. The instructions, when executed by the at least one processor, may cause the electronic device, in response to receiving the screen information, to display, through the display, a user interface including a second image scaled down from the first screen. The instructions, when executed by the at least one processor, may cause the electronic device to change the display of the second image based on at least one user input related to the user interface. The instructions, when executed by the at least one processor, may cause the electronic device to change the layout of a second screen displayed through the display based on the changed second image.

[0006] An electronic device is disclosed. The electronic device may include a display. The electronic device may include at least one communication circuit. The electronic device may include at least one processor. The electronic device may include at least one memory storing instructions. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to identify an external electronic device via the at least one communication circuit. The instructions, when executed by the at least one processor, may be configured to cause the electronic device, in response to identifying the external electronic device, to update a first screen while displaying the first screen via the display to include identification information. The instructions, when executed by the at least one processor, may be configured to cause the electronic device, after updating the first screen, to receive a request for screen information of the first screen from the external electronic device via the at least one communication circuit. The instructions, when executed by the at least one processor, may be configured to cause the electronic device, in response to receiving the request, to transmit the screen information via the at least one communication circuit, such that the external electronic device displays a user interface including a reduced image from the first screen.

[0007] A method is disclosed. The method can be performed in an electronic device comprising a display and at least one communication circuit. The method can include an operation of identifying an external electronic device via the at least one communication circuit. The method can include an operation of updating a first screen to include identification information while displaying the first screen via the display in response to identifying the external electronic device. The method can include an operation of receiving a request for screen information of the first screen from the external electronic device via the at least one communication circuit. The method can include an operation of transmitting the screen information via the at least one communication circuit, in response to receiving the request, so that the external electronic device displays a user interface including a reduced image from the first screen.

[0008] A non-transitory computer-readable recording medium is disclosed. The non-transitory computer-readable recording medium may store a program including instructions. The instructions, when executed by at least one processor of an electronic device including a display and at least one communication circuit, may cause the electronic device to identify an external electronic device via the at least one communication circuit. The instructions, when executed by the at least one processor, may cause the electronic device, in response to identifying the external electronic device, to update a first screen while displaying the first screen via the display to include identification information. The instructions, when executed by the at least one processor, may cause the electronic device, after updating the first screen, to receive a request for screen information of the first screen from the external electronic device via the at least one communication circuit. The instructions, when executed by the at least one processor, may cause the electronic device, in response to receiving the request, to transmit the screen information via the at least one communication circuit, such that the external electronic device displays a user interface including a reduced image from the first screen.

[0009] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0010] Figure 2 is a simplified block diagram of an electronic device according to one embodiment.

[0011] FIG. 3A illustrates an example of a situation in which an electronic device, according to one embodiment, acquires a screen of an external electronic device.

[0012] FIG. 3b illustrates an example of a situation in which an electronic device, according to one embodiment, acquires a screen of an external electronic device.

[0013] FIG. 4A illustrates an example of a situation in which an electronic device according to one embodiment changes the layout of a screen.

[0014] FIG. 4b illustrates an example of a screen of an electronic device according to an embodiment of the present invention having been changed.

[0015] FIG. 5 illustrates an example of a situation in which an electronic device, according to one embodiment, acquires a screen of an external electronic device.

[0016] FIG. 6A illustrates an example of a situation in which an electronic device according to one embodiment changes the layout of a screen.

[0017] FIG. 6b illustrates an example of a screen of an electronic device according to an embodiment of the present invention.

[0018] FIG. 7A illustrates an example of a situation in which an electronic device, according to one embodiment, acquires a screen of an external electronic device.

[0019] FIG. 7b illustrates an example of a screen of an electronic device according to an embodiment of the present invention having been changed.

[0020] FIG. 8A illustrates an example of a situation in which an electronic device, according to one embodiment, acquires a screen of an external electronic device.

[0021] FIG. 8b illustrates an example of a screen of an electronic device according to an embodiment of the present invention having been changed.

[0022] FIG. 9A illustrates an example of a situation in which an electronic device, according to one embodiment, acquires a screen of an external electronic device.

[0023] FIG. 9b illustrates an example of a screen of an electronic device according to an embodiment of the present invention having been changed.

[0024] Figure 10 is a flowchart of operations performed by an electronic device according to one embodiment.

[0025] Figure 11 is a flowchart of operations performed by an electronic device according to one embodiment.

[0026] Figure 12 is a flowchart of operations performed by an electronic device according to one embodiment.

[0027] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0028] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0029] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0030] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0031] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0032] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0033] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0034] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0035] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0036] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0037] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0038] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0039] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0040] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0041] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0042] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0043] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0044] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0045] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 664 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 6 ms or less for round trip) for URLLC realization.

[0046] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0047] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0048] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0049] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0050] FIG. 2 is a simplified block diagram of an electronic device (101) according to one embodiment.

[0051] Referring to FIG. 2, the electronic device (101) may be connected to an electronic device (102). For example, the electronic device (101) may perform wireless communication with the electronic device (102). For example, the electronic device (101) may perform wired communication with the electronic device (102). The electronic device (102) may be referred to as an external electronic device for the electronic device (101). The electronic device (101) may be referred to as an external electronic device for the electronic device (102).

[0052] The electronic device (101) may include a processor (120), a memory (130), a display (260), a camera (280), and a communication circuit (290). Here, the electronic device (101) of FIG. 2 may correspond to the electronic device (101) of FIG. 1. The processor (120) of FIG. 2 may correspond to the processor (120) of FIG. 1. The memory (130) of FIG. 2 may correspond to the memory (130) of FIG. 1. The display (260) of FIG. 2 may correspond to the display module (160) of FIG. 1. The camera (280) of FIG. 2 may correspond to the camera module (180) of FIG. 1. The communication circuit (290) of FIG. 2 may correspond to the communication module (190) of FIG. 1.

[0053] The electronic device (102) may include a processor (220), a memory (230), a display (265), a camera (285), and a communication circuit (295). Here, the electronic device (102) of FIG. 2 may correspond to the electronic device (102) of FIG. 1. The processor (220) of FIG. 2 may correspond to the processor (120) of FIG. 1. The memory (230) of FIG. 2 may correspond to the memory (130) of FIG. 1. The display (265) of FIG. 2 may correspond to the display module (160) of FIG. 1. The camera (285) of FIG. 2 may correspond to the camera module (180) of FIG. 1. The communication circuit (295) of FIG. 2 may correspond to the communication module (190) of FIG. 1.

[0054] The electronic device (101) and the electronic device (102) may be of the same type. For example, the electronic device (101) and the electronic device (102) may be smartphones. However, this is not a limitation. The electronic device (101) and the electronic device (102) may be of different types. For example, the electronic device (101) may be a smartphone, and the electronic device (102) may be a tablet PC (personal computer), a PC, a laptop, or a smartwatch.

[0055] The electronic device (101) and the electronic device (102) can operate based on the same operating system. For example, the electronic device (101) and the electronic device (102) can operate based on Android. TM It can operate based on. However, it is not limited thereto. The electronic device (101) is an Android TM and operates based on, and the electronic device (102) is Android TM It can operate based on other operating systems.

[0056] Hereinafter, with reference to FIGS. 1 and 2, an operation of an electronic device (101) photographing an electronic device (102) and identifying the electronic device (102) will be described.

[0057] The processor (120) can identify at least one electronic device (102) around the electronic device (101) through the communication circuit (290). For example, the processor (120) can identify at least one electronic device (102) around the electronic device (101) based on a designated communication technique (e.g., ultra-wideband (UWB), Bluetooth, Wi-Fi, near field communication (NFC)). The processor (220) of the electronic device (102) can identify the electronic device (101) through the communication circuit (295). In response to identifying the electronic device (101), the processor (220) can update the display of the first screen through the display (265). For example, in response to identifying the electronic device (101), the processor (220) can update the first screen to include identification information of the electronic device (102).

[0058] The processor (120) can obtain identification information from the communication circuit (295) of the electronic device (102) through the communication circuit (290). The processor (120) can obtain identification information from at least one electronic device (102) identified through the communication circuit (290). The processor (120) can obtain identification information from the electronic device (102) based on a specified communication technique.

[0059] The processor (120) can obtain a first image of at least one electronic device (102) through the camera (280). The processor (120) can obtain a first image of at least one electronic device (102) around the electronic device (101) through the camera (280). For example, the processor (120) can obtain the first image of the electronic device (102) through a camera application. Here, the first image can include identification information output by the electronic device (102). For example, while the processor (120) takes a picture of the electronic device (102) through the camera application, the electronic device (102) can display the identification information through the display (265).

[0060] The processor (120) can identify at least one object in the first image. The processor (120) can identify at least one electronic device (102) in the first image. The processor (120) can identify at least one electronic device (102) in the first image through the communication circuit (290).

[0061] The processor (120) can determine whether the electronic device (102) is identified in the first image. The processor (120) can determine whether the electronic device (102) is included in the first image captured by the camera (280). For example, the processor (120) can determine whether the first screen of the electronic device (102) is identified in the first image. The processor (120) can determine whether the first screen of the electronic device (102) is included in the first image captured by the camera (280).

[0062] The processor (120) can identify whether the electronic device (102) identified in the first image corresponds to the electronic device (102) identified through the communication circuit (290).

[0063] The processor (120) may request screen information of the first screen being displayed on the display (265) of the electronic device (102) from the electronic device (102), if the electronic device (102) identified in the first image corresponds to the electronic device (102) identified through the communication circuit (290).

[0064] If the electronic device (102) identified in the first image does not correspond to the electronic device (102) identified through the communication circuit (290), the processor (120) may output a user interface guiding the user to re-capture the electronic device (102). For example, the processor (120) may output a user interface guiding the re-capture based on the fact that at least a portion of the electronic device (102) is not identified in the first image. The processor (120) may output a user interface guiding the re-capture based on the fact that the first screen of the electronic device (102) is not identified in the first image. If the identification information of the electronic device (102) identified in the first image does not match the identification information of the electronic device (102) acquired through the communication circuit (290), the processor (120) may output a user interface guiding the re-capture.

[0065] Hereinafter, with reference to FIG. 1 and FIG. 2, an operation of an electronic device (101) obtaining screen information from an electronic device (102) is described.

[0066] The processor (120) may request screen information from the electronic device (102). The processor (120) may request screen information from the electronic device (102) identified in the first image. The processor (120) may request screen information from the identified electronic device (102) through the communication circuit (290). Here, the screen information may include at least one of the type of the first screen being displayed through the display (265) of the electronic device (102), the layout of the first screen, an executable object of the first screen, and application information of an application that generates the first screen.

[0067] The processor (220) of the electronic device (102) can receive a request for screen information from the electronic device (101). In response to the request for screen information, the processor (220) can transmit the screen information to the electronic device (101). In response to the request for screen information, the processor (220) can transmit the screen information to the electronic device (101) so that the electronic device (101) displays a user interface corresponding to the screen information.

[0068] The processor (120) can obtain screen information from the electronic device (102). The processor (120) can obtain screen information identified in the first image. The processor (120) can obtain screen information of the first screen that the electronic device (102) is displaying. For example, the processor (120) can obtain screen information of at least one of the lock screen, home screen, or application execution screen of the electronic device (102).

[0069] The processor (120) can change the screen displayed by the display (260) based on screen information. The processor (120) can change the screen displayed by the display (260) based on the type of the first screen. For example, if the type of the first screen displayed by the electronic device (102) is a lock screen or a home screen, the processor (120) can display a user interface. Here, the user interface may be a user interface for changing the custom settings of the lock screen or the home screen of the electronic device (101). For example, if the type of the first screen displayed by the electronic device (102) is an application execution screen, the processor (120) can display an application execution screen. For example, the processor (120) can execute an application running in the foreground of the electronic device (102) and display an execution screen indicating the execution result. Here, the application running in the foreground of the electronic device (102) may be a web browser or a gallery application. But it is not limited to this.

[0070] According to an embodiment, when the electronic device (101) and the electronic device (102) operate by different operating systems, the processor (120) may request at least one of the type of the first screen, the layout of the first screen, the executable object of the first screen, and the application information of the application that generates the first screen that is compatible between the electronic device (101) and the electronic device (102).

[0071] Hereinafter, with reference to FIGS. 1 and 2, an operation of changing the layout of a screen by an electronic device (101) based on screen information obtained from an electronic device (102) is described.

[0072] The processor (120) can obtain screen information from the electronic device (102). The processor (120) can obtain screen information for the first screen. The processor (120) can obtain screen information for the lock screen or home screen of the electronic device (102).

[0073] The processor (120) may display a user interface based on screen information. In response to receiving the screen information, the processor (120) may display a user interface including an image object for the first screen. In response to receiving the screen information, the processor (120) may display a user interface including a reduced image from the first screen. Here, the user interface may include at least one selectable option field. Here, the screen information may include functions applied to the first screen of the electronic device (102). For example, screen information for a lock screen or a home screen may include functions applied to the first screen of the electronic device (102).

[0074] For example, a user interface related to a lock screen may include an option field related to shortcuts. A user interface related to a lock screen may include an option field related to widgets (e.g., widget type, location). A user interface related to a lock screen may include an option field related to layout. However, the present invention is not limited thereto. For example, a user interface related to a lock screen may include an option field related to a screen lock method applied to a first screen of an electronic device (102) (e.g., pattern, face, fingerprint, password). For example, a user interface related to a lock screen may include an option field related to a wallpaper applied to a first screen of an electronic device (102) (e.g., recommendation, gallery, graphic, color). For example, a user interface related to a lock screen may include an option field related to a font applied to a first screen of an electronic device (102) (e.g., font size, font type). For example, a user interface related to a lock screen may include an option field related to a resolution applied to a first screen of the electronic device (102). For example, a user interface related to a lock screen may include an option field related to a screen mode applied to the first screen of the electronic device (102) (e.g., vivid screen, natural screen). For example, a user interface related to a lock screen may include an option field related to a screen refresh rate applied to the first screen of the electronic device (102).

[0075] A user interface related to the home screen may include option fields related to the background screen (e.g., home layout settings, types of apps displayed within the page, location). A user interface related to the home screen may include option fields related to widgets (e.g., widget types, locations). A user interface related to the home screen may include option fields related to layout, but is not limited thereto. For example, a user interface related to the home screen may include option fields related to the home screen applied to the first screen of the electronic device (102) (e.g., media page, apps button, configuration lock, add new app, hide app). For example, a user interface related to the home screen may include option fields related to the font applied to the first screen of the electronic device (102) (e.g., font size, font type). For example, a user interface related to the home screen may include option fields related to the resolution applied to the first screen of the electronic device (102). For example, a user interface associated with a home screen may include an option field (e.g., vivid screen, natural screen) related to a screen mode applied to a first screen of the electronic device (102). For example, a user interface associated with a home screen may include an option field related to a screen refresh rate applied to a first screen of the electronic device (102). For example, a user interface associated with a home screen may include an option field related to a theme applied to a first screen of the electronic device (102).

[0076] The processor (120) may obtain at least one user input related to the user interface. For example, the processor (120) may obtain a user input for at least one of at least one selectable option field of the user interface.

[0077] The processor (120) can change the display of an image object on the first screen based on at least one user input. The processor (120) can change the display of an image object displayed on the user interface based on at least one user input.

[0078] The processor (120) can change the second screen of the electronic device (101). The processor (120) can change the layout of the second screen based on at least one user input. The processor (120) can change the layout of the second screen of the electronic device (101) corresponding to the first screen based on at least one user input. For example, the processor (120) can change the layout of the second screen of the electronic device (101) corresponding to the first screen based on at least one user input for an option field. For example, when the first screen is a lock screen, the processor (120) can change the layout of the lock screen of the electronic device (101). For example, when the first screen is a home screen, the processor (120) can change the layout of the home screen of the electronic device (101).

[0079] Hereinafter, with reference to FIGS. 1 and 2, an operation of an electronic device (101) executing an application based on screen information obtained from an electronic device (102) is described.

[0080] The processor (120) can obtain screen information from the electronic device (102). The processor (120) can obtain screen information about the first screen. The processor (120) can obtain screen information about the execution screen of an application of the electronic device (102). The processor (120) can obtain screen information about a web page accessed through a web browser of the electronic device (102). Here, the screen information about the web page may include information about the web browser and / or address information of the web page. The processor (120) can obtain screen information about the gallery application of the electronic device (102). Here, the screen information about the gallery application may include at least one of information about the gallery application, an image being displayed through the gallery application, or meta information about the image. Here, the meta information may include at least one of information about the location and time at which the image was acquired, or information about an object included in the image (e.g., the type of the object). However, the present invention is not limited thereto. For example, the meta information may include at least one of a camera model, pixels, exposure time, or lens focal length. The processor (120) may obtain screen information about an application of the electronic device (102). If the screen represents an execution screen of the application, the screen information may include information about the application and / or information related to an installation file of the application. Here, the information related to the installation file may include data for installing the application (e.g., an apk (Android application package) file) and / or a uniform resource locator (URL) that may obtain data for installing the application.

[0081] The processor (120) can change the second screen of the processor (120) based on the screen information.

[0082] When the first screen is a web browser execution screen, the processor (120) can display the web browser execution screen through the display (260). The processor (120) can display a web page displayed by the electronic device (102). The processor (120) can display the same web page through the same web browser as the electronic device (102).

[0083] When the first screen is the execution screen of the gallery application, the processor (120) can display the execution screen of the gallery application through the display (260). The processor (120) can display an image included in the first screen through the gallery application. Based on the screen information of the first screen, the processor (120) can display meta information of the image included in the first screen through the gallery application. The processor (120) can display an image displayed by the electronic device (102). The processor (120) can display the same image through the same gallery application as the electronic device (102).

[0084] The screen of the processor (120) can be changed based on the application information included in the screen information of the processor (120). For example, the processor (120) can change the screen of the processor (120) based on whether the application indicated by the application information is installed.

[0085] The processor (120) may display a screen for installing an application if the application indicated by the application information is not installed. If the application indicated by the application information is installed, the processor (120) may display a screen indicating the execution result of the application.

[0086] The processor (120) may display an application installation screen if the application indicated by the application information has not been installed. For example, the processor (120) may display an application installation screen if data for application installation (e.g., an apk file) has not been obtained. For example, the processor (120) may display an application installation screen based on a URL from which data for application installation can be obtained. The processor (120) may obtain data for application installation from the server (108) based on the URL from which data for application installation can be obtained. Here, the server (108) may be a server that stores and / or manages data for application installation.

[0087] The processor (120) may display an application execution screen when the application indicated by the application information is installed. For example, the processor (120) may display an execution screen after installing the application based on data for application installation (e.g., an apk file) and / or a URL. For example, the processor (120) may display an application execution screen after executing a pre-installed application.

[0088] According to an embodiment, after receiving screen information from the electronic device (102), the electronic device (101) may request an installation file for at least one application included in the first screen from the electronic device (102). The processor (220) of the electronic device (102) may transmit the screen information to the electronic device (101), and then receive a request for an installation file for at least one application included in the first screen from the electronic device (101). In response to receiving the request for the installation file, the processor (220) may transmit data including the installation file to the electronic device (101) through the communication circuit (295).

[0089] FIG. 3A illustrates an example of a situation in which an electronic device (101) according to an embodiment obtains an image (320) including a screen (310) of an electronic device (102). FIG. 3B illustrates an example of a situation in which an electronic device (101) according to an embodiment obtains an image (320) including a screen (310) of an electronic device (102).

[0090] Figures 3a and 3b can be explained with reference to Figures 1 and 2.

[0091] Referring to FIG. 3A, the electronic device (101) can capture an image of the electronic device (102). The electronic device (101) can capture an image of the electronic device (102) through a camera (280). The electronic device (101) can capture an image of the display (265) of the electronic device (102). The electronic device (101) can capture an image of a screen (310) displayed by the electronic device (102) through the display (265). The screen (310) can include at least one of a lock screen, a home screen, and an application execution screen.

[0092] An electronic device (101) can display an image (320) including an electronic device (102) through a display (260). Here, the image (320) can include an object (312) representing the electronic device (102). The image (320) can include an object (315) representing a screen (310) of the electronic device (102).

[0093] The electronic device (101) can determine whether the electronic device (102) is identified in the image (320). The electronic device (101) can determine whether the electronic device (102) captured by the camera (280) is included in the image (320). For example, the electronic device (101) can determine whether the screen (310) of the electronic device (102) captured by the camera (280) is included in the image (320).

[0094] Referring to FIG. 3B, the electronic device (101) may output a user interface (330) guiding re-capturing of the electronic device (102) based on the electronic device (102) not being identified in the image (320). The electronic device (101) may output the user interface (330) based on the fact that at least a portion of the electronic device (102) is not identified in the image (320). The electronic device (101) may output the user interface (330) guiding re-capturing of the electronic device (102) based on the fact that the screen (310) of the electronic device (102) is not identified in the image (320). The electronic device (101) may output the user interface (330) based on the fact that at least a portion of the screen (310) is not identified in the image (320).

[0095] Below, an operation for changing the screen of an electronic device (101) when an electronic device (102) is identified in an image (320) is described.

[0096] FIG. 4A illustrates an example of a situation in which an electronic device according to one embodiment changes the layout of its screen. FIG. 4B illustrates an example in which the screen of an electronic device according to one embodiment is changed.

[0097] FIGS. 4A and 4B can be described with reference to FIGS. 1, 2, 3A, and 3B.

[0098] The electronic device (101) can request screen information of the screen (310) from the electronic device (102). The electronic device (101) can request screen information of the screen (310) from the electronic device (102) identified in the image (320). The electronic device (101) can request screen information of the screen (310) from the electronic device (102) via the communication circuit (290). Here, the screen information can include at least one of the type of the screen (310), the layout of the screen (310), or the executable object of the screen (310).

[0099] The electronic device (101) can obtain screen information from the electronic device (102). The electronic device (101) can obtain screen information about the screen (310). The electronic device (101) can obtain screen information about the lock screen of the electronic device (102).

[0100] The electronic device (101) may display a user interface (410) based on screen information. In response to receiving the screen information, the electronic device (101) may display a user interface (410) including an object (315) on the screen (310). In response to receiving the screen information, the electronic device (101) may display a user interface (410) including a reduced image from the screen (310). Here, the user interface (410) may include at least one selectable option field (421, 423, 425). Here, the screen information may include functions applied to the screen (310) of the electronic device (102). For example, screen information for a lock screen may include functions applied to the screen (310) of the electronic device (102).

[0101] Referring to FIG. 4A, the user interface (410) may include an option field (421) related to a shortcut. The user interface (410) may include an option field (423) related to a widget. The user interface (410) may include an option field (425) related to a layout. However, the present invention is not limited thereto. For example, the user interface (410) may include an option field (e.g., pattern, face, fingerprint, password) related to a screen lock method applied to the screen (310) of the electronic device (102). For example, the user interface (410) may include an option field (e.g., recommendation, gallery, graphic, color) related to a background screen applied to the screen (310) of the electronic device (102). For example, the user interface (410) may include an option field (e.g., font size, font type) related to a font applied to the screen (310) of the electronic device (102). For example, the user interface (410) may include an option field related to a resolution applied to the screen (310) of the electronic device (102). For example, the user interface (410) may include an option field related to a screen mode applied to the screen (310) of the electronic device (102) (e.g., vivid screen, natural screen). For example, the user interface (410) may include an option field related to a screen refresh rate applied to the screen (310) of the electronic device (102). For example, the user interface (410) may include an option field related to at least one of an edge panel, a lifestyle mode, or an information layout applied to the screen (310) of the electronic device (102).

[0102] The electronic device (101) can obtain at least one user input related to the user interface (410). For example, the electronic device (101) can obtain a user input for at least one of at least one selectable option field (421, 423, 425, 427). For example, the electronic device (101) can obtain a user input for the option field (421). For example, the electronic device (101) can obtain a user input for selecting at least one of the check boxes for "Call" and "Camera" among the option fields (421). For example, the electronic device (101) can obtain a user input for the option field (423). For example, the electronic device (101) can obtain a user input for selecting at least one of the check boxes for "Weather" and "Search" among the option fields (423). For example, the electronic device (101) may obtain a user input for an option field (425). For example, the electronic device (101) may obtain a user input for selecting at least one of a check box for “Background”, a check box for “Watch”, a check box for “Icon”, or a check box for “Always on Display” among the option fields (425).

[0103] The electronic device (101) can change the display of the object (315) based on at least one user input. The electronic device (101) can change the display of the object (315) based on at least one user input related to the user interface (410). For example, the electronic device (101) can change the display of the object (315) such that the object (315) includes a shortcut for "Call" based on a user input selecting a check box for "Call" in the option field (421). For example, the electronic device (101) can change the display of the object (315) such that the object (315) includes a widget for "Weather" based on a user input selecting a check box for "Weather" in the option field (423). For example, the electronic device (101) may change the display of the object (315) to exclude the background screen of the object (315) based on a user input that deselects a check box for “background screen” in the option field (423). Here, the layout of the object (315) excluding the “background screen” may mean that the background screen of the object (315) is changed from the background screen included in the screen information. The layout of the object (315) excluding the “background screen” may mean that the background screen of the object (315) is changed from the background screen of the screen (310). The layout of the object (315) excluding the “background screen” may mean that the background screen of the object (315) is changed from the background screen of the screen (310) to the original background screen.

[0104] The electronic device (101) can change the screen of the electronic device (101). The electronic device (101) can change the layout of the screen based on at least one user input. The electronic device (101) can change the layout of the screen of the electronic device (101) corresponding to the screen (310) based on at least one user input. For example, the electronic device (101) can change the layout of the screen of the electronic device (101) corresponding to the screen (310) based on at least one user input for the option field (427). For example, the electronic device (101) can change the layout of the screen of the electronic device (101) based on a user input selecting “Select” of the option field (427). For example, if the screen (310) is a lock screen, the electronic device (101) may change the layout of the lock screen of the electronic device (101) based on a user input selecting “select” in the option field (427).

[0105] The electronic device (101) can change the screen of the electronic device (101) based on the object (315) changed according to the selectable option fields (421, 423, 425). The electronic device (101) can change the layout of the screen of the electronic device (101) based on the object (315) changed according to the selectable option fields (421, 423, 425).

[0106] Referring to FIG. 4B, the lock screen (431) of the electronic device (101) before the change may be different from the screen (310) of the electronic device (102). For example, the layout (441) related to "Watch" of the lock screen (431) may be different from the layout related to "Watch" of the screen (310). For example, the background screen (451) of the lock screen (431) may be different from the background screen of the screen (310). However, this is not limited thereto. For example, the font and font style (e.g., font size) of the lock screen (431) may be different from the font and font style of the screen (310).

[0107] The lock screen (431) of the electronic device (101) before the change may be different from the lock screen (435) after the change of the electronic device (101). For example, the layout (441) related to "Watch" of the lock screen (431) may be different from the layout (445) related to "Watch" of the lock screen (435). For example, the background screen (451) of the lock screen (431) may be different from the background screen (455) of the lock screen (435). However, the present invention is not limited thereto.

[0108] After the change of the electronic device (101), the lock screen (435) may correspond to the screen (310) of the electronic device (102). For example, the layout (445) related to "Watch" of the lock screen (435) may correspond to the layout related to "Watch" of the screen (310). For example, the background screen (455) of the lock screen (435) may correspond to the background screen of the screen (310). However, the present invention is not limited thereto.

[0109] As described above, the electronic device (101) can obtain screen information of the screen (310) on the condition that the screen (310) being displayed on the electronic device (102) is photographed. As described above, the electronic device (101) applies the custom settings applied in the electronic device (102) to the electronic device (101) based on the screen information of the electronic device (102), thereby allowing the user to complete the custom settings more conveniently.

[0110] FIG. 5 illustrates an example of a situation in which an electronic device, according to one embodiment, acquires a screen of an external electronic device.

[0111] Figure 5 can be explained with reference to Figures 1 and 2.

[0112] Referring to FIG. 5, the electronic device (101) can photograph the electronic device (102). The electronic device (101) can photograph the electronic device (102) through the camera (280). The electronic device (101) can photograph the display (265) of the electronic device (102). The electronic device (101) can photograph the screen (510) displayed by the electronic device (102) through the display (265). The screen (510) can include a home screen.

[0113] The electronic device (101) can display an image (520) including the electronic device (102) through the display (260). Here, the image (520) can include an object (512) representing the electronic device (102). The image (520) can include an object (515) representing the screen (510) of the electronic device (102).

[0114] FIG. 6A illustrates an example of a situation in which an electronic device according to one embodiment changes the layout of its screen. FIG. 6B illustrates an example in which the screen of an electronic device according to one embodiment is changed.

[0115] FIG. 6A illustrates an example of a situation in which an electronic device according to one embodiment changes the layout of its screen. FIG. 6B illustrates an example in which the screen of an electronic device according to one embodiment is changed.

[0116] Figures 6a and 6b can be explained with reference to Figures 1, 2, and 5.

[0117] The electronic device (101) can request screen information of the screen (510) from the electronic device (102). The electronic device (101) can request screen information of the screen (510) from the electronic device (102) identified in the image (520). The electronic device (101) can request screen information of the screen (510) from the electronic device (102) through the communication circuit (290). Here, the screen information can include at least one of the type of the screen (510), the layout of the screen (510), or the executable object of the screen (510).

[0118] The electronic device (101) can obtain screen information from the electronic device (102). The electronic device (101) can obtain screen information about the screen (510). The electronic device (101) can obtain screen information about the home screen of the electronic device (102).

[0119] The electronic device (101) may display a user interface (610) based on screen information. In response to receiving the screen information, the electronic device (101) may display a user interface (610) including an object (515) on the screen (510). In response to receiving the screen information, the electronic device (101) may display a user interface (610) including a reduced image from the screen (510). Here, the user interface (610) may include at least one selectable option field (621, 623, 625). Here, the screen information may include functions applied to the screen (510) of the electronic device (102). For example, the screen information for the home screen may include functions applied to the screen (510) of the electronic device (102).

[0120] Referring to FIG. 6A, the user interface (610) may include an option field (621) related to a background screen. The user interface (610) may include an option field (623) related to a widget. The user interface (610) may include an option field (625) related to a layout. However, the present invention is not limited thereto. For example, the user interface (610) may include an option field (e.g., media page, apps button, configuration lock, add new app, hide app) related to a home screen applied to the screen (510) of the electronic device (102). For example, the user interface (610) may include an option field (e.g., font size, font type) related to a font applied to the screen (510) of the electronic device (102). For example, the user interface (610) may include an option field related to a resolution applied to the screen (510) of the electronic device (102). For example, the user interface (610) may include an option field related to a screen mode applied to the screen (510) of the electronic device (102), such as vivid screen or natural screen. For example, the user interface (610) may include an option field related to a screen refresh rate applied to the screen (510) of the electronic device (102). For example, the user interface (610) may include an option field related to an icon of at least one application included in the screen (510) of the electronic device (102). For example, the user interface (610) may include an option field for inquiring about whether to install at least one application included in the screen (510) of the electronic device (102).

[0121] The electronic device (101) can obtain at least one user input related to the user interface (610). For example, the electronic device (101) can obtain a user input for at least one of at least one selectable option field (621, 623, 625, 627). For example, the electronic device (101) can obtain a user input for the option field (621). For example, the electronic device (101) can obtain a user input for selecting at least one of the check boxes for "Wallpaper" and "Color Palette" among the option fields (621). For example, the electronic device (101) can obtain a user input for the option field (623). For example, the electronic device (101) can obtain a user input for selecting at least one of the check boxes for "Weather" and "Search" among the option fields (623). For example, the electronic device (101) may obtain a user input for an option field (625). For example, the electronic device (101) may obtain a user input for selecting at least one of a check box for “Home screen arrangement,” a check box for “Apps screen arrangement,” or a check box for “Folder arrangement” among the option fields (625).

[0122] The electronic device (101) can change the display of the object (515) based on at least one user input. The electronic device (101) can change the display of the object (515) based on at least one user input related to the user interface (610). For example, the electronic device (101) can change the display of the object (515) so that the object (515) applies options (e.g., recommendations, gallery, graphics, colors) for "Wallpaper" based on a user input selecting a check box for "Wallpaper" among the option fields (621). For example, the electronic device (101) can change the display of the object (515) so that the object (515) includes a widget for "Weather" based on a user input selecting a check box for "Weather" among the option fields (623). For example, the electronic device (101) may change the display of the object (515) so that the arrangement of the home screen of the object (515) is changed based on a user input selecting a check box for “Home screen arrangement” among the option fields (623).

[0123] The electronic device (101) can change the screen of the electronic device (101). The electronic device (101) can change the layout of the screen based on at least one user input. The electronic device (101) can change the layout of the screen of the electronic device (101) corresponding to the screen (510) based on at least one user input. For example, the electronic device (101) can change the layout of the screen of the electronic device (101) corresponding to the screen (510) based on at least one user input for the option field (627). For example, the electronic device (101) can change the layout of the screen of the electronic device (101) based on a user input selecting “Select” of the option field (627). For example, if the screen (510) is a home screen, the electronic device (101) may change the layout of the home screen of the electronic device (101) based on a user input selecting “select” in the option field (627).

[0124] The electronic device (101) can change the screen of the electronic device (101) based on the object (515) changed according to the selectable option fields (621, 623, 625). The electronic device (101) can change the layout of the screen of the electronic device (101) based on the object (515) changed according to the selectable option fields (621, 623, 625).

[0125] Referring to FIG. 6B, the home screen (631) of the electronic device (101) before the change may be different from the screen (510) of the electronic device (102). For example, the layout (641) related to "Watch" of the home screen (631) may be different from the layout related to "Watch" of the screen (510). For example, the background screen (651) of the home screen (631) may be different from the background screen of the screen (510). For example, the widget (651) related to "Search" of the home screen (631) may be different from the widget related to "Search" of the screen (510). For example, the home screen arrangement (661) of the home screen (631) may be different from the home screen arrangement of the screen (510). However, the present invention is not limited thereto. For example, the app icons of the home screen (631) may be different from the app icons of the screen (510). For example, the font and font style (e.g., font size) of the home screen (631) may be different from the font and font style of the screen (510).

[0126] The home screen (631) of the electronic device (101) before the change may be different from the home screen (635) after the change of the electronic device (101). For example, the layout (641) related to "Watch" of the home screen (631) may be different from the layout (645) related to "Watch" of the home screen (635). For example, the widget (651) related to "Search" of the home screen (631) may be different from the widget (655) related to "Search" of the home screen (635). For example, the home screen arrangement (661) of the home screen (631) may be different from the home screen arrangement (665) of the home screen (635). For example, the app icons of the home screen (631) may be different from the app icons (675) of the home screen (635). However, the present invention is not limited thereto.

[0127] After the electronic device (101) is changed, the home screen (635) may correspond to the screen (510) of the electronic device (102). For example, the layout (645) related to "Watch" of the home screen (635) may correspond to the layout related to "Watch" of the screen (510). For example, the widget (655) related to "Search" of the home screen (635) may correspond to the widget related to "Search" of the screen (510). For example, the home screen arrangement (665) of the home screen (635) may correspond to the home screen arrangement of the screen (510). For example, the app icons (675) of the home screen (635) may correspond to the app icons of the screen (510). However, the present invention is not limited thereto.

[0128] As described above, the electronic device (101) can obtain screen information of the screen (510) on the condition that the screen (510) being displayed on the electronic device (102) is photographed. As described above, the electronic device (101) applies the custom settings applied in the electronic device (102) to the electronic device (101) based on the screen information of the electronic device (102), thereby allowing the user to complete the custom settings more conveniently.

[0129] In one embodiment, the electronic device (101) may request information about an installation file for a selected application from the electronic device (102) based on a user input to an option field inquiring about whether to install at least one application included in the user interface (610). The information about the installation file may include data for installing the application (e.g., an apk file) and / or a uniform resource locator (URL) that can obtain data for installing the application. The electronic device (101) may display an icon of the installed application (or an image object of the installed application) on a second screen after installing at least one application based on the information about the installation file. The electronic device (101) may arrange the icon of the installed application on the second screen based on the arrangement information after installing at least one application. Here, the arrangement information

[0130] FIG. 7A illustrates an example of a situation in which an electronic device, according to one embodiment, acquires the screen of an external electronic device. FIG. 7B illustrates an example in which the screen of an electronic device, according to one embodiment, has been changed.

[0131] Figures 7a and 7b can be explained with reference to Figures 1 and 2.

[0132] Referring to FIG. 7A, the electronic device (101) can capture an image of the electronic device (102). The electronic device (101) can capture an image of the electronic device (102) through a camera (280). The electronic device (101) can capture an image of the display (265) of the electronic device (102). The electronic device (101) can capture an image of a screen (710) displayed by the electronic device (102) through the display (265). The screen (710) can include an execution screen of an application.

[0133] The electronic device (101) can display an image (720) including the electronic device (102) through the display (260). Here, the image (720) can include an object (712) representing the electronic device (102). The image (720) can include an object (715) representing the screen (710) of the electronic device (102).

[0134] The electronic device (101) can request screen information of the screen (710) from the electronic device (102). The electronic device (101) can request screen information of the screen (710) from the electronic device (102) identified in the image (720). The electronic device (101) can request screen information of the screen (710) from the electronic device (102) through the communication circuit (290). Here, the screen information can include at least one of information of an application that generates the screen (710), a layout of the screen (710), or an executable object of the screen (710).

[0135] The electronic device (101) can obtain screen information from the electronic device (102). The electronic device (101) can obtain screen information about the screen (710). The electronic device (101) can obtain screen information about the execution screen of the application of the electronic device (102). Referring to FIG. 7A, the screen (710) can display a web page accessed through a web browser. When the screen (710) displays a web page, the screen information can include information about the web browser and / or address information of the web page.

[0136] The electronic device (101) can determine whether to display a user interface based on screen information. In response to receiving the screen information, the electronic device (101) can determine whether to display a user interface. The electronic device (101) can determine whether to display a user interface based on whether the screen (710) is an execution screen of an application. For example, if the screen (710) is an execution screen of an application, the electronic device (101) can determine not to display the user interface. For example, if the screen (710) is not an execution screen of an application, the electronic device (101) can determine to display the user interface. For example, if the screen (710) is a lock screen or a home screen, the electronic device (101) can determine to display the user interface. Here, the user interface can enable the electronic device (101) to select whether to apply at least one of the functions applied to the screen (710) of the electronic device (102).

[0137] The electronic device (101) can change the screen of the electronic device (101) based on screen information. Referring to FIG. 7B, the electronic device (101) can display an execution screen (731) of a web browser based on the screen information of the screen (710). The execution screen (731) may be identical to the screen (710). Here, the fact that the execution screen (731) is identical to the screen (710) may mean that the electronic device (101) and the electronic device (102) display the same web page. The fact that the execution screen (731) is identical to the screen (710) may mean that the electronic device (101) and the electronic device (102) display the same web page through the same web browser.

[0138] As described above, the electronic device (101) can obtain screen information of the screen (710) on the condition that the screen (710) being displayed on the electronic device (102) is photographed. As described above, the electronic device (101) displays the web page being displayed on the electronic device (102) on the electronic device (101) based on the screen information of the electronic device (102), thereby allowing the user to share the screen of the electronic device (102) more conveniently.

[0139] FIG. 8A illustrates an example of a situation in which an electronic device, according to one embodiment, acquires the screen of an external electronic device. FIG. 8B illustrates an example in which the screen of an electronic device, according to one embodiment, has been changed.

[0140] Figures 8a and 8b can be explained with reference to Figures 1 and 2.

[0141] Referring to FIG. 8A, the electronic device (101) can capture an image of the electronic device (102). The electronic device (101) can capture an image of the electronic device (102) through a camera (280). The electronic device (101) can capture an image of the display (265) of the electronic device (102). The electronic device (101) can capture an image of a screen (810) displayed by the electronic device (102) through the display (265). The screen (810) can include an execution screen of an application.

[0142] The electronic device (101) can display an image (820) including the electronic device (102) through the display (260). Here, the image (820) can include an object (812) representing the electronic device (102). The image (820) can include an object (815) representing the screen (810) of the electronic device (102).

[0143] The electronic device (101) can request screen information of the screen (810) from the electronic device (102). The electronic device (101) can request screen information of the screen (810) from the electronic device (102) identified in the image (820). The electronic device (101) can request screen information of the screen (810) from the electronic device (102) through the communication circuit (290). Here, the screen information can include at least one of information of an application that generates the screen (810), a layout of the screen (810), or an executable object of the screen (810).

[0144] The electronic device (101) can obtain screen information from the electronic device (102). The electronic device (101) can obtain screen information about the screen (810). The electronic device (101) can obtain screen information about the execution screen of an application of the electronic device (102). Referring to FIG. 8A, the screen (810) can indicate an image being displayed through a gallery application. When the screen (810) indicates the gallery application, the screen information can include at least one of information about the gallery application, the image, or meta information about the image. Here, the meta information can include at least one of information about the location and time at which the image was acquired, or information about an object included in the image (e.g., the type of object). However, the present invention is not limited thereto. For example, the meta information can include at least one of a camera model, pixels, exposure time, or lens focal length.

[0145] The electronic device (101) can determine whether to display a user interface based on screen information. In response to receiving the screen information, the electronic device (101) can determine whether to display a user interface. The electronic device (101) can determine whether to display a user interface based on whether the screen (810) is an execution screen of an application. For example, if the screen (810) is an execution screen of an application, the electronic device (101) can determine not to display the user interface. For example, if the screen (810) is not an execution screen of an application, the electronic device (101) can determine to display the user interface. For example, if the screen (810) is a lock screen or a home screen, the electronic device (101) can determine to display the user interface. Here, the user interface can enable the electronic device (101) to select whether to apply at least one of the functions applied to the screen (810) of the electronic device (102).

[0146] The electronic device (101) can change the screen of the electronic device (101) based on screen information. Referring to FIG. 8B, the electronic device (101) can display an execution screen (831) of a gallery application based on screen information of the screen (810). The electronic device (101) can display an image (841) included in the screen (810) through the gallery application based on the screen information of the screen (810). The electronic device (101) can display meta information (845) of an image included in the screen (810) through the gallery application based on the screen information of the screen (810). However, the present invention is not limited thereto. For example, the execution screen (831) can be identical to the screen (810). Here, the execution screen (831) being identical to the screen (810) can mean that the same electronic device (101) and the electronic device (102) display the same image. The fact that the execution screen (831) is identical to the screen (810) may mean that the electronic device (101) and the electronic device (102) display the same image through the same gallery application.

[0147] As described above, the electronic device (101) can obtain screen information of the screen (810) on the condition that the screen (810) being displayed on the electronic device (102) is photographed. As described above, the electronic device (101) displays an image being displayed on the electronic device (102) on the electronic device (101) based on the screen information of the electronic device (102), thereby allowing the user to share the screen of the electronic device (102) more conveniently.

[0148] FIG. 9A illustrates an example of a situation in which an electronic device, according to one embodiment, acquires the screen of an external electronic device. FIG. 9B illustrates an example in which the screen of an electronic device, according to one embodiment, has been changed.

[0149] Figures 9a and 9b can be explained with reference to Figures 1 and 2.

[0150] Referring to FIG. 9A, the electronic device (101) can capture an image of the electronic device (102). The electronic device (101) can capture an image of the electronic device (102) through a camera (280). The electronic device (101) can capture an image of the display (265) of the electronic device (102). The electronic device (101) can capture an image of a screen (910) displayed by the electronic device (102) through the display (265). The screen (910) can include an execution screen of an application.

[0151] The electronic device (101) can display an image (920) including the electronic device (102) through the display (260). Here, the image (920) can include an object (912) representing the electronic device (102). The image (920) can include an object (915) representing the screen (910) of the electronic device (102).

[0152] The electronic device (101) can request screen information of the screen (910) from the electronic device (102). The electronic device (101) can request screen information of the screen (910) from the electronic device (102) identified in the image (920). The electronic device (101) can request screen information of the screen (910) from the electronic device (102) through the communication circuit (290). Here, the screen information can include at least one of information of an application that generates the screen (910), a layout of the screen (910), or an executable object of the screen (910).

[0153] The electronic device (101) can obtain screen information from the electronic device (102). The electronic device (101) can obtain screen information about the screen (910). The electronic device (101) can obtain screen information about the execution screen of the application of the electronic device (102). Referring to FIG. 9A, the screen (910) can display the execution screen of the application. When the screen (910) is the execution screen of the application, the screen information can include information about the application and / or information related to the installation file of the application. Here, the information related to the installation file can include data for installing the application (e.g., an apk file) and / or a uniform resource locator (URL) that can obtain data for installing the application.

[0154] The electronic device (101) can determine whether to display a user interface based on screen information. In response to receiving the screen information, the electronic device (101) can determine whether to display a user interface. The electronic device (101) can determine whether to display a user interface based on whether the screen (910) is an execution screen of an application. For example, if the screen (910) is an execution screen of an application, the electronic device (101) can determine not to display the user interface. For example, if the screen (910) is not an execution screen of an application, the electronic device (101) can determine to display the user interface. For example, if the screen (910) is a lock screen or a home screen, the electronic device (101) can determine to display the user interface. Here, the user interface can enable the electronic device (101) to select whether to apply at least one of the functions applied to the screen (910) of the electronic device (102).

[0155] The electronic device (101) can change the screen of the electronic device (101) based on screen information. The screen of the electronic device (101) can be changed based on application information included in the screen information of the electronic device (101). For example, the electronic device (101) can change the screen of the electronic device (101) based on whether the application indicated in the application information is installed.

[0156] The electronic device (101) can display a screen for installing an application if the application indicated by the application information is not installed. If the application indicated by the application information is installed, the electronic device (101) can display a screen indicating the execution result of the application.

[0157] Referring to FIG. 9b, the electronic device (101) can display an application installation screen (931) and / or an application execution screen (935) based on the screen information of the screen (910).

[0158] The electronic device (101) may display an application installation screen (931) if the application indicated by the application information is not installed. For example, the electronic device (101) may display an application installation screen (931) if data for application installation (e.g., an apk file) has not been obtained. For example, the electronic device (101) may display an application installation screen (931) based on a URL from which data for application installation can be obtained.

[0159] The electronic device (101) may display an application execution screen (935) when the application indicated by the application information is installed. For example, the electronic device (101) may display an execution screen (935) after installing the application based on data for application installation (e.g., an apk file) and / or a URL. For example, the electronic device (101) may display an application execution screen (935) after executing a pre-installed application.

[0160] As described above, the electronic device (101) can obtain screen information of the screen (910) on the condition that the screen (910) being displayed on the electronic device (102) is photographed. As described above, the electronic device (101) executes an application running on the electronic device (102) on the electronic device (101) based on the screen information of the electronic device (102), thereby allowing the user to more conveniently share the application running on the electronic device (102).

[0161] Figure 10 is a flowchart of operations performed by an electronic device according to one embodiment.

[0162] Referring to FIG. 10, in operation 1010, the electronic device (101) may obtain an image of an external electronic device (102). The electronic device (101) may obtain an image of at least one electronic device (102) surrounding the electronic device (101) through a camera (280). For example, the electronic device (101) may obtain an image of the electronic device (102) through a camera application. Here, the image may include identification information output by the electronic device (102). For example, while the electronic device (101) is taking a picture of the electronic device (102) through the camera application, the electronic device (102) may display identification information through the display (265).

[0163] The electronic device (101) can identify at least one object in the first image. The electronic device (101) can identify at least one electronic device (102) in the first image. The electronic device (101) can identify at least one electronic device (102) in the image through the communication circuit (290).

[0164] The electronic device (101) can determine whether the electronic device (102) is identified in the image. The electronic device (101) can determine whether the electronic device (102) is included in the image captured by the camera (280). For example, the electronic device (101) can determine whether the first screen of the electronic device (102) is identified in the image. The electronic device (101) can determine whether the first screen of the electronic device (102) is included in the image captured by the camera (280).

[0165] The electronic device (101) can identify whether the electronic device (102) identified in the image corresponds to the electronic device (102) identified through the communication circuit (290). Here, the electronic device (101) can identify at least one electronic device (102) around the electronic device (101) through the communication circuit (290). For example, the electronic device (101) can identify at least one electronic device (102) around the electronic device (101) based on a designated communication technique (e.g., ultra-wideband (UWB), Bluetooth, Wi-Fi, near field communication (NFC)).

[0166] If the electronic device (102) identified in the image corresponds to the electronic device (102) identified through the communication circuit (290), the electronic device (101) may request screen information of the first screen being displayed on the display (265) of the electronic device (102) from the electronic device (102). Here, the screen information may include at least one of the type of the first screen being displayed through the display (265) of the electronic device (102), the layout of the first screen, the executable object of the first screen, and application information of the application that generates the first screen.

[0167] The electronic device (101) can obtain screen information from the electronic device (102). The electronic device (101) can obtain screen information identified in the first image. The electronic device (101) can obtain screen information of the first screen that the electronic device (102) is displaying. For example, the electronic device (101) can obtain screen information of at least one of the lock screen, home screen, or application execution screen of the electronic device (102).

[0168] In operation 1020, the electronic device (101) may display a user interface based on a first screen included in the image. The electronic device (101) may display a user interface if the type of the first screen being displayed by the electronic device (102) is a lock screen or a home screen. Here, the user interface may be a user interface for changing custom settings of the lock screen or home screen of the electronic device (101). For example, if the type of the first screen being displayed by the electronic device (102) is an application execution screen, the electronic device (101) may display an application execution screen. For example, the electronic device (101) may execute an application running in the foreground of the electronic device (102) and display an execution screen indicating the execution result. Here, the application running in the foreground of the electronic device (102) may be a web browser or a gallery application, but is not limited thereto.

[0169] The electronic device (101) can display a user interface based on screen information. In response to receiving the screen information, the electronic device (101) can display a user interface including an image object for the first screen. In response to receiving the screen information, the electronic device (101) can display a user interface including a reduced image from the first screen. Here, the user interface can include at least one selectable option field. Here, the screen information can include functions applied to the first screen of the electronic device (102). For example, screen information for a lock screen or a home screen can include functions applied to the first screen of the electronic device (102).

[0170] In operation 1030, the electronic device (101) may display a second screen with a changed layout based on the user interface.

[0171] The electronic device (101) may obtain at least one user input related to the user interface. For example, the electronic device (101) may obtain a user input for at least one of at least one selectable option field of the user interface.

[0172] The electronic device (101) can change the display of an image object on the first screen based on at least one user input. The electronic device (101) can change the display of an image object displayed on the user interface based on at least one user input.

[0173] The electronic device (101) can change the second screen of the electronic device (101). The electronic device (101) can change the layout of the second screen based on at least one user input. The electronic device (101) can change the layout of the second screen of the electronic device (101) corresponding to the first screen based on at least one user input. For example, the electronic device (101) can change the layout of the second screen of the electronic device (101) corresponding to the first screen based on at least one user input for an option field. For example, when the first screen is a lock screen, the electronic device (101) can change the layout of the lock screen of the electronic device (101). For example, when the first screen is a home screen, the electronic device (101) can change the layout of the home screen of the electronic device (101).

[0174] Figure 11 is a flowchart of operations performed by an electronic device according to one embodiment.

[0175] Referring to FIG. 11, in operation 1110, the electronic device (101) can identify an external electronic device (102) through a communication circuit.

[0176] The electronic device (101) can identify at least one electronic device (102) around the electronic device (101) through the communication circuit (290). For example, the electronic device (101) can identify at least one electronic device (102) around the electronic device (101) based on a designated communication technique (e.g., UWB, Bluetooth, Wi-Fi, NFC). The electronic device (101) can identify at least one electronic device (102) around the electronic device (101) through the communication circuit (290) before acquiring an image through the camera (280). However, the present invention is not limited thereto. After acquiring an image through the camera (280), the electronic device (101) can identify at least one electronic device (102) around the electronic device (101) through the communication circuit (290). For example, the electronic device (101) can identify the electronic device (102) from an image acquired through the camera (280). The electronic device (101) can transmit a signal based on a designated communication technique in the direction in which the electronic device (102) identified in the image is located. The electronic device (101) can identify the electronic device (102) based on a response to the signal transmitted based on the designated communication technique.

[0177] In operation 1120, the electronic device (101) may obtain an image of an external electronic device (102). The electronic device (101) may obtain an image of at least one electronic device (102) through the camera (280). The electronic device (101) may obtain an image of at least one electronic device (102) surrounding the electronic device (101) through the camera (280). For example, the electronic device (101) may obtain an image of the electronic device (102) through a camera application. Here, the image may include identification information output by the electronic device (102). For example, while the electronic device (101) is taking a picture of the electronic device (102) through the camera application, the electronic device (102) may display identification information through the display (265).

[0178] In operation 1130, the electronic device (101) can identify an external electronic device based on an image. The electronic device (101) can identify at least one object in the image. The electronic device (101) can identify at least one electronic device (102) in the image. The electronic device (101) can identify at least one electronic device (102) in the image through the communication circuit (290). The electronic device (101) can identify at least one electronic device (102) based on identification information identified in the image.

[0179] In operation 1140, the electronic device (101) can determine whether the external electronic device is the same. The processor (120) can determine whether the electronic device (102) identified in the first image corresponds to the electronic device (102) identified through the communication circuit (290). The processor (120) can determine whether the identification information of the electronic device (102) identified in the image matches the identification information of the electronic device (102) acquired through the communication circuit (290).

[0180] In operation 1140, based on the determination that the external electronic devices are identical, the electronic device (101) may perform operation 1150. In operation 1140, based on the determination that the external electronic devices are not identical, the electronic device (101) may perform operation 1120 again. However, the present invention is not limited thereto. In operation 1140, based on the determination that the external electronic devices are not identical, the electronic device (101) may output a user interface guiding the user to re-capture the electronic device (102). Thereafter, the electronic device (101) may perform operation 1120 again.

[0181] In operation 1150, the electronic device (101) can obtain screen information for the first screen of the external electronic device (102).

[0182] An electronic device (101) can request screen information from an electronic device (102). The electronic device (101) can request screen information from an electronic device (102) identified in an image. The electronic device (101) can request screen information from the identified electronic device (102) through a communication circuit (290). Here, the screen information can include at least one of the type of the first screen being displayed through the display (265) of the electronic device (102), the layout of the first screen, an executable object of the first screen, and application information of an application that generates the first screen.

[0183] The electronic device (101) can obtain screen information from the electronic device (102). The electronic device (101) can obtain screen information identified in an image. The electronic device (101) can obtain screen information of a first screen that the electronic device (102) is displaying. For example, the electronic device (101) can obtain screen information of at least one of the lock screen, home screen, or application execution screen of the electronic device (102).

[0184] Figure 12 is a flowchart of operations performed by an electronic device according to one embodiment.

[0185] Referring to FIG. 12, in operation 1210, the electronic device (101) can identify an application included in the first screen.

[0186] The processor (120) may obtain screen information of an application being executed on the electronic device (102) based on screen information on the first screen. For example, the processor (120) may obtain screen information on a web page accessed through a web browser of the electronic device (102). Here, the screen information on the web page may include information on the web browser and / or address information of the web page. The processor (120) may obtain screen information on a gallery application of the electronic device (102). Here, the screen information on the gallery application may include at least one of information on the gallery application, an image being displayed through the gallery application, or meta information of the image. Here, the meta information may include at least one of information on a location or time at which an image was captured, or information on an object included in the image (e.g., the type of object). However, the present invention is not limited thereto. For example, the meta information may include at least one of a camera model, pixels, exposure time, or lens focal length. The processor (120) may obtain screen information on an application of the electronic device (102). If the screen represents the running screen of an application, and / or the screen information may include information about the application.

[0187] In operation 1220, the electronic device (101) can determine whether application installation is required. The electronic device (101) can determine whether the application running on the electronic device (102) requires installation. If the application running on the electronic device (102) is not installed on the electronic device (101), the electronic device (101) can determine that application installation is required. If an application that can replace the application running on the electronic device (102) is installed on the electronic device (101), the electronic device (101) can determine that application installation is not required. If the application running on the electronic device (102) is installed on the electronic device (101), the electronic device (101) can determine that application installation is not required.

[0188] In operation 1220, if it is determined that application installation is required, the electronic device (101) may perform operation 1230. In operation 1220, if it is determined that application installation is not required, the electronic device (101) may terminate the operation of FIG. 12.

[0189] In operation 1230, the electronic device (101) can obtain an installation file of the application. The electronic device (101) can obtain information related to the installation file of the application from the electronic device (102). Here, the information related to the installation file can include data for installing the application (e.g., an apk file) and / or a URL for obtaining data for installing the application.

[0190] The processor (120) can obtain data (e.g., an apk file) for installing an application from the electronic device (102). The processor (120) can obtain data for installing an application based on a URL from which data for installing an application can be obtained. The processor (120) can obtain data for installing an application from a server (108) based on the URL from which data for installing an application can be obtained. Here, the server (108) may be a server that stores and / or manages data for installing an application.

[0191] In operation 1240, the electronic device (101) can install an application. The electronic device (101) can install the application based on data for installing the application.

[0192] The processor (120) may display an application execution screen when the application indicated by the application information is installed. For example, the processor (120) may display an execution screen after installing the application based on data for application installation (e.g., an apk file) and / or a URL. For example, the processor (120) may display an application execution screen after executing a pre-installed application.

[0193] As described above, the electronic device (101) may include a display (260). The electronic device (101) may include at least one camera (280). The electronic device (101) may include at least one communication circuit (290). The electronic device (101) may include at least one processor (120). The electronic device (101) may include at least one memory (130) that stores instructions. The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to acquire a first image (320, 520, 720, 820, 920) of an external electronic device (102) through the at least one camera (280). The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to request, through the at least one communication circuit (290), from the external electronic device (102) identified in the image (320, 520, 720, 820, 920) screen information of the first screen (310, 510, 710, 810, 910) being displayed by the external electronic device (102). The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to, in response to receiving the screen information, display a user interface (410, 610) including a second image (315, 515) scaled down from the first screen (310, 510, 710, 810, 910) through the display (260). The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to change the display of the second image (315, 515) based on at least one user input related to the user interface (410, 610).The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to change the layout of the second screen (435, 635, 731, 831, 931, 935) displayed through the display (260) based on the changed second image (315, 515).

[0194] The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to identify the external electronic device (102) through the at least one communication circuit (290).

[0195] The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to identify whether the external electronic device (102) identified in the first image (320, 520, 720, 820, 920) corresponds to the external electronic device (102) identified through the at least one communication circuit (290). The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101), in response to being identified as corresponding to each other, to request the screen information from the external electronic device (102) identified in the first image (320, 520, 720, 820, 920) through the at least one communication circuit (290).

[0196] The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to output another user interface (330) guiding the user to capture an image (320, 520, 720, 820, 920) through the display (260) in response to the electronic device (101) being identified as not being the same.

[0197] The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to identify identification information included in the first screen (310, 510, 710, 810, 910) using the first image (320, 520, 720, 820, 920). The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to identify, based on the identification information, whether the external electronic device (102) identified in the image (320, 520, 720, 820, 920) is the same as the external electronic device (102) identified through the at least one communication circuit (290).

[0198] The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to identify a type of the first screen (310, 510, 710, 810, 910) based on the screen information. The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to change the layout of the second screen (435, 635, 731, 831, 931, 935) of a type corresponding to the identified type of the first screen (310, 510, 710, 810, 910) based on the changed image (320, 520, 720, 820, 920).

[0199] The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to change the wall wallpaper of the second screen (435, 635, 731, 831, 931, 935) displayed through the display (260) based on the wall wallpaper of the first screen (310, 510, 710, 810, 910).

[0200] The identified type of the first screen (310, 510, 710, 810, 910) may include at least one of a lock screen or a home screen.

[0201] The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to identify, based on the screen information, arrangement information of an image object for at least one application included in the first screen (310, 510, 710, 810, 910). The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to display, based on the arrangement information, the second screen (435, 635, 731, 831, 931, 935) on which the image object is arranged, through the display (260).

[0202] The above image object may include at least one of an application icon or a widget.

[0203] The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to identify at least one application included in the first screen (310, 510, 710, 810, 910) based on the screen information. The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to obtain an installation file of the at least one identified application through the at least one communication circuit (290).

[0204] The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to obtain the installation file from a server based on the installation file not being transmitted from the external electronic device (102).

[0205] The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to identify font information for at least one font applied to the first screen (310, 510, 710, 810, 910) based on the screen information. The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to change at least one font applied to the second screen (435, 635, 731, 831, 931, 935) based on the font information.

[0206] The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to display a user interface (410, 610) including a second image (320, 520, 720, 820, 920) based on the first screen (310, 510, 710, 810, 910) not being associated with a designated application. The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to execute a designated application based on the first screen (310, 510, 710, 810, 910) being associated with the designated application. The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101) to display a second screen (435, 635, 731, 831, 931, 935) related to the first screen (310, 510, 710, 810, 910) on the display (260) based on the execution of the designated application.

[0207] The above-mentioned application may include a web browser. The second screen (435, 635, 731, 831, 931, 935) may display a web page corresponding to the web page displayed by the first screen (310, 510, 710, 810, 910).

[0208] The above-mentioned application may include a gallery application. The second screen (435, 635, 731, 831, 931, 935) may display meta information of the image content displayed by the first screen (310, 510, 710, 810, 910).

[0209] As described above, the method can be performed in an electronic device (101) including a display (260), at least one camera (280), and at least one communication circuit (290). The method can include an operation of acquiring an image (320, 520, 720, 820, 920) of an external electronic device (102) through the at least one camera (280). The method can include an operation of requesting, through the at least one communication circuit (290), from the external electronic device (102) identified in the image (320, 520, 720, 820, 920), screen information of a first screen (310, 510, 710, 810, 910) being displayed by the external electronic device (102). The method may include, in response to receiving the screen information, displaying a user interface (410, 610) including a reduced image (320, 520, 720, 820, 920) from the first screen (310, 510, 710, 810, 910) through the display (260). The method may include, based on at least one user input related to the user interface (410, 610), changing the display of the image (320, 520, 720, 820, 920). The above method may include an operation of changing the layout of a second screen (435, 635, 731, 831, 931, 935) displayed through the display (260) based on the changed image (320, 520, 720, 820, 920).

[0210] As described above, a non-transitory computer readable storage medium can store a program including instructions. The instructions, when executed by at least one processor (120), can cause an electronic device (101) including a display (260), at least one camera (280), and at least one communication circuit (290), to acquire a first image (320, 520, 720, 820, 920) of an external electronic device (102) through the at least one camera (280). The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to request, through the at least one communication circuit (290), from the external electronic device (102) identified in the image (320, 520, 720, 820, 920) screen information of a first screen (310, 510, 710, 810, 910) being displayed by the external electronic device (102). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to, in response to receiving the screen information, display a user interface (410, 610) including a second image (315, 515) scaled down from the first screen (310, 510, 710, 810, 910) through the display (260). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to change the display of the second image (315, 515) based on at least one user input related to the user interface (410, 610).The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to change the layout of the second screen (435, 635, 731, 831, 931, 935) displayed through the display (260) based on the changed second image (315, 515).

[0211] As described above, the electronic device (102) may include a display (265). The electronic device (101) may include at least one communication circuit (295). The electronic device (101) may include at least one processor (220). The electronic device (101) may include at least one memory (230) that stores instructions. The instructions, when executed by the at least one processor (220), may be configured to cause the electronic device (102) to identify an external electronic device (101) through the at least one communication circuit (295). The instructions, when executed by the at least one processor (220), may be configured to cause the electronic device (102) to, in response to identifying the external electronic device (101), update the first screen (310, 510, 710, 810, 910) to include identification information while displaying the first screen (310, 510, 710, 810, 910) through the display (265). The above instructions, when executed by the at least one processor (220), may be configured to cause the electronic device (102) to receive a request for screen information of the first screen (310, 510, 710, 810, 910) from the external electronic device (101) through the at least one communication circuit (295) after updating the first screen (310, 510, 710, 810, 910). The instructions, when executed by the at least one processor (220), may be configured to cause the electronic device (102) to transmit the screen information via the at least one communication circuit (295) so that, in response to receiving the request, the external electronic device (101) displays a user interface (410, 610) including a reduced image (320, 520, 720, 820, 920) from the first screen (310, 510, 710, 810, 910).

[0212] The instructions may be configured to cause the electronic device (102), when executed by the at least one processor (220), to receive, from the external electronic device (101), via the at least one communication circuit (295), a request for an installation file for at least one application included in the first screen (310, 510, 710, 810, 910) after transmitting the screen information. The instructions may be configured to cause the electronic device (102), when executed by the at least one processor (220), to transmit, to the external electronic device (101), data including the installation file, via the at least one communication circuit (295), in response to receiving the request for the installation file.

[0213] The above screen information may include at least one of type information of the first screen (310, 510, 710, 810, 910), wallpaper information, font information, or arrangement information of an image object for at least one application included in the first screen (310, 510, 710, 810, 910). The type of the first screen (310, 510, 710, 810, 910) may include at least one of a lock screen and a home screen.

[0214] As described above, the method may be performed in an electronic device (102) including a display (265) and at least one communication circuit (295). The method may include an operation of identifying an external electronic device (101) via the at least one communication circuit (295). In response to identifying the external electronic device (101), the method may include an operation of updating the first screen (310, 510, 710, 810, 910) to include identification information while displaying the first screen (310, 510, 710, 810, 910) via the display (265). The method may include an operation of receiving, via the at least one communication circuit (295), a request for screen information of the first screen (310, 510, 710, 810, 910) from the external electronic device (101). The method may include, in response to receiving the request, transmitting the screen information via the at least one communication circuit (290) so that the external electronic device (101) displays a user interface (410, 610) including a reduced image (320, 520, 720, 820, 920) from the first screen (310, 510, 710, 810, 910).

[0215] As described above, a non-transitory computer-readable storage medium can store a program including instructions. The instructions, when executed by at least one processor (220) of the electronic device (101) including a display (265) and at least one communication circuit (295), can cause the electronic device (102) to identify an external electronic device (101) via the at least one communication circuit (295). The instructions, when executed by the at least one processor (220), may cause the electronic device (102) to, in response to identifying the external electronic device (101), update the first screen (310, 510, 710, 810, 910) to include identification information while displaying the first screen (310, 510, 710, 810, 910) through the display (265). The above instructions, when executed by the at least one processor (220), may cause the electronic device (102) to receive a request for screen information of the first screen (310, 510, 710, 810, 910) from the external electronic device (101) through the at least one communication circuit (295) after updating the first screen (310, 510, 710, 810, 910). The instructions, when executed by the at least one processor (220), may cause the electronic device (102) to transmit the screen information via the at least one communication circuit (295) so that the external electronic device (101) displays a user interface (410, 610) including a reduced image (320, 520, 720, 820, 920) from the first screen (310, 510, 710, 810, 910), in response to receiving the request.

[0216] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0217] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0218] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0219] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0220] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., by download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0221] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), Display (260), At least one camera (280), At least one communication circuit (290), at least one processor (120), and At least one memory (130) for storing instructions, wherein the instructions, when executed by the at least one processor (120), cause the electronic device (101) to: By means of at least one camera (280), a first image (320, 520, 720, 820, 920) for an external electronic device (102) is acquired, Requesting screen information of a first screen (310, 510, 710, 810, 910) being displayed by the external electronic device (102) identified in the image (320, 520, 720, 820, 920) through at least one communication circuit (290), In response to receiving the above screen information, a user interface (410, 610) including a second image (315, 515) reduced from the first screen (310, 510, 710, 810, 910) is displayed through the display (260), Changing the display of the second image (315, 515) based on at least one user input related to the user interface (410, 610), and Based on the above changed second image (315, 515), causing the layout of the second screen (435, 635, 731, 831, 931, 935) displayed through the display (260) to be changed. Electronic devices.

2. In claim 1, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Through at least one communication circuit (290), the external electronic device (102) is identified, Identifying whether the external electronic device (102) identified in the first image (320, 520, 720, 820, 920) corresponds to the external electronic device (102) identified through the at least one communication circuit (290), and In response to being identified as corresponding to each other, causing the external electronic device (102) identified in the first image (320, 520, 720, 820, 920) to request the screen information through the at least one communication circuit (290). Electronic devices.

3. In claim 1 or claim 2, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: In response to being identified as not being the same, causing the display (260) to output another user interface (330) that guides the user to capture an image (320, 520, 720, 820, 920). Electronic devices.

4. In any one of claims 1 to 3, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Identifying the identification information included in the first screen (310, 510, 710, 810, 910) by using the first image (320, 520, 720, 820, 920), and Based on the above identification information, causing the external electronic device (102) identified in the first image (320, 520, 720, 820, 920) to be identified as being the same as the external electronic device (102) identified through the at least one communication circuit (290). Electronic devices.

5. In any one of claims 1 to 4, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on the above screen information, the type of the first screen (310, 510, 710, 810, 910) is identified, and Based on the above changed second image (320, 520, 720, 820, 920), causing the layout of the second screen (435, 635, 731, 831, 931, 935) to be changed to a type corresponding to the identified type of the first screen (310, 510, 710, 810, 910). Electronic devices.

6. In any one of claims 1 to 5, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Causing the wall wallpaper of the second screen (435, 635, 731, 831, 931, 935) displayed through the display (260) to be changed based on the wall wallpaper of the first screen (310, 510, 710, 810, 910). Electronic devices.

7. In any one of claims 1 to 6, The identified type of the above first screen (310, 510, 710, 810, 910) includes at least one of a lock screen or a home screen. Electronic devices.

8. In any one of claims 1 to 7, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on the above screen information, identify the arrangement information of the image object for at least one application included in the first screen (310, 510, 710, 810, 910), and Based on the above arrangement information, causing the second screen (435, 635, 731, 831, 931, 935) on which the image object is arranged to be displayed through the display (260). Electronic devices.

9. In any one of claims 1 to 8, The image object comprises at least one of an application icon or a widget. Electronic devices.

10. In any one of claims 1 to 9, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on the above screen information, at least one application included in the first screen (310, 510, 710, 810, 910) is identified, and Causing to obtain the installation file of at least one application identified through at least one communication circuit (290); Electronic devices.

11. In any one of claims 1 to 10, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on the fact that the installation file is not transmitted from the external electronic device (102), causing the installation file to be obtained from the server, Electronic devices.

12. In any one of claims 1 to 11, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on the above screen information, font information for at least one font applied to the first screen (310, 510, 710, 810, 910) is identified, and Based on the above font information, causing at least one font applied to the second screen (435, 635, 731, 831, 931, 935) to be changed. Electronic devices.

13. In an electronic device (102), Display (265), At least one communication circuit (295), at least one processor (220), and At least one memory (230) storing instructions, said instructions, when executed by said at least one processor (220), causing said electronic device (102) to: Through at least one communication circuit (295) above, identify an external electronic device (101), In response to identifying the external electronic device (101), the first screen (310, 510, 710, 810, 910) displayed through the display (265) is updated to include identification information, After updating the first screen (310, 510, 710, 810, 910), a request for screen information of the first screen (310, 510, 710, 810, 910) is received from the external electronic device (101) through the at least one communication circuit (295), and In response to receiving the request, causing the external electronic device (101) to transmit the screen information via the at least one communication circuit (295) to display a user interface (410, 610) including a reduced image (320, 520, 720, 820, 920) from the first screen (310, 510, 710, 810, 910). Electronic devices.

14. A method performed in an electronic device (101) including a display (260), at least one camera (280), and at least one communication circuit (290), An operation of acquiring an image (320, 520, 720, 820, 920) for an external electronic device (102) through at least one camera (280), An operation of requesting screen information of a first screen (310, 510, 710, 810, 910) being displayed by the external electronic device (102) to the external electronic device (102) identified in the image (320, 520, 720, 820, 920) through at least one communication circuit (290). In response to receiving the above screen information, an operation of displaying a user interface (410, 610) including a reduced image (320, 520, 720, 820, 920) from the first screen (310, 510, 710, 810, 910) through the display (260), An operation of changing the display of the image (320, 520, 720, 820, 920) based on at least one user input related to the user interface (410, 610), and An operation for changing the layout of a second screen (435, 635, 731, 831, 931, 935) displayed through the display (260) based on the changed image (320, 520, 720, 820, 920). method.

15. A method performed in an electronic device (102) including a display (265) and at least one communication circuit (295), An operation of identifying an external electronic device (101) through at least one communication circuit (295), In response to identifying the external electronic device (101), an operation of updating the first screen (310, 510, 710, 810, 910) to include identification information while displaying the first screen (310, 510, 710, 810, 910) through the display (265). An operation of receiving a request for screen information of the first screen (310, 510, 710, 810, 910) from the external electronic device (101) through at least one communication circuit (295), and In response to receiving the request, the external electronic device (101) includes an operation of transmitting the screen information via the at least one communication circuit (290) so as to display a user interface (410, 610) including a reduced image (320, 520, 720, 820, 920) from the first screen (310, 510, 710, 810, 910). method.

Images