Electronic device and method by which electronic device displays content of external electronic device
The described method allows electronic devices to establish direct communication with external devices through image capture, identify and request data, addressing inefficiencies in content sharing by enabling seamless and personalized content display.
Patent Information
- Application Number
- PCT/KR2025/006923
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-11-15
- Filing Date
- 2025-05-22
- Publication Date
- 2025-11-27
AI Technical Summary
Existing methods for sharing content between electronic devices are cumbersome and inefficient, often requiring manual capture and transfer via messengers or file transfers, lacking seamless connectivity and personalized data integration.
An electronic device can establish a communication connection with an external device by capturing its image, identify the device, request and receive data related to the content, and display it seamlessly, utilizing a camera, communication circuit, and processing circuit to facilitate direct data transfer and personalized content display.
Enables efficient and seamless display of content from external devices, incorporating personalized data based on user information, enhancing user experience and reducing manual intervention.
Smart Images

Figure KR2025006923_27112025_PF_FP_ABST
Abstract
Description
Electronic devices and methods for displaying content from external electronic devices on electronic devices
[0001] The present disclosure relates to an electronic device and a method for displaying content of an external electronic device in the electronic device.
[0002] Recently, with the increase in the number of devices owned by individuals and the advancement of IoT communication technology, connectivity and data sharing between various heterogeneous devices are attracting attention.
[0003] For example, in order to view a screen captured on a first device on a second device, a user may capture a screen on the first device and then transmit the captured screen to the second device via a messenger, thereby downloading and saving the captured screen on the second device. Alternatively, in order to transmit the captured screen using a file transfer technology on the first device, the user may first select a second device and then transmit the captured screen to the second device using the file transfer technology.
[0004] An electronic device can establish a communication connection with an external electronic device simply by taking a picture of the external electronic device displaying content on the electronic device, and can provide data related to the content provided from the external electronic device to a user.
[0005] An electronic device can provide a user with data related to content provided from an external electronic device through a management server simply by taking a picture of an external electronic device displaying content on the electronic device.
[0006] Electronic devices can use a user's personal information to generate additional data, including customized data related to the content, and provide the additional data to the user along with the data related to the content.
[0007] According to one embodiment, an electronic device includes a camera, a communication circuit, a display, at least one processor including a processing circuit, and a memory storing instructions, wherein the instructions, when executed by the at least one processor, cause the electronic device to receive an image including an external electronic device through the camera, and, upon confirming a selection of a photograph while displaying the image through the display, identify an external electronic device that has transmitted first information including a first image corresponding to at least a portion of the photographed image among at least one external electronic device, upon establishing a communication connection between the electronic device and the external electronic device, transmit second information requesting data related to the first image to the external electronic device, and upon receiving third information including data related to the first image from the external electronic device, display data related to the first image through the display.
[0008] According to one embodiment, an electronic device includes a communication circuit, a display, at least one processor including a processing circuit, and a memory storing instructions, wherein the instructions, when executed by the at least one processor, cause the electronic device to, when displaying content through the display, receive a request for a first image obtained by screen-capturing the content from an external electronic device, transmit first information including a first image obtained by screen-capturing the content to the external electronic device, establish a communication connection between the electronic device and the external electronic device based on the transmission of the first information, and transmit third information including data related to the first image to the external electronic device when receiving second information requesting data related to the first image from the external electronic device.
[0009] According to one embodiment, a method for displaying content of an external electronic device in an electronic device may include: receiving an image including an external electronic device through a camera of the electronic device; confirming a selection of shooting while displaying the image through a display of the electronic device; identifying an external electronic device that has transmitted first information including a first image corresponding to at least a portion of the captured image among at least one external electronic device; transmitting second information requesting data related to the first image to the external electronic device when a communication connection is established between the electronic device and the external electronic device; and displaying data related to the first image through the display when receiving third information including data related to the first image from the external electronic device.
[0010] In one embodiment, a method for displaying content of an external electronic device in an electronic device may include, when a request for a first image of a screen-captured content is received from an external electronic device while displaying the content through a display of the electronic device, transmitting first information including a first image of the screen-captured content to the external electronic device; establishing a communication connection between the electronic device and the external electronic device based on the transmission of the first information; and transmitting third information including data related to the first image to the external electronic device when second information requesting data related to the first image is received from the external electronic device.
[0011] In one embodiment, a non-volatile storage medium storing commands is provided, wherein the commands are configured to cause the electronic device to perform at least one operation when executed by the electronic device, wherein the at least one operation may include: receiving an image including an external electronic device through a camera of the electronic device; confirming a selection of a photograph while displaying the image through a display of the electronic device; identifying an external electronic device that has transmitted first information including a first image corresponding to at least a portion of the photographed image among at least one external electronic device; transmitting second information requesting data related to the first image to the external electronic device when a communication connection is established between the electronic device and the external electronic device; and displaying data related to the first image through the display when receiving third information including data related to the first image from the external electronic device.
[0012] In one embodiment, a non-volatile storage medium storing commands is provided, wherein the commands are configured to cause the electronic device to perform at least one operation when executed by the electronic device, wherein the at least one operation may include: when a request for a first image obtained by screen-capturing content is received from an external electronic device while displaying content through a display of the electronic device, transmitting first information including a first image obtained by screen-capturing the content to the external electronic device; establishing a communication connection between the electronic device and the external electronic device based on the transmission of the first information; and when second information requesting data related to the first image is received from the external electronic device, transmitting third information including data related to the first image to the external electronic device.
[0013] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.
[0014] FIG. 2 is a drawing for explaining an operation of displaying content of an external electronic device in an electronic device according to an embodiment.
[0015] Figure 3 is a block diagram of a first electronic device according to one embodiment.
[0016] Figure 4 is a block diagram of a second electronic device according to one embodiment.
[0017] FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H are drawings for explaining an operation of displaying content of an external electronic device in an electronic device according to one embodiment.
[0018] FIG. 6 is a diagram for explaining an operation of confirming an image based on time information in an electronic device according to one embodiment.
[0019] FIGS. 7A, 7B, 7C, and 7D are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0020] FIGS. 8A, 8B, 8C, and 8D are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0021] FIGS. 9A and 9B are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0022] FIGS. 10A and 10B are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0023] FIGS. 11A and 11B are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0024] FIGS. 12a, 12b, 12c, and 12d are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0025] FIGS. 13a and 13b are flowcharts illustrating an operation of displaying content of an external electronic device on an electronic device using a communication connection between the electronic device and the external electronic device according to one embodiment.
[0026] FIG. 14 is a flowchart illustrating an operation of displaying content of an external electronic device in an electronic device according to one embodiment.
[0027] FIG. 15 is a flowchart illustrating an operation of providing content information from an electronic device to an external electronic device according to one embodiment.
[0028] FIGS. 16A and 16B are flowcharts illustrating an operation of an electronic device and an external electronic device using a management server to display content of an external electronic device on the electronic device according to one embodiment.
[0029] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to an embodiment. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to an embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0030] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0031] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0032] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0033] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0034] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0035] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0036] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0037] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0038] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0039] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0040] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0041] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0042] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0043] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0044] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0045] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0046] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL) each, or 1 ms or less for round trip) for URLLC realization.
[0047] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0048] According to one embodiment, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent to a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0049] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0050] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0051] FIG. 2 is a drawing for explaining an operation of displaying content of an external electronic device in an electronic device according to one embodiment.
[0052] Referring to FIG. 2, when a first electronic device (301) according to an embodiment receives an image (211) through a camera of the first electronic device (301), the first electronic device (301) may analyze the image (211) to determine that the image (211) includes an external electronic device (an image of the external device) (401a). When the first electronic device (301) according to an embodiment confirms a selection of shooting for the image (211), the first electronic device (301) may transmit (broadcast) (211a, 211b, and 211c) information (e.g., fourth information) requesting transmission of a first image, which is a screen capture of content being displayed (played) through the displays of each of the plurality of external electronic devices (401, 403, and 405)) using a communication circuit (e.g., BLE communication circuit) of the first electronic device (301). According to an embodiment, a first electronic device (301) may receive (231a, 231b, and 231c) information (e.g., first information) including a first image from a plurality of external electronic devices (401, 403, and 405). According to an embodiment, a first electronic device (301) may identify a second electronic device (401) that has transmitted information (e.g., first information) including a first image (e.g., an image captured of content displayed (played) through a display of an external electronic device) (211a) corresponding to at least a part of the captured image (211) among the information (e.g., first information) including a first image received from the plurality of external electronic devices (401, 403, and 405), as an external electronic device (image of an external electronic device) (401a) included in the captured image (211).
[0053] According to an embodiment, a first electronic device (301) may establish (251) communication with a second electronic device (401) among the plurality of external electronic devices (401, 403, and 405) by using a communication circuit (e.g., a Bluetooth communication circuit or a Wi-Fi communication circuit) of the first electronic device (301). According to an embodiment, the first electronic device (301) may transmit information requesting data related to the first image (401a) to the second electronic device (401) (e.g., second information including information related to the first image and time information when the first electronic device captured the image). According to an embodiment, when a first electronic device (301) receives information including data related to the first image (e.g., third information including the first image and metadata of the first image) from the second electronic device (401), the first electronic device (301) may display the data related to the first image through a display of the first electronic device.
[0054] According to an embodiment, when a first electronic device (301) receives information including data related to the first image from the second electronic device (401) (e.g., third information including the first image and metadata of the first image), the first electronic device (301) may verify personal information of a user related to the third information, verify additional data related to the third information (e.g., user-customized data related to the third information) using the personal information of the user, and display the additional data in a second area of the display while displaying the data related to the first image in a first area of the display.
[0055] The operation of the first electronic device (301) can be described in detail through the following drawing 3.
[0056] According to one embodiment, a second electronic device (401) may store screen-captured images of the content (213) in the memory of the second electronic device (401) at designated intervals while displaying the content (213) through the display of the second electronic device (401).
[0057] According to an embodiment, when a second electronic device (401) displays content (213) through a display of the second electronic device (401), if the second electronic device (401) receives information (e.g., fourth information) requesting transmission of a first image obtained by screen-capturing the content being displayed through the display of the second electronic device (401) from the first electronic device (301) through a communication circuit (e.g., BLE communication circuit) of the second electronic device (401), the second electronic device (401) may transmit information (e.g., first information) including a first image obtained by screen-capturing the content displayed through the display of the second electronic device (401) to the first electronic device (301).
[0058] According to one embodiment, a second electronic device (401) may establish a communication connection with the first electronic device (301) by using a communication circuit (e.g., a Bluetooth communication circuit or a Wi-Fi communication circuit) of the second electronic device (401) after transmitting information (e.g., first information) including a first image to the first electronic device (301).
[0059] According to an embodiment, when a second electronic device (401) receives information requesting data related to the first image from the first electronic device (301) (e.g., information related to the first image, and second information including time information when the image was captured by the first electronic device), the second electronic device (401) may check a first image that is screen-captured at the time when the image (211) was captured by the first electronic device among screen-captured images of the content at designated times, and collect metadata of the content screen-captured with the first image as metadata of the first image. According to an embodiment, the second electronic device (401) may transmit information (e.g., third information) including the first image and metadata of the first image as data related to the first image to the first electronic device (301).
[0060] A second electronic device (401) according to one embodiment may include a display device, for example, a TV, a monitor, a laptop, and / or a tablet.
[0061] The operation of the second electronic device (201) can be described in detail through the following drawing 4.
[0062] Figure 3 is a block diagram of a first electronic device according to one embodiment.
[0063] Referring to the above FIG. 3, the first electronic device (301) may include a first processor (320), a first memory (330), a first display (360), and a first communication circuit (390).
[0064] According to one embodiment, the first processor (320) may perform overall control operations of the first electronic device (301). According to one embodiment, the first processor (320) may execute software (e.g., the program (140) of FIG. 1) to control at least one other component (e.g., a hardware or software component) of the first electronic device (301) connected to the first processor (320), and may perform data processing or calculations based on the instructions. According to one embodiment, the instructions may include instructions configured in a machine language that can be processed by the first electronic device (301) or the first processor (320). For example, the instructions may include instructions corresponding to operation instructions used in the program.
[0065] According to one embodiment, the first processor (320) can establish a communication connection with the external electronic device included in the image when confirming a shooting selection for an image including an external electronic device received through the first camera (380).
[0066] According to one embodiment, the first processor (320) may activate the first camera (380) and store the time information at which the first camera (380) was activated in the first memory (330). For example, the first processor (320) may store the time information at which the first camera (380) was activated in UTC (universal time coordinated) time.
[0067] According to one embodiment, the first processor (320) may transmit screen capture request information requesting screen capture of content being displayed through the display of each of the external electronic devices (e.g., a plurality of electronic devices (401, 403, and 405) of FIG. 2) at designated times to the surrounding external electronic devices (e.g., a plurality of electronic devices (401, 403, and 405)) through the first communication circuit (390) (e.g., a BLE communication circuit) when the first camera (380) is activated, and may include information on the time at which the first camera (380) is activated in the screen capture request information.
[0068] According to one embodiment, the first processor (320) analyzes an image received through the first camera (380), and when it confirms that the image includes an external electronic device (an image of the external electronic device), it confirms that the user intends to capture content displayed through the display of the external electronic device, and displays an indicator for capturing an image including the external electronic device in a portion of the first display (360).
[0069] According to one embodiment, the first processor (320) analyzes an image received through the first camera (380), and when it recognizes a shape (e.g., a rectangle) representing a display of an external electronic device in the image, it confirms that the user has an intention to capture content displayed through the display of the external electronic device, and displays an indicator for capturing an image including the external electronic device in a portion of the first display (360).
[0070] According to one embodiment, the first processor (320) may display an indicator for capturing an image including an image received through the first camera (380) and an external electronic device through the first display (360), and when selection of the indicator is confirmed, selection of capturing of the image may be confirmed.
[0071] According to one embodiment, when confirming a selection for shooting the image, if the image displayed through the first display (360) includes a plurality of external electronic devices (images of each of the plurality of external electronic devices), the first processor (320) may display a pop-up window that allows the user to select an external electronic device to be shot.
[0072] According to one embodiment, when confirming a selection for shooting the image, if the image displayed through the first display (360) includes different contents (e.g., first contents, second contents) displayed on the display of an external electronic device, the first processor (320) may display a pop-up window that allows the user to select the contents to be shot.
[0073] According to one embodiment, the first processor (320) may store the shooting time information of the image in the first memory (330) upon confirming the selection of shooting for the image. For example, the first processor (320) may store the shooting time information of the image in UTC (universal time coordinated) time.
[0074] According to one embodiment, the first processor (320), when confirming the selection of the image to be captured, may transmit information (e.g., fourth information) requesting transmission of a first image, which is a screen capture of content being displayed through the display of each of the external electronic devices (e.g., a plurality of electronic devices (401, 403, and 405) of FIG. 2), through the first communication circuit (390) (e.g., BLE communication circuit).
[0075] According to an embodiment, when the first processor (320) confirms the selection of shooting for the image, when it receives information (e.g., first information) including a first image that is a screen capture of content being displayed through the display of each of the external electronic devices (e.g., the plurality of electronic devices (401, 403, and 405) of FIG. 2) in the vicinity through the first communication circuit (390) (e.g., BLE communication circuit), the external electronic device (e.g., the second electronic device (401) of FIG. 2) that has received information (e.g., first information) including a first image corresponding to a part of an image shot by the first electronic device (301) among the information (e.g., first information) including the first image received from the external electronic devices (e.g., the plurality of electronic devices (401, 403, and 405) of FIG. 2) can be identified as an external electronic device included in the shot image.
[0076] According to one embodiment, the first processor (320) can identify a portion of an image corresponding to a display area of an external electronic device displaying content from the captured image as the first image.
[0077] According to an embodiment, the first processor (320), when receiving a first image that is a screen capture of content being displayed through a display of each of the external electronic devices from the external electronic devices, may compare the entire area or a portion of the first image corresponding to a portion of an image captured by the first electronic device (301) with the entire area or a portion of the first image received from the external electronic devices, and may identify an external electronic device (e.g., a second electronic device (401) of FIG. 2) that has received information (e.g., first information) including a first image corresponding to a portion of an image captured by the first electronic device (301) among the external electronic devices (e.g., a plurality of electronic devices (401, 403, and 405) of FIG. 2) as an external electronic device included in the captured image.
[0078] According to one embodiment, the first processor (320), when confirming the selection of the image to be captured, can identify an external electronic device (e.g., the second electronic device (401) of FIG. 2) that is located closest to the first electronic device (301) and can measure the largest RSSI based on the RSSI included in the advertisement packet received from the surrounding external electronic devices through the first communication circuit (e.g., the BLE communication circuit) as the external electronic device included in the captured image.
[0079] According to one embodiment, the first processor (320) may identify an external electronic device (e.g., the second electronic device (401) of FIG. 2) that is logged into the management server with the same account as the first electronic device (301) among the peripheral external electronic devices of the first electronic device (301) as the external electronic device included in the captured image.
[0080] According to an embodiment, the first processor (320) may, when checking a plurality of external electronic devices that are logged in to the management server with the same account as the first electronic device (301) among the peripheral external electronic devices of the first electronic device (301), identify an external electronic device (e.g., the second electronic device (401) of FIG. 2) that has received information (e.g., first information) including a first image corresponding to a part of an image captured by the first electronic device (301) among the plurality of external electronic devices as an external electronic device included in the captured image.
[0081] According to one embodiment, the first processor (320) can identify an external electronic device (e.g., the second electronic device (401) of FIG. 2) included in the captured image among external electronic devices surrounding the first electronic device (301) that are connected to the same AP.
[0082] According to an embodiment, the first processor (320), when checking a plurality of external electronic devices connected to the same AP among the peripheral external electronic devices of the first electronic device (301), can check an external electronic device (e.g., the second electronic device (401) of FIG. 2) that has received information (e.g., first information) including a first image corresponding to a part of an image captured by the first electronic device (301) among the plurality of external electronic devices as an external electronic device included in the captured image.
[0083] According to one embodiment, the first processor (320) may provide the types of external electronic devices searched around the first electronic device (301) through a UI, and may identify an external electronic device selected by a user from among the types of external electronic devices displayed through the UI as an external electronic device included in the captured image.
[0084] According to one embodiment, the first processor (320) can establish a communication connection between the first electronic device (301) and the external electronic device by using the first communication circuit (390) (e.g., a Bluetooth communication circuit or a Wi-Fi communication circuit) when identifying an external electronic device included in the captured image among external electronic devices located around the first electronic device (301).
[0085] According to one embodiment, when the first processor (320) confirms the selection of the image to be captured, the first processor (320) may transmit information (e.g., fifth information) including a first image (e.g., an image corresponding to a display area of an external electronic device displaying content) corresponding to some of the images captured by the first electronic device (301) to the surrounding external electronic devices (e.g., the plurality of electronic devices (401, 403, and 405) of FIG. 2) through the first communication circuit (390) (e.g., BLE communication circuit). According to an embodiment, when the first processor (320) identifies an external electronic device (e.g., the second electronic device (401) of FIG. 2) that has transmitted information (e.g., sixth information) indicating that it has an image corresponding to (similar to or identical to) the first image included in the information (e.g., fifth information) among the external electronic devices (e.g., the plurality of electronic devices (401, 403, and 405) of FIG. 2), the first processor (320) may establish a communication connection between the first electronic device (301) and the external electronic device using the first communication circuit (390) (e.g., a Bluetooth communication circuit or a Wi-Fi communication circuit).
[0086] According to one embodiment, a first processor (320) may request data related to a first image from an external electronic device and display the data related to the first image received from the external electronic device on a first display.
[0087] According to one embodiment, the first processor (320) may transmit information (e.g., second information) including information related to the first image (e.g., type of content captured with the first image) and time information captured with the image to an external electronic device (e.g., second electronic device (401) of FIG. 2) that has a communication connection established with the first electronic device (301) to request data related to the first image.
[0088] According to one embodiment, the first processor (320) may receive information (e.g., third information) including data related to the first image from an external electronic device (e.g., the second electronic device (401) of FIG. 2) that has a communication connection established with the first electronic device (301).
[0089] According to one embodiment, the first processor (320) can identify the first image and metadata of the first image included in information (e.g., third information) received from the external electronic device as data related to the first image.
[0090] According to one embodiment, the first processor (320) may display (provide) the first image of the external electronic device, which has improved quality (resolution) than the first image captured by the first camera (380) of the first electronic device, through the first display (360) upon receiving the first image captured by the screen at the time of capture from the external electronic device.
[0091] According to one embodiment, the first processor (320) may display (provide) metadata of the first image (e.g., information on content captured with the first image) on the first display (360).
[0092] According to one embodiment, a first processor (320) may generate additional data related to a first image received by an external electronic device using the user's personal information, and display the additional data on a first display.
[0093] According to an embodiment, when the first processor (320) receives information including data related to a first image (e.g., third information including the first image and metadata of the first image) from an external electronic device (e.g., the second electronic device (401) of FIG. 2), the first processor (320) may verify personal information of a user related to the information (e.g., third information) received from the external electronic device (e.g., user history information related to content captured with the first image). According to an embodiment, the first processor (320) may generate additional data corresponding to user-customized data related to the information (e.g., third information) by using the personal information of the user related to the information (e.g., third information).
[0094] According to one embodiment, when the first processor (320) receives information including data related to a first image (e.g., third information including the first image and metadata of the first image) from an external electronic device (e.g., the second electronic device (401) of FIG. 2), the first processor (320) may perform an additional search for the first image and generate result data for the additional search as additional data.
[0095] According to one embodiment, the first processor (320) may display data related to a first image (e.g., the first image and metadata related to the first image) in a first area of the first display (360), while displaying user-customized data related to the information (e.g., third information) or result data for an additional search for the first image as additional data in a second area of the first display (360).
[0096] According to one embodiment, the first processor (320) may receive information (e.g., third information) including data related to the first image, and, if the information (e.g., third information) includes a document file, display a pop-up window inquiring the user about downloading the document file.
[0097] For example, when the first processor (320) confirms a selection of shooting for an external electronic device (e.g., a TV) that displays (plays) a sports (e.g., a baseball game) broadcast through the first camera (380), the first processor (320) may receive a first image captured of the sports game and metadata related to the sports game from the external electronic device (e.g., the TV), search for sports game information and sports game information (e.g., lineup information, goal information, and / or goal highlight information, etc.) currently being broadcast on a site that the user has accessed a specified number of times or more as additional data, and display the first image captured of the sports game received from the external electronic device, metadata related to the sports game, and the additional data on the first display (360).
[0098] For example, when the first processor (320) confirms the selection of shooting for an external electronic device (e.g., TV) displaying a drama broadcast through the first camera (380), the first processor (320) receives a first image captured from the music broadcast and metadata related to the music broadcast from the external electronic device (e.g., TV), and, using the metadata and the user's personal information, creates a menu as additional data for searching for a singer or song included in the captured first image in a streaming service where the user has played music more than a specified number of times and adding the singer or song to the user's playlist. The first processor (320) can display the first image captured from the music broadcast received from the external electronic device, the metadata related to the music broadcast, and the additional data on the first display (360).
[0099] For example, when the first processor (320) confirms a selection of shooting for an external electronic device (e.g., a TV) displaying a music broadcast through the first camera (380), the first processor (320) may receive a first image captured from the drama broadcast and metadata related to the drama broadcast from the external electronic device (e.g., the TV), and may use the metadata and the user's personal information to generate additional data, such as news information related to the drama searched on a site accessed by the user a specified number of times or more and reviews related to the drama searched on YouTube, and may display the image captured from the drama broadcast received from the external electronic device and the metadata related to the drama broadcast and the additional data on the first display (360).
[0100] According to one embodiment, the first processor (320) may, upon confirming a shooting selection for an image including an external electronic device received through the first camera (380), receive data related to content provided from the external electronic device through a management server (not shown).
[0101] A management server (not shown) according to one embodiment can manage at least one electronic device while transmitting and receiving information (e.g., status information and / or location information) with at least one electronic device registered with the management server.
[0102] A management server (not shown) according to one embodiment can check room information (e.g., first room (living room), second room (master bedroom), etc.) in which at least one electronic device is located in the home by transmitting and receiving information with at least one electronic device in the home.
[0103] According to one embodiment, a management server (not shown) can, when it confirms that at least one movable electronic device (e.g., a first electronic device (301)) among the electronic devices registered to the management server has entered a home, transmit and receive information with the movable electronic device (e.g., the first electronic device (301)) to check the room information in which the movable electronic device (e.g., the first electronic device (301)) is located in the home.
[0104] According to one embodiment, the first processor (320) may transmit screen capture request information requesting screen capture to a management server when the first camera (380) is activated, and may include information on the time at which the first camera (380) was activated in the screen capture request information.
[0105] According to one embodiment, when the first processor (320) receives information from the management server indicating that an external electronic device (e.g., the second electronic device (401) of FIG. 2) located in a first room (e.g., a living room) where the electronic device (301) is located starts screen capture of content, the first processor (320) may display an indicator for capturing an image including the external electronic device on a portion of the first display (360).
[0106] According to one embodiment, the first processor (320) may display an indicator for capturing an image including an image received through the first camera (380) and an external electronic device through the first display (360), and when selection of the indicator is confirmed, selection of capturing of the image may be confirmed.
[0107] According to one embodiment, the first processor (320) can store the shooting time information of the image and the captured image in the first memory (330) when confirming the selection of shooting for the image.
[0108] According to one embodiment, the first processor (320), upon confirming the selection of the image to be captured, may transmit information (e.g., fourth information) requesting transmission of a first image, which is a screen capture of the content being displayed through the display of the external electronic device, to the management server.
[0109] According to one embodiment, when the first processor (320) receives information (e.g., first information) including a first image captured by screen capturing content being displayed through the display of the external electronic device through the management server, the first processor (320) can confirm that the first image included in the information (e.g., first information) corresponds to (is identical to) a part of an image captured by the first electronic device (301).
[0110] According to one embodiment, a first processor (320) may request data related to a first image from a management server and display the data related to the first image received from the management server on a first display.
[0111] According to one embodiment, the first processor (320) may transmit information related to the first image (e.g., type of content captured with the first image) and information including time information captured with the image (e.g., second information) to the management server to request data related to the first image from a first external electronic device (e.g., second electronic device (401) of FIG. 2).
[0112] According to one embodiment, the first processor (320) may receive information (e.g., third information) including data related to the first image from an external electronic device (e.g., the second electronic device (401) of FIG. 2) through the management server.
[0113] According to one embodiment, the first processor (320) can identify the first image and metadata of the first image included in information (e.g., third information) received from the external electronic device through the management server as data related to the first image.
[0114] According to one embodiment, the first processor (320) may receive a first image of content captured at the time of shooting from the external electronic device through the management server, and display (provide) the first image of the external electronic device, which has improved quality (resolution) than the first image captured through the first camera (380) of the first electronic device, through the first display (360).
[0115] According to one embodiment, when the first processor (320) receives information including data related to a first image (e.g., third information including the first image and metadata of the first image) from an external electronic device (e.g., the second electronic device (401) of FIG. 2) through the management server, the first processor (320) can check the user's personal information (e.g., user's history information related to content captured with the first image) related to the information (e.g., third information) received from the external electronic device.
[0116] According to one embodiment, the first processor (320), when receiving information including data related to a first image (e.g., third information including the first image and metadata of the first image) from an external electronic device (e.g., the second electronic device (401) of FIG. 2) through the management server, may perform an additional search for the first image and generate result data for the additional search as additional data.
[0117] The first memory (330) according to one embodiment may be implemented substantially identically or similarly to the memory (130) of FIG. 1.
[0118] According to one embodiment, a first memory (330) may store data (e.g., the first image and metadata of the first image) related to a first image received from an external electronic device (e.g., the second electronic device (401) of FIG. 2).
[0119] The first display (360) according to one embodiment may be implemented substantially identically or similarly to the display (160) of FIG. 1.
[0120] According to one embodiment, the first display (360) may display data related to a first image (e.g., the first image and metadata of the first image) received from an external electronic device (e.g., the second electronic device (401) of FIG. 2) and additional data corresponding to user-customized data generated using the data related to the first image and the user's personal information.
[0121] A first communication circuit (390) according to one embodiment can form a communication connection with an external electronic device (e.g., another electronic device or a server) using various types of communication methods and transmit and / or receive data.
[0122] The first communication circuit (390) according to one embodiment may include at least one short-range communication circuit (not shown).
[0123] According to one embodiment, the first communication circuit (390) may include an NFC communication circuit, a BLE communication circuit, and / or a UWB communication circuit capable of transmitting and receiving UWB signals with an external device using a plurality of antennas, a Bluetooth communication circuit, and / or a Wi-Fi communication circuit.
[0124] Figure 4 is a block diagram of a second electronic device according to one embodiment.
[0125] Referring to the above FIG. 4, the second electronic device (401) may include a second processor (420), a second memory (430), a second display (460), and a second communication circuit (390).
[0126] According to one embodiment, the second processor (420) may perform overall control operations of the second electronic device (401). According to one embodiment, the second processor (420) may execute software (e.g., the program (140) of FIG. 1) to control at least one other component (e.g., a hardware or software component) of the second electronic device (401) connected to the second processor (320), and may perform data processing or calculations based on instructions. According to one embodiment, an instruction may include a command composed of a machine language that can be processed by the second electronic device (301) or the second processor (420). For example, the instruction may include a command corresponding to an operation instruction used in a program.
[0127] According to one embodiment, the second processor (420) can store screen captured images of the content at specified intervals while displaying (playing) the content through the second display (460).
[0128] According to one embodiment, the second processor (420) can, when it confirms the start of displaying content through the second display (460), store screen-captured images of the content in the second memory (430) every specified time (e.g., 1 second or 5 seconds).
[0129] According to one embodiment, when the second processor (420) receives screen capture request information requesting screen capture of content displayed through the second display (460) from an external electronic device (e.g., the first electronic device (301) of FIG. 2), the second processor (420) may store screen-captured images of the content in the second memory (430) at designated intervals.
[0130] According to one embodiment, the second processor (420) may store images of the content captured on the screen at specified times and time information of the screen capture for each of the images in the second memory (430).
[0131] According to one embodiment, when a second processor (420) receives a request for a first image that is a screen capture of content being displayed through a second display from an external electronic device, the second processor (420) can transmit information (e.g., first information) including the first image that is a screen capture of the content to the external electronic device and establish a communication connection with the external electronic device.
[0132] According to one embodiment, the second processor (420) may receive information (e.g., fourth information) requesting transmission of a first image that is a screen capture of content being displayed through a second display (460) through a second communication circuit (490) (e.g., BLE communication circuit).
[0133] According to one embodiment, when the second processor (420) receives information requesting transmission of a first image (e.g., fourth information), it can identify an image stored before a specified time based on the time at which the information (e.g., fourth information) was received among images stored as screen captures for the content at specified times as the first image.
[0134] According to one embodiment, the second processor (420) can predict a delay according to the transmission time of the information (e.g., fourth information) and identify an image stored before a specified time based on the time at which the information (e.g., fourth information) was received as the first image.
[0135] According to one embodiment, the second processor (420) may transmit information (e.g., first information) including the entire area or a portion of the first image to the external electronic device.
[0136] According to one embodiment, the second processor (420) may establish a communication connection between the second electronic device (401) and the external electronic device through a second communication circuit (490) (e.g., a Bluetooth communication circuit or a Wi-Fi communication circuit) after transmitting information (e.g., first information) including the entire area or a part of the first image.
[0137] According to one embodiment, a second processor (420) may receive information (e.g., fifth information) including a first image (e.g., an image corresponding to a display area of an external electronic device that displays content) corresponding to some of the images captured by the external electronic device (e.g., the first electronic device (301) of FIG. 2) from an external electronic device (e.g., the first electronic device (301) of FIG. 2) through a first communication circuit (390) (e.g., a BLE communication circuit).
[0138] According to one embodiment, the second processor (420) may perform a screen capture of content displayed through the second display (460) to generate an image, compare the generated image with an image included in the information (e.g., fifth information), and, if the comparison results confirm that the two images are similar or identical, transmit information (e.g., sixth information) notifying that the external electronic device has an image corresponding to (similar to or identical to) the first image included in the information (e.g., fifth information).
[0139] According to one embodiment, the second processor (420) predicts a delay according to a transmission time of the information (e.g., fifth information), compares an image stored before a designated time based on a time at which the information (e.g., fifth information) was received with an image included in the information (e.g., fifth information), and if the comparison results confirm that the two images are similar or identical, transmits information (e.g., sixth information) notifying that the external electronic device has an image corresponding to (similar to or identical to) the first image included in the information (e.g., fifth information).
[0140] According to one embodiment, the second processor (420) may establish a communication connection between the second electronic device (401) and the external electronic device by using a second communication circuit (490) (e.g., a Bluetooth communication circuit or Wi-Fi communication) after transmitting the information (e.g., the sixth information).
[0141] According to one embodiment, when a second processor (420) receives information (e.g., second information) requesting data related to a first image from an external electronic device, the second processor (420) may transmit information (e.g., third information) including data related to the first image to the external electronic device.
[0142] According to one embodiment, when a communication connection is established between a second electronic device (401) and an external electronic device (e.g., the first electronic device (301) of FIG. 2), the second processor (420) may receive information (e.g., second information) including information related to the first image (e.g., type of content captured with the first image) and time information at which the image was captured by the external electronic device as information requesting data related to the first image from the external electronic device.
[0143] According to one embodiment, the second processor (420) may identify, as the first image, an image captured from the screen at the time the image was taken by the external electronic device included in the information (e.g., second information) among the images captured from the screen of the content displayed on the second display (460) at a specified time.
[0144] According to one embodiment, the second processor (420) may identify, as the first image, an image of content screen-captured at a time closest to the time at which the image was taken by the external electronic device included in the information (e.g., second information) among images of content screen-captured and displayed on the second display (460) at specified times.
[0145] According to one embodiment, the second processor (420) may identify an image of content screen-captured at a time (T2-T1) obtained by subtracting the time (T1) at which the image was captured by the external electronic device included in the information (e.g., second information) from the time (T2) at which the information (e.g., second information) was received among the screen-captured images of content displayed on the second display (460) at specified times as the first image.
[0146] According to one embodiment, the second processor (420), when content displayed through the second display (460) is provided as a streaming service, performs screen capture at a specified time, and uses a timestamp of a URL to identify a frame of content having the time at which the image was captured by the external electronic device as playback location information, and identifies an image obtained by screen capturing the identified content frame as the first image.
[0147] According to an embodiment, the second processor (420) may collect metadata of content screen-captured with the first image, and generate the collected metadata as metadata of the first image. For example, if the content screen-captured with the first image is a video, the second processor (420) may collect the type of content, the title of the content, a URL, a thumbnail, and / or a playback position, etc., as metadata of the first image. For example, if the content screen-captured with the first image is a broadcast, the second processor (420) may collect the channel name, the broadcast start time, the capture time title, and / or the broadcast name, etc., as metadata of the first image. For example, if the content screen-captured with the first image is a document, the second processor (420) may collect the file name, the file format, the file modification date, the file creation date, and / or the file size, etc., as metadata of the first image.
[0148] According to one embodiment, the second processor (420) may transmit information (e.g., third information) including the first image and metadata of the first image as data related to the first image to the external electronic device.
[0149] According to one embodiment, when the second processor (420) receives screen capture request information requesting screen capture of content displayed through the second display (460) from a management server (not shown), the second processor (420) can store screen captured images of the content in the second memory (430) at designated intervals.
[0150] According to one embodiment, when a second processor (420) receives a request for a first image that is a screen capture of content being displayed through a second display from the management server, the second processor (420) may transmit information (e.g., first information) including the first image that is a screen capture of the content to the management server.
[0151] According to one embodiment, the second processor (420) may receive information (e.g., fourth information) requesting transmission of a first image, which is a screen capture of content being displayed through a second display (460), from an external electronic device (e.g., the first electronic device (301) of FIG. 2) through the management server.
[0152] According to one embodiment, when the second processor (420) receives information (e.g., fourth information) requesting transmission of a first image through the management server, it can identify an image stored before a specified time based on the time at which the information (e.g., fourth information) was received among images stored as screen captures for the content at specified times as the first image.
[0153] According to one embodiment, when the second processor (420) receives information (e.g., fourth information) requesting transmission of the first image through the management server, it can predict a delay according to the transmission time of the information (e.g., fourth information) and identify an image stored before a specified time based on the time at which the information (e.g., fourth information) was received as the first image.
[0154] According to one embodiment, the second processor (420) may transmit information (e.g., first information) including the entire area or a portion of the first image to the management server.
[0155] According to one embodiment, when a second processor (420) receives information (e.g., second information) requesting data related to a first image from an external electronic device through a management server, the second processor (420) may transmit information (e.g., third information) including data related to the first image to the external electronic device through the management server.
[0156] According to one embodiment, the second processor (420) may receive information (e.g., second information) including information related to the first image (e.g., type of content captured with the first image) and time information captured by the external electronic device as information requesting data related to the first image from the external electronic device through the management server.
[0157] According to one embodiment, the second processor (420) may transmit information (e.g., third information) including the first image and metadata of the first image as data related to the first image to an external electronic device through the management server.
[0158] The second memory (330) according to one embodiment may be implemented substantially identically or similarly to the memory (130) of FIG. 1.
[0159] According to one embodiment, the second memory (430) may store screen captured images of content displayed on the second display (260) at specified times.
[0160] The second display (460) according to one embodiment may be implemented substantially identically or similarly to the display (160) of FIG. 1.
[0161] According to one embodiment, the second display (460) can display content selected by the user.
[0162] A second communication circuit (490) according to one embodiment can form a communication connection with an external electronic device (e.g., another electronic device or a server) using various types of communication methods and transmit and / or receive data.
[0163] A second communication circuit (490) according to one embodiment may include at least one short-range communication circuit (not shown).
[0164] The second communication circuit (490) according to one embodiment may include an NFC communication circuit, a BLE communication circuit, and / or a UWB communication circuit capable of transmitting and receiving UWB signals with an external device using a plurality of antennas, a Bluetooth communication circuit, and / or a Wi-Fi communication circuit.
[0165] FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H are drawings for explaining an operation of displaying content of an external electronic device in an electronic device according to one embodiment.
[0166] Referring to FIG. 5A, a first electronic device (301) (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may store the time at which a camera (e.g., the first camera (380) of FIG. 3) of the first electronic device (301) is activated. The first electronic device (301) may analyze an image (511) received through the camera, and as a result of the analysis of the image (511), may confirm the inclusion of an external electronic device (an image of the external electronic device) (401a) in the image (511).
[0167] Referring to FIG. 5b, the first electronic device (301) may display a UI (513) indicating that the display of the external electronic device included in the image (511) has been recognized on the display (360) of the first electronic device (e.g., the first display (360) of FIG. 3), and may display a UI (e.g., an indicator) (515) for selecting a shooting that can confirm the intention to shoot content displayed through the display of the external electronic device.
[0168] As shown in the above FIG. 5c, when the first electronic device (301) confirms the selection of the UI (e.g., indicator) (515) for selecting a shooting, if the image (517) displayed through the display (360) of the first electronic device (301) includes a plurality of external electronic devices (images of the plurality of external electronic devices) (a1, a2), the first electronic device (301) may display a pop-up window (551) that allows the user to select an external electronic device to be the shooting target.
[0169] As shown in the above FIG. 5d, when the first electronic device (301) confirms the selection of the UI (e.g., indicator) (515) for shooting selection, if the image (519) displayed through the display (360) of the first electronic device includes different contents (b1, b2) displayed on the display of the external electronic device, the first electronic device may display a pop-up window (553) that allows the user to select the contents to be shot.
[0170] As shown in the above FIG. 5e, when the first electronic device (301) confirms the selection of the UI (e.g., indicator) (515) for shooting selection, the time at which the UI (e.g., indicator) (515) is selected can be stored as the shooting time in the image (511). When the first electronic device (301) confirms the selection of the UI (e.g., indicator) (515) for selecting a shooting, the first electronic device (301) can compare a first image (511a) corresponding to at least a part of an image (511) captured by the first electronic device (301) (e.g., an image corresponding to a display area of an external electronic device displaying content) with a screen-captured image of content displayed on the display of each of a plurality of external electronic devices (401, 403, and 405) located nearby, thereby confirming (identifying) a second electronic device (401) corresponding to the external electronic device image (401a) included in the image (511) among the plurality of external electronic devices (401, 403, and 405) located nearby. The first electronic device (301) can establish a communication connection (555) with the identified second electronic device (401) through the communication circuit of the first electronic device (e.g., the first communication circuit (390) of FIG. 3).
[0171] As shown in the above FIG. 5f, when the first electronic device (301) includes different contents (e.g., first contents (b1), second contents (b2)) displayed on the display of an external electronic device in the image (519) displayed through the display (360) of the first electronic device, the user can confirm the selection of the second contents (b2) through a pop-up window that allows the user to select the contents to be photographed, and can confirm (identify) the second electronic device (401) corresponding to the external electronic device image (401a) included in the image (519) among a plurality of external electronic devices. When the first electronic device (301) establishes a communication connection (555) with the second electronic device (401), the first electronic device (301) can transmit (557) to the second electronic device (401) information (e.g., second information) including information related to second content (b2) among the first images (519a) corresponding to at least a part of the images (519) captured by the first electronic device (301) (e.g., an image corresponding to a display area of the second electronic device displaying content) and information about the time at which the image (519) was captured.
[0172] As shown in the above FIG. 5g, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401)) displays the first content (b1) and the second content (b2) on the display of the second electronic device (401) (e.g., the second display (460) of FIG. 4), when receiving information (e.g., second information) including information related to the first content (b1) (e.g., the type of the first content) and information including the time information at which the image including the first content (b1) was captured by the first electronic device, the second electronic device (301) captures the first image (571a) that is a screen capture of the first content (b1) at the time the image including the first content (b1) was captured by the first electronic device, and metadata (571b) of the first image (571a) (e.g., first Information (e.g., third information) including metadata related to content (b1) can be transmitted to the first electronic device.
[0173] When the second electronic device (401) receives information (e.g., second information) including information related to the second content (b2) (e.g., type of the second content) and time information at which the first electronic device captured an image including the second content (b2) while displaying the first content (b1) and the second content (b2) on the display of the second electronic device (401) (e.g., second display (460) of FIG. 4), the second electronic device (401) may transmit to the first electronic device a first image (573a) that is a screen capture of the second content (b2) at the time the first electronic device captured the image including the second content (b2) and information (e.g., third information) including metadata of the first image (573a) (e.g., metadata related to the second content (b2)).
[0174] As shown in FIG. 5h, if the information (e.g., third information) received from the second electronic device (401) includes a document file, the first electronic device (301) may display a pop-up window (591) asking the user whether to download the document. If the information (e.g., third information) received from the second electronic device (401) does not include a document file, the first electronic device (301) may display a message (593) notifying the completion of downloading the information received from the second electronic device.
[0175] FIG. 6 is a diagram for explaining an operation of confirming an image based on time information in an electronic device according to one embodiment.
[0176] Referring to FIG. 6, a first electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may transmit various time information to a second electronic device (e.g., the second electronic device (401) of FIG. 2, and / or the second electronic device (401) of FIG. 4) until it receives information (e.g., third information) including the first image and metadata of the first image as data related to the first image corresponding to at least a portion of the images captured by the first electronic device. The first electronic device transmits to the second electronic device, for example, time information (UTC2) at which the camera of the first electronic device is activated, time information (UTC2) at which the first electronic device selects to capture an image including an external electronic device, and time information (UTC3) at which a communication connection is established between the first electronic device and the second electronic device, so that the user of the first electronic device can accurately acquire an image at a time at which the user intends to capture the image.
[0177] The second electronic device can generate (verify) an image A (611) that is a screen capture of content displayed at, for example, "2 o'clock" based on the time information (UTC2) at which the camera of the first electronic device is activated, received from the first electronic device. The second electronic device can generate (verify) an image B (613) that is a screen capture of content displayed at, for example, "2:03" based on the time information (UTC12) at which the camera of the first electronic device is activated, received from the first electronic device. The second electronic device can generate (verify) an image C (615) that is a screen capture of content displayed at, for example, "2:04" based on the time information (UTC3) at which a communication connection is established between the first electronic device and the second electronic device, received from the first electronic device. The second electronic device can identify image B (613) among image A (611), image B (613) and image C (615) as an image at a time point at which the user of the first electronic device intended to take a picture, and transmit image B (613) to the first electronic device.
[0178] FIGS. 7A, 7B, 7C, and 7D are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0179] Referring to FIG. 7a, a first electronic device (301) (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) analyzes an image (711) received through a camera of the first electronic device (301) (e.g., the first camera (380) of FIG. 3), and as a result of the analysis of the image (711), can confirm the inclusion of an external electronic device (an image of the external electronic device) (401a) in the image (711). The first electronic device (301) can confirm (identify) the second electronic device (401) corresponding to the external electronic device image (401a) included in the image (711) among the plurality of external electronic devices (e.g., the plurality of electronic devices (401, 403, and 405) of FIG. 2) by comparing a first image (711a) corresponding to at least a portion of an image (711) captured by the first electronic device (301) with an image captured by screen capturing the content displayed on each display of a plurality of external electronic devices (e.g., the plurality of electronic devices (401, 403, and 405) of FIG. 2) located nearby. The first electronic device (301) can establish a communication connection with the second electronic device (401) identified above through the communication circuit of the first electronic device (e.g., the first communication circuit (390) of FIG. 3). When the first electronic device (301) confirms the selection of shooting for the image (711), the first electronic device (301) can transmit information (e.g., second information) including information about the first image (711a) and shooting time information at which shooting of the image (711) was selected to the second electronic device (401).
[0180] Referring to FIG. 7b, when the second electronic device (401) receives information (e.g., second information) including information about a first image (711a) and information about a shooting time at which shooting of the image (711) is selected from the first electronic device (301) while displaying content (751) related to a home shopping broadcast through the display (460) of the second electronic device (401) (e.g., the second display (460) of FIG. 4), the second electronic device (401) may identify an image captured at a shooting time at which shooting of the image (711) is selected among screen-captured images of the content (751) at designated times as the first image (713a), and collect metadata of the content captured as the first image as metadata (713b) of the first image. The first electronic device (401) can transmit information (e.g., third information) including a first image (713a) and metadata (713b) of the first image to the first electronic device (301).
[0181] Referring to FIG. 7c, when the first electronic device (301) receives information (e.g., third information) including a first image (713a) and metadata (713b) of the first image from the second electronic device (401), the first electronic device (301) may perform an additional image search for the first image (713a) using the information (e.g., third information) and confirm first additional information (715a) based on the additional search. The first electronic device (301) may confirm second additional information (715b) based on the user's personal information (e.g., user history information) related to the information (e.g., third information), and may generate information (image) (717a) about a product that can be recommended to the user and purchase link data (717b) that can purchase the product as additional data corresponding to the user's customized data based on the first additional information (715a) and the second additional information (715b).
[0182] As shown in FIG. 7d, the first electronic device (301) can display the first image (713a) and metadata (713b) of the first image received from the second electronic device (401) in the first area of the display (360) of the first electronic device (301) (e.g., the first display (360) of FIG. 3). The first electronic device (301) can display a purchase link for purchasing a product included in the first image (713a) in the second area of the display (360) of the first electronic device as additional data (717b), and can display information (images) about a product similar to the product included in the first image (713a) owned by the user in the second area of the display as additional data (717c).
[0183] FIGS. 8A, 8B, 8C, and 8D are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0184] Referring to FIG. 8a, a first electronic device (301) (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) analyzes an image (831) received through a camera of the first electronic device (301) (e.g., the first camera (380) of FIG. 3), and as a result of the analysis of the image (831), can confirm the inclusion of an external electronic device (an image of the external electronic device) (401a) in the image (831). The first electronic device (301) can confirm (identify) a second electronic device (401) corresponding to the external electronic device image (401a) included in the image (831) among the plurality of external electronic devices located nearby by comparing a first image (831a) corresponding to at least a portion of an image (831) captured by the first electronic device (301) (e.g., an image corresponding to a display area of an external electronic device displaying content) with a screen-captured image of content displayed on each display of a plurality of external electronic devices (e.g., a plurality of electronic devices (401, 403, and 405) of FIG. 2). The first electronic device (301) can establish a communication connection with the confirmed second electronic device (401) through a communication circuit of the first electronic device (e.g., a first communication circuit (390) of FIG. 3). When the first electronic device (301) confirms the selection of shooting for the image (831), it can transmit information (e.g., second information) including information about the first image (831a) and shooting time information at which shooting of the image (831) was selected to the second electronic device (401).
[0185] Referring to FIG. 8b, when the second electronic device (401) receives information (e.g., second information) including information about a first image (831a) and information about a shooting time at which the image (831) was selected from among screen-captured images of the content (851) at designated times while displaying content (851) related to a document file through the display (460) of the second electronic device (401) (e.g., the second display (460) of FIG. 4), the second electronic device (401) can identify an image captured at a shooting time at which the image (831) was selected among screen-captured images of the content (851) at designated times as the first image (833a), collect metadata of the content captured as the first image as metadata (833b) of the first image, and identify a document file (833c) related to the first image (833a). The first electronic device (401) can transmit information (e.g., third information) including a first image (833a), metadata (833b) of the first image, and a document file (833c) to the first electronic device (301).
[0186] Referring to FIG. 8c, when the first electronic device (301) receives information (e.g., third information) including a first image (833a), metadata (833b) of the first image, and a document file (833c) from the second electronic device (401), the first electronic device (301) may use the information (e.g., third information) to identify first additional information (835a) that is obtained by analyzing the document content included in the first image (831a). The first electronic device (301) may identify second additional information (835b) based on the user's personal information (e.g., user history information) related to the information (e.g., third information), and may generate additional data corresponding to the user's customized data based on the first additional information (835a) and the second additional information (835b).
[0187] As shown in FIG. 8d, the first electronic device (301) can display a first image (833a), metadata (833b) of the first image, and a document file (833a) received from the second electronic device (401) in a first area of the display (360) of the first electronic device (301) (e.g., the first display (360) of FIG. 3). The first electronic device (301) can display a document content summary included in the first image (831a) based on the first additional information (835a) as additional data (837a) in a second area of the display (360) of the first electronic device. The first electronic device (301) can display information on a similar document file or a document having a similar or identical file name as additional data (837b) based on the second additional information (835b) in the second area of the display (360) of the first electronic device.
[0188] FIGS. 9A and 9B are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0189] Referring to FIG. 9A, an electronic device (301) (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may, in response to transmission of information requesting data related to a first image (e.g., second information), receive information (e.g., third information) including the first image and metadata of the first image as data related to the first image from an external electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4). The electronic device (301) may, by using the user's personal information (e.g., user history information) related to the information (e.g., third information), identify at least one image that is identical or similar to the first image (911a) included in the information (e.g., third information), and group the first image received from the external electronic device with the identified at least one image. The first electronic device (301) may sequentially display a plurality of grouped images (913) corresponding to the user's drag direction (915a, 915b).
[0190] Referring to FIG. 9B, an electronic device (301) (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may display a first image (917a) and metadata (917b) of the first image included in information (e.g., third information) received from an external electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4) in a first area of a display (360) of the electronic device (301) (e.g., the first display (360) of FIG. 3). The electronic device (301) may analyze a user's previous content viewing history and then display a notification recommending related content that the user may prefer as additional data (919) in a second area of the display (360) of the electronic device.
[0191] FIGS. 10A and 10B are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0192] Referring to FIG. 10A, an electronic device (301) (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may transmit information (e.g., second information) requesting data related to a first image to a first external electronic device (e.g., a monitor), and receive information (e.g., third information) from the first external electronic device (e.g., the monitor) as data related to the first image, including the first image and first metadata of the first image. The electronic device (301) can display a first image (1011) and first metadata (1013) of the first image included in information (e.g., third information) received from the first external electronic device (e.g., monitor) through a display (360) of the electronic device, and the first metadata (1013) of the first image can include singer and / or song information related to music that can be provided by the first external electronic device (e.g., monitor).
[0193] Referring to FIG. 10B, the electronic device (301) may transmit information (e.g., second information) requesting data related to the same first image as the first external electronic device (e.g., monitor) to a second external electronic device (e.g., TV), and receive information (e.g., third information) including the first image and second metadata of the first image as data related to the first image from the second external electronic device (e.g., TV), and the second metadata (1015) of the first image may include broadcast information related to music that may be provided by the second external electronic device (e.g., TV). The electronic device (301) may display the first image (1011) and the first metadata (1013) of the first image included in the information (e.g., third information) received from the first external electronic device (e.g., monitor) through the display (360) of the electronic device. The electronic device (301) may be provided with the same image and different search results (e.g., metadata) depending on the type of external electronic device requesting.
[0194] FIGS. 11A and 11B are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0195] Referring to FIG. 11A, when an electronic device (301) (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) receives information (e.g., third information) including a first image and metadata of the first image through an external electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4), the electronic device (301) may display the first image (1111) and the metadata (1113) of the first image in a first area of a display (360) of the electronic device (301) (e.g., the first display (360) of FIG. 3), and display a notification notifying personalized information as additional data (1131) in a second area of the display (360). The electronic device (301) can confirm the selection of a notification notifying personalized information displayed as the additional data (1131) in the second area of the display (360).
[0196] Referring to FIG. 11b, the electronic device (301) may expand the second area of the display (360) based on the selection of a notification notifying the user of personalized information displayed as the additional data (1131) in the second area of the display (360) to provide the user with various personalized information (e.g., recommendations for people to share with, searches for similar files, and / or searches for similar images).
[0197] FIGS. 12a, 12b, 12c, and 12d are drawings for explaining an operation for displaying content of an external electronic device in an electronic device according to one embodiment.
[0198] Referring to FIG. 12A, an electronic device (301) (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may display a first image (1201) and metadata (1203) of the first image received from an external electronic device (e.g., the second electronic device (401) of FIG. 2, and / or the second electronic device of FIG. 4) on a first area of a display (360) of the electronic device (301) (e.g., the first display (360) of FIG. 3), while displaying a follow-up image (e.g., a sports-related image) related to the first image (1201) as additional data (1205) on a second area of the display (360).
[0199] Referring to FIG. 12b, an electronic device (301) (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may display a first image (1211) and metadata (1213) of the first image received from an external electronic device (e.g., the second electronic device (401) of FIG. 2, and / or the second electronic device of FIG. 4) on a first area of a display (360) of the electronic device (e.g., the first display (360) of FIG. 3), while displaying purchase link information for purchasing a product included in the first image (1211) and information (image information) about a product similar to the product included in the first image (1211) owned by the user as additional data (1231a) on a second area of the display (360).
[0200] Referring to FIG. 12c, when the electronic device (301) confirms that the purchase link information among the additional data (1231a) provided in FIG. 12a is not used by the user, the electronic device (301) may display a first image (1211) and metadata (1213) of the first image received from an external electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device of FIG. 4) in a first area of the display (360) of the electronic device (e.g., the first display (360) of FIG. 3), and instead of the purchase link information, the electronic device may display information on a home shopping channel preferred by the user and information (image information) on a product similar to the product included in the first image (1211) owned by the user as additional data (1231b) in a second area of the display (360).
[0201] Referring to FIG. 12d, the electronic device (301) may display a first image (1211) and metadata (1213) of the first image received from an external electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device of FIG. 4) in a first area of a display (360) of the electronic device (301) (e.g., the first display (360) of FIG. 3). When the first electronic device (301) confirms a change in a shopping mall preferred by the user based on a change in the user's personal information related to the first image, the first electronic device (301) may display purchase link information and information (image information) on products similar to the products included in the first image (1211) sold in the changed shopping mall preferred by the user as additional data (1231c) in a second area of the display (360).
[0202] An electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) according to one embodiment includes a camera (e.g., the camera (180) of FIG. 1 and / or the first camera (380) of FIG. 3), a communication circuit (e.g., the communication circuit (190) of FIG. 1 and / or the first communication circuit (390) of FIG. 3), a display (e.g., the display (160) of FIG. 1 and / or the first display (360) of FIG. 3), at least one processor including a processing circuit (e.g., the processor (120) of FIG. 1 and / or the first processor (320) of FIG. 3)) and a memory storing instructions (e.g., the memory (130) of FIG. 1 and / or the memory (330) of FIG. 3), which instructions, when executed by the at least one processor, cause the electronic device to, through the camera, When receiving an image including a device and confirming a selection of shooting while displaying the image through the display, the external electronic device that has transmitted first information including a first image corresponding to at least a part of the captured image among at least one external electronic device is identified, and when establishing a communication connection between the electronic device and the external electronic device, second information requesting data related to the first image is transmitted to the external electronic device, and when receiving third information including data related to the first image from the external electronic device, the data related to the first image can be set to be displayed through the display.
[0203] The instructions according to one embodiment may be configured to cause the electronic device, when executed by the at least one processor, to identify an image of a display area of the external electronic device displaying content in an image including the external electronic device as the first image.
[0204] The instructions according to one embodiment, when executed by the at least one processor, may be configured to cause the electronic device to include information related to the first image and information on the time at which the image was captured in the second information.
[0205] The instructions according to one embodiment, when executed by the at least one processor, may be configured to cause the electronic device to display the first image and the metadata of the first image through the display when the first image and the metadata of the first image are identified as data related to the first image in the third information.
[0206] The instructions according to one embodiment, when executed by the at least one processor, may be configured to cause the electronic device to, when receiving the third information from the external electronic device, verify personal information of a user related to the third information, verify additional data related to the third information using the personal information of the user, and display the additional data in a second area of the display while displaying data related to the image in a first area of the display.
[0207] The instructions according to one embodiment may be configured to cause the electronic device, when executed by the at least one processor, to, upon confirming the inclusion of the external electronic device in an image received through the camera, confirm the intention to photograph content displayed through a display of the external electronic device, display an indicator for photographing an image including the external electronic device in a portion of the display, and confirm selection of the indicator as selection of the photographing.
[0208] The instructions according to one embodiment may be configured to, when executed by the at least one processor, cause the electronic device to, upon confirming the selection of the photographing, transmit fourth information requesting transmission of a first image, which is a screen capture of content being displayed through a display of each of the at least one external electronic device, to the at least one external electronic device.
[0209] An electronic device (e.g., a second electronic device (401) of FIG. 2 and / or a second electronic device (401) of FIG. 4) according to an embodiment includes a communication circuit (e.g., a second communication circuit (490) of FIG. 4), a display (e.g., a second display (460) of FIG. 4), at least one processor including a processing circuit (e.g., a second processor (420) of FIG. 4), and a memory (e.g., a memory (430) of FIG. 4) storing instructions, which, when executed by the at least one processor, cause the electronic device to, when displaying content through the display, receive a request for a first image of the content screen-captured from an external electronic device, transmit first information including the first image of the content screen-captured to the external electronic device, establish a communication connection between the electronic device and the external electronic device based on the transmission of the first information, and, when receiving second information requesting data related to the first image from the external electronic device, transmit the first It may be configured to transmit third information including data related to the image to the external electronic device.
[0210] The instructions according to one embodiment, when executed by the at least one processor, may be configured to cause the electronic device to store screen captured images of the content at specified intervals while displaying the content through the display.
[0211] The instructions according to one embodiment may be configured to cause the electronic device, when executed by the at least one processor, to check information related to the first image and capture time information of the image from second information received from the external electronic device, check a first image created by screen capture at the capture time of the image among images created by screen capture of the content at each designated time, check metadata of the first image, and transmit third information including the first image and metadata of the first image to the external electronic device.
[0212] FIGS. 13A and 13B are flowcharts illustrating operations of displaying content of an external electronic device on an electronic device using a communication connection between the electronic device and the external electronic device according to an embodiment. The operations of displaying content of the external electronic device may include operations 1301 to 1337. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or other operations may be added.
[0213] In operation 1301, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4) may display content.
[0214] According to one embodiment, the second electronic device (401) can display (play) content selected by a user through a display of the second electronic device (e.g., the second display (460) of FIG. 4).
[0215] In operation 1303, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may, upon confirming activation of the camera of the first electronic device, store information on the time at which the camera was activated.
[0216] According to one embodiment, when the first electronic device (301) confirms activation of the camera of the first electronic device (e.g., the first camera (380) of FIG. 3) based on the execution of a camera application, the first electronic device (301) may store information on the time at which the camera was activated in the memory of the first electronic device (e.g., the first memory (330) of FIG. 3).
[0217] In operation 1305, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may transmit screen capture request information to at least one external electronic device including the second electronic device (401).
[0218] According to one embodiment, the first electronic device (301) may transmit screen capture request information requesting screen capture of content displayed through the display of each of the external electronic devices (e.g., the plurality of external electronic devices (401, 403, and 405) of FIG. 2) at designated times.
[0219] According to one embodiment, the first electronic device (301) may include information on the time at which the camera of the first electronic device was activated in the screen capture request information.
[0220] In operation 1307, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) may store images of content captured on the screen at specified intervals.
[0221] According to an embodiment, when the second electronic device (401) receives screen capture request information requesting screen capture of content displayed through a display of the second electronic device (e.g., the second display (461) of FIG. 4) from the first electronic device (301), the second electronic device (401) may store screen-captured images of the content and screen capture time information for each of the images at designated intervals in the memory of the second electronic device (401) (e.g., the second memory (430) of FIG. 4).
[0222] In operation 1309, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) can confirm the inclusion of an external electronic device in an image received through a camera of the first electronic device (301).
[0223] According to one embodiment, the first electronic device (301) may analyze an image received through a camera of the first electronic device (301) (e.g., the first camera (380) of FIG. 3) and confirm the inclusion of an external electronic device (an image of the external electronic device) in the image.
[0224] In operation 1311, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may display an indicator for capturing an image including an external electronic device.
[0225] According to one embodiment, the first electronic device (301), when confirming that the image includes an external electronic device (an image of the external electronic device), may confirm the user's intention to capture content displayed through the display of the external electronic device and display an indicator for capturing an image including the external electronic device on a portion of the display of the first electronic device (e.g., the first display (360) of FIG. 3).
[0226] In operation 1313, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may, upon confirming selection of the indicator, store image capture time information in operation 1315.
[0227] The first electronic device (301) according to one embodiment can confirm selection of the indicator as selection of shooting for the image, and store shooting time information of the image. For example, the shooting time information of the image can be stored as UTC (universal time coordinated) time.
[0228] In operation 1317, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may transmit information requesting transmission of a first image, which is a screen capture of content being displayed through a display of each of the external electronic devices, to external electronic devices including the second electronic device.
[0229] According to one embodiment, when the first electronic device (301) confirms the selection of the indicator as a selection of capturing the image, the first electronic device (301) may transmit information (e.g., fourth information) requesting transmission of a first image, which is a screen capture of content being displayed through the display of each of the external electronic devices (e.g., a plurality of external electronic devices (401, 403, and 405) of FIG. 2), through the communication circuit (e.g., the first communication circuit (390) (e.g., BLE communication circuit)) of the first electronic device (301).
[0230] In operation 1319, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) may obtain a first image as a screen capture of content being displayed through the display of the second electronic device.
[0231] According to an embodiment, when the second electronic device (401) receives information (e.g., fourth information) requesting transmission of a first image from the first electronic device (301), the second electronic device (401) may acquire (confirm) as the first image an image stored before a specified time based on the time at which the information (e.g., fourth information) was received among images stored as screen captures for the content at specified times.
[0232] According to one embodiment, the second electronic device (401) can predict a delay according to the transmission time of the information (e.g., fourth information) and acquire (confirm) an image stored before a specified time based on the time at which the information (e.g., fourth information) was received as a first image.
[0233] In operation 1321, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) may transmit information including a first image to the first electronic device.
[0234] According to one embodiment, the second electronic device (401) can transmit information (e.g., first information) including the entire area or a portion of the first image to the first electronic device (301).
[0235] In operation 1323, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may identify a second electronic device that has received information (e.g., first information) including a first image corresponding to a part of an image captured by the first electronic device (301) among information including a first image received from external electronic devices as an external electronic device included in the captured image.
[0236] According to an embodiment, when the first electronic device (301) receives information (e.g., first information) including a first image that is a screen capture of content being displayed through a display of each of the external electronic devices (e.g., a plurality of external electronic devices (401, 403, and 405) of FIG. 2) in the vicinity through a communication circuit (e.g., a first communication circuit (390) (e.g., a BLE communication circuit)) of the first electronic device (301), the second electronic device (401) that has received information (e.g., first information) including a first image corresponding to a part of an image captured by the first electronic device (301) among the information (e.g., first information) including the first image received from the external electronic devices can identify the external electronic device included in the captured image.
[0237] According to one embodiment, the first electronic device (301) can identify an image corresponding to a display area of an external electronic device that displays content in the captured image as the first image.
[0238] According to an embodiment, when the first electronic device (301) receives a first image that is a screen capture of content being displayed through a display of each of the external electronic devices from the external electronic devices, the first electronic device (301) compares the entire area or a part of the first image among the images captured by the first electronic device (301) with the entire area or a part of the first image received from the external electronic devices, and identifies the second electronic device (401) that has received information (e.g., first information) including the first image corresponding to a part of the image captured by the first electronic device (301) among the external electronic devices (e.g., the plurality of external electronic devices (401, 403, and 405) of FIG. 2) as the external electronic device included in the captured image.
[0239] In operation 1325, a communication connection can be established between a first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) and a second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4).
[0240] According to one embodiment, a communication connection may be established between the first electronic device (301) and the second electronic device (401) using a communication circuit of the first electronic device (e.g., the first communication circuit (390) of FIG. 3 (e.g., a Bluetooth communication circuit or a WI-FI communication)) and a communication circuit of the second electronic device (e.g., the first communication circuit (990) of FIG. 4 (e.g., a Blurtooth communication circuit or a WI-FI communication)).
[0241] In operation 1327, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may transmit information requesting data related to the first image to the second electronic device (401).
[0242] According to one embodiment, the first electronic device (301) may transmit information (e.g., second information) including information related to the first image (e.g., type of content captured with the first image) and time information of capturing the image to the second electronic device (401) in order to request data related to the first image.
[0243] In operation 1329, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) can check the first image and metadata of the first image.
[0244] According to one embodiment, the second electronic device (401) may receive information (e.g., second information) including information related to the first image (e.g., type of content captured with the first image) and time information at which the image was captured by the first electronic device, as information requesting data related to the first image from the first electronic device (301).
[0245] According to one embodiment, the second electronic device (401) can identify, as the first image, an image created by screen capture at the time the image was taken by the first electronic device, which is included in the information (e.g., second information), among images captured by screen capturing content displayed on the display of the second electronic device (401) (e.g., the second display (460) of FIG. 4) at specified times.
[0246] According to one embodiment, the second electronic device (401) can identify, as the first image, an image created by screen capture at a time closest to the time at which the image was captured by the first electronic device (301) included in the information (e.g., second information) among images of content displayed on the display of the second electronic device (401) at specified times.
[0247] According to one embodiment, the second electronic device (401) can identify an image generated by screen capture at a time (T2-T1) obtained by subtracting a time (T1) at which an image was captured by the first electronic device (301) included in the information (e.g., second information) from a time (T2) at which the information (e.g., second information) was received among screen capture images of content displayed on the display of the second electronic device (401) at specified times, as the first image.
[0248] According to one embodiment, the second electronic device (401) may collect metadata of content captured on the screen as the first image, and generate the collected metadata as metadata of the first image.
[0249] In operation 1331, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) may transmit information including a first image and metadata of the first image to the first electronic device.
[0250] According to one embodiment, the second electronic device (401) may transmit information (e.g., third information) including the first image and metadata of the first image as data related to the first image to the first electronic device (301).
[0251] In operation 1333, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) can check information including the first image and metadata of the first image.
[0252] According to one embodiment, the first electronic device (301) can identify the first image and metadata of the first image included in information (e.g., third information) received from the second electronic device (401) as data related to the first image.
[0253] In operation 1335, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may generate additional data related to the first image received by the second electronic device based on the user's personal information.
[0254] According to an embodiment, when the first electronic device (301) receives information including data related to a first image from the second electronic device (401) (e.g., third information including the first image and metadata of the first image), the first electronic device (301) can check personal information of a user (e.g., history information of the user related to content captured with the first image) related to the information (e.g., third information) received from the second electronic device (401).
[0255] According to one embodiment, the first electronic device (301) may generate additional data corresponding to user-customized data related to the information (e.g., third information) by using the user's personal information related to the information (e.g., third information).
[0256] According to one embodiment, when the first electronic device (301) receives information including data related to a first image (e.g., third information including the first image and metadata of the first image) from the second electronic device (401), the first electronic device (301) may perform an additional search for the first image and generate result data for the additional search as additional data.
[0257] In operation 1337, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may display a first image, metadata of the first image, and additional data.
[0258] According to one embodiment, the first electronic device (301) may display (provide) a first image of the external electronic device having improved quality (resolution) than a first image captured by a camera of the first electronic device (301) (e.g., the first camera (380) of FIG. 3)) through a display of the first electronic device (301) (e.g., the first display (360) of FIG. 3) upon receiving a first image captured by a screen of the content at the time of capture from the second electronic device (401).
[0259] According to one embodiment, the first electronic device (301) can display (provide) information of content captured with the first image, which is included as metadata of the first image, on the display of the first electronic device (301).
[0260] According to one embodiment, the first electronic device (301) may display data related to a first image (e.g., the first image and metadata related to the first image) in a first area of a first display of the first electronic device (301), while displaying additional data corresponding to user-customized data related to the information (e.g., third information) or result data for an additional search for the first image in a second area of the display.
[0261] FIG. 14 is a flowchart illustrating an operation of displaying content from an external electronic device in an electronic device according to an embodiment. The operations of displaying content from the external electronic device may include operations 1401 to 1421. In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, at least two operations may be performed in parallel, or other operations may be added.
[0262] In operation 1401, an electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) can confirm reception of an image including an external electronic device.
[0263] According to one embodiment, when a camera (e.g., a first camera (380)) of the electronic device is activated, the electronic device stores information on the time at which the camera was activated, and for example, the information on the time at which the camera was activated can be stored as UTC (universal time coordinated) time.
[0264] According to one embodiment, the electronic device may transmit screen capture request information requesting screen capture of content displayed on a display of each of the external electronic devices (e.g., a plurality of external electronic devices (401, 403, and 405) of FIG. 2) at designated intervals to surrounding external electronic devices (e.g., a first communication circuit (390) (e.g., a BLE communication circuit)) when a camera of the electronic device is activated.
[0265] According to one embodiment, the electronic device may analyze an image received through a camera of the electronic device and determine whether the image includes an external electronic device (e.g., the second electronic device (401) of FIG. 2) (an image of the external electronic device).
[0266] In operation 1403, an electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may display an indicator for capturing an image including an external electronic device.
[0267] According to one embodiment, the electronic device analyzes an image received through a camera of the electronic device (e.g., the first camera (380) of FIG. 3), and when it confirms that an external electronic device (an image of the external electronic device) is included in the image, it confirms that the user has an intention to capture content displayed through a display of the external electronic device, and displays an indicator for capturing an image including the external electronic device in a part of the display of the electronic device (e.g., the first display (360) of FIG. 3).
[0268] According to one embodiment, the electronic device (320) may analyze an image received through a camera of the electronic device (e.g., the first camera (380) of FIG. 3), and if it recognizes an external electronic device (e.g., an image of the external electronic device or a shape corresponding to a display of the external electronic device (e.g., a rectangle)) in the image, it may confirm that the user has an intention to capture content displayed through the display of the external electronic device, and may display an indicator for capturing an image including the external electronic device in a portion of the display of the electronic device.
[0269] In operation 1405, the electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may, upon confirming selection of the indicator, transmit information requesting transmission of a first image, which is a screen capture of content being displayed through the display of each of the external electronic devices, to the external electronic devices in operation 1407.
[0270] In one embodiment, the electronic device displays an indicator for capturing an image including an image received through a camera (e.g., a first camera (380) of FIG. 3) of the electronic device and an external electronic device through a display (e.g., a first display (360) of FIG. 3) of the electronic device, and when selection of the indicator is confirmed, selection of capturing of the image can be confirmed.
[0271] According to one embodiment, the electronic device may store shooting time information of the image when confirming a selection for shooting the image, and for example, the shooting time information of the image may be stored in UTC (universal time coordinated) time.
[0272] According to one embodiment, the electronic device, when confirming the selection of the image to be captured, may transmit information (e.g., fourth information) requesting transmission of a first image, which is a screen capture of content being displayed through the display of each of the external electronic devices (e.g., a plurality of external electronic devices (401, 403, and 405) of FIG. 2), to the surrounding external electronic devices through the communication circuit of the electronic device (e.g., the first communication circuit (390) of FIG. 3 (e.g., BLE communication circuit)).
[0273] In operation 1409, an electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may receive information from external electronic devices, including a first image that is a screen capture of content being displayed through the display of each of the external electronic devices.
[0274] According to one embodiment, the electronic device may receive information (e.g., first information) including a first image that is a screen capture of content being displayed through a display of each of the external electronic devices (e.g., a plurality of external electronic devices (401, 403, and 405) of FIG. 2) from surrounding external electronic devices through a communication circuit of the electronic device (e.g., a first communication circuit (390) of FIG. 3 (e.g., a BLE communication circuit)).
[0275] In operation 1411, an electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may identify an external electronic device that has received information including a first image corresponding to a part of an image captured by the electronic device among external electronic devices as an external electronic device included in the captured image.
[0276] According to an embodiment, the electronic device may identify an external electronic device (e.g., a second electronic device (401) of FIG. 2) that has received information (e.g., first information) including a first image corresponding to a part of an image captured by the electronic device among information (e.g., first information) including a first image received from the external electronic devices (e.g., a plurality of external electronic devices (401, 403, and 405) of FIG. 2) as an external electronic device included in the captured image.
[0277] According to one embodiment, the electronic device can identify an image corresponding to a display area of an external electronic device that displays content from the captured image as the first image.
[0278] According to one embodiment, when the electronic device receives a first image that is a screen capture of content being displayed through a display of each of the external electronic devices from the external electronic devices, the electronic device compares the entire area or a part of the first image among the images captured by the electronic device with the entire area or a part of the first image received from the external electronic devices, and identifies an external electronic device (e.g., a second electronic device (401) of FIG. 2) that has received information (e.g., first information) including a first image corresponding to a part of an image captured by the electronic device among the external electronic devices (e.g., a plurality of external electronic devices (401, 403, and 405) of FIG. 2) as an external electronic device included in the captured image.
[0279] In operation 1413, an electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may establish a communication connection with an external electronic device.
[0280] According to one embodiment, when the electronic device identifies an external electronic device included in the captured image among external electronic devices located around the electronic device, the electronic device can establish a communication connection between the electronic device and the external electronic device by using a communication circuit of the electronic device (e.g., a first communication circuit of FIG. 3 (e.g., a Bluetooth communication circuit or Wi-Fi communication).
[0281] In operation 1415, an electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may transmit information requesting data related to a first image to an external electronic device.
[0282] According to one embodiment, the electronic device may transmit information (e.g., second information) including information related to the first image (e.g., type of content captured with the first image) and time information captured with the image, to an external electronic device (e.g., second electronic device (401) of FIG. 2) with which a communication connection is established, in order to request data related to the first image.
[0283] In operation 1417, an electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may receive information including data related to a first image from an external electronic device.
[0284] According to one embodiment, the electronic device may receive information (e.g., third information) including data related to a first image from an external electronic device (e.g., the second electronic device (401) of FIG. 2) with which a communication connection is established with the electronic device.
[0285] According to one embodiment, the electronic device can identify a first image and metadata of the first image included in information (e.g., third information) received from the external electronic device as data related to the first image.
[0286] In operation 1419, an electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may generate additional data related to a first image received by an external electronic device based on the user's personal information.
[0287] According to one embodiment, when the electronic device receives information including data related to a first image (e.g., third information including the first image and metadata of the first image) from an external electronic device (e.g., the second electronic device (401) of FIG. 2), the electronic device can check personal information of a user (e.g., user history information related to content captured with the first image) related to the information (e.g., third information) received from the external electronic device.
[0288] According to one embodiment, the electronic device may generate additional data corresponding to user-customized data related to the information (e.g., third information) using personal information of the user related to the information (e.g., third information).
[0289] According to one embodiment, when the electronic device receives information including data related to a first image (e.g., third information including the first image and metadata of the first image) from an external electronic device (e.g., the second electronic device (401) of FIG. 2), the electronic device may perform an additional search for the first image and generate result data for the additional search as additional data.
[0290] In operation 1421, an electronic device (e.g., the electronic device (101) of FIG. 1, the first electronic device (301) of FIG. 2, and / or the first electronic device (301) of FIG. 3) may display a first image, metadata of the first image, and additional data.
[0291] According to one embodiment, the electronic device may display data related to a first image (e.g., the first image and metadata related to the first image) in a first area of a display of the electronic device (e.g., the first display (360) of FIG. 3), and display additional data corresponding to user-customized data related to the information (e.g., third information) or result data for an additional search for the first image in a second area of the display of the electronic device.
[0292] FIG. 15 is a flowchart illustrating an operation for providing content information from an electronic device to an external electronic device according to an embodiment. The operations for providing content information to the external electronic device may include operations 1501 to 1513. In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, at least two operations may be performed in parallel, or other operations may be added.
[0293] In operation 1501, an electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4) may display content.
[0294] According to one embodiment, the second electronic device (401) can display (play) content selected by the user through the display of the electronic device (e.g., the second display (460) of FIG. 4).
[0295] In operation 1503, an electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4) may store images of content captured on the screen at specified intervals.
[0296] According to one embodiment, when the electronic device confirms the start of displaying content through the display of the electronic device (e.g., the second display (460) of FIG. 4), the electronic device can store screen-captured images of the content in the memory of the electronic device (e.g., the second memory (430) of FIG. 4) at specified intervals (e.g., 1 second or 5 seconds).
[0297] According to an embodiment, when the electronic device receives screen capture request information requesting screen capture of content displayed through a display of the electronic device from an external electronic device (e.g., the first electronic device (301) of FIG. 2), the electronic device may store screen-captured images of the content in a memory of the electronic device (e.g., the second memory (430) of FIG. 4) at designated intervals.
[0298] According to one embodiment, the electronic device may store images of the content captured on the screen at specified times and screen capture time information for each of the images in the memory of the electronic device.
[0299] In operation 1505, an electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4) may receive information requesting a first image of screen-captured content from an external electronic device.
[0300] According to one embodiment, the electronic device may receive information (e.g., fourth information) requesting transmission of a first image, which is a screen capture of content being displayed through a display (e.g., second display (460) of FIG. 4) of the electronic device, from an external electric vehicle device (e.g., first electronic device (301) of FIG. 2) through a communication circuit (e.g., second communication circuit (490) (e.g., BLE communication circuit)) of the electronic device.
[0301] According to one embodiment, when the electronic device receives information requesting transmission of a first image (e.g., fourth information), it can acquire (confirm) as a first image an image stored before a specified time based on the time at which the information (e.g., fourth information) was received among images stored as screen captures for the content at specified times.
[0302] According to one embodiment, the electronic device can predict a delay according to a transmission time of the information (e.g., fourth information) and acquire (confirm) an image stored before a specified time based on the time at which the information (e.g., fourth information) was received as a first image.
[0303] In operation 1507, an electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4) may transmit information including a first image to an external electronic device.
[0304] According to one embodiment, the electronic device may transmit information (e.g., first information) including the entire area or a portion of the first image to the external electronic device.
[0305] In operation 1509, an electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4) may establish a communication connection with an external electronic device.
[0306] According to one embodiment, the electronic device can establish a communication connection with the external electronic device (e.g., the first electronic device (301) of FIG. 2) through a communication circuit (e.g., a second communication circuit (490)) of the electronic device (e.g., a Bluetooth communication circuit or a Wi-Fi communication circuit)) after transmitting information (e.g., first information) including the entire area or a part of the first image.
[0307] In operation 1511, when an electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4) receives information requesting data related to a first image from an external electronic device, the electronic device can verify the first image and metadata of the first image.
[0308] According to an embodiment, when the electronic device establishes a communication connection with the external electronic device (e.g., the first electronic device (301) of FIG. 2), the electronic device may receive information requesting data related to the first image from the external electronic device, including information related to the first image (e.g., the type of content captured with the first image) and information including time information at which the image was captured by the external electronic device (e.g., second information).
[0309] According to one embodiment, the electronic device can identify, as the first image, an image created by screen capture at the time the image was taken by the external electronic device included in the information (e.g., second information) among images captured by screen capturing content displayed (played) on the display of the electronic device (e.g., second display (460) of FIG. 4) at specified times.
[0310] According to one embodiment, the electronic device can identify, as the first image, an image created by screen capture at a time closest to the time at which the image was taken by the external electronic device included in the information (e.g., second information) among images of screen captures of content displayed (played) on the display of the electronic device at specified times.
[0311] According to one embodiment, the electronic device can identify an image generated by screen capture at a time (T2-T1) obtained by subtracting a time (T1) at which an image is captured by the external electronic device included in the information (e.g., second information) from a time (T2) at which the information (e.g., second information) is received among screen capture images of content displayed on the display of the electronic device at specified times, as the first image.
[0312] According to one embodiment, the electronic device may collect metadata of content captured on the screen as the first image, and generate the collected metadata as metadata of the first image.
[0313] In operation 1513, an electronic device (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4) may transmit information including a first image and metadata of the first image to an external electronic device.
[0314] According to one embodiment, the electronic device may transmit information (e.g., third information) including the first image and metadata of the first image as data related to the first image to the external electronic device.
[0315] FIGS. 16A and 16B are flowcharts illustrating operations of an electronic device and an external electronic device using a management server to display content of an external electronic device on an electronic device according to an embodiment. The operations of displaying content of the external electronic device may include operations 1601 to 1649. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or another operation may be added. A management server (501) according to an embodiment may manage at least one electronic device while transmitting and receiving information with at least one electronic device registered in the management server (501). By transmitting and receiving information with at least one electronic device in a home, the management server (501) according to an embodiment may check room information (e.g., a first room (living room), a second room (master bedroom), etc.) in which at least one electronic device is located in a home. According to one embodiment, when a management server (501) confirms that at least one movable electronic device (e.g., a first electronic device (301)) among the electronic devices registered in the management server (301) has entered the home, the management server (501) can confirm room information in which the movable electronic device (e.g., the first electronic device (301)) is located in the home by transmitting and receiving information with the movable electronic device (e.g., the first electronic device (301)).
[0316] In operation 1601, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (401) of FIG. 4) may display content.
[0317] According to one embodiment, the second electronic device (401) can display (play) content selected by a user through a display of the second electronic device (e.g., the second display (460) of FIG. 4).
[0318] In operation 1603, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may, upon confirming activation of the camera of the first electronic device, store information on the time at which the camera was activated.
[0319] According to one embodiment, when the first electronic device (301) confirms activation of the camera of the first electronic device (e.g., the first camera (380) of FIG. 3) based on the execution of a camera application, the first electronic device (301) may store information on the time at which the camera was activated in the memory of the first electronic device (e.g., the first memory (330) of FIG. 3).
[0320] In operation 1605, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may transmit screen capture request information to the management server (501).
[0321] According to one embodiment, the first electronic device (301) may include information on the time at which the camera of the first electronic device was activated in the screen capture request information.
[0322] In operation 1607, the management server (501) can check the first electronic device in the first room of the house and check the second electronic device located in the first room.
[0323] In operation 1069, the management server (501) can transmit screen capture request information to the second electronic device (401).
[0324] According to one embodiment, the management server (501) may transmit screen capture request information to the second electronic device (401) when it is confirmed that the second electronic device is displaying content in an on state based on information received from the second electronic device (401).
[0325] According to one embodiment, the management server (501) can, when it determines that the second electronic device (401) is in an off state based on information received from the second electronic device (401), transmit a command requesting the second electronic device to be turned on and screen capture request information to the second electronic device (401).
[0326] According to one embodiment, when the management server (105) determines that the second electronic device (401) is in an off state based on information received from the second electronic device (401), it can transmit information to the first electronic device (301) informing that the second electronic device (401) located in the first room of the house where the first electronic device is located is currently in an off state.
[0327] In operation 1611, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) may transmit information indicating the start of screen capture for content to the management server (501).
[0328] In operation 1613, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) may store images of content captured on the screen at specified intervals.
[0329] According to an embodiment, when the second electronic device (401) receives screen capture request information requesting screen capture of content displayed through a display of the second electronic device (e.g., the second display (461) of FIG. 4) from a management server (501), the second electronic device (401) may store screen-captured images of the content and screen capture time information for each of the images in a memory of the second electronic device (401) at designated intervals (e.g., the second memory (430) of FIG. 4).
[0330] In operation 1615, the management server (501) may transmit information indicating the start of screen capture for content to the first electronic device (301).
[0331] According to one embodiment, when the management server (501) receives information from the second electronic device (401) indicating the start of screen capture for content, the management server (501) may transmit information to the first electronic device (301) indicating that a second external electronic device located in a first room (e.g., living room) in the house where the first electronic device (301) is located has started screen capture for content.
[0332] In operation 1617, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may display an indicator for capturing an image including an external electronic device.
[0333] According to one embodiment, when the first electronic device (301) receives information from the management server (501) indicating that a second external electronic device located in a first room (e.g., living room) of a house where the first electronic device (301) is located has started screen capture of content, the first electronic device (301) may display an indicator for capturing an image including the external electronic device on a portion of a display of the first electronic device (e.g., the first display (360) of FIG. 3).
[0334] In operation 1619, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may, upon confirming selection of the indicator, store image capture time information in operation 1621.
[0335] The first electronic device (301) according to one embodiment can confirm selection of the indicator as selection of shooting for the image, and store the captured image and shooting time information of the image. For example, the shooting time information of the image can be stored as UTC (universal time coordinated) time.
[0336] In operation 1623, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may transmit information requesting transmission of a first image, which is a screen capture of content being displayed through a display of the second electronic device, to the management server (501).
[0337] According to one embodiment, when the first electronic device (301) confirms the selection of the indicator as a selection of shooting the image, it can transmit information (e.g., fourth information) requesting transmission of a first image that is a screen capture of content being displayed through the display of the second electronic device (401) to the management server.
[0338] In operation 1625, the management server (501) may transmit information requesting transmission of a first image that is a screen capture of content being displayed through the display of the second electronic device to the second electronic device.
[0339] In operation 1627, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) may obtain a first image as a screen capture of content being displayed through the display of the second electronic device.
[0340] According to one embodiment, when the second electronic device (401) receives information (e.g., fourth information) requesting transmission of a first image from the management server (501), it can acquire (confirm) as a first image an image stored before a specified time based on the time at which the information (e.g., fourth information) was received among images stored as screen captures for the content at specified times.
[0341] According to one embodiment, the second electronic device (401) can predict a delay according to the transmission time of the information (e.g., fourth information) and acquire (confirm) an image stored before a specified time based on the time at which the information (e.g., fourth information) was received as a first image.
[0342] In operation 1629, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) may transmit information including the first image to the management server.
[0343] According to one embodiment, the second electronic device (401) may transmit information (e.g., first information) including the entire area or a portion of the first image to the management server (501).
[0344] In operation 1631, the management server (501) can transmit information including the first image to the first electronic device (301).
[0345] In operation 1633, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) can confirm that the first image included in the information (e.g., the first information) received from the management server corresponds (matches) with a part of the image captured by the first electronic device (301).
[0346] In operation 1635, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may transmit information requesting data related to the first image to the management server (501).
[0347] According to one embodiment, the first electronic device (301) may transmit information related to the first image (e.g., type of content captured with the first image) and information including time information captured with the image (e.g., second information) to the management server (501) in order to request data related to the first image.
[0348] In operation 1637, the management server (501) may transmit information requesting data related to the first image to the second electronic device (401).
[0349] In operation 1639, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) can check the first image and metadata of the first image.
[0350] According to one embodiment, the second electronic device (401) may receive information (e.g., second information) including information related to the first image (e.g., type of content captured with the first image) and time information at which the image was captured by the first electronic device, as information requesting data related to the first image from the management server (501).
[0351] According to one embodiment, the second electronic device (401) can identify, as the first image, an image created by screen capture at the time the image was taken by the first electronic device, which is included in the information (e.g., second information), among images captured by screen capturing content displayed on the display of the second electronic device (401) (e.g., the second display (460) of FIG. 4) at specified times.
[0352] According to one embodiment, the second electronic device (401) can identify, as the first image, an image created by screen capture at a time closest to the time at which the image was captured by the first electronic device (301) included in the information (e.g., second information) among images of content displayed on the display of the second electronic device (401) at specified times.
[0353] According to one embodiment, the second electronic device (401) can identify an image generated by screen capture at a time (T2-T1) obtained by subtracting a time (T1) at which an image was captured by the first electronic device (301) included in the information (e.g., second information) from a time (T2) at which the information (e.g., second information) was received among screen capture images of content displayed on the display of the second electronic device (401) at specified times, as the first image.
[0354] According to one embodiment, the second electronic device (401) may collect metadata of content captured on the screen as the first image, and generate the collected metadata as metadata of the first image.
[0355] In operation 1641, the second electronic device (401) (e.g., the second electronic device (401) of FIG. 2 and / or the second electronic device (4301) of FIG. 4) may transmit information including the first image and metadata of the first image to the management server (501).
[0356] According to one embodiment, the second electronic device (401) may transmit information (e.g., third information) including the first image and metadata of the first image as data related to the first image to the management server (501).
[0357] In operation 1643, the management server (501) can transmit information including the first image and metadata of the first image to the first electronic device (201).
[0358] In operation 1645, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) can check information including the first image and metadata of the first image.
[0359] According to one embodiment, the first electronic device (301) can identify the first image and metadata of the first image included in information (e.g., third information) received from the management server (501) as data related to the first image.
[0360] In operation 1647, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may generate additional data related to the first image received by the second electronic device based on the user's personal information.
[0361] According to one embodiment, when the first electronic device (301) receives information including data related to the first image from the management server (501) (e.g., third information including the first image and metadata of the first image), the first electronic device (301) can check the user's personal information (e.g., user's history information related to content captured with the first image) related to the information (e.g., third information) received from the management server (501).
[0362] According to one embodiment, the first electronic device (301) may generate additional data corresponding to user-customized data related to the information (e.g., third information) by using the user's personal information related to the information (e.g., third information).
[0363] According to one embodiment, when the first electronic device (301) receives information including data related to the first image (e.g., third information including the first image and metadata of the first image) from the management server (501), the first electronic device (301) may perform an additional search for the first image and generate result data for the additional search as additional data.
[0364] In operation 1649, the first electronic device (301) (e.g., the first electronic device (301) of FIG. 2 and / or the first electronic device (301) of FIG. 3) may display a first image, metadata of the first image, and additional data.
[0365] According to one embodiment, the first electronic device (301) may display (provide) a first image of the external electronic device having improved quality (resolution) than a first image captured by a camera of the first electronic device (301) (e.g., the first camera (380) of FIG. 3)) through a display of the first electronic device (301) (e.g., the first display (360) of FIG. 3) upon receiving a first image captured by a screen of the content at the time of capture from the management server (501).
[0366] According to one embodiment, the first electronic device (301) can display (provide) information of content captured with the first image, which is included as metadata of the first image, on the display of the first electronic device (301).
[0367] According to one embodiment, the first electronic device (301) may display data related to a first image (e.g., the first image and metadata related to the first image) in a first area of a first display of the first electronic device (301), while displaying additional data corresponding to user-customized data related to the information (e.g., third information) or result data for an additional search for the first image in a second area of the display.
[0368] According to one embodiment, a method for displaying content of an external electronic device in an electronic device may include: receiving an image including an external electronic device through a camera of the electronic device; confirming a selection of shooting while displaying the image through a display of the electronic device; identifying an external electronic device that has transmitted first information including a first image corresponding to at least a portion of the captured image among at least one external electronic device; transmitting second information requesting data related to the first image to the external electronic device when a communication connection is established between the electronic device and the external electronic device; and displaying data related to the first image through the display when receiving third information including data related to the first image from the external electronic device.
[0369] The method according to one embodiment may further include an operation of identifying an image of a display area of the external electronic device displaying content in an image including the external electronic device as the first image.
[0370] The method according to one embodiment may further include an operation of including information related to the first image and information on the shooting time of the image in the second information.
[0371] According to one embodiment, the method may further include an operation of displaying the first image and the metadata of the first image through the display when the first image and the metadata of the first image are identified as data related to the first image in the third information.
[0372] According to one embodiment, the method may further include, when receiving the third information from the external electronic device, an operation of confirming personal information of a user related to the third information, an operation of confirming additional data related to the third information using the personal information of the user, and an operation of displaying the additional data in a second area of the display while displaying data related to the image in a first area of the display.
[0373] The method according to one embodiment may further include an operation of confirming, upon confirmation of inclusion of the external electronic device in an image received through the camera, an operation of confirming an intention to photograph content displayed through a display of the external electronic device, and an operation of displaying an indicator for photographing an image including the external electronic device in a portion of the display, and an operation of confirming selection of the indicator as a selection of the photographing.
[0374] The method according to one embodiment may further include, upon confirming the selection of the shooting, transmitting fourth information requesting transmission of a first image, which is a screen capture of content being displayed through a display of each of the at least one external electronic device, to the at least one external electronic device.
[0375] In one embodiment, a method for displaying content of an external electronic device in an electronic device may include, when a request for a first image of a screen-captured content is received from an external electronic device while displaying the content through a display of the electronic device, transmitting first information including a first image of the screen-captured content to the external electronic device; establishing a communication connection between the electronic device and the external electronic device based on the transmission of the first information; and transmitting third information including data related to the first image to the external electronic device when second information requesting data related to the first image is received from the external electronic device.
[0376] The method according to one embodiment may further include an operation of saving screen captured images of the content at specified intervals while displaying the content through the display.
[0377] According to one embodiment, the method may further include an operation of checking information related to the first image and information on the shooting time of the image from second information received from the external electronic device, an operation of checking a first image created by screen capture at the shooting time of the image among images created by screen capture of content at specified times, an operation of checking metadata of the first image, and an operation of transmitting third information including the first image and metadata of the first image to the external electronic device.
[0378] Electronic devices according to embodiments disclosed herein may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments disclosed herein are not limited to the aforementioned devices.
[0379] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0380] The term "module" used in one embodiment of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0381] An embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101) or an electronic device (301)). For example, a processor (e.g., a processor (520)) of the machine (e.g., an electronic device (301)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0382] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0383] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (101 of FIG. 1; 301 of FIG. 2; 301 of FIG. 3), Camera (180 in Fig. 1; 380 in Fig. 3); Communication circuit (190 in Fig. 1; 390 in Fig. 3); Display (160 in Fig. 1; 360 in Fig. 3); At least one processor including a processing circuit (120 in FIG. 1; 320 in FIG. 3); and It includes a memory (130 in Fig. 1; 330 in Fig. 3) that stores commands, The above instructions, when executed by the at least one processor, cause the electronic device to: Through the above camera, an image including an external electronic device is received, When confirming the selection of shooting while displaying the image through the display, the external electronic device that has transmitted the first information including the first image corresponding to at least a part of the captured image among at least one external electronic device is confirmed, When a communication connection is established between the electronic device and the external electronic device, second information requesting data related to the first image is transmitted to the external electronic device, An electronic device configured to display data related to the first image through the display when receiving third information including data related to the first image from the external electronic device.
2. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: An electronic device set to identify an image of a display area of the external electronic device displaying content from an image including the external electronic device as the first image.
3. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: An electronic device set to include information related to the first image and information on the shooting time of the image in the second information.
4. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: An electronic device set to display the first image and the metadata of the first image through the display when the first image and the metadata of the first image are identified as data related to the first image in the third information.
5. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: When receiving the third information from the external electronic device, the user's personal information related to the third information is verified, Using the personal information of the above user, we will check additional data related to the above third party information, An electronic device configured to display additional data in a second area of the display while displaying data related to the image in a first area of the display.
6. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: When the inclusion of the external electronic device in the image received through the camera is confirmed, the intention to capture the content displayed through the display of the external electronic device is confirmed, and an indicator for capturing the image including the external electronic device is displayed in a part of the display. An electronic device set to confirm the selection of the above indicator with the selection of the above shooting.
7. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: An electronic device configured to transmit fourth information requesting transmission of a first image, which is a screen capture of content being displayed through a display of each of the at least one external electronic device, upon confirmation of the selection of the above shooting.
8. In the electronic device (401 of FIG. 2; 401 of FIG. 4), Communication circuit (490 in Fig. 4); Display (460 in Fig. 4); At least one processor (420 in FIG. 4) comprising a processing circuit; and It includes a memory (430 in Fig. 4) that stores commands, The above instructions, when executed by the at least one processor, cause the electronic device to: When a request for a first image of a screen capture of the content is received from an external electronic device while displaying the content through the display, first information including the first image of the screen capture of the content is transmitted to the external electronic device, Establishing a communication connection between the electronic device and the external electronic device based on the transmission of the first information; An electronic device configured to transmit third information including data related to the first image to the external electronic device when receiving second information requesting data related to the first image from the external electronic device.
9. In paragraph 8, The above instructions, when executed by the at least one processor, cause the electronic device to: An electronic device configured to save screen captured images of the content at specified intervals while displaying the content through the display.
10. In paragraph 8, The above instructions, when executed by the at least one processor, cause the electronic device to: Checking information related to the first image and shooting time information of the image from the second information received from the external electronic device, Among the images generated by screen capture for the content at a specified time, the first image generated by screen capture at the shooting time of the image is checked, Check the metadata of the first image above, An electronic device configured to transmit third information including the first image and metadata of the first image to the external electronic device.
11. A method for displaying content of an external electronic device on an electronic device, An action of receiving an image including an external electronic device through a camera of the electronic device; An operation of confirming a selection of a photograph while displaying the image through a display of the electronic device, and confirming an external electronic device that has transmitted first information including a first image corresponding to at least a part of the photographed image among at least one external electronic device; When a communication connection is established between the electronic device and the external electronic device, an operation of transmitting second information requesting data related to the first image to the external electronic device; and A method comprising an action of displaying data related to the first image through the display when receiving third information including data related to the first image from the external electronic device.
12. In paragraph 11, When the image received through the camera is confirmed to include the external electronic device, an operation of confirming the intention to capture content displayed through the display of the external electronic device and displaying an indicator for capturing an image including the external electronic device in a portion of the display; and A method further comprising an action of confirming the selection of the above indicator with the selection of the above shooting.
13. A method for displaying content of an external electronic device on an electronic device, An operation of receiving a request for a first image of a screen capture of the content from an external electronic device while displaying content through a display of the electronic device, and transmitting first information including the first image of the screen capture of the content to the external electronic device; An operation of establishing a communication connection between the electronic device and the external electronic device based on the transmission of the first information; and A method comprising: receiving second information requesting data related to a first image from the external electronic device; transmitting third information including data related to the first image to the external electronic device.
14. In a non-volatile storage medium storing commands, the commands are configured to cause the electronic device to perform at least one operation when executed by the electronic device, wherein the at least one operation is: An action of receiving an image including an external electronic device through a camera of the electronic device; An operation of confirming a selection of a photograph while displaying the image through a display of the electronic device, and confirming an external electronic device that has transmitted first information including a first image corresponding to at least a part of the photographed image among at least one external electronic device; When a communication connection is established between the electronic device and the external electronic device, an operation of transmitting second information requesting data related to the first image to the external electronic device; and A storage medium including an operation of displaying data related to the first image through the display when receiving third information including data related to the first image from the external electronic device.
15. In a non-volatile storage medium storing commands, the commands are configured to cause the electronic device to perform at least one operation when executed by the electronic device, wherein the at least one operation is: An operation of receiving a request for a first image of a screen capture of the content from an external electronic device while displaying content through a display of the electronic device, and transmitting first information including the first image of the screen capture of the content to the external electronic device; An operation of establishing a communication connection between the electronic device and the external electronic device based on the transmission of the first information; and A storage medium comprising an operation of transmitting third information including data related to the first image to the external electronic device when receiving second information requesting data related to the first image from the external electronic device.
Citation Information
Patent Citations
Method for providing VOD contents of digital TV and AR contents on smart device
KR101797425B1
Mobile terminal and method for controlling the same
KR1020140146759A
Mobile terminal and method for controlling the same
KR1020170078331A
A method of manufactureing jujube soybean paste with excellent antioxident activity and taste
KR102302098B1
Portable device for measuring complex authentication information for identification of companion animals
KR102846001B1