Display device, electronic device and operating method thereof
By realizing content sharing technology in display devices and electronic devices, identifying and sharing display content, the problem of difficult to capture or record display content in the prior art is solved, and high-quality content capture and sharing is achieved.
Patent Information
- Application Number
- CN202380049740.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-08-22
- Filing Date
- 2023-08-22
- Publication Date
- 2025-02-18
AI Technical Summary
The prior art is difficult to effectively capture or record content displayed on display devices, especially due to copyright issues and low quality of content capture.
By introducing a communication unit and a processor in the display device and the electronic device, it is recognized whether the displayed content is shareable content, and some or all of the displayed content is sent to the electronic device through content sharing technology.
It is realized that the content displayed on the display device is effectively captured or recorded without reducing the content quality, meeting the user's capture needs while avoiding copyright issues.
Smart Images

Figure CN119487858A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a display device, an electronic device, and an operating method of the display device and the electronic device, and, for example, to a display device that enables an electronic device to effectively capture content displayed on the display device and an operating method of the display device. Background Art
[0002] Users can use the display device to consume various contents by, for example, watching movies or playing games. In this way, the user may want to capture or record a desired scene from the content while watching the content using the display device, and upload the captured or recorded scene using a social networking service application.
[0003] However, since most contents displayed on the display device have rights-related issues such as copyright, most display devices may not provide a capture function or a recording function. Also, although a user can capture contents displayed on the display device by photographing the display device using a camera of a mobile device separated from the display device, it may be difficult to clearly capture or record only the contents desired by the user. Summary of the invention
[0004] Technical issues
[0005] Embodiments of the present disclosure provide a display device, an electronic device, and an operating method of the display device and the electronic device, so as to effectively capture or record content displayed on the display device.
[0006] Technical Solution
[0007] According to an example embodiment of the present disclosure, a display device includes: a display, a communication unit including a communication circuit, a memory storing one or more instructions, and a processor configured to run one or more instructions stored in the memory. According to an example embodiment of the present disclosure, the processor may be configured to identify whether the content displayed on the display is shareable content by running one or more instructions. According to an example embodiment of the present disclosure, the processor may be configured to control the communication unit to broadcast a signal including status information by running one or more instructions, and the status information indicates that the content is shareable content because the content displayed on the display is identified as shareable content. According to an example embodiment of the present disclosure, the processor may be configured to receive a content sharing request for sharing content based on a broadcast signal from an electronic device by running one or more instructions. According to an example embodiment of the present disclosure, the processor may be configured to control the communication unit to send at least a portion of the content output to the display to the electronic device by running one or more instructions in response to the content sharing request.
[0008] An electronic device according to an exemplary embodiment of the present disclosure includes: a display, a communication unit including a communication circuit, a memory storing one or more instructions, and a processor configured to execute one or more instructions stored in the memory. According to an exemplary embodiment of the present disclosure, the processor may be configured to obtain an image of a display device displaying content through a camera of the electronic device by executing one or more instructions. According to an exemplary embodiment of the present disclosure, the processor may be configured to receive a broadcast signal including state information by executing one or more instructions, the state information indicating that the content displayed on the display device is shareable content. According to an exemplary embodiment of the present disclosure, the processor may be configured to identify whether the display device of the obtained image is a display device that sends a broadcast signal based on the broadcast signal by executing one or more instructions. According to an exemplary embodiment of the present disclosure, the processor may be configured to: by executing one or more instructions, based on determining that the display device of the obtained image is a display device that sends a broadcast signal, send a content sharing request for sharing content to the display device. According to an exemplary embodiment of the present disclosure, the processor may be configured to receive at least a portion of the content output to the display of the display device in response to the content sharing request from the display device by executing one or more instructions.
[0009] The method for operating a display device according to an example embodiment of the present disclosure includes: identifying whether content displayed on the display is shareable content. The method for operating a display device according to an example embodiment of the present disclosure includes broadcasting a signal including status information indicating that the content is shareable content based on the above-mentioned identification. The method for operating a display device according to an example embodiment of the present disclosure includes receiving a content sharing request for sharing content based on a broadcast signal from an electronic device. The method for operating a display device according to an example embodiment of the present disclosure includes sending at least a portion of the content output to the display to the electronic device in response to the content sharing request.
[0010] According to an example embodiment of the present disclosure, a method for operating an electronic device includes: obtaining an image of a display device displaying content through a camera of the electronic device. According to an example embodiment of the present disclosure, the method for operating an electronic device includes receiving a broadcast signal including status information indicating that the content displayed on the display device is shareable content. According to an example embodiment of the present disclosure, the method for operating an electronic device includes, based on the broadcast signal, identifying whether the display device of the obtained image is the display device that sends the broadcast signal. According to an example embodiment of the present disclosure, the method for operating an electronic device includes: sending a content sharing request for sharing content to the display device based on the above-mentioned identification. According to an example embodiment of the present disclosure, the method for operating an electronic device includes receiving from the display device at least a portion of the content output to the display of the display device in response to the content sharing request.
[0011] A computer-readable recording medium according to an exemplary embodiment of the present disclosure has at least one program recorded thereon, and the at least one program may be executed by a processor of a display device to perform a method of operating the display device.
[0012] A computer-readable recording medium according to an exemplary embodiment of the present disclosure has recorded thereon at least one program executable by a processor of an electronic device to perform a method of operating the electronic device.
[0013] Beneficial Effects
[0014] According to various exemplary embodiments of the present disclosure, when a user attempts to capture content displayed on a display device, the content may be transmitted to an electronic device using a content sharing technology, so that the user may capture or record the content with higher quality. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent through the following detailed description in conjunction with the accompanying drawings, in which:
[0016] Figure 1 is a diagram showing an example in which a mobile device captures content displayed on a display device using a camera according to the related art;
[0017] Figure 2 is a diagram illustrating an example system for effectively capturing content displayed on a display device by an electronic device according to various embodiments;
[0018] Figure 3 is a block diagram showing an example configuration of a display device and an electronic device according to various embodiments;
[0019] Figure 4 is a block diagram showing an example configuration of a display device and an electronic device according to various embodiments;
[0020] Figure 5 is a flowchart illustrating an example method of operating a display device according to various embodiments;
[0021] Figure 6 is a flowchart illustrating an example method of operating an electronic device to share content displayed on a display device according to various embodiments;
[0022] Figure 7 is a signal flow diagram illustrating an example method of operating a display device and an electronic device to share content according to various embodiments;
[0023] Figure 8 is a diagram showing an example in which an electronic device recognizes a predetermined object in an obtained image according to various embodiments;
[0024] Fig. 9 is a diagram showing an example in which a display device provides identification response information according to a device check request from an electronic device according to various embodiments;
[0025] Fig.10 is a diagram showing an example in which an electronic device outputs shared content received from a display device according to various embodiments;
[0026] Fig.11 is a diagram illustrating an example user interface that may be provided when an electronic device displays shared content according to various embodiments;
[0027] Fig.12 is a signal flow diagram illustrating an example method of operating a display device and an electronic device to share content according to various embodiments;
[0028] Fig.13 is a diagram illustrating an example process in which an electronic device checks a user's capture intention after checking a display device according to various embodiments;
[0029] Fig.14 is a signal flow diagram illustrating an example method for an electronic device to receive and process shared content according to various embodiments;
[0030] Fig.15 is a diagram showing an example in which an electronic device performs filtering on additional content according to various embodiments;
[0031] Fig.16 is a signal flow diagram illustrating an example method for an electronic device to receive and process shared content according to various embodiments;
[0032] Fig.17 is a signal flow diagram illustrating an example method for an electronic device to receive and process shared content according to various embodiments;
[0033] Fig.18 is a diagram showing an example in which a display device performs filtering on additional content according to various embodiments;
[0034] Fig.19 is a signal flow chart illustrating an example method in which an electronic device sends a content sharing request together with an additional content filtering request to a display device according to various embodiments;
[0035] Fig. 20 is a signal flow diagram illustrating an example method of operating an electronic device when an end command is received while the electronic device is displaying shared content according to various embodiments;
[0036] Fig.21 is a diagram illustrating an example method in which an electronic device ends displaying shared content according to various embodiments;
[0037] Fig. 22 is a signal flow chart illustrating an example method of operating an electronic device when playback of shared content in a display device ends while the electronic device displays the shared content according to various embodiments; and
[0038] Fig.23 is a diagram illustrating an example method in which an electronic device ends displaying shared content according to various embodiments. DETAILED DESCRIPTION
[0039] The terms used herein will be briefly described, and the present disclosure will be described in more detail with reference to the accompanying drawings.
[0040] Considering the functions in the present disclosure, the terms used herein are those common terms currently widely used in the art, but these terms may change according to the intention of ordinary technicians in the art, precedents, or new technologies in the art. In addition, some of the terms used herein may be arbitrarily selected, and in this case, these terms are defined in detail below. Therefore, the specific terms used herein should be defined based on their unique meanings and the entire context of the present disclosure.
[0041] It should be understood that when a certain part "includes" a certain component, the part does not exclude another component, but may further include another component, unless the context clearly dictates otherwise. Also, terms such as "... unit" or "... module" refer to a unit that performs at least one function or operation, and the unit may be implemented as hardware or software or as a combination of hardware and software.
[0042] The present disclosure will now be described more fully with reference to the accompanying drawings. However, the present disclosure may be implemented in many different forms and is not limited to the embodiments of the present disclosure set forth herein. For the sake of clarity, parts not related to the description of the present disclosure may be omitted in the accompanying drawings, and the same parts are represented by the same reference numerals throughout the present disclosure.
[0043] The term "user" as used herein refers to a person who uses a control device to control a function or operation of a computing device or an electronic device, and may include a viewer, a manager, or an installation engineer.
[0044] Figure 1 is a diagram illustrating an example in which a mobile device captures content displayed on a display device using a camera according to the related art.
[0045] refer to Figure 1, the display device 100 may display the content requested by the user. The content displayed by the display device 100 may include any of a variety of content such as video content or game content. For example, when the display device 100 displays game content, the user may want to capture a specific portion of the displayed game content. In this case, the user can capture the screen displaying the game content by capturing an image of the display device 100 using a camera of the electronic device 200.
[0046] However, when the user directly captures the image of the display device 100 using the electronic device 200 in this manner, it may be difficult to effectively obtain the scene of the game content desired by the user. Figure 1 As shown, the screen 20 captured by the mobile device 200 may include not only the image 30 of the screen of the display device 100, but also the image of the environment around the display device 100, for example, the image 40 of the wall. And, when the screen of the display device 100 is captured in this way, the screen may be distorted or the image quality may be uneven, and the light reflected on the screen of the display device 100 or even the user himself / herself may also be captured. Therefore, the user may not be satisfied with using the obtained image of the game content in the social network service system.
[0047] Figure 2 is a diagram illustrating an example system for effectively capturing, by an electronic device, content displayed on a display device according to various embodiments.
[0048] refer to Figure 2 , the system 10 may include a display device 100 and an electronic device 200 .
[0049] The display device 100 may output or display content received from various sources. The display device 100 may include any of various types of electronic devices capable of receiving and outputting content, such as, for example but not limited to, a network TV, a smart TV, an Internet TV, a web TV, an IPTV, a PC, or the like. The display device 100 may be referred to as a display device because it receives and displays content, and may also be referred to as a content output device, an electronic device, or a computing device.
[0050] The electronic device 200 may display the content received from the display device 100, and may capture or record and store a portion of the received content requested by the user. The electronic device 200 may include a camera to capture an image including the display device 100. The electronic device 200 may include any of various types of electronic devices capable of running an application and displaying content according to a user's request. The electronic device 200 may be referred to as an electronic device to distinguish it from the display device 100, and may also be referred to as a portable device, a personal mobile device, a smart device, a computing device, or a multimedia device.
[0051] According to an embodiment of the present disclosure, the display device 100 can display content, and can identify that the displayed content is shareable content. The display device 100 can identify that the displayed content is shareable content based on the attribute information of the content. When there is no copyright problem in the displayed content based on the attribute information of the content, the display device 100 can identify that the content is shareable content. Content without copyright issues may include content that is free of copyright issues, such as content where the copyright itself does not exist, content where the copyright has expired, or content with limited copyright.
[0052] According to an embodiment of the present disclosure, when it is recognized that the displayed content is shareable content, the display device 100 may broadcast a signal including status information indicating that the displayed content is shareable content. For example, the display device 100 may broadcast a signal including status information indicating that the content displayed on the display device 100 is shareable content to an unspecified number of peripheral devices through, for example, BLE communication.
[0053] According to an embodiment of the present disclosure, a user may use the electronic device 200 to operate a camera mode to capture an image of a screen displayed on the display device 100, thereby capturing content displayed on the display device 100. When the electronic device 200 operates in the camera mode, the electronic device 200 may receive a signal broadcasted from the display device 100.
[0054] According to an embodiment of the present disclosure, when the electronic device 200 receives a signal including state information that content displayed on the display device 100 is sharable content from the display apparatus 100 , the electronic device 200 may transmit a content sharing request to the display apparatus 100 .
[0055] According to an embodiment of the present disclosure, the electronic device 200 may send a request to the display device 100 to identify (for example, confirm whether) the display device that sends a signal including status information is the same as the display device that displays the content, and when response information to the request is checked, the electronic device 200 may send a content sharing request to the display device 100.
[0056] According to an embodiment of the present disclosure, when the inspection of the display device 100 is completed in response to a request to identify the display device 100, the electronic device 200 may automatically send a content sharing request to the display device 100, or may send a content sharing request to the display device 100 after checking the user's intention to capture content.
[0057] According to an embodiment of the present disclosure, when the display apparatus 100 receives a content sharing request from the electronic device 200, the display apparatus 100 may transmit the content displayed on the display apparatus 100 to the electronic device 200 using the content sharing technology. According to an embodiment of the present disclosure, when the content displayed on the screen of the display apparatus 100 includes a graphical user interface in addition to the video content, the display apparatus 100 may transmit both the video content and the graphical user interface to the electronic device 200 at once, or may filter the graphical user interface and may transmit only the video content to the electronic device 200. When there is a content sharing request, the user of the electronic device 200 may not want to capture content other than the video content, that is, content such as the graphical user interface, and therefore, in this case, it is preferable to filter and transmit content such as the graphical user interface.
[0058] According to an embodiment of the present disclosure, the electronic device 200 may receive content displayed on the display device 100 from the display apparatus 100 using content sharing technology. The electronic device 200 may perform operations such as capturing or recording a portion of the received content while displaying the received content on the display of the electronic device 200.
[0059] According to various exemplary embodiments of the present disclosure, when a user wants to capture content displayed on the display device 100 using the electronic device 200, the content displayed on the display device 100 is shared with the electronic device 200, and thus, the electronic device can obtain the content displayed on the display device 100 without reducing the quality of the content, and can use the obtained content for personal use in various ways.
[0060] Figure 3 is a block diagram illustrating example configurations of a display device and an electronic device according to various embodiments.
[0061] refer to Figure 3 , the system may include a display apparatus 100 and an electronic device 200 which may be connected to each other through a communication network.
[0062] The display device 100 may be a device for displaying an image or data according to a user's request, and may include a communication unit (eg, including a communication circuit) 110 , a display 120 , a memory 130 , and a processor (eg, including a processing circuit) 140 .
[0063] The communication unit 110 may include various communication circuits included in one or more modules that implement wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network in which another device is located. According to an embodiment of the present disclosure, the communication unit 110 may perform communication with the electronic device 200 according to a short-range communication technology.
[0064] The display 120 may output images or data processed by the display device 100 .
[0065] The memory 130 may store a program for processing and control of the processor 140, and may store data input to or output from the display apparatus 100. Also, the memory 130 may store data required to operate the display apparatus 100.
[0066] The memory 130 may include at least one type of storage medium selected from a flash memory type storage unit, a hard disk type storage unit, a multimedia card micro storage unit, a card type memory (e.g., an SD or XD memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a disk, or an optical disk.
[0067] The processor 140 may include various processing circuits and control the overall operation of the display device 100. For example, the processor 140 may cause the display device 100 to perform functions by executing one or more instructions stored in the memory 130.
[0068] In an embodiment of the present disclosure, the processor 140 may control the operation of the display device to be performed by storing one or more instructions in an internal memory provided therein and executing the one or more instructions stored in the internal memory provided therein. That is, the processor 140 may perform a specified operation by executing at least one instruction or program stored in the internal memory provided in the processor 140 or the memory 130.
[0069] According to an embodiment of the present disclosure, the processor 140 may identify that the content displayed on the display 120 is sharable content by executing one or more instructions stored in the memory 130 .
[0070] According to an embodiment of the present disclosure, when content displayed on the display 120 is identified as shareable content, the processor 140 may control the communication unit 110 to broadcast a signal including status information indicating that the content is shareable content by executing one or more instructions stored in the memory 130 .
[0071] According to an embodiment of the present disclosure, the processor 140 may receive a content sharing request for sharing content based on a broadcast signal from the electronic device 200 by executing one or more instructions stored in the memory 130 .
[0072] According to an embodiment of the present disclosure, the processor 140 may control the communication unit 110 to send at least a portion of the content output to the display 120 to the electronic device in response to a content sharing request received from the electronic device 200 by executing one or more instructions stored in the memory 130 .
[0073] According to an embodiment of the present disclosure, the processor 140 may identify that the content is sharable content by detecting that the content is game content by executing one or more instructions stored in the memory 130 .
[0074] According to an embodiment of the present disclosure, the processor 140 may receive an identification request signal for identifying a display device in response to a broadcast signal from the electronic device by executing one or more instructions stored in the memory 130 .
[0075] According to an embodiment of the present disclosure, the processor 140 may provide identification response information indicating a response together with the content in response to the identification request signal, and may receive a content sharing request for sharing content from the electronic device in response to the identification response information by running one or more instructions stored in the memory 130.
[0076] According to an embodiment of the present disclosure, the processor 140 may embed the recognition response information in the content and may provide the recognition response information invisibly by executing one or more instructions stored in the memory 130 , or may provide the recognition response information to be visibly displayed on the content.
[0077] According to an embodiment of the present disclosure, a content sharing request may include a first type sharing request and a second type sharing request.
[0078] According to an embodiment of the present disclosure, when a first type sharing request is received, the processor 140 may control filtering of additional content other than content in data output to the display by executing one or more instructions stored in the memory 130, and control sending of the content to the electronic device.
[0079] According to an embodiment of the present disclosure, when a second type sharing request is received, the processor 140 may control both the content output to the display and the additional content to be transmitted to the electronic device by executing one or more instructions stored in the memory 130 .
[0080] The components of the block diagram may be integrated, added, or omitted according to the specifications of the display device 100 actually implemented. For example, if necessary, two or more components may be combined into one component, or one component may be subdivided into two or more components. Also, the functions performed in each block are intended to describe the embodiments of the present disclosure, and the detailed operations or devices thereof do not limit the scope of the present disclosure.
[0081] The electronic device 200 may include a communication unit (eg, including a communication circuit) 210, a display 220, a memory 230, a camera 262, and a processor (eg, including a processing circuit) 240. However, the electronic device 200 may include more than Figure 3 There are more elements than those shown in the figure, and the present disclosure is not limited thereto.
[0082] The communication unit 210 may include various communication circuits, and communicate with external devices using any of various communication technologies.
[0083] The display 220 may output images or data processed by the electronic device 200 .
[0084] The camera 262 may capture images (eg, continuous frames) corresponding to the user's motion (including gestures or the external environment within a camera recognition range).
[0085] The memory 230 may store programs for processing and control of the processor 240 , and may store data input to or output from the electronic device 200 .
[0086] The memory 230 may include at least one type of storage medium selected from a flash memory type storage unit, a hard disk type storage unit, a multimedia card micro storage unit, a card type memory (e.g., an SD or XD memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a disk, or an optical disk.
[0087] The processor 240 may include various processing circuits and control the overall operation of the electronic device 200. For example, the processor 240 may enable the electronic device 200 to perform functions by executing one or more instructions stored in the memory 230.
[0088] In an embodiment of the present disclosure, the processor 240 may control the execution of the above operations by storing one or more instructions in an internal memory provided therein and executing the one or more instructions stored in the internal memory provided therein. That is, the processor 240 may execute a specified operation by executing at least one instruction or program stored in the internal memory provided in the processor 240 or the memory 230.
[0089] According to an embodiment of the present disclosure, the processor 240 may obtain an image of the display device displaying content through the camera 262 by executing one or more instructions stored in the memory 230 .
[0090] According to an embodiment of the present disclosure, the processor 240 may control the communication unit 210 to receive a broadcast signal including state information that content displayed on the display device is sharable content by executing one or more instructions stored in the memory 230 .
[0091] According to an embodiment of the present disclosure, the processor 240 may identify (eg, determine whether) the display device of the obtained image is the display device that transmits the broadcast signal based on the broadcast signal by executing one or more instructions stored in the memory 230 .
[0092] According to an embodiment of the present disclosure, the processor 240 may send a content sharing request for sharing content to the display device according to the inspection control communication unit 210 by executing one or more instructions stored in the memory 230 .
[0093] According to an embodiment of the present disclosure, the processor 240 may control the communication unit 210 to receive at least a portion of the content output to the display of the display device in response to the content sharing request from the display device by executing one or more instructions stored in the memory 230 .
[0094] According to an embodiment of the present disclosure, the processor 240 may detect an object representing the display device 100 from an acquired image based on a broadcast signal by executing one or more instructions stored in the memory 230 .
[0095] According to an embodiment of the present disclosure, the processor 240 may transmit an identification request signal for identifying the display device according to detection of an object to the display device by executing one or more instructions stored in the memory 230 .
[0096] According to an embodiment of the present disclosure, the processor 240 may check the display device by detecting recognition response information from an object representing the display device in response to the recognition request signal by executing one or more instructions stored in the memory 230 .
[0097] According to an embodiment of the present disclosure, the processor 240 may detect the recognition response information provided by being invisibly embedded in the content or provided by being visibly displayed on the content by executing one or more instructions stored in the memory 230 .
[0098] According to an embodiment of the present disclosure, the processor 240 can control the communication unit 210 to send a first type of sharing request to filter additional content other than the content in the data output to the display by running one or more instructions stored in the memory 230; or send a second type of sharing request, the second type of sharing request to send both the content output to the display and the additional content to the electronic device.
[0099] According to an embodiment of the present disclosure, the processor 240 may automatically send a content sharing request to the display device according to the check of the display device by controlling the communication unit 210 by executing one or more instructions stored in the memory 230 .
[0100] According to an embodiment of the present disclosure, the processor 240 can provide a user interface for selecting captured content according to the check control communication unit 210 of the display device by running one or more instructions stored in the memory 230, and when a user input for selecting captured content is received according to the user interface, a content sharing request for sharing content is sent to the display device.
[0101] According to an embodiment of the present disclosure, the processor 240 may display content received from the display device according to a content sharing request on the display by executing one or more instructions stored in the memory 230 , and may record or capture content displayed on the display according to user input.
[0102] According to an embodiment of the present disclosure, the electronic device 200 may further include a user interface. According to an embodiment of the present disclosure, the user interface may be any type of interface for receiving user input. According to an embodiment of the present disclosure, for example, the user interface may include an operation button arranged on a part of the electronic device 200 for receiving user input, a light receiving unit that can receive input from a remote control device, and a microphone that can receive touch input or user's voice speech input when the display is a touch-sensitive display.
[0103] The electronic device 200 may be any type of device that includes a processor and a memory and performs a function. The electronic device 200 may be a fixed or portable device. Examples of the electronic device 200 may include various electronic devices such as a computer (e.g., a desktop computer, a laptop computer, or a tablet computer), a television, a set-top box, a smart phone, a cellular phone, a game console, a music player, a video player, a medical device, and a home appliance.
[0104] The components of the block diagram may be integrated, added, or omitted according to the specifications of the electronic device 200 actually implemented. For example, if necessary, two or more components may be combined into one component, or one component may be subdivided into two or more components. In addition, the functions performed in each block are intended to describe the embodiments of the present disclosure, and the detailed operations or devices thereof do not limit the scope of the present disclosure.
[0105] Figure 4 is a block diagram illustrating example configurations of a display device and an electronic device according to various embodiments.
[0106] exist Figure 4 In, with Figure 3The same elements are labeled with the same reference numerals. Therefore, when describing the display device 100 and the electronic device 200, the same reference numerals may not be repeated. Figure 3 The descriptions done are the same as the descriptions.
[0107] refer to Figure 4 In addition to the communication unit 110, the display 120, the memory 130, and the processor 140, the display device 100 may further include a video processing unit (e.g., including a video processing circuit) 125, an audio processing unit (e.g., including an audio processing circuit) 170, an audio output unit (e.g., including an audio output circuit) 150, a detection unit (e.g., including a detection circuit) 160, an input / output unit (e.g., including an input / output circuit) 180, and a user input unit (e.g., including a user input circuit) 190. The processor 140 may control each element of the display device 100 to perform an operation.
[0108] When Figure 4 When describing the memory 130 and the processor 140, it is not necessary to repeat the reference Figure 3 The description is the same as the description given above.
[0109] The communication unit 110 may include one or more modules, each module including various communication circuits, which implement wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network in which another display device is located. For example, the communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, and a short-range communication module 114. The communication unit 110 may be referred to as a transmitting / receiving unit.
[0110] The broadcast receiving module 111 receives broadcast signals and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast signals may include not only TV broadcast signals, radio broadcast signals and data broadcast signals, but also broadcast signals in which data broadcast signals are combined with TV broadcast signals or radio broadcast signals.
[0111] The mobile communication module 112 transmits and receives wireless signals to and from at least one of a base station, an external terminal or a server over a mobile communication network. The wireless signals may include various types of data according to exchange of voice call signals, video call signals or text / multimedia messages.
[0112] The wireless Internet module 113 refers to a module for wireless Internet access and can be coupled to the device internally or externally. Examples of wireless Internet technologies may include wireless local area network (WLAN) (Wi-Fi), wireless broadband (Wibro), world interoperability for microwave access (Wimax), and high-speed downlink packet access (HSDPA). Through the wireless Internet module 113, the display device 100 can establish a Wi-Fi peer-to-peer (P2P) connection with other devices.
[0113] The short-range communication module 114 refers to a module for short-range communication. Examples of short-range communication technology may include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), and ZigBee.
[0114] The display 120 may display an image on a screen under the control of the processor 140. The image displayed on the screen may be received from the communication unit 110, the input / output unit 180, and the memory 130.
[0115] The video processing unit 125 may include various video processing circuits and processes image data to be displayed on the display 120 , and may perform any of various image processing operations on the image data, such as decoding, rendering, scaling, noise removal, frame rate conversion, or resolution conversion.
[0116] The audio processing unit 170 may include various audio processing circuits and process audio data. The audio processing unit 170 may perform any of various processing operations on the audio data, such as decoding, amplification, or noise removal.
[0117] The audio output unit 150 may include various audio output circuits, and outputs audio included in a broadcast signal received under the control of the processor 140, audio input through the communication unit 110 or the input / output unit 180, and audio stored in the memory 130. The audio output unit 150 may include at least one of a speaker 151, a headphone output terminal 152, or a Sony / Phillips Digital Interface (S / PDIF) output terminal 153.
[0118] The detection unit 160 may include various detection circuits and detect the user's voice, image, or interaction, and may include a microphone 161, a camera unit (e.g., including a camera) 162, and a light receiving unit (e.g., including a light receiving circuit) 163. The microphone 161 may receive, for example, a voice uttered by the user. The microphone 161 may convert the received voice into an electrical signal, and may output the electrical signal to the processor 140. The camera unit 162 may include a camera and receive images (e.g., continuous frames) corresponding to the user's motion (including gestures within the camera recognition range). The light receiving unit 163 may include various light receiving circuits and receive light signals (including control signals) received from a remote control device. The light receiving unit 163 may receive an optical signal corresponding to a user input (e.g., touch, press, touch gesture, voice, or motion) from the remote control device. The control signal may be extracted from the received light signal under the control of the processor 140.
[0119] The input / output unit 180 may include various input / output circuits, and receives video (e.g., moving images), audio (e.g., voice or music), and additional information (e.g., EPG) from the outside of the display device 100 under the control of the processor 140. The input / output unit 180 may include one of a high-definition multimedia interface (HDMI) port 181, a component jack 182, a PC port 183, and a universal serial bus (USB) port 184. The input / output unit 180 may include a combination of the HDMI port 181, the component jack 182, the PC port 183, and the USB port 184.
[0120] The user input unit 190 may include various input circuits where a user inputs data for controlling the display device 100. Examples of the user input unit 190 may include, but are not limited to, a keypad, a dome switch, a touch pad, a jog wheel, and a jog switch.
[0121] The memory 130 according to an embodiment of the present disclosure may store a program for processing and control of the processor 140 and may store data input to or output from the display device 100. In addition, the memory 130 may store data required to operate the display device 100.
[0122] The programs stored in the memory 130 may be classified into a plurality of modules according to their functions.
[0123] The processor 140 may include various processing circuits, and controls the overall operation of the display device 100 and the signal flow between the internal elements of the display device 100, and performs a function of processing data. When there is a user's input or a preset and stored condition is met, the processor 140 may execute an operating system (OS) and various applications stored in the memory 130.
[0124] The processor 140 may include an internal memory. In this case, at least one of the data, program, or instruction stored in the memory 130 may be stored in the internal memory (not shown) of the processor 140.
[0125] The components of the block diagram may be integrated, added, or omitted according to the specifications of the display device 100 actually implemented. For example, if necessary, two or more components may be combined into one component, or one component may be subdivided into two or more components. In addition, the functions performed in each block are intended to describe the embodiments of the present disclosure, and the detailed operations or devices thereof do not limit the scope of the present disclosure.
[0126] When describing the electronic device 200, it is not necessary to repeat the reference Figure 3 The descriptions done are the same as the descriptions.
[0127] refer to Figure 4 In addition to the communication unit 210, the display 220, the memory 230, and the processor 240, the electronic device 200 may further include a video processing unit (e.g., including a video processing circuit) 225, an audio processing unit (e.g., including an audio processing circuit) 270, an audio output unit (e.g., including an audio output circuit) 250, a detection unit (e.g., including a detection circuit) 260, an input / output unit (e.g., including an input / output circuit) 280, and a user input unit (e.g., including a user input circuit) 290. The processor 240 may include various processing circuits, and controls each element of the electronic device 200 to perform operations.
[0128] When Figure 4 When describing the memory 230 and the processor 240, it is not necessary to repeat the reference Figure 3 The descriptions done are the same as the descriptions.
[0129] The communication unit 210 may include one or more modules, each module including various communication circuits, which implement wireless communication between the electronic device 200 and a wireless communication system or wireless communication between the electronic device 200 and a network where another display device is located. For example, the communication unit 210 may include a broadcast receiving module 211, a mobile communication module 212, a wireless Internet module 213, and a short-range communication module 214. The communication unit 210 may be referred to as a transmitting / receiving unit.
[0130] The broadcast receiving module 211 receives broadcast signals and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast signals may include not only TV broadcast signals, radio broadcast signals, and data broadcast signals, but also broadcast signals in which data broadcast signals are combined with TV broadcast signals or radio broadcast signals.
[0131] The mobile communication module 212 transmits and receives wireless signals to and from at least one of a base station, an external terminal or a server over a mobile communication network. The wireless signals may include various types of data, such as voice call signals, video call signals or text / multimedia message exchanges.
[0132] The wireless Internet module 213 refers to a module for wireless Internet access and can be coupled to the device from the inside or outside. Examples of wireless Internet technologies may include wireless local area network (WLAN) (Wi-Fi), wireless broadband (Wibro), world interoperability for microwave access (Wimax), and high-speed downlink packet access (HSDPA). Through the wireless Internet module 213, the display device 100 can establish a Wi-Fi peer-to-peer (P2P) connection with other devices.
[0133] The short-range communication module 214 refers to a module for short-range communication. Examples of short-range communication technologies may include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), and ZigBee.
[0134] The display 220 may display an image on a screen under the control of the processor 240. The image displayed on the screen may be received from the communication unit 210, the input / output unit 280, and the memory 230.
[0135] The video processing unit 225 may include various video processing circuits and processes image data to be displayed on the display 220, and may perform any of various image processing operations on the image data, such as decoding, rendering, scaling, noise removal, frame rate conversion, or resolution conversion.
[0136] The audio processing unit 270 may include various audio processing circuits and process audio data. The audio processing unit 270 may perform any of various processing operations on the audio data, such as decoding, amplification, or noise removal.
[0137] The audio output unit 250 may include various audio output circuits, and outputs audio included in a broadcast signal received under the control of the processor 240, audio input through the communication unit 210 or the input / output unit 280, and audio stored in the memory 230. The audio output unit 250 may include at least one of a speaker 251, a headphone output terminal 252, or a Sony / Philips Digital Interface (S / PDIF) output terminal 253.
[0138] The detection unit 260 may include various detection circuits and detect the user's voice, image, or interaction, and may include a microphone 261, a camera unit 262, and a light receiving unit 263. The microphone 261 receives the voice uttered by the user. The microphone 261 may convert the received voice into an electrical signal, and may output the electrical signal to the processor 240. The camera unit 262 may receive images (e.g., continuous frames) corresponding to the user's movements (including gestures within the camera recognition range). The light receiving unit 263 receives an optical signal (including a control signal) received from a remote control device. The light receiving unit 263 may receive an optical signal corresponding to a user input (e.g., touch, press, touch gesture, voice, or movement) from the remote control device. The control signal may be extracted from the received optical signal under the control of the processor 240.
[0139] The input / output unit 280 may include various input / output circuits, and receives video (e.g., moving images), audio (e.g., voice or music), and additional information (e.g., EPG) from the outside of the electronic device 200 under the control of the processor 240. The input / output unit 280 may include one of a high-definition multimedia interface (HDMI) port 281, a component jack 282, a PC port 283, and a USB port 284. The input / output unit 280 may include a combination of the HDMI port 281, the component jack 282, the PC port 283, and the USB port 284.
[0140] The user input unit 290 may include various input circuits through which a user inputs data for controlling the electronic device 200. Examples of the user input unit 290 may include, but are not limited to, a keyboard, a dome switch, a touch pad, a jog wheel, and a jog switch.
[0141] The memory 230 according to an embodiment of the present disclosure may store a program for operation and control of the processor 240 and may store data input to or output from the electronic device 200. The memory 230 may store data required to operate the electronic device 200.
[0142] The programs stored in the memory 230 may be classified into a plurality of modules according to their functions.
[0143] The processor 240 may include various processing circuits, and controls the overall operation of the electronic device 200 and the signal flow between the internal elements of the electronic device 200, and performs a function of processing data. When there is a user's input or a preset and stored condition is met, the processor 240 may run an operating system (OS) and various applications stored in the memory 230.
[0144] The processor 240 may include an internal memory. In this case, at least one of the data, program, or instruction stored in the memory 230 may be stored in the internal memory (not shown) of the processor 240.
[0145] The components of the block diagram may be integrated, added, or omitted according to the specifications of the electronic device 200 actually implemented. For example, if necessary, two or more components may be combined into one component, or one component may be subdivided into two or more components. In addition, the functions performed in each block are intended to describe the embodiments of the present disclosure, and the detailed operations or devices thereof do not limit the scope of the present disclosure.
[0146] Figure 5 is a flowchart illustrating an example method of operating a display device according to various embodiments.
[0147] refer to Figure 5 In operation 510, the display device 100 may display content. The display device 100 may receive content from various content providing sources and may display the content. For example, the display device 100 may retrieve and display content stored in an internal memory of the display device 100, may display content received from an external input device connected via a wired / wireless interface, or may display content received via the Internet or a broadcast network. The content displayed on the display device 100 may include various types of content. For example, the content may include various types of content such as moving image content, still image content, and game content.
[0148] In operation 520 , the display apparatus 100 may recognize that the displayed content is sharable content.
[0149] The display device 100 according to an embodiment of the present disclosure can identify whether the content is shareable content, so that the content can be shared with other adjacent devices according to the content sharing technology through the content sharing operation between the multiple content displayed on the display device 100. Whether the content is shareable content can be identified by checking whether the content is content free of copyright issues. Therefore, when identifying whether the content is shareable content, it can refer to, for example, identifying whether the content can be shared through content sharing technology. For content free of copyright issues, the display device 100 can perform shooting or sharing operations according to content sharing technology. However, for content that is not free of copyright issues, the display device 100 may not perform shooting or sharing operations according to content sharing technology. Content free of copyright issues may refer to content without copyright issues, such as content where the copyright itself does not exist, content where the copyright has expired, or content with limited copyright. Because the display device 100 according to an embodiment of the present disclosure enables content free of copyright issues to be shared with other devices according to the user's intention, the user can conveniently use the content.
[0150] According to an embodiment of the present disclosure, the display device 100 can identify that the displayed content is shareable content based on the attribute information of the displayed content. The display device 100 can obtain the attribute information of the content through metadata of the content, etc. The attribute information of the content may include at least one of the identification information of the content, the category of the content, or the copyright information of the content.
[0151] According to an embodiment of the present disclosure, the display device 100 may identify whether the content is sharable content, ie, content free from copyright issues, using at least one of identification information of the content, category of the content, or copyright information of the content.
[0152] According to an embodiment of the present disclosure, the display device 100 can identify that the content is shareable content by communicating with an external server that provides copyright information of multiple contents. For example, the display device 100 can use the identification information of the content displayed on the display device 100 for the copyright information of the content, obtain the copyright information of the content by querying the external server that provides copyright information of various contents, and receive the copyright information of the content in response to the query, and the display device 100 can identify that the content is shareable content based on the obtained copyright information.
[0153] According to an embodiment of the present disclosure, when the display device 100 is in the game mode automatically, the display device 100 can recognize that the displayed content is shareable content. For example, when the automatic low latency mode (ALLM) is recognized in the game mode, the display device 100 can recognize that the displayed content is shareable content. ALLM is one of the HDMI 2.1 standard specifications and relates to a technology for reducing the delay time between controller input and game content output. For example, a device such as a PC or a game console that supports HDMI 2.1 includes ALLM information in an HDMI infoframe, and the display device 100 can check the ALLM information from the HDMI infoframe received from the device such as a PC or a game console.
[0154] In operation 530 , the display apparatus 100 may broadcast a signal including state information indicating that the displayed content is sharable content.
[0155] The display device 100 may broadcast a signal including status information indicating that the content currently displayed on the display device 100 is a photographable content (i.e., a shareable content), so that a neighboring electronic device receiving the signal recognizes that content sharing can be requested. That is, when a signal including status information indicating that the content is shareable content is broadcast, an electronic device that wishes to share the content from among the electronic devices receiving the broadcast signal may send a content sharing request to the display device 100.
[0156] According to an embodiment of the present disclosure, the display device 100 may broadcast a signal including status information indicating that the displayed content is shareable content using any of various short-range communication technologies. For example, the display device 100 may broadcast a signal using any of various short-range communication technologies such as Wi-Fi communication technology, Bluetooth communication technology, or BLE communication technology.
[0157] In operation 540 , the display apparatus 100 may receive a content sharing request for sharing content based on the broadcast signal from the electronic device 200 .
[0158] When display device 100 broadcasts a signal including status information indicating that displayed content is shareable content using any of a variety of short-range communication technologies, an electronic device from one or more electronic devices receiving the broadcast signal that wishes to share content displayed on display device 100 may send a content sharing request to display device 100, and display device 100 may receive the content sharing request.
[0159] According to an embodiment of the present disclosure, the display apparatus 100 may use any of various communication technologies to receive a content sharing request from the electronic device 200. For example, the display apparatus 100 may use any of various short-range communication technologies such as Wi-Fi communication technology, Bluetooth communication technology, or BLE communication technology to receive a content sharing request from the electronic device.
[0160] According to an embodiment of the present disclosure, the display device 100 can receive a query from the electronic device 200 to identify whether the sender of the broadcast is the display device 100, can send a response signal indicating that the sender of the broadcast signal is the display device 100 to the electronic device 200 in response to the query of the electronic device 200, and can receive a content sharing request from the electronic device.
[0161] In operation 550 , the display apparatus 100 may transmit at least a portion of the content output to the display to the electronic device 200 in response to the content sharing request using a content sharing technology.
[0162] According to an embodiment of the present disclosure, the display apparatus 100 may transmit at least a portion of the content displayed on the display to the electronic device in response to a content sharing request of the electronic device, using any of various content sharing technologies.
[0163] According to an embodiment of the present disclosure, the display device 100 can use content sharing technology to send the entire content displayed on the display to the electronic device. In this case, when the content displayed on the display includes video content and graphic content (such as a user interface overlaid on the video content), the display device 100 can use content sharing technology to send both the video content and the graphic content. In this case, the graphic content sent in addition to the video content may be content that the user of the electronic device does not want.
[0164] According to an embodiment of the present disclosure, the display device 100 can use content sharing technology to send only some of the content displayed on the display (i.e., only the video content) to the electronic device. Because the user of the electronic device may want to use only the video content, the display device 100 can filter and send additional content such as a user interface other than the video content.
[0165] Figure 6 is a flowchart illustrating an example method of operating an electronic device to share content displayed on a display device according to various embodiments.
[0166] refer to Figure 6 , in operation 610, the electronic device 200 may obtain an image of a screen of the display device 100 displaying content through a camera.
[0167] For example, a user carrying the electronic device 200 may want to use the content displayed on the display device 100 for personal purposes while viewing the content through the display device 100. The user may want to capture or record a portion of the content displayed on the display device 100, and use the captured or recorded content for personal purposes. For example, the user may want to capture or record a portion of movie content displayed on the display device 100, and upload the captured or recorded portion of the content to a social networking service application or the like. In this case, the user can use the camera of the electronic device 200 to control shooting or previewing the screen of the display device 100.
[0168] In operation 620 , the electronic device 200 may receive a broadcast signal including state information indicating that content displayed on the display apparatus 100 is sharable content.
[0169] According to an embodiment of the present disclosure, the electronic device 200 may receive a broadcast signal from the display device 100 using any of a variety of short-range communication technologies, and may check status information indicating that the content displayed on the display device 100 is shareable content from the received broadcast signal. For example, the electronic device 200 may include a BLE communication module that may always receive a BLE signal, and such status information may be extracted from the received BLE signal through the BLE communication module.
[0170] In operation 630, the electronic device 200 may identify (eg, determine whether) a display device of an image obtained through a camera is a display device that transmits the broadcast signal using the broadcast signal.
[0171] In a space where a user enjoys content through the display device 100, there may be more display devices other than the display device 100, and other display devices may also display content. In various cases including this case, the electronic device 200 needs to identify whether the display device that sends the broadcast signal is the same as the display device that actually displays the content. Therefore, the electronic device 200 may perform an operation of checking whether the display device that sends the broadcast signal is the same as the display device that actually displays the content.
[0172] According to an embodiment of the present disclosure, the electronic device 200 may send a signal for requesting identification of whether the display device 100 is the device currently displaying content to the display device 100 that sends the broadcast signal, and when the display device 100 provides a response to the identification request signal, the electronic device 200 may check the response to identify whether the display device 100 is the device currently displaying content.
[0173] According to an embodiment of the present disclosure, the electronic device 200 may send a signal for requesting identification of whether the display device 100 is the device currently displaying the content to the display device 100 that transmits the broadcast, and the display device 100 may output predetermined (e.g., specified) response information to the display of the display device 100 in response to the identification request signal. The electronic device 200 may check whether the display device 100 is the device currently displaying the content by analyzing an image of the screen of the display device 100 obtained by a camera and extracting the response information from the image of the analyzed screen. For example, the display device 100 may insert a visible or invisible watermark into the content displayed on the display as predetermined response information, and the electronic device 200 may check whether the display device 100 is the device currently displaying the content by identifying or extracting the visible or invisible watermark from the image of the screen of the display device 100 obtained by a camera.
[0174] In operation 640, when the electronic device 200 checks (eg, determines whether) the device transmitting the broadcast signal is the display device currently displaying the content, the electronic device 200 may transmit a content sharing request for sharing the content to the display device.
[0175] According to an embodiment of the present disclosure, when checking, the electronic device 200 may automatically send a content sharing request to the display apparatus 100 .
[0176] According to an embodiment of the present disclosure, when checking, the electronic device 200 may ask the user whether he or she really wants to share content, and when there is a user selection or input for the inquiry, the electronic device 200 may send a content sharing request to the display apparatus 100 .
[0177] According to an embodiment of the present disclosure, the electronic device 200 may transmit a content sharing request to the display apparatus 100 using any of various short-range communication technologies.
[0178] According to an embodiment of the present disclosure, when sending a content sharing request, the electronic device 200 may include and send information for requesting to filter graphic content such as a graphic user interface and to send only video content.
[0179] In operation 650 , the electronic device 200 may receive at least a portion of the content output to the display of the display device in response to the content sharing request from the display device 100 through the content sharing technology.
[0180] According to an embodiment of the present disclosure, the electronic device 200 can output the content received from the display device 100 through the display of the electronic device 200 using the content sharing technology. That is, before receiving and displaying the content through the content sharing technology, the electronic device 200 outputs the image of the display screen of the display device 100 obtained by the camera of the electronic device 200 as a preview, but when the electronic device 200 receives the content through the content sharing technology, the electronic device 200 can display the content received through the communication network on the display. Therefore, because the electronic device 200 displays the content received through the communication network, it is possible to prevent and / or reduce the disadvantages of capturing the image of the screen of the display device 100 and displaying the image on the display, for example, also obtaining images around the display device, other objects are reflected on the display screen of the display device, or the screen of the display device is distorted.
[0181] According to an embodiment of the present disclosure, the electronic device 200 may provide various user interfaces for implementing operations such as recording or capturing content displayed on the display of the electronic device 200, and may perform operations of recording or capturing content based on user input received through the provided user interfaces.
[0182] Figure 7 is a signal flow diagram illustrating an example method of operating a display apparatus and an electronic device to share content according to various embodiments.
[0183] refer to Figure 7In operation 701, the display device 100 may display content on a display. The display device 100 may obtain content through various sources according to a user's request, and may display the obtained content. For example, the display device 100 may retrieve and display content stored in an internal memory of the display device 100, may display content received from an external input device connected through a wired / wireless interface, or may display content received through the Internet or a broadcast network. The content displayed on the display device 100 may include various types of content. For example, the content may include various types of content, such as moving image content, still image content, and game content.
[0184] In operation 702, the electronic device 200 may obtain content displayed on the screen of the display device 100 through, for example, a camera. In order to allow the user of the electronic device 200 to capture or record at least a portion of the content displayed on the display device 100 while enjoying the content displayed on the display device 100, the electronic device 200 may use a camera application of the electronic device 200 to make the camera of the electronic device 200 face the screen of the display device 100, obtain an image of the screen of the display device 100 through the camera, and may display a preview image on the display of the electronic device 200.
[0185] Not necessarily in Figure 7 Operation 702 is shown to be performed before operation 705 of detecting a broadcast signal, and operation 702 only needs to be performed before operation 706 .
[0186] In operation 703 , the display apparatus 100 may recognize that content displayed on the display is sharable content.
[0187] The display device 100 according to an embodiment of the present disclosure needs to identify whether the content is shareable content, so as to share the content with other adjacent devices according to the content sharing technology, and the content is available through the content sharing operation among the multiple content displayed on the display device 100. Whether the content is shareable content can be identified by checking whether the content is free of copyright issues. Therefore, when identifying whether the content is shareable content, it can refer to, for example, identifying whether the content can be shared through the content sharing technology. For content free of copyright issues, the display device 100 can perform shooting or sharing operations according to the content sharing technology. However, for content that is not free of copyright issues, the display device 100 may not perform shooting or sharing operations according to the content sharing technology. Content free of copyright issues may refer to content without copyright issues, such as content where the copyright itself does not exist, content where the copyright has expired, or content with limited copyright. Because the display device 100 according to an embodiment of the present disclosure enables content free of copyright issues to be shared with other devices according to the user's intention, the user can conveniently use the content.
[0188] According to an embodiment of the present disclosure, the display device 100 can identify that the displayed content is shareable content based on the attribute information of the displayed content. The display device 100 can obtain the attribute information of the content through metadata of the content, etc. The attribute information of the content may include at least one of the identification information of the content, the category of the content, or the copyright information of the content.
[0189] According to an embodiment of the present disclosure, the display device 100 may identify whether the content is sharable content, ie, content free from copyright issues, using at least one of identification information of the content, category of the content, or copyright information of the content.
[0190] According to an embodiment of the present disclosure, the display device 100 can identify that the content is shareable content by communicating with an external server that provides copyright information of multiple contents. For example, for the copyright information of the content, the display device 100 can use the identification information of the content displayed on the display device 100, obtain the copyright information of the content by querying the external server that provides copyright information of various contents, and receive the copyright information of the content in response to the query, and the display device 100 can identify that the content is shareable content based on the obtained copyright information.
[0191] In operation 704 , the display apparatus 100 may broadcast a signal including state information indicating that the displayed content is sharable content.
[0192] The display device 100 may broadcast a signal including status information indicating that the content currently displayed on the display device 100 is shareable content, so that the neighboring electronic device receiving the signal recognizes that content sharing can be requested. That is, when a signal including status information indicating that the content is shareable content is broadcast, an electronic device that wishes to share the content from among the electronic devices receiving the broadcast signal may send a content sharing request to the display device 100.
[0193] According to an embodiment of the present disclosure, the display device 100 may broadcast a signal including status information indicating that the displayed content is shareable content using any of various short-range communication technologies. For example, the display device 100 may broadcast a signal using any of various short-range communication technologies such as Wi-Fi communication technology, Bluetooth communication technology, or BLE communication technology. For example, the display device 100 may send status information in a Wi-Fi signal according to the Wi-Fi communication technology, may send status information in a Bluetooth signal according to the Bluetooth communication technology, or may send status information in a BLE signal according to the BLE communication technology.
[0194] At operation 705 , the electronic device 200 may receive a broadcast signal from the display apparatus 100 , and may detect status information.
[0195] According to an embodiment of the present disclosure, the electronic device 200 may receive a broadcast signal from the display device 100 using any of a variety of short-range communication technologies, and may check status information indicating that the content displayed on the display device 100 is shareable content from the received broadcast signal. For example, the electronic device 200 may include a BLE communication module that may always receive a BLE signal, and may extract status information from the received BLE signal through the BLE communication module.
[0196] In operation 706, the electronic device 200 may identify a predetermined (e.g., specified) object from the image of the screen of the display device 100 obtained by the camera. According to an embodiment of the present disclosure, the electronic device 200 may identify a predetermined object from the image of the screen of the display device 100 obtained by the camera based on a broadcast signal including state information received from the display device 100. That is, in a state where the electronic device 200 receives a broadcast signal including state information from the display device 100, the electronic device 200 may perform an operation of identifying a predetermined object from the image of the screen of the display device 100 obtained by the camera. The electronic device 200 may check that the electronic device 200 currently captures the image of the screen of the display device by identifying a predetermined object (e.g., an object representing the screen of the display device) from the image of the screen of the display device 100 obtained by the camera. That is, in order to identify whether the screen of the display device is included in the image of the screen captured by the electronic device 200, the electronic device 200 may determine a predetermined object that may represent the screen of the display device, and may determine whether the predetermined object is included in the image captured by the electronic device 200. In this way, when the electronic device 200 identifies a predetermined object from the image of the screen of the display device 100 obtained through the camera and detects status information from the received broadcast signal in operation 705, the electronic device 200 can perform an operation of checking whether the device sending the broadcast signal is the same as the display device of the image obtained by the electronic device 200 through the camera.
[0197] Figure 8 is a diagram illustrating an example in which an electronic device recognizes a predetermined object in an obtained image according to various embodiments.
[0198] refer to Figure 8 , the electronic device 200 can capture an image of the screen of the display device 100 through the camera, and can display an image 20 including the captured image of the screen of the display device 100 on the display through the preview. Regardless of how the user manipulates the camera of the electronic device 200 to accurately capture only the image of the screen of the display device 100, the image 20 actually output by the electronic device 200 through the preview may include not only the screen image 30 of the display device 100 but also a background image 40 around the display device 100 or a wall on which the display device 100 is mounted.
[0199] The electronic device 200 can detect a predetermined object 800 from an image 20 obtained by a camera to identify a display device. The predetermined object 800 only needs to be an object having a shape for identifying a screen of a display device. For example, the predetermined object 800 may include an object having a quadrilateral or rectangular shape. The electronic device 200 may use any of a variety of object recognition technologies to identify or detect a predetermined object from an image. The various object recognition technologies may include rule-based object recognition technologies or artificial intelligence-based object recognition technologies.
[0200] When the electronic device 200 recognizes an image moving in the detected predetermined object, the electronic device 200 can recognize that the recognized predetermined object is an image corresponding to the screen of the display device. The electronic device 200 can use any of various video recognition technologies to recognize or detect the presence of video in the predetermined object. The various video recognition technologies may include rule-based video recognition technologies or artificial intelligence-based video recognition technologies.
[0201] Return to reference Figure 7 , through operations 705 and 706, when status information is detected from the broadcast signal received from the display device 100 and an object representing the screen of the display device is detected in the image captured by the electronic device 200, the electronic device 200 can proceed to operation 707 to identify whether the display device 100 that sends the broadcast signal is the same as the display device identified by the electronic device 200 in the image captured by the camera.
[0202] In operation 707, the electronic device 200 may transmit a device identification request signal to the display device 100. The electronic device 200 may check address information of the display device 100 transmitting the broadcast signal from the broadcast signal received in operation 705, and may transmit the device identification request signal to the display device 100 using the checked address information.
[0203] According to an embodiment of the present disclosure, the electronic device 200 may use any of a variety of short-range communication technologies to send a device identification request signal to the display device 100. The various short-range communication technologies may include Wi-Fi communication technology, Bluetooth communication technology, and BLE communication technology. The device identification request signal may be a signal that requests or directs the display device 100 that receives the device identification request signal to insert and output predetermined response information in the image output by the display device 100.
[0204] In operation 708, the display apparatus 100 may receive a device identification request signal from the electronic device 200, and may provide identification response information indicating a response to the received device identification request signal to the electronic device 200. The display apparatus 100 may provide the electronic device 200 with identification response information corresponding to the device identification request signal using any of a variety of methods.
[0205] According to an embodiment of the present disclosure, as an example of identification response information, the display device 100 may insert and output a predetermined watermark into the content of the display of the display device 100. The predetermined watermark inserted into the content may be visible or invisible. A visible watermark refers to a watermark that can be seen or perceived by the user's eyes, and an invisible watermark refers to a watermark that cannot be seen or perceived by the user's eyes but can be identified by the internal processing of the electronic device. When the predetermined watermark is inserted into the content, the electronic device 200 can check that the display device 100 is the display device to which the electronic device 200 sends a device identification request signal by identifying the predetermined watermark inserted into the content when capturing an image of the screen of the display device 100. The watermark is a watermark predetermined between the display device 100 and the electronic device 200, and the electronic device 200 can check the display device 100 by detecting the predetermined watermark.
[0206] According to an embodiment of the present disclosure, as an example of identification response information, the display apparatus 100 may insert or add and output a Quick Response (QR) code into content of a display of the display apparatus 100 .
[0207] According to an embodiment of the present disclosure, as an example of identifying response information, the display device 100 may add and output an object as graphic content superimposed on the content output to the display of the display device 100. The object as the graphic content is an object predetermined between the display device 100 and the electronic device 200, and the electronic device 200 may check the display device 100 by detecting the predetermined object.
[0208] Fig. 9 is a diagram illustrating an example in which a display device provides identification response information according to a device check request from an electronic device according to various embodiments.
[0209] refer to Fig. 9 When the electronic device 200 sends a device identification request signal to the display device 100, the display device 100 may provide the electronic device 200 with identification response information for proving that the display device 100 is a device for displaying sharable content in response to the device identification request signal.
[0210] The display device 100 may insert and output a predetermined watermark into the content output to the display as identification response information. Fig. 9, the display device 100 may output text 900 that reads, for example, <capture> to the content as a predetermined watermark. In this way, when the display device 100 includes and outputs the text 900 that may be a watermark in the output content, the electronic device 200 that captures the image of the screen of the display device 100 may obtain the image of the screen of the display device 100 including the text 900, and may check whether the display device currently captured by the electronic device 200 is a device that transmits a broadcast signal including status information by extracting or recognizing the text 900 as a predetermined watermark from the obtained image. Although in Fig. 9 The predetermined watermark is visible to the user, but the predetermined watermark may be invisible.
[0211] Return to reference Figure 7 , when the display apparatus 100 outputs the identification response information indicating the response to the device identification request signal at operation 708, the electronic device 200 may obtain an image of the screen of the display apparatus 100 including the identification response information, and may identify the identification response information in the obtained image at operation 709. The electronic device 200 may check the display apparatus 100 based on the identified identification response information. That is, the electronic device 200 may check whether the device to which the electronic device 200 sends the device identification request signal is the same as the display device whose screen image is currently captured by the electronic device 200.
[0212] In operation 710 , when checking of the display apparatus 100 is completed, the electronic device 200 may transmit a sharing request signal for sharing the content displayed on the display apparatus 100 to the display apparatus 100 .
[0213] According to an embodiment of the present disclosure, when checking, the electronic device 200 may automatically send a content sharing request to the display apparatus 100 .
[0214] According to an embodiment of the present disclosure, when the inspection of the display device is completed, the electronic device 200 may send a Figure 8 The object 800 shown provides a visual effect to show the user that the inspection of the display device has been completed. Figure 8 The object 800 is highlighted or bolded on or around the screen of the display device to indicate identification.
[0215] According to an embodiment of the present disclosure, the electronic device 200 may use any of various short-range communication technologies to send a content sharing request to the display apparatus 100. The various short-range communication technologies may include Wi-Fi communication technology, Bluetooth communication technology, and BLE communication technology.
[0216] According to an embodiment of the present disclosure, the electronic device 200 may perform an operation of establishing a connection with the display apparatus 100 by sending a BT MAC, a Wi-Fi MAC, or a P2P MAC using a Wi-Fi direct communication technology, and may send a content sharing request through the connection.
[0217] In operation 711 , when the display apparatus 100 receives a content sharing request from the electronic device 200 , the display apparatus 100 may transmit the sharing request content to the electronic device 200 .
[0218] According to an embodiment of the present disclosure, the display apparatus 100 may transmit at least a portion of the content displayed on the display to the electronic device 200 in response to a content sharing request of the electronic device, using any of various content sharing technologies.
[0219] According to an embodiment of the present disclosure, the display device 100 can use content sharing technology to send the entire content displayed on the display to the electronic device. In this case, when the content displayed on the display includes video content and graphic content (such as a user interface overlaid on the video content), the display device 100 can use content sharing technology to send both the video content and the graphic content. In this case, the graphic content sent in addition to the video content may be content that the user of the electronic device does not want.
[0220] According to an embodiment of the present disclosure, the display device 100 can use content sharing technology to send only some of the content displayed on the display (i.e., only the video content) to the electronic device. Because the user of the electronic device may want to use only the video content, the display device 100 can filter and send additional content such as a user interface other than the video content.
[0221] In operation 712 , the electronic device 200 may receive at least a portion of the content output to the display of the display apparatus in response to the content sharing request from the display apparatus 100 using the content sharing technology.
[0222] According to an embodiment of the present disclosure, the electronic device 200 can output the content received from the display device 100 through the display of the electronic device 200 through the content sharing technology. That is, before receiving and displaying the content through the content sharing technology, the electronic device 200 outputs the image of the display screen of the display device 100 obtained through the camera of the electronic device 200 as a preview, but when the electronic device 200 receives the content through the content sharing technology, the electronic device 200 can display the content received through the communication network on the display. Therefore, because the electronic device 200 displays the content received through the communication network, it is possible to prevent and / or reduce the disadvantages of capturing the image of the screen of the display device 100 and displaying the image on the display, for example, also obtaining images around the display device, other objects are reflected on the display screen of the display device, or the screen of the display device is distorted.
[0223] Fig.10 is a diagram illustrating an example in which an electronic device outputs shared content received from a display device according to various embodiments.
[0224] refer to Fig.10 Because the electronic device 200 captures an image of the screen of the display device 100 through the camera using the camera application before receiving the shared content from the display device 100 , the display of the electronic device 200 may display a background image 40 including a screen image 30 of the display device and the surroundings of the display device 100 .
[0225] When the electronic device 200 checks the display device 100, sends a content sharing request to the display device 100, and receives the sharing request content, the electronic device 200 can directly output the shared content on the display. Therefore, the display of the electronic device 200 can directly display the shared content 1000 received from the display device 100, rather than the screen image of the display device obtained by the camera.
[0226] According to an embodiment of the present disclosure, when the electronic device 200 outputs the shared content received from the display device 100, the electronic device 200 can output the shared content through the camera application. Therefore, in this case, for the part other than the part outputting the shared content, the user interface of the camera application can be used as it is.
[0227] According to an embodiment of the present disclosure, when the electronic device 200 outputs the shared content received from the display device 100, the electronic device 200 can output the shared content through the content sharing application. Therefore, in this case, for the part other than the part outputting the shared content, the user interface of the content sharing application can be used as it is.
[0228] According to an embodiment of the present disclosure, when the electronic device 200 outputs shared content received from the display apparatus 100, the electronic device 200 may output the shared content through a dedicated application.
[0229] According to an embodiment of the present disclosure, the electronic device 200 may provide various user interfaces for implementing operations such as recording or capturing content displayed on the display of the electronic device 200, and may perform operations of recording or capturing content based on user input received through the provided user interfaces.
[0230] Fig.11 is a diagram illustrating an example user interface that may be provided when the electronic device 200 displays shared content according to various embodiments.
[0231] refer to Fig.11 , the electronic device 200 may display the shared content 1000 received from the display apparatus 100 , and may provide a user interface 1100 for manipulating the shared content 1000 .
[0232] According to an embodiment of the present disclosure, the user interface 1100 may include a capture item 1110 for capturing displayed shared content in units of images. When the capture item 1110 is selected, the electronic device 200 may capture and store an image of the content displayed when the capture item 1110 is selected.
[0233] According to an embodiment of the present disclosure, the user interface 1100 may include a recording item 1120 for recording the displayed shared content as a video within a specified period of time. When the recording item 1120 is selected, the electronic device 200 may store the content from the time when the recording item 1120 is selected to the time when the recording item 1120 is deselected.
[0234] According to an embodiment of the present disclosure, the user interface 1100 may include an exit item 1130 for ending display of the shared content. When the exit item 1130 is selected, the electronic device 200 may end displaying the shared content and may return to a screen state before displaying the shared content.
[0235] Fig.12 is a signal flow chart illustrating an example method of operating a display device and an electronic device to share content according to various embodiments. Figure 7 In the example of FIG. 1 , the electronic device 200 checks the display device 100 and then automatically sends a content sharing request signal, but in Fig.12 In the example, the electronic device 200 may check the display apparatus 100 and may then send a content sharing request signal according to the user's selection.
[0236] refer to Fig.12 , operations 1201 to 1209 and Figure 7Operations 701 to 709 are the same or similar, and thus, repeated descriptions may not be provided.
[0237] In operation 1210, when checking the display device in operation 1209, the electronic device 200 may provide a user interface for asking whether to capture the content displayed on the display device. Because the user attempted to capture an image of the display device 100 by facing the camera of the electronic device 200 toward the display device 100 in the previous operation (e.g., operation 1202 or 1206), the electronic device 200 may determine that the user has the intention to capture the content displayed on the display device 100. Therefore, in Figure 7 In the embodiment, the electronic device 200 is configured to automatically send a content sharing request signal to the display device immediately after checking the display device. Fig.12 In the example of , a user interface for rechecking the user's intent can be provided.
[0238] In operation 1211 , the electronic device 200 may receive a user input selecting content capture.
[0239] In operation 1212 , the electronic device 200 may transmit a signal for requesting sharing of content to the display apparatus 100 based on the received user input.
[0240] Operations 1212 to 1214 and Figure 7 Operations 710 to 712 of FIG. 7 are the same or similar, and thus, repeated descriptions may not be provided.
[0241] Fig.13 is a diagram illustrating an example process in which an electronic device checks a user's capture intention after checking a display device according to various embodiments.
[0242] refer to Fig.13 Before the display device is checked and the electronic device 200 sends a content sharing request to the display device 100, the electronic device 200 may output a user interface 1300 for inquiring about the user's intention to capture content again. The user interface 1300 may include a message saying, for example, "Do you want to capture or record an image? OK, cancel."
[0243] When the user selects <OK> in response to the user interface 1300, the electronic device 200 may send a content sharing request to the display device 100, and when receiving shared content from the display device 100 according to the content sharing request, the electronic device 200 may display the received shared content 1000 on the display. When the user selects <Cancel> in response to the user interface 1300, the electronic device 200 may not send the content sharing request and may end the operation.
[0244] When playing video content, the display device 100 may output a notification message for notifying the user, an advertising message, or a user interface for menu selection together with the video content. The notification message may include a message indicating a chat text notification of a chat service or a message received by an email, a disaster alert text message, or an alert message such as the usage environment or status of the display device 100. However, according to the example of the present disclosure, because the display device 100 sends content to the electronic device 200 to enable the user to utilize the content displayed on the display device 100 (i.e., the video content as the main content) for personal use, the notification message may not be the content that the user wants. Therefore, it may be preferable to prevent and / or reduce additional content other than the video content from being recorded or captured when the user records or captures video content in the electronic device 200. Reference will be made to Figures 14 to 19 Various examples of filtering contents other than video contents from among the plurality of pieces of contents displayed on the display device 100 are described in more detail.
[0245] Fig.14 is a signal flow diagram illustrating an example method for an electronic device to receive and process shared content according to various embodiments.
[0246] refer to Fig.14 In operation 1401, the electronic device 200 may send a content sharing request signal to the display device 100. Figure 7 Operations 701 to 709 or Fig.12 Operations 1201 to 1211.
[0247] In operation 1402, the display device 100 may receive a content sharing request signal, and may send the sharing request content to the electronic device 200. In addition to the video content requested by the user to be played on the display screen, the display device 100 may also display various additional content. The content displayed in addition to the video content may be referred to as graphic content or additional content. As described above, a notification message for notifying the user, an advertising message, or a user interface for menu selection may be output as additional content together with the video content. The notification message may include a chat text notification indicating a chat service or a message received by an email, a disaster alert text message, or an alert message such as the use environment or status of the display device 100.
[0248] According to an embodiment of the present disclosure, the display apparatus 100 may transmit both the video content and the additional content displayed on the display to the electronic device 200 .
[0249] In operation 1403 , the electronic device 200 may receive shared content including both video content and additional content, and may display the received video content and additional content on a display.
[0250] In operation 1404 , the electronic device 200 may receive a user input selecting to record or capture the shared content.
[0251] In operation 1405, the electronic device 200 may identify additional content in the content displayed on the electronic device 200, and may perform an operation of recording or capturing only video content that does not include the additional content. According to this embodiment of the present disclosure, the display device 100 does not need to perform separate additional content processing in response to a content sharing request, and when the electronic device 200 receives a content manipulation command from a user, additional content filtering may be performed.
[0252] Fig.15 is a diagram illustrating an example in which an electronic device performs filtering on additional content according to various embodiments.
[0253] refer to Fig.15 , when displaying the video content 1510 , the display device 100 may also display additional content 1520 in addition to the video content 1510 .
[0254] In response to the content sharing request of the electronic device 200 , the display apparatus 100 may transmit the shared content 1500 including both the video content 1510 and the additional content 1520 displayed on the display to the electronic device 200 according to the content sharing technology.
[0255] The electronic device 200 may display the shared content 1500 received from the display apparatus 100 , that is, both the video content 1510 and the additional content 200 , on the display of the electronic device 200 .
[0256] When the electronic device 200 receives a command to manipulate the content displayed on the display of the electronic device 200 (e.g., a user input selecting the capture item 1110 or the record item 1120), the electronic device 2100 may capture or record the content displayed on the display in response to the user input. In this case, because the additional content 1520 is unlikely to be the content that the user wants to capture or record, the electronic device 200 may only record or capture and store the video content 1510 that does not include the additional content 1520 in the content 1500 displayed on the display.
[0257] Fig.16 is a signal flow diagram illustrating an example method for an electronic device to receive and process shared content according to various embodiments.
[0258] refer to Fig.16 In operation 1601, the electronic device 200 may send a content sharing request signal to the display device 100. Figure 7 Operations 701 to 709 or Fig.12Operations 1201 to 1211.
[0259] In operation 1602, the display device 100 may receive a content sharing request and may send the sharing request content to the electronic device 200. In addition to the video content requested by the user to be played on the display screen, the display device 100 may also display various additional content. The content displayed in addition to the video content may be referred to as graphic content or additional content. As described above, a notification message for notifying the user, an advertising message, or a user interface for menu selection may be output as additional content together with the video content. The notification message may include a chat text notification indicating a chat service or a message received by an email, a disaster alert text message, or an alert message such as the use environment or status of the display device 100.
[0260] According to an embodiment of the present disclosure, the display apparatus 100 may transmit both the video content and the additional content displayed on the display to the electronic device 200 .
[0261] In operation 1603 , the electronic device 200 may receive shared content including both video content and additional content, may identify the additional content in the received content, and may display only the video content excluding the identified additional content on the display.
[0262] In operation 1604 , the electronic device 200 may receive a user input selecting to record or capture the shared content.
[0263] In operation 1605, the electronic device 200 may perform an operation of recording or capturing content displayed on the electronic device 200. According to this embodiment of the present disclosure, the display apparatus 100 does not need to perform separate additional content processing in response to a content sharing request, and may perform additional content filtering when the electronic device 200 displays shared content.
[0264] Fig.17 is a signal flow diagram illustrating an example method for an electronic device to receive and process shared content according to various embodiments.
[0265] refer to Fig.17 , operation 1701 and Fig.14 Operation 1401 or Fig.16 The operation 1601 is the same or similar to that of FIG. 1601 , and therefore, a repeated description may not be provided.
[0266] In operation 1702, the display apparatus 100 may receive a content sharing request from the electronic device 200, and may identify at least one of the additional content or the video content in the content displayed on the display according to the content sharing request. That is, the display apparatus 100 may obtain the video content by identifying the video content in the content displayed on the display, or may obtain the video content by identifying the additional content in the content displayed on the display and filtering the additional content.
[0267] In operation 1703 , the display apparatus 100 may transmit the video content not including the additional content among the content displayed on the display to the electronic device 200 as shared content.
[0268] In operation 1705 , the electronic device 200 may receive video content that does not include additional content, and may display the received video content on a display.
[0269] In operation 1706 , the electronic device 200 may receive a user input selecting to record or capture the shared content.
[0270] In operation 1707, the electronic device 200 may perform an operation of recording or capturing content displayed on the electronic device 200. According to this embodiment of the present disclosure, the electronic device 200 does not need to perform separate additional content processing and may perform additional content filtering before the display apparatus 100 transmits shared content.
[0271] Fig.18 is a diagram illustrating an example in which a display device performs filtering on additional content according to various embodiments.
[0272] refer to Fig.18 , when displaying the video content 1510 , the display device 100 may also display additional content 1520 in addition to the video content 1510 .
[0273] In response to a content sharing request of the electronic device 200, the display apparatus 100 may filter the additional content 1520 in the content 1500 including both the video content 1510 and the additional content 1520 displayed on the display, and may transmit only the video content 1510 to the electronic device 200 according to the content sharing technology.
[0274] The electronic device 200 may display the shared content, ie, the video content 1510 , received from the display apparatus 100 on the display of the electronic device 200 .
[0275] When the electronic device 200 receives a command to manipulate content displayed on the display of the electronic device 200 (eg, a user input selecting the capture item 1110 or the record item 1120), the electronic device may capture or record the content displayed on the display in response to the user input.
[0276] Fig.19 is a signal flow chart illustrating an example method in which an electronic device sends a content sharing request together with an additional content filtering request to a display device according to various embodiments.
[0277] refer to Fig.19 , in operation 1901, when the electronic device 200 transmits a content sharing request to the display apparatus 100, the electronic device 200 may selectively include additional content filtering request information in the content sharing request signal, and may transmit the content sharing request.
[0278] In operation 1902 , the display apparatus 100 receiving the content sharing request in which the additional content filtering request information is selectively included may determine whether the additional content filtering request information exists in the content sharing request signal.
[0279] When it is determined that the additional content filtering request information does not exist, the display apparatus 100 may proceed to operation 1904 .
[0280] In operation 1904 , the display apparatus 100 may transmit the content displayed on the display to the electronic device 200 without separate additional content filtering using a content sharing technology.
[0281] When it is determined in operation 1902 that the additional content filtering request information exists, the display apparatus 100 may proceed to operation 1903 .
[0282] In operation 1903, the display apparatus 100 may obtain only the video content by filtering the additional content in the content displayed on the display. In operation 1904, only the video content not including the additional content may be transmitted to the electronic device 200 as the sharing request content.
[0283] In operation 1905 , the electronic device 200 may receive and display shared content.
[0284] Fig. 20 is a signal flow diagram illustrating an example method of operating when an end command is received while an electronic device is displaying shared content according to various embodiments.
[0285] refer to Fig. 20 In operation 2001 , the display apparatus 100 may transmit a sharing request content to the electronic device 200 in response to a content sharing request received from the electronic device 200 .
[0286] In operation 2002 , the electronic device 200 may display content requested to be shared and received from the display apparatus 100 .
[0287] In operation 2003, the electronic device 200 may process the shared content according to the user input. For example, when a content recording command is received, the electronic device 200 may record the content, and when a content capture command is received, the electronic device 200 may capture the content.
[0288] In operation 2004, the electronic device 200 may receive an exit command according to a user input. For example, the electronic device 200 may receive an exit command in a Fig.11 A user input is shown in the user interface 1100 to select the exit item 1130. When the user wants to end displaying the shared content in the electronic device 200, the user can select the exit item 1130.
[0289] In operation 2005, the electronic device 200 may transmit a content sharing end request to the display apparatus 100. Therefore, in operation 2006, the display apparatus 100 may stop transmitting the sharing request content.
[0290] In operation 2007, when the exit item 1130 is selected, the electronic device 200 may end displaying the shared content and may return to a screen before displaying the shared content.
[0291] Fig.21 is a diagram illustrating an example method in which an electronic device ends displaying shared content according to various embodiments.
[0292] refer to Fig.21 , the electronic device 200 may display the shared content received from the display device 100. The electronic device 200 may also display a user interface 1100 for controlling the shared content. When the user wishes to end displaying the shared content, the user may select an exit item 1130. When the exit item 1130 is selected, the electronic device 200 may request the display device 100 to stop sending the shared content. Furthermore, the electronic device 200 may end displaying the shared content and may return to the screen before displaying the shared content, that is, to the screen displaying a preview image of the screen of the display device when the user performs an operation of capturing an image of the screen of the display device 100 using the camera application.
[0293] Fig. 22 is a signal flow chart illustrating an example method of operating an electronic device when playback of shared content in a display device ends while the electronic device displays the shared content according to various embodiments.
[0294] refer to Fig. 22 In operation 2201 , the display apparatus 100 may transmit a sharing request content to the electronic device 200 in response to a content sharing request received from the electronic device 200 .
[0295] In operation 2202 , the electronic device 200 may display content requested to be shared and received from the display apparatus 100 .
[0296] In operation 2203, the electronic device 200 may process / control the shared content according to the user input. For example, when a content recording command is received, the electronic device 200 may record the content, and when a content capture command is received, the electronic device 200 may capture the content.
[0297] In operation 2204, when the electronic device 200 displays the shared content, the playback of the content in the display device 100 may end. The playback of the content in the display device 100 may end due to any of a variety of reasons. For example, the display of the content in the display device 100 may end according to a user input to end the playback of the content in the display device 100. For example, when the playback time of the content played in the display device 100 ends, the playback of the content may end.
[0298] In operation 2205 , when playback of the content ends, the display device 100 may stop transmitting the content.
[0299] In operation 2206 , when the transmission of the content ends, the electronic device 200 may end displaying the shared content and may return to a screen before displaying the shared content.
[0300] Fig.23 is a diagram illustrating an example method in which an electronic device ends displaying shared content according to various embodiments.
[0301] refer to Fig.23 , when the electronic device 200 displays the shared content received from the display device 100, the playback of the content in the display device 100 may end. When the playback of the content in the display device 100 ends and the transmission of the content stops, the electronic device 200 may end the display of the shared content, and may return to the screen before the shared content was displayed, that is, return to the screen that displayed the preview image of the screen of the display device when the user uses the camera application to perform an operation of capturing an image of the screen of the display device 100. And, when the display of the shared content ends, the electronic device 200 may output a message indicating the end of the display of the content, for example, a text 2300 that reads <Content playback ends and content sharing ends>.
[0302] Various embodiments of the present disclosure may be implemented in the form of a non-transitory computer-readable recording medium, which includes computer-executable instructions, such as program modules executed by a computer. Computer-readable media can be any available media accessible to a computer, and include all volatile and non-volatile media and separable and non-separable media. Computer-readable media may also include computer storage media. Examples of computer storage media include all volatile and non-volatile media and separable and non-separable media, which have been implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules, and other data.
[0303] Embodiments of the present disclosure may be implemented as a software program including instructions stored in a non-transitory computer-readable storage medium.
[0304] The computer is a device that can acquire instructions stored in a storage medium and operate according to the embodiments of the present disclosure based on the instructions, and may include the electronic device according to the embodiments of the present disclosure.
[0305] The computer-readable storage medium may be provided in the form of a non-transitory storage medium. Here, a "non-transitory" storage medium does not include a signal and is tangible, but it may not be possible to distinguish whether data is stored in the storage medium semi-permanently or temporarily.
[0306] In addition, the control method according to the embodiment of the present disclosure may be included and provided in a computer program product. The computer program product is a product that can be purchased between a seller and a buyer.
[0307] A computer program product may include a software program and a computer-readable storage medium storing the software program. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable application) distributed electronically by the manufacturer of the device or by an electronic market (e.g., Google play storeTM or App storeTM). For electronic distribution, at least a portion of the software program may be stored in a storage medium or temporarily generated. In this case, the storage medium may be a storage medium of a manufacturer's server, a server of an electronic market, or a relay server that temporarily stores the software program.
[0308] In a system including a server and a device, the computer program product may include the storage medium of the server or the storage medium of the device. Alternatively, when there is a third device (e.g., a smart phone) communicatively connected to the server or the device, the computer program product may contain the storage medium of the third device. Alternatively, the computer program product may include the software program itself, which is transmitted from a third party to the device, or from a service provider to the device or a third device.
[0309] In this case, one of the server, the device, and the third device may execute a computer program product to perform the method according to an embodiment of the present disclosure. Alternatively, two or more of the server, the device, and the third device may execute a computer program product to perform the method according to an embodiment of the present disclosure in a distributed manner.
[0310] For example, a server (eg, a cloud server or an artificial intelligence (AI) server) may execute a computer program product stored therein to control a device communicatively connected to the server to perform a method according to an embodiment of the present disclosure.
[0311] In another example, the third device may execute a computer program product to control a device communicatively connected to the third device to execute a method according to an embodiment of the present disclosure. When the third device executes the computer program product, the third device may download the computer program product from the server and execute the downloaded computer program product. Alternatively, the third device may execute a computer program product preloaded to execute a method according to an embodiment of the present disclosure.
[0312] Furthermore, the term “unit” used herein may be a hardware component such as a processor or a circuit, and / or a software component executed by a hardware component such as a processor.
[0313] The above description of the present disclosure is provided for illustration, and it will be appreciated by those skilled in the art that various changes in form and detail may be readily made therein without departing from the basic features and scope of the present disclosure as defined by the appended claims. Therefore, the above embodiments of the present disclosure are merely examples in all respects and are not intended to be limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form. It will also be understood that any embodiment described herein may be used in combination with any other embodiment described herein.
[0314] The scope of the present disclosure includes the appended claims, and all changes or modifications within the scope of the appended claims and their equivalents will be construed as being included in the scope of the present disclosure.
Claims
1. A display device (100), comprising: Display (120); a communication unit (110) comprising a communication circuit; a memory (130) in which one or more instructions are stored; as well as A processor (140) configured to execute one or more instructions stored in the memory to: identifying whether content displayed on the display (120) is shareable content, controlling the communication unit (110) to broadcast a signal including status information indicating that the content is shareable content according to the identification, controlling the communication unit (110) to receive a content sharing request for sharing the content based on the broadcast signal from the electronic device (200), and In response to the content sharing request, the communication unit (110) is controlled to transmit at least a part of the content output to the display (120) to the electronic device (200).
2. The display device according to claim 1, wherein: The processor (140) is further configured to execute the one or more instructions to identify that the content is shareable content by detecting that the content is game content.
3. The display device according to claim 1, wherein: The processor (140) is further configured to execute the one or more instructions to: receiving, from the electronic device, an identification request signal for identifying the display device in response to a broadcast signal, providing identification response information indicating a response together with the content in response to the identification request signal, and A content sharing request for sharing the content is received from the electronic device in response to the identification response information.
4. The display device according to claim 3, wherein: The processor (140) is further configured to execute the one or more instructions to invisibly provide the recognition response information by embedding the recognition response information in the content, or to provide the recognition response information to be visibly displayed in the content.
5. The display device according to claim 1, wherein: The content sharing request includes a first type sharing request and a second type sharing request. The processor (140) is further configured to execute the one or more instructions to: Based on receiving the first type sharing request, controlling the content other than the additional content in the data output to the display to be transmitted to the electronic device, and Based on receiving the second type sharing request, both the content output to the display and the additional content are controlled to be transmitted to the electronic device.
6. An electronic device (200), comprising: Display (220); a communication unit (210) comprising a communication circuit; a memory (230) in which one or more instructions are stored; as well as A processor (250) configured to execute one or more instructions stored in the memory to: An image of a display device (100) displaying content is obtained by a camera of the electronic device, controlling the communication unit (210) to receive a broadcast signal including status information indicating that content displayed on the display device (100) is shareable content, Based on the broadcast signal, identifying whether the display device of the obtained image is a display device that transmits the broadcast signal, controlling the communication unit (210) to send a content sharing request for sharing the content to the display device (100) according to the identification, and The communication unit (210) is controlled to receive at least a portion of the content output to the display (120) of the display device (100) in response to the content sharing request from the display device (100).
7. The electronic device according to claim 6, wherein: The processor (250) is further configured to execute the one or more instructions to: detecting an object representing a display device (100) from the acquired image based on the broadcast signal, controlling the communication unit to transmit an identification request signal for identifying the display device to the display device, and The display device is identified by detecting identification response information from the object representing the display device in response to an identification request signal.
8. The electronic device according to claim 7, wherein: The processor (250) is further configured to execute the one or more instructions to detect identification response information invisibly embedded in the content or to detect identification response information visibly displayed on the content.
9. The electronic device according to claim 6, wherein: The processor (250) is also configured to execute the one or more instructions to control the communication unit to send a first type of sharing request or a second type of sharing request, wherein the first type of sharing request is used to request that content other than additional content in the data output to the display be sent to the electronic device, and the second type of sharing request is used to request that both the content output to the display and the additional content be sent to the electronic device.
10. The electronic device according to claim 6, wherein: The processor (250) is further configured to execute the one or more instructions to control the communication unit to automatically send a content sharing request to the display device according to the identification of the display device.
11. The electronic device according to claim 6, wherein: The processor (250) is further configured to execute the one or more instructions to: providing a user interface for selecting to photograph the content according to the identification of the display device, and Based on a user input of selecting to photograph the content received via the user interface, a content sharing request for sharing the content is transmitted to the display device.
12. The electronic device according to claim 6, wherein: The processor (250) is further configured to execute the one or more instructions to: controlling the display to display the content received from the display device according to the content sharing request, and The content displayed on the display is recorded or captured according to user input.
13. A method for operating a display device (100), the method comprising: identifying whether content displayed on the display is shareable content, broadcasting a signal including status information indicating that the content is shareable content according to the identification, receiving a content sharing request for sharing the content based on the broadcast signal from the electronic device, and In response to a content sharing request, at least a portion of the content output to the display is transmitted to the electronic device.
14. A method of operating an electronic device (200), the method comprising: Obtaining an image of a display device displaying content through a camera of the electronic device, receiving a broadcast signal including status information indicating that the content displayed on the display device is shareable content, identifying, based on a broadcast signal, whether the display device of the obtained image is the display device that transmits the broadcast signal, sending a content sharing request for sharing the content according to the identification to the display device, and At least a portion of the content output to a display of the display device is received from the display device in response to a content sharing request.
15. A non-transitory computer-readable recording medium having at least one program recorded thereon, the at least one program being executable by a processor of a display device to execute an operating method of the display device, wherein: The operating method of the display device comprises: identifying whether content displayed on the display is shareable content, broadcasting a signal including status information indicating that the content is shareable content based on the identification, receiving, from an electronic device, a content sharing request for sharing the content based on a broadcast signal; In response to a content sharing request, at least a portion of the content output to the display is transmitted to the electronic device.