Electronic device and method for capturing images from a remote display of an external electronic device

Abstract

The present invention relates to an electronic device and method for capturing images from an external display of a remote electronic device. The method includes: detecting, by one or more processors, one or more images presented by a remote display of an external electronic device from a first video stream captured by an imager. The method includes receiving a second video stream in response to the detection using a communication device operable with the one or more processors, the second video stream including one or more images presented on the remote display. The method includes replacing, by the one or more processors, the presentation of the first video stream with the second video stream on a local display of the electronic device. This is used to eliminate visual distortion caused by differences between the refresh rates of the display and the remote display or asynchronous characteristics of clocks in the electronic device and the external electronic device.

Description

Technical Field

[0001] The present disclosure relates generally to electronic devices, and more particularly to electronic devices having image capture devices. Background Art

[0002] The use of portable electronic devices such as smartphones and tablet computers has become ubiquitous. As computing power increases, owners of such devices can use them not only to communicate with others, but also to manage financial accounts, track health information, manage calendar and address book data, watch television programs and movies, interact with social media sites, engage in online transactions, and surf the Internet.

[0003] Most of these electronic devices include some form of imager, which may include one or more cameras. As the quality of these cameras improves, people are increasingly using imagers in smartphones and tablet computers as their primary image capture devices, abandoning traditional standalone image capture devices such as single-lens reflex cameras. It would be advantageous to have methods and systems that enable image capture devices of portable electronic devices to perform even more optimally to improve the quality of captured images. Summary of the invention

[0004] According to one aspect of the present invention, a method in an electronic device includes: using one or more processors of the electronic device to detect that one or more images presented on a remote display of an external electronic device appear in a first video stream captured by an imager of the electronic device; using the one or more processors, in response to detecting that the one or more images appear in the first video stream, causing a communication device of the electronic device to establish electronic communication with the external electronic device; using the one or more processors to send a first request for a second video stream to the external electronic device using the communication device, the second video stream including the one or more images presented on the remote display of the external electronic device; using the communication device to receive the second video stream from the external electronic device in response to the first request; and using the one or more processors to present the second video stream on a local display of the electronic device.

[0005] According to another aspect of the present invention, an electronic device includes: an imager that captures one or more images in a first video stream that are presented on a remote display of an external electronic device; a display; a communication device; and one or more processors capable of operating with the communication device and the display; the one or more processors causing the communication device to send a first request to the external electronic device for a second video stream including the one or more images presented on the remote display, and in response to the communication device receiving the second video stream, replacing the presentation of the first video stream on the display with another presentation of the second video stream.

[0006] According to another aspect of the present invention, a method in an electronic device comprises: detecting, by one or more processors, one or more images presented by a remote display of an external electronic device from a first video stream captured by an imager; in response to the detection, receiving a second video stream using a communication device capable of operating with the one or more processors, the second video stream including one or more images presented on the remote display; and replacing, by the one or more processors, the presentation of the first video stream on a local display of the electronic device with the second video stream. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 One or more illustrative method steps are shown according to one or more embodiments of the present disclosure.

[0008] Figure 2 One or more other illustrative method steps are shown according to one or more embodiments of the present disclosure.

[0009] Figure 3 An illustrative electronic device is shown in accordance with one or more embodiments of the present disclosure.

[0010] Figure 4 Other illustrative method steps are shown according to one or more embodiments of the present disclosure.

[0011] Figure 5 Other illustrative method steps are shown according to one or more embodiments of the present disclosure.

[0012] Figure 6 Method step options for detecting the presence of one or more images presented on a remote display of an external electronic device in a video stream captured by an imager of an illustrative electronic device are shown in accordance with one or more embodiments of the present disclosure.

[0013] Figure 7 A prior art electronic device is shown capturing an image presented on a remote display of an external electronic device.

[0014] Figure 8 Various embodiments of the present disclosure are shown.

[0015] Skilled technicians will understand that the elements in the figures are shown for simplicity and clarity and are not necessarily drawn to scale. For example, the size of some elements in the figures may be enlarged relative to other elements to help improve the understanding of the embodiments of the present disclosure. DETAILED DESCRIPTION

[0016] Before describing the embodiments according to the present disclosure in detail, it should be observed that the embodiments mainly lie in the combination of method steps and device components related to detecting one or more images presented on a remote display of an external electronic device and causing a video stream including one or more images to be transmitted to the electronic device to obtain better image quality. Any process description or box in the flowchart should be understood to represent a module, code segment or code portion, which includes one or more executable instructions for implementing specific logical functions or steps in the process. Alternative implementations are included, and it will be clear that, depending on the functions involved, the functions can be performed out of order in the order shown or discussed, including substantially simultaneously or in reverse order. Therefore, where appropriate, device components and method steps are represented by conventional symbols in the drawings, and only those specific details related to understanding the embodiments of the present disclosure are shown, so as not to obscure the details of the present disclosure that are obvious to ordinary technicians in the field who benefit from the description herein.

[0017] The embodiments of the present disclosure do not list the implementation of any common business method for processing business information, nor do they apply known business processes to the specific technical environment of the Internet. In addition, the embodiments of the present disclosure do not use general computer functions and conventional network operations to create or change contractual relationships. On the contrary, the embodiments of the present disclosure adopt the following methods: when these methods are applied to electronic devices and / or user interface technologies, the functions of the electronic devices themselves are improved by improving the overall user experience, thereby overcoming problems that arise particularly in the technical field related to user interaction with electronic devices.

[0018] It should be understood that the embodiments of the present disclosure described herein may include one or more conventional processors and only stored program instructions for controlling one or more processors, so as to implement some, most, or all of the following functions as described herein in combination with certain non-processor circuits: detecting one or more images presented on a remote display of an external electronic device from a first video stream captured by an imager, and receiving a second video stream, wherein the second video stream includes one or more images presented on the remote display, and then replacing the presentation of the first video stream with the second video stream. The non-processor circuit may include, but is not limited to, a radio receiver, a radio transmitter, a signal driver, a clock circuit, a power supply circuit, and a user input device. In this way, these functions can be interpreted as steps of a method of performing a replacement of a first video stream with a second video stream received from an external electronic device, the first video stream being an imager from capturing an image presented on a remote display of an external electronic device. The second video stream is received from the external electronic device and includes the actual image presented on the remote display. Alternatively, some or all of the functions may be implemented by a state machine without stored program instructions, or by one or more application specific integrated circuits (ASICs), wherein each function or certain combinations of certain functions are implemented as custom logic. Of course, a combination of both methods may be used. Therefore, methods and devices for these functions have been described herein. Moreover, it is expected that those skilled in the art, guided by the concepts and principles disclosed herein, can readily produce such software instructions and programs and ASICs with minimal experimentation, without excluding possible extensive effort and numerous design choices inspired by, for example, available time, current technology, and economic considerations.

[0019] Embodiments of the present disclosure are now described in detail. Reference is made to the accompanying drawings, in which like numbers represent like parts throughout the views. As used in the specification and throughout the claims herein, unless the context clearly indicates otherwise, the following terms have the meanings clearly associated herein: "a", "an" and "the" include plural references, and "in" includes "in" and "on". Relational terms such as first and second, top and bottom, etc. may be used solely to distinguish one entity or action from another entity or action, without necessarily requiring or implying any actual such relationship or order between such entities or actions.

[0020] As used herein, components may be "operably coupled" when information may be sent between such components, even though there may be one or more intermediate or intermediary components between or along a connection path. The terms "substantially," "essentially," "approximately," "approximately," or any other version thereof, are defined to be close to what is understood by one of ordinary skill in the art, and in one non-limiting embodiment, the term is defined to within ten percent, in another embodiment to within five percent, in another embodiment to within one percent, and in another embodiment to within half a percent. The term "coupled," as used herein, is defined to be connected, although not necessarily directly and not necessarily mechanically. Additionally, reference numerals enclosed in parentheses herein represent components shown in figures other than the figure being discussed. For example, talking about device 10 while discussing Figure A would refer to element 10 shown in figures other than Figure A.

[0021] First turn Figure 7 , which shows a person 701 using an imager of a prior art electronic device 700 to capture 709 a video stream 710 including one or more images 702 presented on a remote display 703 of an external electronic device 704. The video stream 710 is presented on a display 706 of the prior art electronic device 700.

[0022] like Figure 7 As shown, the display 706 of the prior art electronic device 700 has a refresh rate 707. Similarly, the remote display 703 of the external electronic device 704 also has a refresh rate 708. The refresh rate 707 of the display of the prior art electronic device 700 and the refresh rate 708 of the remote display 703 of the external electronic device 704 can be the same or different. When they are different, the visible artifact of the refresh rate difference will be introduced as a visual distortion 712 on the display 706 of the prior art electronic device 700. Even in the case where the refresh rate 707 of the display of the prior art electronic device 700 and the refresh rate 708 of the remote display 703 of the external electronic device 704 are the same, because the clocks in the prior art electronic device 700 and the external electronic device 704, on which the refresh rate 707 of the display of the prior art electronic device 700 and the refresh rate 708 of the remote display 703 of the external electronic device 704 are based, are not synchronized, so the visual distortion 712 will still appear on the display 706 of the prior art electronic device 700.

[0023] Advantageously, embodiments of the present disclosure address this problem. In one or more embodiments, when a person using an electronic device configured according to one or more embodiments of the present disclosure points their image capture device with an active imager at a remote display of an external electronic device and the viewfinder of the imager is presented on the display of the electronic device, one or more processors of the electronic device automatically detect that one or more images presented on the remote display of the external electronic device appear on the video stream from the imager presented on the display. When this occurs, in one or more embodiments, the one or more processors cause the communication device of the electronic device to establish electronic communication with the external electronic device.

[0024] Thereafter, in one or more embodiments, one or more processors of the electronic device cause the communication device to send a request for another video stream that includes one or more images being presented on a remote display of the external electronic device. In one or more embodiments, this causes the external electronic device to send a second video stream from the external electronic device in response to the request. Thus, the external electronic device begins to send the actual image presented on the remote display of the external electronic device. The electronic device receives the image directly, rather than relying on its imager to capture the image.

[0025] In one or more embodiments, one or more processors of the electronic device then presents the video stream received from the external electronic device on the display of the electronic device instead of the video stream captured by the imager. In fact, for the actual images presented on the remote display of the external electronic device, the one or more processors "swap" the video stream captured by the imager, which may include frame rate or refresh rate visual distortions, including one or more images presented on the remote display of the external electronic device, for the actual images presented on the remote display of the external electronic device from the second video stream. Since these are actual images presented on the remote display of the external electronic device, frame rate or refresh rate visual distortions are not introduced. Therefore, the person receives a clearer and more accurate representation of one or more images on the local display of the electronic device.

[0026] Other advantageous operations may also be performed. For example, in one or more embodiments, when a person simply views a video stream received from an external electronic device on a local display of the electronic device, the video stream received from the external electronic device may have a first resolution or a first quality level. In contrast, if the person begins using an image or video capture function to store images or videos from the video stream received from the external electronic device in a memory of the electronic device, one or more processors of the electronic device may cause the external electronic device to send another video stream having an image of a second resolution or a second quality level that is higher or greater than the first resolution or the first quality level.

[0027] By way of example, suppose a person uses a smartphone to capture video images from a jumbotron at a stadium showing a slow-motion replay of a recent score. If the person is simply viewing these images on the display screen of the smartphone, one or more processors of the smartphone may cause an external electronic device running the jumbotron to transmit a video stream of images having a first resolution or first quality level suitable for the display of the smartphone. For example, the first resolution may have a smaller number of pixels per inch. Alternatively, the first quality level may be that each image is compressed from a RAW or uncompressed format so that each image has less data.

[0028] However, if the person begins recording video images into the memory of the smartphone, embodiments of the present disclosure contemplate that the person may want higher quality images, for example, to play them on a widescreen television to friends at home at a later time. Therefore, in one or more embodiments, when one or more processors of the smartphone detect the start of a recording operation, they cause an external electronic device operable with the ultra-large screen to send a higher resolution video stream. A higher resolution video stream may include, for example, a greater number of pixels per inch. If the first resolution is, for example, 1334x 750 pixels, the second resolution may be 2560x 1440 pixels. Similarly, if the first image quality includes compressing the image into an MPEG-4 compression format, the second higher image quality may include images in RAW, raster, or other uncompressed video formats, and so on.

[0029] In other embodiments, when capturing an image from a remote display of an external electronic device, a user of an electronic device configured according to an embodiment of the present disclosure can change the image resolution or quality level by performing a zoom operation. For example, assume that the external electronic device stores video in RAW format. Assume that the resolution of the RAW image data includes 100 million pixels per image. However, now assume that the resolution of the remote display is less than this resolution. It may only have a 1920x 1080 pixel resolution. When presenting the video on the remote display of the external electronic device, the external electronic device can compress the RAW video into a format with fewer pixels per image, for example, only a 1920x 1080 resolution required for the remote display of the external electronic device.

[0030] As described above, in one or more embodiments, when a person is using a smartphone to capture and record an image of a remote display of an external electronic device, one or more processors of the smartphone can cause the external electronic device to transmit RAW video in a video stream to the smartphone. However, embodiments allow the user to reduce the amount of data received in the video stream by performing a zoom operation.

[0031] In one or more embodiments, if a person uses a zoom operation to cause the imager to capture only a portion of the remote display of the external electronic device, then in one or more embodiments, one or more processors of the smart phone cause the external electronic device to transmit a video stream having partial data from the image. By way of example, if the RAW video format includes 100 million pixels per image, but the person uses the zoom function to cause the imager of the smart phone to capture only one-fifth of the remote display of the external electronic device, then in one or more embodiments, one or more processors of the smart phone cause the external electronic device to send only pixels corresponding to that portion that is captured. Therefore, the external electronic device will transmit a video stream in which each image includes 20 million pixels instead of 100 million, and so on. Other features and benefits provided by embodiments of the present disclosure will be described below. Other content may also be conceived by those of ordinary skill in the art who benefit from the present disclosure.

[0032] In one or more embodiments, when a user points an imager of an electronic device toward a display with a viewfinder feature of the imager turned on, one or more processors of the electronic device automatically detect the fact that one or more images presented on a remote display of an external electronic device appear in a video stream captured by the imager. In one or more embodiments, the one or more processors of the electronic device cause the communication device to establish electronic communication with the external electronic device in response to detecting the one or more images appearing in the video stream captured by the imager. For example, the one or more processors may perform a wireless handshake operation to establish electronic communication with the external electronic device.

[0033] Initially, when the imager is capturing a video stream including one or more images presented on a remote display of an external electronic device, one or more processors of the electronic device present the video stream on a local display of the electronic device. However, in one or more embodiments, when electronic communication is established with the external electronic device, one or more processors of the electronic device send a request for a second video stream that includes one or more images presented on a remote display of the display. In one or more embodiments, the request may include image transmission information, such as the resolution of the image, the image quality of the image, the baud rate, etc. In one or more embodiments, these preferences can be set by the user using a menu.

[0034] Thereafter, in one or more embodiments, the communication device of the electronic device receives the second video stream in response to the request. When this occurs, the one or more processors begin presenting the second video stream including one or more images on the local display of the electronic device instead of the first video stream. In other words, in one or more embodiments, the one or more processors of the electronic device switch from the "viewfinder" video stream to the video stream received from the external electronic device.

[0035] In one or more embodiments, when a user initiates a record or save operation so that an image from a video stream received from an external electronic device is stored in a memory of the external electronic device, one or more processors may request a third video stream from the external electronic device, the third video stream including one or more images of a higher resolution, higher quality, or other format superior to the second video stream. Therefore, if the user starts saving images from the second video stream, in one or more embodiments, higher content, such as in a RAW format, is transferred from the external electronic device to the electronic device, so that the saved image will have a higher quality.

[0036] Now turn to Figure 1 , which shows an illustrative method 100 according to one or more embodiments of the present disclosure. Starting from step 101, a user 108 points an imager (located at the back side) of an electronic device 110 toward an external electronic device 113 including a remote display 111. One or more images 112 are being presented on the remote display 111 of the external electronic device 113.

[0037] exist Figure 1 The external electronic device 113, generally shown as a television-type display in the figure, can be any type of electronic device with a display. Examples include a desktop computer, a laptop computer, a tablet computer, a television, a multimedia player, a projection system with a projection screen, a telephone booth, an Internet of Things (IoT) device with a display, or other types of devices. Therefore, it should be understood that as used herein, the external electronic device 113 with a remote display 111 can be any of a variety of types of devices configured to present still images or video content on a display, where "remote display" refers to the fact that the remote display 111 is located on a device other than the electronic device 110, and more specifically, is located on a device other than the electronic device 110, so that the remote display 111 of the external electronic device 113 can be located within the field of view of the imager of the electronic device 110.

[0038] As shown in step 101, the imager is capturing 109 at least one of the one or more images 112 presented on the remote display 111 of the external electronic device 113. The one or more images 112 can be static content, still images, video images, scrolling images, or other types of images. In this illustrative example, the imager is capturing 109 a series of images of the one or more images 112 presented on the remote display 111 of the external electronic device 113. These series of images, which are continuously displayed on the local display 114 of the electronic device 110 when the imager is in the "viewfinder" operating mode, constitute a video stream 115. In step 101, the video stream 115 captured by the imager is presented on the local display 114 of the electronic device 110.

[0039] As previously described, at step 101, the refresh rate of the remote display 111 when presenting one or more images 112 and the refresh rate of the local display 114 when presenting the video stream 115 may be different, and / or the clocks in the external electronic device 113 and the electronic device 110 on which the refresh rates of the remote display 111 and the local display 114 are based may be unsynchronized. Therefore, at step 101, one or more visual artifacts caused by one or both differences appear as visual distortions 116 in the video stream 115, which can be seen on the local display 114 of the electronic device 110.

[0040] Advantageously, embodiments of the present disclosure improve the image capture process for the user 108 by automatically removing the visual distortion 116 when capturing one or more images 112 presented on the remote display 111 of the external electronic device 113 using the imager of the electronic device 110. In one or more embodiments, this will occur when one or more processors of the electronic device 110 replace the video stream 115 captured by the imager with another video stream including the actual image presented on the remote display 111 of the external electronic device 113 on the local display 114 of the electronic device 110.

[0041] The process of doing so begins at step 102. In one or more embodiments, step 102 includes one or more processors of the electronic device 110 detecting that one or more images 112 presented on the remote display 111 of the external device 113 appear in the video stream 115 captured by the imager of the electronic device 110. This detection process occurring at step 102 may be manual or automatic. By way of example, in one or more embodiments, the user 108 may communicate user input, such as touching, dragging, or sliding with a finger, to identify at least a portion of the local display 114 as presenting one or more images 112 from the remote display 111 of the external electronic device 113 as captured by the imager in the video stream 115 in step 102. In other embodiments, the one or more processors of the electronic device 110 may automatically detect that one or more images 112 presented on the remote display 111 of the external electronic device 113 appear in the video stream 115, so that the user 108 does this without taking any action or communicating any affirmative user input.

[0042] This automatic detection by one or more processors of electronic device 110 at step 102 may occur in a variety of ways. Figure 6 , which shows Figure 1Some illustrative ways of automatically detecting step 102 of FIG. These examples are merely illustrative, as many other examples will be apparent to those of ordinary skill in the art having the benefit of this disclosure.

[0043] In one or more embodiments, at 601, the electronic device 110 includes an artificial intelligence engine configured to detect that one or more images 112 presented on a remote display 111 of an external electronic device 113 appear in a video stream 115 captured by an imager of the electronic device 110. For example, as will be described below with reference to Figure 3 As explained in more detail, in one or more embodiments, the electronic device 110 includes a display detection engine equipped with artificial intelligence, which is operable to detect that the video stream 115 or a portion of the video stream 115 includes illumination data representing a moving frame: or alternatively, includes illumination data 116 representing visual distortions that occur when an imager captures one or more images 112 presented on a remote display 111 of an external electronic device 113. In one or more embodiments, the display detection engine may include an artificial neural network or other similar technology.

[0044] For example, in the case where the external electronic device 113 occupies only a portion of the image of the video stream 115, the display detection engine can detect that a rectangle (or other shape corresponding to the shape of the external electronic device 113) appears in the image of the video stream 115, and that a moving frame and / or visual distortion 116 appears inside the rectangle or other shape. Upon determination, the display detection engine can notify one or more processors of the electronic device 110 that one or more images 112 being presented on the remote display 111 of the external electronic device 113 appear in the video stream 115 captured by the imager of the electronic device 110.

[0045] In another embodiment, at 602, the image processor may be configured to process the video stream 115 to detect one or more of a changing frame rate occurring in the video stream 115, visual distortions 116 occurring in the video stream 115, changing lighting conditions occurring in the video stream 115 at a predetermined frequency associated with a display refresh rate of, for example, 60 Hz, an object within a portion of the video stream 115 moving at a rate unrelated to other portions of the video stream 115, a combination thereof, or by detecting other phenomena occurring in the video stream 115.

[0046] When included, the image processor of 602 may operate in conjunction with one or more processors of the electronic device 110 and various image capture devices of the electronic device 110. In one or more embodiments, the image processor of 602 may be used as a recognition module configured with optical recognition to recognize objects using image recognition, character recognition, visible recognition, facial recognition, color recognition, shape recognition, etc. Advantageously, the imager processor of 602 may be used to recognize an external electronic device, a remote display of an external electronic device, an image presented on a remote display of an external electronic device, or other phenomena within a still or motion video stream captured by an imager of the electronic device 110.

[0047] At 603, the one or more processors of the electronic device 110 may detect that one or more images 112 being presented on the remote display 111 of the external electronic device 113 are in the video stream 115 captured by the imager of the electronic device 110 by optionally using the image processor to identify content or information in the video stream 115 indicating that some or all of the image data in the video stream 115 has been presented on the remote display 111 of the external electronic device 113. For example, the one or more images 112 presented on the remote display 111 of the external electronic device 113 may include a barcode, a matrix barcode (QR code), or other indicia that, when captured by the imager of the electronic device 110, may be recognized by the one or more processors and / or image processors of the electronic device 110. In one or more embodiments, when the one or more processors and / or image processors of the electronic device 110 recognize the barcode, QR code, or other indicia, this allows detection that the one or more images 112 presented on the remote display 111 of the external electronic device 113 appear in the video stream 115 captured by the imager of the electronic device 110.

[0048] It should be noted that the indicia that appears in the one or more images 112 presented on the remote display 111 of the external electronic device 113 may be visible to the user 108, or may not be visible. For example, if configured as a QR code, the user 108 will be able to see the indicia identifying the content as being presented by the remote display 111 of the external electronic device 113. However, the content may be configured as infrared light, ultraviolet light, or using other techniques that make the identifier invisible to the user 108. When using the latter technique, the one or more images 112 presented on the remote display 111 of the external electronic device 113 will appear to the user 108 as normal images, but will be interpreted by the one or more processors and / or image processors of the electronic device 110 as being displayed from the remote display 111 of the external electronic device 113.

[0049] In other embodiments, at 604, electronic communication between the electronic device 110 and the external electronic device 113 may be used to allow one or more processors of the electronic device 110 to automatically detect one or more images 112 presented on the remote display 111 of the external electronic device 113 as appearing in the video stream 115 captured by the imager of the electronic device 110. For example, when the imager is activated, a position detector, orientation detector, or other sensor of the electronic device 110 may determine a reference orientation and direction of the electronic device 110. At the same time, a communication device of the electronic device 110 may receive location data from the external electronic device 113 identifying its location within the environment of the electronic device 110. The one or more processors may use this information obtained via electronic communication between the electronic device 110 and the external electronic device 113 to automatically detect that one or more images 112 being presented on the remote display 111 of the external electronic device 113 appear in the video stream 115 captured by the imager of the electronic device 110. Detecting one or more images 112 being presented on a remote display 111 of an external electronic device 113 via electronic communications between the electronic device 110 and the external electronic device 113 in other ways will be apparent to one of ordinary skill in the art having the benefit of this disclosure.

[0050] As described above, the one or more processors of the electronic device 110 can automatically detect that one or more images 112 presented on the remote display 111 of the external electronic device 113 appear in the video stream 115 captured by the imager of the electronic device 110. Figure 6 The examples are illustrative only. Many others will be apparent to those of ordinary skill in the art having the benefit of this disclosure.

[0051] Now back to Figure 1 In step 103, in response to one or more processors detecting that one or more images 112 presented on the remote display 111 of the external electronic device 113 appear in the video stream 115, the one or more processors of the electronic device 110 cause the communication device of the electronic device to establish electronic communication with the external electronic device 113. In one or more embodiments, step 103 includes the one or more processors of the electronic device 110 causing the communication device to initiate a wireless handshake operation to establish communication with the communication device of the external electronic device 113. Other techniques for establishing electronic communication between the electronic device 110 and the external electronic device 113 will be apparent to those of ordinary skill in the art having the benefit of this disclosure.

[0052] At step 104, in response to the communication between the communication device of the electronic device 110 and the communication device of the external electronic device 113 established at step 103, in one or more embodiments, the one or more processors of the electronic device 110 cause the communication device of the electronic device 110 to send a request for another video stream from the external electronic device 113, i.e., a second video stream different from the video stream 115 captured by the imager of the electronic device 110. In one or more embodiments, the request sent by the communication device of the electronic device 110 at step 104 includes a request for the second video stream to include one or more images 112 presented on the remote display 111 of the external electronic device 113.

[0053] In one or more embodiments, the request sent at step 104 may include image transmission information, such as: the resolution of the one or more images 112 to be included in the second video stream desired by the one or more processors of the electronic device 110, the image quality level of the one or more images 112 to be included in the second video stream desired by the one or more processors of the electronic device 110, the baud rate or data transmission rate of the second video stream desired by the one or more processors of the electronic device 110, the compression level, type or format of the one or more images 112 included in the second video stream desired by the one or more processors of the electronic device 110, the file size of the one or more images 112, or other characteristics of the data on how to configure the second video stream. In one or more embodiments, the user 108 may optionally use a settings menu available on the user interface of the electronic device 110 to define the image transmission information included in the request sent at step 104.

[0054] In step 105, in response to sending the request in step 104, the communication device of the electronic device 110 receives the second video stream from the external electronic device 113. In one or more embodiments, the second video stream includes one or more images 112 being presented on the remote display 111 of the external electronic device 113. Then, step 106 includes the one or more processors of the electronic device 110 then presenting the second video stream on the local display 114 of the electronic device 110.

[0055] As shown in step 107, the communication device of the electronic device 110 receives the second video stream 117 from the external electronic device 113. In addition, the one or more processors of the electronic device 110 are presenting the second video stream 117 on the local display of the electronic device 110. Therefore, due to the fact that the one or more images 112 have been included in the second video stream 117 in their original form rather than being captured by the imager of the electronic device 110 in the first video stream 115, when the one or more images 112 are presented on the local display 114 of the electronic device 110 at step 107, the visual distortion 116 presented at step 101 - where the one or more processors of the electronic device 110 present the first video stream 115 on the local display 114 of the electronic device 110 before detecting the one or more images 112 appearing in the first video stream 115 at step 102 - no longer exists in the one or more images 112.

[0056] This occurs because the one or more processors of the electronic device 110 have replaced the display of the first video stream 115 on the local display 114 of the electronic device 110 in step 101 with the presentation of the second video stream 117 on the local display 114 of the electronic device 110 in step 107, via steps 102-106, between steps 101 and 107. Because the one or more processors present the actual one or more images 112 received in the second video stream 117 in step 107, rather than a visible representation of the one or more images 112 captured by the imager in the first video stream 115 of step 101, all visual distortions 116 are advantageously eliminated. Accordingly, when the imager of the electronic device 110 is capturing the video stream 115 including the images presented on the remote display 111 of the external electronic device 113, Figure 1 The method 100 improves the quality of the image presented on the local display 114 of the electronic device 110 in step 107.

[0057] Recalling from above, in one or more embodiments, the request sent at step 104 may define characteristics that the one or more images 112 presented in the second video stream 117 should include. These include the resolution of the one or more images 112 included in the second video stream 117, the image quality level of the one or more images 112 included in the second video stream 117, the baud rate or data transfer rate of the second video stream 117, the file size of the one or more images 112 presented in the second video stream 117, the compression level, type or format of the one or more images 112 included in the second video stream 117, the file data size of the one or more images 112, or other characteristics related to the data transfer rate, data size, or image quality of the second video stream 117.

[0058] In one or more embodiments, the one or more images 112 received in the second video stream 117 at step 107 have one or more of a first resolution and / or a first image quality level. Embodiments of the present disclosure contemplate that when the user 108 is viewing the one or more images 112 extracted from the second video stream 117 on the local display 114 of the electronic device 110, which may be only a few inches in diameter if the electronic device 110 is a smart phone, a lower image quality may be fully satisfactory than, for example, if the user 108 were to project the one or more images 112 extracted from the second video stream 117 onto a wall or other projection surface using a projector of the electronic device 110. Thus, in one or more embodiments where the request sent at step 104 specifies the first image quality level for the one or more images 112 of the second video stream 117, or when the external electronic device 113 defaults to initially sending the second video stream 117 having the first image quality level, step 107 includes the communication device of the electronic device 110 receiving the one or more images 112 in the second video stream 117 having the specified image quality level or the default image quality level. In contrast, if the user 108 begins using the image or video capture feature to store images or videos from the second video stream 117 received from the external electronic device 113 in the memory of the electronic device 110, as will be described below with reference to Figure 2 As described, one or more processors of the electronic device 110 may send another request to the external electronic device 113 to request it to send a third video stream having an image with a second resolution or second quality level that is higher than or greater than the first resolution or first quality level associated with the second video stream 117.

[0059] For example, now turn to Figure 2 , wherein another method 200 according to one or more embodiments of the present disclosure is shown. In step 201, one or more processors of the electronic device 110 have replaced the first video stream 115 including one or more images 112 presented on the remote display 111 of the external electronic device 113 with the second video stream 117 received from the external electronic device 113 and including the one or more images 112 on the local display 114 of the electronic device 110. Therefore, when the one or more images 112 are presented on the local display 114 of the electronic device 110, there is no visual distortion 116. As described above, since the first request sent to the external electronic device 113 in step 104 specifies the first image quality level for the one or more images 112 of the second video stream 117, the one or more images 112 included in the second video stream 117 are transmitted at the first image quality level.

[0060] The first image quality level may refer to a resolution, a data file size, a compression level, a compression format, or other factors that affect the visual quality of the one or more images 112 when presented on the local display 114 of the electronic device 110. In one or more embodiments, because the user 108 is viewing the one or more images 112 from the second video stream 117 on the small display of the electronic device 110, the first quality level includes a first image resolution level for the one or more images 112 of the second video stream 117, wherein the first image resolution level corresponds to the image resolution presentation capability of the local display 114 of the electronic device 110.

[0061] Effectively, since the local display 114 of the electronic device 110 in this example is a smartphone display, which has a diagonal size of only a few inches, the efficiency of sending and receiving the second video stream 117 can be achieved by sending one or more images 112 in the second video stream 117 with the necessary image resolution to produce high-quality images on a small display, without the need to send a data file that can also present the one or more images 112 of the second video stream 117 on a monitor with a diagonal size of more than 60 inches. For example, in one or more embodiments, the first image quality level of the one or more images 112 of the second video stream 117 can have a lower number of pixels per inch. Alternatively, in another embodiment, the first quality level of the one or more images 112 of the second video stream 117 can be to compress each image from a RAW or uncompressed format so that each image has less data. Other examples of definitions of the first image quality level will be apparent to those of ordinary skill in the art having the benefit of this disclosure.

[0062] In step 201, the user 108 communicates a user input 208 to a local display 114 of the electronic device 110, which is touch-sensitive and serves as the primary user interface of the electronic device 110. In this example, the user input 208 causes a recording operation that initiates recording or storing at least one of the one or more images 112 of the second video stream 117 to a memory of the electronic device 110. In step 202, one or more processors of the electronic device 110 receive the user input from a user interface defined by the local display 114 of the electronic device 110, which causes at least one of the one or more images 112 from the second video stream 117 to be stored to a memory of the electronic device 110, or to a cloud storage or another storage device external to the electronic device 110.

[0063] In response to detecting the initiated “record” operation, in one or more embodiments, step 203 includes one or more processors of the electronic device 110 sending a second request for a third video stream including one or more images 112 from the external electronic device 113. Since the recording operation has been initiated, this second request sent at step 203 specifies a second image quality level for the third video stream, which is higher than the first image quality level of the second video stream 117 sent at step 201 before the user input 208 initiated the recording operation.

[0064] For example, if the first image quality level associated with the second video stream 117 is a predetermined number of pixels per inch, the second image quality level specified for the third video stream may have a higher number of pixels per inch. If the first image quality level of the second video stream 117 is, for example, a first resolution of 1334×750 pixels, the image quality level of the third video stream may have a higher resolution, such as similar to 2560×1440 pixels. Similarly, if the first image quality level associated with the second video stream 117 compresses one or more images 112 in an MPEG-4 compression format, the second quality level associated with the third video stream may include one or more images 112 in a RAW, raster, or other uncompressed video format, etc.

[0065] In step 205, the communication device of the electronic device 110 starts to receive the third video stream from the external electronic device 113. As shown in step 206, the communication device of the electronic device 110 receives the third video stream 209 from the external electronic device 113, which has a higher second image quality level. In addition, due to the fact that the recording operation 210 occurs on the electronic device 110, one or more processors of the electronic device 110 present the third video stream 209 on the local display 114 of the electronic device 110. Although the visual resolution of the user 108 is actually the same in step 206 because the image resolution rendering capability of the local display 114 of the electronic device 110 has not changed, the image recorded in the memory of the electronic device 110 (or cloud storage or other external storage device) will be saved with a higher image quality.

[0066] Therefore, when the user 108 views one or more images 112 on a device with a higher image resolution rendering capability, such as the tablet computer 211 of step 207, they can be rendered at a resolution suitable for the resolution rendering capability because they were recorded at a higher image quality level. As shown in step 207, although the user 108 perceives the one or more images 112 only through the imager of the electronic device 110 with a smaller display, the user 108 thinks that the quality of the image is incredible. In fact, in response to the user 108 only activating the imager and directing its field of view to the remote display 111 of the external electronic device 113, the automatic background step brings true high-definition image resolution without any visual distortion 116.

[0067] Therefore, use Figure 2 In the method 200, if the user is only viewing one or more images 112 from the second video stream 117 on the local display 114 of the electronic device 110, the one or more processors of the electronic device 110 cause the external electronic device 113 to send the second video stream 117 having the one or more images 112 included therein at a first resolution or a first quality level suitable for the local display 114 of the electronic device 110. However, if the user 108 uses the user interface of the electronic device 110 to start recording the video images in the memory of the electronic device 110 or elsewhere, the embodiments of the present disclosure take into account that the user 108 may want higher quality images to be viewed on another electronic device having a higher image resolution rendering capability, such as the tablet computer 211 of step 207. Therefore, in one or more embodiments, when the one or more processors of the electronic device 110 detect the initiation of the recording operation in step 202, they cause the external electronic device 113 to send a higher resolution video stream, such as the third video stream 209 having a higher image quality level.

[0068] Now turn to Figure 3 , wherein further details of an illustrative electronic device 110 configured in accordance with one or more embodiments of the present disclosure are shown. Although shown as a hinged electronic device, the electronic device 110 may include a single housing that is non-deformable and without a hinge, which is also configured in a traditional "candy bar" form factor. When configured as a candy bar, the display 114 of the electronic device 110 will remain exposed and accessible. In contrast, when configured as a hinged device having a first device housing 301 that selectively pivots about a hinge 303 relative to a second device housing 302 between a closed position and an axially displaced open position, the display 114 of the electronic device 110 can be selectively hidden and exposed depending on whether the electronic device is in the closed position or the axially displaced open position.

[0069] Figure 3 The electronic device 110 is configured as a portable electronic device, and for illustration purposes, is configured as a smart phone. However, the electronic device 110 may also be configured in other ways. For example, the electronic device 110 may be configured as a tablet computer, a gaming device, a multimedia player, etc. As will be readily understood by those of ordinary skill in the art having benefited from the present disclosure, one or more embodiments of the present disclosure may also be configured as other types of electronic devices.

[0070] Figure 3 The illustrative electronic device 110 includes multiple displays 114, 325. In this embodiment, an auxiliary display 325, which may be coupled to one of the first device housing 301 or the second device housing 302, is coupled to the first device housing 301. Because this display 325 is exposed when the first device housing 301 and the second device housing 302 are in the closed position, it is considered an "external" display.

[0071] The main display, i.e., display 114, may also be coupled to one or both of the first device housing 301 or the second device housing 302. In this illustrative embodiment, the display 114 is coupled to both the first device housing 301 and the second device housing 302 and spans the hinge 303. In other embodiments, the display 114 may be replaced by two displays, one of which is coupled to the first device housing 301 and the other is coupled to the second device housing 302. In some cases, the display 114 is considered an "internal" display because it is hidden when the first device housing 301 and the second device housing 302 are in the closed position. Either or both of the display 114 or the display 325 may be touch-sensitive.

[0072] Features may be incorporated into the first device housing 301 and / or the second device housing 302. Examples of such features include an optional camera 326 - which is Figure 1 and Figure 2 The method 100, 200 is used as an imager, or an optional speaker port 327. Each is shown as being placed in Figure 3 The back side of the electronic device 110 is shown, but an imager may be placed on the front side instead of or in addition to the camera 326. In this illustrative embodiment, an optional user interface component 328 may also be arranged along the back side of the second device housing 302, which may be a button or a touch-sensitive surface.

[0073] exist Figure 3An illustrative block diagram schematic 300 including one or more components of the electronic device 110 is also shown. In one or more embodiments, the block diagram schematic 300 is configured as a printed circuit board assembly disposed within a first device housing 301 and / or a second device housing 302 of the electronic device 110. The various components may be electrically coupled together by conductors or buses disposed along one or more printed circuit boards. It should be noted that the block diagram schematic 300 includes many optional components, but they are included to illustrate how various electronic devices configured according to embodiments of the present disclosure may vary.

[0074] Therefore, it should be understood that providing Figure 3 The block diagram 300 is for illustration purposes only and is used to illustrate components of an electronic device 110 according to an embodiment of the present disclosure. Figure 3 The block diagram schematic 300 is not intended to be a complete schematic diagram of the various components required for the electronic device 110. Therefore, other electronic devices according to embodiments of the present disclosure may include Figure 3 Various other components not shown in the drawings may either include a combination of two or more components, or a specific component may be divided into two or more separate components and still be within the scope of the present disclosure.

[0075] Figure 3 The illustrative block diagram 300 includes many different components. Embodiments of the present disclosure contemplate that the number and arrangement of such components may vary depending on the particular application. Thus, an electronic device configured according to embodiments of the present disclosure may include: Figure 3 Some components are not shown, and other components shown may not be required and thus may be omitted.

[0076] The schematic block diagram 300 includes a user interface 304. In one or more embodiments, the user interface 304 includes a display 114, which may optionally be touch-sensitive. In one embodiment, a user may pass user input to the display 114 by passing touch input from a finger, a stylus, or other object placed proximate to the display 114. For the electronic device 110, since the display 114 spans the hinge 303, it is configured to be flexible. For example, in one embodiment, the display 114 is configured as an organic light emitting diode (OLED) display manufactured on a flexible plastic substrate. This allows the display 114 to be flexible so as to deform when the first device housing 301 is pivoted around the hinge 303 relative to the second device housing 302. However, it should be noted that other types of displays will be apparent to those skilled in the art who benefit from the present disclosure. In other embodiments, a conventional rigid display may be provided on either side of the hinge 303 instead of using a flexible display.

[0077] In one embodiment, display 114 is configured as an active matrix organic light emitting diode (AMOLED) display. However, it should be noted that other types of displays, including liquid crystal displays, will be apparent to those of ordinary skill in the art having the benefit of this disclosure.

[0078] In one embodiment, the electronic device 110 includes one or more processors 305. In one embodiment, the one or more processors 305 may include an application processor and optionally one or more auxiliary processors. One or both of the application processor or auxiliary processors may include one or more processors. One or both of the application processor or auxiliary processors may be a microprocessor, a group of processing components, one or more ASICs, programmable logic, or other types of processing devices.

[0079] The application processor and the auxiliary processor may operate in conjunction with the various components of the block diagram 300. Each application processor and the auxiliary processor may be configured to process and execute executable software code to perform various functions of the electronic device 110 with which the block diagram 300 operates. A storage device such as memory 306 may optionally store executable software code for use by the one or more processors 305 during operation.

[0080] In this illustrative embodiment, the block diagram 300 also includes a communication device 307, which can be configured for wired or wireless communication with one or more other devices or networks. The network can include a wide area network, a local area network, and / or a personal area network. The communication device 307 can also use wireless technology for communication, such as but not limited to peer or ad hoc communication, such as HomeRF, Bluetooth, and IEEE 802.11, and other forms of wireless communication, such as infrared technology. The communication device 307 can include wireless communication circuitry, one of a receiver, a transmitter, or a transceiver, and one or more antennas.

[0081] In one embodiment, the one or more processors 305 may be responsible for executing the primary functions of the electronic device operable with its block diagram schematic 300. For example, in one embodiment, the one or more processors 305 include one or more circuits operable with the user interface 304 to present information to a user. The information may include a video stream captured by one or more imagers 308 of the electronic device 110 and / or one or more video streams received from an external electronic device. In addition, the one or more processors 305 may operate with an audio output device 309 to deliver audio output to a user. The executable software code used by the one or more processors 305 may be configured as one or more modules 310 operable with the one or more processors 305. Such modules 310 may store instructions, control algorithms, etc.

[0082] In one or more embodiments, block diagram 300 includes audio input / processor 311. In one embodiment, audio input / processor 311 may include hardware, executable code, and voice monitor executable code. Audio input / processor 311 may include a basic voice model stored in memory 306, a trained voice model, or other modules used by audio input / processor 311 to receive and recognize voice commands received together with audio input captured by an audio input device. In one embodiment, audio input / processor 311 may include a speech recognition engine. Regardless of the specific implementation used in various embodiments, in one or more embodiments, audio input / processor 311 may access various voice models to recognize voice commands.

[0083] The audio input / processor 311 may operate as an audio capture device to receive and capture audio input from a source in an environment 312 surrounding the electronic device 110, such as a person, an authorized user, or multiple persons. In one embodiment, the audio input / processor 311 may include hardware, executable code, and a voice monitor executable code. The audio input / processor 311 may operate in conjunction with one or more predefined authentication references stored in the memory 306. In one or more embodiments, the audio input / processor 311 may receive and recognize voice commands received in conjunction with an audio input device captured by the audio input. In one embodiment, the audio input / processor 311 may include a speech recognition engine. Regardless of the specific implementation employed in various embodiments, the audio input / processor 311 may access various speech models stored in conjunction with the predefined authentication references to recognize voice commands.

[0084] In one embodiment, the audio input / processor 311 is configured to implement a voice control feature that allows the electronic device 110 to function as a voice assistant device that can be configured as a voice assistant engine. In one or more embodiments, the voice assistant engine is a digital assistant that uses speech recognition, speech synthesis, and natural language processing to receive audio input including voice commands from a source, determine an appropriate response to the voice command, and then deliver a response in the form of an audio output in response to receiving the audio input from the source. When so configured, a user can cause the audio input to emanate from their mouth to cause the one or more processors 305 of the electronic device 110 to perform a control operation.

[0085] Various sensors 313 may operate with one or more processors 305. A first example of a sensor that may be included with various sensors 313 is a touch sensor. The touch sensor may include a capacitive touch sensor, an infrared touch sensor, a resistive touch sensor, or another touch-sensitive technology.

[0086] Another example of a sensor 313 is a geo-locator used as a location detector 314. In one embodiment, the location detector 314 is capable of determining location data of the electronic device 110. The location can be determined by capturing location data from a constellation of one or more earth-orbiting satellites, or from a network of ground base stations to determine an approximate location. The location detector 314 can also determine the location by locating or triangulating ground base stations of a traditional cellular network such as a CDMA network or a GSM network, or from other local area networks such as a Wi-Fi network.

[0087] One or more motion detectors may be configured as an orientation detector 315 that determines the orientation and / or motion of the electronic device 110 in three-dimensional space. By way of example, the orientation detector 315 may include an accelerometer, a gyroscope, or other device to detect the device orientation and / or motion of the electronic device 110. Using an accelerometer as an example, an accelerometer may be included to detect the motion of the electronic device. Additionally, an accelerometer may be used to sense certain gestures of a user, such as a person talking, running, or walking with his hands.

[0088] The orientation detector 315 can determine the spatial orientation of the electronic device 110 in three-dimensional space by, for example, detecting the direction of gravity. In addition to or instead of the accelerometer, an electronic compass can also be included to detect the spatial orientation of the electronic device relative to the earth's magnetic field. Similarly, one or more gyroscopes can be included to detect the rotational orientation of the electronic device 110.

[0089] The orientation detector 315 can also be used as a motion detector. By way of example, an accelerometer, a gyroscope, or other device can be used as a motion detector in the electronic device 110. Taking an accelerometer as an example, an accelerometer can be included to detect the movement of the electronic device. In addition, the accelerometer can be used to sense certain postures of the user, such as a person talking, running, or walking with his hands.

[0090] The motion detector can also be used to determine the spatial orientation of the electronic device in three-dimensional space by detecting the direction of gravity. In addition to or in place of the accelerometer, an electronic compass can also be included to detect the spatial orientation of the electronic device relative to the earth's magnetic field. Similarly, one or more gyroscopes can be included to detect the rotational motion of the electronic device.

[0091] Another example of sensor 313 is a force sensor. When included, the force sensor can take a variety of forms. For example, in one embodiment, the force sensor includes a resistive switch or force switch array configured to detect contact with a display or housing of an electronic device. In another embodiment, the force sensor can be capacitive. In yet another embodiment, a piezoelectric sensor can also be configured to sense force.

[0092] An image processing system 316 may be included in the electronic device 110 and may operate with the one or more processors 305. The image processing system 316 may operate with the one or more imagers 308. The one or more imagers may include one or more of conventional imagers, such as a camera 326, a depth imager, and optionally one or more proximity sensors.

[0093] In one embodiment, the one or more imagers 308 include a two-dimensional imager, such as the two-dimensional imager shown by camera 326. In one or more embodiments, the camera 326 includes a two-dimensional red-green-blue (RGB) imager. The one or more imagers 308 may also include an infrared imager, such as for identifying invisible indications of images presented on a remote display of an external electronic device, as described above with reference to FIG. Figure 6 Other types of imagers suitable for including one or more imagers 308 will be apparent to those of ordinary skill in the art having the benefit of this disclosure.

[0094] Where one or more imagers 308 include a depth imager, the depth imager can take a variety of forms. In a first embodiment, the depth imager includes a pair of imagers separated by a predetermined distance, such as three to four images. This "stereo" imager works in the same way as the human eye, in that it captures images from two different angles and coordinates the two angles to determine the distance. In another embodiment, the depth imager employs a structured laser. A structured light laser projects tiny light patterns that extend with distance. These patterns fall on a surface and are then captured by the imager. By determining the position and spacing between the elements of the pattern, a three-dimensional mapping can be obtained. In yet another embodiment, the depth imager includes a time-of-flight device. A time-of-flight three-dimensional sensor emits laser or infrared pulses from a photodiode array. These pulses are reflected back from the surface. The time required for the pulse to move from the photodiode array to the surface and back determines the distance, from which a three-dimensional mapping of the surface can be obtained. Regardless of the embodiment, the included depth imager adds a third "z dimension" to the x and y dimensions that define a two-dimensional image captured by a two-dimensional imager such as camera 326.

[0095] In one or more embodiments, the image processing system 316 may operate in conjunction with the environment analyzer 317. The environment analyzer 317 may be configured to process an image or depth scan of an object and determine whether the object meets predetermined criteria by comparing the image or depth scan to one or more predefined verification references stored in the memory 306. In conjunction with the environment analyzer 317, in one or more embodiments, the image processing system 316 may be configured to identify one or both of the following: one or more external electronic devices in the field of view of the one or more imagers 308 and / or one or more images presented on a remote display of the external electronic device when captured in a video stream by the one or more imagers 308. Advantageously, the optional identification performed by the image processing system 316 operating in conjunction with the environment analyzer 317 allows the access electronic device 110 to perform the above-referenced Figure 6 The operation of element 602 is described.

[0096] Other components 318 operable with one or more processors 305 may include output components such as video, audio, and / or mechanical outputs. For example, the output components may include video output components or auxiliary devices including cathode ray tubes, liquid crystal displays, plasma displays, incandescent lamps, fluorescent lamps, front projection displays or rear projection displays, and light emitting diode indicators. Other examples of output components include audio output components, such as one or more speakers, ultrasonic transducers (if included), or other alarms and / or buzzers. Other components 318 may also include mechanical output components, such as vibration or motion-based mechanisms.

[0097] Other components 318 may optionally include a barometer operable to sense changes in air pressure due to changes in altitude or pressure differences of the electronic device 110. In one or more embodiments, other components 318 may also optionally include a light sensor that detects changes in light intensity, color, light, or shadows in a video stream captured by one or more imagers 308 to detect one or more images presented on a remote display of an external electronic device in the video stream.

[0098] In one or more embodiments, the one or more processors 305 may define one or more processing engines. Examples of these processing engines include a display detection engine 319, a zoom monitoring engine 320, an artificial intelligence engine 321, an image quality analyzer 322, and a context engine 323. Each engine may be a component of the one or more processors 305, may operate with the one or more processors 305, is defined by the one or more processors 305, and / or is integrated into the one or more processors 305. Other configurations of these engines, including as software or firmware modules operable on the one or more processors 305, will be apparent to those skilled in the art having the benefit of this disclosure.

[0099] For example, the context engine 323 can operate with various sensors to detect, infer, capture and otherwise detect an external electronic device with a display that presents one or more images around the environment of the electronic device 110. One embodiment of the context engine 323 included therein uses an adjustable algorithm for context evaluation using information, data and events to determine the context and framework of the evaluation. These evaluations can be learned through repeated data analysis. Alternatively, a user can use the user interface 304 to input various parameters, configurations, rules and / or examples that indicate or otherwise guide the context engine 323 to detect when one or more imagers 308 capture one or more images being presented on a remote display of an external electronic device, and other context information. In one or more embodiments, the context engine 323 may include an artificial neural network or other similar technology.

[0100] The display detection engine 319 can be configured to detect, in conjunction with the one or more processors 305 of the electronic device 110, when the one or more imagers 308 are capturing a video stream including one or more images presented on a remote display of an external electronic device. The display detection engine 319 can optionally operate in conjunction with the artificial intelligence engine 321 to perform the above-referenced Figure 6 Alternatively, the display detection engine 319 may operate in conjunction with the image processing system 316 to perform the automatic detection described above with reference to FIG. Figure 6 Elements 602, 603 describe automatic detection.

[0101] The zoom monitoring engine 320 can be used to perform the following reference Figure 4 and Figure 5 For example, the zoom monitoring engine 320 may be configured to receive user input from the user interface 304 of the electronic device 110 that causes only a portion of an image to be captured by the one or more imagers 308 and / or received by the communication device 307 from an external electronic device to be presented on the display 114 of the electronic device 110.

[0102] In addition, the zoom monitoring engine 320 can be used to identify the location and / or size of a portion of an image presented on the display 114 of the electronic device, captured by the one or more imagers 308 and / or received by the communication device 307 from the external electronic device. In other embodiments, the zoom monitoring engine 320 can be used to determine whether one or more images captured in a video stream by the one or more imagers 308 and presented on a remote display of an external electronic device occupy at least a predetermined threshold area of ​​the display 114, as will be described below with reference to Figure 4 Just as described.

[0103] The image quality analyzer 322 may be configured to determine what image quality level is required when the one or more processors 305 cause the communication device 307 to request a video stream from an external electronic device. For example, if the one or more imagers 308 are only in viewfinder mode, and the video streams captured by them are only presented on the display 114 of the electronic device 110, the image quality analyzer 322 may cause the one or more processors 305 to request, via the communication device 307, that the video streams sent by the external electronic device be at a lower first image quality level than when those same images are stored in the memory 306 of the electronic device 110. In the latter case, the image quality analyzer 322 may cause the one or more processors 305 to request, via the communication device 307, that the video streams sent by the external electronic device be at a higher second image quality level, and so on, as previously described.

[0104] In one or more embodiments, each of the display detection engine 319, the scale monitoring engine 320, the artificial intelligence engine 321, the image quality analyzer 322, and the context engine 323 can operate with the one or more processors 305. In some embodiments, the one or more processors 305 can control the display detection engine 319, the scale monitoring engine 320, the artificial intelligence engine 321, the image quality analyzer 322, and the context engine 323. In other embodiments, each of the display detection engine 319, the scale monitoring engine 320, the artificial intelligence engine 321, the image quality analyzer 322, and the context engine 323 can operate independently and pass information to the one or more processors 305. The display detection engine 319, the scale monitoring engine 320, the artificial intelligence engine 321, the image quality analyzer 322, and the context engine 323 can all receive data from various sensors 313. In one or more embodiments, the one or more processors 305 are configured to perform the operations of the display detection engine 319, the scale monitoring engine 320, the artificial intelligence engine 321, the image quality analyzer 322, and the context engine 323.

[0105] When executing a reference such as the one above Figure 1 and Figure 2 During the operation of the method steps described above, in one or more embodiments, one or more imagers 308 capture one or more images in the first video stream for presentation on a remote display of the external electronic device. Figure 1 In one embodiment, the one or more processors 305 cause the communication device 307 to send a first request for a second video stream to the external electronic device, the second video stream comprising one or more images presented on the remote display. In one or more embodiments, in response to the communication device 307 receiving the second video stream, the one or more processors 305 replace any presentation of the first video stream on the display 114 with another presentation of the second video stream. Advantageously, when the second video stream is presented on the display 114, any visual distortion that occurs on the display 114 due to the presentation of the first video stream is eliminated.

[0106] The image quality analyzer 322 may operate simultaneously with the one or more processors 305 to specify an image quality level for a video stream requested from an external electronic device. For example, in one or more embodiments, the image quality analyzer 322 may identify a number of pixels per area suitable for presentation on the display 114, i.e., a number of pixels corresponding to the image resolution presentation capability of the display 114. Thus, when the quality analyzer 322 is operable, one or more images of the second video stream will include a first number of pixels per area.

[0107] However, in one or more embodiments, when the one or more processors 305 receive user input from the user interface 304, resulting in the initiation of a storage process to store at least one image from the second video stream in the memory 306, in response to the user input, the image quality analyzer 322 can determine a higher second number of pixels per unit area for the image to be stored. Therefore, in one or more embodiments, the one or more processors 305 then cause the communication device 307 to send a second request for a third video request to the external electronic device in response to the user input, the third video stream including one or more images presented on the remote display. In one or more embodiments, the second request includes a request for one or more images of the third video stream to include one or more images with a higher second number of pixels per unit area. Therefore, the one or more images of the third video stream will each include a second number of pixels per unit area that is greater than the first number of pixels per unit area.

[0108] The zoom monitoring engine 320 can similarly operate simultaneously with the one or more processors 305. For example, when the one or more processors 305 receive another user input from the user interface 304 that causes a zoom operation to occur, for example, when the other user input causes only a portion of the one or more images of the third video stream to be presented on the display 114, the zoom monitoring engine 320 can identify the location of the portion in the one or more images and / or the size of the portion in the one or more images. The zoom monitoring engine 320 can then relay this information to the one or more processors 305.

[0109] In one or more embodiments, in response to receiving the information, the one or more processors 305 may cause the communication device 307 to send a third request to the external electronic device for a fourth video stream that includes only a portion of one or more images presented on a remote display of the external electronic device as identified by the scaling monitoring engine 320. Since the fourth video stream includes only a portion of one or more images in the third video stream, the one or more processors 305 can request a smaller image file corresponding only to the identified portion. Therefore, in one or more embodiments, the fourth video stream includes a third number of pixels per unit area that is greater than the first number of pixels per unit area of ​​the second video stream, but less than the second number of pixels per unit area of ​​the third video stream. This operation of the scaling monitoring engine 320 will be described below with reference to Figure 5 Describe in more detail.

[0110] Now that the various hardware components have been described, attention is turned to additional methods of using the electronic device in accordance with one or more embodiments of the present disclosure. Figure 4 , which shows the Figure 3Hereinafter, alternative methods will be described with reference to subsequent figures.

[0111] Beginning at step 401, the user 108 again points the imager of the electronic device 110, such as the camera 326, at the external electronic device 113 including the remote display 111. One or more images 112 are being presented on the remote display 111 of the external electronic device 113. The imager is capturing one or more images 112 in a video stream 115, which is being presented on the remote display 111 of the external electronic device 113, and the one or more processors 305 present the video stream 115 on the local display 114 of the electronic device 110. As shown in step 401, the user 108 zooms out the imager so that the video stream 115 only occupies a small portion of the local display 114 of the electronic device 110.

[0112] At step 402, the one or more processors 305, optionally in conjunction with one or both of the display detection engine 319 and / or the artificial intelligence engine 321, detect from the first video stream 115 that one or more images 112 presented on the remote display 111 of the external electronic device 113 are present in the video stream 115. This may be done using the method described above with reference to FIG. Figure 6 Other techniques for performing this automatic detection will be apparent to those of ordinary skill in the art having the benefit of this disclosure.

[0113] At decision 403, the one or more processors 305, optionally using the zoom monitoring engine 320, in response to detecting the one or more images 112 appearing in the video stream 115, determine whether the one or more images 112 appearing in the video stream 115 occupy at least a predetermined area threshold 408 of the local display 114 of the electronic device 110. In one or more embodiments, embodiments of the present disclosure contemplate that the operation of the electronic device 110 may be simplified by limiting instances in which requests are sent to the external electronic device to cause the video stream 115 to alternate to only instances in which the one or more images 112 appearing in the video stream 115 occupy at least a predefined area threshold 408 of the local display 114, such as fifty, sixty, seventy, seventy-five, or more percent of the local display 114. For example, if the user 108 is taking a photo of a person using an imager and a television happens to be in the background, it may be annoying for the user 108 if the one or more processors 305 automatically switches to presenting only the one or more images 112 from the second video stream and not the field of view captured by the imager of the electronic device 110. Thus, in one or more embodiments, decision 403 ensures that one or more images 112 of video stream 115 occupy at least a minimum area of ​​local display 114 of electronic device 110 before requesting any additional video streams from any external electronic device.

[0114] In step 401, one or more images 112 in the video stream 115 appearing on the local display 114 of the electronic device 110 do not occupy or exceed the predefined area threshold 408. Therefore, step 404 precludes any transmission of any request for any video stream from the external electronic device in response to the detection of the one or more images 112 present in the video stream 115 displayed at step 402.

[0115] However, at step 405, the user 107 has communicated user input 409 to the local display 114 performing a zoom operation that causes one or more images 112 of the video stream 115 to exceed a predefined area threshold 408—in this example, at least fifty percent of the area of ​​the local display 114 of the electronic device 110. This is detected at decision 403, which causes the method 400 to move to step 406, where the one or more processors 305 of the electronic device 110 cause the communication device 307 to send a request to the external electronic device 113 for a second video stream, the second video stream comprising one or more images 112 presented on the remote display 111 of the external electronic device 113. At step 407, the video stream is received. Thereafter, the method 400 may proceed as described above with reference to FIG. Figure 1 The process is performed as described in step 107 .

[0116] use Figure 4The method 400 advantageously includes a transmission including a request for a video stream from an external electronic device 113, the video stream including one or more images 112 presented on a remote display 111 of the external electronic device 113, only when one or more images 112 appearing in the first video stream 115 occupy an area of ​​the local display 114 of the electronic device 110 that is equal to or greater than at least a predefined area threshold 408. In one or more embodiments, the predefined area threshold 408 can be set by the user 108 using a control settings menu of the electronic device 110.

[0117] The zoom monitoring engine 320 may also be used in other ways. For example, in other embodiments, when capturing an image from the remote display 111 of the external electronic device 113, the user 108 of the electronic device 110 may cause the image resolution or quality level to change by performing a zoom operation. Figure 5 , where one such method is shown.

[0118] Starting from step 501, in response to the one or more processors 305 of the electronic device 110 detecting that one or more images 112 presented by the remote display 111 of the external electronic device 113 are presented in the video stream presented on the display 114 of the electronic device 110, the one or more processors 305 of the electronic device 110 replace the first video stream with the second video stream 117 received from the external electronic device 113 and including the one or more images 112 on the local display 114 of the electronic device 110. In one or more embodiments, the request sent to the external electronic device 113 to cause the external electronic device 113 to send the second video stream 117 specifies a first image quality level for the one or more images 112 of the second video stream 117. Therefore, in step 501, the one or more images 112 included in the second video stream 117 are delivered at the first image quality level.

[0119] In this illustrative embodiment, data 510 corresponding to one or more images 112 is stored in the external electronic device 113 in a RAW data format. Therefore, each of the one or more images 112 includes pixels on the order of 100 million. However, when the external electronic device 113 renders the one or more images 112 on the remote display 111 of the external electronic device 113, it has a smaller image resolution rendering capability. Therefore, the external electronic device 113 may process the RAW data corresponding to the one or more images 112 to reduce it to a level of, for example, 1920×1080 resolution for rendering on the remote display 111.

[0120] At step 501, while the electronic device 110 is receiving the second video stream 117, the user 108 communicates a user input 517 to initiate recording or storing at least one of the one or more images 112 from the second video stream 117 in the memory 306 of the electronic device 110. At step 502, the one or more processors 305 of the electronic device 110 receive the user input 517 from the user interface 304 of the electronic device 110, resulting in storage of at least one of the one or more images 112 from the second video stream 117 in the memory 306 of the electronic device 110 (or alternatively, cloud storage or another storage device external to the electronic device 110).

[0121] In response to detecting the initiation of this "record" operation, in one or more embodiments, step 503 includes the one or more processors 305 of the electronic device 110 sending a second request for a third video stream from the external electronic device 113 that includes one or more images 112. Because the recording operation has been initiated, the second request sent at step 503 specifies a second image quality level for the third video stream, which is a higher image quality level than the first image quality level of the second video stream 117 sent before the recording operation was initiated by user input 517 at step 501. In this example, the second image quality level includes a RAW data format. Therefore, in one or more embodiments, instead of sending in a compressed format in the second video stream 117, the second request for the third video stream sent at step 503 includes a request that the one or more images 112 included in the third video stream be sent in a RAW data format.

[0122] In step 504, the communication device 307 of the electronic device 110 starts to receive the third video stream from the external electronic device 113. As shown in step 505, the communication device 307 of the electronic device 110 is receiving the third video stream 511 from the external electronic device 113, which has a higher second image quality level. In other words, in step 505, the communication device 307 of the electronic device 110 is receiving the third video stream 511 having one or more images 112 in the third video stream 511 in RAW data format. The one or more processors 305 of the electronic device 110 present the third video stream 511 on the local display 114 of the electronic device 110, and in step 505, record the one or more images 112 to the memory 306 of the electronic device 110 (or in the cloud or an external storage device).

[0123] At step 505, while the electronic device 110 is receiving the third video stream 511, the user 108 communicates another user input 512 that causes only a portion 513 of the one or more images 112 from the third video stream 511 to appear on the local display 114 of the electronic device 110. In one or more embodiments, the one or more processors 305 of the electronic device 110, optionally operating simultaneously with the zoom monitoring engine 320, identify at step 506 a location 514 of the portion 513 of the one or more images 112 presented on the remote display 111 of the external electronic device 113 and / or a size 515 of the portion 513.

[0124] At step 507, the one or more processors 305 of the electronic device 110 cause the communication device 307 to send another request for a fourth video stream to the external electronic device 113. Since the zoom operation performed by the user 108 at step 505 has resulted in only a portion 513 of the one or more images 112 being visible on the local display 114 of the electronic device 110, instead of requesting the entire image - that is, all 100 million pixels of each of the one or more images 112 - to be included in the fourth video stream, in one or more embodiments, the request at step 507 only requests that the portion 513 of the one or more images 112 be included in the fourth video stream. Therefore, this will result in the amount of data sent in the fourth video stream being less than the amount of data sent in the third video stream 511 when all 100 million pixels of each of the one or more images 112 are sent. In other words, this request for the fourth video stream results in the fourth video stream having a bit rate associated therewith that is less than the bit rate associated with the third video stream 511.

[0125] At step 508, the communication device 307 receives the fourth video stream. As shown in step 509, the electronic device 110 is receiving the fourth video stream 516, which includes only a portion 513 of the one or more images 112, rather than the entire image. Therefore, at step 508, instead of receiving a 100-million-pixel image, the electronic device 110 receives only a 20-million-pixel portion of the one or more images 112, thereby reducing the amount of data transmitted from the external electronic device 113 to the electronic device 110 based on the scaling operation performed at step 505 when recording the third video stream 511. In one or more embodiments, the portions 513 of the one or more images 112 of the fourth video stream 516 each include a third number of pixels per unit area, which is greater than the first number of pixels per unit area of ​​the second video stream 117 and less than the second number of pixels per unit area of ​​the third video stream 511.

[0126] Therefore, using Figure 5In the method 500, when the user 108 is using the electronic device 110 to capture and record one or more images 112 presented on the remote display 111 of the external electronic device 113, the one or more processors 305 of the electronic device 110 cause a request sent via step 502 for the external electronic device 113 to send the RAW video to the electronic device 110 in the second video stream 117. The user 108 can then reduce the amount of data received from the external electronic device 113 by performing a zoom operation at step 505 while the recording is occurring.

[0127] In one or more embodiments, when the user 108 causes the zoom operation of step 505 to cause only a portion of the one or more images 112 presented on the remote display 111 of the external electronic device to be presented on the local display 114 of the electronic device 110, the one or more processors 305 of the electronic device 110, via the request sent at step 507, cause the external electronic device 113 to send a fourth video stream 516 having only a portion of the data from the one or more images 112. Thus, in one or more embodiments, if each image in the RAW video format includes 100 million pixels, but the user has used the zoom feature so that only one-fifth of the one or more images 112 presented on the remote display 111 of the external electronic device 113 is visible on the local display 114 of the electronic device 110, the one or more processors 305 of the electronic device 110, via the request sent at step 507, cause the external electronic device 113 to send only the pixels corresponding to the portion 513. Thus, the external electronic device 113 sends the fourth video stream 516 at step 509, which includes 20 million pixels per image instead of 100 million, and so on.

[0128] Now turn to Figure 8 , in which various embodiments of the present disclosure are shown. Since the components of these embodiments have been Figure 8 Previous Figure 1-6 Therefore, Figure 8 The embodiments in are shown as being in accordance with 37 CFR § 1.83(a) Figure 8 Therefore, because these items have been previously illustrated and described, 37 CFR § 1.83(a) indicates that their repeated illustration is no longer necessary for a proper understanding of these embodiments. Therefore, these embodiments are shown as labeled boxes in accordance with 37 CFR § 1.83(a), which states that these embodiments "shall be shown in the drawings by a graphic symbol or labeled representation (e.g., a labeled rectangular box)."

[0129] At 801, a method in an electronic device includes: using one or more processors of the electronic device to detect that one or more images presented on a remote display of an external electronic device appear in a first video stream captured by an imager of the electronic device. At 801, the method includes, in response to detecting that the one or more images appear in the first video stream, using the one or more processors, causing a communication device of the electronic device to establish electronic communication with the external electronic device.

[0130] At 801, the method includes: sending, by one or more processors, a first request for a second video stream to an external electronic device using a communication device, the second video stream including one or more images presented on a remote display of the external electronic device. At 801, the method includes receiving, by the communication device, the second video stream from the external electronic device in response to the first request. At 801, the method includes presenting, by one or more processors, the second video stream on a local display of the electronic device.

[0131] At 802, the method of 801 also includes displaying, by one or more processors, the first video stream on a local display of the electronic device before detecting one or more images appearing in the first video stream. At 802, the method includes replacing, by one or more processors, display of the first video stream with presentation of the second video stream on a local display of the electronic device in response to receiving the second video stream.

[0132] At 803, the first request of 802 specifies a first image quality level for one or more images of the second video stream. At 804, the first image quality level of 803 includes a first image resolution level for the one or more images of the second video stream. At 805, the first image resolution level of 804 corresponds to an image resolution rendering capability of a local display of the electronic device.

[0133] At 806, the method of 803 further includes receiving, using one or more processors, a first user input from a user interface of the electronic device, the first user input causing storage of at least one of the one or more images from the second video in a memory of the electronic device. At 806, the method includes: sending, by the one or more processors, in response to the first user input, a second request for a third video stream including the one or more images. At 806, the second request specifies a second image quality level for the third video stream, the second image quality level having an image quality level that is higher than the first image quality level. At 807, the second image quality level of 806 includes an original image file format of the one or more images.

[0134] At 808, the method of 806 further includes: receiving, using one or more processors, a second user input from a user interface of the electronic device, the second user input causing only a portion of the one or more images from the third video stream to be presented on a local display of the electronic device. At 808, the method includes: in response to the second user input, sending, by the one or more processors, a third request for a fourth video stream including only a portion of the one or more images. At 809, the one or more images of the fourth video stream of 808 have a bit rate associated therewith that is less than another bit rate associated with the third video stream.

[0135] At 810, the method of 808 further includes identifying, by the one or more processors, a location of the portion in the one or more images and a size of the portion in the one or more images.At 810, the third request includes the location of the portion and the size of the portion.

[0136] At 811, the method of 803 further includes, in response to detecting that one or more images appear in the first video stream, determining, using one or more processors, whether the one or more images appearing in the first video stream occupy at least a predefined area threshold of the local display of the electronic device when displayed on the local display of the electronic device. At 811, the sending of the first request occurs only when the one or more images appearing in the first video stream occupy an area of ​​the local display that is equal to or greater than at least the predetermined area threshold.

[0137] At 812, the electronic device includes an imager that captures one or more images presented on a remote display of an external electronic device in a first video stream. At 812, the electronic device includes a display, a communication device, and one or more processors operable with the communication device and the display.

[0138] At 812, the one or more processors cause the communication device to send a first request for a second video stream to the external electronic device, the second video stream comprising one or more images presented on the remote display. At 812, the one or more processors replace the presentation of the first video stream on the display with another presentation of the second video stream in response to the communication device receiving the second video stream. At 813, the one or more images of the second video stream of 812 each include a first number of pixels per unit area.

[0139] At 814, the electronic device of 813 also includes a user interface and a memory operable with the one or more processors. At 814, the one or more processors receive user input from the user interface, which stores at least one image from the second video stream in the memory. At 814, in response to the user input, the one or more processors cause the communication device to send a second request for a third video stream to the external electronic device, the third video stream including one or more images presented on the remote display. At 815, the one or more images of the third video stream of 814 each include a second number of pixels per unit area, which is greater than the first number of pixels per unit area.

[0140] At 816, the one or more processors of 815 receive another user input from the user interface to present only a portion of the one or more images of the third video stream on the display. At 816, in response to the another user input, the one or more processors cause the communication device to send a third request for a fourth video stream to the external electronic device, the fourth video stream comprising only a portion of the one or more images presented on the remote display. At 817, the portions of the one or more images of the fourth video stream of 816 each include a third number of pixels per unit area that is greater than the first number of pixels per unit area and less than the second number of pixels per unit area.

[0141] At 818, the method in the electronic device includes detecting, by one or more processors, one or more images presented by a remote display of the external electronic device from a first video stream captured by the imager. At 818, the method includes receiving, in response to the detection, a second video stream using a communication device operable with the one or more processors, the second video stream including the one or more images presented on the remote display. At 818, the method includes replacing, by the one or more processors on the local display of the electronic device, the presentation of the first video stream with the second video stream.

[0142] At 819, the method of 818 further includes: in response to the one or more processors receiving a user input at the user interface that causes recording of one or more images of the second video stream, receiving, using the communication device, a third video stream including one or more images presented on the remote display. At 819, the third video stream has a resolution per unit area with more pixels per image than the second video stream.

[0143] At 820, the method of 819 further includes: in response to one or more processors receiving another user input at the user interface that causes only a portion of one or more images of the third video stream to be presented on the local display, using the communication device to receive a fourth video stream including only a portion of the one or more images to be presented on the remote display.

[0144] In the foregoing description, specific embodiments of the present disclosure have been described. However, it will be understood by those skilled in the art that various modifications and changes may be made without departing from the scope of the present disclosure as set forth in the appended claims. Therefore, although preferred embodiments of the present disclosure have been illustrated and described, it is apparent that the present disclosure is not limited thereto. For those skilled in the art, various modifications, changes, variations, substitutions and equivalents may be made without departing from the spirit and scope of the present disclosure as defined in the appended claims. Therefore, the description and the drawings should be considered illustrative rather than restrictive, and all such modifications are intended to be included within the scope of the present disclosure. Benefits, advantages, solutions to problems, and any elements that may cause any benefit, advantage or solution to appear or become more apparent should not be interpreted as key, essential or necessary features or elements of any or any claim.

Claims

1. A method for capturing an image from a remote display of an external electronic device, the method comprising: detecting, using one or more processors of the electronic device, that one or more images presented on the remote display of the external electronic device appear in a first video stream captured by an imager of the electronic device, causing, with the one or more processors, a communication device of the electronic device to establish electronic communication with the external electronic device in response to detecting that the one or more images are present in the first video stream; sending, by the one or more processors, utilizing the communication device to the external electronic device, a first request for a second video stream including the one or more images presented on the remote display of the external electronic device; receiving, using the communication device, the second video stream from the external electronic device in response to the first request; as well as The second video stream is presented by the one or more processors on a local display of the electronic device.

2. The method according to claim 1, further comprising: displaying, by the one or more processors, the first video stream on the local display of the electronic device before detecting that the one or more images appear in the first video stream; as well as In response to receiving the second video stream, display of the first video stream is replaced, by the one or more processors, on the local display of the electronic device with presentation of the second video stream. 3 . The method of claim 2 , the first request specifying a first picture quality level for one or more pictures of the second video stream.

4. The method according to claim 3, wherein: The first picture quality level comprises a first picture resolution level for one or more pictures of the second video stream.

5. The method of claim 4, wherein the first image resolution level corresponds to an image resolution rendering capability of the local display of the electronic device.

6. The method according to claim 3, further comprising: receiving, with the one or more processors, a first user input from a user interface of the electronic device, the first user input causing at least one image of the one or more images from the second video stream to be stored in a memory of the electronic device; as well as The one or more processors send a second request for a third video stream including the one or more images in response to the first user input, the second request specifying a second image quality level for the third video stream, the second image quality level being a higher image quality level than the first image quality level.

7. The method according to claim 6, wherein: The second image quality level includes an original image file format of the one or more images.

8. The method according to claim 6, further comprising: receiving, with the one or more processors, a second user input from a user interface of the electronic device, the second user input causing only a portion of one or more images from a third video stream to be presented on the local display of the electronic device; as well as A third request is sent, by the one or more processors in response to the second user input, for a fourth video stream, the fourth video stream comprising only the portion of the one or more images.

9. The method of claim 8, the one or more images of the fourth video stream having a bit rate associated with the one or more images of the fourth video stream that is less than another bit rate associated with the third video stream.

10. The method according to claim 8, further comprising: A location of the portion in the one or more images and a size of the portion in the one or more images are identified by the one or more processors, and the third request includes the location of the portion and the size of the portion.

11. The method according to claim 3, further comprising: Utilizing the one or more processors, in response to detecting that the one or more images appear in the first video stream, determine whether the one or more images appearing in the first video stream occupy at least a predefined area threshold of the local display of the electronic device when displayed on the local display of the electronic device, wherein sending of the first request occurs only if the one or more images appearing in the first video stream occupies an area of ​​the local display equal to or greater than at least the predefined area threshold.

12. An electronic device for capturing an image from a remote display of an external electronic device, comprising: an imager that captures one or more images in a first video stream that are presented on the remote display of the external electronic device; monitor; Communications equipment; as well as one or more processors operable with the communication device and the display; The one or more processors cause the communication device to send a first request to the external electronic device for a second video stream including the one or more images presented on the remote display, and in response to the communication device receiving the second video stream, replace the presentation of the first video stream on the display with another presentation of the second video stream.

13. The electronic device of claim 12, the one or more images of the second video stream each comprising a first number of pixels per unit area.

14. The electronic device according to claim 13 further includes a user interface and a memory capable of operating with the one or more processors, the one or more processors receiving user input from the user interface to store at least one image from the second video stream in the memory, and in response to the user input, causing the communication device to send a second request for a third video stream to the external electronic device, the third video stream including one or more images presented on the remote display.

15. The electronic device of claim 14, the one or more images of the third video stream each comprising a second number of pixels per unit area that is greater than the first number of pixels per unit area.

16. An electronic device according to claim 15, wherein the one or more processors receive another user input from the user interface, thereby causing only a portion of the one or more images of the third video stream to be presented on the display, and in response to the another user input, causing the communication device to send a third request for a fourth video stream to the external electronic device, wherein the fourth video stream includes only the portion of the one or more images presented on the remote display.

17. An electronic device according to claim 16, wherein the portions of the one or more images of the fourth video stream each include a third number of pixels per unit area, and the third number of pixels per unit area is greater than the first number of pixels per unit area and less than the second number of pixels per unit area.

18. A method for capturing an image from a remote display of an external electronic device, the method comprising: detecting, by one or more processors, one or more images presented by the remote display of the external electronic device from a first video stream captured by an imager; In response to the detecting, receiving, with a communication device operable with one or more processors, a second video stream including one or more images presented on the remote display; as well as The one or more processors replace, on a local display of the electronic device, presentation of the first video stream with the second video stream.

19. The method of claim 18, further comprising: In response to the one or more processors receiving user input at a user interface causing the one or more images of the second video stream to be recorded, a third video stream including one or more images presented on the remote display is received using the communication device, the third video stream having a greater number of pixels per image per area resolution than the second video stream.

20. The method according to claim 19, further comprising: In response to the one or more processors receiving another user input at the user interface that causes only a portion of the one or more images of the third video stream to be presented on the local display, a fourth video stream including only the portion of the one or more images to be presented on the remote display is received using the communication device.

Images