A framework for automatically establishing a secure connection for streaming audio and video data between devices based on device state criteria

Abstract

An electronic device, a device, a method, and a non-transitory program storage device for enabling automatic establishment of a secure audio / video data streaming connection are disclosed. For example, a first electronic device can enter a first state of a peer device advertising protocol, and then, based on a determination that the first electronic device meets a first set of device state criteria (e.g., including at least an orientation state criterion), the first electronic device can enter a second (e.g., enhanced) state of the peer device advertising protocol. In response to detecting the presence of a second electronic device in proximity thereto, the first electronic device connects to the second electronic device via a secure peer-to-peer connection protocol, and then can transmit one or more images captured by a first image capture device of the first electronic device to the second electronic device connected via a secure wireless peer-to-peer connection protocol.

Description

Technical Field

[0001] The present disclosure generally relates to the field of audio and video data streaming. More particularly, but not by way of limitation, the present disclosure relates to techniques for automatically establishing a secure connection between a user's devices for streaming audio and video data.

Background Art

[0002] With the advent of portable integrated computing devices, cameras and other video-capturable devices have become widespread. These integrated computing devices generally take the form of smartphones, tablets, or laptop computers, and typically include a general-purpose computer, a camera, a high-performance user interface including a touch-sensitive screen, and wireless communication capabilities via Wi-Fi, Bluetooth, LTE, HSDPA, New Radio (NR), and other cellular-based or wireless technologies. The widespread availability of these integrated devices provides an opportunity to use the capabilities of the devices to perform tasks that would otherwise require dedicated hardware and software.

[0003] For example, portable integrated computing devices such as smartphones, tablets, and laptops typically have two or more built-in cameras. These cameras generally correspond to lens / camera hardware modules that can be controlled through the use of a general-purpose computer using firmware and / or software (e.g., an "app") and a user interface including touchless controls such as touchscreen buttons, fixed buttons, and / or voice controls. The integration of high-quality cameras into these portable integrated communication devices such as smartphones, tablets, and laptop computers has enabled users to capture and share images and videos in ways that were previously impossible. Currently, it is common for a user's smartphone to be their primary image capture device of choice.

[0004] With the increasing popularity of photo and video sharing via portable integrated computing devices having an integrated camera, video conferencing via such portable integrated computing devices is on the rise. In particular, users are often engaged in video conference calls or meetings, and video images are typically captured by a front-facing camera on the device, i.e., a camera that faces the same direction as the display screen of the camera device. Most prior art cameras are optimized for either wide-angle general photography or narrow-angle photography, such as self-portrait and video conference streaming use cases. These cameras optimized for wide-angle are typically optimized for group and landscape compositions, but are not optimal for individual portraits, for example, due to distortion that occurs when the subject is at a short distance from the camera or at the edge of the camera's field of view.

[0005] As used herein, "field of view" or "FOV" refers to the angular range of a given scene imaged by a camera. FOV is typically measured in degrees and can be expressed as vertical FOV, horizontal FOV, and / or diagonal FOV. The diagonal FOV of an image sensor is often referred to herein because it is a more appropriate measure of the camera's optical system as it attempts to cover the corners of the image, and "roll-off," i.e., vignetting, can be more pronounced for pixels at the corners of the image sensor. For reference, a typical 35mm camera with a lens having a focal length of 50mm has a horizontal FOV of 39.6°, a vertical FOV of 27.0°, and a diagonal FOV of 46.8°.

[0006] Cameras optimized for portrait and video conferencing streaming (e.g., "front-facing" cameras) are typically not optimal for landscapes and group photos (or group video conference calls) due to their limited field of view. Further, the field of view of a given camera can also affect how the user composes the shot (i.e., how far and at what angle the user positions themselves relative to the device's camera) and ultimately the quality of the captured image. Additionally, some devices that may be most comfortable or appropriate for a user to utilize during a long video conference call, such as a desktop computer or laptop computer with a stand-alone monitor, may not have an integrated camera or may have a low-quality integrated web camera.

[0007] Accordingly, it is desirable to provide such users with a method and system having the ability to seamlessly and automatically create a secure connection between the user's electronic devices at contextually appropriate times in order to provide the user with greater flexibility in image capture sources and the ability to utilize higher quality image capture devices during a video conference session (e.g., via a camera integrated into one of the user's portable communication devices), for example, to enable the streaming of audio and / or video image data captured by a first electronic device directly to a second electronic device for subsequent presentation, storage, or further transmission by the second electronic device. SUMMARY OF THE INVENTION

[0008] Devices, methods, and non-transitory program storage devices (NPSDs) are disclosed herein for enabling the automatic establishment of secure audio / video data streaming connections between electronic devices, such as electronic devices associated with the same user or the same user account. For example, a first electronic device comprising at least a first image capture device and a first position sensor may enter a first state of a peer device advertising protocol and then determine a first orientation state of the first electronic device based at least in part on information obtained from the first position sensor. In response to determining that the first electronic device meets a first set of device state criteria, the first electronic device may enter a second state of the peer device advertising protocol (e.g., an "enhanced" or "high power" advertising state), and determining that the first electronic device meets the first set of device state criteria includes determining that the first orientation state is within a threshold difference of a predetermined device activation orientation state (e.g., the device activation orientation state may include a portrait orientation state, a landscape orientation state, etc.).

[0009] In response to detecting the presence of a second electronic device proximate to the first electronic device while in the second state of the peer device advertising protocol, the first electronic device may connect to the second electronic device via a secure wireless peer-to-peer connection protocol, and then the first electronic device may transmit one or more images captured by the first image capture device to the connected second electronic device via the secure wireless peer-to-peer connection protocol (e.g., the secure wireless peer-to-peer connection protocol may be a different protocol than the peer device advertising protocol used to initially establish the connection between the devices).

[0010] In some embodiments, an interruption event may be detected in the first electronic device, during which the transmission of image and / or video data to the second electronic device may be temporarily stopped. In other embodiments, the first electronic device may receive image capture related parameters from the second electronic device, and then capture subsequent images using the first image capture device according to the received image capture related parameters.

[0011] According to other embodiments, the first set of device state criteria may further include determining that the first electronic device exhibits movement less than a threshold amount over a determined period, determining that the first electronic device is in at least one of a standby state, a lock screen state, a screen off state, an active communication session, or an idle state, and / or determining that the first image capture device is oriented in a preferred direction with respect to the second electronic device.

[0012] In some other embodiments, the "enhanced" second state of the peer device advertising protocol may have a higher duty cycle and / or a shorter advertising interval between advertising packets than the first state of the peer device advertising protocol.

[0013] In still other embodiments, in response to determining that the first electronic device does not meet the first set of device state criteria, the first electronic device may remain in the first state of the peer device advertising protocol and may not attempt to connect to any peer device via the secure wireless peer-to-peer connection protocol.

[0014] In yet other embodiments, in response to not detecting the presence of a second electronic device proximate to the first electronic device while in the second state of the peer device advertising protocol, the first electronic device can enter a third state of the peer device advertising protocol, where the third state of the peer device advertising protocol has an advertising interval shorter than the first state of the peer device advertising protocol but longer than the advertising interval between advertising packets of the second state of the peer device advertising protocol.

[0015] In yet other embodiments, in response to determining that the first electronic device no longer meets a first set of device state criteria, the first electronic device can disconnect from a second electronic device via a secure wireless peer-to-peer connection protocol.

[0016] The techniques disclosed herein may also be used to perform a "handoff" method for a communication session, such as an active audio-visual (A / V) communication session, i.e., a method of handing off control of a communication session from a first electronic device associated with a user to a second electronic device associated with the user. According to some embodiments, the method includes receiving, at a second electronic device associated with a first user, an indication that a first electronic device associated with the first user is providing one or more images captured by an image capture device of the first electronic device via an active communication session, and then, in response to identifying that the first electronic device meets a first set of device state criteria, 1) at the second electronic device, participating in the active communication session on behalf of the first user (e.g., automatically participating in the session or participating in response to a confirmation user input), and 2) selecting, in the active communication session, the image capture device of the first electronic device as an image source for the second electronic device. When the management of the communication session is handed off to the second electronic device, the second electronic device may start receiving one or more images captured by the image capture device of the first electronic device (e.g., via a secure wireless peer-to-peer connection protocol) and then provide the one or more images received from the first electronic device to the active communication session. In some embodiments, the second electronic device may also display and / or store one or more images received from the first electronic device and / or transmit the one or more images to a third electronic device.

[0017] In some embodiments, identifying a first electronic device as meeting a first set of device state criteria may further include, in a second electronic device, entering a peer device advantaging protocol state, which may include at least one of a default advantaging state, an enhanced advantaging state, or a low power advantaging state. In still other embodiments, identifying a first electronic device as meeting a first set of device state criteria may further include detecting the presence of the first electronic device via a peer device advantaging protocol. In still other embodiments, identifying a first electronic device as meeting a first set of device state criteria includes, in a second electronic device, detecting that the first electronic device is in proximity to the second electronic device and is oriented in a first orientation state within a threshold difference of a predetermined device activation orientation state. In further embodiments, identifying a first electronic device as meeting a first set of device state criteria includes, in a second electronic device, detecting that the first electronic device is in proximity to the second electronic device and that an image capture device of the first electronic device is oriented in a favorable direction with respect to the second electronic device.

[0018] According to yet other embodiments, a method is disclosed. The method includes, at a second electronic device, receiving an indication that a first electronic device is requesting the second electronic device to participate in an active communication session, and, in response to identifying that the first electronic device meets a first set of device state criteria: 1) participating in the active communication session at the second electronic device; 2) selecting an image capture device of the first electronic device as an image source of the second electronic device in the active communication session; receiving, at the second electronic device, one or more images captured by the image capture device of the first electronic device; and providing, from the second electronic device, the one or more images received from the first electronic device in the active communication session. According to some such embodiments, the method can further include displaying, at the second electronic device, the one or more images received from the first electronic device. According to other such embodiments, identifying the first electronic device as meeting the first set of device state criteria further includes entering a peer device advantaging protocol state at the second electronic device. According to yet other such embodiments, the second electronic device can be configured to participate in the active communication session on behalf of a first user in response to a user input. According to yet other such embodiments, the one or more received images captured by the image capture device of the first electronic device are received via a secure wireless peer-to-peer connection protocol. According to yet other such embodiments, the method can further include transmitting, by the second electronic device, the one or more images received from the first electronic device to a third electronic device.

[0019] Embodiments of various non - transient program storage devices are also disclosed herein. Such NPSDs are readable by one or more processors. Instructions can be stored in the NPSD to cause one or more processors to implement any of the embodiments disclosed herein. Also disclosed herein are various image processing and secure device connection methods according to the embodiments disclosed herein.

Brief Description of the Drawings

[0020]

Figure 1

[0021]

Figure 2

[0022]

Figure 3

[0023]

Figure 4A

Figure 4B

Figure 4C

Figure 4D

Figure 4E

Figure 4F

[0024]

Figure 5

[0025]

Figure 6

[0026]

Figure 7

[0027] In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the invention disclosed herein. It will be apparent to one of ordinary skill in the art, however, that the invention can be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order not to obscure the invention. References to numbers without subscripts or suffixes are understood to refer to all cases of subscripts and suffixes corresponding to the reference number. Further, the language used in the present disclosure has been selected primarily for readability and for the purpose of explanation and not to limit or circumscribe the inventive subject matter, and reliance on the claims may be necessary to determine such inventive subject matter. References herein to "one embodiment" or "an embodiment" (or the like) mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention, and references to "one embodiment" or "an embodiment" multiple times are not necessarily all referring to the same embodiment.

[0028] Exemplary device setup for attempting to establish a secure connection between user electronic devices

[0029] Next, referring to FIG. 1, an exemplary electronic device configuration 100 is shown for attempting to establish a secure connection between electronic devices for streaming audio and video data according to one or more embodiments. First referring to scenario A (100A), a first device (104A) and a second device (102) are in proximity to each other and attempt to form a secure connection. As used herein, the term "in proximity to" may refer to devices that are within each other's discoverable range for a given wireless connection protocol. According to some implementations, the measured signal strength may be used as a proxy for estimating the distance between two devices and determining whether they are within a sufficient range of each other. In some such implementations, the threshold signal strength required to determine that two devices are in sufficient proximity to each other may not be a fixed threshold and may also be based on filtering (e.g., averaging) of the signal strength values over time across a number of signal strength samples. In some embodiments, the first device 104A may comprise one or more image capture devices 105, and the second device 102 may also comprise one or more image capture devices 106. In some cases, the image capture device 105 of the first device may be of higher quality than the image capture device 106 of the second device with respect to, for example, resolution, zoom, FOV, spatial resolution, focus, color quality, or any other imaging parameter. In such a case, it may be more desirable to use the image capture device 105 of the first device rather than the image capture device 106 of the second device to capture an image to be used, displayed, stored, transmitted, etc. by the second device (102), for example, as part of an active communication session.In still other cases, the user of the second device (102) may desire to select the image capture device of the first device (104A) for any number of other reasons, such as because the second device (102) may not have its own image capture device, because the image capture device of the second device is not functioning properly, because the image capture device of the first device has special image capture features or modes desired by the user of the second device (e.g., "portrait" or synthetic shallow depth of field (SDOF) photography mode by composition, "night" capture mode, "slow motion" video capture mode, etc.), or to provide different (and / or additional) views of the scene surrounding the second device (104A).

[0030] According to some embodiments disclosed herein, the first device must meet a first set of device state criteria before establishing a connection with the second device. In some such embodiments, the first set of device state criteria comprises 1.) an orientation state criterion, 2.) a device movement criterion, 3.) a device activity criterion, 4.) an active communication session criterion, 5.) a direction criterion, 6.) a proximity criterion, 7.) a user account criterion, and / or any number of other criteria that may be desired to define the overall state of the first device such that the first device will be permitted to attempt to establish a secure connection with the second device, one or more of which may be included.

[0031] 1. Orientation state criterion

[0032] For example, in some embodiments, the orientation state criterion may include the requirement that the first device be within a threshold difference of a predetermined device activation orientation state. In some cases, the device activation orientation state may be a full "landscape" (i.e., horizontal) or "portrait" (i.e., vertical) orientation state, i.e., a rotation of 0 degrees with respect to the measured horizontal (or vertical) axis, and the allowable threshold difference may be, for example, ±5 degrees as measured by an internal position sensor (e.g., an accelerometer) of the first device. In such cases, the first device may be considered to meet the orientation state criterion whenever it is oriented within ±5 degrees of the full landscape (or in some cases portrait) orientation. The examples of full landscape or portrait orientation are merely examples of the device activation orientation state that may be defined in a given implementation, and it should be understood that any suitable and determinable device activation orientation state may be defined for a given implementation. In still other embodiments, the device activation orientation state may also include a specific gesture (e.g., shaking the phone back and forth a predetermined number of times, etc.) indicating that the user intends to establish a secure connection between the first electronic device and another device in proximity thereto. In still other embodiments, for example, if the second electronic device has an integrated image capture device and the user is already within the FOV, the performance of a specific gesture by the user (e.g., a "wave" or "pointing" gesture captured and interpreted by the second electronic device or measured by another electronic device, e.g., a wearable device) may also be used as an indication that the user intends to establish a secure connection between the second electronic device and the first electronic device in proximity thereto. In some implementations, additional device sensors may be used to confirm or improve the understanding of the device's orientation state.For example, signals obtained from an ambient light sensor (ALS) and / or a luminance sensor incorporated in a device can be used as a secondary queue to prevent false positive connections between devices in scenarios where the device can accidentally be in a device activation orientation state (e.g., a full "landscape" orientation) while the device is in a user's pocket or backpack, etc., which is likely to be indicated by such ALS and / or luminance sensors reporting a lower ambient luminance level than a predetermined threshold ambient luminance level required to establish a secure device connection.

[0033] As shown in Scenario A (100A), the first device (104A) appears to be in a full landscape orientation. Thus, assuming an implementation where the landscape orientation is the defined device activation orientation state, the first device (104A) will meet that particular device state criterion. However, as will be described in more detail below, additional device state criteria can also be defined, and the first device will need to meet the additional device state criteria before it is eligible to attempt to establish the secure connection described herein with the second device (102).

[0034] 2. Device movement criteria

[0035] In other embodiments, the device movement criteria can include determining that the first device exhibits movement less than a threshold amount over a determined period. Such device movement criteria can be used, for example, when it is desired for the first device to be attached or otherwise held stationary during a determined period before it is eligible to attempt to establish a secure connection with the second device (102).

[0036] 3. Device activity criteria

[0037] In yet other embodiments, the device activity criteria may include determining that the first electronic device is in at least one of the following states: standby state, lock screen state, screen off state, or idle state. Such device activity criteria may be used, for example, when it is desired that the first device not be actively used by the user for any other function (e.g., reading email, browsing the Internet, etc.) before it is eligible to establish a secure connection with a second device (102).

[0038] 4. Active Communication Session Criteria

[0039] In yet other embodiments, the active communication session criteria may include determining that the first device is participating in an active communication session, such as an active audio / visual communication session that may include the transmission of one or more images to another device. Such active communication session criteria may be used, for example, when it is desired that the eligibility of the first device to attempt to establish a secure connection with a second device be broadcast when the first device is actively capturing an image and / or audio that contributes to a part of the active communication session. In such a situation, the user may desire to have management of the active communication session transferred to the second device while continuing to use the image capture device of the first device to capture one or more images being transmitted as part of the active communication session.

[0040] 5. Orientation Criteria

[0041] In yet other embodiments, the device orientation criteria can include determining that the first electronic device is oriented in a particular direction with respect to the second device (102) before it is eligible to attempt to establish a secure connection with the second device (102). For example, even if the first device meets an orientation criteria (e.g., is in a full landscape orientation), an additional device orientation criteria, e.g., that the "front" (or "back" depending on the convention being used) of the first device is also oriented in the same direction as the display of the second device, may be established before the first device is eligible to attempt to establish a secure connection with the second device. In some implementations, this may be due to the fact that it is known (or indicated by the user) that there is only interest in using the "back" image capture device of the first device during a secure connection with the second device. Thus, there is no need to automatically attempt to establish a secure connection with the second device unless the "back" of the first device is facing the user.

[0042] 6. Proximity Criteria

[0043] In yet other embodiments, the device proximity criteria may include determining that the first device is within a threshold distance of the second device (e.g., within 2 feet, 1 meter, 6 feet, etc.). Such device criteria may be used, for example, when it is desirable that only the first device be eligible to attempt to establish a secure connection with the second device (102) when the first device is located in proximity to the second device (102). For example, as shown in FIG. 1, there are exemplary boundaries 108 depicted in each of scenarios A, B, and C, which are defined as a spherical region (having a radius 110) from the center of the second device (102). The spherical example is merely illustrative, and it should be understood that the device proximity criteria may be specified in any desired manner with respect to, for example, fixed or dynamic signal strength values measured from signals emitted from other devices, raw distance, line of sight, the required successful type of mechanical or magnetic connection between the first device and the second device, etc. As can be understood here, in scenarios A, B, and C of FIG. 1, the first device (104) must be within the exemplary boundary 108 in order to meet the proximity criteria and be eligible to attempt to establish a secure connection with the second device (102).

[0044] 7. User Account Criteria

[0045] In yet other embodiments, user account criteria may be defined, for example, for the first device (104) and the second device (102) to be eligible to attempt to establish a secure connection therebetween, the first device and the second device must be associated with the same user or the same user account. Such user account criteria may be used, for example, when it is desired that the first device not inadvertently attempt to connect to a second device near another user, thereby protecting the privacy of the user of the first device and preventing the first device from appearing on the devices of any other user as an eligible device to establish a secure connection.

[0046] In some embodiments, rather than (or in addition to) being explicitly specified by the user, the first set of device state criteria can be learned and / or customized over time, either individually or for a given user and / or a given first device. For example, if a particular user attempts to consistently establish a connection between their first device and a second device when the first device is in a particular state (e.g., attached to a holding clamp, the screen of the first device is locked, within 6 inches of a second device, and between 5:00 PM and 5:05 PM), the device can begin to learn (e.g., using machine learning techniques) and / or customize (e.g., using explicit user approval or confirmation) a particular set of device state criteria to be implemented before attempting to establish a secure connection with the second device. In this way, the device state criteria can be made to match the device state that is most frequently observed (or explicitly defined by the user) when establishing a secure connection with the second device.

[0047] Returning now to scenario A (100A), the first device (104A) is within a threshold difference of a predetermined device activation orientation state (e.g., full landscape in this example). However, the first device (104A) is not within a threshold distance of the second device (102) (e.g., within the exemplary boundary 108 in this example). Assuming that the aforementioned horizontal device activation orientation state criteria and boundary 108 proximity criteria are the only criteria defined in the first set of device state criteria in this example, as indicated by symbol (107A), the first device (104A) is not eligible to establish a connection with the second device (102), reflecting that no connection has been established between the first device (104A) and the second device (102).

[0048] Referring to Scenario B (100B) here, the first device (104B) and the second device (102) are again in proximity to each other and attempt to form a secure connection. However, in Scenario B (100B), the first device (104A) is in a vertical orientation and thus is not within the threshold difference of a predetermined device activation orientation state (e.g., in this example, completely horizontal), although the first device (104A) is within the threshold distance of the second device (102) (i.e., within the exemplary boundary 108). Again, in this example, assuming that the aforementioned horizontal device activation orientation state criterion and the boundary 108 proximity criterion are the only criteria defined in the first set of device state criteria, as indicated by symbol 107B, the first device (104B) is again not eligible to establish a connection with the second device (102), reflecting that no connection has been established between the first device (104B) and the second device (102).

[0049] Referring to Scenario C (100C) here, the first device (104C) and the second device (102) are again in proximity to each other and attempt to form a secure connection. In Scenario C (100C), the first device (104C) is in a horizontal orientation and thus is within the threshold difference of a predetermined device activation orientation state (e.g., in this example, completely horizontal), and the first device (104C) is also within the threshold distance of the second device (102) (i.e., within the exemplary boundary 108). Again, in this example, assuming that the aforementioned horizontal device activation orientation state criterion and the boundary 108 proximity criterion are the only criteria defined in the first set of device state criteria, the first device (104C) is eligible to establish a connection with the second device (102), as indicated by symbol 107C, reflecting that the established secure wireless connection between the first device (104C) and the second device (102) is successful.

[0050] The exemplary image 109 represents an image captured by the image capture device (105) of the first device (104C) and then transmitted to the second device (102) via the secure connection 107C. The image can then be stored, displayed, and / or transmitted to another third device, etc. In some embodiments, the first device (104C) can automatically attempt to establish a connection to the second device (102), i.e., in response to the first set of device state criteria being met, if the connection is successful, the first device (104C) can be automatically selected for use by the second device (102) (or appear in the list of available image capture device sources in the second device 102 for manual user selection). In some embodiments, the first device 104C can seamlessly appear along any other image capture source available for selection in the second device 102, such as, for example, an image capture device inside the second device (such as the image capture device 106), an image capture device directly connected to the second device 102 (e.g., via a USB port), etc.

[0051] In some implementations, if the first electronic device has not connected to the second electronic device of a specific user according to the secure connection technology described herein after a predetermined amount of time (e.g., 30 days, 60 days, 1 year, etc.), for example, until positively reactivated by the user, the use of the device state criteria detection and secure connection framework described herein can be disabled.

[0052] Exemplary process flow diagram for establishing a secure connection between electronic devices

[0053] Next, referring to FIG. 2, an exemplary process flow diagram 200 for establishing a secure connection between electronic devices for streaming audio data and video data according to one or more embodiments is shown. Starting from block 202, a first device (104) can enter a first peer device advertising protocol state. As will be described in more detail with reference to FIG. 3 below, in some embodiments, the first peer device advertising protocol state can include a "default" or "low power" advertising state configured to have a minimum advertising duty cycle and / or a maximum time interval delay between broadcasts of advertising packets.

[0054] Next, at 206, the first device broadcasts an advertising packet to any device in its proximity, for example, according to the parameters of the first peer device advertising protocol state. As shown in FIG. 2, in some cases, a second device (102) may be in proximity to the first device and may operate in its own default peer device advertising state (block 204), which may or may not be the same as the first peer device advertising protocol state in which the first device is operating.

[0055] Next, in block 208, the first device determines a first device state for itself (which may include at least an orientation state component in some embodiments). In block 210, if a first set of device state criteria are not met (i.e., "no" in block 210), the first device returns to block 202 and may remain in the "default" or "low power" first peer device advantaging protocol state. Instead, in block 210, if it is determined that the first set of device state criteria are met by the first device (i.e., "yes" in block 210), the first device proceeds to block 212 and may enter a second peer device advantaging protocol state. In 214, the first device broadcasts an advantaging packet to any device in its proximity, for example, according to the parameters of the second peer device advantaging protocol state. In some embodiments, as will be described in more detail with reference to FIG. 3 below, the second peer device advantaging protocol state may include an "enhanced" or "high power" advantaging state configured to have a maximum allowable advantaging duty cycle and / or a minimum allowable time interval delay between broadcasts of advantaging packets. In some such embodiments, the second peer device advantaging protocol state may be configured to facilitate a faster connection between the first device and a second device since it is determined that the first device is currently meeting the first set of device state criteria (e.g., the first device is in a state indicating that it is likely ready and / or desiring to make a connection to the second device).In some embodiments, a first device operating in a "strengthened" or "high power" second peer device advantaging protocol state can also cause a second device to enter a strengthened peer device advantaging state (block 216), and vice versa, i.e., any device that is part of the formed connection can initiate another device to enter a strengthened or higher power advantaging state, for example, if any required preconditions or criteria are met.

[0056] Next, at block 218, if the first device and the second device are able to successfully form a connection (i.e., if it is "yes" at block 218), the process flow 200 can proceed to 220 to establish a secure connection for data transfer, for example, via a secure wireless peer-to-peer connection protocol. Note that in some embodiments, the secure wireless peer-to-peer connection protocol can be a different protocol (and / or use different wireless devices) than the peer device advantaging protocol used for the devices to first locate each other. At block 222, the first device proceeds to capture one or more images (or other desired forms of A / V data, or non-A / V data), and at 224, can transmit the one or more captured images to the second device via the secure connection.

[0057] In some embodiments, the first device detects an interruption event (e.g., incoming call, text message, email, etc.) in the first device and, in response to such detection, suspends the transmission of images to the second device at 224 during the duration of the interruption event and, optionally, may resume the transmission of images after the detected interruption event ends. In other embodiments, for example, when the user needs to access the functionality of the first electronic device for some other reason, there may be a user interface option for the user to affirmatively indicate a desire to pause / interrupt the image sharing session. In still other embodiments, the first device receives image capture related parameters (e.g., focus parameters, zoom parameters, exposure parameters, etc.) from the second device and, in response to receiving such image capture related parameters, at 222, may be able to capture subsequent images using the first image capture device according to the received image capture related parameters.

[0058] In block 230, the second device can then proceed, as needed, to store, display, and / or transmit the received one or more images, etc. For example, if the second device is involved in (or managing) an active communication session with another device, the received one or more images can be seamlessly transmitted to another device as part of the communication session. Then, the reception of images can continue in the second device until an indication to end the connection session is received in the second device, for example, by the user affirmatively ending the session, selecting a different image capture device to function as the source of the images, ending the active communication session, removing the first device from a state where it meets a first set of device state criteria, etc.

[0059] Next, returning to block 218, if the first device and the second device cannot successfully form a connection (i.e., if it is "No" at block 218), the process flow 200 can proceed to 232, and the first device enters the third peer device advertising protocol state. As will be described in more detail with reference to FIG. 3 below, in some embodiments, the third peer device advertising protocol state includes an advertising state that uses a duty cycle and / or a time interval delay of broadcasting an advertising packet having a value that alternates between a "default" or "low power" first advertising state and an "enhanced" or "high power" second advertising state. When in the third peer device advertising protocol state, the first device can continue to monitor the change of the state of the first device at block 234. For example, if the first set of device state criteria are no longer met by the first device (i.e., "No" at block 236), the process flow 200 can return to 202, where the first device returns to the first peer device advertising protocol state. Alternatively, if the first set of device state criteria continue to be met by the first device (i.e., "Yes" at block 236), the first device can continue to broadcast advertising packets in accordance with the third peer device advertising protocol state at 238. If there is a new successful connection between the first device and the second device (i.e., "Yes" at block 240), the first device returns to the circle labeled "A" in FIG. 2 and can re-establish a secure connection at 220. Alternatively, if there is no new successful connection between the first device and the second device (i.e., "No" at block 240), the first device returns to block 232, remains in the third peer device advertising protocol state, and can attempt to find a second device that will successfully make a connection.In some embodiments, there may be a maximum allowable time interval for which the first device can remain in the third peer device advertising protocol state, after which the first device may simply return to block 202 and the default or first peer device advertising protocol state.

[0060] Next, returning to 224, the first device is transmitting one or more captured images to the second device via a secure connection, and during this time, the first device can also continue to monitor for changes in the state of the first device at block 226. For example, if the first set of device state criteria are no longer being met by the first device (i.e., "no" at block 228), the process flow 200 can return to 202, where the first device disconnects from the second device and returns to the first peer device advertising protocol state. Alternatively, if the first set of device state criteria continue to be met by the first device (i.e., "yes" at block 228), the first device, at block 222, captures one or more images for transmission to the second device via the secure connection until, for example, an indication to end the connection session is received at the second device, until a different image capture device is selected to act as the source of images for the second device, until the active communication session in which the first device is capturing images ends, or until the first device is taken out of a state where it meets the first set of device state criteria.

[0061] Examples of Peer Device Advertising Protocol States

[0062] Next, referring to FIG. 3, examples 300 of various peer device advertising protocol states according to one or more embodiments are shown. In example 300, the first advertising protocol state (302) is a plurality of sequential advertising packets 306 transmitted at corresponding periodic time intervals 304 n and nIt includes. According to some embodiments, the peer device advertising protocol may include Bluetooth (R) (BT), Bluetooth (R) Low Energy (BLE), or any other suitable type of wireless peer device advertising protocol. (BLUETOOTH is a registered trademark of Bluetooth SIG, Inc.) The horizontal time axis (301) represents the passage of time from left to right across the page, and the advertising interval between consecutive advertising packets becomes longer as any two advertising packets are farther apart. Thus, in one embodiment, the advertising protocol state may be represented with respect to the advertising interval between consecutive advertising packets.

[0063] Also, as shown in FIG. 3, each advertising packet 306 n takes a finite duration during which the device broadcasts the advertising packet. Thus, in a second embodiment, the advertising protocol state may be represented with respect to the duty cycle, i.e., the ratio of the time spent broadcasting the advertising packet over a given time interval. It should be understood that when a second device is within the broadcast range of a device that is advertising itself, the two devices may be paired (or otherwise connected) to each other, for example, in a wireless and peer-to-peer manner, according to an appropriate handshake / connection protocol. Also, while the first device is advertising itself, other devices can also advertise themselves, and each device can have a timing interval and / or duty cycle to check whether it wakes up or actively listens and advertises itself as if any nearby device is interested in making a connection.

[0064] The second advertising protocol state (312) is the corresponding periodic time interval 314 nMultiple sequential advertising packets being sent in 316 n As shown, in this example 300, time interval 314 n In the first advertising protocol state (302), the periodic time interval 304 n , which also results in a greater advertising duty cycle than experienced in the first advertising protocol state (302). As described above with reference to FIG. 2, in some embodiments, the exemplary second advertising protocol state (312) may be initiated by the first device after determining that the first set of device state criteria are satisfied by the first device. In some cases, the satisfied first set of device state criteria may indicate the fact that the first device is ready or expects to enter into a connection with the second device, and thus may decide to enter (at least temporarily) into the aforementioned second advertising protocol state, which may impose greater power and / or thermal requirements on the first device broadcasting its advertising packets. Thus, in some embodiments, the first device may remain in the second state for no more than a predetermined maximum time interval, such as 5 seconds, 10 seconds, 1 minute, etc.

[0065] The third advertising protocol state (322) has a corresponding periodic time interval 324 n Multiple sequential advertising packets being sent in 326 n As shown, in this example 300, the time interval, time interval 324 n is a periodic time interval 304 in a first advertising protocol state (302). n 3, but the periodic time interval 314 in the second advertising protocol state (312) is shorter than nlonger than and, as a result, has a larger advertising duty cycle than experienced in the first advertising protocol state (302), but a smaller advertising duty cycle than experienced in the second advertising protocol state (312). For example, in one implementation, time interval 304 n can be 60 ms, but time interval 314 n can be 10 ms, and time interval 324 n can be 30 ms.

[0066] As described above with reference to FIG. 2, in some embodiments, an exemplary second advertising protocol state (312) can be initiated by the first device after determining that a first set of device state criteria have been met by the first device, but that a connection to the second device has not been successful after spending a predetermined maximum time interval in the second state. In this way, when a second device that is ready to complete a peer-to-peer connection arrives in proximity to the first device, a certain amount of device power / thermal resources can be conserved while still allowing for a connection time faster than the default connection time. Also, as described above with reference to FIG. 2, in some embodiments, if the first device does not succeed in connecting to the second device after spending some second predetermined maximum time interval in the second state, the first device can return to the first advertising protocol state (302). Similarly, in some embodiments, if the first device no longer meets the first set of device state criteria, the first device can return to the first advertising protocol state (302).

[0067] An exemplary method for automatically establishing a secure connection between devices for streaming audio and video data

[0068] Figure 4A is a flowchart 400 showing a method for establishing a secure connection between electronic devices for streaming audio and video data according to various embodiments. First, at step 402, the method 400 can enter a first state of a peer device advertising protocol in a first electronic device, and the first electronic device includes a first image capture device (e.g., a camera) and a first position sensor (e.g., an accelerometer or a gyroscope). Next, at step 404, the method 400 can determine, in the first electronic device, a first orientation state of the first electronic device, where the first orientation state is detected based at least in part on information obtained from the first position sensor. The first orientation state obtained may include one or more of pitch, roll, or yaw of the first electronic device. In the case of roll and pitch, the orientation of the first electronic device can be represented with respect to an angular displacement (positive or negative) from the direction of the gravity vector.

[0069] Next, at step 406, in response to determining that the first electronic device meets a first set of device state criteria, the method 400 can cause the first electronic device to enter a second state of the peer device advertising protocol (e.g., having an enhanced or increased duty cycle compared to the first state), and determining that the first electronic device meets the first set of device state criteria includes determining that the first orientation state is within a threshold difference of a predetermined device activation orientation state. For example, if the predetermined device activation orientation state includes the first electronic device being placed in a completely horizontal landscape orientation, a threshold difference of ±5 degrees can be established such that whenever the first electronic device is within 5 degrees of the completely horizontal landscape orientation, the method 400 can determine that at least the orientation state criterion of the first set of device state criteria is met. (It should be understood that the first set of device state criteria can also include one or more other criteria not related to the orientation state, such as criteria related to the amount of movement, the device power state, etc.)

[0070] Next, in step 408, in response to detecting the presence of a second electronic device proximate to the first electronic device (i.e., via the peer device advertising protocol) while the first electronic device is in the second state of the peer device advertising protocol, method 400 may connect the first electronic device to the second electronic device via a secure wireless peer-to-peer connection protocol. In some implementations, upon successful connection establishment, a visual cue or an audible cue may be generated at either the first electronic device and / or the second electronic device. Upon connection establishment, in step 410, method 400 may cause the first electronic device to transmit, via the secure wireless peer-to-peer connection protocol, one or more images captured by a first image capture device of the first electronic device to the connected second electronic device, and the images may be displayed, stored, further manipulated, transmitted, etc. by the second electronic device. In some cases, the images captured by the first image capture device may contain a cropped portion of the FOV of the first image capture device, e.g., a face of a human or animal subject, a predetermined portion of the FOV of the first image capture device, or a document, table, or other flat surface within the captured scene, etc., particularly cropped portions for capturing purposes.

[0071] FIG. 4B is a flowchart 420 showing additional details for method 400 according to various embodiments. First, in step 422, which may be performed during the execution of step 404, method 420 may cause the first electronic device to remain in the first state of the peer device advertising protocol and not attempt to connect to any peer device via the secure wireless peer-to-peer connection protocol, in response to determining that the first electronic device does not meet a first set of device state criteria.

[0072] Figure 4C is a flowchart 430 showing additional details for method 400 according to various embodiments. First, in step 432 that may be executed during the execution of step 406, method 430 may cause the first electronic device to enter a third state of the peer device advertising protocol in response to detecting the absence of a second electronic device in proximity to the first electronic device while the first electronic device is in a second state of the peer device advertising protocol. In this embodiment, the third state of the peer device advertising protocol may have an advertising interval between advertising packets that is shorter than that of the first state of the peer device advertising protocol (434), but may have an advertising interval between advertising packets that is longer than that of the second state of the peer device advertising protocol (436). Next, in step 438, method 430 monitors for a change in the device state of the first electronic device and may continue to attempt to connect to any second electronic device in proximity to the first electronic device.

[0073] Figure 4D is a flowchart 440 showing additional details for method 400 according to various embodiments. First, in step 442 that may be executed during the execution of step 404, method 440 may disconnect the first electronic device from a second electronic device via a secure wireless peer-to-peer connection protocol in response to determining that the first electronic device no longer meets a first set of device state criteria, and then may return the operation flow to step 402.

[0074] Figure 4E is a flowchart 450 showing additional details for method 400 according to various embodiments. First, in step 452 which may be executed during the execution of step 410, method 450 may detect an interruption event in the first electronic device. Next, in step 454, method 450 may pause the transmission of an image from the first electronic device to the second electronic device during the interruption event. Examples of interruption events in the first electronic device that may cause the first electronic device to pause the transmission of an image to the second electronic device may include receiving an incoming call, message, notification, etc.

[0075] Figure 4F is a flowchart 460 showing additional details for method 400 according to various embodiments. First, in step 462 which may be executed during the execution of step 410, method 460 may receive image capture related parameters from the second electronic device in the first electronic device. Next, in step 464, method 460 may capture subsequent images using the first image capture device of the first electronic device according to the received image capture related parameters. Examples of image capture related parameters received in the first electronic device may include changes to the focus setting, zoom setting, exposure setting, white balance, etc. of the first image capture device in the first electronic device.

[0076] FIG. 5 is a flowchart 500 showing a method of "handing off" control of an active communication session (e.g., an audiovisual communication session) from a first electronic device to a second electronic device according to various embodiments. First, at step 502, the method 500 can receive an indication at the second electronic device (e.g., a media device such as a smart TV style device) that the first electronic device (e.g., a mobile device such as a cellular phone or a tablet) is providing one or more images captured by an image capture device of the first electronic device via an active communication session. In some embodiments, the first and second electronic devices are associated with the same user account. For example, in some implementations, the indication can include a broadcast invitation sent by the first electronic device to nearby devices associated with the same user or the same user account that there is an ongoing communication session that can be "handed off". In some embodiments, there is a trust relationship between the first electronic device and the second electronic device. In some implementations, the first electronic device and the second electronic device are paired. For example, in some implementations, the indication can include a broadcast invitation sent by the first electronic device to nearby devices (paired with the first electronic device) that there is an ongoing communication session that can be "handed off".

[0077] Next, in step 504, in response to the first electronic device identifying that it meets the first set of device state criteria, the second electronic device can: 1) participate in the active communication session on behalf of the first user, and 2) select the image capture device of the first electronic device as the image source for the second electronic device in the active communication session. When the second electronic device participates in the active communication session on behalf of the first user, all management and control of the session (e.g., when to start the session, when to end the session, whether to add a new party to the session, whether to use filters or other visual effects on the images provided in the session, whether to switch the image capture device used to capture the images of the session, etc.) can be effectively transferred to the second electronic device without ending the user's participation in the communication session during the handoff operation.

[0078] Next, in step 506, the second electronic device can receive one or more images captured by the image capture device of the first electronic device. Finally, in step 508, the second electronic device can provide the one or more images received from the first electronic device to the active communication session. It should be understood that the received images may be locally displayed, stored, etc. in the second electronic device as needed. Also, the second electronic device can switch between various image capture devices to function as an image source for the active communication session from among various image capture devices that can be integrated into the first electronic device, various image capture devices that can be integrated into (or directly connected to) the second electronic device, or other devices associated with the user that have an image capture device, are located in proximity to the second electronic device, and can form an appropriate connection with the second electronic device.

[0079] FIG. 6 is a flowchart 600 showing a method of pushing an active communication session (e.g., an audio-visual communication session) from a first electronic device to a second electronic device according to various embodiments. First, at step 602, the method 600 can receive an indication that the second electronic device (e.g., a media device such as a smart TV-style device) is requesting the first electronic device (e.g., a mobile device such as a cellular phone or tablet) to participate in an active communication session. In some embodiments, there is a trust relationship between the first electronic device and the second electronic device. In some implementations, the first electronic device and the second electronic device are paired. For example, in some implementations, the indication can include a broadcast invitation sent by the first electronic device to nearby devices (paired with the first electronic device). In some embodiments, the first and second electronic devices are associated with the same user account. For example, in some implementations, the indication may include a broadcast invitation sent by the first electronic device to nearby devices associated with the same user or the same user account.

[0080] Next, in step 604, in response to the first electronic device identifying that it meets the first set of device state criteria, the second electronic device can: 1) participate in an active communication session, and 2) in the active communication session, select the image capture device of the first electronic device as the image source of the second electronic device. In some embodiments, when the second electronic device participates in an active communication session, one or more operations for the management and control of the session (e.g., when to start the session, when to end the session, whether to add a new party to the session, whether to use filters or other visual effects on the images provided in the session, whether to switch the image capture device used to capture the images of the session, etc.) can be effectively transferred to the second electronic device. In some embodiments, when the second electronic device participates in an active communication session, the first electronic device maintains control of the orchestration of the communication session, such that if the first electronic device leaves the communication session, the second electronic device also leaves the communication session.

[0081] In some embodiments, when the second electronic device participates in an active communication session, it constructs a temporary video stream before receiving the video stream from the first electronic device.

[0082] Next, in step 606, the second electronic device can receive one or more images captured by the image capture device of the first electronic device. Finally, in step 608, the second electronic device can provide the one or more images received from the first electronic device to the active communication session (e.g., as a video stream). In some embodiments, if the second electronic device creates a temporary video stream, in step 608, the second electronic device replaces the temporary video stream with the video stream provided by the first electronic device. It should be understood that the received images may be locally displayed, stored, etc. in the second electronic device as needed. Also, the second electronic device can switch between various image capture devices to function as an image source for the active communication session from among various image capture devices that can be integrated into the first electronic device, various image capture devices that can be integrated into (or directly connected to) the second electronic device, or other devices associated with a user that have an image capture device, are located proximate to the second electronic device, and can form an appropriate connection with the second electronic device.

[0083] As can be understood, for example, with reference to FIGS. 4 - 6, the various methods described herein may be performed by an electronic device by being initiated, for example, by an application (or "app") running on the device and / or the device's native operating system (OS). For example, an app running on the device can initiate or perform all of the steps in the method, or at least a portion of the steps in the method, while calling the device's OS to perform other steps in the method. Similarly, the device's OS can receive an API call from an app or other source and process / perform the call to cause the device to execute the method.

[0084] Exemplary Electronic Computing Device

[0085] Referring now to FIG. 7, there is shown a simplified functional block diagram of an exemplary programmable electronic computing device 700, according to one embodiment. The electronic device 700 can be, for example, a mobile phone, a personal media device, a portable camera, or a tablet, notebook or desktop computer system. As shown, the electronic device 700 includes a processor 705, a display 710, a user interface 715, graphic hardware 720, device sensors 725 (e.g., proximity sensor / ambient light sensor, accelerometer, inertial measurement unit, and / or gyroscope), a microphone 730, an audio codec 735, a speaker 740, a communication circuit 745, an image capture device 750 that can include, for example, a plurality of camera units / optical image sensors with different features or capabilities (e.g., still image stabilization (SIS), HDR, OIS system, optical zoom, digital zoom, etc.), a video codec 755, a memory 760, a storage device 765, and a communication bus 770.

[0086] Processor 705 can execute the instructions necessary to perform or control the operation of a number of functions executed by electronic device 700 (e.g., generation, processing, and / or streaming of image and video data according to various embodiments described herein). Processor 705 can, for example, drive display 710 and receive user input from user interface 715. User interface 715 can take various forms such as buttons, keypads, dials, click wheels, keyboards, display screens, and / or touchscreens. User interface 715 can be, for example, a conduit through which a user can view a video stream that the user has captured and / or can indicate a particular image frame that the user wishes to capture (e.g., by clicking a physical or virtual button at the moment the desired image frame is displayed on the device's display screen). In one embodiment, display 710 can display a video stream when processor 705 and / or graphic hardware 720 and / or image capture circuitry are capturing the video stream while simultaneously generating and storing the video stream in memory 760 and / or storage device 765. Processor 705 can be, for example, a system-on-chip (SOC) such as found in a mobile device and can include one or more dedicated graphic processing units (GPUs). Processor 705 can be based on a reduced instruction-set computer (RISC) or complex instruction-set computer (CISC) architecture, or any other suitable architecture, and can include one or more processing cores. Graphic hardware 720 can be dedicated computing hardware for processing graphics and / or for assisting processor 705 in performing arithmetic tasks.In one embodiment, the graphic hardware 720 can include one or more programmable graphics processing units (GPUs) and / or one or more special SOCs, such as Apple's Neural Engine processing cores, that are specially designed to implement neural networks and machine learning operations (convolutions) in a more energy-efficient manner than either the main device's central processing unit (CPU) or a typical GPU.

[0087] The image capture device 750 can include one or more camera units configured to capture an image, such as an image that can be processed to generate a framed and / or distortion-corrected version of the captured image, according to the present disclosure. The image capture device 750 may include two (or more) lens assemblies 780A and 780B, each lens assembly may have a different focal length. For example, the lens assembly 780A may have a shorter focal length than the focal length of the lens assembly 780B. Each lens assembly may have a separate associated sensor element, such as sensor elements 790A / 790B. Alternatively, two or more lens assemblies may share a common sensor element. The image capture device 750 can capture still images and / or video images. The output from the image capture device 750 can be processed, at least in part, by the video codec 755 and / or the processor 705 and / or the graphic hardware 720, and / or a dedicated image processing unit or image signal processor incorporated within the image capture device 750. Images captured in this way can be stored in the memory 760 and / or the storage device 765.

[0088] Memory 760 can include one or more different types of media used by processor 705, graphic hardware 720, and image capture device 750 to execute the functions of the device. For example, memory 760 can include a memory cache, read-only memory (ROM), and / or random access memory (RAM). Storage device 765 can store media (such as audio files, image files, and video files), computer program instructions or software, preference information, device profile information, and other appropriate data. Storage device 765 can include one or more persistent storage media, such as (fixed, floppy, and removable) magnetic disks and tapes, optical media such as CD-ROMs and digital video disks (DVDs), and semiconductor memory devices such as electrically programmable read-only memory (EPROM) and electrically erasable programmable read-only memory (EEPROM). Memory 760 and storage device 765 can be used to hold computer program instructions or code organized into one or more modules and written in any desired computer programming language. For example, when executed by processor 705, such computer program code can execute one or more of the methods or processes described herein. Power supply 775 can include a rechargeable battery (such as a lithium ion battery) or a power supply, such as other electrical connections to a main power supply, used to manage and / or provide power to the electronic components and associated circuits of electronic device 700.

[0089] It should also be understood that the above description is illustrative only and not restrictive. For example, the above-described embodiments can be used in combination with each other. Many other embodiments will be apparent to those skilled in the art upon consideration of the above description. Accordingly, the scope of the present invention should be determined with reference to the appended claims and also in light of the full scope of equivalents given to such claims.

Claims

1. A method comprising: In a first electronic device, the first electronic device including a first image capture device and a first position sensor, entering a first state of a peer device advertising protocol; In the first electronic device, determining a first orientation state of the first electronic device, the first orientation state being detected based at least in part on information obtained from the first position sensor; Responsive to determining that the first electronic device meets a first set of device state criteria, the first electronic device entering a second state of the peer device advertising protocol, where determining that the first electronic device meets the first set of device state criteria includes determining that the first orientation state is within a threshold difference of a predetermined device activation orientation state; While in the second state of the peer device advertising protocol, detecting the presence of a second electronic device proximate to the first electronic device and connecting the first electronic device to the second electronic device via a secure wireless peer-to-peer connection protocol; Transmitting, by the first electronic device, one or more images captured by the first image capture device to the connected second electronic device via the secure wireless peer-to-peer connection protocol; A method comprising the above.

2. The method of claim 1, wherein the predetermined device activation orientation state includes at least one of a portrait orientation state or a landscape orientation state.

3. The method of claim 1, wherein the first set of device state criteria further includes determining that the first electronic device exhibits movement less than a threshold amount over a determined period.

4. The method according to claim 1, wherein the device state criteria of the first set further include determining that the first electronic device is in at least one of a standby state, a lock screen state, a screen off state, an active communication session, or an idle state.

5. The method according to claim 1, wherein the device state criteria of the first set further include that the first image capture device is oriented in a preferred direction with respect to the second electronic device.

6. The method according to claim 1, wherein the second state of the peer device advertising protocol has an advertising interval between advertising packets that is shorter than the first state of the peer device advertising protocol.

7. In response to determining that the first electronic device does not meet the device state criteria of the first set, in the first electronic device, remain in the first state of the peer device advertising protocol and do not attempt to connect to any peer device via the secure wireless peer-to-peer connection protocol. The method according to claim 1.

8. In response to not detecting the presence of a second electronic device in proximity to the first electronic device while in the second state of the peer device advertising protocol, the first electronic device enters a third state of the peer device advertising protocol. The third state of the peer device advertising protocol has an advertising interval between advertising packets that is shorter than the first state of the peer device advertising protocol. The method according to claim 1, wherein the third state of the peer device advertising protocol has an advertising interval between advertising packets that is longer than the second state of the peer device advertising protocol.

9. The method according to claim 1, wherein in response to the first electronic device determining that the first set of device state criteria is no longer satisfied, the second electronic device disconnects the first electronic device via the secure wireless peer-to-peer connection protocol.

10. The method according to claim 1, wherein the first set of device state criteria is learned individually for the first electronic device.

11. The method according to claim 1, wherein the secure wireless peer-to-peer connection protocol is a protocol different from the peer device advantaging protocol.

12. The method according to claim 1, wherein the first electronic device and the second electronic device are associated with the same user or the same user account.

13. The method according to claim 1, wherein the first electronic device and the second electronic device are required to be located within a threshold distance of each other during the transmission of the one or more images.

14. Detecting an interruption event in the first electronic device; Temporarily suspending the transmission of the image to the second electronic device during the interruption event; The method according to claim 1, further comprising.

15. Receiving, in the first electronic device, image capture related parameters from the second electronic device; Capturing subsequent images using the first image capture device according to the received image capture related parameters; The method according to claim 1, further comprising.

16. An electronic device, A memory, A first image capture device, A first position sensor, and one or more processors operably coupled to the memory, the one or more processors causing the one or more processors to enter the electronic device into a first state of a peer device advertising protocol, determine a first orientation state of the electronic device, the first orientation state being detected at least in part based on information obtained from the first position sensor, in response to determining that the electronic device meets a first set of device state criteria, where determining that the electronic device meets the first set of device state criteria includes determining that the first orientation state is within a threshold difference of a predetermined device activation orientation state, cause the electronic device to enter a second state of the peer device advertising protocol, while in the second state of the peer device advertising protocol, in response to detecting the presence of a second electronic device in proximity to the electronic device, connect the electronic device to the second electronic device via a secure wireless peer-to-peer connection protocol, and cause one or more images captured by the first image capture device to be transmitted to the connected second electronic device via the secure wireless peer-to-peer connection protocol. An electronic device configured to execute instructions.

17. The electronic device according to claim 16, wherein the second state of the peer device advertising protocol has an advertising interval between advertising packets that is shorter than the first state of the peer device advertising protocol.

18. while in the second state of the peer device advertising protocol, in response to not detecting the presence of a second electronic device in proximity to the electronic device, cause the one or more processors to Execute an instruction to cause the electronic device to enter a third state of the peer device advertising protocol, The third state of the peer device advertising protocol has an advertising interval between advertising packets that is shorter than the advertising interval in the first state of the peer device advertising protocol, The third state of the peer device advertising protocol has an advertising interval between advertising packets that is longer than the advertising interval in the second state of the peer device advertising protocol. The electronic device according to claim 16. **Claim 19** A non-transitory computer-readable medium including computer-readable instructions, the computer-readable instructions being executed by one or more processors, In a first electronic device, the first electronic device includes a first image capture device and a first position sensor. Enter a first state of the peer device advertising protocol in the first electronic device, In the first electronic device, determine a first orientation state of the first electronic device, the first orientation state being detected based at least in part on information obtained from the first position sensor, In response to determining that the first electronic device meets a first set of device state criteria, the determination that the first electronic device meets the first set of device state criteria includes determining that the first orientation state is within a threshold difference of a predetermined device activation orientation state. Enter a second state of the peer device advertising protocol in the first electronic device, While in the second state of the peer device advertising protocol, in response to detecting the presence of a second electronic device in proximity to the first electronic device, connect the first electronic device to the second electronic device via a secure wireless peer-to-peer connection protocol, A non-transitory computer-readable medium executable by the first electronic device to transmit one or more images captured by the first image capture device to the connected second electronic device via the secure wireless peer-to-peer connection protocol. Claim 20 The non-transitory computer-readable medium according to claim 19, wherein the secure wireless peer-to-peer connection protocol is a protocol different from the peer device advertising protocol. Claim 21 A method comprising: Receiving, at a second electronic device associated with a first user, an indication that a first electronic device associated with the first user is providing one or more images captured by an image capture device of the first electronic device via an active communication session; In response to identifying the first electronic device as meeting a first set of device state criteria, 1) participating, at the second electronic device, in the active communication session on behalf of the first user; and 2) selecting, in the active communication session, the image capture device of the first electronic device as an image source for the second electronic device; Receiving, at the second electronic device, one or more images captured by the image capture device of the first electronic device; Providing, from the second electronic device, the one or more images received from the first electronic device to the active communication session. A method comprising the above steps. Claim 22 A method comprising: The method according to claim 21, further comprising displaying, at the second electronic device, the one or more images received from the first electronic device. Claim 23 Identifying the first electronic device as meeting a first set of device state criteria is The method of claim 21, further comprising, in the second electronic device, entering a peer device advantaging protocol state. **Claim 24** The method of claim 23, wherein the peer device advantaging protocol state includes at least one of a default advantaging state, an enhanced advantaging state, or a low power advantaging state. **Claim 25** Identifying the first electronic device as meeting a first set of device state criteria is The method of claim 23, further comprising detecting the presence of the first electronic device via the peer device advantaging protocol. **Claim 26** Identifying the first electronic device as meeting a first set of device state criteria is The method of claim 21, further comprising, in the second electronic device, detecting that the first electronic device is proximate to the second electronic device and is oriented in a first orientation state within a threshold difference of a predetermined device activation orientation state. **Claim 27** Identifying the first electronic device as meeting a first set of device state criteria is The method of claim 21, further comprising, in the second electronic device, detecting that the first electronic device is proximate to the second electronic device and that an image capture device of the first electronic device is oriented in a favorable direction with respect to the second electronic device. **Claim 28** The method of claim 21, wherein the second electronic device is configured to participate in the active communication session on behalf of the first user without user input. **Claim 29** The method according to claim 21, wherein the second electronic device is configured to participate in the active communication session on behalf of the first user in response to a user input.

30. The method according to claim 21, wherein the one or more received images captured by the image capture device of the first electronic device are received via a secure wireless peer-to-peer connection protocol.

31. Transmitting, by the second electronic device, the one or more images received from the first electronic device to a third electronic device, The method according to claim 21, further comprising.

32. A method comprising: Receiving, at a second electronic device, an indication that a first electronic device is requesting the second electronic device to participate in an active communication session; In response to identifying the first electronic device as meeting a first set of device state criteria, 1) participating, at the second electronic device, in the active communication session; and 2) selecting, at the second electronic device, an image capture device of the first electronic device as an image source for the second electronic device in the active communication session; Receiving, at the second electronic device, one or more images captured by the image capture device of the first electronic device; Providing, from the second electronic device, the one or more images received from the first electronic device to the active communication session; A method comprising.

33. Displaying, at the second electronic device, the one or more images received from the first electronic device; The method according to claim 32, further comprising.

34. Identifying the first electronic device as meeting a first set of device state criteria, The method of claim 32, further comprising, in the second electronic device, entering a peer device advantaging protocol state. **Claim 35** The method of claim 32, wherein the second electronic device is configured to participate in the active communication session on behalf of the first user in response to a user input. **Claim 36** The method of claim 32, wherein the one or more received images captured by the image capture device of the first electronic device are received via a secure wireless peer-to-peer connection protocol. **Claim 37** Transmitting, by the second electronic device, the one or more images received from the first electronic device to a third electronic device, The method of claim 32, further comprising. **Claim 38** A non-transitory computer-readable medium including computer-readable instructions that, by one or more processors, In a second electronic device, receive an indication that a first electronic device is requesting the second electronic device to participate in an active communication session, In response to identifying the first electronic device as meeting a first set of device state criteria: 1) in the second electronic device, participate in the active communication session; 2) in the active communication session, select the image capture device of the first electronic device as an image source for the second electronic device; In the second electronic device, receive one or more images captured by the image capture device of the first electronic device; A non-transitory computer-readable medium executable to provide, from the second electronic device, the one or more images received from the first electronic device to the active communication session. **Claim 39** Further comprising computer-readable instructions executable by one or more processors to cause the second electronic device to display the one or more images received from the first electronic device, the non-transitory computer-readable medium of claim 38. **Claim 40** The computer-readable instructions executable by one or more processors to identify the first electronic device as meeting a first set of device state criteria further comprises computer-readable instructions executable by one or more processors to cause the second electronic device to enter a peer device advertising protocol state, the non-transitory computer-readable medium of claim 38.

Images