A framework for automatically establishing secure connections for streaming audio and video data between devices based on device status criteria.

Abstract

An electronic device, a device, a method, and a non-transitory program storage device for enabling automatic establishment of a secure audio / video data streaming connection are disclosed. For example, a first electronic device can enter a first state of a peer device advertising protocol, and then, based on a determination that the first electronic device meets a first set of device state criteria (e.g., including at least an orientation state criterion), the first electronic device can enter a second (e.g., enhanced) state of the peer device advertising protocol. In response to detecting the presence of a second electronic device in proximity thereto, the first electronic device connects to the second electronic device via a secure peer-to-peer connection protocol, and then can transmit one or more images captured by a first image capture device of the first electronic device to the second electronic device connected via a secure wireless peer-to-peer connection protocol.

Description

[Technical Field]

[0001] This disclosure relates, in general terms, to the field of audio and video data streaming. More specifically, and not limited to, this disclosure relates to technologies for automatically establishing secure connections between user devices for streaming audio and video data. [Background technology]

[0002] The emergence of portable integrated computing devices has led to the widespread use of cameras and other video-capable devices. These integrated computing devices generally take the form of smartphones, tablets, or laptop computers and typically include a general-purpose computer, a camera, a high-performance user interface including a touch-sensitive screen, and wireless communication capabilities via Wi-Fi, Bluetooth, LTE, HSDPA, New Radio (NR), and other cellular-based or wireless technologies. The widespread adoption of these integrated devices provides opportunities to use the device's capabilities to perform tasks that would otherwise require dedicated hardware and software.

[0003] For example, portable integrated computing devices such as smartphones, tablets, and laptops typically have two or more built-in cameras. These cameras generally correspond to lens / camera hardware modules that can be controlled through the use of a general-purpose computer with a user interface that includes firmware and / or software (e.g., "apps") as well as touchless controls such as touchscreen buttons, fixed buttons, and / or voice control. The integration of high-quality cameras into these portable integrated communication devices, such as smartphones, tablets, and laptop computers, has enabled users to capture and share images and videos in ways that were previously impossible. Today, it is common for users' smartphones to be their primary image capture device.

[0004] With the rising popularity of photo and video sharing via portable integrated computing devices with integrated cameras, video conferencing via such devices is also on the rise. In particular, users often engage in video conference calls or meetings, and the video image is typically captured by a forward-facing camera on the device, i.e., a camera facing the same direction as the display screen of the camera device. Most conventional cameras are optimized for either wide-angle general photography or narrow-angle photography, e.g., self-portraits and video conferencing streaming use cases. These cameras optimized for wide-angle are typically optimized for group and landscape compositions, but are not optimal for individual portraits due to distortion that occurs, for example, when the subject is short distance from the camera or at the edge of the camera's field of view.

[0005] As used herein, “field of view” or “FOV” refers to the angular range of a given scene captured by a camera. FOV is typically measured in degrees and may be expressed as vertical FOV, horizontal FOV, and / or diagonal FOV. The diagonal FOV of an image sensor is often referred to herein as a more appropriate measure of the camera’s optics because it attempts to cover the corners of the image, and “roll-off,” or vignetting, can be more pronounced in problems related to pixels at the corners of the image sensor. For reference, a typical 35mm camera with a lens having a focal length of 50mm has a horizontal FOV of 39.6°, a vertical FOV of 27.0°, and a diagonal FOV of 46.8°.

[0006] Cameras optimized for portraits and video conferencing streaming (e.g., "forward-facing" cameras) are typically not ideal for landscapes and group photos (or group video conference calls) due to their limited field of view. Furthermore, a given camera's field of view can also affect how the user constructs the shot (i.e., how far away and at what angle the user positions themselves relative to the device's camera) and the quality of the final captured image. In addition, some devices that may be most comfortable or appropriate for a user during long video conference calls, such as desktop or laptop computers with standalone monitors, may either lack an integrated camera or have a low-quality integrated webcam.

[0007] Therefore, in order to provide users with greater flexibility in image capture sources and the ability to leverage higher-quality image capture devices during video conferencing sessions (for example, via a camera integrated into one of the user's portable communication devices), it is desirable to have methods and systems that provide such users with the ability to seamlessly and automatically create secure connections between their electronic devices at a contextually appropriate time, for example, to enable direct streaming of audio and / or video image data captured by a first electronic device to a second electronic device for subsequent presentation, storage, or further transmission by the second electronic device. [Overview of the project]

[0008] Disclosed herein are devices, methods, and non-temporary program storage devices (NPSDs) for enabling the automatic establishment of secure audio / video data streaming connections between electronic devices, for example, electronic devices associated with the same user or the same user account. For example, a first electronic device comprising at least a first image capture device and a first position sensor may enter a first state of a peer device advertising protocol and then determine a first orientation state of the first electronic device, at least in part, based on information obtained from the first position sensor. Depending on the determination that the first electronic device satisfies a first set of device state criteria, the first electronic device may enter a second state of the peer device advertising protocol (e.g., an "enhanced" or "high-power" advertising state), where the determination that the first electronic device satisfies a first set of device state criteria includes determining that the first orientation state is within a threshold difference of a predetermined device activation orientation state (e.g., the device activation orientation states may include a portrait state, a landscape state, etc.).

[0009] While in the second state of the peer device advertising protocol, upon detecting the presence of a second electronic device adjacent to the first electronic device, the first electronic device may connect to the second electronic device via a secure wireless peer-to-peer connection protocol, and then the first electronic device may transmit one or more images captured by the first image capture device to the connected second electronic device via the secure wireless peer-to-peer connection protocol (for example, the secure wireless peer-to-peer connection protocol may be a different protocol from the peer device advertising protocol used to initially establish the connection between the devices).

[0010] In some embodiments, an interruption event may be detected in the first electronic device, during which the transmission of image and / or video data to the second electronic device may be temporarily suspended. In other embodiments, the first electronic device may receive image capture-related parameters from the second electronic device and then use the first image capture device to capture subsequent images according to the received image capture-related parameters.

[0011] In other embodiments, the first set of device state criteria may further include determining that the first electronic device has shown movement below a threshold amount over a determined period of time, determining that the first electronic device is in at least one of the following states: standby, locked screen, screen off, active communication session, or idle, and / or determining that the first image capture device is oriented in a favorable direction relative to the second electronic device.

[0012] In some other embodiments, the “enhanced” second state of the peer device advertising protocol may have a higher duty cycle and / or shorter advertising intervals between advertising packets than the first state of the peer device advertising protocol.

[0013] In yet another embodiment, if the first electronic device determines that it does not meet the device state criteria of the first set, the first electronic device may remain in the first state of the peer device advertising protocol and may not attempt to connect to any peer device via the secure wireless peer-to-peer connection protocol.

[0014] In yet another embodiment, if the first electronic device does not detect the presence of a second electronic device adjacent to it while in a second state of the peer device advertising protocol, the first electronic device may enter a third state of the peer device advertising protocol, the third state of the peer device advertising protocol having a shorter advertising interval than the first state of the peer device advertising protocol, but a longer advertising interval between advertising packets than the second state of the peer device advertising protocol.

[0015] In yet another embodiment, if the first electronic device determines that it no longer meets the first set of device state criteria, the first electronic device may disconnect from the second electronic device via a secure wireless peer-to-peer connection protocol.

[0016] The techniques disclosed herein may also be used to perform a “handoff” method for a communication session, such as an active audiovisual (A / V) communication session, i.e., a method for handing off control of a communication session from a first electronic device associated with a user to a second electronic device associated with a user. According to some embodiments, the method may include, in a second electronic device associated with a first user, receiving an indication that the first electronic device associated with the first user is providing one or more images captured by the image capture device of the first electronic device via an active communication session, and then, in response to identifying that the first electronic device satisfies a first set of device state criteria, 1) the second electronic device joining the active communication session on behalf of the first user (e.g., automatically joining the session or joining in response to acknowledgment user input), and 2) in the active communication session, selecting the image capture device of the first electronic device as the image source for the second electronic device. When the management of the communication session is handed off to a second electronic device, the second electronic device may begin receiving one or more images captured by the image capture device of the first electronic device (for example, via a secure wireless peer-to-peer connection protocol), and then provide one or more images received from the first electronic device to the active communication session. In some embodiments, the second electronic device may also display and / or store one or more images received from the first electronic device, and / or transmit one or more images to a third electronic device.

[0017] In some embodiments, identifying a first electronic device as satisfying a first set of device state criteria may further include, in the second electronic device, entering a peer device advertising protocol state, the peer device advertising protocol state may include at least one of a default advertising state, an enhanced advertising state, or a low-power advertising state. In yet another embodiment, identifying a first electronic device as satisfying a first set of device state criteria may further include, in the second electronic device, detecting that the first electronic device is in proximity to the second electronic device and is oriented to a first orientation state within a predetermined threshold difference of device activation orientation states. In a further embodiment, identifying the first electronic device as satisfying a first set of device state criteria further includes detecting in the second electronic device that the first electronic device is in proximity to the second electronic device and that the image capture device of the first electronic device is oriented in a favorable direction relative to the second electronic device.

[0018] Further embodiments disclose a method which, in a second electronic device, receives an indication that a first electronic device is requesting the second electronic device to join an active communication session, and in response to the first electronic device being identified as satisfying a first set of device state criteria, the method includes: 1) the second electronic device joining an active communication session; 2) the first electronic device's image capture device being selected as the second electronic device's image source in the active communication session; the second electronic device receiving one or more images captured by the first electronic device's image capture device; and the second electronic device providing one or more images received from the first electronic device to the active communication session. In some such embodiments, the method may further include the second electronic device displaying one or more images received from the first electronic device. In other such embodiments, identifying the first electronic device as satisfying a first set of device state criteria further includes the second electronic device entering a peer device advertising protocol state. In yet another such embodiment, the second electronic device may be configured to participate in an active communication session on behalf of the first user in response to user input. In yet another such embodiment, one or more received images captured by the image capture device of the first electronic device are received via a secure wireless peer-to-peer connection protocol. In yet another such embodiment, the method may further include the second electronic device transmitting one or more images received from the first electronic device to a third electronic device.

[0019] Embodiments of various non - transient program storage devices are also disclosed herein. Such NPSDs are readable by one or more processors. Instructions can be stored in the NPSD to cause one or more processors to implement any of the embodiments disclosed herein. Various image processing and secure device connection methods according to the embodiments disclosed herein are also disclosed herein.

Brief Description of the Drawings

[0020] [Figure 1] An exemplary electronic device configuration for attempting to establish a secure connection between electronic devices for streaming audio and video data according to one or more embodiments is shown.

[0021] [Figure 2] An exemplary process flow diagram for establishing a secure connection between electronic devices for streaming audio and video data according to one or more embodiments is shown.

[0022] [Figure 3] An exemplary peer device advertising protocol state according to one or more embodiments is shown.

[0023] [Figure 4A] A flowchart showing various methods for establishing a secure connection between electronic devices for streaming audio and video data according to various embodiments. [Figure 4B] A flowchart showing various methods for establishing a secure connection between electronic devices for streaming audio and video data according to various embodiments. [Figure 4C] A flowchart showing various methods for establishing a secure connection between electronic devices for streaming audio and video data according to various embodiments. [Figure 4D]This flowchart shows various methods for establishing secure connections between electronic devices for streaming audio and video data, according to various embodiments. [Figure 4E] This flowchart shows various methods for establishing secure connections between electronic devices for streaming audio and video data, according to various embodiments. [Figure 4F] This flowchart shows various methods for establishing secure connections between electronic devices for streaming audio and video data, according to various embodiments.

[0024] [Figure 5] This flowchart shows a method for handing off control of an active audio-visual (A / V) communication session from a first electronic device to a second electronic device, according to various embodiments.

[0025] [Figure 6] This flowchart shows various embodiments of a method for pushing an active AV communication session from a first electronic device to a second electronic device.

[0026] [Figure 7] This is a block diagram showing a programmable electronic computing device in which one or more of the technologies disclosed herein may be implemented. [Modes for carrying out the invention]

[0027] The following description includes many specific details for illustrative purposes to enhance understanding of the invention disclosed herein. However, it will be apparent to those skilled in the art that the invention can be practiced without these specific details. Where else, structures and devices are shown in block diagram form to avoid obscuring the invention. References of numbers without subscripts or suffixes are understood to refer to all cases of corresponding subscripts and suffixes. Furthermore, the language used in this disclosure has been selected primarily for readability and explanatory purposes, and not to delineate or limit the gist of the invention, and it may be necessary to rely on the claims to determine such gist of the invention. Wherever “one embodiment” or “one embodiment” (or similar) is used herein, it means that a particular feature, structure or characteristic described in relation to an embodiment is included in at least one embodiment of the invention, and whereever “one embodiment” or “one embodiment” is used multiple times, it should not be understood that all of them refer to the same embodiment.

[0028] An exemplary device setup for attempting to establish a secure connection between user electronic devices.

[0029] Referring next to Figure 1, an exemplary electronic device configuration 100 for attempting to establish a secure connection between electronic devices for streaming audio and video data is shown according to one or more embodiments. Referring first to Scenario A (100A), a first device (104A) and a second device (102) are in close proximity to each other and attempt to form a secure connection. As used herein, the term “in close proximity” may refer to devices that are within discoverable distance of each other for a given wireless connection protocol. According to some implementations, measured signal strength may be used as a proxy to estimate the distance between two devices and determine whether they are within a sufficiently close range to each other. In some such implementations, the threshold signal strength required to determine that two devices are in sufficiently close proximity to each other may not be a fixed threshold and may also be based on filtering (e.g., averaging) of signal strength values ​​over time across many signal strength samples. In some embodiments, the first device 104A may comprise one or more image capture devices 105, and the second device 102 may also comprise one or more image capture devices 106. In some cases, the image capture device 105 of the first device may be of higher quality than the image capture device 106 of the second device, for example, with respect to resolution, zoom, FOV, spatial resolution, focus, color quality, or any other imaging parameters. In such cases, it may be more desirable to use the image capture device 105 of the first device rather than the image capture device 106 of the second device to capture images that are used, displayed, stored, transmitted, etc., by the second device (102) as part of an active communication session.In other cases, the user of the second device (102) may simply want to select the image capture device of the first device (104A) to provide a different (and / or additional) view of the scene surrounding the second device (104A), for any number of other reasons, such as the second device (102) not having its own image capture device, the image capture device of the second device (102) not functioning properly, or the image capture device of the first device (102) having special image capture functions or modes desired by the user of the second device (e.g., "portrait" or shallow depth of field (SDOF) photography mode by composite, "night" capture mode, "slow motion" video capture mode, etc.).

[0030] According to some embodiments disclosed herein, a first device must satisfy a first set of device state criteria before establishing a connection with a second device. In some such embodiments, the first set of device state criteria may comprise one or more of the following: 1) orientation state criteria, 2) device motion criteria, 3) device activity criteria, 4) active communication session criteria, 5) orientation criteria, 6) proximity criteria, 7) user account criteria, and / or any number of other criteria that may be desired to define the overall state of the first device in which the first device would be permitted to attempt to establish a secure connection with the second device.

[0031] 1. Orientation and State Criteria

[0032] For example, in some embodiments, the orientation state criterion may include the requirement that the first device is within a threshold difference of a given device activation orientation state. In some cases, the device activation orientation state may be a full “sideways” (i.e., horizontal) or “vertical” (i.e., vertical) orientation state, i.e., a rotation of 0 degrees with respect to a measured horizontal (or vertical) axis, and the allowable threshold difference may be ±5 degrees, for example, as measured by an internal position sensor (e.g., an accelerometer) of the first device. In such cases, the first device may be considered to satisfy the orientation state criterion whenever it is oriented within ±5 degrees of a full sideways (or possibly vertical) orientation. The examples of full sideways or vertical orientation are merely examples of device activation orientation states that may be defined in a given implementation, and it should be understood that any suitable and determinable device activation orientation state may be defined for a given implementation. In yet another embodiment, the device activation orientation state may also include a specific gesture (e.g., shaking a phone back and forth a predetermined number of times) indicating that the user intends to establish a secure connection between the first electronic device and another device adjacent to it. In yet another embodiment, for example, if the second electronic device has an integrated image capture device in which the user is already within the FOV, the user performing a specific gesture (e.g., a "waving" or "pointing" gesture, which is captured and interpreted by the second electronic device or measured by another electronic device, e.g., a wearable device) may also be used as an indication that the user intends to establish a secure connection between the second electronic device and the first electronic device in close proximity to it. In some implementations, additional device sensors may also be used to confirm or improve the understanding of the device orientation state.For example, signals acquired from an ambient light sensor (ALS) and / or luminance sensor incorporated into a device may be used as a secondary queue to prevent false positive connections between devices in a scenario where the device may accidentally be in a device activation orientation (e.g., fully "sideways") while it is in a user's pocket or backpack, which is likely to be indicated by such an ALS and / or luminance sensor reporting that it is lower than a predetermined threshold ambient luminance level required to establish a secure device connection.

[0033] As shown in Scenario A (100A), the first device (104A) appears completely sideways. Therefore, assuming an implementation where sideways is the defined device activation orientation state, the first device (104A) will satisfy its particular device state criterion. However, additional device state criteria can also be defined, as will be described in more detail below, and the first device must satisfy these additional device state criteria before it is eligible to attempt to establish the secure connection described herein with the second device (102).

[0034] 2. Device motion criteria

[0035] In other embodiments, the device motion criterion may include determining that the first device has exhibited motion below a threshold amount over a determined period. Such a device motion criterion may be used, for example, when it is desired that the first device be mounted or otherwise held stationary for a determined period before it is eligible to establish a secure connection with the second device (102).

[0036] 3. Device Activity Criteria

[0037] In yet another embodiment, the device activity criterion may include determining that the first electronic device is in at least one of the following states: standby, locked screen, screen off, or idle. Such a device activity criterion may be used, for example, when it is desired that the first device is not being actively used by the user for any other function (e.g., reading email, browsing the internet, etc.) before it is eligible to establish a secure connection with the second device (102).

[0038] 4. Active Communication Session Criteria

[0039] In yet another embodiment, the active communication session criterion may include determining that a first device is involved in an active communication session, for example, an active audio / visual communication session which may include the transmission of one or more images to another device. Such an active communication session criterion may be used, for example, when it is desirable that the first device be able to broadcast its eligibility to attempt to establish a secure connection with a second device when it is actively capturing images and / or audio that are contributing to part of an active communication session. In such a situation, the user may want to have control of the active communication session transferred to the second device while continuing to use the image capture device of the first device to capture one or more images being transmitted as part of the active communication session.

[0040] 5.Direction reference

[0041] In yet another embodiment, the device orientation criterion may include determining that the first electronic device is oriented in a particular direction relative to the second device (102) before it is eligible to attempt to establish a secure connection with the second device (102). For example, even if the first device satisfies an orientation state criterion (e.g., is perfectly horizontal), an additional device orientation criterion may be established, such as that the "front" (or "back," depending on the convention used) of the first device is also oriented in the same direction as the display of the second device before it is eligible to attempt to establish a secure connection with the second device (102). In some implementations, this may be due to the fact that, during a secure connection with the second device, it is known (or indicated by the user) that only the use of the "back" image capture device of the first device is of interest. Therefore, as long as the "back" of the first device is not facing the user, there is no need to automatically attempt to establish a secure connection with the second device.

[0042] 6. Proximity Criteria

[0043] In yet another embodiment, the device proximity criterion may include determining whether the first device is within a threshold distance (e.g., within 2 feet, 1 meter, 6 feet, etc.) of the second device. Such a device criterion may be used, for example, when it is desirable that only the first device is eligible to attempt to establish a secure connection with the second device (102) if the first device is located in close proximity to the second device (102). For example, as shown in Figure 1, there are exemplary boundaries 108 drawn in each of scenarios A, B, and C, which are defined as a spherical region (with a radius 110) from the center of the second device (102). It should be understood that the spherical example is merely illustrative, and the device proximity criterion can be specified in any desired way with respect to, for example, a fixed or dynamic signal intensity value measured from a signal emitted from the other device, raw distance, line of sight, the required successful type of mechanical or magnetic connection between the first device and the second device, etc. As can be understood here, in scenarios A, B, and C of Figure 1, the first device (104) must be within the exemplary boundary 108 so that it meets the proximity criterion and is eligible to attempt to establish a secure connection with the second device (102).

[0044] 7. User Account Criteria

[0045] In yet another embodiment, user account criteria may be defined such that, for example, the first device (104) and the second device (102) must be associated with the same user or the same user account in order to be eligible to attempt to establish a secure connection between them. Such user account criteria may be used, for example, when it is desirable that the first device not attempt to inadvertently connect to a second device that is near another user, thereby protecting the privacy of the user of the first device and preventing the first device from appearing on any other user's device as an eligible device to establish a secure connection.

[0046] In some embodiments, rather than being explicitly specified by the user (or in addition to that), a first set of device state criteria may be learned over time, individually or customized for a given user and / or a given first device. For example, if a particular user consistently attempts to establish a connection between their first device and a second device when the first device is in a particular state (e.g., mounted on a retaining clamp, the screen of the first device is locked, within six inches of the second device, and between 5:00 p.m. and 5:05 p.m.), the device may begin to learn (e.g., using machine learning techniques) and / or customize (e.g., using explicit user approval or confirmation) a particular set of device state criteria that should be performed before attempting to establish a secure connection with the second device. In this way, the device state criteria may be aligned with the device states most frequently observed (or explicitly defined by the user) when establishing a secure connection with the second device.

[0047] Returning to scenario A(100A), the first device (104A) is within the threshold difference of a given device activation orientation state (e.g., fully lateral in this example). However, the first device (104A) is not within the threshold distance of the second device (102) (e.g., within the exemplary boundary 108 in this example). Assuming in this example that the aforementioned horizontal device activation orientation criterion and the boundary 108 proximity criterion are the only criteria defined in the first set of device state criteria, the first device (104A) is not qualified to establish a connection with the second device (102), as indicated by the symbol (107A), and this reflects the fact that no connection has been established between the first device (104A) and the second device (102).

[0048] Referring now to scenario B(100B), the first device (104B) and the second device (102) are again in close proximity to each other and attempt to form a secure connection. However, in scenario B(100B), the first device (104A) is oriented vertically and therefore not within the threshold difference of a given device activation orientation state (e.g., perfectly horizontal in this example), but the first device (104A) is within the threshold distance of the second device (102) (i.e., within the exemplary boundary 108). Again, assuming in this example that the aforementioned horizontal device activation orientation criterion and the boundary 108 proximity criterion are the only criteria defined in the first set of device state criteria, the first device (104B) is again ineligible to establish a connection with the second device (102), as indicated by symbol 107B, reflecting that no connection has been established between the first device (104B) and the second device (102).

[0049] Referring now to scenario C(100C), the first device (104C) and the second device (102) are again in close proximity to each other and attempt to form a secure connection. In scenario C(100C), the first device (104C) is lateral and therefore within a threshold difference of a given device activation orientation state (e.g., perfectly lateral in this example), and the first device (104C) is also within a threshold distance of the second device (102) (i.e., within the exemplary boundary 108). Again, assuming in this example that the aforementioned horizontal device activation orientation criterion and boundary 108 proximity criterion are the only criteria defined in the first set of device state criteria, the first device (104C) is qualified to establish a connection with the second device (102), as indicated by symbol 107C, reflecting the success of the secure wireless connection established between the first device (104C) and the second device (102).

[0050] An exemplary image 109 represents an image captured by an image capture device (105) of a first device (104C) and then transmitted to a second device (102) via a secure connection 107C, the image which may then be stored, displayed, and / or transmitted to another third device, etc. In some embodiments, the first device (104C) may automatically attempt to establish a connection to the second device (102), i.e., if the connection is successful, depending on whether a first set of device state criteria is met, the first device (104C) may be automatically selected for use by the second device (102) (or appear in the list of available image capture device sources in the second device 102 for manual user selection). In some embodiments, the first device 104C can seamlessly appear along any other image capture source available for selection in the second device 102, such as an internal image capture device of the second device 102 (e.g., image capture device 106), an image capture device directly connected to the second device 102 (e.g., via a USB port), etc.

[0051] In some implementations, if the first electronic device has not connected to a second electronic device of a particular user according to the secure connection technology described herein after a predetermined period of time (e.g., 30 days, 60 days, 1 year, etc.), the use of the device state-based detection and secure connection framework described herein may be disabled, for example, until it is positively reactivated by the user.

[0052] Exemplary process flow diagram for establishing secure connections between electronic devices

[0053] Referring next to Figure 2, an exemplary process flow diagram 200 for establishing a secure connection between electronic devices for streaming audio and video data according to one or more embodiments is shown. Starting from block 202, the first device (104) can enter a first peer device advertising protocol state. As will be described in more detail with reference to Figure 3 below, in some embodiments the first peer device advertising protocol state may include a “default” or “low power” advertising state configured to have a minimum advertising duty cycle and / or a maximum time interval delay between broadcasts of advertising packets.

[0054] Next, in 206, the first device broadcasts advertising packets to any adjacent devices, for example, according to the parameters of the first peer device advertising protocol state. As shown in Figure 2, a second device (102) may be adjacent to the first device and may be operating in its own default peer device advertising state (block 204), which may or may not be the same as the first peer device advertising protocol state in which the first device is operating.

[0055] Next, in block 208, the first device determines a first device state for itself (which may include at least an orientation state component in some embodiments). In block 210, if the first set of device state criteria are not met (i.e., "no" in block 210), the first device may return to block 202 and remain in the "default" or "low power" first peer device advertising protocol state. Alternatively, in block 210, if it is determined that the first set of device state criteria are met by the first device (i.e., "yes" in block 210), the first device may proceed to block 212 and enter a second peer device advertising protocol state. In 214, the first device broadcasts advertising packets to any nearby devices, for example, according to the parameters of the second peer device advertising protocol state. As will be illustrated in more detail with reference to Figure 3 below, in some embodiments, the second peer device advertising protocol state may include an "enhanced" or "high-power" advertising state configured to have a maximum allowable advertising duty cycle and / or a minimum allowable time interval delay between broadcasts of advertising packets. In some such embodiments, the second peer device advertising protocol state may be configured to facilitate a faster connection between the first and second devices, since it is determined that the first device currently satisfies a first set of device state criteria (e.g., a state indicating that the first device is likely ready and / or willing to make a connection to the second device).In some embodiments, a first device operating in a second peer device advertising protocol state of "enhanced" or "high power" can also cause the second device to enter the enhanced peer device advertising state (block 216), and vice versa; that is, any device that is part of a formed connection can initiate another device to enter an enhanced or higher power advertising state, for example, if any necessary preconditions or criteria are met.

[0056] Next, in block 218, if the first and second devices are able to successfully form a connection (i.e., the answer is "yes" in block 218), the process flow 200 can proceed to 220 to establish a secure connection for data transfer, for example, via a secure wireless peer-to-peer connection protocol. Note that in some embodiments, the secure wireless peer-to-peer connection protocol may be a different protocol (and / or use different wireless devices) from the peer device advertising protocol used to initially locate the devices. In block 222, the first device can proceed to capture one or more images (or other desired forms of A / V data, or non-A / V data), and in 224, one or more captured images can be transmitted to the second device via the secure connection.

[0057] In some embodiments, the first device may detect an interruption event on the first device (e.g., an incoming phone call, text message, email, etc.) and, in response to such detection, may temporarily suspend the transmission of images to the second device at 224 for the duration of the interruption event and optionally resume the transmission of images after the detected interruption event has ended. In other embodiments, for example, if the user needs to access the functionality of the first electronic device for any other reason, there may be a user interface option for the user to affirmatively indicate a desire to pause / interrupt the image sharing session. In yet another embodiment, the first device may receive image capture-related parameters (e.g., focus parameters, zoom parameters, exposure parameters, etc.) from the second device and, in response to receiving such image capture-related parameters, may, at 222, capture subsequent images using the first image capture device according to the received image capture-related parameters.

[0058] In block 230, the second device can then, as necessary, proceed to store, display, and / or transmit one or more received images. For example, if the second device is involved in (or managing) an active communication session with another device, one or more received images may be seamlessly transmitted to the other device as part of the communication session. The reception of images may then continue on the second device until an indication to terminate the connection session is received on the second device, such as when the user positively terminates the session, selects a different image capture device to act as the source of the images, terminates the active communication session, or removes the first device from a state that satisfies a first set of device state criteria.

[0059] Returning to block 218, if the first and second devices are unable to successfully form a connection (i.e., if the answer is "No" in block 218), the process flow 200 can proceed to 232, where the first device enters a third peer device advertising protocol state. As will be described in more detail with reference to Figure 3 below, in some embodiments, the third peer device advertising protocol state may include an advertising state that uses a duty cycle and / or time interval delay for broadcasting advertising packets, with a value that falls between a first advertising state of "default" or "low power" and a second advertising state of "enhanced" or "high power". Once in the third peer device advertising protocol state, the first device can continue to monitor changes in the state of the first device in block 234. For example, if the first set of device state criteria is no longer met by the first device (i.e., "No" in block 236), process flow 200 may return to 202, where the first device returns to the first peer device advertising protocol state. Alternatively, if the first set of device state criteria remains met by the first device (i.e., "Yes" in block 236), the first device may continue broadcasting advertising packets in 238 according to the third peer device advertising protocol state. If there is a new successful connection between the first device and the second device (i.e., "Yes" in block 240), the first device may return to the circle labeled "A" in Figure 2 and re-establish the secure connection in 220. Alternatively, if there is no new successful connection between the first and second devices (i.e., "No" in block 240), the first device returns to block 232 and remains in the third peer device advertising protocol state, which may attempt to find a second device to establish a successful connection.In some embodiments, there may be a maximum allowable time interval during which the first device can remain in the third peer device advertising protocol state, after which the first device may simply return to block 202 and the default or first peer device advertising protocol state.

[0060] Next, returning to 224, the first device is sending one or more captured images to the second device via a secure connection, and during this time, the first device may also continue to monitor changes in the state of the first device in block 226. For example, if the first set of device state criteria are no longer met by the first device (i.e., "No" in block 228), the process flow 200 may return to 202, where the first device disconnects from the second device and returns to the first peer device advertising protocol state. Alternatively, if the first set of device state criteria remains met by the first device (i.e., "yes" in block 228), the first device may continue to capture one or more images for transmission over a secure connection to the second device until, for example, an indication to terminate the connection session is received by the second device, until a different image capture device is selected to act as the image source for the second device, until an active communication session in which the first device is capturing images is terminated, or until the first device is removed from a state that satisfies the first set of device state criteria.

[0061] Example of peer device advertising protocol state

[0062] Next, referring to Figure 3, an example 300 of various peer device advertising protocol states according to one or more embodiments is shown. In Example 300, the first advertising protocol state (302) corresponds to the periodic time interval 304 n Multiple sequential advertising packets 306 are being transmitted. nThis includes, according to some embodiments, the peer device advertising protocol may include Bluetooth® (BT), Bluetooth® Low Energy (BLE), or any other suitable type of wireless peer device advertising protocol. (BLUETOOTH is a registered trademark of Bluetooth SIG, Inc.) The horizontal time axis (301) represents the passage of time from left to right across the page, and the further apart any two advertising packets are, the longer the advertising interval between consecutive advertising packets. Thus, in one embodiment, the advertising protocol state may be expressed in terms of the advertising interval between consecutive advertising packets.

[0063] Furthermore, as shown in Figure 3, each advertising packet 306 n This takes a finite duration for which a device broadcasts advertising packets. Thus, in a second embodiment, the advertising protocol state can be expressed in terms of a duty cycle, i.e., the percentage of time spent broadcasting advertising packets over a given time interval. It should be understood that if a second device is within the broadcast range of a device advertising itself, the two devices may be able to pair (or otherwise connect) with each other, for example, wirelessly and peer-to-peer, according to an appropriate handshake / connection protocol. It should also be understood that while the first device is advertising itself, other devices may also advertise themselves, and each device may have a timing interval and / or duty cycle to see if it can “wake up” or actively listen to see if any nearby device is interested in advertising itself as being interested in making a connection.

[0064] The second advertising protocol state (312) corresponds to the periodic time interval 314 nA plurality of sequential advertising packets 316 being transmitted n is included. As shown, in this example 300, the time interval 314 n is shorter than the periodic time interval 304 in the first advertising protocol state (302), and also results in an advertising duty cycle that is greater than that experienced in the first advertising protocol state (302). As described above with reference to FIG. 2, in some embodiments, an exemplary second advertising protocol state (312) may be initiated by a first device after determining that a first set of device state criteria has been met by the first device. In some cases, the first set of device state criteria that are met may indicate that the first device is ready or expecting to enter a connection with a second device, and thus may decide to (at least temporarily) enter the aforementioned second advertising protocol state, which may impose greater power and / or thermal requirements on the first device that broadcasts that advertising packet. For this reason, in some embodiments, the first device can stay in the second state for a period of time less than a predetermined maximum time interval, such as 5 seconds, 10 seconds, 1 minute, etc.

[0065] The third advertising protocol state (322) includes a plurality of sequential advertising packets 326 being transmitted at a corresponding periodic time interval 324 n As shown, in this example 300, the time interval, time interval 324 n is shorter than the periodic time interval 304 in the first advertising protocol state (302), but longer than the periodic time interval 314 in the second advertising protocol state (312). n is shorter than the periodic time interval 304 in the first advertising protocol state (302), n but longer than the periodic time interval 314 in the second advertising protocol state (312). n ​​This is longer than the advertising duty cycle experienced in the first advertising protocol state (302), but shorter than the advertising duty cycle experienced in the second advertising protocol state (312). For example, in one implementation, the time interval 304 n It could be 60ms, but the time interval is 314 n This could be 10ms, and the time interval is 324 n This could be 30ms.

[0066] As described above with reference to Figure 2, in some embodiments, an exemplary second advertising protocol state (312) may be initiated by the first device after it has determined that it has not succeeded in connecting to the second device after spending a predetermined maximum time interval in the second state, although the first set of device state criteria has been met by the first device. In this way, when a second device that is ready to complete a peer-to-peer connection arrives near the first device, a certain amount of device power / thermal resources can be saved while still allowing a faster connection time than the default connection time. Also, as described above with reference to Figure 2, in some embodiments, if the first device fails to successfully connect to the second device after spending some second predetermined maximum time interval in the second state, the first device may return to the first advertising protocol state (302). Similarly, in some embodiments, if the first device no longer meets the first set of device state criteria, the first device may return to the first advertising protocol state (302).

[0067] An exemplary method for automatically establishing a secure connection between devices for streaming audio and video data.

[0068] Figure 4A is a flowchart 400 illustrating a method for establishing a secure connection between electronic devices for streaming audio and video data according to various embodiments. First, in step 402, method 400 may enter a first state of a peer device advertising protocol in a first electronic device, the first electronic device comprising a first image capture device (e.g., a camera) and a first position sensor (e.g., an accelerometer or gyrometer). Next, in step 404, method 400 may determine a first orientation state of the first electronic device, the first orientation state being detected at least in part based on information obtained from the first position sensor. The obtained first orientation state may include one or more of the pitch, roll, or yaw of the first electronic device. In the case of roll and pitch, the orientation of the first electronic device may be expressed in terms of angular displacement (positive or negative) from the direction of the gravity vector.

[0069] Next, depending on whether step 406 determines that the first electronic device satisfies the first set of device state criteria, method 400 may cause the first electronic device to enter a second state of the peer device advertising protocol (e.g., having an enhanced or increased duty cycle compared to the first state), and determining that the first electronic device satisfies the first set of device state criteria includes determining that the first orientation state is within a threshold difference of a predetermined device activation orientation state. For example, if a predetermined device activation orientation state includes the first electronic device being positioned in a perfectly horizontal transverse orientation, a threshold difference of ±5 degrees may be established so that method 400 can determine that at least the orientation state criterion of the first set of device state criteria is satisfied whenever the first electronic device is within 5 degrees of a perfectly horizontal transverse orientation. (It should be understood that the first set of device state criteria may also include one or more other criteria not related to orientation state, such as criteria related to the amount of motion, device power state, etc.)

[0070] Next, in step 408, in response to detecting the presence of a second electronic device adjacent to the first electronic device (i.e., via the peer device advertising protocol) while the first electronic device is in a second state of the peer device advertising protocol, method 400 may cause the first electronic device to connect to the second electronic device via a secure wireless peer-to-peer connection protocol. In some implementations, once a successful connection is established, visual cues or audible cues may be generated in either the first electronic device and / or the second electronic device. Once the connection is established, in step 410, method 400 may cause the first electronic device to transmit one or more images captured by the first image capture device of the first electronic device to the connected second electronic device via the secure wireless peer-to-peer connection protocol, the images of which may be displayed, stored, further manipulated, transmitted, etc., by the second electronic device. In some cases, the image captured by the first image capture device may include a portion of the field of view (FOV) of the first image capture device, such as a face of a human or animal, a predetermined portion of the FOV of the first image capture device, or a portion specifically cropped to capture a document, table, or other flat surface within the captured scene.

[0071] Figure 4B is a flowchart 420 illustrating additional details for Method 400 in various embodiments. First, in step 422, which may be performed during the execution of step 404, Method 420 may, in response to determining that the first electronic device does not meet a first set of device state criteria, allow the first electronic device to remain in the first state of the peer device advertising protocol and not attempt to connect to any peer device via the secure wireless peer-to-peer connection protocol.

[0072] Figure 4C is a flowchart 430 illustrating additional details for Method 400 according to various embodiments. First, in step 432, which may be performed during the execution of step 406, Method 430 may cause the first electronic device to enter a third state of the peer device advertising protocol, depending on the fact that it does not detect the presence of a second electronic device adjacent to the first electronic device while the first electronic device is in a second state of the peer device advertising protocol. In this embodiment, the third state of the peer device advertising protocol may have advertising intervals between advertising packets that are shorter than those of the first state of the peer device advertising protocol (434), but longer than those of the second state of the peer device advertising protocol (436). Next, in step 438, Method 430 may monitor changes in the device state of the first electronic device and continue to attempt to connect to any second electronic device adjacent to the first electronic device.

[0073] Figure 4D is a flowchart 440 illustrating additional details for Method 400 in various embodiments. First, in step 442, which may be performed during the execution of step 404, Method 440 may, in response to determining that the first electronic device no longer meets the first set of device state criteria, disconnect the first electronic device from the second electronic device via a secure wireless peer-to-peer connection protocol, and then return the operation flow to step 402.

[0074] Figure 4E is a flowchart 450 illustrating additional details to Method 400 according to various embodiments. First, in step 452, which may be performed during the execution of step 410, Method 450 may detect an interruption event in the first electronic device. Next, in step 454, Method 450 may pause the transmission of images from the first electronic device to the second electronic device during the interruption event. Examples of interruption events in the first electronic device that cause the first electronic device to pause the transmission of images to the second electronic device may include receiving an incoming call, message, notification, etc.

[0075] Figure 4F is a flowchart 460 illustrating additional details of Method 400 according to various embodiments. First, in step 462, which may be performed during the execution of step 410, Method 460 may receive image capture-related parameters from the second electronic device in the first electronic device. Next, in step 464, Method 460 may capture subsequent images using the first image capture device of the first electronic device according to the received image capture-related parameters. Examples of image capture-related parameters received in the first electronic device may include changes to the focus setting, zoom setting, exposure setting, white balance, etc., of the first image capture device in the first electronic device.

[0076] Figure 5 is a flowchart 500 illustrating a method for “handing off” control of an active communication session (e.g., an audiovisual communication session) from a first electronic device to a second electronic device, according to various embodiments. First, in step 502, the method 500 can receive an indication on the second electronic device (e.g., a media device such as a smart TV-style device) that the first electronic device (e.g., a mobile device such as a cellular phone or tablet) is providing one or more images captured by the image capture device of the first electronic device via an active communication session. In some embodiments, the first and second electronic devices are associated with the same user account. For example, in some implementations, the indication may include a broadcast invitation sent by the first electronic device to a nearby device associated with the same user or the same user account, indicating that there is an ongoing communication session that can be “handed off.” In some embodiments, a trust relationship exists between the first and second electronic devices. In some implementations, the first and second electronic devices are paired. For example, in some implementations, the indication may include a broadcast invitation sent by a first electronic device to a nearby device (paired with the first electronic device) indicating that there is an ongoing communication session that can be "handed off".

[0077] Next, in step 504, depending on whether the first electronic device has identified that it meets the first set of device state criteria, the second electronic device may 1) join an active communication session on behalf of the first user, and 2) select the first electronic device's image capture device as the image source for the second electronic device in the active communication session. When the second electronic device joins an active communication session on behalf of the first user, all management and control over the session (e.g., when to start the session, when to end the session, when to add a new party to the session, when to use filters or other visual effects on the images provided to the session, when to switch the image capture device used to capture images of the session, etc.) can be effectively transferred to the second electronic device without terminating the user's participation in the communication session during the handoff operation.

[0078] Next, in step 506, the second electronic device can receive one or more images captured by the image capture device of the first electronic device. Finally, in step 508, the second electronic device can provide one or more images received from the first electronic device to the active communication session. It should be understood that the received images may be displayed, stored, etc., locally on the second electronic device as needed. It should also be understood that the second electronic device may switch between various image capture devices to function as an image source for the active communication session, for example, various image capture devices that can be integrated into the first electronic device, various image capture devices that can be integrated into (or directly connected to) the second electronic device, or other devices associated with a user that have an image capture device and are located in close proximity to the second electronic device (and can form an appropriate connection with the second electronic device).

[0079] Figure 6 is a flowchart 600 illustrating a method for pushing an active communication session (e.g., an audiovisual communication session) from a first electronic device to a second electronic device according to various embodiments. First, in step 602, the method 600 may receive an indication on the second electronic device (e.g., a media device such as a smart TV-style device) that the first electronic device (e.g., a mobile device such as a cellular phone or tablet) is requesting the second electronic device to join an active communication session. In some embodiments, a trust relationship exists between the first and second electronic devices. In some implementations, the first and second electronic devices are paired. For example, in some implementations, the indication may comprise a broadcast invitation sent by the first electronic device to a nearby device (paired with the first electronic device). In some embodiments, the first and second electronic devices are associated with the same user account. For example, in some implementations, the indication may comprise a broadcast invitation sent by the first electronic device to a nearby device associated with the same user or the same user account.

[0080] Next, in step 604, depending on whether the first electronic device has identified that it satisfies the first set of device state criteria, the second electronic device may 1) join an active communication session, and 2) in the active communication session, select the image capture device of the first electronic device as the image source for the second electronic device. In some embodiments, when the second electronic device joins an active communication session, one or more actions for management and control of the session (e.g., when to start the session, when to end the session, when to add a new party to the session, when to use filters or other visual effects on the images provided to the session, when to switch the image capture device used to capture images of the session) may be effectively transferred to the second electronic device. In some embodiments, when the second electronic device joins an active communication session, the first electronic device maintains control of the orchestration of the communication session, so that if the first electronic device leaves the communication session, the second electronic device also leaves the communication session.

[0081] In some embodiments, when a second electronic device joins an active communication session, it constructs a temporary video stream before receiving a video stream from the first electronic device.

[0082] Next, in step 606, the second electronic device can receive one or more images captured by the image capture device of the first electronic device. Finally, in step 608, the second electronic device can provide the one or more images received from the first electronic device to the active communication session (for example, as a video stream). In some embodiments, if the second electronic device has created a temporary video stream, in step 608, the second electronic device replaces the video stream provided by the first electronic device with the temporary video stream. It should be understood that the received images may be displayed, stored, etc., locally on the second electronic device as needed. It should also be understood that the second electronic device may switch between various image capture devices to function as an image source for the active communication session, for example, various image capture devices that can be integrated into the first electronic device, various image capture devices that can be integrated into (or directly connected to) the second electronic device, or other devices associated with a user that have an image capture device and are located in close proximity to the second electronic device (and can form a suitable connection with the second electronic device).

[0083] To make it clear, for example, with reference to Figures 4-6, the various methods described herein may be performed by an electronic device, for example, by being initiated by an application (or “App”) running on the device and / or the device’s native operating system (OS). For example, an App running on a device may initiate or perform all or at least some of the steps in the Method, while calling the device’s OS to perform other steps in the Method. Similarly, the device’s OS may receive API calls from an App or elsewhere, process / execute those calls, and allow the device to perform the Method.

[0084] Exemplary electronic computing devices

[0085] Referring here to Figure 7, a simplified functional block diagram of an exemplary programmable electronic computing device 700 according to one embodiment is shown. The electronic device 700 may be, for example, a mobile phone, a personal media device, a portable camera, or a tablet, notebook, or desktop computer system. As shown, the electronic device 700 may include a processor 705, a display 710, a user interface 715, graphics hardware 720, device sensors 725 (e.g., proximity sensor / ambient light sensor, accelerometer, inertial measurement unit, and / or gyrometer), a microphone 730, an audio codec 735, a speaker 740, a communication circuit 745, an image capture device 750 (which may include, for example, multiple camera units / optical image sensors having different features or capabilities (e.g., still image stabilization (SIS), HDR, OIS system, optical zoom, digital zoom, etc.), a video codec 755, memory 760, storage device 765, and a communication bus 770.

[0086] The processor 705 can execute instructions necessary to perform or control the operation of numerous functions performed by the electronic device 700 (e.g., the generation, processing, and / or streaming of image and video data according to various embodiments described herein). The processor 705 can, for example, drive the display 710 and receive user input from the user interface 715. The user interface 715 can take various forms such as buttons, keypads, dials, click wheels, keyboards, display screens, and / or touchscreens. The user interface 715 can, for example, be a conduit through which the user can view a captured video stream and / or indicate a specific image frame that the user wants to capture (e.g., by clicking a physical or virtual button at the moment the desired image frame appears on the device's display screen). In one embodiment, the display 710 can display a video stream when the video stream is being captured while the processor 705 and / or graphics hardware 720 and / or image capture circuitry are simultaneously generating and storing the video stream in memory 760 and / or storage device 765. The processor 705 may be a system-on-a-chip (SOC), such as those found in mobile devices, and may include one or more dedicated graphics processing units (GPUs). The processor 705 may be based on a reduced instruction-set computer (RISC) or a complex instruction-set computer (CISC) architecture, or any other suitable architecture, and may include one or more processing cores. The graphics hardware 720 may be dedicated computing hardware for processing graphics and / or for assisting the processor 705 in performing computational tasks.In one embodiment, the graphics hardware 720 may include one or more programmable graphics processing units (GPUs) and / or one or more specialized SOCs, such as Apple's Neural Engine processing core, which are specially designed to perform neural network and machine learning operations (convolution) in a more energy-efficient manner than either the main device's central processing unit (CPU) or a typical GPU.

[0087] The image capture device 750 may comprise one or more camera units configured to capture images, which may be processed, for example, to produce framed and / or distortion-corrected versions of the captured images as described herein. The image capture device 750 may comprise two (or more) lens assemblies 780A and 780B, each having a distinct focal length. For example, lens assembly 780A may have a shorter focal length than lens assembly 780B. Each lens assembly may have a distinct associated sensor element, e.g., sensor element 790A / 790B. Alternatively, two or more lens assemblies may share a common sensor element. The image capture device 750 can capture still images and / or video images. The output from the image capture device 750 may be processed, at least in part, by a video codec 755 and / or processor 705 and / or graphics hardware 720, and / or a dedicated image processing unit or image signal processor incorporated within the image capture device 750. The captured images can be stored in memory 760 and / or storage device 765.

[0088] Memory 760 may include one or more different types of media used by the processor 705, graphics hardware 720, and image capture device 750 to perform the functions of the device. For example, memory 760 may include a memory cache, read-only memory (ROM), and / or random access memory (RAM). Storage device 765 may store media (e.g., audio files, image files, and video files), computer program instructions or software, preference information, device profile information, and other appropriate data. Storage device 765 may include one or more persistent storage media, including, for example, magnetic disks and tapes (fixed, floppy, and removable), optical media such as CD-ROMs and digital video discs (DVDs), and semiconductor memory devices such as electrically programmable read-only memory (EPROM) and electrically erasable programmable read-only memory (EEPROM). Memory 760 and storage device 765 may be organized into one or more modules and used to hold computer program instructions or code written in any desired computer programming language. For example, when executed by processor 705, such computer program code can perform one or more of the methods or processes described herein. Power supply 775 may include a rechargeable battery (e.g., a lithium-ion battery) or other electrical connection to a power supply, such as a mains power supply, used to manage and / or provide power to the electronic components and associated circuits of the electronic device 700.

[0089] It should be understood that the above description is illustrative and not limiting. For example, the embodiments described above can be used in combination with each other. A number of other embodiments will become apparent to those skilled in the art when considering the above description. Therefore, the scope of the present invention should be determined by referring to the appended claims and the entire scope of equivalents given to such claims.

Claims

1. It is a method, A first electronic device, the first electronic device including a first image capture device and a first position sensor, enters a first state of a peer device advertising protocol, which is configured to have the maximum advertising interval permissible between broadcasts of advertising packets. In the first electronic device, the first orientation state of the first electronic device is determined, which is detected at least partially based on information obtained from the first position sensor. The determination that the first electronic device satisfies the device state criteria of the first set, and the determination that the first electronic device satisfies the device state criteria of the first set includes the determination that the first orientation state is within a threshold difference of a predetermined device activation orientation state, and in response to the determination that the first electronic device satisfies the device state criteria of the first set, the first electronic device enters a second state of the peer device advertising protocol, which has an advertising interval between advertising packets that is shorter than that of the first state of the peer device advertising protocol, and is configured to have the minimum advertising interval allowed between broadcasts of advertising packets. While the peer device advertising protocol is in the second state, in response to detecting the presence of a second electronic device adjacent to the first electronic device, the first electronic device is connected to the second electronic device via a secure wireless peer-to-peer connection protocol. The first electronic device transmits one or more images captured by the first image capture device to the connected second electronic device via the secure wireless peer-to-peer connection protocol. Methods that include...

2. The method according to claim 1, wherein the predetermined device activation orientation state includes at least one of a vertical state or a horizontal state.

3. The method according to claim 1, further comprising determining that the first set of device state criteria has shown movement below a threshold amount over a determined period of time.

4. The method according to claim 1, further comprising determining that the first set of device state criteria is in at least one of the following states: standby state, lock screen state, screen off state, active communication session, or idle state.

5. The method according to claim 1, further comprising the device state criterion for the first set being that the first image capture device is oriented in a preferred direction with respect to the second electronic device.

6. The method according to claim 1, wherein, in response to determining that the first electronic device does not meet the device state criteria of the first set, the first electronic device remains in the first state of the peer device advertising protocol and does not attempt to connect to any peer device via the secure wireless peer-to-peer connection protocol.

7. In response to the fact that the presence of a second electronic device adjacent to the first electronic device was not detected while the peer device advertising protocol was in the second state, the first electronic device enters the third state of the peer device advertising protocol. The third state of the peer device advertising protocol has a shorter advertising interval between advertising packets than the first state of the peer device advertising protocol. The method according to claim 1, wherein the third state of the peer device advertising protocol has a longer advertising interval between advertising packets than the second state of the peer device advertising protocol.

8. The method according to claim 1, wherein, in response to determining that the first electronic device no longer meets the device state criteria of the first set, the first electronic device is disconnected from the second electronic device via the secure wireless peer-to-peer connection protocol.

9. The method according to claim 1, wherein the device state criteria for the first set are learned individually for the first electronic device.

10. The method according to claim 1, wherein the secure wireless peer-to-peer connection protocol is a protocol different from the peer device advertising protocol.

11. The method according to claim 1, wherein the first electronic device and the second electronic device are associated with the same user or the same user account.

12. The method according to claim 1, wherein the first electronic device and the second electronic device are required to be located within a threshold distance of each other during the transmission of one or more images.

13. The first electronic device detects an interruption event, During the interruption event, the transmission of the image to the second electronic device is temporarily suspended, The method according to claim 1, further comprising:

14. The first electronic device receives image capture-related parameters from the second electronic device, The process involves capturing subsequent images using the first image capture device according to the received image capture-related parameters, The method according to claim 1, further comprising:

15. It is an electronic device, Memory and A first image capture device and First position recovery and The memory comprises one or more processors operably coupled to the memory, and the one or more processors are configured to provide the one or more processors The electronic device is brought into a first state of the peer device advertising protocol, which is configured to have the maximum advertising interval permissible between broadcasts of advertising packets. The first orientation state of the electronic device is determined based at least partially on information acquired from the first position sensor. The determination that the electronic device satisfies the first set of device state criteria, and the determination that the electronic device satisfies the first set of device state criteria includes determining that the first orientation state is within a threshold difference of a predetermined device activation orientation state, and in response to the determination that the electronic device satisfies the first set of device state criteria, the electronic device is moved into a second state of the peer device advertising protocol, which has a shorter advertising interval between advertising packets than the first state of the peer device advertising protocol and is configured to have the minimum advertising interval allowed between broadcasts of advertising packets. While the peer device advertising protocol is in the second state, upon detecting the presence of a second electronic device adjacent to the electronic device, the electronic device is connected to the second electronic device via a secure wireless peer-to-peer connection protocol. An electronic device configured to execute commands to cause one or more images captured by the first image capture device to be transmitted to the connected second electronic device via the secure wireless peer-to-peer connection protocol.

16. In response to the failure to detect the presence of a second electronic device adjacent to the electronic device while the peer device advertising protocol is in the second state, one or more processors: An instruction is executed to cause the electronic device to enter the third state of the peer device advertising protocol. The third state of the peer device advertising protocol has a shorter advertising interval between advertising packets than the first state of the peer device advertising protocol. The electronic device according to claim 15, wherein the third state of the peer device advertising protocol has a longer advertising interval between advertising packets than the second state of the peer device advertising protocol.

17. A non-temporary computer-readable medium containing computer-readable instructions, wherein the computer-readable instructions are processed by one or more processors. A first electronic device, the first electronic device including a first image capture device and a first position sensor, enters a first state of a peer device advertising protocol, the first electronic device is configured to have the maximum advertising interval permissible between broadcasts of advertising packets, In the first electronic device, a first orientation state of the first electronic device is determined, the first orientation state is detected at least partially based on information acquired from the first position sensor, The determination that the first electronic device satisfies the device state criteria of the first set, and the determination that the first electronic device satisfies the device state criteria of the first set includes the determination that the first orientation state is within a threshold difference of a predetermined device activation orientation state, and in response to the determination that the first electronic device satisfies the device state criteria of the first set, the first electronic device enters a second state of the peer device advertising protocol, which has an advertising interval between advertising packets that is shorter than that of the first state of the peer device advertising protocol, and is configured to have the minimum advertising interval allowed between broadcasts of advertising packets. While the peer device advertising protocol is in the second state, in response to detecting the presence of a second electronic device adjacent to the first electronic device, the first electronic device is connected to the second electronic device via a secure wireless peer-to-peer connection protocol. A non-temporary computer-readable medium capable of transmitting one or more images captured by the first image capture device to the connected second electronic device via the secure wireless peer-to-peer connection protocol.

18. The non-temporary computer-readable medium according to claim 17, wherein the secure wireless peer-to-peer connection protocol is a protocol different from the peer device advertising protocol.

Images