Techniques for displaying content with live video feed

Abstract

The present disclosure generally relates to techniques for displaying content with a live video feed.

Description

Cross-reference to technology-related applications for displaying content with live video feeds

[0001] This application claims priority to U.S. Patent Application No. 18 / 895,940, filed September 25, 2024, entitled "TECHNIQUES FOR DISPLAYING CONTENTWITH A LIVE VIDEO FEED," and U.S. Provisional Patent Application No. 63 / 541,809, filed September 30, 2023, also entitled "TECHNIQUES FOR DISPLAYING CONTENTWITH A LIVE VIDEO FEED." The entire contents of each of these patent applications are incorporated herein by reference. Technical Field

[0002] This disclosure relates in general to techniques for displaying content with live video feeds. Background Technology

[0003] Platforms such as buildings and vehicles may include displays for showing content. Summary of the Invention

[0004] However, some technologies used to display content with live video feeds on electronic devices are often cumbersome and inefficient. For example, some existing technologies use complex and time-consuming user interfaces that may include multiple buttons or keystrokes. These technologies require more time than necessary, resulting in wasted user time and device power. This latter consideration is particularly important in battery-powered devices.

[0005] Therefore, this technology provides electronic devices with faster and more efficient methods and interfaces for displaying content with live video feeds. Such methods and interfaces optionally complement or replace other methods for displaying content with live video feeds. These methods and interfaces reduce the cognitive burden on the user and result in a more efficient human-machine interface. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charging sessions.

[0006] According to some embodiments, a method is described. The method includes: displaying a user interface via a display component located within an internal portion of a platform; detecting a request to display content; and in response to the detection of the display content request, via the display component: displaying the content in a first area of ​​the display component; and displaying a live video feed in a second area of ​​the display component, wherein the live video feed comprises video of the environment outside the platform captured by one or more cameras of the platform.

[0007] According to some embodiments, a non-transitory computer-readable storage medium is described. This non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system. The one or more programs include instructions for: displaying a user interface via a display component located within an internal portion of a platform; detecting a request to display content; and, in response to the detection of the display content request, via the display component: displaying the content in a first area of ​​the display component; and displaying a live video feed in a second area of ​​the display component, wherein the live video feed comprises video of the environment outside the platform captured by one or more cameras of the platform.

[0008] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system. The one or more programs include instructions for: displaying a user interface via a display component located within an internal portion of a platform; detecting a request to display content; and, in response to the detection of the request to display content, via the display component: displaying the content in a first area of ​​the display component; and displaying a live video feed in a second area of ​​the display component, wherein the live video feed comprises video of the environment outside the platform captured by one or more cameras of the platform.

[0009] According to some embodiments, a system is described. The system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: displaying a user interface via a display component located within an internal portion of a platform; detecting a request to display content; and, in response to the detection of the display content request, displaying the content in a first area of ​​the display component and displaying a live video feed in a second area of ​​the display component, wherein the live video feed includes video of the environment outside the platform captured by one or more cameras of the platform.

[0010] According to some embodiments, a system is described. The system includes: components for displaying a user interface via a display component located within an internal portion of a platform; components for detecting a request to display content; and components for: in response to the detected request to display content, via the display component: displaying content in a first area of ​​the display component; and displaying a live video feed in a second area of ​​the display component, wherein the live video feed includes video of the environment outside the platform captured by one or more cameras of the platform.

[0011] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a system. The one or more programs include instructions for: displaying a user interface via a display component located within an internal portion of the platform; detecting a request to display content; and, in response to the detection of the display content request, via the display component: displaying the content in a first area of ​​the display component; and displaying a live video feed in a second area of ​​the display component, wherein the live video feed includes video of the environment outside the platform captured by one or more cameras of the platform.

[0012] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0013] Therefore, devices are provided with faster and more efficient methods and interfaces for displaying content with live video feeds, thereby improving the effectiveness, efficiency, and user satisfaction of such devices. These methods and interfaces can complement or replace other methods for displaying content with live video feeds. Attached Figure Description

[0014] To better understand the various described embodiments, reference should be made to the following detailed description in conjunction with the accompanying drawings, in which similar reference numerals indicate corresponding parts throughout the drawings.

[0015] Figure 1 is a block diagram illustrating a system with various components according to some implementation schemes.

[0016] Figures 2A to 2M illustrate example techniques for displaying content with live video feeds according to some implementation schemes.

[0017] Figure 3 is a flowchart illustrating a method for displaying content with live video feeds according to some implementation schemes. Detailed Implementation

[0018] The following description illustrates exemplary techniques for displaying content with live video feeds. This description is not intended to limit the scope of this disclosure, but is provided as a description of specific example implementations.

[0019] Users require electronic devices with efficient technologies for displaying content with live video feeds. Efficient technologies can reduce the mental load on users when displaying content with live video feeds. This reduction in mental load can improve user productivity and make the device easier to use. In some implementations, the technologies described herein can reduce battery usage and processing time (e.g., by providing a user interface that requires less user input to operate).

[0020] Figure 1 provides an illustration of an exemplary device for performing techniques for displaying content with live video feeds. Figures 2A to 2M illustrate exemplary user interfaces for displaying content with live video feeds according to some embodiments. Figure 3 is a flowchart illustrating a method for displaying content with live video feeds according to some embodiments. The user interfaces in Figures 2A to 2M are used to illustrate the processes described below, including the processes in Figure 3.

[0021] The process described below describes various techniques for making user interfaces and / or human-computer interaction more efficient (e.g., by helping users provide input quickly and easily and preventing user errors when operating the device). These techniques sometimes reduce the number of inputs required for users (e.g., people and / or users) to perform actions, provide users with clear and / or meaningful feedback (e.g., visual, auditory, and / or tactile feedback), inform users of the current state and subsequent expectations, provide additional information and controls without cluttering the user interface, and / or perform certain actions without requiring further input from the user. Because users can use the device more quickly and easily, these techniques sometimes improve battery life and / or reduce the device's power consumption.

[0022] In a method where one or more steps depend on the satisfaction of one or more conditions, it should be understood that the described method can be repeated in multiple repetitions such that, during the repetitions, all conditions depending on the steps in the method have been satisfied in different repetitions of the method. For example, if the method requires performing a first step if a condition is satisfied, and a second step if a condition is not satisfied, it should be understood that the steps are repeated until both conditions are satisfied and not satisfied (in no particular order). Thus, a method described as having one or more steps depending on the satisfaction of one or more conditions can be rewritten as a method that repeats until each condition described in the method has been satisfied. However, system or computer-readable medium claims do not require such multiple repetitions, wherein the system or computer-readable medium contains instructions for performing conditional operations that require one or more conditions to be satisfied before the operation occurs. Those skilled in the art will also understand that, similar to a method having conditional steps, a system or computer-readable storage medium can repeat the steps of the method multiple times as needed to ensure that all conditional steps have been performed.

[0023] The terminology used in the description of the various implementation schemes is for the purpose of describing a particular implementation scheme only and is not intended to be limiting.

[0024] The following describes user interfaces for electronic devices and associated processes for using these devices. In some embodiments, the device is a desktop computer with a touch-sensitive surface (e.g., a touchscreen display and / or touchpad). In other embodiments, the device is a portable, mobile, and / or mobile electronic device (e.g., a processor, smartphone, smartwatch, tablet, fitness tracker, laptop, head-mounted display (HMD) device, public facilities, vehicles, media devices, smart speakers, smart displays, robots, televisions, and / or personal computing devices).

[0025] In some embodiments, the electronic device is a computer system that communicates with the display component (e.g., via wireless or wired communication). The display component may be integrated into the computer system or may be separate from the computer system. Additionally, the display component may be configured to provide visual output to a display (e.g., a liquid crystal display, an OLED display, or a CRT display). As used herein, "display" content includes content that is visually generated by sending data (e.g., image data or video data) to an integrated or external display component via a wired or wireless connection (e.g., video data rendered or decoded by a display controller). In some embodiments, visual output is any output that can be perceived by the human eye, including but not limited to images, videos, graphics, charts, and other graphical representations of data.

[0026] In some embodiments, the electronic device is a computer system that communicates with the audio generation component (e.g., via wireless or wired communication). The audio generation component may be integrated into the computer system or may be separate from the computer system. Additionally, the audio generation component may be configured to provide audio output. Examples of audio generation components include speakers, home theater systems, soundbars, headphones, in-ear headphones, earbuds, television speakers, augmented reality headset speakers, audio jacks, optical audio outputs, Bluetooth audio outputs, and / or HDMI audio outputs. In some embodiments, the audio output is any output that can be perceived by the human ear, including but not limited to sound waves, music, speech, and / or other audible representations of data.

[0027] In the following discussion, an electronic device including specific input and output devices is described. However, it should be understood that the electronic device may optionally include one or more other input and / or output devices, such as physical user interface devices (e.g., physical keyboard, mouse, and / or joystick).

[0028] Figure 1 illustrates an example system 100 for implementing the techniques described herein. System 100 can perform any of the methods described in Figure 3 (e.g., method 300) and / or portions of those methods.

[0029] In Figure 1, system 100 includes various components such as processor 103, RF circuitry 105, memory 107, sensors 156 (e.g., image sensors, orientation sensors, position sensors, heart rate monitors, temperature sensors), input components 158 (e.g., cameras (e.g., periscope cameras, telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras), depth sensors, microphones, touch-sensitive surfaces, hardware input mechanisms, and / or rotatable input mechanisms), mobility components (e.g., actuators (e.g., pneumatic actuators, hydraulic actuators, and / or electric actuators), motors, wheels, movable bases, rotatable components, translational components, and / or rotatable bases), and output components 160 (e.g., speakers, display components, audio generation components, haptic output devices, displays, projectors, and / or touch-sensitive displays). These components optionally communicate via the system's communication bus 123. Although shown as separate components, in some specific implementations, various components may be combined and used as a single component; for example, a sensor may be an input component.

[0030] In some implementations, system 100 is a mobile and / or mobile device (e.g., a tablet, smartphone, laptop, head-mounted display (HMD) device, and / or smartwatch). In other implementations, system 100 is a desktop computer, embedded computer, and / or server.

[0031] In some embodiments, processor 103 includes one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some embodiments, memory 107 is one or more non-transitory computer-readable storage media (e.g., flash memory and / or random access memory) storing computer-readable instructions configured to be executed by processor 103 to perform the techniques described herein.

[0032] In some embodiments, RF circuit 105 includes circuitry for communicating with electronic devices and / or networks (e.g., the Internet, intranets, and / or wireless networks such as cellular networks and wireless local area networks (LANs)). In some embodiments, RF circuit 105 includes circuitry for using near-field communication and / or short-range communication such as Bluetooth. ® Circuits for communication, or ultra-wideband communication.

[0033] In some embodiments, display 121 includes one or more monitors, projectors, and / or screens. In some embodiments, display 121 includes a first display for displaying an image to a user's first eye and a second display for displaying an image to a user's second eye. In such embodiments, corresponding images may be displayed simultaneously on the first and second displays. Optionally, the corresponding images include representations of the same virtual objects and / or the same physical objects from different viewpoints, thereby creating a parallax effect that provides the user with a stereoscopic effect of objects on the display. In some embodiments, display 121 is a single display. In such embodiments, for each of the user's eyes, the corresponding image is simultaneously displayed in a first and a second area of ​​a single display. Optionally, the corresponding images include representations of the same virtual objects and / or the same physical objects from different viewpoints, thereby creating a parallax effect that provides the user with a stereoscopic effect of objects on a single display.

[0034] In some embodiments, system 100 includes one or more touch-sensitive surfaces 115 for receiving user input such as tap and swipe inputs. In some embodiments, display 121 and touch-sensitive surfaces 115 form a touch-sensitive display.

[0035] In some embodiments, sensor 156 includes sensors for detecting various conditions. In some embodiments, sensor 156 includes orientation sensors (e.g., orientation sensor 111) for detecting the orientation and / or movement of the platform. For example, system 100 uses orientation sensors to track changes in the position and / or orientation (sometimes collectively referred to as positioning) of system 100, such as relative to physical objects in the physical environment. In some embodiments, sensor 156 includes one or more gyroscopes, one or more inertial measurement units, and / or one or more accelerometers. In some embodiments, sensor 156 includes a Global Positioning Sensor (GPS) for detecting the GPS position of the platform. In some embodiments, sensor 156 includes a radar system, a LiDAR system, a sonar system, an image sensor (e.g., image sensor 109, a visible light image sensor, and / or an infrared sensor), a depth sensor, a rangefinder, and / or a motion detector. In some embodiments, sensor 156 includes sensors located within internal portions of system 100 and / or sensors located externally to system 100. In some embodiments, system 100 uses sensors 156 (e.g., internal sensors) to detect the presence and / or state (e.g., location and / or orientation) of passengers within the interior of system 100. In some embodiments, system 100 uses sensors 156 (e.g., external sensors) to detect the presence and / or state of objects outside system 100. In some embodiments, system 100 uses sensors 156 to receive user input, such as gestures and / or other air gestures. In some embodiments, system 100 uses sensors 156 to detect the location and / or orientation of system 100 in the physical environment. In some embodiments, system 100 uses sensors 156 to navigate system 100 along a planned route, around obstacles, and / or to a destination location. In some embodiments, sensors 156 include one or more sensors for identifying and / or authenticating users of system 100, such as fingerprint sensors and / or facial recognition sensors.

[0036] In some embodiments, the image sensor includes one or more visible light image sensors, such as charge-coupled device (CCD) sensors and / or complementary metal-oxide-semiconductor (CMOS) sensors, capable of operating to acquire images of physical objects. In some embodiments, the image sensor includes one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light. For example, an active IR sensor may include an IR emitter, such as an IR point emitter, for emitting infrared light. In some embodiments, the image sensor includes one or more cameras configured to capture movement of the physical object. In some embodiments, the image sensor includes one or more depth sensors configured to detect the distance of the physical object from system 100. In some embodiments, system 100 uses the CCD sensor, camera, and depth sensor in combination to detect the physical environment surrounding system 100. In some embodiments, the image sensor includes a first image sensor and a second image sensor different from the first image sensor. In some embodiments, system 100 uses the image sensor to receive user input, such as gestures and / or other air gestures. In some embodiments, system 100 uses the image sensor to detect the position and / or orientation of system 100 in the physical environment.

[0037] In some implementations, system 100 uses an orientation sensor to detect the orientation and / or movement of system 100. For example, system 100 may use an orientation sensor to track changes in the position and / or orientation of system 100, such as relative to a physical object in the physical environment. In some implementations, the orientation sensor includes one or more gyroscopes, one or more inertial measurement units, and / or one or more accelerometers.

[0038] In some embodiments, system 100 uses a microphone to detect sound from one or more users and / or the physical environment of those users. In some embodiments, the microphone includes a microphone array (comprising multiple microphones) that optionally cooperates to identify ambient noise or to locate sound sources in a space of the physical environment (e.g., inside and / or outside system 100).

[0039] In some embodiments, input component 158 ​​includes one or more mechanical and / or electrical devices for detecting input, such as buttons, sliders, knobs, switches, remote controls, joysticks, touch-sensitive surfaces, keypads, microphones, and / or cameras. In some embodiments, input component 158 ​​includes one or more input devices internal to system 100. In some embodiments, input component 158 ​​includes one or more input devices (e.g., touch-sensitive surfaces and / or keypads) external to system 100.

[0040] In some embodiments, output device 160 includes one or more devices such as a display, monitor, projector, speaker, lamp, and / or haptic output device. In some embodiments, output device 160 includes one or more external output devices such as an external display screen, external lamp, and / or external speaker. In some embodiments, output device 160 includes one or more internal output devices such as an internal display screen, internal lamp, and / or internal speaker.

[0041] In some embodiments, environmental controls 162 include mechanical and / or electrical systems for monitoring and / or controlling the condition of internal portions (e.g., compartments) of system 100. In some embodiments, environmental controls 162 include fans, heaters, air conditioners, and / or thermostats for controlling temperature and / or airflow within the internal portions of system 100.

[0042] In some embodiments, the mobility component includes mechanical and / or electrical components that enable and / or assist the platform in moving. In some embodiments, the mobility system 164 includes a power system, drivetrain, motor (e.g., an electric motor), engine, power source (e.g., a battery), transmission, suspension system, speed control system, and / or steering system. In some embodiments, one or more elements of the mobility component are configured for autonomous or manual control (e.g., via system 100 and / or input component 158).

[0043] In some implementations, system 100 performs monetary transactions with or without another computer system. For example, system 100, or another computer system associated with and / or communicating with system 100 (e.g., via a user account described below), is associated with a user's payment account, such as a credit card account or checking account. To complete the transaction, system 100 may send a key to the entity purchasing goods and / or services from it, enabling the entity to charge the payment account for the transaction. As another example, system 100 stores encrypted payment account information and sends that information to the entity purchasing goods and / or services from it to complete the transaction.

[0044] System 100 may optionally engage in other transactions with other systems, computers, and / or devices. For example, system 100 may transact to unlock another system, computer, and / or device, and / or be unlocked by another system, computer, and / or device. Unlocking transactions may optionally include using, for example, RF circuitry 105 to transmit and / or receive one or more secure cryptographic keys.

[0045] In some implementations, system 100 is capable of communicating with other computer systems and / or electronic devices. For example, system 100 may use RF circuitry 105 to access a network connection that enables the transmission of data between systems for communication purposes. Example communication sessions include telephone calls, emails, SMS messages, and / or video conferencing communication sessions.

[0046] In some implementations, a video conferencing communication session includes the transmission and / or reception of video and / or audio data between systems participating in the video conferencing communication session (including system 100). In some implementations, system 100 uses sensor 156 to capture video and / or audio content, which is then transmitted to other systems in the video conferencing communication session using RF circuitry 105. In some implementations, system 100 uses RF circuitry 105 to receive video and / or audio from other systems in the video conferencing communication session and uses output components 160 (such as display 121 and / or speakers) to present the video and / or audio. In some implementations, the transmission of audio and / or video between systems is near real-time, such as presenting it to other systems with a delay of less than 0.1 seconds, 0.5 seconds, 1 second, or 3 seconds from the time the corresponding portion of the audio and / or video was captured.

[0047] In some embodiments, system 100 uses output component 160 to generate haptic (e.g., touch) output. In some embodiments, output component 160 generates haptic output by shifting a movable mass block relative to a neutral position. In some embodiments, the haptic output is inherently periodic, optionally including the frequency and / or amplitude of movement in two or three dimensions. In some embodiments, system 100 generates a variety of different haptic outputs that differ in the frequency, amplitude, and / or duration / number of cycles of the included movement. In some embodiments, the haptic output pattern includes a start buffer and / or an end buffer during which the movable mass block gradually accelerates and / or decelerates at the beginning and / or end of the haptic output, respectively.

[0048] In some embodiments, the haptic output has a corresponding characteristic frequency that affects the "pitch" of the haptic perception felt by the user. For example, a higher frequency corresponds to faster movement of the movable mass, while a lower frequency corresponds to slower movement of the movable mass. In some embodiments, the haptic output has a corresponding characteristic amplitude that affects the "intensity" of the haptic perception felt by the user. For example, a higher amplitude corresponds to movement of the movable mass over a greater distance, while a lower amplitude corresponds to movement of the movable mass over a smaller distance. In some embodiments, the "pitch" and / or "intensity" of the haptic output varies over time.

[0049] In some embodiments, the tactile output is distinct from the movement of system 100. For example, system 100 may include a tactile output device that moves a movable mass to generate the tactile output, and may include other moving parts that control the movement of system 100, such as motors, wheels, axles, control arms, and / or brakes. Although in some cases the movement and / or cessation of movement of system 100 generates vibrations and / or other physical sensations, these vibrations and / or other physical sensations are distinct from the tactile output. In some embodiments, system 100 generates a tactile output independent of the movement of system 100. For example, system 100 may generate a tactile output without causing system 100 to accelerate, decelerate, and / or move to a new position.

[0050] In some implementations, system 100 detects gesture input made by a user. In some implementations, gesture input includes touch gestures and / or air gestures, as described herein. In some implementations, touch-sensitive surface 115 identifies touch gestures based on contact patterns (e.g., different intensities, timings, and / or movements of an object touching or nearly touching touch-sensitive surface 115). Thus, touch-sensitive surface 115 detects gestures by detecting the corresponding contact patterns. For example, detecting a finger press event and then detecting a finger lift-off (e.g., lift-off) event at the same location as the finger press event (e.g., at the location of a user interface element) may correspond to detecting a tap gesture on a user interface element. As another example, detecting a finger press event, then detecting movement of the contact, and subsequently detecting a finger lift-off (e.g., lift-off) event may correspond to detecting a swipe gesture. Additional and / or alternative touch gestures are possible.

[0051] In some embodiments, an air gesture is a gesture performed by a user without touching the input component 158. In some embodiments, an air gesture is based on the detected movement of a portion of the user (e.g., hand, fingers, and / or body) in the air. In some embodiments, an air gesture includes the movement of that portion of the user relative to a reference. Example references include the distance of the user's hand relative to a physical object (such as the ground), the angle of the user's arm relative to a physical object, and / or the movement of a first portion of the user (e.g., hand or fingers) relative to a second portion of the user (e.g., shoulder, another hand, or another finger). In some embodiments, detecting an air gesture includes detecting the absolute movement of that portion of the user, such as a tapping gesture including moving the hand in a predetermined posture by a predetermined amount and / or speed, or a shaking gesture including rotating a portion of the user at a predetermined speed or amount.

[0052] In some implementations, detecting one or more inputs includes detecting the user's speech. In some implementations, system 100 uses one or more microphones of input component 158 ​​to detect when the user utters one or more words. In some implementations, system 100 parses information and / or communicates information to one or more other systems to determine the content of the user's speech, including identifying words and / or obtaining a semantic understanding of those words. For example, system processor 103 may be configured to perform natural language processing to detect one or more words and / or determine the possible meaning of one or more words in a sequence spoken by the user. Additionally or alternatively, in some implementations, system 100 determines the meaning of one or more words in a spoken sequence based on the context determined by system 100.

[0053] In some implementations, system 100 outputs spatial audio via output component 160. In some implementations, the spatial audio is output at a specific location. For example, system 100 may play a notification ringtone having one or more characteristics that cause the notification ringtone to be generated as if it were emitted from a first location relative to the user's current viewpoint (e.g., "spatializing" and / or "spatializing" includes modifying the audio in amplitude, filtering, and / or delaying it to provide the user with perceived spatial quality).

[0054] In some embodiments, system 100 presents visual and / or audio feedback indicating the user's current position relative to another user's current viewpoint, thereby informing the other user of the user's updated position. In some embodiments, playing audio corresponding to the user includes altering one or more characteristics of audio obtained from another computer system to simulate the effect of placing an audio source generating the audio playback within the user's position, such as a position where the user moves, appears, and / or is assigned within a three-dimensional environment. In some embodiments, the relative magnitude of audio at one or more frequencies and / or frequency groups is altered, one or more filters are applied to the audio (e.g., directional audio filters), and / or the magnitude of audio provided via one or more channels is altered (e.g., increased or decreased) to produce the perceived effect of a physical audio source. In some embodiments, the simulated position of the audio source relative to the ground of the three-dimensional environment is matched to the height of the participant's head, or one or more predetermined heights relative to the ground of the three-dimensional environment, of the simulated audio source. In some embodiments, system 100 presents feedback based on determining that the user's position corresponds to a second position different from a first position and meeting one or more first criteria, the feedback including generating audio as if it were emanating from the second position.

[0055] In some embodiments, system 100 communicates with one or more accessory devices. In some embodiments, one or more accessory devices are integrated with system 100. In some embodiments, one or more accessory devices are external to system 100. In some embodiments, system 100 communicates with accessory devices using RF circuitry 105 and / or using a wired connection. In some embodiments, system 100 controls the operation of accessory devices such as doors, windows, locks, speakers, lights, and / or cameras. For example, system 100 may control the operation of a motorized door of system 100. As another example, system 100 may control the operation of a motorized window included in system 100. In some embodiments, accessory devices used as input devices, such as remote controls and / or other computer systems (e.g., smartphones, media players, tablets, computers, and / or wearable devices), control the operation of system 100. For example, a wearable device (e.g., a smartwatch) serves as a key to initiate the operation of the actuation system of system 100. In some implementations, system 100 acts as an input device to control the operation of another system, device, and / or computer, such as platform 100 acting as a key to initiate the operation of an actuation system of a platform associated with another system, device, and / or computer.

[0056] In some implementations, the digital assistant assists the user in performing various functions using System 100. For example, the digital assistant may provide weather updates, set alarms, and perform searches locally and / or using a network connection (e.g., the Internet) via a natural language interface. In some implementations, the digital assistant accepts requests, at least in part, in the form of natural language commands, narrations, requests, statements, and / or inquiries. In some implementations, the user uses the digital assistant to request informational answers and / or the execution of tasks. For example, in response to receiving the question “What is the current temperature?”, the digital assistant answers “The current temperature is 30 degrees.” As another example, in response to receiving a request to perform a task, such as “Please invite my family to dinner tomorrow,” the digital assistant may acknowledge the request by playing spoken words such as “Okay, soon,” and then, on behalf of the user, send the requested calendar invitations to each family member listed in the user’s contact list. In some implementations, the digital assistant engages in a continuous dialogue with the user during the execution of a user-requested task, which involves multiple exchanges of information over a period of time. Other ways of interacting with the digital assistant may involve requesting the execution of tasks and / or requesting information. For example, a digital assistant may respond to a user in other forms, such as displayed alerts, text, video, animation, music, etc. In some embodiments, the digital assistant includes a client portion executing on system 100 and a server portion executing on a server communicating with system 100. The client portion may communicate with the server via a network connection using RF circuitry 105. For example, the client portion may provide client functionality, input and / or output processing, and / or communication with the server. In some embodiments, the server end is divided into any number of client portions across multiple systems providing server functionality.

[0057] In some implementations, system 100 is associated with one or more user accounts. In some implementations, system 100 stores and / or encrypts user data, including files, settings, and / or preferences associated with a specific user account. In some implementations, user accounts are password protected, and system 100 requires user authentication before accessing user data associated with an account. In some implementations, user accounts are associated with other systems, devices, and / or servers. In some implementations, associating a user account with multiple systems enables those systems to access, update, and / or synchronize user data associated with the user account. For example, a system associated with a user account may have access to purchased media content, contact lists, communication sessions, payment information, stored passwords, and other user data. Therefore, in some implementations, user accounts provide security mechanisms for a customized user experience.

[0058] Figures 2A to 2M illustrate example techniques for displaying content with live video feeds according to some embodiments. Figure 3 is a flowchart of an exemplary method 300 for displaying content with live video feeds according to some embodiments. The example embodiments shown in Figures 2A to 2M are used to illustrate the processes described below, including the processes in Figure 3.

[0059] Figure 2A illustrates platform 202 in environment 200. Environment 200 includes a mountain 200a in front of platform 202, a tree 200b to the right of platform 202, and a sunset 200c to the left of platform 202. Platform 202 includes a first display 204a and a second display 204b in an internal portion 203 of platform 202. In some embodiments, any of the features described with reference to display 204a may be applied to and / or performed by display 204b. In some embodiments, display 204a and / or display 204b is controlled by a computer system included in and / or communicating with platform 202. External sensors 206a-206d (e.g., cameras) are located outside platform 202, and internal sensors 206e-206f (e.g., cameras) are located in the internal portion 203 of platform 202. External sensors 206a-206d are configured to capture images and / or video of the environment 200 outside platform 202.

[0060] Figure 2B shows an isolated view of display 204a. In Figure 2B, display 204a displays user interface 206 (e.g., a home screen and / or application launcher). In Figure 2B, input 250a is detected to select media application icon 208. In some embodiments, input 250a includes a tap on display 204a, a press of a button to specify media application icon 208, and / or other inputs corresponding to the selection of media application icon 208. In response to input 250a, display 204a displays content 212 and live video feed 210, as shown in Figure 2C. In the embodiment illustrated in Figure 2C, content 212 includes a user interface (e.g., a window) of the media application corresponding to media application icon 208, and live video feed 210 is displayed in the background behind content 212. The live video feed 210 shown in Figure 2C provides a first view of the environment 200 outside platform 202 captured by one or more of external sensors 206a-206d. In some embodiments, the live video feed 210 includes a wide-angle field of view, a 360-degree field of view, and / or a fisheye field of view of the environment 200 outside the platform 202. In some embodiments, the live video feed 210 includes images and / or videos captured by two or more external sensors 206a-206d.

[0061] In Figure 2C, input 250b corresponding to a request to move and zoom in on content 212 on display 204a is detected. In some embodiments, input 250b includes drag, release, and / or other inputs corresponding to a request to move and / or zoom in on content 212. In response to input 250b, content 212 is moved and zoomed in on display 204a while maintaining the display of live video feed 210, as shown in Figure 2D.

[0062] In Figure 2D, input 250c is detected corresponding to a request to change the view of the external environment 200 displayed on display 204a (e.g., a live video feed). In the embodiment illustrated in Figure 2D, input 250c includes a tap and / or other input to select the live video feed 210. In response to the detection of input 250c, display 204a displays a live video feed 214 of the environment 200 outside platform 202, as shown in Figure 2E. Live video feed 214 includes a view of the environment 200 that is different from (e.g., narrower) than live video feed 210. In the embodiment illustrated in Figure 2E, live video feed 214 includes a view of the environment 200 (e.g., mountain 200a) in front of platform 202. In this way, the user can change, select, and / or customize the view of the environment 200 displayed in the background of content 212.

[0063] In Figure 2E, input 250d is detected corresponding to a request (e.g., another request) to change the view of the external environment 200 displayed on display 204a (e.g., a live video feed). In the embodiment illustrated in Figure 2E, input 250c includes a tap and / or other input pointing to the right side of the live video feed 214. In response to the detection of input 250d, display 204a displays a live video feed 216 of the environment 200 outside platform 202, as shown in Figure 2F. Live video feed 216 includes a view of the environment 200 in a different orientation than live video feed 214 (e.g., but with the same field of view). In the embodiment illustrated in Figure 2F, live video feed 214 includes a view of the environment 200 (e.g., a tree 200b) to the right of platform 202. In some embodiments, the view of the environment 200 displayed in response to input 250d is based on the position of input 250d. For example, because input 250d is directed to the right of display 204a and / or live video feed 214, display 204a changes its view to the right side of platform 202. In some implementations, in response to input directed to the left side of display 204a and / or live video feed 214, display 204a displays a view to the left of platform 202 (e.g., a view of sunset 200c). In this way, the user can change, select, and / or customize the orientation of the view of environment 200 displayed in the background of content 212.

[0064] Turning to Figure 2G, platform 202 moves in the manner indicated by motion indicator 218 (e.g., directional velocity, rate, acceleration, rotation, and / or vibration). In some embodiments, content 212 moves on display 204a in response to the movement of platform 202. Moving content 212 in response to the movement of platform 202 can help provide comfort to the user viewing content 212 while platform 202 is moving by providing visual effects corresponding to the motion that the user is experiencing and / or feeling. For example, in Figure 2G, in response to detecting movement indicated by motion indicator 218, display 204a moves (e.g., translates and / or shifts) content 212 on display 204a.

[0065] In the embodiment illustrated in Figure 2G, the display 204a moves the content 212 in a direction opposite to the direction of movement of the platform 202 (e.g., similar to how a user would tilt or feel as if he or she were being pushed in the opposite direction of the platform 202's movement). In some embodiments, the display 204a moves the content 212 in the same direction as the platform 202's movement. In some embodiments, in response to detecting movement of the platform 202, the display 204a changes the size, shape, color, orientation, and / or opacity of the content 212, with or without changing its positioning.

[0066] Turning to Figure 2H, compared to the orientation of platform 202 shown in Figure 2A, platform 202 is oriented 90 degrees to the right (e.g., rotated) so that the front of platform 202 (e.g., represented by the side of platform 202 where external sensor 206a is located) faces tree 200b. Display 204a displays live video feed 214, which provides a view of the environment 200 in front of platform 202 as described above with reference to Figure 2E. Because platform 202 faces tree 200b, live video feed 214 includes a view of tree 200b (e.g., not mountain 200a as shown in Figure 2E).

[0067] Turning to Figure 2I, an extended view of displays 204a and 204b is shown. In some embodiments, different displays within platform 202 display different views of the environment 200 outside platform 202. In some embodiments, the view of the environment 200 displayed on the displays is based on the position of the displays within platform 202. For example, in Figure 2I, display 204a displays a view of the environment 200 in front of platform 202 because display 204a is closer to the front of platform 202 than display 204b, and display 204b displays a view of the environment 200 on one side (e.g., right or left) of platform 202 (e.g., live video feed 216) because display 204b is closer to the rear of platform 202 than display 204a (e.g., because a user viewing display 204b may be blocked from seeing the view in front of platform 202 by other users in front of display 204a and / or display 204b).

[0068] Turning to Figures 2J through 2K, in some embodiments, display 204a displays different content in the background of content 212 based on the location of the user's attention (e.g., based on the location of the user's gaze and / or the location the user is viewing). For example, in Figure 2J, because the user's attention (e.g., gaze 224) is not directed at content 212 (e.g., gaze 224 is directed at a portion of display 204a that does not include content 212) (e.g., in response to the user's attention moving away from content 212), display 204a displays user interface 206 as the background. In Figure 2K, because the user's attention (e.g., gaze 224) is directed at content 212 (e.g., gaze 224 is directed at a portion of display 204a that includes content 212) (e.g., in response to the user's attention moving to content 212), display 204a displays a live video feed of the environment 200 outside platform 202 (e.g., live video feed 214) as the background. In some implementations, as gaze 224 moves to and from content 212, the background behind content 212 switches between user interface 206 (or another user interface excluding the live video feed of environment 200 outside platform 202) and the live video feed of environment 200 outside platform 202.

[0069] Turning to Figures 2L through 2M, in some embodiments, display 204a displays different content in the background of content 212 based on the user's location on platform 202. For example, in Figure 2L, because user 226 is outside platform 202 (e.g., not inside the platform) (e.g., in response to user 226 leaving platform 202), display 204a displays user interface 206 as the background. In Figure 2M, because user 226 is inside platform 202 (e.g., in response to user 226 entering platform 202), display 204a displays a live video feed of the environment 200 outside platform 202 (e.g., live video feed 214) as the background. In some embodiments, as user 226 enters and leaves platform 202, the background behind content 212 switches between user interface 206 (or another user interface excluding the live video feed of the environment 200 outside platform 202) and the live video feed of the environment 200 outside platform 202.

[0070] The following description, with reference to method 300 described in relation to Figure 3, provides additional information about Figures 2A to 2M.

[0071] Figure 3 is a flowchart of an exemplary method 300 for displaying content with a live video feed, according to some embodiments. In some embodiments, method 300 is performed at a computer system (e.g., computer system 152), a display (e.g., 121, 204a and / or 204b), and / or a platform (e.g., a vehicle). In some embodiments, the computer system is within and / or part of a platform (e.g., 202). In some embodiments, method 300 is managed by instructions stored in a non-transitory (or transient) computer-readable storage medium and executed by one or more processors (such as one or more processors 103 of system 100) of the computer system (e.g., 152) and / or the platform (e.g., a vehicle). Some operations in method 300 may be combined, and / or the order of some operations may be changed.

[0072] In some implementations, according to method 300, a computer system (e.g., 152 and / or a computer system communicating with platform 202) displays (302) a user interface (e.g., 206) via display components (e.g., 121, 204a and / or 204b) (e.g., displays, display devices, monitors, head-up displays and / or head-mounted displays) located in an internal portion (e.g., 203) (e.g., a compartment) of the platform (e.g., a vehicle, car, truck and / or mobile platform). The computer system detects (304) a request (e.g., 250a) (e.g., input and / or data) to display content (e.g., movies, videos, windows and / or applications) via one or more input devices, such as 156, 158, a mouse, a touch-sensitive surface and / or a touch-sensitive display, and / or a data input interface). In response to a request to detect display content, the computer system displays (306) (e.g., concurrently displays and / or initiates display) content (e.g., 212 and / or 228) in a first area of ​​the display component (e.g., 306) and a live video feed (e.g., 210, 214, and / or 216) in a second area of ​​the display component (e.g., the area surrounding content 212), wherein the live video feed includes video of the environment outside the platform (e.g., 200) captured by one or more cameras of the platform (e.g., 109, 156, and / or 206a-206d). In some embodiments, the display component includes a display of a personal device (e.g., a smartphone, smartwatch, laptop computer, and / or tablet computer) and / or a display of the platform (e.g., a display integrated into a seat, headrest, table, ceiling, wall, and / or other structure within the interior of the platform).

[0073] In some embodiments, the live video feed includes a first view of the environment outside the platform (e.g., 214) (e.g., a first field of view, a front view, a first-person view, a view outside a first side and / or window of the platform, a view of the road, and / or a fisheye view). In some embodiments, the live video feed includes a wide-angle view of the environment outside the platform (e.g., 210) (e.g., a wide-angle field of view, a stitched camera view, the field of view of two or more cameras, a 360-degree view, and / or a 360-degree field of view). In some embodiments, the wide-angle view includes a field of view that completely surrounds the platform. In some embodiments, the wide-angle view includes at least a portion of the field of view of a first camera and at least a portion of the field of view of a second camera different from the first camera (e.g., portions of the field of view of the first and second cameras are combined or stitched together to form the wide-angle view).

[0074] In some implementations, while displaying content and live video feed, the computer system detects input (e.g., 250c and / or 250d) (e.g., tap input on a touch-sensitive surface, button press, voice input, and / or air gesture); and in response to the detection of input, the computer system changes the live video feed from a first view of the environment outside the platform captured by one or more cameras (e.g., the field of view of the first camera and / or the field of view having a first angular range) to a second view of the environment outside the platform captured by one or more cameras (e.g., the field of view of the second camera and / or the field of view having a second angular range different from the first angular range) (e.g., the computer system changes from 210 to 214, as shown in Figures 2D to 2E, or from 214 to 216, as shown in Figures 2E to 2F). In some implementations, while displaying content and live video feed, the computer system detects movement of the platform (e.g., 218 and / or as described with reference to FIG. 2H) (e.g., change of orientation, change of rate, acceleration, change of acceleration, rotation, and / or vibration); and in response to detecting the movement of the platform, the computer system alters the live video feed (e.g., video of the environment outside the platform) based on the movement of the platform (e.g., changing from 214 in FIG. 2E to 214 in FIG. 2H). For example, in response to detecting a first movement of the platform, a first change is applied to the live video feed (e.g., the live video feed changes in a first manner, in a first direction, and / or by a first amount); and in response to detecting a second movement of the platform different from the first movement of the platform, a second change different from the first change is applied to the live video feed (e.g., the live video feed changes in a second manner, in a second direction, and / or by a second amount, different from the first manner, the first direction, and / or the first amount).

[0075] In some implementations, while displaying content and live video feeds (e.g., 214 in FIG2E), the computer system detects input (e.g., 250d) (e.g., tap input on a touch-sensitive surface, button press, voice input, and / or air gesture); and in response to the detection of input, the computer system adjusts (e.g., zooms in, zooms out, tilts, pans, and / or scrolls) the live video feed (e.g., video of the environment outside the platform) based on the input (e.g., changing the live video feed from 214 to 216, as shown in FIG2E to FIG2F). In some implementations, adjusting the live video feed includes: displaying (e.g., changing the live video feed to) a first adjusted view (e.g., 216) of the environment outside the platform captured by one or more cameras (e.g., a view in a first direction, for example, in response to 250d) based on a determined input corresponding to a first position (e.g., a first position on the display component); and displaying (e.g., changing the live video feed to) a second adjusted view of the environment outside the platform captured by one or more cameras (e.g., a view in a second direction different from the first direction, for example, in response to an input on the left side of 204a, based on an image captured by at least sensor 206b) of the environment outside the platform, based on an image captured by at least sensor 206b.

[0076] In some embodiments, a first region of the display component includes a graphical user interface window (e.g., an application window) (e.g., 212 is a user interface window or is displayed in a user interface window). In some embodiments, a second region of the display component includes a background (e.g., relative to the first region) (e.g., the background of 212). In some embodiments, the second region is a window (e.g., behind the first region). In some embodiments, the second region surrounds the first region (e.g., partially surrounds the first region, completely surrounds the first region, and / or surrounds a threshold amount, such as 70%, 80%, or 90% of the first region) (e.g., 210, 214, and 216 surround content 212). In some embodiments, the second region includes an area around the edge of the display component (e.g., a portion and / or the entire edge of the edge) (e.g., an area that touches and / or is adjacent to the edge of the display component) (e.g., 210, 214, and 216 are displayed along the edge of 204a).

[0077] In some implementations, during the display of content and live video feed, the computer system detects movement of the platform (e.g., 218) (e.g., change of orientation, change of rate, acceleration, change of acceleration, rotation, and / or vibration); and in response to the detection of platform movement, the computer system alters a first area of ​​the display component in which the displayed content is located based on the platform movement (e.g., adjusts, moves, translates, scales, rotates the first area, changes the positioning of the first area, changes the size of the first area, and / or changes the aspect ratio of the first area) (e.g., moves content 212, as shown in FIG. 2G) (e.g., the computer system displays content in a third area of ​​the display component, different from the first area of ​​the display component). For example, in response to the detection of a first movement of the platform, a first change is applied to the first area (e.g., the first area is changed in a first manner, in a first direction, and / or by a first amount); and in response to the detection of a second movement of the platform different from the first movement of the platform, a second change different from the first change is applied to the first area (e.g., the first area is changed in a second manner, in a second direction, and / or by a second amount, different from the first manner, the first direction, and / or the first amount).

[0078] In some implementations, while displaying content and live video feed, the computer system detects input (e.g., 250b) (e.g., tap input on a touch-sensitive surface, button press, voice input, air gesture, request to start live video feed and / or request to stop live video feed); and in response to the detected input, the computer system alters a first area in which the content is displayed (e.g., adjusts, moves, pans, scales, rotates the first area, changes the positioning of the first area, changes the size of the first area and / or changes the aspect ratio of the first area) (e.g., the computer system displays the content in a third area of ​​a display component that is different from the first area of ​​the display component) (e.g., panning and zooming 212, as described with reference to FIG. 2D).

[0079] In some implementations, displaying content in a first area and a live video feed in a second area includes: displaying the content and live video feed in a first configuration based on a first positioning of the display component within an internal portion of the platform (e.g., positioning of 204a in platform 202) (e.g., the first area of ​​the content being displayed having a first positioning, orientation, shape, and / or size relative to the second area where the live video feed is displayed) (e.g., displaying 214 in the background of 212); and displaying the content and live video feed in a second configuration different from the first configuration based on a second positioning of the display component within an internal portion of the platform (e.g., positioning of 204b in platform 202) (e.g., the first area of ​​the content being displayed having a second positioning, orientation, shape, and / or size relative to the second area where the live video feed is displayed) (e.g., displaying 216 in the background of 212).

[0080] In some implementations, based on (or in some implementations, in response to) determining that the user's gaze is directed at content (e.g., 224 points to 212 in Figure 2K) (e.g., the user's gaze is directed at a first area of ​​the display component and / or the user is viewing content), the computer system displays (e.g., initiates, continues, and / or maintains the display) a live video feed (e.g., 214), including video of the environment outside the platform captured by one or more cameras; and based on (or in some implementations, in response to) determining that the user's gaze is not directed at content (e.g., 224 is not directed at 212 in Figure 2J) (e.g., the user's gaze is not directed at a first area of ​​the display component and / or the user is not viewing content), the computer system stops (or in some implementations, abandons) the display of the live video feed (e.g., displays 206, as shown in Figure 2J) (e.g., the computer system displays a user interface without a live video feed) (e.g., the live video feed is replaced by a static image, a static background, a home screen, a user interface different from the live video feed, and / or a user interface that does not include video of the environment outside the platform captured by one or more cameras).

[0081] In some implementations, based on (or in some implementations, in response to) determining that the user is within the internal portion of the platform (e.g., the user has entered the platform) (e.g., as shown in Figure 2M), the computer system displays (e.g., continues and / or maintains the display) a live video feed (e.g., 210, 214, or 216), including video of the environment outside the platform captured by one or more cameras; and based on (or in some implementations, in response to) determining that the user is not within the internal portion of the platform (e.g., the user has left and / or has not entered the platform) (e.g., as shown in Figure 2L), the computer system stops (or in some implementations, abandons) the display of the live video feed (e.g., display 206, as shown in Figure 2L) (e.g., displays a user interface without a live video feed) (e.g., the live video feed is replaced by a static image, a static background, a main screen, a user interface different from the live video feed, and / or a user interface that does not include video of the environment outside the platform captured by one or more cameras).

[0082] For illustrative purposes, this disclosure has been described with reference to specific embodiments. The foregoing discussion is not intended to be exhaustive or to limit this disclosure and / or the claims to particular embodiments. Modifications and / or variations are possible according to this disclosure. Some embodiments have been selected and described to explain the principles of the technology and its practical application. Others skilled in the art will thus be able to utilize the technology and various embodiments with modifications and / or variations suitable for the intended particular use.

[0083] While this disclosure and its embodiments have been fully described with reference to the accompanying drawings, it should be noted that various changes and / or modifications will become apparent to those skilled in the art. It should be understood that such changes and / or modifications are considered to be included within the scope of this disclosure and its embodiments as defined by the claims.

[0084] The intention of this disclosure is that any personal information of users should be collected, managed, and processed in a manner that minimizes the risk of unintentional and / or unauthorized access and / or use.

[0085] Therefore, while this disclosure broadly covers the use of personal information to implement one or more embodiments, it also anticipates that embodiments can be implemented without access to such personal information.

Claims

1. A method, the method comprising: The user interface is displayed via a display component located within the platform's internal components; A request to detect the displayed content; In response to the detected request to display the content, via the display component: the content is displayed in a first area of ​​the display component; and a live video feed is displayed in a second area of ​​the display component, wherein the live video feed includes video of the environment outside the platform captured by one or more cameras of the platform.

2. The method of claim 1, wherein the live video feed includes a first view of the environment outside the platform.

3. The method according to any one of claims 1 to 2, wherein the live video feed includes a wide-angle view of the environment outside the platform.

4. The method according to any one of claims 1 to 3, further comprising: Input is detected while the content is being displayed and the live video feed is being sent. And in response to detecting the input, the live video feed is changed from a first view of the environment outside the platform captured by the one or more cameras to a second view of the environment outside the platform captured by the one or more cameras.

5. The method according to any one of claims 1 to 4, further comprising: The movement of the platform is detected while the content is being displayed and the live video feed is being sent. And in response to detecting the movement of the platform, to change the live video feed based on the movement of the platform.

6. The method according to any one of claims 1 to 5, further comprising: Input is detected while the content is being displayed and the live video feed is being sent. And in response to detecting the input, adjust the live video feed based on the input.

7. The method of claim 6, wherein adjusting the live video feed comprises: Based on the determination that the input corresponds to a first location, a first adjusted view of the environment outside the platform captured by the one or more cameras is displayed; And based on determining that the input corresponds to a second location different from the first location, display a second adjusted view of the environment outside the platform captured by the one or more cameras, which is different from the first adjusted view of the environment outside the platform captured by the one or more cameras.

8. The method according to any one of claims 1 to 7, wherein the first area of ​​the display component includes a graphical user interface window.

9. The method according to any one of claims 1 to 8, wherein the second region of the display component includes a background.

10. The method of claim 9, wherein the second region surrounds the first region.

11. The method according to any one of claims 9 to 10, wherein the second region includes the area surrounding the edge of the display component.

12. The method according to any one of claims 1 to 11, further comprising: The movement of the platform is detected while the content is being displayed and the live video feed is being sent. And in response to detecting the movement of the platform, changing the first area of ​​the display component in which the content is displayed based on the movement of the platform.

13. The method according to any one of claims 1 to 12, further comprising: Input is detected while the content is being displayed and the live video feed is being sent. And in response to detecting the input, change the first area in which the content is displayed.

14. The method according to any one of claims 1 to 13, wherein displaying the content in the first area and displaying the live video feed in the second area comprises: Based on determining that the display component is located in a first position within the internal portion of the platform, the content and the live video feed are displayed in a first configuration; And based on determining that the display component is in a second location within the internal portion of the platform, different from the first location, the content and the live video feed are displayed in a second configuration different from the first configuration.

15. The method according to any one of claims 1 to 14, the method further comprising: Based on determining that the user's gaze is directed at the content, the live video feed is displayed, including video of the environment outside the platform captured by the one or more cameras; And based on the determination that the user's gaze is not directed at the content, the display of the live video feed is stopped.

16. The method according to any one of claims 1 to 15, further comprising: Based on the determination that the user is within the internal portion of the platform, the live video feed is displayed, including video of the environment outside the platform captured by the one or more cameras; And if it is determined that the user is not within the internal portion of the platform, the display of the live video feed is stopped.

17. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for performing the method according to any one of claims 1 to 16.

18. A system comprising: One or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 16.

19. A system comprising: Components for performing the method according to any one of claims 1 to 16.

20. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 16.

21. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for: displaying a user interface via a display component located in an internal portion of a platform; detecting a request to display content; and, in response to detecting the request to display the content, displaying the content via the display component in a first area of ​​the display component; and displaying a live video feed in a second area of ​​the display component, wherein the live video feed comprises video of the environment outside the platform captured by one or more cameras of the platform.

22. A system comprising: One or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying a user interface via a display component located in an internal portion of the platform; and detecting requests for display content; In response to the detected request to display the content, via the display component: the content is displayed in a first area of ​​the display component; and a live video feed is displayed in a second area of ​​the display component, wherein the live video feed includes video of the environment outside the platform captured by one or more cameras of the platform.

23. A system comprising: Components used to display the user interface via display components located within the platform's internal parts; A component used to detect requests for displayed content; And components for: in response to detecting the request to display the content, via the display component: displaying the content in a first area of ​​the display component; and displaying a live video feed in a second area of ​​the display component, wherein the live video feed includes video of the environment outside the platform captured by one or more cameras of the platform.

24. A computer program product comprising one or more programs configured to be executed by one or more processors of a system, the one or more programs including instructions for: displaying a user interface via a display component located in an internal portion of a platform; detecting a request to display content; and in response to detecting the request to display the content, via the display component: displaying the content in a first area of ​​the display component; and displaying a live video feed in a second area of ​​the display component, wherein the live video feed comprises video of the environment outside the platform captured by one or more cameras of the platform.

Images