Techniques for controlling area
By detecting proximity conditions to display the control area and receiving user input, the problem of complex and inefficient control areas in existing technologies is solved, resulting in a faster and more efficient user interface and extended battery life.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- APPLE INC
- Filing Date
- 2024-09-27
- Publication Date
- 2026-04-17
AI Technical Summary
Existing methods for controlling areas are often complex and inefficient, resulting in wasted user time and device energy, especially in battery-powered devices.
By detecting proximity conditions, the system displays prompts for the area control application, receives user input, displays the user interface, and performs corresponding operations, reducing the number of input steps on the user interface.
It provides a faster and more efficient method and interface, reduces the cognitive burden on users, saves power for battery-powered devices, and improves device effectiveness and user satisfaction.
Smart Images

Figure CN121889761A_ABST
Abstract
Description
Cross-reference to related applications
[0001] This application claims priority to U.S. Patent Application No. 18 / 896,009, filed September 25, 2024, entitled “TECHNIQUES FOR CONTROLLING AN AREA,” and U.S. Provisional Patent Application No. 63 / 541,812, filed September 30, 2023, entitled “TECHNIQUES FOR CONTROLLING AN AREA.” The entire contents of each of these patent applications are incorporated herein by reference. Technical Field
[0002] This disclosure relates in general to technologies used for controlling areas. Background Technology
[0003] Users can access various types of areas, such as buildings, platforms, vehicles, and parts thereof. Areas can include systems and accessories that can be controlled. Summary of the Invention
[0004] However, some technologies used to control areas with electronic devices are often cumbersome and inefficient. For example, some existing technologies use complex and time-consuming user interfaces that may include multiple buttons or keystrokes. These existing technologies require more time than necessary, resulting in wasted user time and device power. This latter consideration is particularly important in battery-powered devices.
[0005] Therefore, this technology provides faster and more efficient methods and interfaces for controlling electronic devices. Such methods and interfaces can optionally supplement or replace other methods used for controlling the area. These methods and interfaces reduce the cognitive burden on the user and result in a more efficient human-machine interface. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charging cycles.
[0006] According to some implementations, a method is described. The method includes: detecting that one or more proximity conditions are met, wherein the one or more proximity conditions include distance conditions that are met when the distance between a computer system and a region is determined to meet a threshold distance; in response to detecting that the one or more proximity conditions are met, displaying a prompt to open a region control application, the region control application being configured to perform one or more functions associated with the region; detecting input including selection of the prompt when displaying the prompt to open the region control application; in response to detecting input including selection of the prompt, displaying a user interface of the region control application, including displaying one or more selectable elements including a region control element in the user interface of the region control application; detecting input including selection of the region control element; and in response to detecting input including selection of the region control element, requesting the region to perform an operation corresponding to the region control element.
[0007] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system. The one or more programs include instructions for: detecting that a set of one or more proximity conditions is satisfied, wherein the set of one or more proximity conditions includes distance conditions satisfied when the distance between the computer system and a region is determined to satisfy a threshold distance; in response to detecting that the set of one or more proximity conditions is satisfied, displaying a prompt to open a region control application, the region control application being configured to perform one or more functions associated with the region; detecting input including selection of the prompt when displaying the prompt to open the region control application; in response to detecting input including selection of the prompt, displaying a user interface of the region control application, including displaying one or more selectable elements including region control elements in the user interface of the region control application; detecting input including selection of region control elements; and in response to detecting input including selection of region control elements, requesting the region to perform an operation corresponding to the region control element.
[0008] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system. The one or more programs include instructions for: detecting that a set of one or more proximity conditions is satisfied, wherein the set of one or more proximity conditions includes distance conditions satisfied when the distance between the computer system and a region is determined to satisfy a threshold distance; in response to detecting that the set of one or more proximity conditions is satisfied, displaying a prompt to open a region control application, the region control application being configured to perform one or more functions associated with the region; detecting input including selection of the prompt when displaying the prompt to open the region control application; in response to detecting input including selection of the prompt, displaying a user interface of the region control application, including displaying one or more selectable elements including region control elements in the user interface of the region control application; detecting input including selection of region control elements; and in response to detecting input including selection of region control elements, requesting the region to perform an operation corresponding to the region control element.
[0009] According to some embodiments, a computer system is described. The computer system includes: one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: detecting that a set of one or more proximity conditions is satisfied, wherein the set of one or more proximity conditions includes distance conditions satisfied when the distance between the computer system and a region is determined to satisfy a threshold distance; in response to detecting that the set of one or more proximity conditions is satisfied, displaying a prompt to open a region control application, the region control application being configured to perform one or more functions associated with the region; detecting input including selection of the prompt when displaying the prompt to open the region control application; in response to detecting input including selection of the prompt, displaying a user interface of the region control application, including displaying one or more selectable elements including region control elements in the user interface of the region control application; detecting input including selection of the region control elements; and in response to detecting input including selection of the region control elements, requesting the region to perform an operation corresponding to the region control elements.
[0010] According to some embodiments, a computer system is described. The computer system includes: means for detecting satisfaction of one or more proximity conditions, wherein the one or more proximity conditions include distance conditions satisfied when the distance between the computer system and a region is determined to satisfy a threshold distance; means for: displaying a prompt to open a region control application, the region control application being configured to perform one or more functions associated with the region, in response to detecting satisfaction of the one or more proximity conditions; means for: detecting input including selection of the prompt when displaying the prompt to open the region control application; means for: displaying a user interface of the region control application, including displaying one or more selectable elements including region control elements, in the user interface of the region control application, in response to detecting input including selection of the region control elements; and means for: requesting the region to perform an operation corresponding to the region control element in response to detecting input including selection of the region control element.
[0011] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system. The one or more programs include instructions for: detecting that a set of one or more proximity conditions is satisfied, wherein the set of one or more proximity conditions includes distance conditions satisfied when the distance between the computer system and a region is determined to satisfy a threshold distance; in response to detecting that the set of one or more proximity conditions is satisfied, displaying a prompt to open a region control application, the region control application being configured to perform one or more functions associated with the region; detecting input including selection of the prompt when displaying the prompt to open the region control application; in response to detecting input including selection of the prompt, displaying a user interface of the region control application, including displaying one or more selectable elements including region control elements in the user interface of the region control application; detecting input including selection of region control elements; and in response to detecting input including selection of region control elements, requesting the region to perform an operation corresponding to the region control element.
[0012] According to some implementations, a method is described. The method includes: displaying a set of one or more environmental control elements at a computer system; detecting input including selection of a first environmental control element from the set of one or more environmental control elements; and, in response to detecting the input including selection of the first environmental control element, setting corresponding environmental parameters for a corresponding location of a region, the setting including: setting corresponding environmental parameters for the first location based on a determination that the computer system is located at a first location relative to the region; and setting corresponding environmental parameters for the second location based on a determination that the computer system is located at a second location relative to the region, different from the first location.
[0013] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system. The one or more programs include instructions for: displaying a set of one or more environmental control elements at the computer system; detecting input including selection of a first environmental control element from the set of one or more environmental control elements; and, in response to detecting the input including selection of the first environmental control element, setting corresponding environmental parameters for a corresponding location of a region, the setting including: setting corresponding environmental parameters for a first location based on a determination that the computer system is located at a first location relative to the region; and setting corresponding environmental parameters for a second location based on a determination that the computer system is located at a second location relative to the region, different from the first location.
[0014] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system. The one or more programs include instructions for: displaying a set of one or more environmental control elements at the computer system; detecting input including selection of a first environmental control element from the set of one or more environmental control elements; and, in response to detecting the input including selection of the first environmental control element, setting corresponding environmental parameters for a corresponding location of a region, the setting including: setting corresponding environmental parameters for a first location based on a determination that the computer system is located at a first location relative to the region; and setting corresponding environmental parameters for a second location based on a determination that the computer system is located at a second location relative to the region, different from the first location.
[0015] According to some embodiments, a computer system is described. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: displaying a set of one or more environmental control elements at the computer system; detecting input including selection of a first environmental control element from the set of one or more environmental control elements; and, in response to detecting the input including selection of the first environmental control element, setting corresponding environmental parameters for a corresponding location of a region, the setting including: setting corresponding environmental parameters for a first location based on a determination that the computer system is located at a first location relative to the region; and setting corresponding environmental parameters for a second location based on a determination that the computer system is located at a second location relative to the region, different from the first location.
[0016] According to some embodiments, a computer system is described. The computer system includes: means for displaying a set of one or more environmental control elements at the computer system; means for detecting input including selection of a first environmental control element from the set of one or more environmental control elements; and means for: in response to detecting the input including selection of the first environmental control element, setting corresponding environmental parameters for a corresponding location of a region, the setting including: setting corresponding environmental parameters for a first location based on a determination that the computer system is located at a first location relative to the region; and setting corresponding environmental parameters for a second location based on a determination that the computer system is located at a second location relative to the region, different from the first location.
[0017] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system. The one or more programs include instructions for: displaying a set of one or more environmental control elements at the computer system; detecting input including selection of a first environmental control element from the set of one or more environmental control elements; and, in response to detecting the input including selection of the first environmental control element, setting corresponding environmental parameters for a corresponding location of a region, the setting including: setting corresponding environmental parameters for a first location based on a determination that the computer system is located at a first location relative to the region; and setting corresponding environmental parameters for a second location based on a determination that the computer system is located at a second location relative to the region, different from the first location.
[0018] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.
[0019] Therefore, faster and more efficient methods and interfaces are provided to devices for controlling areas, thereby improving the effectiveness, efficiency, and user satisfaction of such devices. These methods and interfaces can complement or replace other methods used for controlling areas. Attached Figure Description
[0020] To better understand the various described embodiments, reference should be made to the following detailed description in conjunction with the accompanying drawings, in which similar reference numerals indicate corresponding parts throughout the drawings.
[0021] Figure 1 This is a block diagram illustrating a system with various components according to some implementation schemes.
[0022] Figures 2A to 2I Example techniques for controlling areas according to some implementation schemes are illustrated.
[0023] Figure 3 This is a flowchart illustrating a method for controlling a region according to some implementation schemes.
[0024] Figures 4A to 4K Example techniques for controlling environmental parameters of a region, according to some implementation schemes, are illustrated.
[0025] Figure 5 This is a flowchart illustrating a method for controlling environmental parameters of a region according to some implementation schemes. Detailed Implementation
[0026] The following description illustrates exemplary techniques for controlling regions. This description is not intended to limit the scope of this disclosure, but is provided as a description of exemplary implementations.
[0027] Users require electronic devices that offer efficient technology for controlling the area. Efficient technology reduces the psychological burden on users when controlling the area. This reduction in psychological burden can improve user productivity and make the device easier to use. In some implementations, the technologies described herein can reduce battery usage and processing time (e.g., by providing a user interface that requires less user input to operate).
[0028] Figure 1 An illustration is provided of an exemplary device for performing techniques for controlling a region. Figures 2A to 2I An exemplary user interface for controlling a region is illustrated according to some implementation schemes. Figure 3 This is a flowchart illustrating a method for controlling a region according to some implementation schemes. Figures 2A to 2I The user interface in the document is used to illustrate the processes described below, including Figure 3 The process in. Figures 4A to 4K An exemplary user interface for controlling environmental parameters of a region, according to some implementation schemes, is illustrated. Figure 5 This is a flowchart illustrating a method for controlling environmental parameters of a region according to some implementation schemes. Figures 4A to 4K The user interface in the document is used to illustrate the processes described below, including Figure 5 The process in.
[0029] The following process describes various techniques used to make user interfaces and / or human-computer interaction more efficient (e.g., by helping users provide input quickly and easily and preventing user errors when operating the device). These techniques sometimes reduce the amount of input required for users (e.g., people and / or users) to perform actions, provide users with clear and / or meaningful feedback (e.g., visual, acoustic, and / or haptic feedback) so that users know what is happening or what is expected, provide additional information and controls without cluttering the user interface, and / or perform certain actions without requiring further input from the user. Because users can use the device more quickly and easily, these techniques can sometimes improve battery life and / or reduce the device's power consumption.
[0030] In a method where one or more steps depend on the satisfaction of one or more conditions, it should be understood that the described method can be repeated in multiple repetitions such that, during the repetitions, all the conditions on which the steps of the method depend have been satisfied in different repetitions of the method. For example, if the method requires performing a first step if a condition is satisfied, and a second step if a condition is not satisfied, it should be understood that these steps are repeated until both conditions are satisfied and not satisfied (in no particular order). Therefore, a method described as having one or more steps depending on the satisfaction of one or more conditions can be rewritten as a method that repeats until each of the conditions described in the method has been satisfied. However, system or computer-readable medium claims do not require such multiple repetitions, where the system or computer-readable medium contains instructions for performing conditional operations that require the satisfaction of one or more conditions prior to the operation. Those skilled in the art will also understand that, similar to methods with conditional steps, a system or computer-readable storage medium can repeat the steps of a method multiple times as needed to ensure that all conditional steps have been performed.
[0031] The terminology used in the description of the various implementation schemes is for the purpose of describing a particular implementation scheme only and is not intended to be limiting.
[0032] The following describes user interfaces for electronic devices and the associated processes of using these devices. In some embodiments, the device is a desktop computer with a touch-sensitive surface (e.g., a touchscreen display and / or touchpad). In other embodiments, the device is a portable, mobile, and / or mobile electronic device (e.g., a processor, smartphone, smartwatch, tablet, fitness tracker, laptop, head-mounted display (HMD) device, public utility, vehicle, media device, smart speaker, smart display, robot, television, and / or personal computing device).
[0033] In some embodiments, the electronic device is a computer system that communicates with a display component (e.g., via wireless or wired communication). The display component may be integrated into the computer system or may be separate from the computer system. Additionally, the display component may be configured to provide visual output to a display (e.g., a liquid crystal display, an OLED display, or a CRT display). As used herein, "display" content includes displaying content (e.g., video data rendered or decoded by a display controller) by transmitting data (e.g., image data or video data) to an integrated or external display component via a wired or wireless connection to visually generate content. In some embodiments, visual output is any output that can be perceived by the human eye, including but not limited to images, videos, graphics, charts, and other graphical representations of data.
[0034] In some implementations, the electronic device is a computer system that communicates with the audio generation component (e.g., via wireless or wired communication). The audio generation component may be integrated into the computer system or may be separate from it. Additionally, the audio generation component may be configured to provide audio output. Examples of audio generation components include speakers, home theater systems, soundbars, headphones, in-ear headphones, earbuds, television speakers, augmented reality headset speakers, audio jacks, optical audio outputs, Bluetooth audio outputs, and / or HDMI audio outputs. In some implementations, the audio output is any output perceptible to the human ear, including but not limited to sound waves, music, speech, and / or other audible representations of data.
[0035] In the following discussion, electronic devices including specific input and output devices are described. However, it should be understood that electronic devices may optionally include one or more other input and / or output devices, such as physical user interface devices (e.g., physical keyboards, mice, and / or joysticks).
[0036] Figure 1 An example system 100 for implementing the techniques described herein is illustrated. System 100 can perform... Figure 3 and / or Figure 5 Any method described herein (e.g., method 300 and / or 500) and / or portions thereof.
[0037] exist Figure 1In this system 100, various components are included, such as processor 103, RF circuitry 105, memory 107, sensors 156 (e.g., image sensors, orientation sensors, position sensors, heart rate monitors, temperature sensors), input components 158 (e.g., cameras (e.g., periscope cameras, telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras), depth sensors, microphones, touch-sensitive surfaces, hardware input mechanisms, and / or rotatable input mechanisms), mobility components (e.g., actuators (e.g., pneumatic actuators, hydraulic actuators, and / or electric actuators), motors, wheels, movable bases, rotatable components, translational components, and / or rotatable bases), and output components 160 (e.g., speakers, display components, audio generation components, haptic output devices, displays, projectors, and / or touch-sensitive displays). These components optionally communicate via the system's communication bus 123. Although shown as separate components, in some specific implementations, various components may be combined and used as a single component; for example, a sensor may be an input component.
[0038] In some implementations, system 100 is a mobile and / or mobile device (e.g., a tablet, smartphone, laptop, head-mounted display (HMD) device, and / or smartwatch). In other implementations, system 100 is a desktop computer, embedded computer, and / or server.
[0039] In some embodiments, processor 103 includes one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some embodiments, memory 107 is one or more non-transitory computer-readable storage media (e.g., flash memory and / or random access memory) storing computer-readable instructions configured to be executed by processor 103 to perform the techniques described herein.
[0040] In some embodiments, RF circuit 105 includes circuitry for communicating with electronic devices and / or networks (e.g., the Internet, intranets, and / or wireless networks, such as cellular networks and wireless local area networks (LANs)). In some embodiments, RF circuit 105 includes circuitry for using near-field communication and / or short-range communication (such as Bluetooth). ® Circuits that communicate (or ultra-wideband).
[0041] In some embodiments, display 121 includes one or more monitors, projectors, and / or screens. In some embodiments, display 121 includes a first display for displaying an image to a user's first eye and a second display for displaying an image to a user's second eye. In such embodiments, corresponding images can be displayed simultaneously on the first and second displays. Optionally, the corresponding images include representations of the same virtual objects and / or the same physical objects from different viewpoints, thereby creating a parallax effect that provides the user with a stereoscopic effect of objects on the display. In some embodiments, display 121 is a single display. In such embodiments, for each of the user's eyes, the corresponding image is simultaneously displayed in a first and a second area of the single display. Optionally, the corresponding images include representations of the same virtual objects and / or the same physical objects from different viewpoints, thereby creating a parallax effect that provides the user with a stereoscopic effect of objects on the single display.
[0042] In some embodiments, system 100 includes a touch-sensitive surface 115 for receiving user input such as tap and swipe input. In some embodiments, display 121 and touch-sensitive surface 115 form a touch-sensitive display.
[0043] In some embodiments, sensor 156 includes sensors for detecting various conditions. In some embodiments, sensor 156 includes orientation sensors (e.g., orientation sensor 111) for detecting orientation and / or movement of an area. For example, system 100 uses orientation sensors to track changes in the position and / or orientation (sometimes collectively referred to as positioning) of system 100, such as relative to physical objects in the physical environment. In some embodiments, sensor 156 includes one or more gyroscopes, one or more inertial measurement units, and / or one or more accelerometers. In some embodiments, sensor 156 includes a Global Positioning Sensor (GPS) for detecting the GPS position of an area and / or platform. In some embodiments, sensor 156 includes a radar system, a LiDAR system, a sonar system, an image sensor (e.g., image sensor 109, a visible light image sensor, and / or an infrared sensor), a depth sensor, a rangefinder, and / or a motion detector. In some embodiments, sensor 156 includes sensors located within an internal portion of system 100 and / or sensors located externally to system 100. In some embodiments, system 100 uses sensors 156 (e.g., internal sensors) to detect the presence and / or state (e.g., location and / or orientation) of passengers within the interior of system 100. In some embodiments, system 100 uses sensors 156 (e.g., external sensors) to detect the presence and / or state of objects outside system 100. In some embodiments, system 100 uses sensors 156 to receive user input, such as hand gestures and / or other air gestures. In some embodiments, system 100 uses sensors 156 to detect the location and / or orientation of system 100 in the physical environment. In some embodiments, system 100 uses sensors 156 to navigate system 100 along a planned route, around obstacles, and / or to a destination location. In some embodiments, sensors 156 include one or more sensors for identifying and / or authenticating users of system 100, such as fingerprint sensors and / or facial recognition sensors.
[0044] In some embodiments, the image sensor includes one or more visible light image sensors, such as charge-coupled device (CCD) sensors and / or complementary metal-oxide-semiconductor (CMOS) sensors, capable of operating to acquire images of physical objects. In some embodiments, the image sensor includes one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light. For example, an active IR sensor may include an IR emitter for emitting infrared light, such as an IR point emitter. In some embodiments, the image sensor includes one or more cameras configured to capture movement of the physical object. In some embodiments, the image sensor includes one or more depth sensors configured to detect the distance between the physical object and system 100. In some embodiments, system 100 uses a combination of CCD sensors, cameras, and depth sensors to detect the physical environment surrounding system 100. In some embodiments, the image sensor includes a first image sensor and a second image sensor different from the first image sensor. In some embodiments, system 100 uses the image sensor to receive user input, such as hand gestures and / or other air gestures. In some embodiments, system 100 uses the image sensor to detect the position and / or orientation of system 100 in the physical environment.
[0045] In some implementations, system 100 uses an orientation sensor to detect the orientation and / or movement of system 100. For example, system 100 can use an orientation sensor to track changes in the position and / or orientation of system 100, such as relative to a physical object in the physical environment. In some implementations, the orientation sensor includes one or more gyroscopes, one or more inertial measurement units, and / or one or more accelerometers.
[0046] In some embodiments, system 100 uses microphones to detect sound from one or more users and / or the physical environment of one or more users. In some embodiments, the microphones include a microphone array (comprising multiple microphones) that optionally operates cooperatively, such as to identify ambient noise or locate sound sources in a space of the physical environment (e.g., inside and / or outside system 100).
[0047] In some embodiments, input component 158 includes one or more mechanical and / or electrical devices for detecting input, such as buttons, sliders, knobs, switches, remote controls, joysticks, touch-sensitive surfaces, keypads, microphones, and / or cameras. In some embodiments, input component 158 includes one or more input devices internal to system 100. In some embodiments, input component 158 includes one or more input devices (e.g., touch-sensitive surfaces and / or keypads) external to system 100.
[0048] In some embodiments, output device 160 includes one or more devices such as a display, monitor, projector, speaker, lamp, and / or haptic output device. In some embodiments, output device 160 includes one or more external output devices such as an external display screen, external lamp, and / or external speaker. In some embodiments, output device 160 includes one or more internal output devices such as an internal display screen, internal lamp, and / or internal speaker.
[0049] In some embodiments, environmental controls 162 include mechanical and / or electrical systems for monitoring and / or controlling the condition of the interior portion (e.g., cabin) of system 100. In some embodiments, environmental controls 162 include fans, heaters, air conditioners, and / or thermostats for controlling temperature and / or airflow within the interior portion of system 100.
[0050] In some embodiments, the mobility component includes mechanical and / or electrical components that enable the platform to move and / or assist in the movement of the area. In some embodiments, the mobility system 164 includes a power system, drivetrain, motor (e.g., electric motor), engine, power source (e.g., battery), transmission, suspension system, speed control system, and / or steering system. In some embodiments, one or more elements of the mobility component are configured to be controlled autonomously or manually (e.g., via system 100 and / or input component 158).
[0051] In some implementations, system 100 performs monetary transactions with or without another computer system. For example, system 100, or another computer system associated with and / or communicating with system 100 (e.g., via a user account described below), is associated with a user's payment account, such as a credit card account or checking account. To complete the transaction, system 100 may transmit a key to the entity purchasing goods and / or services from it, enabling the entity to charge the payment account for the transaction. As another example, system 100 stores encrypted payment account information and transmits this information to the entity purchasing goods and / or services from it to complete the transaction.
[0052] System 100 may optionally engage in other transactions with other systems, computers, and / or devices. For example, system 100 may engage in transactions to unlock another system, computer, and / or device and / or be unlocked by another system, computer, and / or device. Unlocking transactions may optionally include sending and / or receiving one or more secure cryptographic keys using, for example, RF circuitry 105.
[0053] In some implementations, system 100 is capable of communicating with other computer systems and / or electronic devices. For example, system 100 can use RF circuitry 105 to access a network connection that enables the transfer of data between systems for communication purposes. Example communication sessions include telephone calls, emails, SMS messages, and / or video conferencing communication sessions.
[0054] In some implementations, a video conferencing communication session includes the transmission and / or reception of video and / or audio data between systems participating in the video conferencing communication session (including system 100). In some implementations, system 100 uses sensor 156 to capture video and / or audio content for transmission to other systems during the video conferencing communication session using RF circuitry 105. In some implementations, system 100 uses RF circuitry 105 to receive video and / or audio from other systems in the video conferencing communication session and presents the video and / or audio using output components 160 (such as display 121 and / or speakers). In some implementations, the transmission of audio and / or video between systems is near real-time, such as presenting it to other systems with a delay of less than 0.1, 0.5, 1, or 3 seconds from the time the corresponding portion of the audio and / or video was captured.
[0055] In some embodiments, system 100 uses output component 160 to generate tactile (e.g., haptic) output. In some embodiments, output component 160 generates tactile output by shifting a movable mass relative to an intermediate position. In some embodiments, the tactile output is inherently periodic, optionally including a frequency and / or amplitude of movement in two or three dimensions. In some embodiments, system 100 generates a variety of different tactile outputs varying in the frequency, amplitude, and / or duration / number of cycles of the included movement. In some embodiments, the tactile output pattern includes a start buffer and / or an end buffer during which the movable mass gradually accelerates and / or decelerates at the beginning and / or end of the tactile output, respectively.
[0056] In some embodiments, the haptic output has a corresponding characteristic frequency that affects the "pitch" of the tactile sensation felt by the user. For example, a higher frequency corresponds to faster movement of the movable block, while a lower frequency corresponds to slower movement of the movable block. In some embodiments, the haptic output has a corresponding characteristic amplitude that affects the "intensity" of the tactile sensation felt by the user. For example, a higher amplitude corresponds to movement of the movable block over a greater distance, while a lower amplitude corresponds to movement of the movable block over a smaller distance. In some embodiments, the "pitch" and / or "intensity" of the haptic output varies over time.
[0057] In some embodiments, the tactile output is distinct from the movement of system 100. For example, system 100 may include a tactile output device that moves a movable mass to generate the tactile output, and may include other moving parts, such as motors, wheels, axles, control arms, and / or brakes, that control the movement of system 100. Although in some cases the movement and / or cessation of movement of system 100 generates vibrations and / or other physical sensations, these vibrations and / or other physical sensations are distinct from the tactile output. In some embodiments, system 100 generates the tactile output independently of the movement of system 100. For example, system 100 may generate the tactile output without accelerating, decelerating, and / or moving system 100 to a new position.
[0058] In some implementations, system 100 detects gesture input made by a user. In some implementations, gesture input includes touch gestures and / or air gestures, as described herein. In some implementations, the touch-sensitive surface 115 identifies touch gestures based on contact patterns (e.g., varying intensities, timings, and / or movements of an object touching or nearly touching the touch-sensitive surface 115). Thus, the touch-sensitive surface 115 detects gestures by detecting the corresponding contact patterns. For example, detecting a finger press event, followed by detecting a finger lift-off (e.g., lift-off) event at the same location as the finger press event (e.g., at the location of a user interface element) (e.g., substantially), may correspond to detecting a tap gesture on a user interface element. As another example, detecting a finger press event, followed by detecting movement of the contact, and subsequently detecting a finger lift-off (e.g., lift-off) event may correspond to detecting a swipe gesture. Additional and / or alternative touch gestures are possible.
[0059] In some embodiments, an air gesture is a gesture performed by a user without touching the input component 158. In some embodiments, an air gesture is based on detected movement of a portion of the user (e.g., hand, fingers, and / or body) through the air. In some embodiments, an air gesture includes movement of that portion of the user relative to a reference. Example references include the distance of the user's hand relative to a physical object (such as the ground), the angle of the user's arm relative to a physical object, and / or movement of a first portion of the user (e.g., hand or fingers) relative to a second portion of the user (e.g., shoulder, another hand, or another finger). In some embodiments, detecting an air gesture includes detecting absolute movement of that portion of the user, such as a tapping gesture including a hand moving in a predetermined posture with a predetermined amount and / or speed, or a shaking gesture including a portion of the user moving with a predetermined speed or amount of rotation.
[0060] In some implementations, detecting one or more inputs includes detecting the user's speech. In some implementations, system 100 uses one or more microphones of input component 158 to detect when the user utters one or more words. In some implementations, system 100 parses information and / or transmits information to one or more other systems to determine the content of the user's speech, including identifying words and / or obtaining semantic understanding of the words. For example, system processor 103 may be configured to perform natural language processing to detect one or more words and / or determine the possible meaning of one or more words in a sequence spoken by the user. Additionally or alternatively, in some implementations, system 100 determines the meaning of one or more words in a sequence spoken based on the context of the user determined by system 100.
[0061] In some implementations, system 100 outputs spatial audio via output component 160. In some implementations, spatial audio is output at a specific location. For example, system 100 may play a notification ringtone with one or more characteristics that cause the notification ringtone to be generated as if it were emitted from a first location relative to the user's current viewpoint (e.g., "spatialization" includes modifying the audio in amplitude, filtering, and / or delaying it to provide the user with perceived spatial quality).
[0062] In some embodiments, system 100 presents visual and / or audio feedback indicating the user's current position relative to another user's current viewpoint, thereby informing the other user of their updated position. In some embodiments, playing audio corresponding to the user includes altering one or more characteristics of audio obtained from another computer system to simulate the effect of placing an audio source generating the playback of the audio within the user's corresponding position, such as the position the user has moved to, generated from, and / or assigned to within a three-dimensional environment. In some embodiments, the relative magnitude of audio at one or more frequencies and / or frequency groups is altered, one or more filters are applied to the audio (e.g., directional audio filters), and / or the magnitude of audio provided via one or more channels is altered (e.g., increased or decreased) to produce the perceived effect of a physical audio source. In some embodiments, the simulated position of the simulated audio source relative to the floor of the three-dimensional environment is matched to the height of the participant's head, or one or more predetermined heights relative to the floor of the three-dimensional environment, of the participant providing the audio generated by the simulated audio source. In some embodiments, based on the user's position corresponding to a second position different from a first position and the determination that one or more first criteria are met, system 100 presents feedback, including generating audio as if it were emanating from the second position.
[0063] In some embodiments, system 100 communicates with one or more accessory devices. In some embodiments, one or more accessory devices are integrated with system 100. In some embodiments, one or more accessory devices are external to system 100. In some embodiments, system 100 communicates with accessory devices using RF circuitry 105 and / or using a wired connection. In some embodiments, system 100 controls the operation of accessory devices such as doors, windows, locks, speakers, lights, and / or cameras. For example, system 100 may control the operation of a motorized door of system 100. As another example, system 100 may control the operation of a motorized window included in system 100. In some embodiments, accessory devices used as input devices, such as remote controls and / or other computer systems (e.g., smartphones, media players, tablets, computers, and / or wearable devices), control the operation of system 100. For example, a wearable device (e.g., a smartwatch) is used as a key to initiate the operation of the actuation system of system 100. In some implementations, system 100 acts as an input device to control the operation of another system, device, and / or computer, such as area 100 acting as a key to initiate the operation of an actuation system of an area and / or platform associated with another system, device, and / or computer.
[0064] In some implementations, the digital assistant assists the user in using System 100 to perform various functions. For example, the digital assistant may provide weather updates, set alarms, and perform searches locally and / or via a network connection (e.g., the Internet) using a natural language interface. In some implementations, the digital assistant accepts requests that are at least partially in the form of natural language commands, narrations, requests, statements, and / or inquiries. In some implementations, the user uses the digital assistant to request informational answers and / or the execution of tasks. For example, in response to receiving the question “What is the current temperature?”, the digital assistant answers “The current temperature is 30 degrees.” As another example, in response to receiving a request to perform a task, such as “Please invite my family to dinner tomorrow,” the digital assistant may acknowledge the request by playing spoken words such as “Okay, right away,” and then send the requested calendar invitations on behalf of the user to each family member listed in the user’s contact list. In some implementations, the digital assistant engages in a continuous dialogue with the user during the execution of a user-requested task, which involves multiple exchanges of information over a period of time. Other ways of interacting with the digital assistant may involve requesting the execution of tasks and / or requesting information. For example, a digital assistant may respond to a user in other forms, such as displayed warnings, text, video, animation, music, etc. In some embodiments, the digital assistant includes a client-side portion executing on system 100 and a server-side portion executing on a server communicating with system 100. The client-side portion may communicate with the server via a network connection using RF circuitry 105. For example, the client-side portion may provide client-side functionality, input and / or output processing, and / or communication with the server. In some embodiments, the server-side portion provides server-side functionality for any number of client-side portions across multiple systems.
[0065] In some implementations, system 100 is associated with one or more user accounts. In some implementations, system 100 stores and / or encrypts user data, including files, settings, and / or preferences associated with a specific user account. In some implementations, user accounts are password protected, and system 100 requires user authentication before accessing user data associated with an account. In some implementations, user accounts are associated with other systems, devices, and / or servers. In some implementations, associating a user account with multiple systems enables those systems to access, update, and / or synchronize user data associated with the user account. For example, systems associated with a user account may have access to purchased media content, contact lists, communication sessions, payment information, stored passwords, and other user data. Therefore, in some implementations, user accounts provide security mechanisms for a customized user experience.
[0066] Figures 2A to 2IExample techniques for controlling areas according to some implementation schemes are illustrated. Figure 3 This is a flowchart of an exemplary method 300 for controlling a region according to some implementation schemes. Figures 2A to 2I The example implementation shown is used to illustrate the process described below, including Figure 3 The process in.
[0067] Figure 2A A zone 200, a user 210, and a computer system 204 associated with the user 210 are shown. Zone 200 includes a display 202. In some embodiments, the display 202 is controlled by a computer system included in and / or communicating with zone 200. Figure 2A In this case, user 210 is outside area 200, and computer system 204 displays user interface 208 (e.g., home screen) on display 206 (e.g., touch-sensitive display).
[0068] exist Figure 2B In the middle, user 210 approaches area 200. In response to detecting that one or more proximity conditions are met, including that the distance between computer system 204 and area 200 is less than a threshold distance, computer system 204 displays prompt 212. Figure 2B In the illustrated implementation, computer system 204 extends the area 213 of user interface 208 (e.g., with...). Figure 2A Compared to the configuration of zone 213, prompt 212 is displayed in zone 213.
[0069] exist Figure 2B In this process, computer system 204 detects input 250a from selection prompt 212 (e.g., a tap and / or other input). In response to the detection of input 250a, computer system 204 opens an application for controlling and / or displaying information associated with zone 200 (referred to herein as a zone control application), such as... Figure 2C As shown. In Figure 2C In the illustrated embodiment, computer system 204 displays an environmental control user interface 214 (e.g., corresponding to environmental control tab 218), which includes an ambient temperature control element 216a for controlling the temperature setting of area 200, a volume control element 216b for controlling the volume setting of area 200, a fan speed control element 216c for controlling the fan speed of area 200, and a seat temperature control element 216d for controlling the temperature of the seats within area 200 (collectively referred to as area control element 216). In some embodiments, the appearance of area control element 216 indicates the status of the current settings and / or corresponding settings.
[0070] In response to detecting input 250c (e.g., a swipe gesture and / or other input) corresponding to a request to leave the user interface 214, the computer system 204 displays (e.g., returns to) the user interface 208, such as Figure 2B As shown. In some embodiments, in response to the detection of input 250c, computer system 204 displays a reference. Figures 2G to 2I The user interface 234 is described. In response to detecting an input 250b (e.g., a drag gesture, swipe gesture, and / or other input) to an ambient temperature control element 216a corresponding to a request to lower the temperature in region 200, the computer system 204 lowers the ambient temperature setting of region 200, as determined by... Figure 2D The appearance of the ambient temperature control element 216a is indicated.
[0071] In some implementations, in response to detection Figure 2D Input 250e (e.g., pressing and / or activating button 205), computer system 204 displays a reference. Figures 2G to 2I The user interface 234 is described. In response to the detection of a selection... Figure 2D In the Media Control tab 220, input 250d (e.g., tap and / or other input), and the computer system 204 displays the Media Control user interface 224, such as... Figure 2E As shown in the middle. The media control user interface 224 includes a media queue 226 for playback of media items (e.g., songs and / or tracks) in area 200, including media item 226a (e.g., the current track), media item 226b (e.g., the next track to be played after the current track), and media item 226c (e.g., the last track in media queue 226). In response to detecting input 250f corresponding to a request to edit media queue 226 (e.g., a drag gesture, swipe gesture, and / or other input), computer system 204 edits media queue 226 by moving media item 226c up to the next track to be played and moving media item 226b to the bottom or end of media queue 226, as shown. Figure 2E As shown on the right. In response to detecting input 250f (e.g., a tap and / or other input) to select playback control element 228 (e.g., a play button), computer system 204 initiates playback of the media item (e.g., "track 1") at the top or beginning of media queue 226 in area 200 by changing the appearance of playback control element 228 (e.g., changing from a play symbol to a pause symbol), as shown on the right. Figure 2E As indicated on the right side.
[0072] exist Figure 2EIn the process, computer system 204 detects input 250g (e.g., a tap and / or other input) for selecting navigation tab 222. In response to detecting input 250g, computer system 204 displays navigation user interface 230, which includes a destination queue 232 for planned destinations in region 200, such as... Figure 2F As shown in the middle. Destination queue 232 includes a first destination 232a (e.g., the current destination for region 200), a second destination 232b (e.g., an intermediate destination for region 200), and a third destination 232c (e.g., the final destination for region 200). In response to detecting input 250h corresponding to a request to edit destination queue 232 (e.g., a drag gesture, swipe gesture, and / or other input), computer system 204 edits destination queue 232 for region 200 by moving the third destination 232c to the top of destination queue 232, as shown in the middle. Figure 2F As shown on the right.
[0073] exist Figure 2F In this context, computer system 204 detects input 250i (e.g., drag gesture, swipe gesture, and / or other input) corresponding to a request to navigate away from the user interface of the area control application. In some implementations, in response to detecting input 250i, computer system 204 displays, for example... Figure 2B The user interface 208 shown (e.g., with a prompt 212 corresponding to the area control application in zone 213). In some embodiments, when the computer system 204 navigates away from the area control application, the computer system 204 runs the area control application as a background process. In some embodiments, the computer system 204 initiates the area control application in response to detecting that one or more proximity conditions are met and runs the area control application as a background process (e.g., in...). Figure 2B middle).
[0074] Go to Figure 2GComputer system 204 displays user interface 234. In some embodiments, user interface 234 is a wake-up screen displayed when computer system 204 is in a low-power state or when computer system 204 transitions from a low-power state. In some embodiments, user interface 234 is a lock screen displayed when computer system 204 is in a state in which only a predetermined set of functions is available. For example, in some embodiments, when computer system 204 is locked, flashlight functionality can be activated by selecting flashlight icon 238, and the camera application can be activated by selecting camera icon 240. Because user 210 is in area 200, computer system 204 displays area control element 236 when displaying user interface 234. Area control element 236 includes an environment control tab 218, a media control tab 220, and a navigation tab 222 for accessing information and / or selectable options for controlling area 200. In some embodiments, the user can customize the control elements displayed in area control element 236 (e.g., via a settings menu on computer system 204). In some implementations, if user 210 is not in region 200 but is within a threshold distance of region 200, computer system 204 displays different content and / or controls in region control element 236. For example, in Figure 2H In this case, because user 210 is not inside area 200, but within a threshold distance of area 200, computer system 204 displays area control element 236 with destination indication label 242a, battery level indication label 242b (e.g., an indication of the battery and / or charging level of area 200), and lock status indication label 242c (e.g., an indication of the lock status of area 200). In some embodiments, if user 210 is not within the threshold distance of area 200, computer system 204 displays user interface 234 without area control element 236, such as... Figure 2I As shown.
[0075] The following text refers to... Figure 3 The described method 300 provides information about Figures 2A to 2I Additional description.
[0076] Figure 3This is a flowchart of an exemplary method 300 for controlling a region according to some embodiments. In some embodiments, method 300 is performed at a computer system (e.g., computer systems 152 and / or 204) and / or a region (e.g., region 200, platform, vehicle, vehicle interior, vehicle cabin, and / or a portion thereof). In some embodiments, method 300 is managed by instructions stored in a non-transitory (or transient) computer-readable storage medium and executed by one or more processors of the computer system (e.g., 152 and / or 204), such as one or more processors 103 of system 100. Some operations in method 300 may optionally be combined, and / or the order of some operations may optionally be changed.
[0077] In some implementations, a computer system (e.g., 152, 202, 204, and / or 404) (e.g., a smartphone, smartwatch, tablet computer, and / or head-mounted display device) detects (302) (e.g., via GPS and / or one or more sensors, such as ultra-wideband sensors and / or near-field communication sensors) that satisfies a set of one or more proximity conditions, wherein the set of one or more proximity conditions includes distance conditions that are satisfied when the distance (e.g., physical distance, measurable distance, measured distance, and / or estimated distance) between the computer system and an area (e.g., 200, vehicle, car, truck, automobile, van, and / or bus) is determined to satisfy (e.g., less than, equal to, or less than or equal to) a threshold distance (e.g., 0 feet, 5 feet, 10 feet, 25 feet, 50 feet, or 100 feet). In response to detecting that one or more proximity conditions are met, the computer system displays (304) a prompt (e.g., 212) (e.g., a user interface element, a user-interactive user interface element, a button, a selectable icon, and / or a power indicator) to open a region control application (e.g., to launch, execute, and / or display the user interface of the region control application) (e.g., 212) (e.g., a user interface element, a user-interactive user interface element, a button, a selectable icon, and / or a power indicator) that the region control application is configured to perform one or more functions associated with a region. When the prompt to open the region control application is displayed, the computer system detects (306) (e.g., via one or more input devices such as 206, a touch-sensitive surface 115, an input device 158, a mouse, and / or a button) including input (e.g., 250a) that includes a selection of the prompt (e.g., a touch gesture on a touch-sensitive surface, an air gesture, a voice command, a button press, and / or other selection input). In response to the detection of input including selection of a prompt, the computer system displays (308) a user interface of the area control application (e.g., 214, 224, or 230), including displaying one or more selectable elements (e.g., 216, 226, 228, and / or 232) including area control elements (e.g., 216a, 216b, 216c or 216d, 226a, 226b, 226c, 228, 232a, 232b, or 232c) in the user interface of the area control application. The computer system detects (310) input including selection of an area control element (e.g., 250b, 250f, and / or 250h) (e.g., touch gestures on a touch-sensitive surface, air gestures, voice commands, button presses, and / or other selection inputs). In response to detecting input including a selection of a region control element, the computer system requests (312) the region to perform an operation corresponding to the region control element (e.g., the computer system initiates, transmits, and / or sends (e.g., via wireless communication) instructions to the region to perform the operation corresponding to the region control element). Figures 2C to 2DChanging environmental parameters; such as Figure 2E Controlling media playback; such as Figure 2E In the queue of edit media projects, and / or as Figure 2F Edit destination queue in the middle.
[0078] In some implementations, based on (or in some implementations, in response to) the computer system's determination within the area (e.g., having entered the area and / or within the area such as the interior of a cockpit) (e.g., as... Figures 2C to 2G As shown), the computer system executes (e.g., runs) the region control application as a background process on the computer system (e.g., without displaying the user interface of the region control application). In some implementations, the computer system executes the region control application as a background process before a selection is made on the prompt and / or after closing and / or navigating away from the user interface of the region control application.
[0079] In some embodiments, displaying a prompt includes: displaying the prompt in a dynamic area (e.g., 213) of the computer system's display (e.g., 206) based on the computer system's determination within the area. In some embodiments, the dynamic area includes a contracted state covering a first area and an expanded state occupying a second area, and the prompt is displayed in the portion of the second area not included in the first area. In some embodiments, displaying a prompt includes expanding the dynamic area (e.g., changing the dynamic area from a contracted state to an expanded state), and displaying the prompt in the dynamic area while the dynamic area is expanded. In some embodiments, the prompt is displayed in the dynamic area while the computer system is displaying the home screen, lock screen, wake screen, application pop-up, and / or a user interface other than the user interface of the area control application (e.g., the user interface of a different application). In some embodiments, the home screen and / or application pop-up includes a plurality of selectable application icons corresponding to a respective application, which, when an application icon is selected, cause the computer system to open the application corresponding to the selected application icon. In some implementations, the wake-up screen is a user interface displayed when the computer system is in a low-power state and / or a resting state and / or when the computer system transitions from a low-power state and / or a resting state to a normal operating state.
[0080] In some embodiments, the computer system stops displaying the user interface of the area control application; when the user interface of the area control application is not displayed (e.g., when the computer system is displaying the home screen, lock screen, wake screen, application jump, and / or a user interface other than the user interface of the area control application), the computer system displays an interactive area control user interface element (e.g., 236) including one or more selectable control elements (e.g., 218, 220, and / or 222); the computer system detects user input (e.g., 250k) including selection of a first control element among the one or more selectable control elements; and in response to detecting the selection of the first control element, the computer system requests (e.g., transmits and / or sends instructions via wireless communication) the area to perform an operation corresponding to the first control element. In some embodiments, the interactive area control user interface element is displayed when the computer system is in a locked state (e.g., a user interface locked state), in which the functionality of the computer system is limited to a predetermined set of functions.
[0081] In some embodiments, displaying interactive area control user interface elements includes displaying interactive area control user interface elements with context-based content (e.g., the state of the computer system and / or the location of the computer system). In some embodiments, displaying interactive area control user interface elements includes: determining the location of the computer system (or, in some embodiments, the user associated with the computer system) within the area (e.g., ...). Figure 2G As shown), this displays selectable control elements having a first group of one or more selectable control elements (e.g., when selected, enabling the computer system to control playback of media (e.g., songs and / or videos) played in the area and / or control the environmental settings (e.g., temperature and / or fan speed) of the area) (e.g., such as...). Figure 2G The interactive region control user interface element shown in 236). In some embodiments, displaying the interactive region control user interface element includes: determining whether the computer system (or, in some embodiments, the user associated with the computer system) is not inside the region (e.g., outside the region) (e.g., as shown in 236). Figure 2H As shown), it displays an interactive area control user interface element (e.g., such as) having a second group of one or more selectable control elements (e.g., different from the first group of one or more selectable control elements) (e.g., including selectable control elements that lock or unlock areas of the computer system when selected). Figure 2H 236 shown).
[0082] In some implementations, the set of one or more proximity conditions does not require the computer system to have an account associated with the region (e.g., the computer system can control the region without having an account associated with it). In some implementations, the set of one or more proximity conditions does not require the computer system to have previously performed configuration associated with the region (e.g., the computer system does not need to have previously set up access to the region and / or set up an account associated with it) (e.g., the computer system can control the region without prior setup).
[0083] In some implementations, the operations corresponding to the area control element include controlling (e.g., setting, changing, selecting, and / or adjusting) the area's environmental (e.g., climate) control parameters (e.g., fan speed, temperature, air conditioning status, heater status, and / or vent settings) (e.g., as referenced). Figures 2C to 2D (As described). In some implementations, operations corresponding to a region control element include controlling (e.g., setting, changing, selecting, and / or adjusting) media parameters for the region (e.g., media source, media channel, media item for playback, playback settings (such as play, stop, pause, and / or skip) and / or media queue) (e.g., as described in reference). Figure 2E (As described). In some implementations, the operations corresponding to the region control element include controlling (e.g., setting, changing, selecting, and / or adjusting) destination parameters for the region (e.g., destination, initial destination, current destination, final destination, intermediate destinations, and / or destination queues for the region) (e.g., as described in reference). Figure 2F (As described). In some implementations, operations corresponding to a region control element include editing queues associated with the region (e.g., queues of media items and / or queues of locations such as destinations) (e.g., adding items to the queue, removing items from the queue, and / or rearranging items currently in the queue) (e.g., as described regarding Figure 2E Media queue 226 and / or Figure 2F (As described in destination queue 232). In some embodiments, the computer system detects input including selection of user interface settings (e.g., configuration, appearance, and / or one or more elements) for a region-specific user interface (e.g., selection of an application, graphical element, and / or selectable element to be included in one or more selectable elements), wherein displaying the user interface of the region control application (e.g., 214, 224, and / or 230) includes displaying the user interface of the region control application according to the user interface settings (e.g., a user can customize the application's menus and / or controls on the user interface of the region control application).
[0084] Figures 4A to 4KThe user interface and techniques for controlling environmental parameters of a region are illustrated according to some implementation schemes. Figure 5 This is a flowchart of an exemplary method 500 for controlling environmental parameters of a region according to some implementation schemes. Figures 4A to 4K The example implementation shown is used to illustrate the process described below, including Figure 5 The process in.
[0085] Figure 4A User 210 is shown, where computer system 204 is outside region 200. (See above for reference.) Figures 2A to 2I User 210, computer system 204, and region 200 are described. Figure 4A Indicates two designated locations (e.g., areas, zones, and / or seats) within area 200, locations 400a and 400b. Figure 4A In this context, the public area 415 within the interior portion of region 200 has an environmental state S0. In some embodiments, the environmental state includes temperature, fan speed, humidity, pressure, volume, and / or heater settings. Location 400a has an environmental state S1, and location 400b has an environmental state S2.
[0086] exist Figure 4B In this scenario, user 210 enters area 200 and occupies position 400a within area 200. In response to user 210 entering area 200 and occupying position 400a, area 200 sets position 400a to environment state S3 (e.g., changes position 400a from environment state S1 to environment state S3), while maintaining the environment states of the public areas (e.g., under S0) and position 400b (e.g., under S2) within the internal portion of area 200.
[0087] Figure 4B The user interface 214 is shown (e.g., referenced above). Figures 2C to 2D An enlarged view of the computer system 204 (as described). Figure 4B In this process, computer system 204 detects input 450a (e.g., drag gesture, swipe gesture, and / or other input) on fan speed control element 216c corresponding to a request to increase fan speed. Figure 4C As shown, in response to the detection of input 450a, the temperature in region 200 is adjusted at position 400a (e.g., as indicated by the change of the state at position 400a from S3 to S4) without changing the state of common area 415 and without changing the state of position 400b (e.g., only changing the state of position 400a).
[0088] exist Figure 4C In the above scenario, user 210 moves from position 400a to position 400b. (For example...) Figure 4DAs shown, in response to detecting user 210 at the new location 400b, region 200 changes the state of location 400b to S4 (e.g., the state of location 400a before user 210 moves from location 400a to location 400b). In some embodiments, region 200 changes the state of location 400b to S4 in response to automatically detecting user 210 at location 400b without input from user 210. In this way, the state associated with user 210 can automatically move with user 210. Figure 4D As shown, in some implementations, when user 210 moves from location 400a, area 200 automatically changes the state of location 400a to the state of location 400a before user 210 occupied it (e.g., as shown). Figure 4A The state shown is S1.
[0089] exist Figure 4D In this process, computer system 204 detects input 450b corresponding to a request to change the seat temperature (e.g., a drag gesture, a swipe gesture, and / or other input). In response to the detection of input 450b, because user 210 occupies position 400b, the state at position 400b is changed to S5 (e.g., due to the change in seat temperature based on input 450b) without changing the state of the common area 415 or the state of position 400a. Figure 4E As shown.
[0090] Go to Figure 4F User 402 enters area 200 and occupies position 400a. User 402 is associated with electronic device 404. When user 402 enters area 200, user 402 is associated with electronic device 404. Figure 4F The settings indicated by the user interface 214 displayed on the display 406 of the electronic device 404 are associated with state S6. User interface 214 has been described above with reference to computer system 204. In some embodiments, the electronic device 404 of user 210 includes the same area control application used by user 402 to control settings of area 200. In response to detecting user 402 at location 400a, area 200 sets location 400a to the state associated with user 402 (e.g., state S6) without changing the state of public area 415 or the state of location 400b.
[0091] exist Figure 4FIn the process, user 402's electronic device 404 detects input 450c (e.g., drag gesture, swipe gesture, and / or other input) corresponding to a request to adjust the temperature setting. In response to the detection of input 450c, because user 402 is at position 400a, the state of position 400a changes to S7 (e.g., by lowering the temperature setting at position 400a) without changing the state of the common area 415 or the state of position 400b, as shown. Figure 4G As shown.
[0092] Go to Figure 4H User 402's electronic device 404 displays a public environment control user interface 408, which includes control elements 410a to 410c for controlling the state of the public area 415. In response to detecting input 450d corresponding to a request to change the fan speed (e.g., a drag gesture, swipe gesture, and / or other input), the state of the public area 415 is changed to S8 without changing the state of position 400a or position 400b. Figure 4I As shown. In this way, user 402 can control the state of public area 415 without affecting other areas of area 200.
[0093] Go to Figure 4J Region 200, User 210, and User 402 are in the same position as... Figure 4I The same configuration is shown, and an enlarged view of user 210's computer system 204 is displayed. Computer system 204 displays the user interface 408 for controlling the status of the public area 415, as described above with reference to user 4022's electronic device 404. Figure 4J In the process, computer system 204 detects input 450e corresponding to a request to adjust the temperature setting (e.g., drag gesture, swipe gesture, and / or other input). In response to the detection of input 450e, without changing the state of position 400a or position 400b, the state of the common area 415 changes to S9, as shown. Figure 4K As shown. In this way, user 210 can control the state of public area 415 without affecting other areas of area 200.
[0094] The following text refers to... Figure 5 The described method 500 provides information about Figures 4A to 4K Additional description.
[0095] Figure 5This is a flowchart of an exemplary method 500 for controlling environmental parameters of a region according to some embodiments. In some embodiments, method 500 is performed at a computer system (e.g., computer system 152) and / or a region (e.g., region 200, platform, vehicle, vehicle interior, vehicle cabin, and / or a portion thereof). In some embodiments, method 500 is managed by instructions stored in a non-transitory (or transient) computer-readable storage medium and executed by one or more processors (such as one or more processors 103 of system 100) of the computer system (e.g., 152 and / or 204) and / or the region (e.g., platform, vehicle, and / or region 200). Some operations in method 500 may optionally be combined, and / or the order of some operations may optionally be changed.
[0096] In some embodiments, according to method 500, a computer system (e.g., 152, 202, 204, and / or 404) displays (502) (e.g., via a display device and / or display component of the computer system) a group of one or more environmental control elements (e.g., 216a to 216d) (e.g., user interface elements, user-interactive user interface elements, buttons, selectable icons, and / or display indicators). In some embodiments, the group of one or more environmental control elements is displayed in a user interface of an application that includes information and / or controls for a region (e.g., a vehicle). The computer system detects (504) input (e.g., via one or more input devices such as 206, a touch-sensitive surface 115, an input device 158, a mouse, and / or a button) (e.g., 250b, 450a, 450b, 450c, and / or 450d) (e.g., touch gestures on a touch-sensitive surface, air gestures, voice commands, button presses, and / or other selection inputs), which includes selection of a first environmental control element from the group of one or more environmental control elements. In response to detecting an input including the selection of a first environmental control element, the computer system sets (506) corresponding environmental parameters for a specific location (e.g., 400a or 400b) (e.g., a seat, section, part, and / or passenger position) (e.g., the interior and / or cabin of the area) within a region (e.g., region 200, platform, vehicle, vehicle interior, vehicle cabin, and / or part thereof) (e.g., within the area). This setting includes: based on the computer system's determination of its location relative to the region (e.g., within the area) at a first position (e.g., 400a and / or a first seat), the computer system sets (508) corresponding environmental parameters (e.g., temperature, temperature mode) for the first position (e.g., 400a). The computer system sets (510) appropriate environmental parameters for the second position (e.g., 400b and / or the second seat) based on the determination that the computer system is located at a second position (e.g., 400b) relative to the area (e.g., within the area) that is different from the first position (e.g., the environmental parameters at the second position are set instead of those at the first position) (e.g., the environmental parameters are set for the location of the computer system therein) (e.g., without setting and / or changing the first environmental parameters at the first position).
[0097] In some implementations, setting appropriate environmental parameters for a given location includes setting appropriate environmental parameters for a given location without setting appropriate environmental parameters for different locations within the region (e.g., without changing environmental parameters for any other locations within the region; setting environmental parameters only for the given location; setting appropriate environmental parameters for a first location without setting environmental parameters for a second location; and / or setting appropriate environmental parameters for a second location without setting environmental parameters for the first location) (e.g., as referenced). Figure 4C , Figure 4E and Figure 4G (as described).
[0098] In some implementations, when the computer system is in a third location (e.g., 400a or 400b) in the area different from the corresponding location, the computer system detects input (e.g., via one or more input devices) (e.g., 250b, 450a, 450b, 450c and / or 450d) (e.g., touch gestures on a touch-sensitive surface, air gestures, voice commands, button presses and / or other selection inputs), which includes selection of a first environmental control element from the group of one or more environmental control elements; and in response to detecting input including selection of the first environmental control element, the computer system sets corresponding environmental parameters for the third location (e.g., when in different locations in the area, the user can use the same inputs, user interface and / or control elements to control the same environmental parameters).
[0099] In some implementations, when setting appropriate environmental conditions for a given location, the computer system detects a new location (e.g., such as...) of the computer system (or, in some implementations, a user associated with the computer system) from the given location to a new location within the area. Figures 4C to 4D The location change shown is from 400a to 400b; and in response to detecting a location change from the corresponding location to the new location by the computer system, the computer system sets (e.g., automatically and / or without user input) the corresponding environmental parameters for the new location (e.g., setting location 400b to...). Figure 4D (State S4 in the middle).
[0100] In some implementations, the computer system detects that the computer system (or in some implementations, the user associated with the computer system) has entered the area (and in some implementations, the computer system is located at its initial position in the area) (e.g., user 210 enters). Figure 4BIn the context of area 200); and in response to detecting that a computer system has entered the area, the computer system sets (e.g., automatically and / or without user input) the environmental state of the computer system's (or, in some embodiments, the user associated with the computer system) location in the area (e.g., setting location 400a to state S3). In some embodiments, the environmental state is based on the user associated with the computer system (e.g., logged into the computer system) (e.g., the area automatically sets the environmental state of the computer system's location to the state associated with the user of the computer system) (e.g., ... Figure 4B State S3 in the context is associated with user 210, specific to that user, and / or customized for that user. For example, setting an environmental state for the location of the computer system in the area in response to detecting that the computer system has entered the area includes: setting the environmental state to a first set of environmental parameters (e.g., a set of environmental parameters associated with, customized for, and / or selected by the first user) based on a determination that the computer system is associated with a first user; and setting the environmental state to a second set of environmental parameters (e.g., a set of environmental parameters associated with, customized for, and / or selected by the second user) that is different from the first set of environmental parameters based on a determination that the computer system is associated with a second user different from the first user.
[0101] In some implementations, the corresponding environmental parameters include one or more of the following: air temperature (e.g., corresponding to 216a), fan speed (e.g., corresponding to 216tc), or seat temperature (e.g., corresponding to 216d).
[0102] In some implementations, aspects / operations of methods 300 and / or 500 may be interchanged, substituted, and / or added between these methods.
[0103] For illustrative purposes, this disclosure has been described with reference to specific embodiments. The above discussion is not intended to be exhaustive or to limit this disclosure and / or claims to specific embodiments. Modifications and / or variations are possible in light of this disclosure. Some embodiments have been selected and described to explain the principles of the technology and its practical application. Therefore, others skilled in the art will be able to utilize the technology and various embodiments with modifications and / or variations suitable for the specific intended use.
[0104] While this disclosure and its embodiments have been fully described with reference to the accompanying drawings, it should be noted that various changes and / or modifications will become apparent to those skilled in the art. It should be understood that such changes and / or modifications are considered to be included within the scope of this disclosure and its embodiments as defined by the claims.
[0105] The intention of this disclosure is that any personal information of users should be collected, managed, and processed in a manner that minimizes the risk of unintentional and / or unauthorized access and / or use.
[0106] Therefore, although this disclosure broadly covers the use of personal information to implement one or more embodiments, this disclosure also envisions that embodiments can be implemented without access to such personal information.
Claims
1. A method, the method comprising: The detection satisfies one or more proximity conditions, wherein the one or more proximity conditions include distance conditions that are satisfied when the distance between the computer system and the area is determined to satisfy a threshold distance; In response to detecting that one or more proximity conditions are met, a prompt to open a region control application is displayed, the region control application being configured to perform one or more functions associated with the region; When the prompt to open the region control application is displayed, input including a selection of the prompt is detected; In response to detecting the input including a selection of the prompt, the user interface of the region control application is displayed, including displaying one or more selectable elements including region control elements in the user interface of the region control application; The detection includes input for selecting the region control element; as well as In response to the detection of the input including the selection of the region control element, the region is requested to perform the operation corresponding to the region control element.
2. The method according to claim 1, further comprising: Based on the determination made by the computer system within the region, the region control application is executed on the computer system as a background process.
3. The method according to any one of claims 1 to 2, wherein displaying the prompt comprises: Based on the computer system's determination of the area, the prompt is displayed in the dynamic area of the computer system's display.
4. The method according to any one of claims 1 to 3, further comprising: Stop displaying the user interface of the area control application; When the user interface of the area control application is not displayed, an interactive area control user interface element including one or more selectable control elements is displayed; The detection includes user input regarding the selection of a first control element among the one or more selectable control elements; as well as In response to detecting a selection of the first control element, the computer system requests the region to perform an operation corresponding to the first control element.
5. The method of claim 4, wherein displaying the interactive region control user interface element includes displaying the interactive region control user interface element having context-based content.
6. The method of claim 5, wherein displaying the interactive area control user interface elements comprises: Based on the computer system's determination of the area, the interactive area control user interface elements, having a first group of one or more selectable control elements, are displayed.
7. The method according to any one of claims 5 to 6, wherein displaying the interactive area control user interface elements comprises: Based on the determination that the computer system is not within the area, the interactive area control user interface elements with a second group of one or more selectable control elements are displayed.
8. The method according to any one of claims 1 to 7, wherein the set of one or more proximity conditions does not require the computer system to have an account associated with the region.
9. The method according to any one of claims 1 to 8, wherein the set of one or more proximity conditions does not require the computer system to have previously performed a configuration associated with the region.
10. The method according to any one of claims 1 to 9, wherein the operation corresponding to the area control element includes controlling environmental control parameters of the area.
11. The method according to any one of claims 1 to 10, wherein the operation corresponding to the region control element includes controlling media parameters for the region.
12. The method according to any one of claims 1 to 11, wherein the operation corresponding to the region control element includes controlling the destination parameter for the region.
13. The method according to any one of claims 1 to 12, wherein the operation corresponding to the region control element includes editing the queue associated with the region.
14. The method according to any one of claims 1 to 13, further comprising: The detection includes input regarding the selection of user interface settings for the user interface targeting the region. The user interface for displaying the area control application includes displaying the user interface for the area control application according to the user interface settings.
15. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for performing the method according to any one of claims 1 to 14.
16. A computer system, the computer system comprising: One or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 14.
17. A computer system, the computer system comprising: Apparatus for performing the method according to any one of claims 1 to 14.
18. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 14.
19. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for: The detection satisfies one or more proximity conditions, wherein the one or more proximity conditions include distance conditions that are satisfied when the distance between the computer system and the area is determined to satisfy a threshold distance; In response to detecting that one or more proximity conditions are met, a prompt to open a region control application is displayed, the region control application being configured to perform one or more functions associated with the region; When the prompt to open the region control application is displayed, input including a selection of the prompt is detected; In response to detecting the input including a selection of the prompt, the user interface of the region control application is displayed, including displaying one or more selectable elements including region control elements in the user interface of the region control application; The detection includes input for selecting the region control element; as well as In response to the detection of the input including the selection of the region control element, the region is requested to perform the operation corresponding to the region control element.
20. A computer system, the computer system comprising: One or more processors; and The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: The detection satisfies one or more proximity conditions, wherein the one or more proximity conditions include distance conditions that are satisfied when the distance between the computer system and the area is determined to satisfy a threshold distance; In response to detecting that one or more proximity conditions are met, a prompt to open a region control application is displayed, the region control application being configured to perform one or more functions associated with the region; When the prompt to open the region control application is displayed, input including a selection of the prompt is detected; In response to detecting the input including a selection of the prompt, the user interface of the region control application is displayed, including displaying one or more selectable elements including region control elements in the user interface of the region control application; The detection includes input for selecting the region control element; as well as In response to the detection of the input including the selection of the region control element, the region is requested to perform the operation corresponding to the region control element.
21. A computer system, the computer system comprising: A means for detecting a set of one or more proximity conditions, wherein the set of one or more proximity conditions includes a distance condition that is satisfied when the distance between the computer system and the area is determined to be a threshold distance. A device for: displaying a prompt to open a region control application in response to detecting that one or more proximity conditions are met, the region control application being configured to perform one or more functions associated with the region; A device for: detecting input including a selection of the prompt when displaying the prompt to open the area control application; A device for: displaying a user interface of the region control application in response to detecting input including a selection of the prompt, including displaying one or more selectable elements including region control elements in the user interface of the region control application; A means for detecting inputs including the selection of the area control element; and A device for: in response to detecting the input including selection of the region control element, requesting the region to perform an operation corresponding to the region control element.
22. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs comprising instructions for performing the following operations: The detection satisfies one or more proximity conditions, wherein the one or more proximity conditions include distance conditions that are satisfied when the distance between the computer system and the area is determined to satisfy a threshold distance; In response to detecting that one or more proximity conditions are met, a prompt to open a region control application is displayed, the region control application being configured to perform one or more functions associated with the region; When the prompt to open the region control application is displayed, input including a selection of the prompt is detected; In response to detecting the input including a selection of the prompt, the user interface of the region control application is displayed, including displaying one or more selectable elements including region control elements in the user interface of the region control application; The detection includes input for selecting the region control element; as well as In response to the detection of the input including the selection of the region control element, the region is requested to perform the operation corresponding to the region control element.
23. A method, the method comprising: Displays a group or more environmental control elements on the computer system; The detection includes input for selecting a first environmental control element from the set of one or more environmental control elements; as well as In response to detecting the input including the selection of the first environmental control element, setting corresponding environmental parameters for the corresponding location of the region, the setting including: Based on the determination that the computer system is located at a first position relative to the region, the corresponding environmental parameters for the first position are set; as well as Based on the determination that the computer system is located at a second location relative to the region, different from the first location, the corresponding environmental parameters for the second location are set.
24. The method of claim 23, wherein setting the corresponding environmental parameter for the corresponding location includes setting the corresponding environmental parameter for the corresponding location without setting the corresponding environmental parameter for different locations in the region.
25. The method according to any one of claims 23 to 24, further comprising: When the computer system is at a third location in the region different from the corresponding location, it detects input including the selection of the first environmental control element in the set of one or more environmental control elements; and In response to the detection of the input including the selection of the first environmental control element, the corresponding environmental parameters for the third location are set.
26. The method according to any one of claims 23 to 25, further comprising: When setting appropriate environmental conditions for the corresponding location, the computer system detects changes in its positioning from the corresponding location to a new location in the region. as well as In response to detecting a change in the computer system's location from the corresponding location to the new location, corresponding environmental parameters are set for the new location.
27. The method according to any one of claims 23 to 26, further comprising: The computer system has been detected to have entered the area; as well as In response to the detection that the computer system has entered the area, an environmental state is set for the location of the computer system in the area.
28. The method of claim 27, wherein the environmental state is based on a user associated with the computer system.
29. The method according to any one of claims 23 to 28, wherein the corresponding environmental parameter includes one or more of air temperature, fan speed, or seat temperature.
30. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for performing the method according to any one of claims 23 to 29.
31. A computer system, the computer system comprising: One or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 23 to 29.
32. A computer system, the computer system comprising: Apparatus for performing the method according to any one of claims 23 to 29.
33. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs comprising instructions for performing the method according to any one of claims 23 to 29.
34. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for performing the following operations: Displays a group or more environmental control elements on the computer system; The detection includes input for selecting a first environmental control element from the set of one or more environmental control elements; as well as In response to detecting the input including the selection of the first environmental control element, setting corresponding environmental parameters for the corresponding location of the region, the setting including: Based on the determination that the computer system is located at a first position relative to the region, the corresponding environmental parameters for the first position are set; as well as Based on the determination that the computer system is located at a second location relative to the region, different from the first location, the corresponding environmental parameters for the second location are set.
35. A computer system, the computer system comprising: One or more processors; and The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: Displays a group or more environmental control elements on the computer system; The detection includes input for selecting a first environmental control element from the set of one or more environmental control elements; as well as In response to detecting the input including the selection of the first environmental control element, setting corresponding environmental parameters for the corresponding location of the region, the setting including: Based on the determination that the computer system is located at a first position relative to the region, the corresponding environmental parameters for the first position are set; as well as Based on the determination that the computer system is located at a second location relative to the region, different from the first location, the corresponding environmental parameters for the second location are set.
36. A computer system, the computer system comprising: A device for displaying a group or more environmental control elements at a computer system; A means for detecting an input including the selection of a first environmental control element from the set of one or more environmental control elements; and A device for: in response to detecting the input including selection of the first environmental control element, setting corresponding environmental parameters for a corresponding location of a region, the setting including: Based on the determination that the computer system is located at a first position relative to the region, the corresponding environmental parameters for the first position are set; as well as Based on the determination that the computer system is located at a second location relative to the region, different from the first location, the corresponding environmental parameters for the second location are set.
37. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs comprising instructions for performing the following operations: Displays a group or more environmental control elements on the computer system; The detection includes input for selecting a first environmental control element from the set of one or more environmental control elements; as well as In response to detecting the input including the selection of the first environmental control element, setting corresponding environmental parameters for the corresponding location of the region, the setting including: Based on the determination that the computer system is located at a first position relative to the region, the corresponding environmental parameters for the first position are set; as well as Based on the determination that the computer system is located at a second location relative to the region, different from the first location, the corresponding environmental parameters for the second location are set.