Techniques for changing states of devices

Abstract

The present disclosure generally relates to changing states of devices.

Description

TECHNIQUES FOR CHANGING STATES OF DEVICESCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] The present application claims priority to U.S. Provisional Patent Application Serial No. 63 / 540,036, entitled “TECHNIQUES FOR CHANGING STATES OF DEVICES,” filed September 22, 2023, which is hereby incorporated by reference in its entirety for all purposes.BACKGROUND

[0002] Electronic devices are becoming more and more ubiquitous in the home, but configuration and automation of electronic devices across devices, device types, manufacturers, and / or platforms typically require individual and / or manual setup and control.SUMMARY

[0003] Improved techniques for changing states of devices are desired. Current techniques for changing states of devices using electronic devices may involve complex and time-consuming configuration processes and / or multiple key presses or keystrokes. This disclosure provides more effective and / or efficient techniques for changing states of devices using examples of accessory devices. In addition, techniques optionally complement or replace other techniques for changing states of devices.

[0004] In some examples, a method that is performed by a first electronic device is described. In some examples, the method comprises: detecting movement of a subject from a first position to a second position; and after detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to a first location, causing a state of a first device to change.

[0005] In some examples, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device is described. In some examples, the one or more programs includes instructions for: detecting movement of a subject from a first position to a second position; and after detecting the movement of the subject to the second position and in accordance witha determination that the second position corresponds to a first location, causing a state of a first device to change.

[0006] In some examples, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device is described. In some examples, the one or more programs includes instructions for: detecting movement of a subject from a first position to a second position; and after detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to a first location, causing a state of a first device to change.

[0007] In some examples, a first electronic device comprising one or more processors and memory storing one or more programs configured to be executed by the one or more processors is described. In some examples, the one or more programs includes instructions for: detecting movement of a subject from a first position to a second position; and after detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to a first location, causing a state of a first device to change.

[0008] In some examples, a first electronic device is comprising means for performing each of the following steps: detecting movement of a subject from a first position to a second position; and after detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to a first location, causing a state of a first device to change.

[0009] In some examples, a computer program product is described. In some examples, the computer program product comprises one or more programs configured to be executed by one or more processors of a first electronic device. In some examples, the one or more programs include instructions for: detecting movement of a subject from a first position to a second position; and after detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to a first location, causing a state of a first device to change.

[0010] Executable instructions for performing these functions are, optionally, included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performingthese functions are, optionally, included in a transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.DESCRIPTION OF THE FIGURES

[0011] Embodiments described below in the Detailed Description may reference the following drawings.

[0012] FIG. 1 A is a block diagram illustrating an electronic device in accordance with some examples.

[0013] FIG. IB illustrates an exemplary electronic device in accordance with some examples.

[0014] FIGS. 2A-2B illustrate an environment with a subject changing position in accordance with some examples.

[0015] FIG. 3 is a flow diagram illustrating a method for changing states of devices in accordance with some examples.DETAILED DESCRIPTION

[0016] The following detailed description describes one or more different techniques that can be implemented as methods, devices, systems, computer readable mediums, and the like. This detailed description is intended to assist in understanding the scope of the present disclosure. It is not, however, intended to limit the scope of the present disclosure. For example, some of the phrases and terminology used below are for the purpose of providing examples rather than to limit the scope of the present disclosure.

[0017] Turning to FIGS. 1 A-1B, an example electronic device 100 is illustrated.Electronic device 100 is a non-limiting example of an electronic device that can be used to perform functionality described herein. With reference to the block diagram of FIG. 1 A, electronic device 100 includes processor subsystem 110 communicating with memory 120 (e.g., a system memory) and EO interface 130 via interconnect 150 (e.g., a system bus, one or more memory locations, or other communication channel for connecting multiple components of electronic device 100). In addition, EO interface 130 is communicating with (e.g., wired or wirelessly) EO device 140. In some examples, EO interface 130 is includedwith I / O device 140 such that the two are a single component. It should be recognized that there can be one or more I / O interfaces, with each I / O interface communicating with one or more I / O devices. In some examples, multiple instances of processor subsystem 110 can be communicating via interconnect 150.

[0018] Electronic device 100 can be any of various types of devices, including, but not limited to, a system on a chip, a server system, a personal computer system, a smart phone, a smart watch, a wearable device, a tablet, a laptop computer, a fitness tracking device, a headmounted display (HMD) device, a desktop computer, an accessory (e.g., switch, light, speaker, air conditioner, heater, window cover, fan, lock, media playback device, television, and so forth), a controller, a hub, and / or a sensor. In some examples, a sensor includes one or more hardware components that detect information about a physical environment in proximity of (e.g., surrounding) the sensor. In some examples, a hardware component of a sensor includes a sensing component (e.g., an image sensor or temperature sensor), a transmitting component (e.g., a laser or radio transmitter), and / or a receiving component (e.g., a laser or radio receiver). Examples of sensors include an angle sensor, a breakage sensor such as a glass breakage sensor, a chemical sensor, a contact sensor, a non-contact sensor, a flow sensor, a force sensor, a gas sensor, a humidity or moisture sensor, an image sensor (e.g., a RGB camera and / or an infrared sensor), an inertial measurement unit, a leak sensor, a level sensor, a metal sensor, a microphone, a motion sensor, a particle sensor, a photoelectric sensor (e.g., ambient light and / or solar), a position sensor (e.g., a global positioning system), a precipitation sensor, a pressure sensor, a proximity sensor, a radiation sensor, a range or depth sensor (e.g., RADAR, LiDAR), a speed sensor, a temperature sensor, a time-of-flight sensor, a torque sensor, and an ultrasonic sensor, a vacancy sensor, an voltage and / or current sensor, and / or a water sensor. In some examples, sensor data is captured by fusing data from one sensor with data from one or more other sensors. Although a single electronic device is shown in FIGS. 1A-1B, electronic device 100 can also be implemented as two or more electronic devices operating together.

[0019] In some examples, processor subsystem 110 includes one or more processors or processing units configured to execute program instructions to perform functionality described herein. For example, processor subsystem 110 can execute an operating system and / or one or more applications.

[0020] Memory 120 can include a computer readable medium (e.g., non-transitory or transitory computer readable medium) usable to store (e.g., configured to store, assigned to store, and / or that stores) program instructions executable by processor subsystem 110 to cause electronic device 100 to perform various operations described herein. For example, memory 120 can store program instructions to implement the functionality associated with method 300 described below.

[0021] Memory 120 can be implemented using different physical, non-transitory memory media, such as hard disk storage, optical drive storage, floppy disk storage, removable disk storage, removable flash drive, storage array, a storage area network (e.g., SAN), flash memory, random access memory (e g., RAM-SRAM, EDO RAM, SDRAM, DDR SDRAM, and / or RAMBUS RAM), and / or read only memory (e.g., PROM and / or EEPROM).

[0022] VO interface 130 can be any of various types of interfaces configured to communicate with other devices. In some examples, VO interface 130 includes a bridge chip (e.g., Southbridge) from a front-side bus to one or more back-side buses. VO interface 130 can communicate with one or more VO devices (e.g., VO device 140) via one or more corresponding buses or other interfaces. Examples of VO devices include storage devices (e.g., as described above with respect to memory 120), network interface devices (e.g., to a local or wide-area network), sensor devices (e.g., as described above with respect to sensors), a physical user-interface device (e.g., a physical keyboard, a mouse, and / or a joystick), and an auditory and / or visual output device (e.g., speaker, light, screen, and / or projector). In some examples, the visual output device is referred to as a display generation component. The display generation component is configured to provide visual output, such as display via an LED display or image projection. As used herein, “displaying” content includes causing to display the content (e.g., video data rendered or decoded by a display controller) by transmitting, via a wired or wireless connection, data (e.g., image data or video data) to an integrated or external display generation component to visually produce the content.

[0023] In some examples, VO device 140 includes one or more camera sensors (e.g., one or more optical sensors and / or one or more depth camera sensors), such as for recognizing a subject and / or a subject’s gestures (e.g., hand gestures and / or air gestures) as input. In some examples, an air gesture is a gesture that is detected without the user touching an input element that is part of the device (or independently of an input element that is a part of the device) and is based on detected motion of a portion of the user’s body through the airincluding motion of the user’s body relative to an absolute reference (e.g., an angle of the user’s arm relative to the ground or a distance of the user’s hand relative to the ground), relative to another portion of the user’s body (e.g., movement of a hand of the user relative to a shoulder of the user, movement of one hand of the user relative to another hand of the user, and / or movement of a finger of the user relative to another finger or portion of a hand of the user), and / or absolute motion of a portion of the user’s body (e.g., a tap gesture that includes movement of a hand in a predetermined pose by a predetermined amount and / or speed, or a shake gesture that includes a predetermined speed or amount of rotation of a portion of the user’s body).

[0024] In some examples, I / O device 140 is integrated with other components of electronic device 100. In some examples, I / O device 140 is separate from other components of electronic device 100. In some examples, I / O device 140 includes a network interface device that permits electronic device 100 to communicate with a network or other electronic devices, in a wired or wireless manner. Exemplary network interface devices include Wi-Fi, Bluetooth, NFC, USB, Thunderbolt, Ethernet, and so forth. With reference to FIG. IB, example electronic device 100 can house one or more processors 150, memory 152, input devices 154, sensors 156, and display 158.

[0025] Attention is now directed towards techniques for changing states of devices based on a subject (e.g., a user, a person, and / or an animal) within an environment. For example, different devices can change states to correspond to a current activity, a current body position, and / or a current location of the subject within the environment.

[0026] FIGS. 2A-2B illustrate an environment with a subject changing position in accordance with some examples, and various electronic devices changing states in a corresponding manner. Exemplary environment 200 corresponds to a room of a house, such as a living room or office. It should be recognized that techniques described herein can be used with other building environments, such as an office building, and / or physical spaces. Environment 200 includes a person (e.g., subject 218), multiple objects, such as couch 204, table 210, and multiple accessory devices, such as lamps 202, 206, and 214, television 208, and speaker 212. Lamp 202 and lamp 206 are located next to couch 204. Television 208 is located in front of couch 204. Speaker 212 and lamp 214 are located on top of table 210 in a different part of environment 200 than lamp 202, lamp 206, couch 204, and television 208. There is also an empty space behind television 208.

[0027] In some examples, an accessory device is controlled via input detected by the accessory device and / or through another electronic device in communication with the accessory device. For example, a lamp can include a switch that, when pressed, turns the lamp on or off. For another example, a smart phone can be in communication with the lamp and, in response to detecting one or more inputs directed to the smart phone, the smart phone causes the lamp to turn on or off. It should be recognized that an environment using one or more techniques described herein can include more, fewer, and / or different accessory devices than the multiple accessory devices illustrated in FIGS. 2A-2B.

[0028] In environment 200, subject 218 is sitting upright on couch 204 at position 216A. In some examples, before subject 218 entered environment 200, accessory devices in environment 200 were off. In response to subject 218 entering environment 200 (e.g., and / or before subject 218 was at position 216A), one or more of the accessory devices can turn on. For example, lamps 202, 206 can turn to full brightness when subject 218 enters environment 200. In such an example, other accessory devices can remain off in response to subject 218 entering environment 200, such as television 208, speaker 212, and / or lamp 214. When subject 218 reaches position 216A, states of some accessory devices in environment 200 can change. For example, lamps 202, 206 can turn to 50% brightness while lamp 214 remains off. For another example, television 208 can turn on and start displaying content while speaker 212 remains off. In such an example, lamps 202, 206 and television 208 react to subject 218 being in a position to watch television 208 while lamp 214 and speaker 212 do not react.

[0029] FIG. 2B illustrates various possible positions of subject 218, labeled as 216B, 216C, and 216D, within environment 200 that affect the various accessory devices in environment 200. Such positions illustrate how different accessory devices can change their state as subject 218 changes position.

[0030] In some examples, position 216B is a position where subject 218 is lying down on couch 204 (e.g., in the same physical location or slightly different physical location as position 216A). In response to subject 218 lying down on couch 204, television 208 turns off and lamps 202, 206 change in brightness (e.g., reducing to 15%). Such changes can be reactions to subject 218 appearing to no longer be watching television 208 and possibly attempting to sleep. In such examples, lamp 214 can remain off while the other lamps are turned down because lamp 214 is lower than a particular brightness (e.g., 15%).

[0031] In some examples, the same action by subject 218 (e.g., lying down) has the same effect on states of accessory devices in different environments. For example, subject 218 lying down in a workout room as opposed to a living room or office can cause one or more lamps in the workout room to also change brightness (e.g., to at most 15% brightness) without changing brightness of lamps in the living room or office. In other examples, the same action by subject 218 (e.g., lying down) has different effects on states of accessory devices in different environments. For example, subject 218 lying down in a bedroom as opposed to a living room, office, or workout room can cause lamps in the bedroom room to turn off. In other examples, the same action by subject 218 (e.g., lying down) has no effect on states of accessory devices in another environment. For example, subject 218 lying down in a hallway can result in no changes in states of accessory devices in the hallway or another environment near the hallway.

[0032] In some examples, position 216C is a position of subject 218 after moving from couch 204 to table 210. In response to subject 218 moving to table 210, television 208 can turn off while speaker 212 and lamp 214 can turn on. In some examples, speaker 212 and lamp 214 change state before subject 218 reaches position 216C. That is, while subject 218 was moving toward table 210, the states of speakers 212 and 214 preemptively change before subject 218 arrived at position 216C. In some examples, after subject 218 leaves position 216C, the states of the accessory devices on table 210 (e.g., speaker 212 and lamp 214) change in response to subject 218 leaving position 216C. In some examples, after the states of the accessory devices on table 210 change in response to subject 218 leaving position 216C, subject 218 returns to position 216C within a predefined period of time. In response to subject 218 returning to position 216C within the predefined period of time, the devices near and / or corresponding to position 216C do not change states until subject 218 fully returns to position 216C. That is, when subject 218 is moving to a new position (e.g., a position that was not visited within the predefined period of time), the accessory devices in the new position change state before subject 218 arrives at the new position. In some examples, if subject 218 is returning to a previous position from a new position, the accessory devices in the previous position do not change state until subject 218 is back at the previous position.

[0033] In some examples, position 216D is a position of subject 218 after moving to an empty space of environment 200. In response to detecting subject 218 moving to the empty space, no accessory devices in environment 200 change state. That is, if subject 218 movesfrom position 216A, 216B, or 216C to position 216D, no accessory devices in environment 200 have their states’ changed.

[0034] While the above discussion is related to changing states of accessory devices, it should be recognized that techniques described herein can impact operations on a personal device of subject 218. In some examples, certain notifications, applications, and / or contacts (e.g., personal contacts, friends, family, and / or associates of a user) for the personal device are silenced and / or suppressed while subject 218 is in certain positions within environment 200. In some examples, the appearance of a lock screen and / or home screen of the personal device is customized and / or changed to display certain applications, widgets, backgrounds, and / or fonts in response to detecting that subject 218 is in a certain position within environment 200. In some examples, the power mode of the personal device is changed. For example, the personal device can begin operating in a lower or higher power mode in response to detecting that subject 218 is in a certain position within environment 200. In some examples, a lower power mode is a setting in which the personal device conserves battery power by lowering brightness, reducing background application refresh, and / or activating auto-lock after a reduced amount of time. In some examples, the brightness of the personal device changed (e.g., raised or lowered) in response to detecting that subject 218 is in a certain position within environment 200. In some examples, a notification is provided to the personal device when an accessory device in environment 200 changes state. In such examples, the notification can include an identification of a new state of the accessory device. Examples of personal devices that may perform in this way within environment 200 include subject 218’s phone, tablet, laptop, and / or wearable devices, and so forth.

[0035] As mentioned above, a position of a subject is used to change states of accessory devices. In some examples, the position of subject 218 refers to a body position of subject 218 (e.g., standing up, sitting, lying down, and / or walking), an orientation of subject 218 (e.g., facing a wall or having their back to a wall), and / or a location of subject 218 (e.g., near a table, on a couch, in a first room, and / or in a second room different from the first room). In such examples, the position of subject 218 can be detected using one or more cameras and / or an electronic device capable of identifying an orientation and / or locating itself (e.g., via a global positioning system (e.g., GPS) and / or signal strength with another device, such as an accessory device). For example, a camera can capture an image of an environment. The image can be analyzed to identify position of subject 218 within the image to determine theposition of subject 218 within the environment. For another example, the electronic device can identify a location of the electronic device. The location can be compared and / or used to determine the position of subject 218 within the environment.

[0036] The discussion above is with respect to a single subject in an environment. In some examples, at least some techniques described herein are used with respect to multiple subjects in the environment such that operations are performed based on positions of the multiple subjects rather than a position of a single subject. For example, while a first subject is lying down on a couch in a room, a second subject can enter the room. Rather than lights in the room turning to full brightness in response to the second subject entering the room, the lights can turn on to a reduced brightness as a result of the first subject lying down on the couch in the room while the second subject enters the room. In such an example, if the first subject was not in the room, the lights can turn on to the full brightness in response to the second subject entering the room. For another example, two subjects can be watching content on a TV. When one of the subjects lies down, the TV can continue to play the content as a result of the other subject still watching the content on the TV. In such an example, if the other subject was not watching the content on the TV, the TV can turn off in response to the subject lying down.

[0037] In some examples, positions of different subjects can be used together and / or in combination to determine what operation to perform based on the positions. For example, different positions can be weighted differently such that certain positions take precedent over other positions in determining what operations to perform (e.g., one subject watching the content of the TV takes precedent over another subject lying down). For another example, an operation can be performed that corresponds to both positions rather than just one of the positions (e.g., a subset of lights in a room can be turned on when either of two subjects are in particular positions in the room; however, when both of the subjects are in the particular positions, other lights can also turn on as a result). In such examples, one or more policies, a machine learning algorithm, and / or other means for taking into account different positions of different subjects can be used to determine what operation to perform.

[0038] The operations described above can be performed using various combination of devices. Conceptually, a source device obtains and delivers data representing the environment to a decision controller. Source device(s) and decision controller(s) can be made by the same or by different manufacturers. For example, a phone can act as a source deviceby providing camera output about environment 200. As another example, a television or computer monitor can act as a source device by providing camera output about environment 200. As another example, a camera accessory can act as a source device by providing camera output about environment 200. The camera output can be provided to a controller device with sufficient computation power to process the incoming information and generate instructions for other devices in a system (e.g., environment 200 and / or one or more devices in communication with the controller device). Examples of electronic devices having sufficient computational power to act as controllers include a smart phone, a tablet, a laptop, and / or a desktop computer. Controller functionality may also be integrated into devices that have other primary functionalities, such as a media playback device, a smart speaker, a tabletop dock or smart screen, a television, and so forth. Source devices, such as the camera, can in some instances have sufficient computational power to act as controller devices. It should be appreciated that computational power generally represents a design choice that is balanced with power consumption, packaging, and cost. For example, a source device that is wired to mains electricity may be more likely to take on controller device functionality than a battery- powered device, even though both are possible. The controller device, upon determining a decision based on the obtained sensor output, provides instructions to be processed by one or more other accessory devices in environment 200. In the foregoing examples, the controller device instructs lamps, in addition to other accessories, to turn on or off.

[0039] The various ecosystem of devices described above can connect and communicate with one another using various communication configurations. Some exemplary configurations involve direct communications such as device-to-device connections. For example, a source device (e.g., camera) can capture images of environment 200, determine a position of a subject and, acting as a controller device, determine to send an instruction to an accessory device to change states. The connection between the source device and the accessory device can be wired or wireless. The connection can be a direct device-to-device connection such as Bluetooth. Some exemplary configurations involve mesh connections. For example, a source device may use a mesh connection such as Thread to connect with other devices in environment 200. Some exemplary configurations involve local and / or wide area networks and may employ a combination of wired (e.g., Ethernet) and wireless (Wi-Fi) connections. For example, a camera may connect locally with a controller hub in the form of a smart speaker, and the smart speaker may relay instructions remotely with a smart phone, over a cellular or Internet connection.

[0040] The foregoing description describes the use of data from various possible sources, such as a system on a chip, server, personal computer system, smart phone, smart watch, wearable device, tablet, laptop computer, fitness tracking device, HMD device, desktop computer, accessory (e.g., switch, light, speaker, air conditioner, heater, window cover, fan, lock, media playback device, television, and so forth), controller, hub, and / or sensor (e.g., visual, aural, light, motion) to improve interactions with connected devices. These devices may be situated in an enclosed space such as a room, a home, a building, and / or other predefined area, to provide a connected intemet-of-things experience to users. Implementers should consider and adhere to prevailing privacy standards and policies in maintaining user privacy. These standards and policies should meet industry, government, and / or other legal requirements.

[0041] As one example, implementers can take steps to anonymize sensor data. For instance, sensors may operate at low resolution for automatic object detection, and capture at higher resolutions upon explicit user instruction. Additionally or alternatively, sensor data that are captured in the enclosed space can also be restricted to devices that are located in the enclosed space, and not be transmitted and stored in the cloud. Additionally or alternatively, identification information can be removed from (or otherwise not become associated with) the data. During set up, users may be allowed to selectively block the use of sensor information, such that users are allowed to, for example, opt-in or opt-out of certain features. For example, users may be allowed to enable ambient light detection while disabling high resolution camera imaging.

[0042] FIG. 3 is a flow diagram illustrating a method (e.g., method 300) for changing states of devices in accordance with some examples, including those discussed with reference to FIGS. 2A-2B. In some examples, one or more operations of method 300 is performed by a controller device as described above with reference to FIGS. 2A-2B. In some examples, the controller device is or is integrated with an electronic device such as device 100 described above with reference to FIGS. 1A-1B. Some operations in method 300 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted. In some examples, operations of method 300 are shared between a first electronic device and a different second electronic device.

[0043] Method 300 provides an intuitive way for changing states of devices. A first electronic device (e.g., device 100) detects (302) movement of a subject (e.g., a user, aperson, and / or an animal) (e.g., via a camera and / or a sensor of a wearable device worn by the subject) from a first position (e.g., 216A) (e.g., a body position and / or a location within a physical environment) (e.g., lying down, sitting, standing up, kneeling, and / or bending over) to a second position (e.g., position corresponding to 216B, 216C, and / or 216D) (e.g., lying down, sitting, standing up, kneeling, and / or bending over) (e.g., within a room, a home, a building, and / or a predefined area). In some examples, the subject is detected via a sensor (e.g., a camera, a microphone, a heart-rate monitor, a depth sensor, and / or a communication transmitter (e.g., a radio)) in communication with the first electronic device.

[0044] After (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second position corresponds to (e.g., is in, is at, and / or located within) a first location (e.g., 200) (e.g., a room, a micro location, a building, and / or a predefined area) (e.g., and not a location corresponding to the first position, such as the subject vacating a previous location), the first electronic device causes (304) a state (e.g., on to off, active to inactive, from one level and / or setting to another level and / or setting, and / or vice versa) of a first device (e.g., 202, 206, 208, 212, and / or 214) (e.g., different from the first electronic device) (e.g., of a set of one or more devices (e.g., one or more external devices) corresponding to the first location) to change. In some examples, the first electronic device is associated with, corresponds to, and / or is in communication with a set of one or more devices (e.g., an accessory, a controller, a speaker, a smart light, a laptop, a smart phone, a smart watch, a tablet, a head-mounted display (HMD) device, a fitness tracking device, an electronic device, and / or another type of electronic device) including the first device. Causing the state of the first device to change based on movement of the subject enables the first electronic device to automatically change a state of a device as the position of the subject changes, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0045] In some examples, in response to detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to (e.g., is in, is at, and / or located within) a second location (e.g., 216B, 216C, and / or 216D) different from the first location, the first electronic device maintains (306) the state of the first device (e.g., forgoes causing the state of the first device to change). In some examples, inresponse to detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to the second location, the first electronic device causes a state of one or more devices corresponding to the second location to change. Maintaining the state of the first device when the subject moves to a position corresponding to the second location enables the first electronic device to not change states of devices not corresponding to a current location, thereby providing improved feedback to the user.

[0046] In some examples, detecting the movement of the subject to the second position is performed using output (e.g., one or more images) from one or more cameras (302). In some examples, detecting the movement of the subject to the second position includes identifying the subject in (and / or at) the second position in the output (e.g., the one or more images) from the one or more cameras. In some examples, the one or more cameras are in communication with the first electronic device. Detecting the movement of the subject using the one or more cameras enables the first electronic device to track the position of the subject using the one or more cameras, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0047] In some examples, detecting the movement of the subject to the second position is performed using output from a sensor of a wearable electronic device worn by the subject (e.g., an indication of the second position and / or a current position of the subject) (302). In some examples, the wearable electronic device is a watch, a tablet, a fitness tracking device, a multimedia device, an accessory, a speaker, a head-mounted display (HMD), and / or a personal computing device. In some examples, the wearable electronic device performs one or more operations of method 300. In some examples, the wearable electronic device is in communication with the first electronic device. Detecting the movement of the subject to the second position using output from a sensor of a wearable electronic device worn by the subject enables the first electronic device to determine position based on information from a wearable device, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0048] In some examples, the first position is (and / or includes) a first body position (e.g., a body configuration and / or orientation, such as sitting, laying down, standing up, handsholding an item, hands empty, and / or the subject looking in a particular direction) of the subject (302). In some examples, the second position is (and / or includes) a second body position of the subject (e.g., different from the first body position of the subject). In some examples, the first electronic device detects that the subject is in the second body position. In some examples, after and / or in response to detecting that the subject is in the second body position and in accordance with a determination that the second position corresponds to the first location, the first electronic device causes the state of the first device to change. Causing the state of the first device to change after detecting the movement of the subject to the second body position and in accordance with the determination that the second position corresponds to the first location enables the first electronic device to automatically change the state of the first device based on the body position of the subject, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0049] In some examples, the first position is (and / or includes, corresponds to, and / or is associated with) a first location (e.g., a first physical location or a first virtual location) within an environment (e.g., a physical environment, a mixed-reality environment, and / or a virtual environment) (302). In some examples, the second position (e.g., a second physical location or a second virtual location) is (and / or includes, corresponds to, and / or is associated with) a second location within the environment (e.g., different from the first location within the environment). Causing the state of the first device to change after detecting the movement of the subject to the second location in the environment and in accordance with the determination that the second position corresponds to the first location enables the first electronic device to automatically change the focus state based on the location of the subject, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0050] In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second position corresponds to the first location, the first electronic device changes (308) an amount of brightness of content output (e.g., via a first display generation component (e.g., adisplay screen, a projector, and / or a touch-sensitive display)) (e.g., modifies a brightness setting corresponding to the first display generation component from a first brightness level to a second brightness level different from the first brightness level). In some examples, before detecting the movement of the subject to the second position (e.g., while the subject is at and / or in the first position), the first electronic device outputs, via the first display generation component, content at a third brightness level. In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second position corresponds to the first location, the first electronic device outputs, via the first display generation component, content at a fourth brightness level different from the third brightness level. In some examples, the first electronic device is in communication with (and / or includes) the first display generation component. Changing an amount of brightness of content output after detecting the movement of the subject to the second position and in accordance with the determination that the second position corresponds to the first location enables the first electronic device to automatically change brightness based on the position of the subject, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0051] In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second position corresponds to the first location, the first electronic device changes (310) a background of a user interface (e.g., a graphical user interface) (e.g., output via a second display generation component (e.g., a display screen, a projector, and / or a touch-sensitive display)) (e.g., modifies a background corresponding to the second display generation component from a first background to a second background different from the first background) (and / or via the first electronic device). In some examples, before detecting the movement of the subject to the second position (e.g., while the subject is at and / or in the first position), the first electronic device outputs, via the second display generation component, a third background. In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determinationthat the second position corresponds to the first location, the first electronic device outputs, via the second display generation component, a fourth background different from the third background. In some examples, the first electronic device is in communication with (and / or includes) the second display generation component. Changing a background of a user interface output after detecting the movement of the subject to the second position and in accordance with the determination that the second position corresponds to the first location enables the first electronic device to automatically change a background based on the position of the subject, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0052] In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second position corresponds to the first location, the first electronic device changes (312) a manner in which one or more notifications are output (e.g., via an electronic device). In some examples, changing the manner in which one or more notifications are output includes enabling or disabling output of a notification via a third display generation component and / or an audio generation component (e.g., a speaker) in communication with an electronic device. In some examples, changing the manner in which one or more notifications are output includes enabling or disabling a notification to be output. In some examples, changing the manner in which one or more notifications are output includes grouping one or more notifications in a different manner and / or according to different criteria. In some examples, before detecting the movement of the subject to the second position (e.g., while the subject is at and / or in the first position), the first electronic device outputs one or more notifications in a first manner. In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second position corresponds to the first location, the first electronic device outputs one or more notifications in a second manner different from the first manner. Changing a manner in which one or more notifications are output after detecting the movement of the subject to the second position and in accordance with the determination that the second position corresponds to the first location enables the first electronic device to automatically change how notifications are output based on the position of the subject, thereby performing anoperation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0053] In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second position corresponds to the first location, the first electronic device changes a particular electronic device (e.g., the first electronic device or another electronic device different from the first electronic device) to operate in a different power mode (e.g., a different power state, a different level of power usage, a higher power mode, and / or a lower power mode) (e.g., changes a power mode corresponding to the particular electronic device from a first power mode (e.g., a higher power mode than another power mode) to a second power mode (e.g., a lower power mode than another power mode, such as the first power mode) different from the first power mode) (and / or via the particular electronic device) (e.g., than before detecting the movement of the subject to the second position). In some examples, before detecting the movement of the subject to the second position (e.g., while the subject is at and / or in the first position), the particular electronic device is in a third power mode (e.g., a higher power mode than another power mode). In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second position corresponds to the first location, the particular electronic device is in a fourth power mode (e.g., a lower power mode than another power mode, such as the first power mode) different from the third power mode. In some examples, the particular electronic device performs one or more operations of method 300. Causing the particular electronic device to operate in a different power mode after detecting the movement of the subject to the second position and in accordance with the determination that the second position corresponds to the first location enables the first electronic device to automatically change a power mode based on the position of the subject, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0054] In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second position corresponds to the first location, the first electronic device sends (314), to a second electronic device different from the first device and the first electronic device, a notification that the state of the first device changed. In some examples, the notification includes an indication of a current state of the first device after changing the state of the first device. In some examples, the notification includes an identification of the first device. Sending a notification that the state of the first device changed after detecting the movement of the subject to the second position and in accordance with the determination that the second position corresponds to the first location enables the first electronic device to notify electronic devices of the state of the first device changing so that the electronic devices can stay updated to changes, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0055] In some examples, the first electronic device and the second electronic device are logged into and / or associated with the same account (e.g., the first electronic device is logged into a first account (e.g., a user account, a profile, and / or a user profile) and the second electronic device is logged into and / or associated with the first account). Notifying another electronic device logged into the same user account when a state of another device is changed enables the first electronic device to notify the other electronic device logged into the same account of the state change based on the position of the subject so that the other electronic device can stay aware of the state of the first device, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0056] In some examples, causing the state of the first device to change includes causing the state of the first device to change from a first state to a second state different from the first state. In some examples, after causing the state of the first device to change to the second state, the first electronic device detects movement of the subject from the second position to the first position. In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the first position (e.g., and in accordance with a determination that the first position corresponds to a second location different from the firstlocation), the first electronic device causes the state of the first device to change to the first state. Causing the state of the first device to change to the first focus state after detecting the movement of the subject to the first position enables the first electronic device to cause the first device to go back to the first state based on the position of the subject, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0057] In some examples, causing the state of the first device to change includes causing the state of the first device to change from a third state to a fourth state different from the third state. In some examples, after causing the state of the first device to change to the fourth state, the first electronic device detects movement of the subject from the second position to a third position different from the first position and the second position. In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the third position (e.g., and in accordance with a determination that the third position corresponds to a third location different from the first location), the first electronic device causes the state of the first device of the set of one or more devices to change to a fifth state different from the third state and the fourth state. Causing the state of the first device to change to the fifth state based on movement of the subject to a different position enables the first electronic device to automatically change the state to different states depending on a position, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0058] In some examples, after causing the state of the first device to change, the first electronic device detects movement of the subject from the second position to a fourth position different from the first position and the second position (and / or the third position). In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the fourth position, the first electronic device maintains the state of the first device (e.g., after detecting the movement of the subject to the fourth position (and / or while detecting the subject at the fourth position), the first electronic device forgoes causing the state of the first device to change). Maintaining the state of the first device after detecting the movement of the subject to the fourth position enables the first electronic device to change state of devices that correspond to particular positions, thereby performing an operation whena set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0059] In some examples, a distance from the second position to the fourth position is more than a distance from the first position to the second position (e.g., the state of the first device did not change after detecting the movement of the subject to the fourth position because the fourth position does not correspond to a location causing change and not because the subject did not move enough from the second position).

[0060] In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to the first location, the first electronic device causes a state of multiple devices (e.g., the first device, a second device different from the first device, and / or another device different from the first device and the second device) of the set of one or more devices to change. In some examples, the state of the second device and / or the state of the other device is changed concurrently with the state of the first device. Causing the state of multiple devices to change after detecting the movement of the subject to the first position enables the first electronic device to automatically change the focus state of multiple devices based on the position of the subject, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0061] In some examples, after causing the state of the first device to change, the first electronic device detects movement of the subject from the second position to a fifth position (e.g., 216B, 216C, and / or 216D) different from the first position and the second position. In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the fifth position, in accordance with a determination that the fifth position corresponds to a third location (e.g., micro-location, room, building, and / or outdoor space) different from the first location, wherein the third location is associated with a first set of devices, the first electronic device causes a state of a seventh device to change without causing a state of an eighth device to change, wherein the seventh device is included in the first set of devices, and wherein the eighth device is included in a second set of devices different from the first set of devices (e.g., the seventh device is not included in the second set of devices) (e.g., the eighth device is not included in the first set of devices). In some examples, after detecting the movement of the subject to the fifth position, in accordance witha determination that the fifth position corresponds to a fourth location (e.g., micro-location, room, building, and / or outdoor space) different from the first location and the third location, wherein the fourth location is associated with the second set of devices, the first electronic device causes the state of the eighth device to change without causing the state of the seventh device to change. Causing different sets of devices to change depending on which location the subject is at enables the first electronic device to automatically change the state of the device that is at the position associated with the subject and not change the state of the device that is not at the position, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0062] In some examples, after causing the state of the first device to change in accordance with the determination that the second position corresponds to the first location (e.g., a first room), the first electronic device detects movement of the subject to a position corresponding to (and / or in and / or at) a second location (e.g., a second room) different from the first location. In some examples, in response to detecting the movement of the subject to the position corresponding to the second location and in accordance with a determination that the position corresponding to the second location is positioned with respect to the second location in the same manner (e.g., same body position and / or same portion of a respective location) as the second position is positioned with respect to the first location, the first electronic device causes the state of the first device to change.

[0063] In some examples, after causing the state of the first device to change, the first electronic device detects movement of the subject from a sixth position to a seventh position within a first respective area. In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the seventh position (and / or in response to the detecting an input corresponding to a request from the subject) and in accordance with a determination that the first respective area is a first area, the first electronic device performs a first operation. In some examples, performing the first operation in accordance with a determination that the first respective area is the first area includes outputting content via a display generation component and / or an audio generation component. In some examples, performing the first operation in accordance with a determination that the first respective area is the first area includes sending an instruction to change a third device (e.g., different from the first device) from a first state to a second state. In some examples, the third device is inthe first area. In some examples, the third device is a device of a first type (e.g., has one or more functions, functionality, and / or capability). In some examples, performing the first operation in accordance with a determination that the first respective area is the first area includes changing a configuration and / or setting of an electronic device. In some examples, the seventh position is a body position (e.g., the position of the subject’s body and / or an activity being performed by the subject).

[0064] In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the seventh position and in accordance with a determination that the first respective area is a second area different from the first area, the first electronic device performs the first operation. In some examples, performing the first operation in accordance with a determination that the first respective area is the second area includes outputting content via a display generation component and / or an audio generation component. In some examples, performing the first operation in accordance with a determination that the first respective area is the second area includes sending an instruction to change a fourth device from a first state to a second state. In some examples, the fourth device is in the second area. In some examples, the fourth device is a device of the first type or a second type (e.g., has one or more functions, functionality, and / or capability) different from the first type. In some examples, performing the first operation in accordance with a determination that the first respective area is the second area includes changing a configuration and / or setting of an electronic device. Performing the same operation when the subject is in the same position in different locations enables the first electronic device to perform the same operation if the position of the person is the same regardless of the area it is performed in, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0065] In some examples, after causing the state of the first device to change in accordance with the determination that the second position corresponds to the first location (e.g., a first room), the first electronic device detects movement of the subject to a position corresponding to (and / or in and / or at) a third location (e.g., a third room) different from the first location. In some examples, in response to detecting the movement of the subject to the position corresponding to the third location and in accordance with a determination that the position corresponding to the third location is positioned with respect to the third location inthe same manner (e.g., same body position and / or same portion of a respective location) as the second position is positioned with respect to the first location, the first electronic device performs a different operation than performed after detecting the movement of the subject to the second position. In some examples, same setting and / or control is modified for a respective device in a respective location (e.g., an operation performed when the second position corresponds to the first location is with respect to a different device than an operation performed when the second respective position corresponds to and / or is in the second location). In some examples, an operation performed when the subject is at the second respective position is a different type of operation than an operation performed when the subject is at the second position).

[0066] In some examples, after causing the state of the first device to change, the first electronic device detects movement of the subject from an eighth position to a ninth position within a second respective area. In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the ninth position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second respective area is a third area, the first electronic device performs a second operation (e.g., corresponding to the third area). In some examples, performing the second operation includes outputting content via a display generation component and / or an audio generation component. In some examples, performing the second operation includes sending an instruction to change a fifth device (e.g., different from the first device) from a first state to a second state. In some examples, the fifth device is in the third area. In some examples, the third device is a device of a third type (e.g., has one or more functions, functionality, and / or capability). In some examples, performing the second operation includes changing a configuration and / or setting of an electronic device. In some examples, the ninth position is a body position (e.g., the position of the subject’s body and / or an activity being performed by the subject).

[0067] In some examples, after (e.g., in response to and / or at some time after) detecting the movement of the subject to the ninth position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second respective area is a fourth area different from the third area, the electronic device performs a third operation (e.g., corresponding to the fourth area and not the third area) different from the second operation without performing the second operation. In someexamples, the second operation is performed without performing the third operation after (e.g., in response to and / or at some time after) detecting the movement of the subject to the ninth position (and / or in response to detecting an input corresponding to a request from the subject) and in accordance with a determination that the second respective area is the third area. In some examples, performing the third operation includes outputting content via a display generation component and / or an audio generation component. In some examples, performing the third operation includes sending an instruction to change a sixth device from a first state to a second state. In some examples, the sixth device is in the fourth area. In some examples, the sixth device is a device of the third type or a fourth type (e.g., has one or more functions, functionality, and / or capability) different from the third type. In some examples, performing the third operation includes changing a configuration and / or setting of an electronic device. Performing different operations based on detecting the movement of the subject to the same position in different locations enables the first electronic device to automatically perform an operation that corresponds to a location and position of the movement of the subject, thereby performing an operation when a set of conditions has been met without requiring further user input, reducing the number of inputs needed to perform an operation, and / or providing improved feedback to the user.

[0068] In some examples, the subject is a first subject. In some examples, the electronic device detects the first subject in a sixth position (e.g., within an environment). In some examples, in response to detecting the first subject in the sixth position and in accordance with a determination that the first subject is in the sixth position and that a second subject is in a seventh position (e.g., within the environment), the electronic device causes a state of a ninth device to change (e.g., in a first manner, such as changing brightness of a light to 50% brightness). In some examples, the second subject is different from the first subject. In some examples, the state of the ninth device is different from the state of the first device. In some examples, the ninth device is different from the first device. In some examples, in response to detecting the first subject in the sixth position and in accordance with a determination that the first subject is in the sixth position and that the second subject is not in the seventh position, the electronic device maintains the state of the ninth device (and / or forgoes causing the state of the ninth device to change). In some examples, in response to detecting the first subject in the sixth position and in accordance with a determination that the first subject is in the sixth position and that the first subject is the only subject in the environment, the electronic device maintains the state of the ninth device (and / or forgoes causing the state of the ninth device tochange). In some examples, in response to detecting the first subject in the sixth position and in accordance with a determination that the first subject is in the sixth position and that the first subject is the only subject in the environment, the electronic device causes the state of the ninth device to change (e.g., in a second manner different from the first manner, such as changing brightness of the light to 100% brightness). In some examples, the electronic device performs different operations (e.g., causes a device to change to different states and / or changes states of different devices) depending on whether the second subject is in the same environment as the first subject (e.g., a position of the second subject is taken into account when determining what operation to perform).

Claims

AMENDED CLAIMS received by the International Bureau on 07 January 2025 (07.01.2025)

1. A method, comprising: detecting movement of a subject from a first location within an environment to a second location within the environment; and after detecting the movement of the subject to the second location within the environment, causing a state of a first device to change.

2. The method of claim 1 , wherein detecting the movement of the subject to the second position is performed using output from a sensor of an electronic device held or worn by the subject.

3. The method of any one of claims 1-2, wherein detecting the movement of the subject to the second position is performed using output from one or more cameras.

4. The method of any one of claims 1-3, further comprising: coordinating an output of the sensor of the wearable electronic device with output from the one or more cameras, and wherein causing a state of the first device to change comprises causing the state of the first device to change in accordance with the coordination.

5. The method of any one of claims 1-4, further comprising: after detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to the first location, changing an amount of brightness of content output by the first device.

6. The method of any one of claims 1-4 and 5, further comprising: after detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to the first location, changing a background of a user interface of the first device.

7. The method of any one of claims 1-4 and 5-6, further comprising: after detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to the first location, changing a manner in which one or more notifications are output.

8. The method of any one of claims 1-4 and 7, further comprising:30AMENDED SHEET (ARTICLE 19)after detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to the first location, pausing media output or reducing a power consumption of the first device.

9. The method of any one of claims 1-4 and 5-7, further comprising: after detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to the first location, sending, to a second electronic device different from the first device, by a first electronic device different from the second electronic device and the first device, a notification that the state of the first device changed.

10. The method of claim 9, wherein the first electronic device and the second electronic device are logged into the same account.

11. The method of any one of claims 1 -4 and 5-10, wherein causing the state of the first device to change includes causing the state of the first device to change from a first state to a second state different from the first state, the method further comprising: after causing the state of the first device to change to the second state, detecting movement of the subject from the second position to the first position; and after detecting the movement of the subject to the first position, causing the state of the first device to change to the first state.

12. The method of any one of claims 1-4 and 5-11 , further comprising: in response to detecting the movement of the subject to the second position and in accordance with a determination that the second position corresponds to a second location different from the first location, maintaining the state of the first device.

13. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a first electronic device, the one or more programs including instructions for performing the method of any one of claims 1-4 and 5-12.31AMENDED SHEET (ARTICLE 19)

14. A first electronic device, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 1-4 and 7-12.

15. A first electronic device, comprising: means for performing the method of any one of claims 1-4 and 5-12.

16. A computer program product, comprising one or more programs configured to be executed by one or more processors of a first electronic device, the one or more programs including instructions for performing the method of any one of claims 1-4 and 5-12.32AMENDED SHEET (ARTICLE 19)

Images