Augmented reality to facilitate accessibility

Abstract

Method (900) comprising: Determining (905) whether a user of a first augmented reality unit (110) is within a threshold distance of a configurable physical device (130); In response to determining that the user is within the threshold distance of the configurable physical device, establishing (910) a communication connection between the first augmented reality unit and a controller (134) of the configurable physical device, wherein a second augmented reality unit (170) is within the threshold distance of the configurable physical device; Coordinating the first augmented reality unit with the second augmented reality unit by exchanging at least one message (194) between the first augmented reality unit and the second augmented reality unit; based on the at least one message, determining by at least the first augmented reality unit that the first augmented reality unit has priority over the second augmented reality unit in controlling the configurable physical device; and in response to determining that the first augmented reality device has priority in controlling the configurable physical device, starting (915), by the first augmented reality device, the controller of the configurable physical device to change the configurable physical device from a first configuration to a second configuration, the second configuration making the configurable physical device more accessible to the user.

Description

BACKGROUND

[0001] The present invention relates to augmented reality and, in particular, to augmented reality devices.

[0002] Augmented reality, in its traditional sense, is a real-time, direct or indirect view of a physical, real-world environment whose elements are augmented (or enhanced) by computer-generated sensory input such as sound, video, graphics, or Global Positioning System (GPS) data. Augmented reality is traditionally performed in real time and in conjunction with environmental elements. Unlike virtual reality, which presents a virtual world, augmented reality presents and enhances information about the surrounding real world.

[0003] JP 2008-271358 A relates to an appliance control system that can significantly improve a user's comfort when using an appliance. Each household electrical appliance, such as a television, includes a radio communication section and a control section that performs automatic operation control based on information received via the radio communication section. Furthermore, each portable unit includes a radio communication section and a memory, and each of the memories stores individual identification information that is different for each owner, as well as user-specific information about the body and preferences of each owner.When a wireless connection is established with a portable unit, each household electrical appliance receives identification information and user-specific information and performs automatic operation based on the received information. Furthermore, each household electrical appliance gradually changes an operating state when the operating condition changes.

[0004] The document US 2013 / 0 069 985 A1 shows a wearable computing device that includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the surroundings of the wearable computing device is visible. The HMD is operable to display images superimposed on the field of view. When the wearable computing device detects that a target device is in its surroundings, the wearable computing device receives target device information related to the target device. The information about the target device may include information defining a virtual control interface for controlling the target device and an identification of a specific area of ​​the target device on which the virtual control image is to be provided.The wearable computing device controls the HMD to display the virtual control image as an image superimposed on the defined area of ​​the target device in the field of view.

[0005] JP 2008-261148 A relates to an automatically adjustable handrail device that can adjust the shape of a handrail to suit the user without significant time and effort. The automatically adjustable handrail device consists of: a handrail that can adjust its height and thickness; electric motors for adjusting the handrail; a smart key, carried by the user, which stores personal identification information to identify the user using the handrail and can transmit a user signal including the personal identification information and preference information; and a communication device for receiving the user signal transmitted by the smart key. A control device then drives the electric motors based on the information contained in the user signal received by the communication device.In this way, the user signal is transmitted from the smart key by the user approaching the handrail, and the height and thickness of the handrail are automatically adjusted based on the information in the user signal. SUMMARY

[0006] The invention relates to a method, an augmented reality device, and a computer program product, the features of which are specified in the corresponding independent patent claims. Embodiments of the invention are specified in the dependent patent claims.

[0007] An augmented reality device includes a processor programmed to initiate executable operations. The executable operations include determining whether a user of the augmented reality device is within a threshold distance of a configurable physical device. The executable operations may also include establishing a communication connection between the augmented reality device and a controller of the configurable physical device in response to determining that the user is within the threshold distance of the configurable physical device.The executable operations may also include starting the controller of the configurable physical device to change the configurable physical device from a first configuration to a second configuration, wherein the second configuration makes the configurable physical device more easily accessible to the user.

[0008] A computer program includes a computer-readable storage medium having program code stored thereon. The program code is executable by a processor to perform a method. The method includes determining, by an augmented reality device, whether a user of the augmented reality device is within a threshold distance of a configurable physical device. The method may also include, in response to determining that the user is within the threshold distance of the configurable physical device, establishing, by the augmented reality device, a communications connection between the augmented reality device and a controller of the configurable physical device.The method may also include starting, by the augmented reality unit, the controller of the configurable physical device to change the configurable physical device from a first configuration to a second configuration, wherein the second configuration makes the configurable physical device more easily accessible to the user. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram illustrating an example of an augmented reality environment. Fig. Figure 2 shows an example of a movable handrail in an augmented reality environment. Fig. Figure 3 shows an example of movable shelves in an augmented reality environment. Fig. Figure 4 shows an example of a character in an augmented reality environment. Fig. Figure 5 shows an example of a lighting system in an augmented reality environment. Fig. Figure 6 illustrates an example of an illuminating configurable physical structure in an augmented reality environment. Fig. Figure 7 is a block diagram illustrating an example data processing architecture for an augmented reality device. Fig. Figure 8 is a block diagram illustrating an example computing architecture for a physical device. Fig. 9 is a flowchart illustrating an example of a method for starting a physical structure to change a configuration. DETAILED DESCRIPTION

[0009] This disclosure relates to augmented reality, and more particularly, to augmented reality devices. According to the inventive arrangements disclosed herein, an augmented reality device may launch a physical device to change a configuration to make the physical device more accessible to a user. For example, the augmented reality device may launch the physical device to adjust a handrail or shelf to a user-preferred height. In another example, the augmented reality device may launch the physical device to change a color of a sign or lamp to a color recognizable by the user, for example, if the user has a vision impairment such as color blindness.In yet another example, the augmented reality unit can initiate the physical device to control a plurality of lamps to illuminate a path for the user to travel from one location to another. One or more colors of light emitted by the lamps can be selected as colors recognizable by the user.

[0010] Several definitions that apply throughout this document are now presented.

[0011] As defined herein, the term "augmented reality device" means a device carried by a user, either on the user's body or on a mobile device / device that moves with the user, having at least a single processor and on-board memory that augments elements of the real world presented to the user. Examples of an augmented reality device include, but are not limited to, augmented reality glasses (e.g., smart glasses), augmented reality headsets, and mobile devices (e.g., smartphones) containing an augmented reality application. Sensors, such as motion detectors and touch sensors, that are not carried by a user during operation are not augmented reality devices as defined herein.

[0012] As defined herein, the term “configurable physical device” means a physical device that can operate under a variety of physical device configurations.

[0013] As defined herein, the term "in response to" means promptly responding or reacting to an action or event. If a second action is performed "in response to" a first action, there is thus a causal relationship between an occurrence of the first action and an occurrence of the second action, and the term "in response to" indicates such a causal relationship.

[0014] As defined herein, the term "computer-readable storage medium" means a storage medium that contains or stores program code for use by or in connection with an instruction execution system, apparatus, or device. As defined herein, a "computer-readable storage medium" is not a transient, propagating signal per se.

[0015] As defined herein, the term "transceiver" means a unit configured to modulate and demodulate signals to convert signals from one form to another, and to transmit and / or receive such signals over one or more different wireless transmission networks. In one illustration, a transceiver may transmit data over 2G, 3G, 4G, GSM, LTE, UMB, GPRS, EUTRAN, TDMA, CDMA, WCDMA, UMTS, OFDM, HSPA+, direct wireless transmission, etc. Direct wireless transmissions include, but are not limited to, transmissions over a Personal Area Network (PAN). Examples of PAN transmissions include, but are not limited to, Bluetooth®, Bluetooth® Low Energy (BLE), and / or Zigbee™ transmission protocols, and so on.Furthermore, a transceiver may be embodied as a network wireless adapter configured to transmit data via IEEE 802 wireless transmissions, for example, 802.11 and 802.16 (WiMax), mobile WiMax, WPA, or WPA2. However, the invention is not limited to these examples, and a transceiver may be configured to transmit RF signals according to any suitable transmission standards, protocols, and / or architectures, or a suitable combination of such standards, protocols, and / or architectures.

[0016] As defined herein, the term "processor" means at least one hardware circuit (e.g., an integrated circuit) configured to execute instructions contained in program code. Examples of a processor include, but are not limited to, a central processing unit (CPU), an array processor, a vector processor, a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic array (PLA), an application-specific integrated circuit (ASIC), a programmable logic circuit, and a controller.

[0017] As defined herein, the term "real time" means a level of processing response that a user or system perceives as sufficiently fast for a particular process or decision to be made, or that allows the processor to keep pace with some external processes.

[0018] As defined herein, the term “automatic” means without user intervention.

[0019] As defined herein, the term “User” means a person (i.e., a human being).

[0020] Fig. 1 is a block diagram illustrating an example of an augmented reality environment 100. The augmented reality environment 100 may include an augmented reality unit 110 and a physical device 130. The augmented reality unit 110 may include at least a single transceiver 112, at least a single processor 114, an augmented reality application 116, and optionally a user profile 118.

[0021] The augmented reality application 116 may be configured to detect a spatial proximity of the augmented reality device 110 to the physical device 130 based on signals generated by the physical device 130 and received by the transceiver 112. Furthermore, the augmented reality application 116 may be configured to initiate various processes described herein based at least in part on the spatial proximity of the augmented reality device 110 to the physical device 130.

[0022] The user profile 118 may store user profile data for a user of the augmented reality application 116. In one arrangement, the user profile 118 may store an electronic medical record 120 of the user. In another arrangement, the augmented reality application 116 may access the user's electronic medical record 120 from another system (not shown), for example, via the transceiver 112.

[0023] The physical device 130 may include at least a single transceiver 132, one or more controllers 134, one or more controlled units and / or structures 136, and optionally one or more actuators 138. Furthermore, the physical device 130 may include a physical device application 140. The physical device application 140 may be stored in main memory (not shown) accessed by the controller(s) 134, stored as computer program code within the controller(s) 134, or embodied as configuration data used to configure the controller 134 (e.g., in an arrangement where the controller 134 includes programmable logic circuits, an FPGA, a PLA, etc.).

[0024] The controller(s) 134 may be processors or any other hardware circuitry (e.g., integrated circuits) configured to execute instructions contained in the program code of the controller(s) 134 and / or configured to execute instructions provided by the physical device application 140. In this regard, the controller(s) 134 may be processors specifically configured to execute particular instructions, although the present arrangements are not limited in this regard.

[0025] The controlled units and / or structures 136 may be components of the physical device 130 configured to operate under a variety of operating states, for example, in response to control signals received from one or more of the controllers 134 or in response to mechanical inputs received from one or more actuators 138 controlled by the controller(s) 134. In one illustration, the actuators 138 may include one or more solenoids, motors, etc., configured to mechanically move one or more components of the controlled units and / or structures 136.

[0026] In another arrangement, the controller(s) 134 may directly operate the controlled units and / or structures 136 under various of a variety of operating states. For example, the controller(s) 134 may be directly connected to the controlled units and / or structures 136 via an interface to control the operating states of the controlled units and / or structures 136. In one illustration, the controller(s) 134 may be directly connected to signs and / or lamps via an interface to control a color of light emitted by the signs and / or lamps, a direction in which the signs and / or lamps emit light, and so on.The controller(s) 134 may generate control signals in response to data received from the physical device application 140, or the controller(s) 134 may generate control signals in response to data received from the augmented reality application 116.

[0027] The augmented reality device 110 may be communicatively connected to one or more physical devices via at least a single transmission connection 150 established between the transceiver 112 and the transceiver 132. The transmission connection 150 is the medium used to provide transmissions between the augmented reality device 110 and the physical device 130 and may be established according to any of the previously described protocols. The augmented reality application 116 may transmit augmented reality requests 160 to the physical device application 140 or directly to the controller(s) 134 via the transmission connection 150.The augmented reality requirements 160 may provide data to the physical device application 140 or directly to the controller(s) 134 indicating a desired configuration state of the physical device 130 that is optimized for a user of the augmented reality device 110.

[0028] In a single, non-limiting arrangement, the augmented reality environment 100 may further include one or more additional augmented reality devices, for example, an augmented reality device 170. The augmented reality device 170 may include at least one transceiver 172, at least one processor 174, an augmented reality application 176, and optionally a user profile 178. The transceiver 172, the processor 174, the augmented reality application 176, and the user profile 178 may be configured in respective ways similar to those described for the transceiver 112, the processor 114, the augmented reality application 116, and the user profile 118.The augmented reality device 170 may further be communicatively connected to one or more physical devices, for example, the physical device 130, via at least a single transmission connection 152 established between the transceiver 172 and the transceiver 132. Optionally, the user profile 178 may store an electronic medical record 180 of the user of the augmented reality device 170. In another arrangement, the augmented reality application 176 may access the electronic medical record 180 of that user from another system (not shown), for example, via the transceiver 172.

[0029] Fig. 2 illustrates an example of a displaceable handrail 210 in an augmented reality environment 100. In this example, the physical device 130 may implement the handrail 210 as the controlled structure 136 ( Fig. 1). The handrail 210 may be mounted near a ramp 215 or stairs that the user wishes to pass, although the present arrangements are not limited in this regard. For example, the handrail 210 may be mounted near another type of walkway. As described, the height of the handrail 210 may be adjustable. Furthermore, the height may be set to a desired height by the user of the augmented reality unit 110 ( Fig. 1) preferred height. This can make the handrail 210 more accessible to the user, as the user can more easily grasp the handrail 210 and use the handrail 210 more easily for support while walking.

[0030] With reference to the Fig. 1 and Fig. 2, the augmented reality device 110 may determine whether the user is within a threshold distance of the handrail 210. For example, the controller 134 may transmit a beacon signal via the transceiver 132. The beacon signal may be transmitted, for example, according to a short-range RF transmission protocol, such as BLE. Using the transceiver 112 and the processor 114, the augmented reality application 116 may monitor for the beacon signal. In response to detecting the beacon signal, the augmented reality device 116 may determine that the user is within the threshold distance of the handrail 210. In this regard, the threshold distance may be a distance over which the beacon signal is detectable by the augmented reality device 110.

[0031] In another arrangement, the user may enter a user input into the augmented reality device 110 to indicate that the user is within a threshold distance of the handrail 210. For example, the user may enter the user input as the user approaches the handrail 210. In this example, the threshold distance may be a distance between the user (e.g., the augmented reality device 110 used by the user) and the handrail 210 at the time the user enters the user input.

[0032] In response to detecting the beacon signal or user input, the augmented reality application 116, using the transceiver 112 and the processor 114, may transmit the augmented reality request 160 to the physical device 130. The augmented reality request 160 may specify a preferred height 220 of the handrail 210 for the user, for example, a height 220 above the ramp 215, stairs, or a floor. The augmented reality application 116 may determine the preferred height 220 based on the user profile 118 or the electronic medical record 120 and generate the augmented reality request 160 to include the preferred height 220. The height 220 may be measured / defined from a top of the ramp 215, stairs or walkway to the handrail 210 or measured / defined in any other suitable manner.

[0033] Using the transceiver 112 and the processor 114, the augmented reality application 116 may transmit the augmented reality request 160 to the physical device 130, for example, the transceiver 112, using at least one RF transmission protocol, such as an RF transmission protocol known in the art (e.g., BLE). The transceiver 132 may receive the augmented reality request 160 and transmit the augmented reality request 160 to the controller 134. The controller 134 may process the augmented reality request 160 to determine the preferred height 220 of the handrail 210 for the user. In this regard, the augmented reality request 160 may initiate an adjustment of the height 220 of the handrail 210 for the user.

[0034] The controller 134 may output control signals 230 to one or more actuators 225. The control signals 230 may control the actuators 225 to, for example, vertically translate the handrail 210 up and down to the desired height 220. In a single arrangement, the actuators 225 may be telescopic actuators that vertically translate structural support members 235 up and down. Furthermore, other types of actuators may be used, and the present arrangements are not limited in this regard. For example, the actuators 225 may be sliding actuators if the handrail 210 is attached to a wall. The actuators 225 may operate using hydraulic, pneumatic, electrical, magnetic, and / or mechanical processes, as known in the art.

[0035] In one arrangement, the actuators 225 may include sensors 240 that generate sensor data indicative of the current height of the handrail 210. In another arrangement, the sensors 240 may be located external to the actuators 224 at suitable locations. In one aspect, the actuators 225 may process the sensor data to determine the height of the handrail 210 at any time, for example, before, when, and after the handrail 210 is being moved, and may stop moving the handrail 210 in response to the handrail 210 being moved from a previous height to the desired height 220. In another aspect, the sensors 240 may transmit the sensor data to the controller 134, and the controller 134 may generate the control signals 230 in response to the sensor data.In this regard, the controller 134 may control the actuators 225 to stop the translation of the handrail 210 in response to the handrail 210 being translated to the desired height 220.

[0036] In some cases, augmented reality units 110, 170 from a plurality of users may generate augmented reality requests 160, 190 at the same or nearly the same time. In a single arrangement, the controller 134 may perform scheduling processes to determine which augmented reality request 160, 190 should be processed first. For example, the controller 134 may process the first received augmented reality request 160 and temporarily store the second augmented reality request 190 in main memory. In response to adjusting the height of the handrail 210 according to the first augmented reality request 160, the controller 134 may maintain the handrail 210 at that height 220 for a threshold period. The threshold period may be a period long enough for the first user to pass the ramp 215, stairs, or walkway.In another aspect, the physical device 130 may include one or more sensors (not shown) that detect when the user has passed the ramp 215, stairs, or a walkway and maintain the handrail 210 at the height 220 until the user has passed the ramp 215, stairs, or a walkway. Regardless, in response to the threshold period expiring or in response to the user passing the ramp 215, stairs, or a walkway, the controller 134 may process the second augmented reality request 190 to adjust the height of the handrail 210 for the second user.

[0037] In another arrangement, the augmented reality units 110, 170 of a plurality of users may coordinate with each other to determine which augmented reality unit 110 initially has control over the physical device 130 to adjust the height of the handrail 210. For example, the augmented reality applications 116, 176 of the respective augmented reality units 110, 170 may be configured to establish a communication link 192 with each other using the respective processors 114, 174 and transceivers 112, 172 (e.g., using BLE). Via the communication link 192, the respective augmented reality applications 116, 176 may perform the coordination, for example, by exchanging coordination messages 194 with each other.Based on the coordination, the augmented reality applications 116, 176 can determine which augmented reality device 110, 170 has priority over the other in controlling the physical device 130 and which augmented reality device 110, 170, at least initially, relinquishes control of the physical device 130 to the other augmented reality device 110, 170. Such a determination can be based on levels of disability, age, size, etc., of the users of the respective augmented reality device 110, 170, or on any other suitable parameters.

[0038] For example, each user profile 118, 178 and / or each electronic medical record 120, 180 may indicate a severity level (e.g., a value indicating the severity) of a respective user's disability. The augmented reality applications 116, 176 may determine that the augmented reality device 110 of the user with the highest or lowest disability severity is given priority over the augmented reality device 170 in controlling the physical device 130. Consequently, the augmented reality device 110 may initiate the controller 134 to, for example, adjust the height of the handrail 210 by transmitting a respective augmented reality request 160 to the physical device 130. In response to receiving the augmented reality request 160, the controller 134 may change the configuration of the physical device 130 according to the augmented reality request 160.In response to the threshold period expiring, or in response to the user passing the ramp 215, stairs, or a walkway, the other augmented reality unit 170 may transmit another augmented reality request 190 to the physical device 130. In response to receiving the another augmented reality request 190, the controller 134 may change the configuration of the physical device 130 according to the augmented reality request 190, for example, by adjusting a handrail height for the user of the augmented reality unit 170.

[0039] The augmented reality application 176 may communicate with the augmented reality application 116 and / or the physical device application 140 to determine when to transmit the augmented reality request 190. For example, the augmented reality application 116 of the physical device application and / or the physical device application 140 may transmit a message (not shown) to the augmented reality application 176 indicating that the user of the augmented reality device 110 has passed through the ramp 215, stairs, or a walkway.

[0040] In yet another arrangement, the augmented reality applications 116, 176 may each present information to their respective users indicating that a plurality of users are currently attempting to access the handrail 210 and prompting the users to indicate whether they agree to delay adjustment for them until one or more other users have used the handrail 210. Furthermore, any other process for coordinating height adjustment for a plurality of users may be performed, and the present arrangements are not limited in this regard.

[0041] Fig. 3 illustrates an example of movable shelves 310, 312 in an augmented reality environment 100. In this example, the physical device 130 may include at least one single shelf 310, 312 as the controlled structure 136 ( Fig. 1). The present arrangements are not limited to the number of movable shelves 310, 312. For example, the present arrangements may include a single movable shelf, two movable shelves, three movable shelves, four movable shelves, five movable shelves, and so on.

[0042] The shelves 310, 312 may be relocatably arranged within a cabinet 320, although the present arrangements are not limited in this regard. For example, the shelves 310, 312 may be relocatably mounted to a wall or other structure. As described, a height 330, 332 of each shelf 310, 312 may be adjustable. Furthermore, the height(s) 330, 332 may be adjusted based on the user of the augmented reality device 110 ( Fig. 1) Preferred heights can be adjusted. This allows the shelves 310, 312 to be more easily accessible to the user, allowing the user to more easily access items from the adjustable shelves 310, 312 and place items on the adjustable shelves 310, 312.

[0043] With reference to the Fig. 1 and Fig. 3, the augmented reality unit 110 may, for example, be based on a beacon signal or user input, as previously described with reference to the Fig. 1 and Fig. 2, determine whether the user is within a threshold distance to the control floors 310, 312. In response to detecting the beacon signal or the user input, the augmented reality application 116 may, using the transceiver 112 and the processor 114 (in Fig. 1) transmits the augmented reality request 160 to the physical device 130. The augmented reality request 160 may specify a preferred height 330 of the shelf 310 and / or a preferred height 332 of the shelf 312. The augmented reality application 116 may determine the preferred heights 330, 332 based on the user profile 118 or the electronic medical record 120 and generate the augmented reality request 160 to include the preferred height 330 and / or the preferred height 332.

[0044] The augmented reality application 116 may transmit the augmented reality request 160 to the physical device 130, for example, as previously described with reference to the Fig. 1 and Fig. 2. The controller 134 may process the augmented reality request 160 to determine the preferred height(s) 330, 332 of the shelf(s) 310, 312 for the user. In this regard, the augmented reality request 160 may initiate an adjustment of the height(s) 330, 332 of the shelf(s) 310, 312 for the user. The height(s) 330, 332 may be measured / defined from a bottom 340 of the cabinet 320 to tops 350, 352 of the respective shelves 310, 312, measured / defined from the bottom to a top 350, 352 of the respective shelves 310, 312, or measured / defined in any other suitable manner.

[0045] The controller 134 may output control signals (not shown) to one or more actuators 360. The control signals 230 may control the actuators 360 to, for example, vertically move the shelves 310, 312 up and down to the desired heights 330, 332. In a single arrangement, the actuators 360 may be slide actuators that vertically move structural support members 370, 372 to which the shelves 310, 312 are respectively attached. Furthermore, other types of actuators may be used, and the present arrangements are not limited in this regard.

[0046] In a single arrangement, the actuators 360 may include sensors 380 that generate sensor data indicative of the current heights of the shelves 310, 312. In another arrangement, the sensors 380 may be located external to the actuators 360 at suitable locations. In a single aspect, the actuators 360 may process the sensor data to determine the height(s) of the shelves 310, 312 at any time, for example, before, when, and after the shelves 310, 312 are moved, and stop moving the shelves 310, 312 in response to the shelves 310, 312 being moved from previous heights to the desired heights 330, 332. In another aspect, the sensors may transmit the sensor data to the controller 134, and the controller 134 may generate the control signals 230 in response to the sensor data.In this regard, the controller 134 may control the actuators 360 to stop the translation of the shelves 310, 312 in response to the respective shelves 310, 312 being translated to the desired heights 330, 332.

[0047] It should be noted that the present arrangements do not apply to the examples of Fig. 2 and Fig. 3. For example, the arrangements described herein may be applied to adjust a height of a wheelchair to facilitate entry and exit from the wheelchair, and to adjust the height of the wheelchair for locomotion. In another example, the arrangements described herein may be adjusted to adjust a height of a vehicle to facilitate entry and exit from the vehicle. For example, the controller 134 may control an air suspension system of the vehicle to lower the vehicle to assist with entry / exit and to raise the vehicle for travel.

[0048] Fig. 4 illustrates an example of a character 400 in an augmented reality environment 100. In this example, the physical device 130 may represent the character 400 as the controlled structure 136 ( Fig. 1). The sign 400 is operable to change at least one color of at least one part 410, 412, 414 of the sign 400. In a single arrangement, for example, an arrangement in which the sign 400 is a traffic light, as in Fig. As shown in Figure 4, each portion 410, 412, 414 of the character 400 may display one or more specific colors, although each color need not be displayed simultaneously. In another arrangement, the character 400 may display text in one or more colors. In yet another arrangement, the character 400 may display one or more images in one or more colors.

[0049] A user may have a visual impairment (e.g., color blindness) where the user is unable to distinguish certain colors, which may be indicated in the user profile 118 and / or the electronic medical record 120. Thus, the user may not have the ability to distinguish between different colors represented by the indicia 400. However, the present arrangements may simplify the user's recognition of the various parts 410, 412, 414 of the indicia 400. In one illustration, the user may have red-green color blindness, where the user is unable to distinguish the color red from the color green. The present arrangements may represent one or more of the various parts 410, 412, 414 of the indicia 400 in colors that are easily recognizable by the user. Consequently, the user will not confuse the parts 410, 412, 414 and will understand their meaning (e.g.,Caution, Stop, or Proceed). In the following example, assume that the user is a driver of a vehicle traveling on a road and encounters the 400 sign.

[0050] With reference to the Fig. 1 and Fig. 4, the augmented reality application 116 may, in response to detecting the beacon signal or user input, execute the augmented reality application 116 using the transceiver 112 and the processor 114 (in Fig. 1) transmits the augmented reality request 160 to the physical device 130, as previously described. In another arrangement, the augmented reality application 116 may determine that the user (e.g., the augmented reality device 110 used by the user) is within a threshold distance of the sign 400 using GPS data generated by a GPA receiver (not shown) of the augmented reality device 110. In response to determining that the user is within the threshold distance of the sign 400, the augmented reality application 116 may transmit the augmented reality request 160 to the controller 134.

[0051] The augmented reality requirement 160 may specify a preferred color for one or more of the portions 410, 412, 414 of the sign 400. For example, assume that the user has red-green color blindness. Since the portion 410 of the sign 400 typically represents a red light color and the portion 414 of the sign 400 typically represents a green light color, the user may have difficulty distinguishing between the respective colors represented by the portions 410, 414 of the sign 400.

[0052] Nevertheless, the present arrangements address this problem. If portion 410 of indicia 400 is normally displayed in red, augmented reality request 160 may specify another preferred light color to be emitted by portion 410, for example, brown. Similarly, if portion 414 of indicia 400 is normally displayed in green, augmented reality request 160 may specify another preferred light color to be emitted by portion 414, for example, blue. Augmented reality application 116 may determine the preferred colors based on processing user profile 118 and / or electronic medical record 120.

[0053] The controller 134 may be configured to display the portions 410, 414 of the sign 400 in the respective preferred colors when illuminated in response to receiving the augmented reality request 160. For example, the controller may transmit control signals to switches / controllers that control the lamps 510. The switches / controllers may configure the portions 410, 414 of the sign 400 to display desired colors when illuminated.

[0054] Other drivers may also encounter the sign 400, and the preferred colors may be confusing to them. Nonetheless, the controller 134 may be configured to display different colors simultaneously or to display different colors repeatedly in sequence in response to receiving the augmented reality request 160. For example, the controller 134 may be configured to illuminate both red and brown lamps simultaneously for a portion 410 of the sign 400. Likewise, the controller 134 may be configured to illuminate both green and blue lamps simultaneously for a portion 414 of the sign 400. In another example, the lamps may be configured to display a specific color at a specific time. For example, the lamps may be LED lamps configured to emit two or more colors.Controller 134 may be configured to control the lamps for portion 410 of sign 400 to alternate between displaying red light and brown light. Furthermore, controller 134 may be configured to control the lamps for portion 414 of sign 400 to alternate between displaying green light and blue light.

[0055] In another arrangement, for example, an arrangement in which the augmented reality unit 110 is embodied as data glasses or an augmented reality headset, the augmented reality application 116 can, via the processor 114, overlay preferred colors onto a real view of the character 400 displayed by the augmented reality unit 110. In this regard, the augmented reality unit 110 can augment the real representation of the character 400.

[0056] For example, the augmented reality unit 110 may include an image capture unit that captures images of the sign 400 and displays the images to the user via the lenses of the smart glasses or a screen of the augmented reality headset. The augmented reality application 116 may detect light colors displayed by the parts 410, 412, 414 of the sign 400 in real time. Furthermore, the augmented reality application 116 may determine the light colors that are indistinguishable to the user based on the user profile 118 and / or the electronic medical record 120. The augmented reality application 116 can select colors to overlay the respective portions 410, 412, 414 of the character 400 in real time based on the user profile 118 and / or the electronic patient record 120 to make the character easier for the user to understand.The augmented reality application 116 may display the selected colors for the respective portions 410, 412, 414 of the sign 400 using an image display unit (e.g., projecting images / colors onto lenses of the smart glasses or displaying images / colors on a screen of the augmented reality headset) for visualization to the user. For example, if the portion 410 of the sign 400 is illuminated in a red color, the augmented reality application 116 may display a brown color over the portion 410 of the sign 400 when that portion of the sign is illuminated, and a blue color over the portion 414 of the sign when that portion of the sign is illuminated.

[0057] Fig. 5 illustrates an example of a lighting system 500 in an augmented reality environment 100. In this example, the physical device 130 may include lamps 510 of the lighting system 500 as the controlled units 136 ( Fig. 1). The lighting system 500 may illuminate a path 520 to allow the user to move (e.g., safely move) from a first location (e.g., a current location of the user) to at least one second location (e.g., a location to which the user intends to move).

[0058] With reference to the Fig. 1 and Fig. 5, the controller 134 may control the lamps 510 to illuminate the path 520 in response to receiving the augmented reality request 160 from the augmented reality device 110. Further, the augmented reality requests 160 may indicate to the controller 134 to illuminate the path 520 in one or more specific colors. Such colors may be colors that are distinguishable from other colors to the user. In one illustration, the user may have a visual impairment where the user is unable to distinguish certain colors. The augmented reality requests 160 may specify a preferred color in which to illuminate the path 520 so that the user can distinguish such illumination from other light the user may visually receive.

[0059] In a single arrangement, the augmented reality requests 160 may be generated in response to one or more user inputs to the augmented reality device 110. For example, the user may select a menu item presented by a user interface of the augmented reality device 110. The menu item may be, for example, a menu item indicating a request to find the nearest exit, a menu item indicating a request to travel to a specific location, etc. In response to the user selection of the menu item, the augmented reality application may generate the augmented reality requests 160 using the processor 114. Using the processor 114 and the transceiver 112, the augmented reality application may transmit the augmented reality request 160 to the transceiver 132, which may transmit the augmented reality requests 160 to the controller 134.

[0060] The controller 134 may process the augmented reality requests 160 and, in response, select the lamps 510 suitable for illuminating the path 520 and transmit control signals to those lamps (e.g., to switches / controllers controlling the lamps 510) to illuminate the lamps 510. The lamps 510 may be configured to produce a variety of light colors. For example, each lamp 510 may include one or more LED lamps configured to emit two or more colors.

[0061] Based on the augmented reality request 160, the control signals may indicate the light color that each respective lamp 510 should produce. For example, the augmented reality request 160 may specify one or more particular light colors, and the controller 134 may generate the control signals to indicate the one or more particular light colors. The augmented reality application 116 may select the particular light color(s) based on the user profile 118 and / or the user's electronic medical record 120. For example, if the user has difficulty distinguishing certain light colors, the augmented reality application 116 may select one or more colors that are distinguishable to the user.

[0062] In a further arrangement, for example an arrangement in which the augmented reality unit 110 is embodied as data glasses or as an augmented reality headset, the augmented reality application 116 may, via the processor 114, overlay a representation of the real environment presented to the user via the augmented reality unit 110 with the path 520. In this respect, the augmented reality unit 110 may augment the real representation with the path 520, for example in a manner similar to that described with reference to Fig. 4 is described.

[0063] Fig. 6 illustrates an example of an illuminating configurable physical structure 130 in an augmented reality environment 100. In this example, the physical structure 130 may be a wall, a floor, a ceiling, an area, etc. The physical structure 130 may include at least one screen 600 configured to emit light. In a single arrangement, the physical structure 130 may include a plurality of screens 600. Examples of a screen 600 include, but are not limited to, an LED light-emitting diode screen, an OLED organic light-emitting diode screen, a liquid crystal display (LCD), a plasma display, and so on. In another example, a screen 600 may be a fiber optic display including a plurality of fiber optic light tubes (not shown).A first end of each fiber optic light tube may be flush with a surface of the display 600, recessed behind the surface of the display 600, or protrude above the surface of the display 600. A second end of each tube may be attached to a lamp or placed near a lamp (e.g., an LED). Each fiber optic tube may emit light generated by the respective lamp through the first end of the fiber optic tube. In another example, a display 600 may include an image projector that projects images onto the physical structure 130.

[0064] With reference to the Fig. 1 and Fig. 6, the controller 134 may control the screen(s) 600 to illuminate a path 610 to allow the user to travel (e.g., safely travel) from a first location (e.g., a current location of the user) to at least a second location. The controller 134 may control the screen(s) 600 to illuminate the path 610 in response to receiving the augmented reality request 160 from the augmented reality device 110. Further, the augmented reality requests 160 may indicate to the controller 134 to illuminate the path 610 in one or more specific colors.

[0065] In another arrangement, the controller 134 may selectively control the screen(s) 600 to change an illuminated color scheme visually representing colors or textures of the physical device 130 in response to receiving the augmented reality request 160 from the augmented reality unit 110. For example, the controller 134 may control the screen(s) 600 to change a visual appearance of the screen(s) 600, and thus the physical structure 130, by changing colors or textures displayed on the screen(s).

[0066] In one illustration, if the physical device 130 is a ceiling, the controller 134 may control the screen(s) 600 to change one or more images presented by the screen. For example, a first set of images may be images of ceiling tiles. The images of the ceiling tiles may represent certain textures. Such textures may change in response to the images being changed. Thus, the physical device 130 may look like a certain type of ceiling. In response to receiving the augmented reality request 160 from the augmented reality unit 110, the controller 134 may control the screens 600 to change the images, for example, to images representing different ceiling tiles. Thus, the physical device 130 may look like a different type of ceiling.If the physical device 130 is a floor, a first set of images displayed by the screens 600 may be images depicting a wooden floor. Consequently, the physical device 130 may appear like a wooden floor containing wood textures. In response to receiving the augmented reality request 160 from the augmented reality unit 110, the controller 134 may control the screens 600 to change the images, for example, to images depicting a marble floor. Consequently, the physical device 130 may appear like a marble floor. If the physical device 130 is a wall, a first set of images displayed by the screens 600 may be images depicting one or more pieces of art.In response to receiving the augmented reality request 160 from the augmented reality device 110, the controller 134 can control the screens 600 to change the images, for example, to images depicting one or more different works of art. In further arrangements, the controller 134 can control the screens 600 to display different colors, combinations of colors, and / or visible textures. For example, the screens 600 can display images of steel gratings, images of carpet, and so on.

[0067] Fig. 7 is a block diagram illustrating an example computing architecture for an augmented reality device 110. The augmented reality device 170 may be configured similarly. The augmented reality device 110 may include at least one processor 114 (e.g., a central processing unit) connected to main memory elements 710 via a system bus 715 or other suitable circuitry. Thus, the augmented reality device 110 may store program code in the main memory elements 710. The processor 114 may execute the program code accessed from the memory elements 710 via the system bus 715.

[0068] The main memory elements 710 may include one or more physical main memory devices, such as a local main memory 720 and one or more mass storage devices 725. The local main memory 720 refers to random access memory (RAM) or other non-persistent main memory device(s) generally used during actual execution of the program code. The mass storage device(s) 725 may be implemented as a hard disk drive (HDD), solid state drive (SSD), or other persistent data storage device. The augmented reality device 110 may also include one or more cache memories (not shown) that provide temporary storage of at least a portion of the program code to reduce the frequency with which program code must be retrieved from the mass storage device 725 during execution.

[0069] Input / output (I / O) units, such as a user interface 730 and a transceiver 112. The I / O units may be connected to the augmented reality unit 110 either directly or through intermediary I / O controllers. The user interface 730 may include one or more screens, one or more projection units, one or more input / output audio units, and so on.

[0070] As in Fig. 7, the main memory elements 710 may store the components of the augmented reality device 110, namely the augmented reality application 116, the user profile 118, and optionally the electronic medical record 120. Executed as executable program code, the augmented reality application 116 may be executed by the processor 114 and, as such, may be considered part of the augmented reality device 110. Furthermore, the augmented reality application 116, the user profile 118, and the electronic medical record 120 are functional data structures that, when deployed as part of the augmented reality device 110, provide functionality.

[0071] Fig. Figure 8 is a block diagram illustrating an example computing architecture for a physical device 130. The physical device 130 may include at least one controller 134 connected to main memory elements 810 by a system bus 815 or other suitable circuitry. Thus, the physical device 130 may store program code in the main memory elements 810. The controller 134 may execute the program code accessed from the memory elements 810 via the system bus 815.

[0072] Main memory elements 810 may include one or more physical main memory units, such as local main memory 820 and one or more mass storage units 825. Physical device 130 may also include one or more caches (not shown) that provide temporary storage of at least a portion of the program code to reduce the frequency with which program code must be retrieved from mass storage unit 825 during execution.

[0073] Input / output (I / O) devices such as a transceiver 132 may be connected to the physical device 130 either directly or through intermediate I / O controllers. One or more actuators 138 may also be connected to the physical device 130 either directly or through intermediate I / O controllers. In a single arrangement, the actuator(s) 138 may be connected to one or more controlled devices and / or structures 136. In another arrangement, for example, an arrangement in which the controlled devices and / or structures 136 are lamps, the physical device 130 may include switches / controllers in addition to or instead of the actuator(s) 138.

[0074] As in Fig. 8, main memory elements 810 may store the components of physical device 130, namely, physical device application 140. In an arrangement where physical device application 140 is embodied in the form of executable program code, physical device application 140 may be executed by controller 134 and, as such, considered part of physical device 130. In an arrangement where controller 134 comprises programmable logic circuits, an FPGA, a PLA, etc., physical device application 140 may be executed within such controller 134. Physical device application 140 is a functional data structure that, when deployed as part of physical device 130, provides functionality.

[0075] Fig. 9 is a flowchart illustrating an example of a method 900 for launching a physical structure to change a configuration. The method 900 may be performed by the augmented reality unit 110 of Fig. 1 can be executed.

[0076] In step 905, the augmented reality device 110 may determine whether a user of the augmented reality device is within a threshold distance of a configurable physical device. In step 910, in response to determining that the user is within the threshold distance of the configurable physical device, the augmented reality device 110 may establish a communication connection between the augmented reality device and a controller of the configurable physical device. In step 915, the augmented reality device 110 may initiate the controller of the configurable physical device to change the configurable physical device from a first configuration to a second configuration, wherein the second configuration makes the configurable physical device more easily accessible to the user.

[0077] While the disclosure concludes with claims defining novel features, it is believed that the various features described herein will be better understood when the description is considered in conjunction with the drawings. The process(es), machine(s), manufacture(s), and any variations thereof described in this disclosure are provided for purposes of illustration. Any specific structural and functional details described are not to be construed as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously utilize the features described in virtually any appropriately detailed structure.Furthermore, the terms and phrases used in this disclosure are not intended to be limiting, but rather to enable an understandable description of the features presented.

[0078] For simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some elements may be slightly exaggerated relative to others for clarity. Furthermore, where appropriate, reference numerals are repeated in the figures to indicate corresponding, similar, or identical features.

[0079] The present invention may be a system, a method, and / or a computer program product. The computer program product may include a computer-readable storage medium(s) having computer-readable program instructions stored thereon for causing a processor to perform aspects of the present invention.

[0080] The computer-readable storage medium may be any physical device capable of retaining and storing instructions for use by an instruction-executing system. The computer-readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. A non-exhaustive list of more specific examples of the computer-readable storage medium includes the following: a portable computer diskette, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM).Flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanically encoded device such as punched cards or raised structures in a groove on which instructions are stored, and any suitable combination thereof. A computer-readable storage medium, as used herein, shall not be construed as containing transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., pulses of light carried through a fiber optic cable), or electrical signals carried through a wire.

[0081] Computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to respective computing / processing units or to an external computer or storage unit via a network such as the Internet, a local area network, a wide area network, and / or a wireless network. The network may include copper transmission cables, fiber optic transmission lines, wireless transmission, routers, firewalls, switching units, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing unit receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium within the respective computing / processing unit.

[0082] Computer-readable program instructions for performing operations of the present invention may be assembly language instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, or the like, as well as conventional procedural programming languages ​​such as the C programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server.In the latter case, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, over the Internet using an Internet service provider). In some embodiments, electronic circuits, including, for example, programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), may execute the computer-readable program instructions by utilizing state information of the computer-readable program instructions to personalize the electronic circuits to perform aspects of the present invention.

[0083] Aspects of the present invention are described herein with reference to flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, may be implemented by computer-readable program instructions.

[0084] These computer-readable program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device to produce a machine such that the instructions, executed by the processor of the computer or other programmable data processing device, produce a means for implementing the functions / steps defined in the flowchart block(s) and / or block diagrams.These computer-readable program instructions may also be stored on a computer-readable storage medium that can direct a computer, a programmable data processing apparatus, and / or other devices to function in a particular manner, such that the computer-readable storage medium having instructions stored thereon comprises an article of manufacture, including instructions that implement aspects of the function / step specified in the flowchart block(s) and / or block diagrams.

[0085] The computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of process steps to be performed on the computer, other programmable apparatus, or other device to produce a computer-executable process such that the instructions executing on the computer, other programmable apparatus, or other device implement the functions / steps defined in the block(s) of flowcharts and / or block diagrams.

[0086] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of instructions comprising one or more executable instructions for performing the particular logical function(s). In some alternative implementations, the functions indicated in the block may occur in a different order than shown in the figures. For example, two blocks shown in succession may actually execute substantially concurrently, or the blocks may sometimes execute in reverse order depending on the corresponding functionality.It is further understood that each block of the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by special purpose hardware-based systems that perform the specified functions or steps, or by combinations of special purpose hardware and computer instructions.

[0087] The terminology used herein is for the purpose of describing particular embodiments only and should not be construed as limiting the invention. The singular forms "a," "an," and "the," "which," as used herein, are intended to include the plural forms as well, unless the context clearly indicates otherwise. It is further understood that the terms "including," "including," "comprises," and / or "having," when used in this disclosure, refer to the presence of specified features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0088] Reference throughout this disclosure to "a single embodiment," "an embodiment," "a single arrangement," "an arrangement," "a single aspect," "an aspect," or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment described in this disclosure. Accordingly, one occurrence of the phrases "a single embodiment," "an embodiment," "a single arrangement," "an arrangement," "a single aspect," "an aspect," and similar language throughout this disclosure may, but need not, refer to the same embodiment.

[0089] The term "plurality" as used herein is defined as two or more than two. The term "another" as used herein is defined as at least one second or more. The term "connected" as used herein is defined as connected, whether directly without any intervening elements or indirectly with one or more intervening elements, unless otherwise specified. Two elements may also be mechanically, electrically, or communicatively connected through a transmission channel, path, network, or system. The term "and / or" as used herein refers to and includes any and all combinations of one or more of the related listed elements. Although the terms first, second, etc.may be used herein to describe various elements, it is also understood that these elements should not be limited by these terms, as these terms are used only to distinguish one element from another unless otherwise stated or unless the context indicates otherwise.

[0090] The term "if" may, depending on the context, be interpreted to mean "when" or "after" or "in response to the determination" or "in response to the detection." Similarly, the phrase "if it is determined" or "if [a specified condition or event] is detected" may, depending on the context, be interpreted to mean "after the determination" or "in response to the determination" or "after [the specified condition or event] has been detected," or "in response to [the specified condition or event] having been detected."

[0091] The descriptions of the various embodiments of the present invention have been presented for illustrative purposes, but are not intended to be exhaustive or limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope of the described embodiments. The terminology used herein has been chosen to best explain the principles of the embodiments, practical application, or technical improvement over existing technology, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

A method (900) comprising: determining (905) whether a user of a first augmented reality device (110) is within a threshold distance of a configurable physical device (130); in response to determining that the user is within the threshold distance of the configurable physical device, establishing (910) a communication connection between the first augmented reality device and a controller (134) of the configurable physical device, wherein a second augmented reality device (170) is within the threshold distance of the configurable physical device; coordinating the first augmented reality device with the second augmented reality device by exchanging at least one message (194) between the first augmented reality device and the second augmented reality device;based on the at least one message, determining, by at least the first augmented reality device, that the first augmented reality device has priority over the second augmented reality device in controlling the configurable physical device; and in response to determining that the first augmented reality device has priority in controlling the configurable physical device, starting (915), by the first augmented reality device, the controller of the configurable physical device to change the configurable physical device from a first configuration to a second configuration, wherein the second configuration makes the configurable physical device more accessible to the user; The method of claim 1, wherein:the configurable physical device comprises a handrail (210); andchanging the configurable physical device from the first configuration to the second configuration comprises translating the handrail from a first height to a second height. The method of claim 1, wherein: the configurable physical device comprises a shelf (320); and changing the configurable physical device from the first configuration to the second configuration comprises moving the shelf from a first height (330, 332) to a second height (332, 330). The method of claim 1, wherein:the configurable physical device comprises a character (400); andchanging the configurable physical device from the first configuration to the second configuration comprises changing a color of at least a portion (410, 412, 414) of the character from a first color to a second color. The method of claim 1, wherein: the configurable physical device comprises a lamp (510); and changing the configurable physical device from the first configuration to the second configuration comprises changing a color of the lamp from a first color to a second color. The method of claim 1, wherein: the configurable physical device comprises a plurality of lamps (510); and changing the configurable physical device from the first configuration to the second configuration comprises controlling the plurality of lamps to illuminate a path (520) to allow the user to travel from a first location to at least one second location. The method of claim 1, wherein:the configurable physical device has at least one screen (600) configured to emit light; andchanging the configurable physical device from the first configuration to the second configuration comprises selectively controlling the screen to change an illuminated color scheme that visually represents colors or textures of the configurable physical device. The method of claim 1, further comprising:accessing an electronic medical record (180) of the user; andautomatically determining the second configuration based on the user's electronic medical record. The method of claim 1, further comprising:accessing a user profile (178) of the user; andautomatically determining the second configuration based on the user profile of the user. An augmented reality device (110), comprising: a processor (114) programmed to initiate executable operations comprising: determining whether a user of a first augmented reality device (110) is within a threshold distance of a configurable physical device (130); in response to determining that the user is within the threshold distance of the configurable physical device, establishing a communications connection between the first augmented reality device and a controller (134) of the configurable physical device, wherein a second augmented reality device (170) is within the threshold distance of the configurable physical device;Coordinating the first augmented reality unit with the second augmented reality unit by exchanging at least one message (194) between the first augmented reality unit and the second augmented reality unit; based on the at least one message, determining by at least the first augmented reality unit that the first augmented reality unit has priority over the second augmented reality unit in controlling the configurable physical device;andin response to determining that the first augmented reality device has priority in controlling the configurable physical device, starting, by the first augmented reality device, the controller of the configurable physical device to change the configurable physical device from a first configuration to a second configuration, wherein the second configuration makes the configurable physical device more easily accessible to the user.; The augmented reality device of claim 10, wherein: the configurable physical device comprises a handrail (210); and changing the configurable physical device from the first configuration to the second configuration comprises displacing the handrail from a first height to a second height. The augmented reality device of claim 10, wherein: the configurable physical device comprises a shelf (320); and changing the configurable physical device from the first configuration to the second configuration comprises displacing the shelf from a first height (330, 332) to a second height (332, 330). The augmented reality device of claim 10, wherein: the configurable physical device comprises a character (400); and changing the configurable physical device from the first configuration to the second configuration comprises changing a color of at least a portion (410, 412, 414) of the character from a first color to a second color. The augmented reality device of claim 10, wherein: the configurable physical device comprises a lamp (510); and changing the configurable physical device from the first configuration to the second configuration comprises changing a color of the lamp from a first color to a second color. The augmented reality device of claim 10, wherein: the configurable physical device comprises a plurality of lamps (510); and changing the configurable physical device from the first configuration to the second configuration comprises controlling the plurality of lamps to illuminate a path (520) to allow the user to travel from a first location to at least one second location. The augmented reality device of claim 10, wherein: the configurable physical device includes at least one screen (600) configured to emit light; and changing the configurable physical device from the first configuration to the second configuration includes selectively controlling the screen to change an illuminated color scheme that visually represents colors or textures of the configurable physical device. A computer program product comprising a computer-readable storage medium having program code stored thereon, the program code being executable by a processor to perform a method according to any one of claims 1 to 9.

Images