Convertible interface

Abstract

The invention relates to a convertible interface. A portable electronic device may include a display, a processor, a sensor, and a wireless communication module. A sensor may detect the presence of an operable object in the vicinity of the portable electronic device. The processor may cause the display to depict an interface corresponding to the actionable object based at least in part on the detection of the presence of the actionable object. The wireless communication module may transmit a signal indicating that the operable object performs an action based at least in part on the input to the interface.

Description

[0001] This application is a divisional application of the patent application for invention with the application date of March 7, 2022, application number 202210216465.5, and invention title "Convertible Interface".

[0002] Cross - Reference to Related Applications

[0003] This application claims the benefit of U.S. Provisional Patent Application No. 63 / 158,766, filed on March 9, 2021, with the title "TRANSFERRABLE INTERFACE", the entire disclosure of which is incorporated herein by reference. Technical Field

[0004] The described examples generally relate to user interfaces. More specifically, the examples herein relate to supplementing input from an object using a user interface. Background Art

[0005] People around the world typically always carry at least one portable electronic device with them. Portable electronic devices such as smart phones, smart watches, tablet computers, or other devices can provide functions that are beneficial for organizing, planning, and performing various daily tasks. For example, a portable electronic device can provide valuable utilities to a user of the electronic device, related to time management, appointment scheduling, exercise, communication, navigation, shopping, entertainment, and many other activities. In addition, some portable electronic devices can provide utilities related to health monitoring, such as sleep tracking or heart rate monitoring. Summary of the Invention

[0006] According to some examples of the present disclosure, a portable electronic device may include a display, a processor, a sensor, and a wireless communication module. The sensor can detect the presence of an operable object near the portable electronic device. The processor can cause the display to depict an interface corresponding to the operable object at least in part based on the detection of the presence of the operable object. The wireless communication module can transmit a signal indicating that the operable object performs an action at least in part based on an input to the interface.

[0007] In some examples, the portable electronic device may include a smart phone, a smart watch, or a tablet computing device. The interface may correspond to an input component of the operable object. The sensor can detect the presence of the operable object at least in part based on receiving radio waves emitted by the operable object. The operable object may include a button. The interface may visually resemble the button, and the input may include a touch input. The signal can notify the operable object of the user's presence at the operable object.

[0008] When the sensor detects the presence of an operable object, the portable electronic device may download information. The characteristics of the input elements generated in the interface may correspond to the information. The signal may be a first signal, and the wireless communication module may receive a second signal from the operable object. The processor may perform an action at least in part based on the second signal. Causing the display to depict an interface corresponding to the operable object may include causing the display to depict the interface on a portion of the display.

[0009] According to some examples, an operable device may include a controller, an operable component, and a communication module. The communication module may transmit a first signal to the portable electronic device. The first signal includes identification information. In addition or alternatively, the communication module may receive a second signal from the portable electronic device. The second signal may include instructions. The controller may cause the operable component to perform an action at least in part based on the instructions.

[0010] In some examples, the identification information may include a unique operable device identifier. The second signal may further include a unique user identifier. The action may include a transaction. The operable device may include an input component communicatively coupled to the controller. The controller may cause the operable component to perform an action at least in part based on the input received by the input component. The input component may include at least one of an analog input component or a digital input component. The plurality of input components may include a combination of analog and digital inputs for operating a physical machine. Example analog input components may include one or more physical and tactile input mechanisms such as buttons, switches, toggle devices, levers, or knobs. Example digital input components may include touchscreens and other digital user interfaces. The first signal may include information related to at least one of the size, appearance, or position of an input element of a user interface to be depicted by the portable electronic device. The identification information may include at least one of information related to the type of the operable device or the location of the operable device. The communication module may include at least one of an ultra-wideband (UWB) module, a Bluetooth module, a Wi-Fi module, or a near-field communication (NFC) module. In some examples, the communication module may continuously transmit the first signal. The portable electronic device may include a smartwatch, a smartphone, or a tablet computing device.

[0011] According to some examples, a method is disclosed that includes detecting an operable device. The method may include receiving information at least in part based on detecting the operable device. The method may include generating a user interface on an electronic device based on the received information. The method may include receiving an input from a user at the user interface. The method may include transmitting a signal including instructions that, when received by the operable device, cause the operable device to perform an action associated with the input.

[0012] In some examples, the method further includes prompting a user to begin receiving information. The operable device can include an automated teller machine (ATM), a pedestrian crossing system, a medical device, an elevator control system, an access control system, an intercom system, or a vending machine. The input can include touch input, voice input, gesture input, swipe touch input, or proximity touch input. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The present disclosure will be readily understood by the following detailed description in conjunction with the accompanying drawings, where like reference numerals refer to like structural elements, and wherein:

[0014] Figure 1 A block diagram is shown that includes a portable electronic device and an operable object.

[0015] Figure 2 A block diagram is shown that includes a portable electronic device and an operable object.

[0016] Figure 3A A display of the portable electronic device is shown.

[0017] Figure 3B A display of the portable electronic device is shown.

[0018] Figure 3C A display of the portable electronic device is shown.

[0019] Figure 4A A person using the portable electronic device is shown.

[0020] Figure 4B A perspective view of the operable object and Figure 4A the portable electronic device is shown.

[0021] Figure 4C A perspective view of the operable object and Figure 4A the portable electronic device is shown.

[0022] Figure 5 A person using the portable electronic device is shown.

[0023] Figure 6 A person using the portable electronic device is shown.

[0024] Figure 7 A person using the portable electronic device is shown.

[0025] Figure 8 A person using the portable electronic device is shown.

[0026] Figure 9 A process flow diagram is shown. DETAILED DESCRIPTION

[0027] Reference will now be made specifically to representative examples shown in the accompanying drawings. It should be understood that the following description is not intended to limit the examples to one preferred example. Instead, the following description is intended to cover alternatives, modifications, and equivalents that may be included within the spirit and scope of the examples as defined by the appended claims.

[0028] Portable electronic devices such as smart phones, tablet computing devices, smart watches, and earphones have become common and are almost necessary for accessing electronic information and communicating with others. Additionally, portable electronic devices can provide assistance in completing daily tasks and errands. For example, a user of a portable electronic device can generate a shopping list or monitor their progress during and after a routine workout. However, some daily activities can expose users to public surfaces that may contain harmful pathogens such as viruses and bacteria. For example, contact with public or communal operable objects or devices such as elevators, pedestrian crossing systems, medical devices, and automated teller machines (ATMs) can expose a user to harmful pathogens left on the buttons or other input components of the operable object by a previous user of the operable object. A user can also put others at risk by spreading pathogens after contact with a contaminated button or other input component of an operable object.

[0029] In addition, the input components for these public operable devices may need to be robust to withstand repeated use by many users. This robustness or other requirements of the operable device often result in binary switches and buttons and can limit the ways in which a user can interact with or provide input to the operable device. However, such operable devices may be capable of performing additional or more complex functions compared to those that can be controlled with binary or simplified built-in input components of the operable device.

[0030] One aspect of the present disclosure relates to supplementing a button, interface, or input component of an actionable object with a user interface on a display of a portable electronic device. In other words, a user's portable electronic device can detect the presence of an actionable object (e.g., a crosswalk button, an elevator, an ATM, a medical device, and any other physical machine, system, or object that performs a function or operation in response to a received signal, which is often generated by an interaction with a button or user interface), and can generate a user interface that allows the user to operate the actionable object without physically touching the actionable object. In some examples, the actionable object can be any object that is publicly available or usable by the user and other members of the public, and includes a physical / tactile / real input interface or component having at least one physical button, lever, or input area. In some examples, the portable electronic device can include a display, a processor, a sensor, and a wireless communication module. The sensor can detect the presence of the actionable object near the portable electronic device. The processor can cause the display to depict an input area corresponding to the actionable object, at least in part based on the detection of the presence of the actionable object. The input area can include a user interface corresponding to the actionable object such that the input area or the generated user interface mimics the input component or physical interface of the actionable object. For example, the user interface can include any number of displays, virtual sliders, buttons, switches, and fields representing the actual display, slider, button, switch, and fields of the actionable object. The wireless communication module can transmit a signal indicating that the actionable object performs an action at least in part based on an input to the input area.

[0031] Another aspect of the present disclosure relates to a method for supplementing an input component of an actionable device. The method can include detecting the actionable device. In one example, a portable electronic device can detect the actionable device by receiving radio waves transmitted by the actionable device. Once the actionable device is detected, the method can then further include receiving information about the actionable device and generating a user interface on the portable electronic device based on the received information. For example, when the sensor detects the presence of the actionable device, the portable electronic device can download the information. The method can also include receiving an input from the user at the interface. For example, the input can include a touch input, a voice input, a gesture input, a swipe touch input, a proximity touch input, another type of input, or a combination thereof. After receiving the input from the user at the interface, the portable electronic device can then transmit a signal including instructions that, when received by the actionable device, cause the actionable device to perform an action associated with the input. For example, the actionable device can be communicatively coupled to a door of a building, and the instructions can cause the actionable device to open the door without the user physically touching the door handle.

[0032] Reference will be made below to Figures 1 - 9Let's discuss these examples and other examples. However, those skilled in the art will readily understand that the detailed description given herein with respect to these figures is for illustrative purposes only and should not be construed as limiting. Additionally, as used herein, a system, method, article of manufacture, component, feature, or sub-feature that includes at least one of a first option, a second option, or a third option should be understood to refer to a system, method, article of manufacture, component, feature, or sub-feature that may include one (e.g., only one first option, only one second option, only one third option) of each of the listed options, multiple of a single listed option (e.g., two or more first options), two options simultaneously (e.g., one first option and one second option), or a combination thereof (e.g., two first options and one second option).

[0033] Figure 1 A block diagram showing a portable electronic device 100 and an operable object 102 is presented. The portable electronic device 100 may represent one or more portable electronic devices, such as one or more smart phones, head-mounted devices or displays (e.g., computer glasses, smart glasses, virtual reality (VR) head-mounted devices, mixed reality head-mounted devices, augmented reality (AR) head-mounted devices or glasses, and any head-mounted electronic device configured for or adaptable for non-immersive experiences that directly interact with the physical environment, semi-immersive experiences that combine interactions with the physical environment and virtual environment, and / or fully immersive experiences that only interact with the virtual environment), tablet computing devices, smart watches, laptop computing devices, or any other portable electronic device. The operable object 102 may also be referred to as an operable device, and thus, the terms "operable object", "operable device", and "device" may be used interchangeably herein. The operable object 102 can be any physical machine or system having a user input component or interface that can be operated by more than one user. For example, the operable object 102 can be an electric machine or electric device that is often operated by multiple discrete users to perform tasks. In some examples, the operable object 102 can be an automated teller machine (ATM), a pedestrian crossing system, a medical device, a control system for a lift, an access control system, an intercom system, a vending machine, a product kiosk, a printer or copier, a vehicle, including semi-autonomous or fully autonomous vehicles, an industrial machine, a factory assembly line, a processing system, and / or any other physical machine or system having a user input component or interface, and / or a combination thereof.

[0034] The portable electronic device 100 may include a display 104, a processor 106, one or more sensors 108, and a wireless communication module 110. Each of the display 104, the processor 106, the one or more sensors 108, and the wireless communication module 110 may be operably connected via a communication path 112. The communication path 112 may be a wired or wireless communication path that electrically couples one or more components within the portable electronic device 100 (e.g., the display 104, the processor 106, the one or more sensors 108, and the wireless communication module 110). For example, the communication path 112 may be a serial bus that communicatively couples the components of the portable electronic device 100.

[0035] The display 104 may be any form of display, component, or device for displaying visual content to a user. For example, the display 104 may be an LED display, an OLED display, an LCD display, or any other form of display known in the art presently or that may be developed in the future. In some examples, the display 104 may be a touchscreen display or may have touch detection capabilities, such as capacitive touch, force touch, and proximity touch capabilities. For example, the display 104 may define a user input area that may receive input from a user of the portable electronic device 100. The display 104 may include one or more layers (e.g., a capacitive touch layer) and / or components disposed within an internal volume defined by the portable electronic device 100 for detecting user input at or near the user input area.

[0036] The processor 106 may include one or more computer processors, controllers, or microcontrollers that perform operations in response to receiving computer-readable instructions. The processor 106 may include a central processing unit (CPU) of the portable electronic device 100. Additionally or alternatively, the processor 106 may include other processors within the portable electronic device 100, including application-specific integrated circuits (ASICs) and other microcontrollers.

[0037] The processor 106 may be operatively coupled to a memory (not shown) disposed within or communicatively coupled to the portable electronic device 100. The memory may include various types of non-transitory computer-readable storage media, including, for example, random access memory (RAM), read-only memory (ROM), erasable programmable memory (e.g., EPROM and EEPROM), or flash memory. The memory may store computer-readable instructions. Additionally or alternatively, the memory may include various types of non-transitory computer-readable storage media, including, for example, hard drive storage devices, solid state storage devices, portable magnetic storage devices, or other similar devices. The processor 106 may read the computer-readable instructions stored on the memory. The computer-readable instructions may cause the processor 106 to perform the operations, functions, and aspects of the disclosure described herein. The computer-readable instructions may be provided as a computer program product, software application, and the like.

[0038] In some examples, the portable electronic device 100 may further include one or more power sources or power supplies (not shown) located within the portable electronic device 100 and operatively coupled to one or more of the display 104, the processor 106, the one or more sensors 108, and the wireless communication module 110. The one or more power sources may be rechargeable and may provide power to the display 104, the processor 106, the one or more sensors 108, and the wireless communication module 110 of the portable electronic device 100. The one or more power sources may include any device capable of storing and discharging electrical power, such as one or more lithium-ion polymer batteries or other forms of electrical energy storage devices.

[0039] The one or more sensors 108 may be disposed within the portable electronic device 100. When the portable electronic device 100 is near or in the vicinity of the actionable object 102, the one or more sensors 108 may detect the presence of the actionable object 102. For example, the actionable object 102 may emit a signal (e.g., radio wave), and the one or more sensors 108 may detect or receive the signal when the portable electronic device 100 is sufficiently close to the actionable object 102. The signal emitted from the actionable object 102 may be a radio wave having a frequency and magnitude that conform to a wireless communication protocol, such as ultra-wideband (UWB), Bluetooth, Wi-Fi, near field communication (NFC), or another wireless communication protocol. The actionable object 102 may emit the signal intermittently or continuously. For example, the actionable object 102 may periodically emit the signal throughout a duration, such as emitting the signal every 5 seconds for a duration of 2 hours. The period of emitting the signal may be any period between 1 millisecond and 1 hour. In some examples, the period may vary with respect to the expected usage rate of the actionable object 102. For example, the actionable object 102 may be a crosswalk system or a pedestrian crossing system, and the period of the crosswalk system emitting the signal may be more frequent (e.g., smaller period) when the expected usage rate of the crosswalk system is higher, such as when a sports event is held at a venue adjacent to the crosswalk system. The signal (e.g., radio wave) may inform the crosswalk system (i.e., the pedestrian crossing system) of the presence of a user at the crosswalk.

[0040] The one or more sensors 108 may detect the presence of the actionable object 102 near the portable electronic device 100. The portable electronic device 100 may be disposed near the actionable object 102 when the distance between the portable electronic device 100 and the actionable object 102 is less than 1 meter, between about 1 meter and about 5 meters, between about 5 meters and about 25 meters, between about 25 meters and about 50 meters, or less than about 200 meters. In some examples, the portable electronic device 100 may be located within half a meter of the actionable object 102 such that the one or more sensors 108 detect the presence of the actionable object 102.

[0041] In some examples, the one or more sensors 108 may include any number or combination of sensor types, including but not limited to force sensors, position sensors, pressure sensors, capacitance sensors, piezoelectric sensors, optical sensors, laser sensors, ultrasonic sensors, Hall effect sensors, etc. In one example, the one or more sensors 108 may include an optical sensor and / or other sensors that can detect the presence of the operable object 102 when the portable electronic device 100 is near or in the vicinity of the operable object 102 without the operable object 102 emitting any kind of signal. In some examples, the one or more sensors 108 may include a camera that detects the presence of the operable object 102 by capturing an image of the operable object 102, a portion of the operable object 102, or an attribute of the operable object 102. For example, the one or more sensors 108 may include a camera for detecting a light pulse, a quick response (QR) code, or another optically recognizable image or design visible on the operable object 102. The one or more sensors 108 (along with the processor 106) may implement image recognition techniques or computer vision to detect the presence of the operable object 102 near the portable electronic device 100.

[0042] In some examples, a communication module such as the wireless communication module 110 may wirelessly transmit and / or receive data with respect to the operable object 102. In some examples, the wireless communication module 110 may include one or more wireless transmitters and / or systems, including an antenna system, such as WIFI, Bluetooth, UWB, cellular, LTE, 5G, GPS, ZigBee, radio, or any other form of wireless transmission system. These systems may facilitate wireless communication with other devices (e.g., the operable object 102). Each of the one or more wireless antenna systems may transmit and / or receive wireless signals at one or more frequencies. For example, the wireless communication module 110 may transmit instructions to the operable object 102 that, when received, cause the operable object 102 to perform an action (e.g., change a traffic signal and count down a crosswalk for pedestrians).

[0043] In some examples, the operable object 102 may include an input component 114, a communication module 116, a controller 118, and an operable component. Each of the input component 114, the communication module 116, the controller 118, and the operable component 120 may be operably connected via a communication path 122. The communication path 122 may be a wired or wireless communication path that electrically couples one or more components within the operable object 102 (e.g., the input component 114, the communication module 116, the controller 118, the operable component 120, or other components). For example, the communication path 122 may be a serial bus that communicatively couples the components of the operable object 102.

[0044] The input component 114 can be one or more buttons, switches, toggle devices, levers, knobs, touchscreens, other input components, or combinations thereof. In some examples, the controller 118 can cause the operable component 120 to perform an action at least partially based on the input received by the input component 114. For example, an ATM can be considered an example of the operable object 102, and the buttons on the ATM that a user uses to interact with the ATM can be considered the input component 114. When actuated, the input component 114 can cause the operable object 102 to perform an action or task (e.g., withdraw currency from an ATM). The communication module 116 can include one or more antennas and controllers that enable wireless communication between the operable object 102 and another device (e.g., the portable electronic device 100). In other words, the communication module 116 can transmit and / or receive signals (e.g., radio waves) from the device. Thus, the communication module 116 can include one or more wireless antenna systems, such as WIFI, Bluetooth, UWB, cellular, LTE, 5G, GPS, or any other form of wireless antenna system. For example, the communication module 116 can transmit signals, such as radio waves, that can be detected by the one or more sensors 108 of the portable electronic device 100. In addition or alternatively, the communication module 116 can receive or detect signals transmitted by the portable electronic device 100 that indicate the operable object 102 to perform an action or task.

[0045] The controller 118 can include one or more computer processors, controllers, or microcontrollers that execute operations in response to receiving computer-readable instructions. In addition or alternatively, the operation instructions received at the communication module 116 can be provided to the controller 118 to cause the controller 118 to perform an action or task (e.g., change a traffic signal and count down for pedestrians to cross the road). The controller 118 can include a processor within the operable object 102, including an application-specific integrated circuit (ASIC) and other microcontrollers.

[0046] The controller 118 may be operatively coupled to a memory (not shown) disposed within or communicatively coupled to the operable object 102. The memory may include various types of non-transitory computer-readable storage media, including, for example, random access memory (RAM), read-only memory (ROM), erasable programmable memory (e.g., EPROM and EEPROM), or flash memory. The memory may store computer-readable instructions. Additionally or alternatively, the memory may include various types of non-transitory computer-readable storage media, including, for example, hard drive storage devices, solid state storage devices, portable magnetic storage devices, or other similar devices. The controller 118 may read the computer-readable instructions stored on the memory. The computer-readable instructions may cause the controller 118 to perform the operations, functions, and aspects of the disclosure described herein. The computer-readable instructions may be provided as a computer program product, software application, or the like.

[0047] The operable component 120 may be any component of the operable object 102 capable of performing an action. For example, the operable component 120 may include any operable object, such as one or more buttons, dials, knobs, touch detection surfaces, displays, combinations thereof, or any other component or combination of components capable of performing one or more actions or affecting the operation of the operable object 102. The operable component 120 may be pressed, turned, pushed, flipped, rotated, or otherwise actuated to perform an action associated with the operable object 102. Examples of the operable object 102 and its associated operable component 120 may include, but are not in any way limited to, a crosswalk system and a push button to cross; an ATM and an ATM user interface; an access keypad; an elevator control system and buttons; an access control system and a near field communication terminal; a medical device and a touch display panel; an autonomous vehicle and a start button; or other systems or devices capable of performing actions having one or more of the examples of the operable component 120 listed above.

[0048] In some examples, the operable object 102 may be a crosswalk system, and the operable component 120 may be a traffic signal that changes the emitted color to stop traffic while a pedestrian crosses the street. Additionally or alternatively, the operable component 120 may be a light-emitting display that depicts a numerical countdown sequence corresponding to the number of seconds remaining for a pedestrian to cross the street. In some examples, the operable object 102 may be a medical device, and the operable component 120 may be a valve, motor, pump, or other component of the medical device that is actuated when a signal is transmitted by the portable electronic device 100 (e.g., via the wireless communication module 110). The operable component 120 may be communicatively coupled to the controller 118 such that the controller 118 may cause the operable component 120 to perform one or more actions.

[0049] In some examples, the operable component 120 can be a display, a control panel, or another component capable of receiving input within a vehicle (i.e., the operable object 102), such as a vehicle configured for autonomous operation / transportation. For example, a first user of a vehicle can enter the vehicle and operate the vehicle using a first portable electronic device carried by the first user without physically touching the display. After the first user has left the vehicle, a new or second user can enter the vehicle and operate the vehicle using a second portable electronic device carried by the second user without physically touching the display. Thus, the multiple users (e.g., the first user and the second user) can control or otherwise operate the autonomous vehicle without physically touching or contacting the vehicle's display, which may have been contaminated by a previous user of the vehicle. Additionally, the exemplary system reduces wear and increases the useful life of the operable component 120.

[0050] In some examples, the communication module 116 can transmit a first signal to the portable electronic device 100. The communication module 116 can transmit the first signal continuously or periodically. The first signal can include information, such as identification information identifying the user or the portable electronic device 100 itself. The identification information can include a unique operable device identifier that allows the portable electronic device 100 to further communicate with the operable device 102. The identification information can include at least one of information related to the type of the operable device or the location of the operable device. For example, the type of the operable device can be an elevator control system, and the location of the operable device can be an address or a description of the location of the elevator within a building. In an example, the first signal can include information related to at least one of the size, appearance, or location of an input element (e.g., input element 310) of a user interface (e.g., user interface 308) to be depicted by the portable electronic device 100.

[0051] In addition or alternatively, the communication module 110 of the portable electronic device 100 can transmit a second signal to the portable electronic device 100. The second signal can include, for example, an instruction that instructs the controller 118 to cause the operable component 120 to perform an action at least partially based on the instruction. For example, the operable object 102 can be an automated teller machine, and the second signal can include a unique user identifier. The instruction can cause the automated teller machine to conduct a transaction between the automated teller machine and the portable electronic device. The instruction can include information related to the monetary value of the transaction.

[0052] Figure 2A block diagram showing a portable electronic device 200 and an operable object 202 is presented. The portable electronic device 200 may include a display 204, a processor 206, and a wireless communication module 210. Each of the display 204, the processor 206, and the wireless communication module 210 may be operably connected via a communication path 212. The communication path 212 may be a wired or wireless communication path that electrically couples one or more components within the portable electronic device 200 (e.g., the display 204, the processor 206, and the wireless communication module 210). For example, the communication path 212 may be a serial bus that communicatively couples the components of the portable electronic device 200.

[0053] The display 204 may be substantially similar to the display 104 and may include some or all of the features of the display 104. For example, the display 204 may be a touchscreen display or may have touch detection capabilities such as capacitive touch, force touch, and proximity touch capabilities. The processor 206 may be substantially similar to the processor 106 and may include some or all of the features of the processor 106. For example, the processor 206 may include one or more computer processors or microcontrollers that perform operations in response to receiving computer-readable instructions. The wireless communication module 210 may be substantially similar to the wireless communication module 110 and may include some or all of the features of the wireless communication module 110. For example, the wireless communication module 210 may wirelessly transmit and / or receive data relative to the operable object 202.

[0054] In some examples, the wireless communication module 210 may be disposed within the portable electronic device 200. When the portable electronic device 200 is near or in the vicinity of the operable object 202, the wireless communication module 210 may detect the presence of the operable object 202. For example, the operable object 202 may emit a signal (e.g., radio waves), and an antenna within the wireless communication module 210 may detect or receive the signal. The signal emitted from the operable object 202 may be radio waves having a frequency and magnitude that conform to a wireless communication protocol, such as ultra-wideband (UWB), Bluetooth, Wi-Fi, near-field communication (NFC), or another wireless communication protocol. The operable object 202 may emit the signal intermittently or continuously. For example, the operable object 202 may periodically emit the signal throughout a duration, such as emitting the signal every 2 seconds for a duration of 10 hours. The period of the emitted signal may be any period between 1 millisecond and 1 hour. In some examples, the period may vary relative to the expected usage rate of the operable object 202. For example, the operable object 202 may be a crosswalk system or a pedestrian crossing system, and the period of the crosswalk system emitting the signal may be more frequent (e.g., a smaller period) when the expected usage rate of the crosswalk system is higher, such as when a sports event is held at a venue adjacent to the crosswalk system.

[0055] The wireless communication module 210 can detect the presence of the operable object 202 near the portable electronic device 200. When the distance between the portable electronic device 200 and the operable object 202 is less than 1 meter, between about 1 meter and about 5 meters, between about 5 meters and about 25 meters, between about 25 meters and about 50 meters, or less than about 200 meters, the portable electronic device 200 can be set near the operable object 202. In some examples, the portable electronic device 200 can be located within half a meter of the operable object 202 so that the wireless communication module 210 can detect the presence of the operable object 202.

[0056] Any number or type of components in any configuration described herein can be included in the portable electronic device. The components can include any combination of the features described herein and can be arranged in any of the various configurations described herein. The structure and arrangement of the device components and the concepts regarding their use can be applied not only to the specific examples discussed herein but also to any number of examples in any combination. The following refers to Figures 3A - 3C Describe various examples of user input areas depicted on the display of a portable electronic device.

[0057] Figure 3A A portable electronic device 300 is shown, which includes a display 302 disposed within a housing 304. The display 302 can be substantially similar to the display 104 and can include some or all of the features of the display 104. For example, the display 302 can be an LED display, an OLED display, an LCD display, or any other form of display known in the art now or that may be developed in the future. In some examples, the display 302 can be a touchscreen display or can have touch detection capabilities such as capacitive touch, force touch, and proximity touch capabilities. For example, the display 302 can define a user input area 306, and the user input area can receive input from a user of the portable electronic device 300. The user input area 306 can include a user interface 308 corresponding to an operable object (such as an input component of the operable object). The display 302 can include one or more layers (e.g., a capacitive touch layer) and / or components that are disposed within an internal volume defined by the housing 304 of the portable electronic device 300. The one or more layers and / or components can detect user input at or near the user input area 306.

[0058] The portable electronic device 300 can detect or otherwise identify an input at the user input area 306, such as a touch input, a near-touch input, a swipe touch input, other inputs, or a combination thereof. In some examples, a user interface 308 of input elements 310 may be depicted within the user input area 306. The user interface 308 can be any graphical user interface (GUI) or touchscreen GUI, form-based interface, or menu-driven interface that is configured to simulate or otherwise represent real-world inputs, buttons, screens, or other interfaces of operable objects. In some examples, the user interface 308 may include graphical representations that present the shape, color, tactile response, and / or other characteristics of real-world inputs. In some examples, the user interface 308 may include additional inputs and functions that are not typically available for the physical or real-world interfaces of operable objects. As Figure 3A shown, the input elements 310 of the user interface 308 can form virtual buttons that can receive touch inputs from a user of the portable electronic device 300. The input elements 310 can be similar to or otherwise related to input components of operable objects (e.g., input component 114). For example, the input elements 310 can be similar to buttons on a crosswalk system or call buttons for a lift system. When actuated (e.g., touched by the user), the input elements 310 can cause the portable electronic device 300 to transmit a signal indicating that one or more operable objects perform an action. Additionally, the signal can be a first signal, and a wireless communication module (e.g., wireless communication module 210) can receive a second signal from an operable object (e.g., operable object 202) that causes a processor (e.g., processor 206) to perform an action at least in part based on the second signal. For example, the second signal can cause the portable electronic device 300 to output a message to a user of the portable electronic device 300.

[0059] In some examples, the user input area 306 can cover most of the display 302 (see Figure 3A and Figure 3B ) or cover a portion of the display 302 (see Figure 3C ). Although Figure 3A only depicts a user interface 308 with a single input element 310, other examples of user interfaces can be formed by multiple input elements arranged around the user input area (see Figure 3B ). Additionally, the multiple input elements can vary in size, shape, and function. For example, the input elements can include any graphically generated buttons, regions, sliders, levers, switches, knobs, or other features configured to receive input from a user to effect an action or input to the system. Other examples of user interfaces will be described in more detail with reference to Figure 3B and Figure 3C .

[0060] Figure 3B illustrates a portable electronic device 300 that includes a display 302 disposed within a housing 304. As Figure 3B shown, the display 302 can depict a user interface 308 within a user input area 306 and can include a plurality of input elements 310A, 310B, 310C, 310D. Although Figure 3B each of the input elements 310A, 310B, 310C, 310D depicted in

[0061] is unique, the user interface 308 can additionally or alternatively include a plurality of repeated input elements (e.g., two or more input elements of the same type). Additionally, although a specific number of input elements 310A, 310B, 310C, 310D are shown, the user interface 308 can include any number of input elements and can include input elements of variable number and size. In some examples, the number, size, shape, and / or configuration of the input elements can be user-controlled and / or automatically adjusted as needed. In other examples, the number, size, shape, and / or configuration of the input elements can be controlled by an operable object and transmitted to the portable electronic device 300 via an emitted signal.

[0062] The input elements 310A, 310B, 310C, 310D described herein are given only as examples of possible input elements that can be used to form the user interface 308. Thus, the examples of input elements shown in the figures and described herein should not be considered as limiting the scope of input elements contemplated within the present disclosure. Each of the input elements 310A, 310B, 310C, 310D that form the user interface 308 can receive input from a user that can be used to form an instruction to be transmitted to an operable object. In some examples, at least a portion of the input elements 310A, 310B, 310C, 310D can be similar to corresponding buttons or other input components of the operable object. For example, the input element 310D can look like or be substantially similar to the keypad of an ATM. In some examples, one or more of the input elements 310A, 310B, 310C, 310D that form the user interface 308 can be unique to the user interface 308 (i.e., not present on the operable object), and thus can enable a user to control additional aspects or functions of the operable object beyond those provided by the input components of the operable object. For example, the input element 310A can allow a user to specify the desired amount of time to cross a street in a crosswalk and can transmit that time to the crosswalk system, while the standard physical buttons on the crosswalk system do not enable a user to select the amount of time required to cross. After the user has selected a desired value using the toggle arrows 314A, 314B, an instruction can be generated and transmitted from the portable electronic device 300 to the crosswalk control system (e.g., the operable object), which operates in accordance with the instruction.

[0063] Figure 3C A portable electronic device 300 is shown that includes a display 302 disposed within a housing 304. As Figure 3C shown, in some examples, the user input area 306 and the user interface 308 can occupy only a portion of the display 302, and in some examples, a small portion of the display 302, to limit the amount of the display 302 obscured by the user interface 308. For example, when the portable electronic device 300 detects an operable object in the vicinity of the portable electronic device 300, the user interface 308 can be generated at the top corner of the display 302 (as Figure 3C shown). Although the input elements 310A - 310D receive touch input or near-touch input, the portable electronic device 300 can additionally or alternatively receive input via voice input, gesture recognition, or other forms of inputting information into the portable electronic device 300.

[0064] Any number or type of components in any configuration described herein may be included in a portable electronic device as described herein. The components may include any combination of the features described herein and may be arranged in any of the various configurations described herein. The structure and arrangement of the device components and the concepts regarding their use may be applied not only to the specific examples discussed herein but also to any number of examples in any combination. An example of supplementing an input component of an operable object such as a crosswalk system (i.e., a pedestrian crossing system) with a portable electronic device is described below with reference to Figures 4A - 4C Description.

[0065] Figure 4A FIG. shows an example environment in which a portable electronic device 400 may be utilized to supplement the control of an operable object (e.g., a crosswalk system interface 402) to allow a user 404 to utilize the operable object without physically touching the operable object. The electronic device 400 may be substantially similar to the portable electronic devices 100, 200, 300 and may include some or all of the features of the portable electronic devices. For example, the portable electronic device 400 may include a display, a processor, one or more sensors, and a wireless communication module as previously described herein. The crosswalk system interface 402 may be substantially similar to the operable objects 102, 202 and may include some or all of the features of the operable objects. For example, the crosswalk system interface 402 may include an input component 406 and a communication module as previously described. In some examples, the input component 406 may receive physical input (touch, force, etc.) such that the input component 406 may be an analog or physical input component. For example, an analog input component or a physical input component may include any physically actuated input mechanism including, but not in any way limited to, physical buttons, touchscreen buttons, keyboards, switching devices, switches, levers, knobs, dials, sliders, and / or pedals. Additionally, the portable electronic device 400 may include one or more haptic motors, speakers, and coordinating electronics to further enhance the user experience in the analog physical input component. For example, if the physical input component 406 is a button represented and displayed on the portable electronic device 400, when actuated on the electronic device, the electronic device may simulate the pressing and actuation of the physical input component 406 with an associated sound and / or haptic response.

[0066] When user 404 approaches the input component 406, the portable electronic device 400 can detect the presence of the crosswalk system interface 402 and generate a user input area on the portable electronic device 400. In some examples, a communication link can be established between the portable electronic device 400 and the crosswalk system interface 402. For example, a communication link can be established between the wireless communication module of the portable electronic device 400 and the communication module of the crosswalk system interface 402. Information regarding the crosswalk system interface 402 can be supplied by the crosswalk system interface 402 and downloaded to the portable electronic device 400 via the communication link, for example when the portable electronic device 400 detects the presence of the crosswalk system interface 402.

[0067] In some examples, the downloaded information can relate to the configuration or layout of the user interface, and one or more input elements generated on the display of the portable electronic device 400. More specifically, the user input area can form a user interface including the one or more input elements. The size, shape, appearance, position, or other characteristics of each of the input elements can be determined by the downloaded information. In other words, the characteristics of the input elements of the user input area are related to the information. The user interface and the one or more input elements can supplement the function of the input component 406 of the crosswalk system interface 402. The portable electronic device 400 can receive input at the user input area, such as by user 404 touching an input element of the user interface. After receiving the input at the user input area, the portable electronic device 400 can transmit a signal that is received by the crosswalk system interface 402, indicating that the crosswalk system interface perform an action at least in part based on the input at the user input area. For example, the crosswalk system interface 402 can receive the signal and thereby implement a crossing procedure (i.e., activate a countdown timer for user 404 to cross the street) at least in part based on the signal received from the portable electronic device 400.

[0068] In some examples, one or more of the input elements can resemble the input component 406 to enable user 404 to associate the user interface with the crosswalk system interface 402. This will be discussed in more detail below with reference to Figure 4B the user input area, the user interface, and the one or more input elements.

[0069] Figure 4BFIG. 400 shows a portable electronic device 400 that includes a display 408 disposed within a housing 410. The display 408 can be substantially similar to the displays 104, 204, 302 and can include some or all of the features of the displays 104, 204, 302. For example, the display 408 can be an LED display, an OLED display, an LCD display, or any other form of display now known in the art or that may be developed in the future. In some examples, the display 408 can be a touchscreen display or can have touch detection capabilities such as capacitive touch, force touch, and proximity touch capabilities. For example, the display 408 can define a user input area 412 that can receive input from a user of the portable electronic device 400. The display 408 can include one or more layers (e.g., a capacitive touch layer) and / or components that are disposed within an interior volume defined by the housing 410 of the portable electronic device 400. The one or more layers and / or components can detect user input at or near the user input area 412.

[0070] As Figure 4B shown, the user input area 412 can include a user interface 414 having an input element 416. The user interface 414 and / or the input element 416 can be substantially similar to the input component 406 and / or the crosswalk system interface 402. For example, a symbol 418 can be depicted on the display 408 that is substantially similar to the symbol 420 on the crosswalk system interface 402. The input element 416 of the user interface 414 can form a virtual button that can receive touch input from a user of the portable electronic device 400. When actuated (e.g., touched by a user), the input element 416 can cause the portable electronic device 400 to transmit a signal instructing the crosswalk system interface 402 to implement a crossing sequence (i.e., to stop traffic by changing traffic signals and initiating a countdown sequence for pedestrian crossing).

[0071] The input element 416 can supplement the input component 406 to enable the user 404 to utilize the crosswalk system interface 402 without having to physically touch the input component 406, which may be touched by thousands of users each day. In other words, the user 404 can interact with the portable electronic device 400 to actuate the crosswalk system interface 402 rather than having to touch the potentially dirty or hazardous surface of the input component 406. By supplementing the input component 406 with the portable electronic device 400, the user 404 is less likely to come into contact with and spread dangerous pathogens such as viruses, bacteria, and other potentially dangerous microorganisms.

[0072] Figure 4CAnother example of a user input area 412 is shown that includes a user interface 414 having a plurality of input elements 416A, 416B, 416C. In some examples, one or more of the plurality of input elements 416A, 416B, 416C may provide additional functionality beyond that of the input component 406. For example, one or more of the input elements 416A, 416B, 416C may change the duration given to the user 404 to cross a street, contact emergency personnel, report a malfunction, or any other function beyond actuating the input component 406. Input element 416A may be substantially similar to input element 310A and may include a sub-display 422 and switching arrows 424A, 424B. The sub-display 422 may display content, such as content related to the crosswalk system interface 402. For example, the sub-display 422 may depict a numerical countdown sequence related to the amount of time the user 404 has to cross the street. The switching arrows 424A, 424B may be used to manipulate or change the numerical value depicted on the sub-display 422. For example, the user may actuate switching arrow 424A to increase the numerical value depicted on the sub-display 422 and thereby increase the amount of time the user 404 has to cross the street. Alternatively, switching arrow 424B may decrease the numerical value depicted on the sub-display 422. Input element 416B may be similar to a button that can receive a touch input from a user of the portable electronic device 400.

[0073] Input element 416C may receive a touch input that causes the portable electronic device 400 to contact emergency responders or send a notification to emergency responders, such as firefighters, emergency medical technicians (EMTs), police, etc. For example, the user 404 may touch input element 416C due to a motor vehicle collision or pedestrian injury. Although Figure 4C the user interface 414 depicted herein shows only a few example input elements, those of ordinary skill in the art will readily understand that other types of input elements having one or more functions may be presented on the user interface 414. For example, the user interface may include an input element that notifies a public utility department that a traffic signal or other component of the crosswalk system has malfunctioned or is inoperable.

[0074] In some examples, the portable electronic device 400 may generate a status indicator or other warning to inform the user 404 of the status of an operable object. For example, a status indicator may be generated on the display 408 and depict a countdown clock. The status indicator may represent the action of the operable object in response to an operation instruction transmitted from the portable electronic device 400 to the operable object. In addition or alternatively, the portable electronic device 400 may include an audio component that generates a sound warning related to the action of the operable object. For example, the audio component may generate a sound warning that alerts the user 404 that there are less than 10 seconds left to cross the street.

[0075] Any number or type of components in any configuration described herein may be included in a portable electronic device as described herein. The components may include any combination of the features described herein and may be arranged in any of the various configurations described herein. The structure and arrangement of the device components and the concepts regarding their use may be applied not only to the specific examples discussed herein, but also to any number of examples in any combination. Reference is made below to Figures 5 - 8 Describe various examples of using a portable electronic device to supplement input components of an operable object.

[0076] Figure 5 An example environment is shown in which a portable electronic device 500 is used to supplement the control of an operable object (e.g., an ATM 502) to allow a user 504 to utilize the operable object without physically touching the operable object. Enabling the user 504 to interact with the ATM 502 via the portable electronic device 500 can be beneficial in eliminating the possibility of card theft and other forms of theft associated with physically inserting a credit or debit card into the ATM 502. Additionally, by supplementing the input component 506 with the portable electronic device 500, the user 504 is less likely to come into contact with and potentially spread dangerous pathogens such as viruses, bacteria, and other potentially hazardous microorganisms left on the input component 506 of the ATM 502.

[0077] The portable electronic device 500 may be substantially similar to the portable electronic devices 100, 200, 300, 400 and may include some or all of the features of the portable electronic devices. For example, the portable electronic device 500 may include a display, a processor, one or more sensors, and a wireless communication module as previously described herein. The ATM 502 may be substantially similar to the operable objects 102, 202 and may include some or all of the features of the operable objects. For example, the ATM 502 may include one or more input components 506 and a communication module as previously described herein.

[0078] When the user 504 approaches the input component 506, the portable electronic device 500 may detect the presence of the ATM 502 and may generate a user input area on the portable electronic device 500. In some examples, a communication link may be established between the portable electronic device 500 and the ATM 502. For example, a communication link may be established between the wireless communication module of the portable electronic device 500 and the communication module of the ATM 502. Information regarding the ATM 502 may be supplied by the ATM 502 and downloaded to the portable electronic device 500 via the communication link when the portable electronic device 500 detects the presence of the ATM 502. For example, the number and type of input elements depicted on the user interface of the input area may be at least partially based on the information transmitted from the ATM 502.

[0079] The user input area can receive input from user 504 to guide the tasks or actions performed by ATM 502. For example, user 504 can enter a personal identification number, account number, or other criteria at the user input area to gain access to ATM 502. In some examples, the user input area can depict a user interface with default information, such as the amount of currency withdrawn by user 504 during a previous transaction. Portable electronic device 500 can generate operation instructions based at least in part on the user input at the user input area and transmit them to ATM 502. The operation instructions can cause ATM 502 to perform tasks or actions, such as withdrawing a desired amount of currency or viewing an account balance. In some examples, the operation instructions can include a signal identifying portable electronic device 500 and thereby allow the user to access secure information and withdraw currency from ATM 502.

[0080] Figure 6 An example environment is shown where portable electronic device 600 is used to supplement the control of an operable object (e.g., elevator control system 602) to allow user 604 to utilize the operable object without physically touching the input component 606 (e.g., call button) of the operable object. Enabling user 604 to interact with elevator control system 602 via portable electronic device 600 can be beneficial because by supplementing input component 606 with portable electronic device 600, user 604 is less likely to come into contact with and potentially spread dangerous pathogens such as viruses, bacteria, and other potentially dangerous microorganisms left on input component 606 of elevator control system 602.

[0081] Portable electronic device 600 can be substantially similar to portable electronic devices 100, 200, 300, 400, 500 and can include some or all of the features of the portable electronic devices. For example, portable electronic device 600 can include a display, a processor, one or more sensors, and a wireless communication module, as previously described herein. Elevator control system 602 can be substantially similar to operable objects 102, 202 and can include some or all of the features of the operable objects. For example, elevator control system 602 can include one or more input components 606 (e.g., call buttons and other buttons within elevator 608) and a communication module, as previously described herein.

[0082] When user 604 approaches input component 606, portable electronic device 600 may detect the presence of input component 606 and / or elevator control system 602, and may generate a user input area on portable electronic device 600. In some examples, a communication link may be established between portable electronic device 600 and elevator control system 602. For example, a communication link may be established between the wireless communication module of portable electronic device 600 and the communication module of elevator control system 602. Information regarding elevator control system 602 may be supplied by elevator control system 602 and downloaded to portable electronic device 600 via the communication link when portable electronic device 600 detects the presence of input component 606 and / or elevator control system 602. For example, the number and type of input elements depicted on the user interface of the input area may be at least partially based on information transmitted from elevator control system 602. In some examples, the user interface may resemble the control panel of elevator 608, having buttons associated with each floor; buttons for opening and closing the door; and buttons for calling emergency personnel.

[0083] The user input area may receive input from user 604 to direct tasks or actions traditionally performed by elevator control system 602. For example, user 604 may call elevator 608 or enter the desired floor on which user 604 wishes to exit elevator 608. In some examples, the user input area may depict a user interface with default or predicted information, such as the floor that user 604 most frequently selects (e.g., the floor on which user 604 resides). Portable electronic device 600 may generate and transmit an operation instruction to elevator control system 602 at least partially based on the user input at the user input area. The operation instruction may cause elevator control system 602 to perform a task or action, such as stopping at a specific floor or calling elevator 608 to a specific floor. In some examples, the operation instruction may include a signal identifying portable electronic device 600 and thereby allowing user 604 access to a secure floor (i.e., a floor accessible only by a selected group of individuals).

[0084] Figure 7 An example environment is shown in which portable electronic device 700 is used to supplement the control of an operable object (e.g., access control system 702) to allow user 704 to open protected door 708 without physically touching input component 706 (e.g., a touchpad, numeric keypad, RFID reader, or other input mechanism) of access control system 702. Enabling user 704 to interact with input component 706 via portable electronic device 700 can be beneficial because by supplementing input component 706 with portable electronic device 700, user 704 is less likely to come into contact with and potentially spread dangerous pathogens such as viruses, bacteria, and other potentially dangerous microorganisms left on input component 706 of access control system 702.

[0085] The portable electronic device 700 may be substantially similar to the portable electronic devices 100, 200, 300, 400, 500, 600, and may include some or all of the features of the portable electronic devices. For example, the portable electronic device 700 may include a display, a processor, one or more sensors, and a wireless communication module, as previously described herein. The access control system 702 may be substantially similar to the operable objects 102, 202, and may include some or all of the features of the operable objects. For example, the access control system 702 may include one or more input components 706 (e.g., a touchpad, a numeric keypad, an RFID reader, or other input mechanism) and a communication module, as previously described herein.

[0086] When the user 704 approaches the input component 706, the portable electronic device 700 may detect the presence of the input component 706 and / or the access control system 702, and it may generate a user input area on the portable electronic device 700. In some examples, a communication link may be established between the portable electronic device 700 and the access control system 702. For example, a communication link may be established between the wireless communication module of the portable electronic device 700 and the communication module of the access control system 702. Information regarding the access control system 702 may be supplied by the access control system 702 and downloaded to the portable electronic device 700 via the communication link when the portable electronic device 700 detects the presence of the input component 706 and / or the access control system 702. For example, the number and type of input elements depicted on the user interface of the input area may be at least partially based on the information transmitted from the access control system 702.

[0087] The user input area can receive input from a user 704 to direct tasks or actions traditionally performed by an access control system 702. For example, the user 604 can obtain access to a protected door 708; restrict or modify the access rights of others; prevent the protected door from being opened or unlocked for a duration; etc. The portable electronic device 700 can generate operation instructions at least in part based on the user input at the user input area and transmit the operation instructions to the access control system 702. The operation instructions can cause the access control system 702 to perform tasks or actions, such as unlocking the protected door 708, to provide access to the user 704. In some examples, the operation instructions can include a signal identifying the portable electronic device 700. In addition or alternatively, the access control system 702 can require the user 704 to enter a password or passcode on the input area of the portable electronic device 700 to open or unlock the protected door 708. The access control system 702 can include or otherwise be communicatively coupled to a memory containing a database. The access control system 702 can compare the credentials provided by the user 704 (e.g., password, passcode, identity of the portable electronic device 700, other credentials, or a combination thereof) with the credentials stored on the database to determine whether to provide access to the user 704.

[0088] Figure 8 An example environment is shown in which a portable electronic device 800 is used to supplement the control of an operable object (e.g., a medical device 802, such as a ventilator, a monitoring device, or other medical device) to allow a medical professional 804 (e.g., a nurse, a doctor, or other medical professional) to utilize the operable object without physically touching the operable object. Enabling the medical professional 804 to interact with an input component 806 of the medical device 802 via the portable electronic device 800 can be beneficial because by supplementing the input component 806 with the portable electronic device 800, the medical professional 804 is less likely to come into contact with dangerous pathogens such as viruses, bacteria, and other potentially dangerous microorganisms that may be present on the input component 806 of the medical device 802 and potentially spread.

[0089] The portable electronic device 800 can be substantially similar to the portable electronic devices 100, 200, 300, 400, 500, 600, 700, and can include some or all of the features of the portable electronic devices. For example, the portable electronic device 800 can include a display, a processor, one or more sensors, and a wireless communication module, as previously described herein. The medical device 802 can be substantially similar to the operable objects 102, 202, and can include some or all of the features of the operable objects. For example, the medical device 802 can include one or more input components 806 and a communication module, as previously described herein.

[0090] When a medical professional 804 approaches a medical device 802, the portable electronic device 800 can detect the presence of the medical device 802 and generate a user input area on the portable electronic device 800. In some examples, a communication link can be established between the portable electronic device 800 and the medical device 802. For example, a communication link can be established between the wireless communication module of the portable electronic device 800 and the communication module of the medical device 802. Information regarding the medical device 802 can be supplied by the medical device 802 and downloaded to the portable electronic device 800 via the communication link when the portable electronic device 800 detects the presence of the medical device 802. For example, the number and type of input elements depicted on the user interface of the input area can be at least partially based on the information transmitted from the medical device 802.

[0091] The user input area can receive input from the medical professional 804 to direct a task or action performed by the medical device 802. For example, if the medical device 802 is a ventilator, the medical professional 804 can input a desired operation mode of the ventilator, such as pressure support (PS), synchronized intermittent mandatory ventilation (SIMV), airway pressure release ventilation (APRV), or another operation mode. In an example, the user input area can depict a user interface with default information, such as the most frequently used operation mode. The portable electronic device 800 can generate and transmit an operation instruction to the medical device 802 at least partially based on the input of the medical professional at the user input area. The operation instruction can cause the medical device 802 to perform a task or action, such as changing the operation mode, entering a standby mode, changing the information depicted on the display screen of the medical device 802, or another task or action. In some examples, the operation instruction can include a signal identifying the portable electronic device 800 and thereby allow the medical professional 804 to obtain access to modify or change aspects of the operation of the medical device 802.

[0092] Any number or variety of components in any configuration described herein can be included in the portable electronic device as described herein. The components can include any combination of the features described herein and can be arranged in any configuration of the various configurations described herein. The structure and arrangement of the device components and the concepts regarding their use can be applied not only to the specific examples discussed herein, but also in any combination to any number of examples. The following refers to Figure 9 An example flowchart depicting a method for supplementing the input components of an operable device using a portable electronic device.

[0093] Figure 9A flowchart of a method 900 for supplementing an input component of an operable device is shown. The method 900 may include detecting an operable device 902, receiving information at least partially based on the detected operable device 904, generating a user interface on an electronic device based on the received information 906, receiving input from a user at the user interface 908, and transmitting a signal including instructions 910, the instructions causing the operable device to perform an action associated with the input when received by the operable device. The terms “operable object” and “operable device” may be used interchangeably herein, and thus, the operable device may be substantially similar to other operable objects disclosed herein (e.g., operable objects 102, 202, 402, 502, 602, 702, 802) and may include some or all of the features of the operable objects.

[0094] As described above, the method 900 may include detecting an action of the operable device 902. The operable device may be detected, for example, by a portable electronic device. In some examples, the portable electronic device may include one or more sensors that detect the presence of the operable device using computer vision or image recognition techniques. The one or more sensors may be one or more cameras that capture static or real-time images of the operable device to detect the operable device. For example, a user of the portable electronic device may position a portion of the operable device within the range of the camera lens to detect the operable device.

[0095] In some examples, the one or more sensors may detect the presence of the operable device when the portable electronic device is near or in the vicinity of the operable device by detecting a signal transmitted from the operable device. The signal transmitted from the operable device may be a radio wave having a frequency and magnitude that conforms to a wireless communication protocol, such as ultra-wideband (UWB), Bluetooth, Wi-Fi, near-field communication (NFC), or another wireless communication protocol. Alternatively or in addition, the portable electronic device may include wireless communication components that receive the signal transmitted by the operable device to detect the presence of the operable device. According to one example, the portable electronic device may incorporate a directional wireless communication protocol that allows for directional sensing of the signal, such as using the UWB wireless communication protocol. According to this example, the user may direct the electronic device towards the operable device, and if the operable device is transmitting an appropriate signal, a communication handshake or connection may occur. This directional detection may eliminate random, continuous, multiple, or accidental detections of the operable device. Additionally, the directional detection of the operable device may provide the user with control over which operable device is communicating in an environment where multiple operable devices may be present, such as at a busy intersection or in a multi-lift garage. In addition or alternatively, the detection of the presence of the operable device may be limited to the case where a dedicated application is open and / or running on the portable electronic device.

[0096] Method 900 may also include an action 904 of receiving information at least partially based on detecting an operable device. The information may relate at least partially to the function, visual appearance, operability, location, and / or other aspects of the operable device. For example, the information may include data related to the appearance and layout of an input component of the operable device (e.g., an elevator call button that summons an elevator to a specific floor) that can receive at least one input to cause the operable device to perform an action or task. In some examples, the information may include data related to the operability status of the operable device, such as whether the device is currently inoperable due to a fault or scheduled maintenance. The information may be transmitted from the operable device itself and / or from another source (e.g., a server at a data center located at a position separate from the operable device).

[0097] Method 900 may also include an action 906 of generating a user interface on an electrical device based on the received information. The electrical device may be substantially similar to the portable electronic devices described herein (e.g., portable electronic devices 100, 200, 300, 400, 500, 600, 700, 800) and may include some or all of the features of the portable electronic devices. The user interface may be substantially similar to the user interfaces disclosed herein (e.g., user interfaces 308, 414) and may include some or all of the features of the user interfaces. For example, the user interface may include one or more input elements for receiving input from a user of the electrical device. The input elements may include one or more buttons, switches, toggle devices, levers, knobs, touchscreens, other input components, or combinations thereof. In some examples, the user interface may be similar to the interface of the operable device (e.g., an elevator control panel, a pedestrian crossing system button, etc.).

[0098] Method 900 may include an action 908 of receiving input from a user at the user interface. The user interface may be depicted on a display of the electrical device, and the display may include any technique now known or otherwise developed for receiving input from a user at the user interface. For example, the display may include one or more layers capable of receiving touch input, swipe touch input, proximity touch input, another type of input, or combinations thereof. Additionally or alternatively, the electrical device may include an audio component (e.g., a microphone) such that voice input can be received by the electrical device. In some examples, the electrical device may include one or more cameras such that gesture input can be received by the electrical device.

[0099] Method 900 may also include an action 910 of transmitting a signal including instructions that, when received by an operable device, cause the operable device to perform an action associated with the input. The signal may be transmitted by an electrical device, for example, by a wireless communication module disposed within the electrical device. The wireless communication module may wirelessly transmit and / or receive data relative to the operable device. For example, the wireless communication module may include one or more wireless antenna systems such as WIFI, Bluetooth, UWB, cellular, LTE, 5G, GPS, or any other form of wireless antenna system. These systems may facilitate wireless communication with other devices (e.g., the operable device). Each of the one or more wireless antenna systems may transmit and / or receive wireless signals at one or more frequencies.

[0100] The signal may be received by a communication module within the operable device. The communication module may include one or more antennas and a controller that enable wireless communication between the operable device and another device (e.g., the electrical device). In other words, the communication module may transmit and / or receive signals (e.g., radio waves) from the device. Thus, the communication module may include one or more wireless antenna systems such as WIFI, Bluetooth, UWB, cellular, LTE, 5G, GPS, or any other form of wireless antenna system. For example, the communication module may receive or detect a signal transmitted by the electrical device indicating that the operable device perform an action or task associated with the input. The action or task may be at least partially associated with an input from a user at a user interface. For example, the action may be at least partially associated with at least one of a parameter, password, numerical value, duration, operation mode, setting, or a combination thereof input by the user into the user interface.

[0101] As used herein and in the appended claims, the phrase “at least one of A, B, or C” (where A, B, C may be independent elements, conditions, events, or other objects) is satisfied by any of the following cases: A exists or occurs and B and C do not exist or occur; B exists or occurs and A and C do not exist or occur; C exists or occurs and A and C do not exist or occur; A and B exist or occur and C does not exist or occur; A and C exist or occur and B does not exist or occur; B and C exist or occur and A does not exist or occur; or A, B, and C exist or occur.

[0102] To the extent applicable to the present technology, data collected and used from various sources may be used to improve the delivery to the user of heuristic content or any other content that the user may be interested in. The present disclosure contemplates that, in some instances, such collected data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, ID, home address, data or records related to the user's health or health level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identifying or personal information.

[0103] The present disclosure recognizes that the use of such personal information data in the technology of the present invention can be used to benefit the user. For example, the personal information data can be used to deliver target content that the user is more interested in. Thus, the use of such personal information data enables the user to have planned control over the delivered content. In addition, the present disclosure also anticipates other uses of personal information data that are beneficial to the user. For example, health and fitness data can be used to provide insights into the user's overall health condition, or can be used as positive feedback for individuals who use technology to pursue health goals.

[0104] The present disclosure contemplates that entities responsible for collecting, analyzing, disclosing, transmitting, storing, or otherwise using such personal information data will comply with established privacy policies and / or privacy practices. Specifically, such entities should implement and adhere to privacy policies and practices that are recognized as meeting or exceeding industry or government requirements for maintaining the privacy and security of personal information data. Such policies should be readily accessible to users and should be updated as the data collection and / or use changes. Personal information from users should be collected for legitimate and reasonable uses of the entity and should not be shared or sold outside of these legitimate uses. In addition, such collection / sharing should be done after receiving informed consent from the user. Further, such entities should consider taking any necessary steps to safeguard and secure access to such personal information data and to ensure that others with access to personal information data comply with their privacy policies and procedures. Additionally, such an entity can subject itself to third-party assessments to demonstrate its compliance with widely accepted privacy policies and practices. Moreover, policies and practices should be adjusted to account for the specific types of personal information data being collected and / or accessed and to apply applicable laws and standards that include specific considerations of the jurisdiction. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to other regulations and policies and should be handled accordingly. Thus, different privacy practices should be maintained for different types of personal data in each country.

[0105] Notwithstanding the foregoing, the present disclosure also contemplates examples where users selectively block the use or access of personal information data. That is, the present disclosure anticipates that hardware elements and / or software elements may be provided to prevent or block access to such personal information data. For example, with respect to an advertising delivery service, the inventive technology may be configured to allow a user to select "opt-in" or "opt-out" of participating in the collection of personal information data during or at any time after registering for the service. In another example, a user may choose not to provide emotion-related data for a targeted content delivery service. In yet another example, a user may select to limit the length of time that emotion-related data is retained, or may completely prohibit the development of underlying emotion states. In addition to providing "opt-in" and "opt-out" options, the present disclosure contemplates providing notifications relating to access or use of personal information. For example, a user may be notified upon download of an application that their personal information data will be accessed, and then reminded again just prior to the personal information data being accessed by the application.

[0106] Moreover, it is an object of the present disclosure that personal information data should be managed and processed to minimize the risk of inadvertent or unauthorized access or use. The risk can be minimized by restricting data collection and deleting data once it is no longer needed. Additionally, and when applicable, including in certain health-related applications, data de-identification can be used to protect the privacy of users. De-identification can be facilitated, when appropriate, by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of the data stored (e.g., collecting location data at the city level rather than at the address level), controlling how the data is stored (e.g., aggregating data across users), and / or other methods.

[0107] Thus, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed examples, the present disclosure also contemplates that various examples may also be implemented without access to such personal information data. That is, various examples of the inventive technology will not fail to operate due to the lack of all or a portion of such personal information data. For example, preferences may be inferred based on non-personal information data or an absolute minimum amount of personal information such as the content requested by a device associated with the user, other non-personal information available to the content delivery service, or publicly available information, and content may be selected and delivered to the user accordingly.

[0108] For purposes of illustration, the foregoing description uses specific names to provide a thorough understanding of the described examples. However, it will be apparent to those skilled in the art that the described examples may be practiced without specific details. Accordingly, for purposes of illustration and description, the foregoing description of specific examples herein is presented. These descriptions are not intended to be exhaustive or to limit these examples to the precise forms disclosed. It will be apparent to those of ordinary skill in the art that many modifications and variations are possible in light of the above teachings.

Claims

1. A portable electronic device, comprising: a display; a sensor for detecting the presence of an operable object near the portable electronic device; a processor for causing the display to depict an interface corresponding to the operable object at least partially based on the detection of the presence of the operable object, the interface including an input element that provides a function beyond the function available through the input element of the operable object, the input element including a greater number of inputs than the input element of the operable object; and a wireless communication module for transmitting a signal instructing the operable object to perform an action at least partially based on an input to the interface, the action including controlling a function beyond the function available through the input element of the operable object for the operable object.

2. The portable electronic device according to claim 1, wherein: the portable electronic device includes a head-mounted device, a smart phone, a smart watch or a tablet computing device; the operable object is publicly available and includes a physical input component; the interface corresponds to the physical input component; and the sensor detects the presence of the operable object at least partially based on receiving radio waves transmitted by the operable object.

3. The portable electronic device according to claim 2, wherein: the physical input component includes a button; the interface visually resembles the button, and the input includes a touch input; and the signal notifies the operable object of the user's presence at the operable object.

4. The portable electronic device according to claim 1, wherein: the signal includes a first signal; and the portable electronic device downloads information based on at least one of the sensor detecting the presence of the operable object or the wireless communication module receiving a second signal from the operable object.

5. The portable electronic device according to claim 4, wherein the characteristics of the input element of the interface are related to the information.

6. The portable electronic device according to claim 1, wherein: the signal includes a first signal; the wireless communication module is configured to receive a second signal from the operable object; and the processor performs an action at least partially based on the second signal.

7. The portable electronic device according to claim 1, wherein causing the display to depict an interface corresponding to the operable object includes causing the display to depict the interface on a portion of the display.

8. An operable device, comprising: a controller; an operable component; an analog input component coupled to the controller; and a communication module configured to: transmit a first input corresponding to the analog input to be displayed by the portable electronic device; transmit a second input to be displayed by the portable electronic device, the second input having a different number of input elements from the input available at the operable device; and Receiving a signal from the portable electronic device, the signal including an instruction, the controller causing the operable component to perform an action at least partially based on the instruction, the action including control of additional aspects of the operable object that are beyond the functions available via the analog input component of the operable device.

9. The operable device according to claim 8, wherein: the communication module is configured to transmit identification information to the portable electronic device; the identification information includes a unique operable device identifier; the signal further includes a unique user identification; and the action includes a transaction.

10. The operable device according to claim 8, further comprising a touch screen input component.

11. The operable device according to claim 8, wherein the analog input component includes at least one of a button, a switch, a toggle device, a lever, or a knob.

12. The device according to claim 8, wherein the communication module is further configured to transmit information related to at least one of the size, appearance, or position of an input element of a user interface to be depicted by the portable electronic device.

13. The device according to claim 9, wherein the identification information includes at least one of information related to the type of the operable device or the position of the operable device.

14. The device according to claim 8, wherein the communication module includes at least one of an Ultra-Wideband (UWB) module, a Bluetooth module, a Wi-Fi module, or a Near Field Communication (NFC) module.

15. The device according to claim 9, wherein the communication module continuously transmits the identification information.

16. The device according to claim 8, wherein the portable electronic device includes a head-mounted device, a smartwatch, a smartphone, or a tablet computing device.

17. A method, comprising: detecting an operable device; receiving information at least partially based on detecting the operable device; generating, on the electronic device, the user interface based on at least one of the received information, the number, size, shape, or configuration of input elements of a user interface controlled by a user of the electronic device, the user interface including a greater number of input elements than the input components of the operable device; receiving an input from the user at the user interface; and transmitting a signal including an instruction for the operable device to perform an action associated with the input, the action including control of additional functions beyond the functions available via the input component of the operable device.

18. The method according to claim 17, further comprising prompting the user to start receiving the information.

19. The method according to claim 17, wherein the operable device includes a publicly available physical machine.

20. The method according to claim 17, wherein the input includes touch input, voice input, gesture input, swipe touch input, or proximity touch input.

Images